Archive

Author Archive

AWS re:Invent 2017: The Day 4 Buzz

December 1st, 2017 No comments

image

Breakfast

I headed to the Venetian to watch the keynote remotely. Have to mention the breakfast at the Grand Luxe Cafe which was Churros French Toast!

I certainly wasn’t expecting this, it was excellent!

image

Werner Vogels Keynote

2017-11-30 08.55.23AWS CTO Werner Vogels wanted to use the keynote not for a slew of announcements but rather to revisit the original AWS keynote with “21st century architecture re:Imagined” and set out what the architecture should be for the next few years.

I’m not going to go through the whole keynote as this is covered elsewhere but some things that I found interesting.

Human Interfaces

He talked about the importance of data and the interfaces to it. They will become more human rather than machine like voice with Alexa. Voice unlocks digital systems for everyone.

Alexa for Business was announced which will allow you to join conference calls easily and know where you are and who you are to automatically join a call. I wonder how this will all work in open plan offices. Werner says we need to start thinking about voice as an interface with a conversation rather than just a webpage output to interact with back end systems.

He then talked about the three different “planes”, Admin, Control and Data. I like the addition of the Admin plan which I haven’t seen before.

  • He listed some architecture guidelines
  • Stop guessing capacity needs
  • Test systems in production
  • Automate to make architectural experimentation
  • Drive your architecture using data
  • Improve through Game Days

Read more…

Categories: AWS, re:Invent Tags: , ,

AWS re:Invent 2017: What’s New in Serverless – SRV305

December 1st, 2017 No comments

Tim Wagner the AWS Serverless GM and Jeet Kaul from FICO

This session was about new things in serverless.

Tim reiterated how mazing Lambda is coming, its even inside a camera which was announced in the keynote as well as the top memory size being doubled to 3Gb which also doubled the CPU power.

2017-11-30 15.18.52Magic!

There was a mini magic show which was apparently a nod to something they did last year.

The idea is to show disappearing servers, as there are more and more serverless offerings, this means more and more disappearing servers.

Serverless Application Repository.

It’s worth looking at the recently announces Serverless Application Repository, its a marketplace of serverless functions published by AWS and others.

Read more…

AWS re:Invent 2017: Become a Serverless Black Belt: Optimizing Your Serverless Applications – SRV401

December 1st, 2017 No comments

Ajay Nair from AWS and Peter Sbarski from A Cloud Guru

Another session on architectural best practices and a bunch of handy little things to help you out. It was advanced so no overviews required about “what is serverless”.

Multiple Points to Optimise

For normal optimisation with traditional application stacks you actually pack things together but for serverless you do the opposite, as its generally better and more scalable if things are spread out.

There are three components to look at, the interface via API Gateway or Alexa, the compute with Lambda and the data with S3, DynamoDB etc.

The main goal is to try and reduce latency which doesn’t just take time but also costs you more. The more functions you are stringing together the more latency issues will bug you.

The Lean Function

Anatomy of a function = the function + language runtime + functional container + compute substrate

When function invokes it:

  1. downloads your code
  2. starts new container
  3. bootstraps the runtime
  4. starts the code.

Everything before start code is cold start. AWS optimises stages 1 and 2 (and have had 80% improvement in latency for some scenarios) and your job is to optimise 3 and 4.

Try to make your logic as concise as possible:

  • efficient / single purpose code
  • avoid fat / monolithic functions
  • control the dependencies in the package
  • optimise for your language

You can also see the start times in X-Ray.

2017-11-30 13.52.26 2017-11-30 13.53.03

For Java avoid using the whole SDK aws-java-sdk directly, rather use the subcomponent aws-java-sdk-s3 or aws-java-sdk-dynamodb.

This reduces your dependency size

Ephemeral Environment

Read more…

Categories: AWS, re:Invent Tags: , , ,

AWS re:Invent 2017: The Day 3 Buzz

November 30th, 2017 No comments

2017-11-29 07.09.04

Andy Jassy’s Keynote

2017-11-29 08.00.51An early wake up to get to the keynote in time with the hordes. Common sense would say to rather watch the stream from the comfort of somewhere else but I wanted to get a sense of the vibe and how the inevitable kool-aid gushing felt “live” as it was delivered.

I’m not going to live blog the keynote, way too much for that and it will be covered extensively elsewhere particularly by Scott Lowe: AWS re:Invent 2017 Keynote with Andy Jassy

Andy Jassy had a fun way to go through some of the themes by having a house band on stage playing 5 songs The words were on the BIG screen and he used song lyrics to explain how AWS “thinks”.

There were SO many announcements at some stages I actually felt a little overwhelmed, not from the number of announcements but more for the implications of what we’re seeing.

Wake Up Enterprise and smell the Cloud

We are seeing an incredible amount of service building by AWS itself to create some pretty impressive capabilities. I’d go far enough to say that if you’re thinking of installing or running any sort of platform yourself be it infrastructure, platform, database, analytics, containers…just don’t bother.

Read more…

Categories: AWS, re:Invent Tags: , ,

AWS re:Invent 2017: How AWS Runs Our Weekly Operations Meetings – ENT346

November 29th, 2017 No comments

2017-11-29 14.29.54David Lubell and Kevin Miller from AWS

I was really looking forward to this session, as this is the very first time AWS has opened the kimono on how it actually runs its own operations.

I was there two hours in advance to guarantee a place, they only had a room for 60!

David started off by mentioning that AWS has had a weekly operational meeting which has now been running for more than 10 years. It runs for 2 hours every week. This looks at the  performance of services with the idea of nipping issues in the bud as well as being forward looking by identifying new best practices.

David wanted to share some lessons learned from what he termed “the trenches” with one of the largest services in the world.

In every meeting, leaders for every AWS service together with more than 100 engineers deep dive into their operations. The reason for having so many people is to have immediate ownership of things and be able to more quickly respond across the whole organisation.

David went through ways they’ve developed to run an effective meeting which is so large. It’s not just about the tech they’re looking at but also how you can run a meeting to look at this effectively, how can you feed back the metrics you can see to stop issues recurring. AWS understandably has a very high bar for operational performance.

In the meeting, they go through and share successes, look at organisation projects, review operational events, do service metrics reviews and other updates and announcements. It’s not just about metrics but is an ops information sharing forum which sends the right message that operations really matters. It helps to gather a community and tech best practices with an accountable audit mechanism. They try to avoid spending too much time on things specific to each team.

Each team has a standard set of metrics (responsiveness etc.) and also metrics for what’s special about the service. Customer service always important so they measure how long it takes an EC2 instance to get fully up and running for example as well as how long the console displays the updates.

Read more…

Categories: AWS, Cloud, re:Invent Tags: , ,

AWS re:Invent 2017: The Day 2 Buzz

November 29th, 2017 No comments

awsreinvent

 

The 4K Run

An early fresh start this morning to help with the jetlag and convince myself that I’m battling the conference calorie overload.

 

2017-11-28 06.01.22 2017-11-28 06.04.19

2017-11-28 06.36.12 2017-11-28 06.45.38

2017-11-28 06.55.25-1Re:Invent arranged a 6am 4Km run for charity raising money for Girls Who Code and the American Heart Association. I was amazed to read the Fun Run Series which has run since 2014 has raised $500,000 so far! Tragically the co-founder of the run, Sam Blackman, died unexpectedly very recently.

A South African won it in a ridiculously quick time of just over 12 minutes! It was a great run, everyone enjoyed it and is stretched the legs and cleared the cobwebs!

ARC304  —  From One to Many:  Evolving VPC Design

Androski Spicer & Rob Alexander from AWS

Read more…

Categories: AWS, re:Invent Tags: , ,

AWS re:Invent 2017: Tuesday Night Live with Peter Desantis

November 29th, 2017 No comments

Tuesday Night Live Peter Desantis

2017-11-28 20.14.21 2017-11-28 19.40.26_thumb[2]

Peter is VP of AWS Global Infrastructure which he’s been doing for a year and a bit although he’s been at Amazon for 20 years. This slot has always traditionally been done by James Hamilton, AWS Distinguished Engineer & one of the super techies.

Talk on the street is that all the techie stuff they are likely to talk about in this session is actually the stuff AWS was using two years ago and now wants to talk about, they’re so far ahead that they keep some of their new cards close to their chest.

2017-11-28 19.11.17There was a cool warm up band.

Update on AWS Global Infrastructure

Write your app once and deploy to any region “going global has never been so easy”, said Peter.

He went through the history of the global expansion and how this is accelerating. They have announced plans to expand with 17 new Availability Zones in six new geographic Regions: Bahrain, China, France, Hong Kong, Sweden, and a second AWS GovCloud Region in the US.”

Just let that sink in, 11 regions in the first 10 years and 17 in two years, that;s massive scale.

He touted the AWS commitment for renewal energy. He continued drilling down into what regions look like with the make up of availability zones being separately powered and super redundently cabled together.

Machine Learning

Read more…

Categories: AWS, Cloud, re:Invent Tags: , ,

AWS re:Invent 2017: Serverless Architectural Patterns and Best Practices – ARC401

November 28th, 2017 No comments

Another session on managing serverless and the new architectural patterns required to make it a success. The idea of to create reusable serverless patterns with an continual eye on reducing costs.

2017-11-28 13.28.01The venue was spectacular, in the Venetian Theatre which is magnificent. Shows the importance AWS is placing on serverless where most of the other sessions are in smaller rooms at the Aria.

Drew and Maitreya went through a number of patterns, giving operational and security best practices.

This was a fly by the seat of your pants session, so many AWS services were talked about, you needed an AWS dictionary to know what some are. If you are an infrastructure person who manages an OS, this was a very busy but insightful look at what is possible.

Serverless Foundations

For running your apps you can do it yourself with EC2 and even Docker, have managed services like EMR, ES, RDS etc. and then there’s services with no OS which is how they’re defining serverless, so that’s things like API Gateway, Kinesis Streams & Analytics, DynamoDB, S3, Step Functions, Config, X-Ray and Athena.

They reiterated the “never paying for idle” line and its all built for HA and DR.

You need to be aware of cold start, instantiate AWS client and database client outside the scope of the handler to take advantage of container re-use. Schedule with CloudWatch Events for pre-warming. ENUs for VPC support are attached during cold start

Lambda Best Practices

  • Minimise package size to necessities
  • Separate Lambda handler from core logic,
  • Use environment variables to modify operational behaviours.
  • Self-contain dependencies in your function package.
  • Leverage “Max Memory Used” to right size your functions.
  • Delete large unused functions
  • Use X-Ray integration for great insights.

Read more…

AWS re:Invent 2017: Scaling Up to Your First 10 Million Users – ARC201

November 28th, 2017 No comments

Benjamin Thurgood from AWS

Cloud is awesome, you can scale your web app or site on demand! But where do you start when you’re planning for bi g numbers of users. Making some design choices up front can dramatically simplify your life later.

Benjamin showed how best to link together different AWS services and using the capabilities of the AWS platform.

Autoscaling is only the beginning, there’s a lot more to look at.

Use Native Sevices

First step is to use the AWS Global Infrastructure with Edge locations. Take advantage of the global AWS platfom so you don’t have to reinvent the wheel.

Many native features available like Cloudfront, S3, DynamoDB, EFS etc.

EC2, EBS, RDS etc are scalable but you need to work a little harder.

Lightsail is an easy way to get started as a developer.

You can scale up but you’ll reach an end some time.

Read more…

Categories: AWS, Cloud, re:Invent Tags: , , , ,

AWS re:Invent 2017: The Day 1 Buzz

November 28th, 2017 2 comments

image

AWS Re:Invent kicked off in ernest today, 43,000 cloud makers and learners spread across 5 hotels, basically taking over Las Vegas. Its difficult to appreciate the size of the conference as you could be involved in part of the conference and be very separate from another area.

See my preview posts yesterday, AWS re:Invent 2017: The Show Preview as well as re:Invent 2017: The Day 0 Buzz for what I’m concentrating on.

This morning, the 1st proper day of the conference, I started off with a hot topic for all of IT at the moment, security. As I’m currently consulting in the financial sector, this session piqued my interest.

FSV301 – Security Anti-Patterns: Mistakes to Avoid

Kurt Gray from AWS and Jonathan Baulch from Fidelity Investments

This was a really great session with lots of useful tips. I wrote it up separately here:

AWS re:Invent 2017: Security Anti-Patterns: Mistakes to Avoid – FSV301

It’s a shame I had to leave a little early as I needed to head across Vegas because size of conference.

SRV213 – Thirty Serverless Architectures in 30 Minutes

Chris Munns from AWS

Unfortunately I was in the walk up line for this one and despite my dash across Vegas, they only let in 20 people so missed out on the session, a shame, I hope its posted afterwards.

Read more…

Categories: AWS, re:Invent Tags: , ,