Archive

Archive for the ‘Cloud’ Category

AWS re:Invent 2017: What’s New in Serverless – SRV305

December 1st, 2017 No comments

Tim Wagner the AWS Serverless GM and Jeet Kaul from FICO

This session was about new things in serverless.

Tim reiterated how mazing Lambda is coming, its even inside a camera which was announced in the keynote as well as the top memory size being doubled to 3Gb which also doubled the CPU power.

2017-11-30 15.18.52Magic!

There was a mini magic show which was apparently a nod to something they did last year.

The idea is to show disappearing servers, as there are more and more serverless offerings, this means more and more disappearing servers.

Serverless Application Repository.

It’s worth looking at the recently announces Serverless Application Repository, its a marketplace of serverless functions published by AWS and others.

Read more…

AWS re:Invent 2017: How AWS Runs Our Weekly Operations Meetings – ENT346

November 29th, 2017 No comments

2017-11-29 14.29.54David Lubell and Kevin Miller from AWS

I was really looking forward to this session, as this is the very first time AWS has opened the kimono on how it actually runs its own operations.

I was there two hours in advance to guarantee a place, they only had a room for 60!

David started off by mentioning that AWS has had a weekly operational meeting which has now been running for more than 10 years. It runs for 2 hours every week. This looks at the  performance of services with the idea of nipping issues in the bud as well as being forward looking by identifying new best practices.

David wanted to share some lessons learned from what he termed “the trenches” with one of the largest services in the world.

In every meeting, leaders for every AWS service together with more than 100 engineers deep dive into their operations. The reason for having so many people is to have immediate ownership of things and be able to more quickly respond across the whole organisation.

David went through ways they’ve developed to run an effective meeting which is so large. It’s not just about the tech they’re looking at but also how you can run a meeting to look at this effectively, how can you feed back the metrics you can see to stop issues recurring. AWS understandably has a very high bar for operational performance.

In the meeting, they go through and share successes, look at organisation projects, review operational events, do service metrics reviews and other updates and announcements. It’s not just about metrics but is an ops information sharing forum which sends the right message that operations really matters. It helps to gather a community and tech best practices with an accountable audit mechanism. They try to avoid spending too much time on things specific to each team.

Each team has a standard set of metrics (responsiveness etc.) and also metrics for what’s special about the service. Customer service always important so they measure how long it takes an EC2 instance to get fully up and running for example as well as how long the console displays the updates.

Read more…

Categories: AWS, Cloud, re:Invent Tags: , ,

AWS re:Invent 2017: Tuesday Night Live with Peter Desantis

November 29th, 2017 No comments

Tuesday Night Live Peter Desantis

2017-11-28 20.14.21 2017-11-28 19.40.26_thumb[2]

Peter is VP of AWS Global Infrastructure which he’s been doing for a year and a bit although he’s been at Amazon for 20 years. This slot has always traditionally been done by James Hamilton, AWS Distinguished Engineer & one of the super techies.

Talk on the street is that all the techie stuff they are likely to talk about in this session is actually the stuff AWS was using two years ago and now wants to talk about, they’re so far ahead that they keep some of their new cards close to their chest.

2017-11-28 19.11.17There was a cool warm up band.

Update on AWS Global Infrastructure

Write your app once and deploy to any region “going global has never been so easy”, said Peter.

He went through the history of the global expansion and how this is accelerating. They have announced plans to expand with 17 new Availability Zones in six new geographic Regions: Bahrain, China, France, Hong Kong, Sweden, and a second AWS GovCloud Region in the US.”

Just let that sink in, 11 regions in the first 10 years and 17 in two years, that;s massive scale.

He touted the AWS commitment for renewal energy. He continued drilling down into what regions look like with the make up of availability zones being separately powered and super redundently cabled together.

Machine Learning

Read more…

Categories: AWS, Cloud, re:Invent Tags: , ,

AWS re:Invent 2017: Scaling Up to Your First 10 Million Users – ARC201

November 28th, 2017 No comments

Benjamin Thurgood from AWS

Cloud is awesome, you can scale your web app or site on demand! But where do you start when you’re planning for bi g numbers of users. Making some design choices up front can dramatically simplify your life later.

Benjamin showed how best to link together different AWS services and using the capabilities of the AWS platform.

Autoscaling is only the beginning, there’s a lot more to look at.

Use Native Sevices

First step is to use the AWS Global Infrastructure with Edge locations. Take advantage of the global AWS platfom so you don’t have to reinvent the wheel.

Many native features available like Cloudfront, S3, DynamoDB, EFS etc.

EC2, EBS, RDS etc are scalable but you need to work a little harder.

Lightsail is an easy way to get started as a developer.

You can scale up but you’ll reach an end some time.

Read more…

Categories: AWS, Cloud, re:Invent Tags: , , , ,

AWS re:Invent 2017: Build a Multi-Region Serverless Application for Resilience and High Availability Workshop

November 28th, 2017 No comments

Steven Challis & Derek Felska from AWS were the workshop leaders and it was very hands on, basically up to you and anyone else you wanted to team up with.

2017-11-27 12.58.36 2017-11-27 12.58.45

This is one of the reasons to actually attend a conference, you get to do things in person and interact with other people rather than watching a recorded session or just follow a step by step plan when you can’t confer.

Intro

Availability and fast performance is key to user experience. Building a global application from the start is traditionally extremely difficult. Think before serverless how you would have to manage a global fleet of EC2 instances, load balancers, databases and storage. You would need to be a DNS guru and keeping your compute generic yet regionalised was super tough. Enter serverless and the promise was there but Lambda needed a whole lot of hacking to get functions to fire based on geographical access.

2017-11-27 13.15.14 2017-11-27 13.05.29

In the workshop we set up a fictional company called www.wildrydes.com (would you use a ride sharing company called this!). This wasn’t just a normal rider sharing company though, the drivers were unicorns! They needed a customer support application which customers can use to report any issues, be it lost property or a grumpy unicorn! As the service was global and needed to be built, serverless was touted as the ideal platform to use as much as possible (of course, it’s re:Invent!). We needed to lash together Lambda, API Gateway, DynamoDB, Route 53, CloudFront and S3 for better availability. Cognito Federated Identities was also used for user authentication.

The workshop was also to highlight the new “API Gateway regional endpoints” feature which was recently released.

There’s no reason to feel left out though, you can go through it all at: https://github.com/awslabs/aws-serverless-workshops/

Read more…

AWS re:Invent 2017: Security Anti-Patterns: Mistakes to Avoid – FSV301

November 27th, 2017 No comments

FSV301 – Security Anti-Patterns: Mistakes to Avoid

Kurt Gray from AWS and Jonathan Baulch from Fidelity Investments

AWS has obviously spent a huge amount of effort building security into the very fabric of its cloud offerings. Enterprises still hesitant to use public cloud as they’re concerned about the security implications of AWS in my opinion are thinking old school. They are often taking the processes and procedures that they currently use on-prem and applying it to AWS rather than looking at all the new possibilities which are often more secure than they can do themselves.

AWS famously has touted the security split of “security OF the cloud” which is AWSs job and “security IN the cloud” which is the customer’s responsibility, however AWS has a huge number of tools to help with the IN part.

Kurt and Jonathan went through some of their learning about best practices and pitfalls. There are a number of governance patterns to avoid even though they may seem logical at first but may limit scale and throttle getting stuff done. This is all bundled under the banner of DevSecOps on a massive scale.

Read more…

Categories: AWS, Cloud, re:Invent Tags: , ,

AWS re:Invent 2017: The Show Preview

November 27th, 2017 No comments

image_thumb5

Scaling Up and Out

re:Invent has turned into a vast conference, dwarfing many other IT get togethers, 50,000 people expected with an unmanageable schedule spread across 5 hotels. Even if you can walk quickly, its at least 30-45 minutes walk between quite a few of the venues.

This is the first time I’m attending re:Invent so the rush of excitement of a new event is invigorating for me.

I’d love to meet up with anyone who is here so please get in touch via @julian wood

AWS seems an unstoppable machine and that’s not in any way to say it should be stopped. Its rare a single company rises so spectacularly to create a major new part of an already established industry. 10 years ago this new thing called EC2 was a curiosity, now its old hat as services like Lambda become the new compute engine.

Why I’m here

I’m coming to AWS self funded so don’t have a company/vendor agenda I need to follow, I can truly see what interests me! My plan is to first of all see what’s new. This isn’t just about announcements although those are important but more how AWS develops into a service provider specifically for enterprises. Cloud is a new way of doings things yet enterprises have been doing things in a particular way for a long time, sometimes for good reasons and sometimes it is plain old toxic heritage IT!

I’m also investigating how enterprises change themselves to do cloud properly, taking advantage of the flexibility and scalability of public cloud and also how AWS updates itself to service enterprises better. This is a complicated dance which needs a lot of back and forth fancy foot work from both sides. I’m expecting more enterprise features, plenty of compliance, governance and security as a service. The recently announcement of PrivateLink as a new way to connect your VPCs to AWS services with more control is a nod to enterprises that’s don’t want all their stuff near the internet by default. AWS is working hard to ensure enterprises can take advantage of all the clever cloud stuff they have to offer.

Secondly I’m watching the serverless space very keenly and expecting a huge focus on Lambda. I’m not being hyperbolic by stating the serverless/FaaS pattern is the future of compute. A new cloud operating model where all infrastructure is abstracted, business processes as pure code without restrictions on scale, billed per invocation giving you financial super-powers.

What could be coming?

AWS releases new features and major updates to existing ones in an unprecedented manor. Just last week, more than 30 announcements were made and that’s before re:Invent and the big picture announcements likely reserved for the show. Make sure you subscribe to the excellent Last Week in AWS mailing list by Corey Quinn

At this stage its a guessing game as to what they might be, but certainly more IoT, ML, AI and buckets of enticing delicious serverless. I’m expecting some Blockchain as a Service and likely Kubernetes as well.

Amazon is also a remarkable company in the way it is able to erm. reinvent itself. This isn’t just an AWS thing but AWS certainly helps all of the rest of Amazon be incredible agile, be able to continually experiment, use its own platform as a sensing engine, rely on real data to make decisions and cannibalise itself. Lambda has been built to cannibalise EC2.

Read more…

Serverless, Show Me the Servers! – A UK VMUG 2017 Presentation

November 16th, 2017 No comments

I was happy to be asked to present at the National UK VMUG about Serverless. I had done the closing keynote last year so pretty relieved that I was at least invited back!

The presentation was similar to the London VMUG presentation I had done in July although updated as the Serverless ecosystem is moving at breakneck speed.

Changes of note since July are the addition of the new and momentum gathering OpenFaas framework, Azure Functions now available in the wild with Azure Stack, AWS adding more Lambda functionality particularly with its announcement that traffic shifting is coming soon for canary releases and blue/green routing. Iron.io bought by Oracle and VMware shutting down Photon Platform and shifting direction to Pivotal Container Service (PKS) and vSphere Integrated Containers (VIC).

AWS Re:Invent is in less that 2 week’s time so I’m sure there will be plenty more to talk about!

Here are the slides:

Presentation Summary:

I went though some of the public cloud examples like Amazon Lambda, Azure Functions and Google Cloud Functions. There are also Kubernetes based options you can deploy yourself like Fission, Kubeless and Funktion as well as cross container platforms such as Apache OpenWhisk, IronFunctions and the new and exciting OpenFaaS. I spent time going through what events are, why they are so critical to understanding serverless and gave some examples. How much it costs was covered, the differences between PaaS and containers. Listed the benefits and currently many disadvantages as its very new.

I also talked about how Ops is changing and doesn’t mean Ops goes away, just evolves. As it was a VMware user group I went through two connections to VMware, the kinds of things you could use serverless for to manage a VMware environment as well as the VMware cloud native story and using Pivotal Container Service the new Kubernetes based container runtime from VMware as your private serverless hosting platform.

Functional billing was highlighted as probably the most important future benefit for serverless, being able to track the cost of every single function call you make which can very easily highlight the inefficiencies you have and the benefit of being now able to have business costings matching up to IT costings.

Looking into the future there’s lots that needs to evolve but perhaps this is the time to decide whether you skip PaaS and containers for some things that have event triggers and go straight to serverless?

Joining the CloudInsiders Podcast to talk all about Serverless

November 15th, 2017 No comments

I was thrilled to be asked recently to join the CloudInsiders podcast to talk about Serverless. I was joined by Chan Ekanayake and we had a wide ranging discussion on what Serverless is, use cases, pros and cons and much more. It’s worth a listen if you’re trying to get your head around what its all about.

Thanks for having me.

Listen to the episode here: Serverless: Viva la revolución

The whole CloudInsiders podcast series is certainly worth subscribing to via iTunes or Stitcher.

Cloud Field Day 2 Preview: HPE Nimble Storage

July 21st, 2017 No comments

Cloud Field Day 2, part of the Tech Field Day family of events is happening in San Francisco and Silicon Valley, from 26-28 July and I’m super excited to be invited as a delegate.

We are hearing from a number of companies about how they cloud!

Nimble Storage is a storage company with lofty goals of “giving users the fastest, most reliable access to data – on-premise and in the cloud”. The premise is their wording, certainly not mine, really should be premises, Nimble!

Nimble has an interesting Tech Field Day history as it announced its original product, the CS200 hybrid array at Tech Field Day 3 in Seattle in 2010. Fast forward to March 2017 when Nimble was purchased by HPE for just over $1 Billion.

HPE Land

Read more…

Categories: CFD2, Cloud, Storage, Tech Field Day Tags: , , ,