Archive

Archive for the ‘AWS’ Category

AWS re:Invent 2017: Build a Multi-Region Serverless Application for Resilience and High Availability Workshop

November 28th, 2017 No comments

Steven Challis & Derek Felska from AWS were the workshop leaders and it was very hands on, basically up to you and anyone else you wanted to team up with.

2017-11-27 12.58.36 2017-11-27 12.58.45

This is one of the reasons to actually attend a conference, you get to do things in person and interact with other people rather than watching a recorded session or just follow a step by step plan when you can’t confer.

Intro

Availability and fast performance is key to user experience. Building a global application from the start is traditionally extremely difficult. Think before serverless how you would have to manage a global fleet of EC2 instances, load balancers, databases and storage. You would need to be a DNS guru and keeping your compute generic yet regionalised was super tough. Enter serverless and the promise was there but Lambda needed a whole lot of hacking to get functions to fire based on geographical access.

2017-11-27 13.15.14 2017-11-27 13.05.29

In the workshop we set up a fictional company called www.wildrydes.com (would you use a ride sharing company called this!). This wasn’t just a normal rider sharing company though, the drivers were unicorns! They needed a customer support application which customers can use to report any issues, be it lost property or a grumpy unicorn! As the service was global and needed to be built, serverless was touted as the ideal platform to use as much as possible (of course, it’s re:Invent!). We needed to lash together Lambda, API Gateway, DynamoDB, Route 53, CloudFront and S3 for better availability. Cognito Federated Identities was also used for user authentication.

The workshop was also to highlight the new “API Gateway regional endpoints” feature which was recently released.

There’s no reason to feel left out though, you can go through it all at: https://github.com/awslabs/aws-serverless-workshops/

Read more…

AWS re:Invent 2017: Security Anti-Patterns: Mistakes to Avoid – FSV301

November 27th, 2017 No comments

FSV301 – Security Anti-Patterns: Mistakes to Avoid

Kurt Gray from AWS and Jonathan Baulch from Fidelity Investments

AWS has obviously spent a huge amount of effort building security into the very fabric of its cloud offerings. Enterprises still hesitant to use public cloud as they’re concerned about the security implications of AWS in my opinion are thinking old school. They are often taking the processes and procedures that they currently use on-prem and applying it to AWS rather than looking at all the new possibilities which are often more secure than they can do themselves.

AWS famously has touted the security split of “security OF the cloud” which is AWSs job and “security IN the cloud” which is the customer’s responsibility, however AWS has a huge number of tools to help with the IN part.

Kurt and Jonathan went through some of their learning about best practices and pitfalls. There are a number of governance patterns to avoid even though they may seem logical at first but may limit scale and throttle getting stuff done. This is all bundled under the banner of DevSecOps on a massive scale.

Read more…

Categories: AWS, Cloud, re:Invent Tags: , ,

AWS re:Invent 2017: The Day 0 Buzz

November 27th, 2017 No comments

2017-11-26 20.09.49

I flew yesterday from London to Las Vegas and with it being Thanksgiving Weekend, the airport was rather quieter than expected which made for a pleasantly quick immigration experience. The streams of travellers inbound to one of the most important IT conferences of the year has given Vegas some more buzz today.

I wrote a comprehensive Preview Blog Post: AWS re:Invent 2017: The Show Preview with my reasons for why I’m here, what I hope to get out of it and some crystal ball gazing about what I expect we’ll see.

I buffeted up big time for breakfast this morning as I didn’t have much conference stuff on. Marvellous glutonny. Smile

2017-11-26 10.22.29 2017-11-26 09.07.11 2017-11-26 09.40.14

Registration

I then registered which was painless and had a DJ playing which was nice and lively.

2017-11-26 12.52.10 2017-11-26 12.52.02

Robocar Rally

2017-11-26 18.21.01This was an interesting “session”. The idea was getting behind a keyboard for a hackathon for getting your hands dirty with deep learning, IoT, AI and autonomous cars, sounds like a fun mix.

Read more…

Categories: AWS, re:Invent Tags: , ,

AWS re:Invent 2017: The Show Preview

November 27th, 2017 No comments

image_thumb5

Scaling Up and Out

re:Invent has turned into a vast conference, dwarfing many other IT get togethers, 50,000 people expected with an unmanageable schedule spread across 5 hotels. Even if you can walk quickly, its at least 30-45 minutes walk between quite a few of the venues.

This is the first time I’m attending re:Invent so the rush of excitement of a new event is invigorating for me.

I’d love to meet up with anyone who is here so please get in touch via @julian wood

AWS seems an unstoppable machine and that’s not in any way to say it should be stopped. Its rare a single company rises so spectacularly to create a major new part of an already established industry. 10 years ago this new thing called EC2 was a curiosity, now its old hat as services like Lambda become the new compute engine.

Why I’m here

I’m coming to AWS self funded so don’t have a company/vendor agenda I need to follow, I can truly see what interests me! My plan is to first of all see what’s new. This isn’t just about announcements although those are important but more how AWS develops into a service provider specifically for enterprises. Cloud is a new way of doings things yet enterprises have been doing things in a particular way for a long time, sometimes for good reasons and sometimes it is plain old toxic heritage IT!

I’m also investigating how enterprises change themselves to do cloud properly, taking advantage of the flexibility and scalability of public cloud and also how AWS updates itself to service enterprises better. This is a complicated dance which needs a lot of back and forth fancy foot work from both sides. I’m expecting more enterprise features, plenty of compliance, governance and security as a service. The recently announcement of PrivateLink as a new way to connect your VPCs to AWS services with more control is a nod to enterprises that’s don’t want all their stuff near the internet by default. AWS is working hard to ensure enterprises can take advantage of all the clever cloud stuff they have to offer.

Secondly I’m watching the serverless space very keenly and expecting a huge focus on Lambda. I’m not being hyperbolic by stating the serverless/FaaS pattern is the future of compute. A new cloud operating model where all infrastructure is abstracted, business processes as pure code without restrictions on scale, billed per invocation giving you financial super-powers.

What could be coming?

AWS releases new features and major updates to existing ones in an unprecedented manor. Just last week, more than 30 announcements were made and that’s before re:Invent and the big picture announcements likely reserved for the show. Make sure you subscribe to the excellent Last Week in AWS mailing list by Corey Quinn

At this stage its a guessing game as to what they might be, but certainly more IoT, ML, AI and buckets of enticing delicious serverless. I’m expecting some Blockchain as a Service and likely Kubernetes as well.

Amazon is also a remarkable company in the way it is able to erm. reinvent itself. This isn’t just an AWS thing but AWS certainly helps all of the rest of Amazon be incredible agile, be able to continually experiment, use its own platform as a sensing engine, rely on real data to make decisions and cannibalise itself. Lambda has been built to cannibalise EC2.

Read more…

Cloud Field Day 2 Preview: Gigamon

July 21st, 2017 No comments

Cloud Field Day 2, part of the Tech Field Day family of events is happening in San Francisco and Silicon Valley, from 26-28 July and I’m super excited to be invited as a delegate.

We are hearing from a number of companies about how they cloud!

Gigamon is an established vendor which provides network traffic visibility. In its simplest form it is a large network tap. You chose what traffic you want to inspect more closely and run it through Gigamon’s devices. Gigamon then can hand off to other vendor products to then analyse the data. It could be security scanning with an intrusion detection system or watching traffic for data loss prevention or seeing if you have a bot net running internally.

In terms of virtualisation inspection, Gigamon already has its GigaVUE solutions which provide visibility into virtual workloads running in VMware networking with ESXi and NSX as well as OpenStack KVM powered clouds. Its Cloud Field Day so of course Gigamon is heading to the clouds and has recently announced the Gigamon Visibility Platform for AWS.

Enterprises love the simplicity of cloud networking, create a VPC with pretty much all the address space you need. Connect via an API and easily connect servers and clouds together. Nothing can communicate unless you specifically say it can so some of your firewalling is already taken care of and all the config can be more easily managed as code. Amazon looks after all the underlying compute, network and storage so you don’t have to, sounds great. It can be easy to think you then don’t have to worry about more security at the network level. Well, you may have permissioned a web server to be able to talk to an app server but how do you know what is actually running across port 443. What if the web server is in AWS but your app server is on-prem?

Visibility Platform for AWS

Read more…

Categories: AWS, CFD2, Cloud, Tech Field Day Tags: , , , ,

Cloud Field Day 2 Preview: Rubrik

July 21st, 2017 No comments

Cloud Field Day 2, part of the Tech Field Day family of events is happening in San Francisco and Silicon Valley, from 26-28 July and I’m super excited to be invited as a delegate.

We are hearing from a number of companies about how they cloud!

What a journey Rubrik has had so far, a 2 year old company that has ambitious plans to redefine that stodge of datacenter technologies, backup. Rubrik recently received a further $180 million in a Series D round at a $1.3 billion valuation. Yes, that’s a more than billion dollar valuation for a company that does backup, wow! Rubrik says it has hardly dipped into its $61 million Series C round but is going for hyper growth. It currently has several hundred enterprises as customers. Interestingly in the Series D funding announcement Rubrik mentioned investing heavily in R&D with this money. They’ve already had 8 product releases with the latest including a number of cloud features so I would think sales and marketing is where the money will need to be spent to increase customers. Hyper growth phase is normally less about R&D and more about knocking on the doors of prospective customers so will be interesting to hear the latest company plans.

All the Data

Read more…

Cloud Field Day 2 Preview: Scality

July 20th, 2017 No comments

Cloud Field Day 2, part of the Tech Field Day family of events is happening in San Francisco and Silicon Valley, from 26-28 July and I’m super excited to be invited as a delegate.

We are hearing from a number of companies about how they cloud!

Scality has been a previous Tech Field Day presenter.

Scality is one of the new storage companies leveraging the AWS S3 storage API standard to create new enterprise storage options beyond your typical block and file store. S3 is object storage which is all about scale, built to store billions of objects or massive petabyte sized files or stores.

Scality already provides an open source implementation of the AWS S3 API called Scality S3 Server. Interestingly it is packaged as a Docker container so can leverage the benefits of Docker such as the same deployment mechanism from a developers laptop to being deployed in production and further scaled out via Docker Swarm.

Scality RING is the enterprise friendly version of S3 Server for more critical workloads with the usual enterprise feature requirements of security, support, availability, etc.

AWS S3 is all great but some enterprises aren’t willing to store everything in a public cloud. There may be (often unfounded) security concerns or more valid concerns about bandwidth usage, data gravity and cost. If you have PBs of on-prem storage for your media files, x-rays, satellite images etc. you would love the ease of use of the S3 API but accessed locally. Scality can provide this S3 API on-prem as well as the replicated, highly available storage infrastructure running on standard x86 underneath. Having S3 locally also allows your developers to test functionality locally for things that may eventually access AWS S3.

Zenko

Scality has now announced Zenko which is an open source multi-cloud controller and this is what I expect we’ll hear more about at Cloud Field Day.

Read more…

Categories: AWS, CFD2, Cloud, Storage, Tech Field Day Tags: , , , ,

Cloud Field Day 2 Preview: Platform9

July 20th, 2017 No comments

Cloud Field Day 2, part of the Tech Field Day family of events is happening in San Francisco and Silicon Valley, from 26-28 July and I’m super excited to be invited as a delegate.

We are hearing from a number of companies about how they cloud!

Platform9 is a regular Tech Field Day presenter and I am lucky to be able to heard from them directly when I attended Virtualisation Field Day 4 in 2015 when it was just starting

The company was founded in 2013 by some clever VMware people who wanted to create a company to provide managed cloud infrastructure with two important distinctions. They wanted their offerings to be SaaS managed and wanted it to use open source software.

It’s first product was a cloud managed OpenStack. OpenStack was (is?) hellishly complicated to set up and manage yourself so Platform9 stepped in and offered a cloud managed OpenStack which would run on-premises. Platform9 would take all the hassle away of deploying and upgrading OpenStack and you could spend your time using your OpenStack private cloud rather than managing it.

As the cloud landscape evolved and containers became the next big thing, Platform9 added a managed Kubernetes option. Kubernetes is also difficult to set up so Platform9 came to the rescue. Clouds don’t stand still and Platform9 now has an alpha version of its own Serverless offering called Fission (plenty to say about this).

Platform9 is a cloud infrastructure management company following the current cloud trajectory in what seems like an ideal evolving portfolio: Managed servers, then managed containers then managed Serverless.

The company has had a recent fund injection of $22m with a mix of existing a new investors to bring the total capital raised to date to £36.5m, a helpful war chest. It currently manages 200 enterprise clouds worldwide.

Hybrid Cloud

Read more…

Can I order some servers for my serverless please – London VMUG Presentation

June 22nd, 2017 No comments

I was super happy to be able to present again at the London VMUG today on some tech that’s going to make a huge impact, Serverless. Yes, its a dumb name, as dumb as cloud but basically refers to Functions as a Service. I went through what it is, covering the important points of event driven user defined functions spun up and down on demand. There’s no infrastructure to manage from the point of the developer, the provider does all the provisioning and scaling.

Here are the slides:

and continuing the summary of what I spoke about…

I went though some of the public cloud examples like Amazon Lambda, Azure Functions and Google Cloud Functions. There are also Kubernetes based options you can deploy yourself like Fission, Kubeless and Funktion as well as cross container platforms such as Apache OpenWhisk, IronFunctions and Funcatron. I spent time going through what events are, why they are so crticial to understanding serverless and gave some examples. How much it costs was covered, the differences between PaaS and containers. Listed the benefits and currently many disadvantages as its very new.

I also talked about how Ops is changing and doesn’t mean Ops goes away, just evolves. As it was a VMware user group I went through two connections to VMware, the kinds of things you could use serverless for to manage a VMware environment as well as the VMware cloud native story and using Photon Kubernetes as a Service as your private serverless hosting platform.

Functional billing was highlighted as probably the most important future benefit for serverless, being able to track the cost of every single function call you make which can very easily highlight the inefficiencies you have and the benefit of being now able to have business costings matching up to IT costings.

Looking into the future there’s lots that needs to evolve but perhaps this is the time to decide whether you skip PaaS and containers for some things that have event triggers and go straight to serverless?

JeffConf is also very soon so mentioned the London conference.

Thanks for having me London VMUG.

Categories: AWS, Serverless, VMware Tags: , , , ,