Archive

Archive for the ‘Serverless’ Category

Maybe spend time looking at how new tech CAN help you rather than CAN’T help you

September 12th, 2018 No comments

I was recently invited to do an internal enterprise financial company presentation on serverless computing as part of a general what’s happening in IT series. There was a wider range of people than I expected who attended, some business people and some IT people.

The business lens

In the questions and feedback afterwards interestingly some of the business people could see some of the value more easily than the IT people. Business people liked the coming together of business logic and IT and could see the benefit of just encoding what they need doing in a serverless function without having to worry as much about all the IT infrastructure stuff behind the scenes. Although the business people weren’t coders, someone likened the approach to using Excel macros. Some fairly sophisticated Excel functions have graced the trading desks of many an organisation. They didn’t need to think about infrastructure with Excel Macros, Excel was just a platform you could code mathematical functions in. Sure, Excel macros had many issues, security, performance, availability etc. but they served the business need easily without having to get IT involved.

The IT lens

I then spoke to a development team leader afterwards. She’s very well versed in coding, a super smart algorithmic trading developer. She voiced valid concerns though that with serverless functions you couldn’t control the latency of the function and so she couldn’t see any use for them in their work. Part of the workflow they develop is low-latency trading, pricing and analytics which of course is very latency and performance sensitive. Some of the workflows include many steps necessary for compliance and auditing. A price range traded may need to be put into a database to reference later. A trade that is priced needs to be logged somewhere and a trade completed needs to go into another database which kicks off a whole other bunch of workflows to be reconciled in the back-office. She mentioned the low-latency algo stuff was working well but they sometimes struggled with performance and speed when it was a very busy trading day. Some of the compliance and auditing code sits very close compute wise to the low-latency code. This makes it simpler to code the end-to-end transactions but it means the most expensive physical server hardware low-latency compute cycles are also being “wasted” on compliance and auditing code which may struggle to keep up on an extra busy trading day. To improve this would generally require scaling up existing compute resources. The compliance and auditing data was also used by many other integrated systems so care needed to be taken so that the secondary databases could keep up with low-latency demand.

This made me think of two things, first of all how this application would of course benefit from some splitting up. The app could be changed for the low-latency code to push out the minimal amount of compliance and auditing information to another database, queue or even stream. A separate set of serverless functions could then very efficiently respond to an event or pick up these trades or prices and do whatever needs to be done (BTW, its not just functions that can be serverless, databases, queues and storage can be too!). This could also be massively scalable in parallel. 1 trade at a time or a million and this wasn’t latency sensitive stuff once the initial small record was created.

CAN use or CAN’t USE

Secondly was how the developer team leader was seeing how serverless functions COULD NOT be used for latency sensitive workloads but not seeing how useful they COULD be for all the rest of the compliance and auditing code. The low latency code was the most important so naturally her focus is on that.

The splitting up of the app is an architectural discussion and may not in fact be suitable in the end but the more important point is sometimes we are a little myopic and only see what a technology CAN’T do rather than looking at the bigger picture and seeing what it CAN do. This can distance you from the business. Oh, and of course, Excel can do a LOT!

Categories: Cloud, DevOps, Scale, Serverless Tags:

AWS re:Invent 2017: The Show Review

December 19th, 2017 No comments
Categories: AWS, Cloud, re:Invent, Serverless Tags: , ,

AWS re:Invent 2017: What’s New in Serverless – SRV305

December 1st, 2017 No comments

Tim Wagner the AWS Serverless GM and Jeet Kaul from FICO

This session was about new things in serverless.

Tim reiterated how mazing Lambda is coming, its even inside a camera which was announced in the keynote as well as the top memory size being doubled to 3Gb which also doubled the CPU power.

2017-11-30 15.18.52Magic!

There was a mini magic show which was apparently a nod to something they did last year.

The idea is to show disappearing servers, as there are more and more serverless offerings, this means more and more disappearing servers.

Serverless Application Repository.

It’s worth looking at the recently announces Serverless Application Repository, its a marketplace of serverless functions published by AWS and others.

Read more…

AWS re:Invent 2017: Serverless Architectural Patterns and Best Practices – ARC401

November 28th, 2017 No comments

Another session on managing serverless and the new architectural patterns required to make it a success. The idea of to create reusable serverless patterns with an continual eye on reducing costs.

2017-11-28 13.28.01The venue was spectacular, in the Venetian Theatre which is magnificent. Shows the importance AWS is placing on serverless where most of the other sessions are in smaller rooms at the Aria.

Drew and Maitreya went through a number of patterns, giving operational and security best practices.

This was a fly by the seat of your pants session, so many AWS services were talked about, you needed an AWS dictionary to know what some are. If you are an infrastructure person who manages an OS, this was a very busy but insightful look at what is possible.

Serverless Foundations

For running your apps you can do it yourself with EC2 and even Docker, have managed services like EMR, ES, RDS etc. and then there’s services with no OS which is how they’re defining serverless, so that’s things like API Gateway, Kinesis Streams & Analytics, DynamoDB, S3, Step Functions, Config, X-Ray and Athena.

They reiterated the “never paying for idle” line and its all built for HA and DR.

You need to be aware of cold start, instantiate AWS client and database client outside the scope of the handler to take advantage of container re-use. Schedule with CloudWatch Events for pre-warming. ENUs for VPC support are attached during cold start

Lambda Best Practices

  • Minimise package size to necessities
  • Separate Lambda handler from core logic,
  • Use environment variables to modify operational behaviours.
  • Self-contain dependencies in your function package.
  • Leverage “Max Memory Used” to right size your functions.
  • Delete large unused functions
  • Use X-Ray integration for great insights.

Read more…

AWS re:Invent 2017: Build a Multi-Region Serverless Application for Resilience and High Availability Workshop

November 28th, 2017 No comments

Steven Challis & Derek Felska from AWS were the workshop leaders and it was very hands on, basically up to you and anyone else you wanted to team up with.

2017-11-27 12.58.36 2017-11-27 12.58.45

This is one of the reasons to actually attend a conference, you get to do things in person and interact with other people rather than watching a recorded session or just follow a step by step plan when you can’t confer.

Intro

Availability and fast performance is key to user experience. Building a global application from the start is traditionally extremely difficult. Think before serverless how you would have to manage a global fleet of EC2 instances, load balancers, databases and storage. You would need to be a DNS guru and keeping your compute generic yet regionalised was super tough. Enter serverless and the promise was there but Lambda needed a whole lot of hacking to get functions to fire based on geographical access.

2017-11-27 13.15.14 2017-11-27 13.05.29

In the workshop we set up a fictional company called www.wildrydes.com (would you use a ride sharing company called this!). This wasn’t just a normal rider sharing company though, the drivers were unicorns! They needed a customer support application which customers can use to report any issues, be it lost property or a grumpy unicorn! As the service was global and needed to be built, serverless was touted as the ideal platform to use as much as possible (of course, it’s re:Invent!). We needed to lash together Lambda, API Gateway, DynamoDB, Route 53, CloudFront and S3 for better availability. Cognito Federated Identities was also used for user authentication.

The workshop was also to highlight the new “API Gateway regional endpoints” feature which was recently released.

There’s no reason to feel left out though, you can go through it all at: https://github.com/awslabs/aws-serverless-workshops/

Read more…

Serverless, Show Me the Servers! – A UK VMUG 2017 Presentation

November 16th, 2017 No comments

I was happy to be asked to present at the National UK VMUG about Serverless. I had done the closing keynote last year so pretty relieved that I was at least invited back!

The presentation was similar to the London VMUG presentation I had done in July although updated as the Serverless ecosystem is moving at breakneck speed.

Changes of note since July are the addition of the new and momentum gathering OpenFaas framework, Azure Functions now available in the wild with Azure Stack, AWS adding more Lambda functionality particularly with its announcement that traffic shifting is coming soon for canary releases and blue/green routing. Iron.io bought by Oracle and VMware shutting down Photon Platform and shifting direction to Pivotal Container Service (PKS) and vSphere Integrated Containers (VIC).

AWS Re:Invent is in less that 2 week’s time so I’m sure there will be plenty more to talk about!

Here are the slides:

Presentation Summary:

I went though some of the public cloud examples like Amazon Lambda, Azure Functions and Google Cloud Functions. There are also Kubernetes based options you can deploy yourself like Fission, Kubeless and Funktion as well as cross container platforms such as Apache OpenWhisk, IronFunctions and the new and exciting OpenFaaS. I spent time going through what events are, why they are so critical to understanding serverless and gave some examples. How much it costs was covered, the differences between PaaS and containers. Listed the benefits and currently many disadvantages as its very new.

I also talked about how Ops is changing and doesn’t mean Ops goes away, just evolves. As it was a VMware user group I went through two connections to VMware, the kinds of things you could use serverless for to manage a VMware environment as well as the VMware cloud native story and using Pivotal Container Service the new Kubernetes based container runtime from VMware as your private serverless hosting platform.

Functional billing was highlighted as probably the most important future benefit for serverless, being able to track the cost of every single function call you make which can very easily highlight the inefficiencies you have and the benefit of being now able to have business costings matching up to IT costings.

Looking into the future there’s lots that needs to evolve but perhaps this is the time to decide whether you skip PaaS and containers for some things that have event triggers and go straight to serverless?

Joining the CloudInsiders Podcast to talk all about Serverless

November 15th, 2017 No comments

I was thrilled to be asked recently to join the CloudInsiders podcast to talk about Serverless. I was joined by Chan Ekanayake and we had a wide ranging discussion on what Serverless is, use cases, pros and cons and much more. It’s worth a listen if you’re trying to get your head around what its all about.

Thanks for having me.

Listen to the episode here: Serverless: Viva la revolución

The whole CloudInsiders podcast series is certainly worth subscribing to via iTunes or Stitcher.

Cloud Field Day 2 Preview: Platform9

July 20th, 2017 No comments

Cloud Field Day 2, part of the Tech Field Day family of events is happening in San Francisco and Silicon Valley, from 26-28 July and I’m super excited to be invited as a delegate.

We are hearing from a number of companies about how they cloud!

Platform9 is a regular Tech Field Day presenter and I am lucky to be able to heard from them directly when I attended Virtualisation Field Day 4 in 2015 when it was just starting

The company was founded in 2013 by some clever VMware people who wanted to create a company to provide managed cloud infrastructure with two important distinctions. They wanted their offerings to be SaaS managed and wanted it to use open source software.

It’s first product was a cloud managed OpenStack. OpenStack was (is?) hellishly complicated to set up and manage yourself so Platform9 stepped in and offered a cloud managed OpenStack which would run on-premises. Platform9 would take all the hassle away of deploying and upgrading OpenStack and you could spend your time using your OpenStack private cloud rather than managing it.

As the cloud landscape evolved and containers became the next big thing, Platform9 added a managed Kubernetes option. Kubernetes is also difficult to set up so Platform9 came to the rescue. Clouds don’t stand still and Platform9 now has an alpha version of its own Serverless offering called Fission (plenty to say about this).

Platform9 is a cloud infrastructure management company following the current cloud trajectory in what seems like an ideal evolving portfolio: Managed servers, then managed containers then managed Serverless.

The company has had a recent fund injection of $22m with a mix of existing a new investors to bring the total capital raised to date to £36.5m, a helpful war chest. It currently manages 200 enterprise clouds worldwide.

Hybrid Cloud

Read more…

Can I order some servers for my serverless please – London VMUG Presentation

June 22nd, 2017 No comments

I was super happy to be able to present again at the London VMUG today on some tech that’s going to make a huge impact, Serverless. Yes, its a dumb name, as dumb as cloud but basically refers to Functions as a Service. I went through what it is, covering the important points of event driven user defined functions spun up and down on demand. There’s no infrastructure to manage from the point of the developer, the provider does all the provisioning and scaling.

Here are the slides:

and continuing the summary of what I spoke about…

I went though some of the public cloud examples like Amazon Lambda, Azure Functions and Google Cloud Functions. There are also Kubernetes based options you can deploy yourself like Fission, Kubeless and Funktion as well as cross container platforms such as Apache OpenWhisk, IronFunctions and Funcatron. I spent time going through what events are, why they are so crticial to understanding serverless and gave some examples. How much it costs was covered, the differences between PaaS and containers. Listed the benefits and currently many disadvantages as its very new.

I also talked about how Ops is changing and doesn’t mean Ops goes away, just evolves. As it was a VMware user group I went through two connections to VMware, the kinds of things you could use serverless for to manage a VMware environment as well as the VMware cloud native story and using Photon Kubernetes as a Service as your private serverless hosting platform.

Functional billing was highlighted as probably the most important future benefit for serverless, being able to track the cost of every single function call you make which can very easily highlight the inefficiencies you have and the benefit of being now able to have business costings matching up to IT costings.

Looking into the future there’s lots that needs to evolve but perhaps this is the time to decide whether you skip PaaS and containers for some things that have event triggers and go straight to serverless?

JeffConf is also very soon so mentioned the London conference.

Thanks for having me London VMUG.

Categories: AWS, Serverless, VMware Tags: , , , ,