DevOps on AWS Deep Dive on Continuous Delivery and the AWS Developer Tools

Transcription

1 DevOps on AWS Deep Dive on Continuous Delivery and the AWS Developer Tools Woody Borraccino, AWS Solutions Architect May 4, 2016, Stockholm 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

2 What to expect from the session The Amazon DevOps story New developer tools for everyone: AWS CodeCommit AWS CodeDeploy AWS CodePipeline AWS Elastic Beanstalk

3 What is DevOps? Software development lifecycle delivery pipeline build test release developers plan monitor customers feedback loop DevOps = efficiencies that speed up this lifecycle

4 The Amazon DevOps story

5

6 Monolith development lifecycle build test release developers app delivery pipeline

7 Service-Oriented Architecture (SOA) Single-purpose Connected through APIs Highly decoupled Microservices

8 Two-pizza teams Full ownership Full accountability Aligned incentives DevOps

9 Missing tools??? developers services delivery pipeline

10 Self-service Technology-agnostic Encourage best practices Single-purpose services

11 Deployment service No downtime deployments Health tracking Versioned artifacts and rollbacks

12 Continuous delivery Pipelines Automated release process Faster and more reliable releases >90% of teams

13 Microservice development lifecycle build test release build test release build test release build test release build test release developers services build test delivery pipelines release

14 Thousands of teams Microservice architecture Continuous delivery Multiple environments = 50 million deployments a year

15 How can others do this?

16 Setting up a delivery pipeline Source Build AWS CodePipeline release Testing Staging Production AWS CodeCommit deploy deploy AWS CodeDeploy deploy

17 AWS Code Services

18 AWS CodeCommit Git objects in Amazon S3 git pull/push SSH or HTTPS CodeCommit Git index in Amazon DynamoDB Encryption key in AWS KMS Use standard Git tools Scalability, availability, and durability of Amazon S3 Encryption at rest with customer-specific keys

19 AWS CodeDeploy application revisions deployment groups Dev v1, v2, v3 CodeDeploy Test Production Easy and reliable deployments Scale with ease Deploy to any server

20 AWS CodePipeline Source Build Beta Gamma Production 1) Pull 1) Build 2) Unit test 1) Deploy 2) UI test 1) Deploy 2) Perf test 1) Deploy canary 2) Deploy region 1 3) Deploy region 2 Connect to best-of-breed tools Accelerate your release process Consistently verify each release

21 CodePipeline MyApplication Source Source GitHub Build JenkinsOnEC2 Jenkins Deploy JavaApp Elastic Beanstalk Action Stage Transition Pipeline

22 CodePipeline MyApplication Source Source GitHub Build JenkinsOnEC2 Jenkins NotifyDevelopers Lambda Parallel actions Deploy JavaApp Elastic Beanstalk

23 CodePipeline MyApplication Source Source GitHub Build JenkinsOnEC2 Jenkins TestAPI Runscope NotifyDevelopers Lambda Sequential actions Deploy JavaApp Elastic Beanstalk

24 CodePipeline MyApplication Source 1. Get Changes Source GitHub Build JenkinsOnEC2 Jenkins 3. Poll for Job 4. Acknowledge Job 7. Put Success EC2 instance 5. Get source artifact S3 Source Artifact 6. Store build artifact S3 Deploy 8. Retrieve build artifact Build Artifact JavaApp Elastic Beanstalk 9. Deploy build artifact Java App Elastic Beanstalk Web container

25 We have a strong partner list, and it s growing Source Build Test Deploy HPE StormRunner

26 AWS service integrations Source Invoke Logic Deploy Amazon S3 AWS CodeCommit AWS Lambda AWS Elastic Beanstalk AWS CodeDeploy

27 AWS Elastic Beanstalk Easily deploy PHP, Java, Python, Ruby, Node.js,.NET, Go or Docker application Fast & simple to begin Developer productivity Impossible to outgrow Complete resource control

28 DevOps: road to loveable product AWS Summit, Stockholm Niilo Ursin / Alma

29 who am I :: Niilo CTO, Alma Talent Oy Joined Alma Media/ Kauppalehti 2009 Commercial web sites since

30 founded website latest mobile

31 Kauppalehti s road to DevOps dedicated & virtual servers 2013 started experimenting cloud with private cloud + AWS Automation with Chef (private cloud) AWS Route53, S3, CloudFront, SES, SNS, SQS 2015 Three sites (frontends+some apis) moved to AWS Automation with scripts + CloudFormation AWS Elastic Load Balancing, Elastic Beanstalk, EC2, DynamoDB, ElasticSearch, Lambda, CloudWatch 2016 Kinesis, Redshift,

32 DevOps :: gives capability to do rapid and experimental business

33 MINIMUM LOVEABLE PRODUCT MLP = The version of a new product that brings back the maximum amount of love from your early tribe members with the least effort.

34 DevOps :: TRUST -> NO FEAR 1. EVERY DEVELOPER HAS ACCESS TO EVERYTHING 2. EVERY DEVELOPER CAN UPDATE PRODUCTION 3. NO FEAR OF UPDATING PRODUCTION Spotify :

35 DevOps :: Collaboration and

36 DevOps :: Automation -> Infrastructure as a code QA STAGING PRODUCTION One time testing environments for: PERFORMANCE SECURITY

37 DevOps :: Tested small increments continuously deployed to production record 7 production deployments in one DAY

38 DevOps :: Measure end user experience -> Visible

39 Prototypes :: After desktop site renewal team built four prototypes of mobile site within two weeks: NodeJS with Express and React (serverside) RiotJS (clientside) Golang (serverside) React + Fluxible + nodejs (universal) All prototypes were deployed multiple times per day to Amazon Elastic

40 be fast or be last. Niilo Ursin /

41 Thank you! Woody Borraccino, AWS Solutions Architect