The Software Development Process at Amazon

Similar documents
DevOps on AWS Deep Dive on Continuous Delivery and the AWS Developer Tools

Microservices on AWS. Matthias Jung, Solutions Architect AWS

Microservices Architekturen aufbauen, aber wie?

BARCELONA. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved

A DEVOPS STATE OF MIND. Chris Van Tuin Chief Technologist, West

Driving DevOps Transformation in Enterprises

DevOps Agility in the Evolving Cloud Services Landscape

Performance Testing in a Containerized World. Paola Rossaro

DevOps Tooling from AWS

Building a Microservices Platform, Patterns and Best Practices

How to re-invent your IT Architecture. André Christ, Co-CEO LeanIX

Microservices Smaller is Better? Eberhard Wolff Freelance consultant & trainer

Accelerating Software Delivery with the AWS Developer Tools. Pradyumna Dash Solutions Architect, UK Public Sector

DevOps Anti-Patterns. Have the Ops team deal with it. Time to fire the Ops team! Let s hire a DevOps unit! COPYRIGHT 2019 MANICODE SECURITY

Deep Dive on AWS CodeStar

How to get From Zero to Hundreds of AWS Certified Engineers

A DEVOPS STATE OF MIND. Chris Van Tuin Chief Technologist, West

Build planetary scale applications with compartmentalization

DELIVERING WITH MICROSERVICES HOW TO ITERATE TOWARDS SOPHISTICATION

How Can Testing Teams Play a Key Role in DevOps Adoption?

Advanced Continuous Delivery Strategies for Containerized Applications Using DC/OS

São Paulo. August,

Azure DevOps. Randy Pagels Intelligent Cloud Technical Specialist Great Lakes Region

WHITEPAPER. Embracing Containers & Microservices for future-proof application modernization

Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme

FROM VSTS TO AZURE DEVOPS

Digital Transformation with HPE Cloud Management October 26, Copyright 2016 Vivit Worldwide

Using Layered Model-Based Requirements to achieve Continuous Testing

AUTOMATE THE DEPLOYMENT OF SECURE DEVELOPER VPCs

RED HAT OPENSHIFT A FOUNDATION FOR SUCCESSFUL DIGITAL TRANSFORMATION

OpenShift on Public & Private Clouds: AWS, Azure, Google, OpenStack

Openshift: Key to modern DevOps

DevSecOps Why Aren t You Doing It? Brian Liceaga, CISSP 1

CDN SaaS aligned to NFV

Serverless Architecture meets Continuous Delivery. Andreas

Connecting your Microservices and Cloud Services with Oracle Integration CON7348

A DEVOPS STATE OF MIND WITH DOCKER AND KUBERNETES. Chris Van Tuin Chief Technologist, West

Experiences with Serverless Big Data

Cloud Native Architecture 300. Copyright 2014 Pivotal. All rights reserved.

Continuous Delivery for Cloud Native Applications

DevOps in the Cloud A pipeline to heaven?! Robert Cowham BCS CMSG Vice Chair

Amazon Linux: Operating System of the Cloud

Suman Sourav Director DevSecOps, Vantage Point Security. OWASP Indonesia Day 2017

Accelerate High-Quality App Delivery with the Micro Focus DevOps Suite March 28, 2018

I keep hearing about DevOps What is it?

Scaling on AWS. From 1 to 10 Million Users. Matthias Jung, Solutions Architect

From Closed to Open to Transparent Software Development. Development

UPGRADING IMIS NEWLIN

Please give me your feedback

MODERN APPLICATION ARCHITECTURE DEMO. Wanja Pernath EMEA Partner Enablement Manager, Middleware & OpenShift

Test-driven development

DevOps and Continuous Delivery USE CASE

Cloud Foundry and OpenStack

Shift Happens. The Role of Continuous Testing in DevOps. Alex Martins. CTO Continuous Testing. May 15 th, 2018 CA Technologies.

Elizabeth Lawler CEO & Co-Founder Conjur,

devops with

Quality Engineering in DevOps world a Strategic Enabler

Test-driven development

VMware Cloud on AWS Technical Deck VMware, Inc.

DEVELOPING DEVOPS ON AWS

Docker CaaS. Sandor Klein VP EMEA

AGILE RELIABILITY WITH RED HAT IN THE CLOUDS YOUR SOFTWARE LIFECYCLE SPEEDUP RECIPE. Lutz Lange - Senior Solution Architect Red Hat

Micro-Service Applications for Infrastructure People

Building an Effective Cloud Operating Model on AWS

PREPARING FOR DISASTER

Reactive Microservices Architecture on AWS

Security Precognition: Chaos Engineering in Incident Response

UNLOCKING THE TRUE BENEFIT OF SOFTWARE DEFINED NETWORKING

A Cloud Gateway - A Large Scale Company s First Line of Defense. Mikey Cohen Manager - Edge Gateway Netflix

Building Microservices with the 12 Factor App Pattern

Achieving Continuous Delivery - Micro Services. - Vikram Gadang

Java Architectures A New Hope. Eberhard Wolff

Microservices at Netflix Scale. First Principles, Tradeoffs, Lessons Learned Ruslan

Micro- Services. Distributed Systems. DevOps

Red Hat Atomic Details Dockah, Dockah, Dockah! Containerization as a shift of paradigm for the GNU/Linux OS

Containers, Serverless and Functions in a nutshell. Eugene Fedorenko

Cloud Essentials for Architects using OpenStack

Orchestrating the Continuous Delivery Process

Put Security Into Your DevOps NOW. Or Prepare for the Flood Matthew Fisher Solution Architect, Fortify Federal 08MAR2018

Möbius Partners : : 5444 Westheimer, Suite 1430 Houston, TX : : mobiuspartners.com

DevOps Made Easy. Shireesh Thanneru, Platform Architect. Intel. Linoy Alexander, Director, DevOps

DevOps. A way to reduce risks for IoT? Hui Song, SINTEF

OPNFV overview and Edge Cloud

How to Keep UP Through Digital Transformation with Next-Generation App Development

Automate best practices and operational health for your AWS resources with Trusted Advisor and AWS Health

Architecting for Scale

Test Automation Strategies in Continuous Delivery. Nandan Shinde Test Automation Architect (Tech CoE) Cognizant Technology Solutions

How to Re-Architect without Breaking Stuff (too much) Owen Garrett March 2018

In This Webinar. ConEnuous Load TesEng & ConEnuous Delivery with Jenkins

our container journey

CASE STUDY IT. Albumprinter Adopting Redgate DLM

Modernize your IT- Landscape

Sunil Shah SECURE, FLEXIBLE CONTINUOUS DELIVERY PIPELINES WITH GITLAB AND DC/OS Mesosphere, Inc. All Rights Reserved.

Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme

How can you implement this through a script that a scheduling daemon runs daily on the application servers?

2018 Report The State of Securing Cloud Workloads

Service Mesh and Microservices Networking

Research Faculty Summit Systems Fueling future disruptions

Open Cloud Engine - An Open Source Cloud Native Transformer

Logging in the age of

Transcription:

The Software Development Process at Amazon Jonathan Weiss Managing Director Amazon Web Services Germany GmbH AWS OpsWorks, AWS Resource Groups, AWS Systems Manager

Amazon is hundreds of different businesses AWS did over 1,430 major feature releases in 2017 No signs of slowing down

The Software Development Lifecycle delivery pipeline build test release developer s plan feedback loop monitor customer s

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Let s go back 15 years ago

Monolith development lifecycle build test release developer s app delivery pipeline

Service-Oriented Architecture (SOA) Single-purpose Primitive Connected w/ APIs Highly decoupled Microservices

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Two-pizza teams Decentralized Agility Autonomy Accountability Ownership DevOps

Missing Tools??? developer s services delivery pipeline

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Self-service Technology-agnostic Encourage best practices Single-purpose services Two-pizza teams Decentralized Agility Autonomy Accountability Ownership DevOps

ment service No downtime deployments Health tracking Versioned artifacts and rollbacks

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Pipelines Continuous delivery Automated release process Faster & more reliable releases Adopted by virtually all teams

Microsservice development lifecycle build test release build test release build test release build test release build test release developer s services delivery pipelines build test release

Thousands of teams x Microservice architecture x Continuous delivery x Multiple environments = millions of deployments

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Release Pipelines Source Build Staging Production Pull Source Code Run Build and Unit Tests to Staging Environment to Production Environment

Release Pipelines Source Build Staging Production Pull Source Code Run Build and Unit Tests to Staging Environment to One Box to 1 st AZ to One Box to 1 st AZ to 2 nd AZ to 2 nd AZ to 3 rd AZ to 3 rd AZ

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Release Pipelines Source Build Staging Production Pull Source Code Run Build and Unit Tests to Staging Environment to One Box to 1 st AZ to One Box to 1 st AZ to 2 nd AZ to 2 nd AZ to 3 rd AZ to 3 rd AZ

Release Pipelines Source Build Staging Production Pull Source Code Run Build and Unit Tests to Staging Environment to One Box to 1 st AZ to One Box to 1 st AZ Functional Tests to 2 nd AZ to 2 nd AZ Load / Perf Tests Other Tests to 3 rd AZ to 3 rd AZ

Release Pipelines Source Build beta gamma Production Pull Source Code Run Build and Unit Tests to Staging Environment to Staging Environment to One Box to 1 st AZ to One Box to 1 st AZ Functional Tests Integration Tests to 2 nd AZ to 2 nd AZ Other Tests Load / Perf Tests Other Tests to 3 rd AZ to 3 rd AZ

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

The Edit-Compile-Test Loop

The Edit-Compile-Test Loop ECT Loop

The Edit-Compile-Test Loop ECT Loop Code Review

The Edit-Compile-Test Loop ECT Loop Staging Code Review

The Edit-Compile-Test Loop ECT Loop Production Staging Code Review

Catching Problems in the Development Lifecycle ECT Code Review Staging Production Ideal Place Great Place Good Place Last Resort

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

The Software Development Lifecycle delivery pipeline build test release developer s plan feedback loop monitor customer s

Ops Culture Ops Meetings Ops Dashboards resource monitoring application monitoring canary monitoring client-side monitoring order drop rate

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Data Culture WBR Meetings Metrics Decks feature adoption segment growth funnel analysis cost structure

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Listen It's easy to be right if you just listen to customers. 1. Ask them want they want 2. Get feedback on what you build 3. Course correct if need to

Wenger 16999 Swiss Army Knife Giant https://www.amazon.com/wenger-16999-swiss-knife-giant/dp/b001dztjrq Feature vs. Need

Ten Lessons Learned Working Backwards description by Werner Vogels, Amazon CTO www.allthingsdistributed.com/2006/11/working_backwards.html

Ten Lessons Learned 1. Microservices 2. DevOps Teams 3. Self-Service Tools 4. Continuous Delivery 5. Pessimistic ments 6. Automated Testing 7. Optimize ECT Loop 8. Monitor Everything 9. Measure Everything 10. Listen to Customers

Thank you

Two reminders: Please complete the session survey in the summit mobile app. AWS DevDay with Chef in Berlin on June 12 th - https://bit.ly/2sp8kxo