Getting Started With Amazon EC2 Container Service

Transcription

1 Getting Started With Amazon EC2 Container Service Emeka Igbokwe Solution Architect 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved

2 Agenda Containers EC2 Container Service EC2 Container Registry Q&A

3 Containers

4 What are containers? App1 App2 Bins/Libs Bins/Libs OS virtualization Process isolation Images Automation

5 Container advantages App1 App2 Bins/Libs Bins/Libs Portable Flexible Fast Efficient

6 A container pipeline IT Operations Utilities Patches Base Image

7 A container pipeline IT Operations Base Image Ruby Redis Logger

8 A container pipeline IT Operations Developer App Base Image Ruby Redis Logger

9 A container pipeline IT Operations Developer App Base Image Ruby Redis Logger

10 A container pipeline IT Operations Developer App Patches Base Image Ruby Redis Logger

11 Managing one resource is straightforward App1 Bins/Libs App2 Bins/Libs

12 Managing one resource is straightforward App1 Bins/Libs App2 Bins/Libs $ docker run myimage

13 Managing a cluster is hard

14 EC2 Container Service

15 Cluster Management Made Easy No cluster software to install and manage Manages cluster state Manages containers Control and monitoring Scale from one to tens of thousands of containers

16 Flexible Scheduling Optimal instance placement Integrate custom or 3 rd party scheduler

17 Integrated and Extensible Integrated with existing AWS services such as IAM roles and security groups Extensible through powerful APIs Use your own scheduler Connect with existing software delivery process

18 Designed for use with other AWS services Elastic Load Balancing Amazon Elastic Block Store Amazon Virtual Private Cloud AWS Identity and Access Management (IAM) AWS CloudTrail

19 Security Isolation boundaries through EC2 instances VPC only Security Group and IAM roles support

20 Performance at Scale Building block for distributed applications Coordinates and automates container deployment Launch thousands of containers in seconds

21 Scalable

22 Pattern 1: Services and applications Any app, any language Image is the version Simplified deployments Phong Nguyen, Founder at Gilt Groupe, said, "As we Dockerize all our services, it is very important for us to have a platform that can help us speed up deployments, automate our services, and gain greater efficiencies. The new service scheduler and ELB integration make Amazon ECS an excellent platform for our services.

23 Monolith development lifecycle build test release developers app delivery pipeline

24 Micro service development lifecycle build test release build test release build test release build test release build test release developers services build test delivery pipelines release

25 Pattern 2: Batch jobs Share resource pools Ideal for bursty jobs Spot instances We required a solution on which we could securely and efficiently deploy Docker containers to encapsulate learner programming assignment submissions, said Brennan Saeta, Architect at Coursera. We are using Amazon EC2 Container Service to power our new programming assignments infrastructure for next-generation On-Demand course platform.

26 Key Components Docker Daemon Task Definitions Containers Service Clusters Container Instances

27 Key components: container instances Amazon EC2 instances Docker daemon Amazon ECS agent

28 Key Components: Clusters Regional Resource pool Grouping of container instances Start empty, dynamically scalable

29 Key components: task definitions Volume definitions Container definitions

30 Key components: task definitions Shared data volume PHP app Time of day app

31 Key components: task definitions { "environment": [], "name": "simple-demo", "image": "my-demo", "cpu": 10, "memory": 500, "portmappings": [ { "containerport": 80, "hostport": 80 } ], "mountpoints": [ { "sourcevolume": "my-vol", "containerpath": "/var/www/myvol" }, } ], "entrypoint": [ "/usr/sbin/apache2", "-D", "FOREGROUND" ], "essential": true { "name": "busybox", "image": "busybox", "cpu": 10, "memory": 500, "volumesfrom": [ { "sourcecontainer": "simple-demo" } ], "entrypoint": [ "sh", "-c" ], "command": [ "/bin/sh -c \"while true; do /bin/date > /var/www/my-vol/date; sleep 1; done\"" ], "essential": false }

32 Key components: task definitions { "environment": [], "name": "simple-demo", "image": amazon/amazon-ecs-sample", "cpu": 10, "memory": 500, "portmappings": [ { "containerport": 80, "hostport": 80 } ], "mountpoints": [ { "sourcevolume": "my-vol", "containerpath": "/var/www/myvol" }, } ], "entrypoint": [ "/usr/sbin/apache2", "-D", "FOREGROUND" ], "essential": true [ ] { } "image": "mysql", "name": "db", "cpu": 500 megabytes 10, of memory "memory": 500, "essential": true, Expose port 80 in container "entrypoint": [ to "/entrypoint.sh" port 80 on host ], "environment": [ { Create "name": and "MYSQL_ROOT_PASSWORD", mount volumes "value": "pass" } ], "portmappings": [] 10 CPU Units (1024 is full CPU), Essential to our task

33 Key components: task definitions [ { "image": "tutum/wordpress-stackable", "name": "wordpress", "cpu": 10, "memory": 500, "essential": true, "links": [ "db" ], "entrypoint": [ "/bin/sh", "-c" ], "environment": [ ], "portmappings": [ { "containerport": 80, "hostport": 80 } ] }, ] From Docker Hub Mount volume from other container Command to exec { "name": "busybox", "image": "busybox", "cpu": 10, "memory": 500, "volumesfrom": [ { "sourcecontainer": "simple-demo" } ], "entrypoint": [ "sh", "-c" ], "command": [ "/bin/sh -c \"while true; do /bin/date > /var/www/my-vol/date; sleep 1; done\"" ], "essential": false }

34 Key components: tasks Shared data volume PHP app Time of day app Schedule Container Instance

35 Key Components: tasks Unit of work Grouping of related containers Run on container instances

36 Key Components: Run a task Good for short-lived containers, e.g. batch jobs

37 Key components: Create a service Good for longrunning applications and services

38 Key components: Create a service Load balance traffic across containers Automatically recover unhealthy containers Discover services Elastic Load Balancing

39 Key components: Update a service Scale up Scale down Elastic Load Balancing

40 Key components: Update a service Deploy a new version Drain connections Elastic Load Balancing

41 Key components: Update a service Deploy a new version Drain connections Elastic Load Balancing

42 Key components: Update a service Deploy a new version Drain connections Elastic Load Balancing

43 Key components: Deploy a service Define two ECS services Each service is associated w/ ELB Both ELBs in Route 53 record set with weighted routing policy, 100% Primary, 0% Secondary Deploy to Blue or Green service and switch weights Route 53 record set with weighted routing policy 100% Task 0% Task

44 Architecture

45 Typical user workflow I want to run a service.

46 Typical user workflow Run Instances Amazon EC2 Use custom AMI with Docker support and ECS agent. Instances register with default cluster.

47 Typical user workflow Create Task Definition Declare resource requirements for containers

48 Typical user workflow Create Service Elastic Load Balancing X 5 Declare resource requirements for service

49 Typical user workflow Describe Service

50 EC2 Container Registry

51 Amazon EC2 Container Registry Private Docker Repository v2 Docker Registry AWS Identity and Access Management (IAM) and AWS Auth integration Low latency push, pulls, and inspection Alternatives: DockerHub Docker Trusted Registry

52 Benefits Fully managed Secure Highly available Simplified workflow

53 Fully Managed No registry software to install and manage Hundreds of concurrent pulls

54 Secure IAM resource-based policies Transfer via HTTPS Image encryption at rest

55 Highly Available Backed by Amazon S3 Images redundantly stored across multiple facilities and multiple devices in each facility

56 Simplified Workflow Tight integration with Amazon ECS Use Docker CLI commands (e.g., push, pull, list, tag)

57 Additional Resources Setup, Monitoring & Discovery ECS CloudFormation template - ECS CloudWatch metrics - Monitoring ECS with Datadog - Monitoring Amazon ECS with Sysdig - Scaling with CloudWatch Alarms - Service discovery with Weaveworks - Service discovery with Consul -

58 Demo

59 Q&A 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved