Containers and the Evolution of Computing

Transcription

1 Containers and the Evolution of Computing Matt Nowina Solutions Architect 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

2 Scaling Applications

3 Order UI User UI Shipping UI Order Service User Service Shipping Service Data Access

4

5 Order UI User UI Shipping UI Order Service User Service Shipping Service

6 Order UI User UI UI Order UI User UI Shipping UI Order UI UI Order Service Order Service Order Service Service Service Service Service Service User Service Shipping Service Shipping Service

7

8 What are Containers? App1 Bins/Libs App2 Bins/Libs OS virtualization Process isolation Images Automation

9 Container advantages App1 Bins/Libs App2 Bins/Libs Portable Flexible Fast Efficient

10 Containers are natural for microservices Simple to model Any app, any language Image is the version Test & deploy same artifact Stateless servers decrease change risk

11 Managing one host is straightforward App1 Bins/Libs App2 Bins/Libs

12 Managing a fleet is hard AZ 1 AZ 2 AZ 3

13 What is Amazon ECS? Amazon EC2 Container Service (ECS) is a highly scalable, high performance container management service. You can use Amazon ECS to schedule the placement of containers across your cluster. You can also integrate your own scheduler or third-party scheduler to meet business or application specific requirements.

14 Our Goals with Amazon ECS

15 Container Management at Any Scale Nothing to run Complete state Control and monitoring Scale

16 Flexible Container Placement Long running applications Batch jobs Multiple schedulers

17 Integration with the AWS Platform Elastic Load Balancing Amazon Elastic Block Store Amazon Virtual Private Cloud Amazon CloudWatch AWS Identity and Access Management AWS CloudTrail

18 Container Management

19 What is a Container Manager? Maintains Available Resources Tracks Resource Changes Accepts Resource Requests Guarantees Accuracy and Consistency

20 Resources CPU Memory Ports Disk Space Disk IOPS Network Bandwidth

21 Container Instance Docker ECS Task Task Agent Container Container ECS Agent

22 Instance Registration register-container-instance --total-resources [ ] { }, name : cpu, type : integervalue, integervalue : 2048

23 Modifying Exposed Resources

24 How do you model your applications?

25

26 { }, "environment": [], "name": "simple-demo", "image": "my-demo", "cpu": 10, "memory": 500, "portmappings": [ { "containerport": 80, "hostport": 80 } ], "mountpoints": [ { "sourcevolume": "my-vol", "containerpath": "/var/www/my-vol" } ], "entrypoint": [ "/usr/sbin/apache2", "-D", "FOREGROUND" ], "essential": true

27 Tasks Shared Data Volume Containers Volume Definitions Container Definitions launch Container Instance

28 Starting a Task User / Scheduler StartTask API

29 Starting a Task User / Scheduler StartTask API Cluster Management Engine

30 Starting a Task User / Scheduler StartTask Agent Communication API Cluster Management Engine

31 Starting a Task Docker Container Instance Task Container User / Scheduler WebSocket ECS Agent StartTask Agent Communication API Cluster Management Engine

32 Starting a Task Container Instance Docker Task Container Task Container User / Scheduler ECS Agent SubmitStateChange StartTask Agent Communication API Cluster Management Engine

33 Tracking Resource Changes

34 Terminated Task Container Instance Docker Task Container User / Scheduler ECS Agent SubmitStateChange StartTask Agent Communication API Cluster Management Engine

35 Missing Container Instance Container Instance Docker Task Container? ECS Agent User / Scheduler StartTask Agent Communication API Cluster Management Engine

36 Terminated Container Instance Container Instance Docker Task Container User / Scheduler ECS Agent StartTask Agent Communication API Termination Notifier Cluster Management Engine

37 Guaranteeing Accuracy and Consistency

38 Amazon ECS under the Hood WRITE ID N+6 ID N-1 ID N ID N+1 ID N+2 ID N+3 ID N+4 ID N+5 READ ID N+5

39 Amazon ECS under the Hood WRITE WRITE ID N+3 ID N+6 ID N-1 ID N ID N+1 ID N+2 ID N+3 ID N+4 ID N+5 READ ID N+2 READ ID N+5

40 Scalable

41 Schedulers

42 What is a Scheduler? Determine Desired State Check Against Current State Perform Action

43 Amazon ECS Service Scheduler

44 What is a Service? Models a long-running application Maintains desired state Optionally runs behind an Elastic Load Balancer

45 Discovering Differences Deployment Status Desired Pending Running ecs-svc/1 PRIMARY Minimum Healthy Maximum Healthy 50% 200%

46

47 Discovering Differences Deployment Status Desired Pending Running ecs-svc/2 PRIMARY ecs-svc/1 ACTIVE Minimum Healthy Maximum Healthy 50% 200%

48

49 Other Considerations ELB Registration/Deregistration Permissions and Errors Task Health Scale Down Requests

50

51 Multiple Schedulers

52 Amazon ECS: Scheduling

53 Amazon ECS: Scheduling

54 Amazon ECS: Scheduling

55 Amazon ECS: Scheduling

56 Let us recap

57

58 Task Definitions { }, "environment": [], "name": "simple-demo", "image": "my-demo", "cpu": 10, "memory": 500, "portmappings": [ { "containerport": 80, "hostport": 80 } ], "mountpoints": [ { "sourcevolume": "my-vol", "containerpath": "/var/www/my-vol" } ], "entrypoint": [ "/usr/sbin/apache2", "-D", "FOREGROUND" ], "essential": true

59 Internet User / Scheduler ELB ELB AZ 1 AZ 2 Container Instance Container Instance Container Instance Docker Docker Docker Task Container Task Container Task Container Task Container Task Container Task Container ECS Agent ECS Agent ECS Agent Amazon ECS Agent Communication Service Cluster Management Engine Key/Value Store API

60

61 Thank you!