Amazon EC2 Deep Dive. Michael #awssummit

Size: px

Start display at page:

Download "Amazon EC2 Deep Dive. Michael #awssummit"

Janice Stephens
5 years ago
Views:

1 Berlin

2 Amazon EC2 Deep Dive Michael #awssummit

3 Let s get started

4 Amazon EC2 instances

6 AMIs & Virtualization Types

7 EBS-backed AMIs AMI instance Physical host server New root volume snapshot

8 S3-backed AMIs AMI instance Mount volume Copy image data to instance store disk Physical host server

9 EBS-backed vs. S3-backed AMIs EBS faster to boot (esp. with EBS GP2) Need at least one root volume per instance S3-backed AMIs require instance storage Only M3 / I2 / D2 / G2 instance types + previous generation

10 Virtualization Primer: x86 CPU Prior to Intel VT-x Binary translation Para-virtualization (PV) After Intel VT-x Hardware assisted virtualization (HVM) PV vs. HVM Amazon Machine Images vcpu scheduling choices and variability

11 Virtualization Primer: I/O and Devices Scheduling I/O requests between virtual devices and shared physical hardware Split driver model for shared devices; requires host resources Intel VT-d Direct pass through and IOMMU for dedicated devices

12 Virtualization types: PV vs. HVM Bare Metal PV-HVM PV Kernel Kernel Application VMM Kernel Application VMM Application PV-HVM allows Application to call directly into the Kernel PV requires going through the VMM overhead! Applications that are system call bound are most affected

13 Virtualization types: PV vs. HVM PV / paravirtual AMIs Need customized OS kernel that supports virtualization Can use separate AKI (Amazon Kernel Image) and ARI (Amazon Ramdisk Image), ie. Drop-in replacements for Linux kernel + drivers without changing the AMI Special PV-GRUB bootloader

14 Support for PV AMIs Previous Generation Instance Types T1 M1 M2 C1 CC2 CR1 HI1 HS1 CG1

15 Support for PV AMIs Current Generation Instance Types T2 M3 M4 C3 C4 R3 I2 D2 G2

16 Virtualization types: PV vs. HVM HVM AMIs Guest OS can run unmodified No custom Kernels etc. needed Bootloader starts off of MBR of root device Use PV drivers for fast access to underlying hardware without translation ( PV-HVM )! Faster network & storage IO! Direct access to network interfaces, GPUs etc, Allows for access to CPU hardware features

17 Support for HVM AMIs Previous Generation Instance Types T1 M1 M2 C1 CC2 CR1 HI1 HS1 CG1

18 Support for HVM AMIs Current Generation Instance Types T2 M3 M4 C3 C4 R3 I2 D2 G2

19 The Bottom Line Use 64 bit HVM EBS-backed AMIs ( unless you really want to use previous generation instance types)

22 Instance Types

23 Instance generation c3.large Instance family Instance size

24 CPU Storage Memory Network

25 C 3

26 C 4

27 CPU

28 C4 Instance Type Compute-Optimized Instance Family Highest amount of compute performance per $ Smaller amount of RAM per vcore Custom Intel CPU (Intel Xeon E5-2666v3) Base speed 2.9Ghz Intel Turbo Boost 3.5Ghz AVX2 supports 256-bit integer vectors and can process 32 single precision or 16 double precision floating point operations per cycle Available in 5 different sizes 4 to 36 vcores 3.75 GiB to 60 GiB RAM

29 C4 Instance Type Only 2 vcores can run at highest Turbo Boost speed at the same time, others run at base freq Alternatively, all vcores can run at 3.2GHz Influence speed using Processor State Control Access to CPU features: AVX 2.0, AES-NI

30 C4 Instance Type C4.8xlarge allows to control the CPU s C-state and P- state Control which idle state vcpus can reach (C0=running, C6=off) Control the available performance state for vcpus Decrease latency of thread switching Max. frequency for two threads vs. higher base performance Turn off turbo mode for more consistent performance

31 M 3

32 M 4

33 M4 Instance Type General Purpose Instance Family Less CPU per RAM than C4 More RAM per vcore than C4 (and less than R3) Custom Intel CPU (Xeon E v3) Base speed 2.4Ghz turbo up to 3.0Ghz (2.70 GHz when all cores are running) Available in 5 different sizes 2 to 40 vcores 8 GiB to 160 GiB RAM

34 T 2

35 T2 Instance Type General Purpose Instance Family Burstable CPU Intel Xeon CPU Base 2.5Ghz, Intel Turbo Boost up to 3.3Ghz Available in 4 different sizes 1 to 2 vcores 1 to 8 GiB RAM

36 T2 Instance Type General Purpose Instance Family Burstable CPU Intel Xeon CPU Base 2.5Ghz, Intel Turbo Boost up to 3.3Ghz Available in 4 different sizes 1 to 2 vcores 1 to 8 GiB RAM

37 Understanding T2 CPU Credits An instance earns CPU credits at a steady rate Max. credit depends on instance size Initial credit after boot! 1 CPU Credit provides the performance of a full CPU core for 1 minute An instance consumes credits when active 37

38 Model vcpu CPU credits/h Memory (all) Storage t2.micro EBS Only T2.small EBS Only T2.medium EBS Only T2.large EBS Only

39 CPU Storage Memory Network

41 Storage Options Current Generation Instance Types T2 M3 M4 C3 C4 R3 I2 D2 G2 Amazon EBS only Amazon EBS only Amazon EBS only

42 Storage Options Current Generation Instance Types T2 M3 M4 C3 C4 R3 I2 D2 G2 Amazon EBS Amazon EBS Amazon EBS Amazon EBS Amazon EBS Amazon EBS Amazon EBS only Amazon EBS only Amazon EBS only

45 VPC-only Instance Types Current Generation Instance Types T2 M3 M4 C3 C4 R3 I2 D2 G2

46 VPC-only Features Enhanced Networking / SR-IOV Multiple Elastic Network Interfaces Multiple IP addresses More powerful Security Groups (ingress/egress) VPC flow-logs

47 Enhanced Networking / SR-IOV Single Root I/O Virtualization Supports significantly higher # of packets / sec Reduced latency, less jitter

48 Enhanced Networking / SR-IOV C4, M4, C3, R3, D2, I2 instance families HVM virtualization type VPC-only Required kernel version Linux: Windows: Server 2008 R2+ Appropriate VF driver Linux: ixgbevf module Windows: Intel Virtual Function driver

49 Enhanced Networking / SR-IOV Verify Intel ixgbevf driver is installed and enabled $"ethtool"(i"eth0" driver:"ixgbevf( version:" amzn" "

50 Enhanced Networking / SR-IOV Verify Intel ixgbevf driver is installed and enabled Enable sriov instance attribute $"aws"ec2"modify(instance(attribute"\"""" ((instance(id=i(xxxxxxx"\" ((sriov(net(support=simple;" " (Or launch from an AMI that has this flag set!)

52 Placement Groups 10Gb/s network Fully bisected instance instance instance instance Low latency instance instance instance instance

53 Placement Groups Use 10Gbps instance size for max throughput Enable Enhanced Networking to reduce latency and increase packets-per-second Use Jumbo Frames (9001 MTU) to achieve maximum throughput

54 Support for Placement Groups Previous Generation Instance Types T1 M1 M2 C1 CC1 CC2 HI1 HS1 CG1

55 Support for Placement Groups Current Generation Instance Types T2 M3 M4 C3 C4 R3 I2 D2 G2

57 Dedicated Instances Not a performance optimization! Only instances of same AWS AccountID are placed on same physical server Use this for compliance or security reasons not to get extra bandwidth / CPU /

60 Amazon Elastic Block Store

61 Amazon Elastic Block Store Which volume type? How many volumes? RAID, JBOD, LVM? instance volume volume

62 Virt. block device Hypervisor Physical host server Amazon EBS EBS Server

63 Other traffic Virt. block device Hypervisor EBS traffic only! Amazon EBS Physical host server EBS Server

64 Virt. block device Hypervisor Amazon EBS Primary Physical host server Amazon EBS Secondary EBS Server

65 Amazon EBS Performance Depends on a number of factors: EBS Volume type IO capacity (IOPS) Volume bandwidth Instance (network) bandwidth Instance type & size EBS-optimized option enabled or not

66 Amazon EBS Volume Types & Limits General Purpose (SSD) 1 GiB size 16 TiB 10,000 IOPS Max. 160 MiB/s Up to 256 KB / IOP Provisioned IOPS 4 GiB size 16 TiB 20,000 IOPS Max. 320 MiB/s Up to 256 KB / IOP

67 Amazon EC2 instance types & limits Instance bandwidth Varies depending on instance size Depends on utilization of network link (internet traffic, ) EBS optimized Supported on most instance families Additional reserved bandwidth of up to 4 GiB/s for communication with Amazon EBS volumes Up to 32,000 16kB, ie. 256 MB/s throughput

68 Amazon EC2 instance types & limits Instance throughput Up to 48,000 IOPS (16 kb) Up to 800 MB/s

73 The End

74 What is still missing? VPC features & usage scenarios Monitoring & alarming Resilience & Recovery Instance store performance Purchase models: Spot / On Demand / RI

BERLIN. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved

BERLIN. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved BERLIN 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Introduction to Amazon EC2 Danilo Poccia Technical Evangelist @danilop 2015, Amazon Web Services, Inc. or its affiliates. All