Lean & Mean on AWS: Cost-Effective Architectures. Constantin Gonzalez, Solutions Architect, AWS

Transcription

1

2 Lean & Mean on AWS: Cost-Effective Architectures Constantin Gonzalez, Solutions Architect, AWS

3 What you ll get out of this session A lower AWS bill A more scalable, robust, dynamic architecture More time to innovate Real-world customer examples Easy to implement

4 Cloud computing benefits Pay as you go, no up-front investments Low ongoing cost Flexible capacity Speed, agility, and innovation Focus on your business Go global in minutes

5 Cloud computing benefits Pay as you go, no up-front investments Low ongoing cost Flexible capacity Speed, agility, and innovation Focus on your business Go global in minutes

6 How to optimize for cost

7 Strategy 1: Do nothing

8 AWS pricing philosophy Infrastructure Innovation Reduced Prices More Customers Ecosystem Global Footprint New Features New Services Lower Infrastructure Costs Economies of Scale More Infrastructure More AWS Usage 48 price reductions since 2006

9 Strategy 2: Do almost nothing

10 AWS Trusted Advisor aws.amazon.com/premiumsupport/trustedadvisor/ Free with Business or Enterprise Support

11 Strategy 3: Optimize Architecture

12 The basic process

13 Architecting for low cost

14 1: Turn off unused instances

15 1: Turn off unused instances Developer, test, training instances Use simple instance start and stop Or tear down and build up all together Instances are disposable Automate, automate, automate: AWS CloudFormation Weekend/off-hours scripts Use tags

16 Customer dev/test example Monday Friday End of Vacation Season 35% saved

17 2: Use Auto Scaling

18 Auto Scaling

19 AWS CloudFormation: Launch Configuration "LaunchConfig": { "Type" : "AWS::AutoScaling::LaunchConfiguration", "Metadata" : { "AWS::CloudFormation::Init" : { "config" : { packages, sources, files, services } } }, "Properties": { "ImageId" : "ami-149f7863", "InstanceType" : "m1.small", "SecurityGroups" : [ {"Ref" : "WebServerSecurityGroup"} ], "KeyName" : "MySSHKey", "UserData" : { "Fn::Base64" : { "Fn::Join" : ["", [ "#!/bin/bash -v\n", your user data script ]]}} } }

20 AWS CloudFormation: Auto Scaling group "WebServerGroup" : { } "Type" : "AWS::AutoScaling::AutoScalingGroup", "Properties" : { } "AvailabilityZones" : [ ], "us-east-1a", "us-east-1b", "us-east-1c", "LaunchConfigurationName" : { "Ref" : "LaunchConfig" }, "MinSize" : 3", "MaxSize" : 6", "DesiredCapacity" : 3", "LoadBalancerNames" : [ { "Ref" : "ElasticLoadBalancer" } ]

21 Align your resources with demand

22 3: Use Reserved Instances

23 3: Use Reserved Instances 3y RI Break even 1y RI Break even

24 Reserved Instances are flexible Can be moved between AZs Can be moved between EC2- Classic and EC2-VPC platforms Size can be modified within the same instance family

25 Track Savings over Time

26 4: Use Spot Instances

27 Spot Instance rules Price based on supply/demand You choose your maximum price/hour Your instance is started if the Spot price is lower Your instance is terminated if the Spot price is higher But: You did plan for fault tolerance, didn t you?

28 Spot Instance example $3.28 (1367%) On-Demand: $0.24 $0.028 (11.7%) $0.026 (10,8%)

29 Spot Instances recap Very dynamic pricing Opportunity to save 80-90% cost But there are risks Different prices per AZ Leverage Auto Scaling! One group with Spot Instances One group with On-Demand Get the best of both worlds Coming soon: 2-minute Spot interruption warnings

30 5: Use Amazon S3 storage classes Reduced redundancy storage class 99.99% durability vs % Up to 20% savings Everything that is easy to reproduce Use Amazon SNS lost object notifications Amazon Glacier storage class Same % durability 3 to 5 hours restore time Up to 64% savings Archiving, long-term backups, and old data Use life-cycle rules

31 6. Optimize Amazon DynamoDB capacity units Read/write capacity units (CUs) determine most of DynamoDB cost By optimizing CUs, you can save a lot of money But: Need to provision enough capacity to not run into capacity errors Need to prepare for peaks Need to constantly monitor/adjust

32 Use caching to save read capacity units Local RAM caches at app server instances Check out Amazon ElastiCache Think of strategies for optimizing CU use Use multiple tables to support varied access patterns Understand access patterns for time series data Compress large attribute values Use Amazon SQS to buffer over-capacity writes

33 Amazon SQS can buffer requests

34 Dynamic DynamoDB

35 DynamoDB optimization example Dynamic DynamoDB: 20% saved Caching/Optimization: 80% saved Cache flush Growth + new features

36 7. Offload your architecture The more you can offload, the less infrastructure you need to maintain, scale, and pay for Three easy ways to offload: Use Amazon CloudFront Introduce caching Leverage existing Amazon web services

37 Offload popular traffic to Amazon S3 and CloudFront

38 Offload databases through caching

39 Leverage existing services Amazon RDS, Amazon DynamoDB or Amazon ElastiCache for Redis, Amazon Redshift Instead of running your own database Amazon CloudSearch Instead of running your own search engine Amazon Elastic Transcoder Amazon Elastic MapReduce Amazon Cognito, Amazon SQS, Amazon SNS, Amazon Simple Workflow Service, Amazon SES, Amazon Kinesis, and more Simple, more reliable, lower cost

40 Cost monitoring & analysis

41 AWS TCO calculator

42 AWS simple monthly calculator

43 AWS Billing Console

44 AWS Cost Explorer

45 AWS billing alerts

46 Let s recap 1. Turn off unused instances 2. Use Auto Scaling 3. Use Reserved Instances 4. Use Spot Instances 5. Leverage Amazon S3 storage classes 6. Optimize Amazon DynamoDB capacity units 7. Offload your architecture

47 and remember to iterate!

48