Freitag, 2. November 12

Transcription

1

2 Click to edit Master title style Click to edit Master text styles

3

4

5 Angry Birds Shop Cloud Auto-Scaling Presented by Kian T. Gould

6 The Angrybirds Merchandize Shop

7

8

9 Traffic Peaks

10 Angrybirds Magento Universe Magento Store DRM Server Storefronts Reporting Products + Warehouse Invetory Ordermgmt Mail Service Shipwire Giftcards Manage Warehouse Fullfillment Braintree

11 Angrybirds Magento Universe Magento Store Storefronts Products + Warehouse Invetory Shipwire Manages Worldwide Reporting Warehouses Ordermgmt Find best way for order Fullfillment DRM Server Mail Service Giftcards Shipwire Manage Warehouse Fullfillment Braintree

12 Why Amazon Cloud?

13 Scales quickly on demand Pay only what you need

14 Useful AWS Services EC2 S3 RDS Cloud Elastic ELB R53 Front Cache Amazon Webservices & Amazon Console Rightscale Services

15 Cloud Drawbacks? Complexity Plan for EC2 Failover Plan Security Need to adjust Application Lack of Service

16 Cloud Drawbacks? Complexity Plan Security Architecture Requirements High availibility (Multiple Failover and Loadbalancing) Magento admin Backend independent from Shop-Frontend Efficient and independent background task management Aggressive caching Asset management in the cloud Lack of Service Plan for EC2 Failover Need to adjust Application

17

18 How does the cloud architecture look?

19

20 Architecture ELB R53 DNS Cloud Front CDN for Skin Cloud Front CDN for Assets S3 Assets Storage Varnish Frontend Array Autoscaling FE FE FE Backend Array Worker Array Elastic Cache Cache Backend S3 Deployment RDS mysql

21 Scaling is about finding the Bottleneck

22 Scaling and Tuning Bottleneck Bandwidth Varnish Array Load Varnish Varnish Balancing Cloud Front Bottleneck CPU Frontend Array Autoscaling FE FE FE FE FE FE FE FE FE FE FE FE FE FE FE FE FE FE FE Bottleneck Database RDS mysql Elastic Cache Cache Backend

23 Image Caching Frontend Frontend Backend Cloud Front CDN for Assets Image resized? Read and save resized images S3 Assets Storage Upload new original images to S3

24 The 6 Caching senses 1. achieve a high hit rate 2. dont flood your cache 3. deliver as fast as required 4. never loose all cache at once 5. clean up old cache entries 6. be able to clean/refresh on demand

25 Magento Performance hints 1. Asyncronous Cache Clearing Queue 2. Take care of Cache Cleaning (Magento does not?!) 3. Disable Magento Logs (No option available?!) 4. Make page cacheable in Varnish (Aoe_Static) 5. and... Profiling, Profiling, Profiling: 6. xdebug + kcachegrind 7. Newrelic 8. xhprof

26 Magento Cloud-Adjustments 1. Compress Javascript + CSS on deploy time 2. Prefix bundeled JS and CSS with timestamp 3. Use Deployment name as Cache prefix 4. Health Check for LB 5. automatic Varnish Purging 6. Mail distribution handling 7. Asset handling

27

28 Lessons learned is too expensive => cache or redirect 2. Cloudfront with S3 backend cannot handle gzip => deploy time bundeling/compression 3. You cannot forsee everything (Collection handling) => But you can be prepared to fix things quickly => continuous deployment

29

30 Continuous Deployment

31

32 Don t be scared of releasing to production

33 Definition of Continuous Deployment We want on demand deployment of tested features and fixes in a fast and reliable way

34 You can achieve this by Automating everyting Build Testing Deployment

35 ..and doing it frequently

36

37 The Deployment Pipeline

38

39 Angrybirds Deployment Pipeline SVN Backup Storage Commit and Build Unit Tests Install on latest Selenium Acceptance Tests Performance Tests Build Downstream and Test Strategy Feedback to Developers

40 Magento Installation Package htdocs [Magento Source] Filesystem Database Install Binaries settings.php media 1.set maintenance mode.modman 2.Delta [Custom Package Packages] prepare changelog.txt 3.apply Database 4.sync files 5.run modman deploy-all 6.adjust Settings 7.Post install: fix p. / cache clean /...

41 Angrybirds Deployment Pipeline Install on Cloud Integration Cloud Deployment Copy to S3 Deployment Tests deployment System Staging AOE + Rovio production

42 Cloud Deployment Development «88 Production» R53 DNS Development «89 Production» Varnish Array Start new release by Varnish Array ELB V V V ELB cloning old deployment V V V adjusting release number Autoscaling Backend Worker Autoscaling Backend Worker Frontend Array Array Array Frontend Array Array Array FE FE FE BE BE BE W FE FE FE BE BE BE W RDS mysql S3

43

44 The real life

45

46 Day 1 - Release 1

47 Day 2 - Release 2 - get ready for Space

48 Day 3 - People want it so badly USA wakes up Space game launched Array scales up New release deployed

49 Day 4 - Release 3 Performance Improvement Not more than 100% CPU in total. 2 FE Servers are enough

50

51 100 DEVELOPERS 7 COUNTRIES 12 YEARS 2700% CLIENTS GROWTH OS COMMUNITY

52

53 Thank you AOE media GmbH Borsigstr Wiesbaden Germany Tel.: Fax: Web: