Immutable Infrastructure

Transcription

1 @axelfontaine Immutable Infrastructure Rise of the Machine Images

2 About Axel Fontaine Founder and CEO of Boxfuse Over 15 years industry experience Continuous Delivery expert Regular speaker at tech conferences JavaOne

3 flywaydb.org

4 boxfuse.com

5 about questions

6 sometime in the 20 th century

7

8

9

10 Challenges ON = + + PREM OS Install OS Patching App Install App Updates Procurement Vendor Mgmt Capacity Plan. Financing Power Network Cooling Phys. Security Phys. Space

11 Challenges ON = + + PREM OS Install OS Patching App Install App Updates Procurement Vendor Mgmt Capacity Plan. Financing Power Network Cooling Phys. Security Phys. Space

12

13 Challenges ON = + + PREM OS Install OS Patching App Install App Updates Procurement Vendor Mgmt Capacity Plan. Financing Power Network Cooling Phys. Security Phys. Space Hours Days or Weeks Months

14 Challenges COLO = + + OS Install OS Patching App Install App Updates Procurement Vendor Mgmt Capacity Plan. Financing Power Network Cooling Phys. Security Phys. Space Hours Days or Weeks Months

15 Challenges ROOT SERVER = + + OS Install OS Patching App Install App Updates Procurement Vendor Mgmt Capacity Plan. Financing Hours Days or Weeks

16 Let s talk about software OS Install OS Patching App Install App Updates

17 POLL: which level of automation are you at? Build Unit Tests Continuous Integration Acceptance Tests Continuous Deployment (Code) Continuous Deployment (Code + DB + Configuration) Infrastructure

18 Build Test

19 Build Test

20 One immutable unit Regenerated after every change Promoted from Environment to Environment Classic Mistake: Build per Environment

21 App App Server Language Libraries OS Kernel

22 App App Server Language Libraries OS Kernel

23 why aren t we doing the same for the layers this is running on???

24

25 Build Test App App Server Language Libraries OS Kernel

26 Build Test App App Server Language Libraries OS Kernel

27 Any difference is a potential source of errors App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel

28 Sysadmin Updates Updates Updates App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel

29 If I had asked my customers what they wanted they would have said a faster horse. Henry Ford

30 Sysadmin Updates Updates Updates App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel

31 Updates Updates Automated Sysadmin Updates App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel

32 fast forward to 2016

33 Every day, AWS adds enough server capacity to power the whole $7B enterprise Amazon.com was in Weekends included.

34 Shift to a world of abundance (no more resource scarcity)

35 "RIAN Control archive Kursk Nuclear Power Plane Plant" by RIA Novosti archive, image # / Sergey Pyatakov / CC-BY-SA 3.0. Licensed under CC BY-SA 3.0 via Wikimedia Commons - Kursk_Nuclear_Power_Plant.jpg#mediaviewer/File:RIAN_archi ve_341194_kursk_nuclear_power_plant.jpg "Advanced Data Test Reactor" by Argonne Plane National Laboratory - originally posted to Flickr as Advanced Test Reactor core, Idaho National LaboratoryUploaded using F2ComButton. Licensed under CC BY-SA 2.0 via Wikimedia Commons - tor.jpg#mediaviewer/file:advanced_test_reactor.jpg

36 Control Plane Data Plane

37 Automated Provisioning Cost-driven Architectures

38 it is time to rethink the faster horse

39 Build Test App App Server Language Libraries OS Kernel

40 Build Test App App Server Language Libraries OS Kernel Undifferentiated Heavy lifting

41 Build Test App App Server Language Libraries OS Kernel

42 App Build Test Machine Image App Server Machine Language Image Libraries OS Kernel

43 App App Server Machine Language Image Libraries OS Kernel App App Server Machine Language Image Libraries OS Kernel App App Server Machine Language Image Libraries OS Kernel

44 Updates Machine Image Machine Image Machine Image

45 but there is one big problem left

46 Machine Image Network Cable

47 Machine Multiple Image GB Network Cable

48 Running servers in production should be like going backpacking. You take the bare minimum with you. Anything else is going to hurt. A Wise Man

49 what is really adding business value???

50 Machine Image Network Cable

51 App App Server Compatibility Man Pages Package Mgr Compilers Editors SSH Language Machine Image Log Files Utilities Users Network Cable Firewall Drivers Daemons Shells Libraries OS Kernel

52 App App Server Language Bootable App Libraries OS Kernel

53 15 MB

54 Multiple GB 15 MB

55 Network Cable Bootable App

56 who is this for???

57 App App Server Language Libraries OS Kernel 12-factor app

58 demo

59 What are the implications???

60 Focus shift Instance Service Individual instances become disposable

61 Treat servers like cattle instead of pets

62 for servers is dead!

63 high uptime is a liability The longer an instance is up, the harder it becomes to recreate exactly (and it will fail eventually!)

64 How to solve service discovery?? Elastic Load Use a stable Balancer entry point with an internal registry Instance Instance Instance

65 What about security? When was the last time your toaster got hacked?

66 What about security? Complexity is the Enemy of Security

67 What about security? Smallest possible attack surface Bootable App Vastly reduced implications due to low uptime and transient nature of instances Very difficult to exploit other systems because essential tooling is missing

68 what about configuration??? Bake as much configuration as possible for all environments directly in the Bootable App Use environment detection and auto-configuration

69 what about configuration??? Bake as much configuration as Key Value possible for all environments JDBC_URL jdbc: directly in the Bootable App ENV prod Use environment detection and auto-configuration Bootable App Pass remaining configuration at startup and expose it as environment variables

70 what about the database??? Instance Keep all persistent state out of the instance, including the database Use one of the many good hosted solutions available like Amazon RDS or Google Cloud SQL Use a database migration tool to update the schema on application startup

71 LOG file what about the logs??? ssh tail -f server.log LOG file ssh tail -f server.log LOG file ssh tail -f server.log

72 LOG file LOG file LOG file log server where logs can be aggregated stored and backuped indexed searched

73 what about sessions??? Instance Keep session in an encrypted and signed cookie avoids session timeouts avoids server clustering & session replication avoids sticky sessions & server affinity

74 what about rolling out new versions???

75 Availability Zone 1 App V1 Load Balancer App V1 Logs Availability Zone 2

76 Availability Zone 1 App V1 Load Balancer App V1 Logs Availability Zone 2

77 Availability Zone 1 App V1 Load Balancer App V2 App V1 App V2 Availability Zone 2 Logs

78 Availability Zone 1 App V1 Load Balancer App V2 App V1 App V2 Availability Zone 2 Logs

79 what about containers??? (as in OS-level virtualization)

80 understanding modern CPUs Both Intel and AMD have hardware support for virtualization isolation performance penalty

81 on prem Image Hypervisor Hardware Image OS+Container Runtime Hardware your responsibility VM Container

82 cloud Image Image Hypervisor Hardware OS+Container Runtime Hypervisor Hardware VM Container

83 cloud container images container scheduling containers container volumes container networking your responsibility machine images instance scheduling instances instance volumes instance networking cloud responsibility

84 1.5 months of t2.nano

85 1 hour of t2.nano

86 cloud Only makes sense if you cannot afford 0.5p/hour granularity container images container scheduling containers container volumes container networking your responsibility machine images instance scheduling instances instance volumes instance networking cloud responsibility

87 summary

88 One immutable unit Regenerated after every change Promoted from Environment to Environment Classic Mistake: Build per Environment

89 Bootable App One immutable unit Regenerated after every change Promoted from Environment to Environment Use Minimal Images Focus on Cost in your architecture Classic Mistake: Build per Environment

90 boxfuse.com

91 Thanks

92 AXEL I'LL BE BACK boxfuse.com