Immutable Infrastructure

Transcription

1 Immutable Infrastructure The New App Deployment AXEL

2 About Axel Fontaine Founder and CEO of Boxfuse Over 15 years industry experience Continuous Delivery expert Regular speaker at tech conferences JavaOne RockStar in

3 flywaydb.org

4 boxfuse.com

5 Let s start with a small story

6 Incandescent Bulb 60 W LED Bulb 10 W

7 Heater that gives off a little bit of light Light that gives off a little bit of heat

8

9 Edison Screw

10 My responsibility Simple, stable, standards-compliant interface The electricity company s responsibility with a clear contract

11 Room For Innovation Simple, stable, standards-compliant interface Undifferentiated Heavy Lifting with a clear contract

12 back to IT infrastructure

13 POLL: what type of infrastructure are you running on? On Premise Colocation Root Server Cloud

14 How did this evolve?

15 sometime in the 20 th century

16

17

18

19 ON = + + PREM Challenges Power, Network, Cooling Physical Security Physical Space Procurement, Vendor Management Capacity Planning Financing OS + Patches App + Updates

20 ON = + + PREM Our responsibility

21 COLO= + + Our responsibility Their responsibility

22 = + + COLO Simple, stable, standards-compliant interface: (19 Rack, AC Power, Ethernet, )

23 COLO = + + Undifferentiated Heavy Lifting Our responsibility Can change as long as it complies with the interface contract

24 ROOT SERVER = + Undifferentiated Heavy Lifting Our responsibility Can change as long as it complies with the interface contract

25 ROOT SERVER = + Undifferentiated Heavy Lifting Simple, stable, standardscompliant interface Software <-> Hardware

26 Room For Innovation + Undifferentiated Heavy Lifting Simple, stable, standardscompliant interface Could this be our industry s Edison Screw?

27 Let s talk about software

28 POLL: which level of automation are you at? Build Unit Tests Continuous Integration Acceptance Tests Continuous Deployment (Code) Continuous Deployment (Code + DB + Configuration) Infrastructure

29 Build Test

30 One immutable unit Regenerated after every change Promoted from Environment to Environment Classic Mistake: Build per Environment

31 App App Server Language Libraries OS Kernel

32 App App Server Language Libraries OS Kernel

33 why aren t we doing the same for the layers this is running on???

34 what could possibly go wrong in these other layers???

35 missing software

36 wrong name

37 bad version

38 incorrect permissions

39 critical resource in use

40 what aren t we holding our servers to the same standards as our applications???

41

42 Build Test App App Server Language Libraries OS Kernel

43 Build Test App App Server Language Libraries OS Kernel

44 Multiple instances in multiple Environments App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel

45 Multiple instances in multiple Environments App App Server Language Libraries OS Kernel All instances should be as similar as possible (any difference is a potential source of errors) That also includes your local Dev environment! Must be able to reliably provision new ones (and recreate existing ones from scratch)

46 Sysadmin Updates Updates Updates App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel

47 If I had asked my customers what they wanted they would have said a faster horse. Henry Ford

48 Sysadmin Updates Updates Updates App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel

49 Updates Updates Automated Sysadmin Updates App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel

50 fast forward to 2015

51 Every day, AWS adds enough server capacity to power the whole $5B enterprise Amazon.com was in Weekends included.

52 "RIAN Control archive Kursk Nuclear Power Plane Plant" by RIA Novosti archive, image # / Sergey Pyatakov / CC-BY-SA 3.0. Licensed under CC BY-SA 3.0 via Wikimedia Commons - Kursk_Nuclear_Power_Plant.jpg#mediaviewer/File:RIAN_archi ve_341194_kursk_nuclear_power_plant.jpg "Advanced Data Test Reactor" by Argonne Plane National Laboratory - originally posted to Flickr as Advanced Test Reactor core, Idaho National LaboratoryUploaded using F2ComButton. Licensed under CC BY-SA 2.0 via Wikimedia Commons - tor.jpg#mediaviewer/file:advanced_test_reactor.jpg

53 Control Plane Data Plane

54 Benefits of the cloud Shift to a world of abundance (no more resource scarcity) Clean Control Plane/Data Plane split with API-based provisioning Cost-based Architectures with the ability to turn infrastructure off

55 it is time to rethink the faster horse

56 Build Test App App Server Language Libraries OS Kernel

57 Build Test App App Server Language Libraries OS Kernel Undifferentiated Heavy lifting

58 Build Test App App Server Language Libraries OS Kernel

59 App Build Test Machine Image App Server Machine Language Image Libraries OS Kernel

60 Updates App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel App App Server Language Libraries OS Kernel

61 Updates Machine Image Machine Image Machine Image

62 but there is one big problem left

63 Machine Image Network Cable

64 Machine Multiple Image GB Network Cable

65 Running servers in production should be like going backpacking. You take the bare minimum with you. Anything else is going to hurt. A Wise Man

66 what is really adding business value???

67 Machine Image Network Cable

68 App App Server Package Mgr Compilers Editors SSH Firewall Drivers Daemons Compatibility Man Pages Language Log Files Utilities Users Shells Libraries OS Kernel Network Cable

69 App App Server Language Bootable App Libraries OS Kernel

70 Multiple GB MB

71 Bootable App Network Cable

72 who is this for???

73 App App Server Language Libraries OS Kernel 12-factor app

74 demo

75 What are the implications???

76 Focus shift Instance Service Individual instances become disposable

77 Treat servers like cattle instead of pets

78 high uptime is a liability The longer an instance is up, the harder it becomes to recreate exactly (and it will fail eventually!)

79 How to solve service discovery?? Elastic Load Balancer Bootable App Bootable App Bootable App Use a stable entry point with an internal registry

80 What about security? When was the last time your toaster got hacked?

81 What about security? Smallest possible attack surface Vastly reduced implications due to low uptime and transient nature of instances Very difficult to exploit other systems because essential tooling is missing

82 what about configuration??? Bake as much configuration as possible for all environments directly in the Bootable App Use environment detection and auto-configuration Pass remaining configuration at startup and expose it as environment variables

83 what about the database???

84 what about the database??? Bootable App

85 what about the database??? Keep all persistent state, including the database, out of the instance Many good hosted solutions available like Amazon RDS or Google Cloud SQL Use a database migration tool like Flyway to update on application startup

86 what about the logs??? Bootable App Ship logs to a central log server where they can be aggregated stored and backuped indexed searched through a nice web UI Many good hosted solutions Loggly Logentries Papertrail

87 what about sessions??? Bootable App Keep session in an encrypted and signed cookie avoids session timeouts avoids server clustering & session replication avoids sticky sessions & server affinity

88 what about rolling out new versions???

89 Availability Zone 1 App v1 Load Balancer App v1 Logs Availability Zone 2

90 Availability Zone 1 App v1 Load Balancer App v2 App v1 App v2 Availability Zone 2 Logs

91 Availability Zone 1 Load Balancer App v2 App v2 Logs Availability Zone 2

92 what about containers???

93 understanding modern CPUs Both Intel and AMD have hardware support for virtualization isolation performance

94 Bootable App Hypervisor Hardware Bootable App OS+Container Runtime Hardware On Prem On Prem

95 Only makes sense if you cannot afford $9.60/month granularity Bootable App Hypervisor Hardware Bootable App OS+Container Runtime Hardware Bootable App OS+Container Runtime Hypervisor Hardware On Prem / Cloud On Prem Cloud

96 Only makes sense if you cannot afford 1.3 cents /hour granularity Bootable App Hypervisor Hardware Bootable App OS+Container Runtime Hardware Bootable App OS+Container Runtime Hypervisor Hardware On Prem / Cloud On Prem Cloud

97 summary

98 One immutable unit Regenerated after every change Promoted from Environment to Environment Classic Mistake: Build per Environment

99 Bootable App One immutable unit Regenerated after every change Promoted from Environment to Environment Classic Mistake: Build per Environment

100 boxfuse.com

101 AXEL Thanks! boxfuse.com