Here comes the. Cloud. But is your architecture ready for

Transcription

1 Here comes the Cloud But is your architecture ready for

2 About Axel Fontaine Founder and CEO of Boxfuse Flyway creator Continuous Delivery & Immutable Infrastructure expert Java Champion, JavaOne

3 flywaydb.org

4 boxfuse.com

5 about questions

6 POLL: what type of infrastructure are you running on? On Premise Colocation Root Server Cloud

7 moving to the cloud

8 lift & shift (= the naïve approach)

9 Congratulations! You now have: lift & shift (= the naïve approach) Lots of (too much?) trust in your cloud provider + legal trouble due to data privacy laws A more expense Hetzner/OVH Potential data loss when auto-scaling

10 Fundamental changes 1. Security 2. Cost-driven 3. Auto-scaling

11 Security

12 understanding the cloud

13 regions

14 availability zones <<IMAGE GERMANY + two small clouds with racks>>

15 building blocks

16 building blocks Storage Compute Network Security

17

18 The hard Truth about Security 1. Always breakable with infinite time & resources 2. Must make it more complicated/expensive to break than it s worth (use defense in depth!) 3. Has a usability cost 4. Almost always about the data

19 the 3 states of data Data at Rest Data in Use Data in Motion

20 Trusting your neighbors is good. But it s even better to put a good lock on the door. Werner Vogels CTO of a large online book shop

21 Data in Motion TLS / SSL

22 Client-side encryption Data in Use & at Rest

23 Client-side encryption Encrypt sensitive & personally identifiable data Use different Encryption key for each field/record Encrypt Encryption Key using Key encrypting Key Secure & Rotate the Key encrypting Key

24 Key Management In App KMS HSM

25 Querying Encrypted Data Original Flyway Boxfuse Encrypted #!azw\b 67ftf6&)

26 Querying Encrypted Data Id Encrypted 123 #!azw\b ftf6&) Hmac Encrypted #!azw\b ftf6&) Low Fi Encrypted 48.5 #!azw\b ftf6&) Other clear text field Exact Match => Hmac Range => Lower fidelity => Use transparent persistence layer converters!

27 Cost

28 what is special about the cloud??

29 Every day, AWS adds enough server capacity to power the whole $7B enterprise Amazon.com was in Weekends included.

30 Shift to a world of abundance (no more resource scarcity)

31 "RIAN Control archive Kursk Nuclear Power Plane Plant" by RIA Novosti archive, image # / Sergey Pyatakov / CC-BY-SA 3.0. Licensed under CC BY-SA 3.0 via Wikimedia Commons - Kursk_Nuclear_Power_Plant.jpg#mediaviewer/File:RIAN_archi ve_341194_kursk_nuclear_power_plant.jpg "Advanced Data Test Reactor" by Argonne Plane National Laboratory - originally posted to Flickr as Advanced Test Reactor core, Idaho National LaboratoryUploaded using F2ComButton. Licensed under CC BY-SA 2.0 via Wikimedia Commons - tor.jpg#mediaviewer/file:advanced_test_reactor.jpg

32 Control Plane Data Plane

33 Automated Provisioning Cost-driven Architectures

34 Compute

35 Spare capacity is wasted money (paying for something you don t use)

36 instance types General Purpose CPU RAM Disk

37 scaling up in out down

38 scaling & costs vs prefer smaller granularity

39 Auto-scaling

40 Auto-Scaling = automated alarms + automated corrective actions

41 scaling triggers for different types of services sync => load async => queue depth cron => time

42 Image Instance? Fully Baked Provisioned on Startup

43 Every Instance 100% identical Fastest startup Launch always succeeds Most people Fully Baked Provisioned on Startup

44 One immutable unit Regenerated after every change Promoted from environment to environment Most people Fully Baked Provisioned on Startup

45 What are the implications???

46 Focus shift Instance Service Individual instances become disposable

47 Treat servers like cattle instead of pets

48 How to solve service discovery?? Elastic Load Use a stable Balancer entry point with an internal registry Instance Instance Instance

49 what about configuration??? Bake as much configuration as possible for all environments directly in the Bootable App Use environment detection and auto-configuration

50 what about configuration??? Bake as much configuration as Key Value possible for all environments JDBC_URL jdbc: directly in the Bootable App ENV prod Use environment detection and auto-configuration Pass remaining Image configuration at startup and expose it as environment variables

51 what about the database??? Instance Keep all persistent state out of the instance, including the database Use one of the many good hosted solutions available like Amazon RDS or Google Cloud SQL Use a database migration tool to update the schema on application startup

52 LOG file what about the logs??? ssh tail -f server.log LOG file ssh tail -f server.log LOG file ssh tail -f server.log

53 LOG file LOG file LOG file log server where logs can be aggregated stored and backuped indexed searched

54 what about sessions??? Instance Keep session in an encrypted and signed cookie avoids session timeouts avoids server clustering & session replication avoids sticky sessions & server affinity

55 what about containers??? (as in OS-level virtualization)

56 understanding modern CPUs Both Intel and AMD have hardware support for virtualization isolation performance penalty

57 cloud VM Hypervisor

58 cloud Image Image VM Hypervisor machine images instance scheduling hardware capacity instance volumes instance networking

59 your responsibility cloud + Container container images container scheduling cluster capacity container volumes container networking Cont. Runt. ImageOS Image VM Hypervisor machine images instance scheduling hardware capacity instance volumes instance networking

60 1 hour of t2.nano VM Hypervisor machine images instance scheduling hardware capacity instance volumes instance networking

61 1 month of t2.nano VM Hypervisor machine images instance scheduling hardware capacity instance volumes instance networking

62 1 year of t2.nano VM Hypervisor machine images instance scheduling hardware capacity instance volumes instance networking

63 Only makes sense if you cannot afford 0.5 cent/hour granularity Image Image + Container container images container scheduling cluster capacity container volumes container networking Cont. Runt. OS VM Hypervisor machine images instance scheduling hardware capacity instance volumes instance networking

64 optimize for total monthly bill not resource usage

65 summary Put a good lock on the door (use encryption!) Optimize architecture for cost Auto-Scale & treat servers like cattle

66 Fully baked images generated in seconds (not minutes or hours) Optimized for JVM, Node.js and Go apps (Spring Boot, Dropwizard, Tomcat, TomEE,...) Minimal images just 1% of size of regular OS (measured in MB not GB) boxfuse.com Images work on VirtualBox & AWS (environment parity from dev to prod) Zero downtime updates on AWS (fully automatic blue/green deployments)

67 final disclaimer no animals were harmed while making this talk

68 @axelfontaine Thanks! boxfuse.com