DevOps + Infrastructure TRACK SUPPORTED BY

Size: px

Start display at page:

Download "DevOps + Infrastructure TRACK SUPPORTED BY"

Phillip Smith
5 years ago
Views:

2 DevOps + Infrastructure TRACK SUPPORTED BY

About me Nils Peeters DevOps Engineer nils@scalecity.

3 About me Nils Peeters DevOps Engineer

4 Containerized Drupal, Kubernetes and blue/green Down the rabbit hole

5 Agenda Kubernetes What, how and why Q&A Drupal 8 Containerized Q&A Deploying CI/CD Rolling-update Blue-green Q&A

6 Kubernetes The what, how and why

7 What is Kubernetes? Open source Borg commits 1800 contributors Google, Microsoft, Red Hat and Huawei Cloud Native Computing Foundation

8 What is Kubernetes? Container orchestrator Automation

9 What is Kubernetes? Master API Server

10 What is Kubernetes? Nodepool(s) Same machine type

11 What is Kubernetes? Node Machine (VM) COS Fleeting Pods

12 Pods vs Containers What is this Pod you speak of?

13 Pods vs Containers Pod!= Container

14 Image reference: Technology X I m a container! I m a pod! Technology X

15 Pods vs Containers: example PHP-fpm Nginx

16 Pods vs Containers: example

17 Pods vs Containers: example ElasticSearch Kibana

18 Pods vs Containers: example

19 Pods vs Containers: example d

20 Pod vs Containers apiversion: v1 kind: Pod metadata: name: www spec: containers: - name: my-nginx image: docker.example.com/nginx:1.14 ports: - containerport: name: my-php image: docker.example.com/php:7.1-fpm ports: - containerport: 9000

21 Services Connecting the Pods

22 Services Networking component Labels Name = hostname

23 Services kind: Service apiversion: v1 metadata: name: www spec: ports: - protocol: TCP port: 80 targetport: 8080 Will resolve as hostname www:80

24 Labels & label selectors Connecting the dots

25 Labels & label selectors Services connect pods Key value Get operations by label

26 Labels & label selectors

27 Labels & label selectors

28 Labels & label selectors

29 Labels & label selectors apiversion: v1 kind: Pod metadata: name: elastic labels: app: elastic role: master spec: containers: - name: my-apache image: docker.example.com/elasticsearch:6.4 ports: - containerport: 8080

30 Labels & label selectors apiversion: v1 kind: Service metadata: name: elastic labels: name: elastic spec: selector: app: elastic role: master ports: - protocol: TCP port: 80 targetport: 8080 Watch out here!

31 Configmaps & Secrets You pods act my way, or the highway

32 Configmaps Pod configuration Attached by name Deploy = upload to master

33 Secrets Configmap + encryption Great for stuff like API keys

34 Configmaps / Secrets apiversion: v1 kind: ConfigMap metadata: name: my-apache-config data: my.conf: <VirtualHost *:8080> DocumentRoot "/www/example1" ServerName </VirtualHost>

35 Configmaps / Secrets apiversion: v1 kind: Pod spec: containers: - name: my-apache image: docker.example.com/apache:2.4 ports: - containerport: 8080 volumemounts: - name: sites-enabled-config mountpath: /etc/apache2/sites-enabled/default.conf subpath: my.conf volumes: - name: sites-enabled-config configmap: name: my-apache-config

36 Drupal 8 Containerized

37 Component breakdown D8

38 Container breakdown D8 PHP-fpm MySQL Nginx Varnish

39 Container breakdown D8 Linux cron

40 Container buildup: cron

41 Pod buildup & dataflow varnish:80,443 www:80 mysql:3306 cron

42 Deploying All that good stuff

43 Jenkins Knowledge in-house Pipeline script Lazy Java Mature

44 Rolling update Default deploy method in Kubernetes

45 Rolling update Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.13 nginx: 1.13 nginx: 1.13

46 Rolling update Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.13 nginx: 1.13 nginx: 1.13

47 Rolling update Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.13 nginx: 1.13 nginx: 1.13

48 Rolling update Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.13 nginx: 1.13

49 Rolling update Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.13 nginx: 1.13

50 Rolling update Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.13

51 Rolling update Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.13

52 Rolling update Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.14

53 Rolling update Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.14

54 Blue-green Not available in vanilla kubernetes

55 Blue-green Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.13 nginx: 1.13 nginx: 1.13

56 Blue-green Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.13 nginx: 1.13 nginx: 1.13 nginx: 1.14 nginx: 1.14 nginx: 1.14

57 Blue-green Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.13 nginx: 1.13 nginx: 1.13 nginx: 1.14 nginx: 1.14 nginx: 1.14

58 Blue-green Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.13 nginx: 1.13 nginx: 1.13 nginx: 1.14 nginx: 1.14 nginx: 1.14

59 Blue-green Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.13 nginx: 1.13 nginx: 1.13 nginx: 1.14 nginx: 1.14 nginx: 1.14

60 Blue-green Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.14

61 Blue-green Use-case: upgrading nginx from 1.13 to 1.14 nginx: 1.14 nginx: 1.14 nginx: 1.14

62 Why now Not new Duplicate entire infrastructure Cheaper Stateless

63 Advantages Never in a mixed state Less downtime vs classic deployment

64 Blue-green Use-case: upgrading drupal Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

65 Blue-green Use-case: upgrading drupal Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

66 Advantages Never in a mixed state Less downtime vs classic deployment Safety nets Rollback

67 Blue-green gone wrong Use-case: fallback on faulty code Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

68 Blue-green gone wrong Use-case: fallback on faulty code Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

69 Blue-green gone wrong Use-case: fallback on faulty code Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

70 Blue-green gone wrong Use-case: fallback on faulty code Codebase v1 Codebase v1 Codebase v1

71 Advantages Never in a mixed state Less downtime vs classic deployment Safety nets Rollback Canary

72 Blue-green canary Use-case: canary Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

73 Blue-green canary Use-case: canary Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

74 Blue-green canary Use-case: canary Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

75 Blue-green canary Use-case: canary Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

76 Blue-green canary Use-case: canary Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

77 Blue-green canary Use-case: canary Codebase v1 Codebase v1 Codebase v1 Codebase v2 Codebase v2 Codebase v2

78 Advantages Never in a mixed state Less downtime vs classic deployment Safety nets Rollback Canary

79 Issues Costly Stateful components Can get pretty confusing Communication and teamwork required

80 Drupal pitfalls Stateful component Duplication? Content freeze? Deploy commands One or all replica s? On blue or green stack?

81 Thanks! Nils Peeters DevOps ScaleCity nils@scalecity.io

82 Become a Drupal contributor Friday from 9am First timers workshop Mentored contribution General contribution

83 Thanks! Nils Peeters DevOps ScaleCity nils@scalecity.io

Code: Slides:

Code: Slides: Workshop Resources Code: https://github.com/beekpr/public-workshops Slides: https://tinyurl.com/yc2uo3wk Make sure minikube and kubectl is setup (labs/1-setup-cluster.md has some instructions) Kubernetes