Stephan Hochdörfer //

Transcription

1 From dev to prod with GitLab CI Stephan Hochdörfer //

2 About me Stephan Hochdörfer Head of Technology, bitexpert AG (Mannheim, #PHP, #DevOps, #Automation #phpugffm, #phpugmrn, #unkonf

3 GitLab «[...] is a web-based Git-repository manager with wiki and issue-tracking features.» - Wikipedia

4 Beyond CI/CD Source: Kharnagy CC BY-SA 4.0(Wikimedia Commons)

5 GitLab: Installation $> docker run \ --detach \ --publish 80:80 \ --publish 22:22 \ --name gitlab \ --restart always \ --volume /srv/gitlab/config:/etc/gitlab \ --volume /srv/gitlab/logs:/var/log/gitlab \ --volume /srv/gitlab/data:/var/opt/gitlab \ gitlab/gitlab-ce:latest

6 Sonatype Nexus «A single source of truth for ALL your so ware parts.» - sonatype.com

7 $> docker run \ --detach \ --publish 80:80 \ --publish 443:433 \ --name nexus \ --restart always \ bitexpert/nexus Nexus: Installation

8 Nexus Repository Manager

9 Nexus: Docker Authentication $> docker login nexus.loc Username: Password: Login Succeeded

10

11 traefik configuration defaultentrypoints = ["http", "https"] [entrypoints] [entrypoints.http] address = ":80" [entrypoints.http.redirect] entrypoint = "https" [entrypoints.https] address = ":443" [entrypoints.https.tls] [[entrypoints.https.tls.certificates]] CertFile = "/etc/traefik/ssl/myapp.loc.pem" KeyFile = "/etc/traefik/ssl/myapp.loc.key" [docker] endpoint = "unix:///var/run/docker.sock" domain = "myapp.loc" watch = true exposedbydefault = true

12 traefik: Installation $> docker run -d \ --restart=always \ --publish 8080:8080 \ --publish 80:80 \ --publish 443:443 \ -volume /var/run/docker.sock:/var/run/docker.sock \ -volume /etc/traefik/traefik.toml:/etc/traefik/traefik.toml traefik

13 GitLab: Create project

14 GitLab: Push the code $> composer create-project --repository-url= \ magento/project-community-edition my-app Installing magento/project-community-edition (2.2.4) - Installing magento/project-community-edition (2.2.4): Loading from cache Created project in my-app Loading composer repositories with package information Updating dependencies (including require-dev) Package operations: 257 installs, 0 updates, 0 removals - Installing magento/magento-composer-installer (0.1.13): Loading from cache -... Writing lock file Generating autoload files $> cd my-app $> git add -A && git commit -m "Initial Magento setup" $> git push

15 GitLab: Push the code

16 GitLab Runner «[...] is the open source project that is used to run your jobs and send the results back to GitLab. It is used in conjunction with GitLab CI [...] that coordinates the jobs.» - GitLab Runner

17 GitLab Runner: Run the daemon $> docker run \ --detach \ --name gitlab-runner \ --restart always \ --volume /srv/gitlab-runner/config:/etc/gitlab-runner \ --volume /var/run/docker.sock:/var/run/docker.sock \ gitlab/gitlab-runner:latest

18 GitLab Runner: Register new instance $> docker exec -it gitlab-runner gitlab-runner register Please enter the gitlab-ci coordinator URL (e.g. Please enter the gitlab-ci token for this runner: Please enter the gitlab-ci description for this runner: Please enter the gitlab-ci tags for this runner (comma separated): Whether to run untagged builds [true/false]: Whether to lock the Runner to current project [true/false]: Please enter the executor: docker, shell,...: Please enter the default Docker image (e.g. ruby:2.1):

19 GitLab Runner: Configuration concurrent = 4 check_interval = 0 [[runners]] name = "Docker Runner" url = " token = "50bf240bb1a7ab39e116a b" executor = "docker" [runners.docker] tls_verify = true image = "debian:stretch" privileged = false disable_cache = false volumes = [ "/home/gitlab-runner/.composer:/root/.composer:rw" ] shm_size = 0 [runners.cache]

20 GitLab: Managing secrets «GitLab CI allows you to define per-project or per-group secret variables that are set in the pipeline environment.» - GitLab

21 GitLab CI: Storing secrets

22 GitLab: Add.gitlab-ci.yml image: php:7.1-cli test: stage: test tags: - docker script: - apt-get update -q && DEBIAN_FRONTEND=noninteractive apt-get instal - docker-php-ext-configure gd --with-freetype-dir=/usr/include/ --wi - php -r "copy(' 'setup.php');" - php -r "if (hash_file('sha384', 'composer-setup.php') === '544e09e - php setup.php --install-dir=/usr/local/bin - php -r "unlink('setup.php');" - composer.phar config \ http-basic.repo.magento.com $MAGENTO_USER $MAGENTO_PASS - composer.phar install

23 GitLab CI: Pushed configuration

24 GitLab CI: Build Pipeline

25 GitLab CI: Build Pipeline

26 GitLab CI: Build Pipeline

27 GitLab Services «[...] defines just another Docker image that is run during your job and is linked to the Docker image that the image keyword defines.» - GitLab

28 GitLab Services health check Checks which ports are exposed from the container by default Starts a special container that waits for these ports to be accessible

29 GitLab CI: Add MySQL service image: php:7.1-cli variables: MAGENTO_DATABASE: magento2 MYSQL_ROOT_PASSWORD: magento2 test: stage: test tags: - docker script: -... services: - mysql:5.6

30 GitLab CI: Add MySQL service

31 Build Pipelines «A pipeline is a group of jobs that get executed in stages (batches)» - GitLab

32 Build Pipelines (Shared config) image: php:7.1-cli variables: MAGENTO_DATABASE: magento2 MYSQL_ROOT_PASSWORD: magento2 stages: - test - build - deploy before_script: - apt-get update -q && DEBIAN_FRONTEND=noninteractive apt-get instal - docker-php-ext-configure gd --with-freetype-dir=/usr/include/ --wi - php -r "copy(' 'setup.php');" - php -r "if (hash_file('sha384', 'composer-setup.php') === '544e09e - php setup.php --install-dir=/usr/local/bin - php -r "unlink('setup.php');" - composer.phar config http-basic.repo.magento.com $MAGENTO_USER $MA - composer.phar install

33 Build Pipelines (Test & Build) test: stage: test tags: - docker script: -... services: - mysql:5.6 build: stage: build tags: - docker script: -... services: - mysql:5.6

34 Build Pipelines (Stage Deployment) deploy_staging: stage: deploy tags: - docker-stage script: -... variables: GIT_STRATEGY: none environment: name: staging url: only: - master

35 Running your Build Pipeline

36 Running your Build Pipeline

37 Running your Build Pipeline

38 How to build the container? tar cvfz /tmp/myapp-$ci_commit_ref_slug.tgz. mv /tmp/myapp-$ci_commit_ref_slug.tgz $CI_PROJECT_DIR docker build -t myapp --build-arg package=myapp-$ci_commit_ref_slug.tgz docker tag myapp:latest nexus.loc/myapp:$ci_commit_ref_slug docker push nexus.loc/myapp:$ci_commit_ref_slug

39 Nexus: Docker Registry

40 Running your Build Pipeline

41 How to deploy the container? docker pull nexus.loc/myapp:$ci_commit_ref_slug docker stop myapp-mysql-$ci_commit_ref_slug true docker stop myapp-$ci_commit_ref_slug true docker rm myapp-mysql-$ci_commit_ref_slug true docker rm myapp-$ci_commit_ref_slug true docker run -d -P \ --name myapp-mysql-$ci_commit_ref_slug \ -v $CI_PROJECT_DIR/data/db:/var/lib/mysql mysql:5.6 docker run -d -P \ --name myapp-$ci_commit_ref_slug \ --link myapp-mysql-$ci_commit_ref_slug:mysql \ -l traefik.enable=true -l traefik.frontend.rule=host:stage.myapp.loc \ -l traefik.protocol=http \ nexus.loc/myapp:$ci_commit_ref_slug

42 ...aaaand deployed on stage!

43 Build Pipelines (Prod Deployment) deploy_prod: stage: deploy tags: - docker-prod script: -... variables: GIT_STRATEGY: none environment: name: production url: only: - master when: manual

44 Prod Deployment running

45 Prod Deployment running

46 Prod Deployment running

47 Prod Deployment running

48 ...aaaand deployed on prod!

49 Review Apps «The basis of Review Apps is the dynamic environments which allow you to create a new environment (dynamically) for each one of your branches.» - GitLab

50 Review App Build Pipeline (Start) deploy_review: stage: deploy tags: - docker-review script: -... variables: GIT_STRATEGY: none environment: name: review/$ci_commit_ref_name url: on_stop: stop_review only: - branches except: - master

51 Review App Build Pipeline (Stop) stop_review: stage: deploy tags: - docker-review script: -... variables: GIT_STRATEGY: none when: manual environment: name: review/$ci_commit_ref_name action: stop

52 Let's test the Build Pipeline! $> git checkout -b feature/force-login $> composer.phar require bitexpert/magento2-force-customer-login Using version ^3.0 for bitexpert/magento2-force-customer-login./composer.json has been updated Loading composer repositories with package information Updating dependencies (including require-dev) Package operations: 1 install, 0 updates, 0 removals - Installing bitexpert/magento2-force-customer-login (3.0.1): Loading Writing lock file Generating autoload files $> git add -A && git commit -m "Add Force Login module" $> git push

53 Merge Request! Merge Request!

54 Build Pipeline running

55 Build Pipeline finished!

56 ...aaaand Review App deployed!

57 How to deploy on stage & prod?

58 Merge kicks of Build Pipeline again...

59 ...aaaand deployed!

60 GitLab CI: Environments

61 GitLab CI: Environment History

62 Thank you! Questions? Stephan Hochdörfer Head of Technology, bitexpert AG (Mannheim, #PHP, #DevOps, #Automation #phpugffm, #phpugmrn, #unkonf