OpenShift-Build-Pipelines Build Test Run! Tobias Schneck Software Loodse GmbH ConSol Software GmbH (bis Juli 18)

Transcription

1 OpenShift-Build-Pipelines Build Test Run! Tobias Schneck Software Loodse GmbH ConSol Software GmbH (bis Juli 18)

2 + Agenda OpenShift CI/CD Pipeline Concept Build up some Pipelines! Stage I: CI-Build of the Artefact Stage II: Automated Testing Citrus Integration Testing Sakuli E2E Testing Stage III: Artefact Deployment Review Alternatives Links

3 OpenShift CI/CD Pipeline Concept

4 Prozess Development QA Stage Code Container Image Container Registry Build & Unit-Test AUTOMATIC Deploy in Dev MANUEL ODER AUTOMATIC Deploy in QA Test POD Folie 4 OPS POD

5 Prozess QA Production Stage OPS Container Image from QA Stage MANUEL Deploy in Production Smoke-Test Folie 5

6 OpenShift Core Components CI / CD Build Pipeline? Jenkins Integration + Jenkins Template + OpenShift Jenkins Client Plugin + OpenShift Jenkins Sync Plugin Folie 6

7 OpenShift Regular Builds (traditional) OpenShift Master Scheduler OpenShift Internal Registry OpenShift Builder Pod Source-2Image Build Docker native Build build.yml Dockerfile Base Image Builder Image Image Artifcat Execution Node Folie 7 Image Stream (Project/Global)

8 OpenShift CI Pipeline Build OpenShift Master Scheduler OpenShift Internal Registry OpenShift Builder Pod Jenkins Pipeline Build Jenkins Image Jenkinsfile Maven Image OpenShift Regular Build Image Artifcat Execution Node Folie 8 Image Stream (Project/Global)

9 OpenShift Build & Deploy with Jenkinsfile Jenkinsfile Uses OpenShift CLI: oc Automatically authorized Use complete CLI possibilities Huge flexibility Uses OpenShift Jenkins Client Plugin Based on Jenkins kubernetes-plugin Groovy wrapper for OpenShift API Enables dynamic slave images - built-in images: base, maven, nodejs - custom images Folie 9 Jenkins Image Maven Image Node Image

10 OpenShift Custom Jenkins Slave citrusframework/citrus-docker-images PR #3 Jenkinsfile FROM consol/citrus:2.7.5 Used by ### sourced are copied from: # # # Copy the jenkins-slave entrypoint ADD contrib/bin/* /usr/local/bin/ # Run the Jenkins JNLP client ENTRYPOINT ["/usr/local/bin/run-jnlp-client"] Folie 10 podtemplate(label: "citrus", cloud: "openshift", inheritfrom: "maven", containers: [ containertemplate(name: "jnlp", image: "toschneck/citrus-jenkins-slave", ) ]) { node('citrus') { sh "echo execute oc citrus build" checkout scm sh "mvn install" junit 'citrus-tests/target/citrus-reports/**/*.xml' archiveartifacts "citrus-tests/target/citrus-*/**/*" } }

11 Build up a Build Pipeline!

12 Bakery App Folie 12

13 Bakery App Folie 13

14 Transition to OpenShift Goals: Don t change the Sourcecode of the Apps Also don t change the Testcode Fully Automated Pipeline until Production All in OpenShift (CI, Build, Test, Deployment) Jenkins v1 -> v2 Folie 14

15 Stage I: CI-Build of the Artefact

16 CI Build Docker Image Docker Image Artifact build.pipeline.yml Jenkinsfile.dev Dockerfiles Maven Image OpenShift Regular Build Folie 16

17 DEMO toschneck/openshift-example-bakery-ci-pipeline

18 Stage II: Automated Testing

19 Citrus Integration Testing

20 Mission Integration Tests System under Test Kunde Stammdaten Webclient Verträge Htt S JM p SO AP Agent / Techniker Mobile, PDA System Under Test tp t H FTP T S E CSV R Folie 20 L XM Dienstleister Shipping

21 Mission Integration Tests Automated API Interface Tests Stammdaten Kunde Htt S JM p SO AP Agent / Techniker System Under Test tp t H FTP T S E CSV R Folie 21 L XM Dienstleister

22 Citrus Features Use Case: Testing of Middleware Integration / ESB / API Ready to use components citrusframework/citru s Client & Server Implementation Application Server Deployments Container Images Message transports Http REST, SOAP, JMS, FTP, TCP/IP, Mail, RMI, SSH,... Data formats XML, Json, PlainText, CSV, XSD, WSDL Test DSL XML & Java Folie 22

23 more Citrus Citrus Admin UI Easy Testsuite Management Reporting Citrus Simulator Complex Messaging Workflow Simulation Predefined Interface Packages: WBCI, WITA Folie 23

24 QA Citrus API Integration Tests build.pipeline.yml Jenkinsfile.qa Citrus Slave Image Folie 24

25 DEMO toschneck/openshift-example-bakery-ci-pipeline

26 E2E Testing

27 Sakuli End-to-End Use Cases Folie 27

28 Motivation Founded February 2014 Open Source (Apache) Goals: Combine a web and screen-based testing in ONE tool Use test results in CI- and monitoring systems Platform independent: (Linux/Windows/MacOS) Application tests from a End User Perspective Functionality (business critical path) Performance (e2e loading time) Folie 28

29 Component 1: Sahi / Selenium Web testing tool (sahi.co.in, seleniumhq.org) method based DOM access: _assertcontainstext ("Logged in as: Sakuli", _div("user_field")); _click(_span("loaded Run Tabels")); _assertexists(_table("cross_table_fixed")); _assertexists(_cell( testing allowed", _rightof(_span("name")), _under(_cell("action"))); localhost:9999 {js} Webserver <table> <tbody> <tr> <td>alice</td> <td>bob</td> </tr> </tbody> </table> Folie 29

30 Component 2: Sikuli Visual automation tool (sikuli.org) image identification, mouse & keyboard interaction: screen.find("sap_ok").click(); screen.find("sap_ok").right(40).click().type("2223"); var bubble = new Region().waitForImage("bubble.png", 20); bubble.draganddropto(bubble.left(35)).highlight(); Folie 30

31 Benefits Integrated API for both Tools - one TestScope Step by Step Code (JavaScript, Java) Automatic Screenshots on any Errors Cloud-ready Docker Images for Kubernets/OpenShift Sakuli UI for Maintenance, Execution and Reporting (beta) "Forwarder" Modules: Monitoring (Gearman, Icinga, CheckMK) CI (Jenkins, Travis CI, Drone...) Databases (MySQL/MariaDB,...) Folie 31

32 Monitoring Integration Ready-to-use setup in Kubernetes/OpenShift Combinable with traditional monitoring checks Performance graphs Cron scheduled check execution Error screenshots Mail / Chat Notification Live watching possible Folie 32

33 Sakuli End-2-End Testing Container ConSol/docker-headless-vnc-container Folie 33

34 QA Tested Docker Image Docker Image Artifcat build.pipeline.yml Jenkinsfile.qa Citrus Slave Image Folie 34 Sakuli Image

35 DEMO toschneck/openshift-example-bakery-ci-pipeline

36 Review Jenkins wurde nicht desingend für Container/Pods Plugins, Startup, Java Agents, lokales Filesystem, Weiterentwicklung Migration zu Jenkinsfiles Viele Wrapper-Scripte, um flexibel zu sein Verteiltes CI-Design erfordert ein Umdenken CI-Daten schwerer zugänglich Logs, Screenshots, Artifakte Technologie-Mix Slave-Image intransparent -> do it your self Base Image: github.com/openshift/jenkins/slave-base Verteilte Dokumentation OpenShift, Kubernetes, Jenkins, Jenkins-Plugins, Docker, Folie 36

37 Review Skalierung übernimmt der Cluster "oc CLI client" anstatt Openshift-Jenkins-Plugin Pipeline modular test/entwickelbar Parametrisierte YAML Templates für OpenShift Infrastructur as Code Neue Stages sind einfach zu erstellen Deployment wird automatisch mitgetestet Secrets durch Cluster-Admins verwaltbar Builds Steuerbar von CLI und UI Erweiterbarkeit durch OpenSource Folie 37

38 Alternative Ansätze Gitkube git push based Workflow on remote Git Simple: Kombination von bash Scripts hasura/gitkube Skaffold: GoogleContainerTools/skaffold Einfacher CI/CD Workflow 2 Stages: Local & Remote JenkinsX Vordefinierter Workflow für CI/CD in Kubernetes kein neuer Jenkins -> Wrapper GitHub only DroneCI / KubeCI drone/drone Container first und einfache Konzept Nutzbar für gebaute Images Layered Build Concept für Pods (in Entwicklung) jenkins-x/jx Folie 38 kubeciio

39 KubeCI WIP Drone Kubernetes Runtime Plugins: kubectl helm img (daemon-less build) more will follow pipeline: test: image: python:2-slim commands: - python test/wait-for-it.py build-docker: image: plugins/docker repo: toschneck/wait-for-it dockerfile: Dockerfile

40 Links toschneck/openshift-example-bakery-ci-pipeline citrusframework/citrus @sakuli_e2e Folie 40

41 Questions?

42 Thank you Stuttgart! Tobias Schneck,