Real World CI with Red Hat Cloud Suite. Sim Zacks - Principal Quality Engineer Oded Ramraz - Manager QE Ops TLV

Transcription

1 Real World CI with Red Hat Cloud Suite Sim Zacks - Principal Quality Engineer Oded Ramraz - Manager QE Ops TLV

2 Who we are DevOps Engineers - experts in software engineering and sys admin QE Ops - we build customer-like environments for testing products Central CI - we manage all the CI requirements for the testing env Sim Zacks Principal Quality Engineer Oded Ramraz Manager QE Ops

3 Introduction - Central CI Environment

4 Enterprise solution for multiple teams

5 RHCS Components - Harmonious Conjunction st, u b Ro VM ble Sta?I, le xib e l F? nce a t ns er? n i a nt Co Jen kin s, L og sta sh, S Bu il dy ou ro wn on ar, G CI Wo rk err it flo w!!

6 Agenda The What and How of CI RHCS Components Role Added value of each component Satellite Configuration Management RHEV VM vs OpenStack Instance vs OpenShift Container Integration with Jenkins, Gerrit, Logstash, High level management and reporting with CloudForms Summary

7 What is CI? Multi-user Continuous Integrated Automated

8 Why do we need CI? Prevent broken builds Early detection of bugs Continuous quality monitoring Increase SW development process

9 CI Workflow

10 CI Infrastructure

11 CI Goals Continuous quality analysis Automatic provisioning Configuration management Centralized reporting

12 Continuous Quality Analysis

13 Automatic Provisioning Reduces provision time and human errors Reduces non test related errors Allows investing more time on development

14 Centralized Logging Detection of anomalous activity Simplify log analysis and correlation tasks Display trends, graphs and data tables Fast deployment Jenkins integration Containerized Scalable ShipShift

15 Centralized Logging

16 How we do it RHCS Components

17 RHEVM Centralized virtual infrastructure management (e.g hosts, VMs, networking, storage, templates) Providing mechanism for VMs high availability Delivering leading performance and scalability for virtual machines on a stable and secure platform Running crucial CI services such as Jenkins, ELK, CFME, etc

18 RHEVM - Permanent services (Jenkins, Satellite, Gerrit, ELK stack, SonarQube, )

19 RHEVM - Static platform/properties High availability Live migration Storage live migration Live snapshots Load balancing Power saving Hot plug disk and network Storage on local disk, FC, iscsi, NFS, Red Hat Storage Server, IBM GPFS, Posix or Direct LUN Self service portal with quotas

20 RHEVM - Reporting

21 Satellite New modern design, cutting-edge open source software Designed for software life cycle (SLC) management Bare metal, virtual machine (VM), and cloud deployment

22 Satellite 6 Architecture

23 Satellite - Application Lifecycle Management

24 Satellite - Provisioning

25 Jenkins Pluginable Supports various source control management tools Supports various script languages and common tools Allows triggered builds

26 Jenkins - Workflow - Triggers

27 Jenkins - Workflow - CI Message Bus Expands trigger capabilities Allows passing additional information for smart triggering Allows customizing Jenkins triggers

28 Jenkins - Workflow - Plugins Jenkins functionality extended via plugins For example, CI message bus is a Jenkins plugin New plugins could be added according to requirements

29 Jenkins - Workflow - Jenkins nodes (slaves) Jenkins nodes are used for Jenkins builds VM, bare metal and containers could be used as Jenkins nodes Jenkins nodes connected to Jenkins master Accessible by Jenkins plugins and Jenkins master

30 Jenkins - Workflow - Tools Jenkins Job Builder: Allows us to maintain Jenkins Jobs in YAML format Fast deployment of jobs Nodepool: Key part of Openstack CI infra. Allows Jenkins nodes lifecycle management CI provisioner: Test bed provision/teardown Allows provision of complex topologies that contain bare metal, vm from various providers, containers

31 Cloud Implementation Openstack/OpenShift

32 OpenStack

33 OpenStack - Tenant per team

34 OpenStack - Zones

35 OpenStack - Jenkins slaves ov r P on d ne o i is an m De d No de po ol St an db y Image Labels

36 OpenStack - Virtualized Test Resources

37 OpenStack - Image Management

38 OpenShift

39 OpenShift - Containers

40 OpenShift - Lightweight disposable tasks

41 OpenShift - Lightweight disposable tasks - Doc Gen

42 OpenShift - Lightweight disposable tasks - Unit Testing Taken from CommitStrip (strip)

43 ShipShift / Logstash

44 Container Management

45 Cloud Management CloudForms

46 CloudForms - Unified Management

47 CloudForms - Reporting

48 CloudForms - Automation

49 Summary

50

51

52

53

54

55 Q&A

56