Bitte decken Sie die schraffierte Fläche mit einem Bild ab. Please cover the shaded area with a picture. (24,4 x 7,6 cm)

Size: px

Start display at page:

Download "Bitte decken Sie die schraffierte Fläche mit einem Bild ab. Please cover the shaded area with a picture. (24,4 x 7,6 cm)"

Anthony Cunningham
5 years ago
Views:

1 Bitte decken Sie die schraffierte Fläche mit einem Bild ab. Please cover the shaded area with a picture. (24,4 x 7,6 cm) Continuous Integration / Continuous Testing Seminary IIC

2 Requirements Java SE Runtime Environment re8-downloads html Python 2.7 / 3.x 2

3 Step 1: Create your account Visit the following site - Create your account using your FII . domains are whitelisted hosted GitLab Server inside a docker container hosted Jenkins Server (Jenkins Master how we call it) inside a docker container The Jenkins user database is linked to GitLab s accounts via OAuth plugin. 3

4 Step 2: Create, set up, clone a GIT repository Visit Create a New Project Project name: user-name Visibility: Private Deactivate the Auto DevOps option Generate a SSH private key / public pair by running inside a Git Bash Terminal: sshkeygen Extract the public key from the generated path */id_rsa.pub Go to your Profile Settings in GitLab web interface -> SSH Key -> Paste the id_rsa.pub file content and save the key Now you can clone your repo by following the commands from your project main page 4

5 Step 2.2: Bullshit Python script Write a dummy Python script with a lot of style errors (no docstring, multiple new lines, no new line at the end of file, don t respect variable naming convention eg. test_variable) Commit the script. Push the changes. 5

Step 3: Set up your machine as a Jenkins Node Go to https://conti-ci.gocht.at/computer Here is the Jenkins Nodes tab, where you are going to set up your machine as a Jenkins agent (slave).

6 Step 3: Set up your machine as a Jenkins Node Go to Here is the Jenkins Nodes tab, where you are going to set up your machine as a Jenkins agent (slave). All your desired tests will be run inside a continuous pipeline on your specific node. The connection will be done on a local side via Java Web Start application (creates a SSH connection directly with the Jenkins Master by validating a secret token). The user logged in into that machine who establish the connection will be used as the host runner for each Jenkins build on that machine. How to add your node: 6

7 7

8 8

9 If you set up the node configuration via Java Web Start the following page should appear: Download the agent.jar by clicking on the link 9

10 Now we will switch to your OS CLI and run the specified command 10

11 Step 4: Create new Jenkins credentials Visit Add Credentials Kind: Username with password Username: Your GitLab username Password: your GitLab password ID: leave blank Description: Username 11

Step 5: Create & Configure a Jenkins Pipeline Access the Jenkins master page https://conti-ci.

12 Step 5: Create & Configure a Jenkins Pipeline Access the Jenkins master page Switch to your LabX view Create your Jenkins Pipeline by clicking on the New Item icon. 12

13 13

14 Skip directly to pipeline configuration 14

15 Optional: My pipe security In the pipeline config page, Enable project-based security for full disclosure over your pipeline and select the last option and leave the matrix empty 15

16 Step 6: Create the Pipeline s groovy script Write a groovy script by following the next template: Commit the groovy script inside your project s GIT repository Push the commit Note: Usually having a Jenkins as the CI Service, a separate repository is used for holding the groovy scripts + CI Scripts. 16

17 Step 7: Run your Pipeline Select your pipeline from your Lab View Build Now Enjoy the automagically act happening. Also congrats for your +2 Points 17

18 It s that enough? Manually triggering a Job only for the latest commit into the master branch is far from the Continuous Integration meaning. Well there might be jobs that are only to be manually started by a user (Integrator / Configuration Manager / responsible DevOps Engineer) only in some specific cases, but what we covered is not fit for a main integration pipeline So shame on us everybody gets: -2 POINTS * just kidding the next part is for an additional 1 point ** not the optional 1 point 18

19 Step 8: Enable automatic triggers for the pipeline Basic concept: User to GitLab to Jenkins: The user pushes to GitLab repo remotes/origin/master a commit The project is directly integrated with a webhook from a specific Jenkins project for which only some (or all, who cares) events are chosen to be sent Data in JSON format is sent over via the Jenkins project webhook with various information about the commit to be tested / integrated / checked / reported etc. The Jenkins job is configured to accept only some (or all, who cares) events by interpreting that JSON data. The job can now start and build that specific reference and test within the stages created inside the groovy script. But the failure / success status will be only visible from a Jenkins side perspective 19

20 Basic concept: Jenkins to GitLab (to User): Once the pipeline is triggered, it should be able to poll the exact revision from the GitLab server via SCM. And should be able to query between all references. If the Pipeline it s triggered automatically by GitLab, it should send back values like stages status and overall pipeline status and the status of Integrate or not that specific change This is done by having one Admin account or at least on developer s account for that project depending on what the pipeline can and will do. (If it s intended to merge the changes if they succeed, this operation will need an Admin rank account for the project). The GitLab account s API Token is stored in Jenkins and via that protocol the statuses are posted in GitLab. 20

21 Step 8.1: Activate GitLab trigger in Jenkins Pipeline Configure Pipeline > Build Triggers > Something with GitLab Check only Push Events, because I had no time to look over the Opened Merge Request Events (ongoing commit reviews) 21

22 Step 8.2: Set up JSON data send to the webhook Copy the webhook which is marked at the precedent step. Go to your GitLab project > Settings >Integrations Paste the webhook, select only push events and add the webhook To test if the connection works, scroll down: and select from the dropdown the Push Event: 22

23 Step 8.2: SCM Polling Enable the parametrization of this pipeline, via this option we will can run manually the pipeline to check things on the last snapshot, as the default value will be: master Also via this parameter we will fetch the tested snapshot from JSON data. 23

24 Refspec: +refs/heads/*:refs/remotes/origin/* +refs/mergerequests/*/head:refs/remotes/origin/merge-requests/* 24

25 Step 8.3: Additional Settings / Info If you protected your pipeline add Build rights for Anonymous Users, so GitLab can trigger builds. Only one GitLab Connection: There is one account set up with it s API Token on Jenkins which will post pipelines statuses in GitLab (which is an Admin account = general read / write access) 25

26 Step 8.4: Adapt groovy script Via the following template: 26

27 Step 9: Commit anything and watch your pipeline automagically starting and posting results to GitLab + 1 more point 27

28 Optional +1 Point Create another pipeline, which groovy script is placed in the same repository. This pipeline is triggered by the first pipeline if it succeeds. It has 3 stages: Prerequisites, Python Check PyLint, Finalize Verification In the PyLint stage. It runs another code checker for python called PyLint and spits all the information in one txt which is then published as a report attached to the pipeline in HTML format. The pipeline fails if the PyLint discovers any Warnings / Errors, but it publishes every time the HTML Report (Adds information to the commit that triggered the first pipeline) Don t know if it works, might skip this It s more of a research task, the actual codding is really lightweight. +1 More point if you finish the task 28

29 29

Continuous Integration / Continuous Testing

Bitte decken Sie die schraffierte Fläche mit einem Bild ab. Please cover the shaded area with a picture. (24,4 x 7,6 cm) Continuous Integration / Continuous Testing IIC What s SW Integration? Integration