Voltron of Devops DrupalCI PNWDS. Mixologic + Mile23 Tell you what s what About DrupalCI.

Transcription

1 Voltron of Devops DrupalCI PNWDS Mixologic + Mile23 Tell you what s what About DrupalCI.

2 Overview DrupalCI, an Etude? (THE PHBS) DrupalCI Overview For Project Maintainers (THE CUSTOMERS) How It s Built And The Tools we used to build it (THE DEVOPS) And then what happens? (THE MUSIC MAKERS, THE DREAMERS OF DREAMS)

3 What is DrupalCI? Why is it important to the Drupal Project?

4 What do we talk about when we talk about DrupalCI? DrupalCI is the continuous integration system you use when you upload a patch to drupal.org. It's maintained and funded by the Drupal Association. It s not just the testbot software, it's a holistic system. It s important for all the reasons CI is important: It can do a bunch of maintainer work for you, such as figuring out if tests pass or not. And automating any work that doesn t need to be done manually. Can be run locally too!

5 Alot of testing 9 different php versions 3 different databases tests so far since June 2015 Several upstream bugs in php tests in Jan - $ per test

6 DrupalCI costs

7 Drupal.org Testing Policy and goals Code Targets Environment Targets Assessment Targets Test Triggers Test Priority

8 Can You Draw Us A Picture, Please? Drupal.org Dispatcher Your Patch Queue build job Testbot Testbot available? Spin one up if needed. Run Tests Poll For Results Get Results/Artifacts Show Your Results Generate Artifacts

9 How do you use DrupalCI as a project maintainer?

10 What s your testing policy? Why policy? So you can be clear with contributors what s going on. There are branch tests and patch tests. What expectations do you have for each? You can have a matrix of different environments and codebases per run. Branch might have highest and lowest PHP version as well as different types of databases. Patches might only use PHP 7 for speed. Consider coding style configurations for tools like phpcs, eslint, and csslint.

11 "Examples for Developers" branch testing policy Examples should pass tests against the current Drupal release, so 8.2.x right now. 7.x-1.x is maintenance-only. Regression testing against the minimum PHP version for Drupal 7, which is x-1.x needs to pass on PHP version 5.5, since that s minimum PHP version for Drupal 8. Should also be able to run on PHP 7.x stable.

12 Examples CI configuration

13 Branch Tests Choose when to test your project s branches.

14 Reading The Results

15 Jenkins Test Runner Console Build Artifacts Checkstyle Code Quality

16 Jenkins Console Output - Show Full Log

17 Checkstyle Result Shows stats on code quality improvement and regression.

18 Build Artifacts Artifacts are organized by build step name, such as simpletest or phplint. Dive in for lots of interesting things. We re adding features all the time, so please poke around.

19 Artifact Deep Dive #1: php -i There s a log of the output of php -i in the runcontainers/ directory. Why is it there? Because the runcontainers step starts up the PHP docker container, so it s a good time to make that file.

20 Artifact Deep Dive #2: phpcs Makes A Patch DrupalCI generates a patch that will help you fix coding standards errors that it found. Find it in the phpcs directory.

21 Artifact Deep Dive #3: Re-Run Your Exact Test DrupalCI generates a build definition YAML file for the test it just ran. If you have a local testbot, you can re-run the same test using this YAML file.

22 So how was DrupalCI built?

23 Terminology Build - the complete end-to-end 'instance' of a test run, including tasks run against a code target in a specific environment. Task - tasks are the components of a test run to be performed against the code target in the environment, such as simpletest, phantomjs, eslint, etc. Environment - environments represent the php/sql/configuration environment that the build takes place in. Code target - the codebase to be tested by the build in the environment

24 drupalci_testrunner DrupalCI Overview AWS EC2 CI Jenkins Drupal.org dispatcher.drupalci.org AWS EC2 AWS EC2

25 Drupal.org Drupal.org integration Infra Jenkins drush Drupal.org UI Projects, Issues, Tests project_issue_file_test module pift-cron-test Queue tests pift-cron-fetch-results CI Jenkins Find running jobs dispatcher.drupalci.org pift-cron-parse-results PiftCiJob entity pift_ci_job_result table Get results from completed jobs pift-cron-daily Create daily jobs

26 dispatcher.drupalci.org FreeBSD (ZFS) Separate from drupal.org (Security) Runs Jenkins Autoscaling Artifact Parsing Json API Exeriments and Troubleshooting Build tool for testrunner CI Jenkins dispatcher.drupalci.org

27 Key Jenkins plugins CI Jenkins dispatcher.drupalci.org Key Jenkins Plugins that we use Amazon EC2 Plugin Priority sorter plugin Build Auth token plugin Naginator: Job restart xunit plugin Checkstyle Clover

28 Aws and DrupalCI AWS EC2 Spot requests Instance type AWS EC2 That one weird trick (IOPS) AWS EC2

29 DrupalCI testrunner Prepares Codebase Check out/patch Setup Containers Pulls and Starts Containers AWS EC2 Runs Tests Kicks off run-tests.sh Post Process Output Turn output into xml results

30 Packer (packer.io) Abstraction layer between machine configuration and virtualization formats. Helps solve the Works on my machine Dilemma by unifying the definitions of a machine What we build with it in drupalci: AWS AMI Virtualbox + Vagrant (soon) VMWare Flexibility and Future proofing Amazon EC2 (AMI), Azure Resource Manager, CloudStack, DigitalOcean, Docker, Google Compute Engine, Hyper-V, 1&1, OpenStack, Parallels, ProfitBricks, QEMU, Triton (Joyent Public Cloud), VirtualBox, VMware

31 Packer in drupalci Our packer definition file Packer parts Variables Builders Provisioners Post Processors The DrupalCI snowflake Software / OS config Provisioner divergence

32 Docker containers PHP containers Mysql/Postgres containers Currently all definitions can be found at

33 The Future

34 Contributing DrupalCI is different from other community-run projects, since the DA is the customer. Get a local testbot running and make it do things. Talk in #drupal-testing IRC channel. Read CONTRIBUTING.md Not a Drupal codebase, but uses Drupal components.

35 Roadmap - really needs updating Environments: Definable environments w/docker compose Other dbs/other architectural components queues/caching proxies/memcache/ Assessments User defined builds

36 Recap What Is It? (ryan?) How It s Build And The Tools It Uses (Ryan) DrupalCI Overview For Project Maintainers(Paul) Contributing to DrupalCI (Paul) The Future (roadmap)