ThinkPalm s BreakThrough DevOps Capabilities ThinkPalm

Size: px

Start display at page:

Download "ThinkPalm s BreakThrough DevOps Capabilities ThinkPalm"

Amberly Willis
5 years ago
Views:

1 ThinkPalm s BreakThrough DevOps Capabilities ThinkPalm Dev Ops Business Planning Collaborative Development Customer Feedback & Optimization Testing Monitoring Release and Deployment STANDARDS OPERATE DEPLOY DevOps Feedback PRACTICES STEAR DEVELOP/TEST ECOSYSTEM

2 ThinkPalm s DevOps capabilities span all facets of Software Development Life Cycle including DevOps Assessment and Planning, Agile Tools and Practices, Integration and Delivery Pipelines, Multi-Cloud Support, Monitoring and Analytics, custom development of dashboards, tools, connectors and accelerators, Training and Consulting services and On-site and Offshore Support. Our expertise extends across a broad spectrum of tools in the DevOps landscape including Jenkins, CircleCI, Bamboo in Integration, Selenium, jmeter, TestComplete in Testing, Kibana, ElasticSearch, Splunk, Logstash in Monitoring, AZURE, AWS, Docker in Delivery, Sonarqube in Code review and Ansible, Chef and Puppet in Code Deployment. The scenarios emphasized below depict the foothold we have acquired in the DevOps revolution by delivering bespoke DevOps solutions, leveraging extensive tool and technologies. DEVOPS SOLUTION FOR COMMUNICATIONS INDUSTRY BUSINESS NEED In a typical scenario, developers perform a commit of code changes to various Feature Branches or the master/trunk. There would be multiple commits across various time zones into the main Git (Repository) server. At a predefined time (once in 24 hours), a cron job picks up a pre-defined branch to perform a build which would be subsequently queued for automated nightly test runs. Multiple, stable automated nightly runs lead to a Release Candidate (RC) being built. The Release Candidate is picked up by manual QA for regression runs. As depicted in the figure below, the process contained gaps in terms of testing: Development Gap 1 Feature Branch Gap 2 Feature Branch 2 Feature Branch Cron job Enqueue Dequeue Build Queue Automated Nightly Tests Manual QA Regressions Gap 3 Defects

3 Gap1 : i. Multiple commits before a build led to difficulty in tracing back build failures to specific commits. ii. Absence of integration testing before commits. Gap 2: i. Multiple builds queued for testing, but just one build was tested per night. ii. Not all branches and as a result not all commits could be tested due to manual changes in priorities. Gap 3: i. Due to the cascading effect of Gap 1 and Gap 2, builds reached manual QA late into the PDLC. ii. Defects, sometimes release blockers, were reported during regression cycle, resulting in reduced time for development to fix and re-test. Lack of integration testing and lengthy test cycles led to build failures and defect detection very late into the Product Development Life Cycle, leading to expensive bug fixes and delayed delivery. THINKPALM SOLUTION In order to fill the above gaps, the Integration process was introduced. The goal was to create a Jenkins test suite, integrated into the client s Git server, to initiate a test suite run for each commit. Post implementation, CI resulted in the following changes: 3 4 S/w image 5 Trigger Firmware upgrade & tests 1 2 s Webhook Code Review Jobs Full Build (on local Git client) Virtualized DUT Virtual LAN Server (SIPP, Scapy, DHCP) Virtual WAN Server (SIPP, Scapy, DHCP, NTP, DNS) Hypervisor (Fully Virtual) Format results and send to committers CI Server (Jenkins) 7 Process test results 6

4 1. Developers perform a commit of their code changes into the Git server for various branches. 2. Post each commit, webhook to Bitbucket triggers build pipeline on Jenkins for the specific branch. 3. Pre-build tests like Doxygen, code review tests and code analysis tests are run. 4. Full Build is performed to build a binary image on the local Git client. 5. Connect to the test server using SSH to trigger functionality tests. 6. The binary image is deployed on the DUT. 7. Automated tests are executed on the DUT. 8. Results are captured and processed by Jenkins. 9. Test reports are formatted and mailed automatically to the committer along with commit information. Other highlights include: Completely virtual test-bed in the test set-up, implemented using Virtual Box, with no cabling between devices. Automated branch specific build process after every developer commit using a webhook in Bitbucket for Jenkins. Multi-branch support. Queuing of builds if a commit occurs while a build is being tested. Capability to submit private builds for testing on the CI set-up. BENEFITS Integration of Development, Pre-build Testing, Build Process, Deployment of the build on the DUT and Automated Sanity & Integration Testing were achieved. This led to stable, sanity tested builds being submitted to QA for regressions. Early detection of blocker issues lead to efficient tackling and faster deployment of software to the client. DEVOPS SOLUTION FOR ENTERPRISE SOFTWARE SERVICES BUSINESS NEED An automated system for facilitating faster validation of code, early detection of defects and automated deployment of builds to test beds was lacking in the client environment. The test beds employed physical machines, making the setting up of multiple test beds and their configuration expensive. After each deployment, test scripts were executed by Engineers and notifications on each test case status had to be sent manually.

5 THINKPALM SOLUTION ThinkPalm automated branch specific build process by triggering the build and deployment pipelines after each developer commit. Support was extended to both partial and full builds. All machines in the test beds were configured as virtual machines and multiple test beds were made capable of running on one physical test server. Auto deployments were implemented where new build artifacts get pushed to the test beds after each auto build. After each deployment, automated execution of test scripts for the concerned development branches was realized, along with the receipt of detailed status information on each test case. Code Analysis Other pre-build steps Dev 1 SVN Dev 1 Branch Post Hook triggers CI jobs for the branches Pre-Build Jobs Build Jobs Parse/Process Info Send CI Reports Parse/Build Info and Status JIRA Integration Test/ Production Dev n Dev n Branch SVN SERVER CI Server Deployments BENEFITS End-to-end automation improved the efficiency of all build, deployment and test cycles significantly. Use of virtual test beds saved costs on additional hardware for setting up test beds. Quick TAT for testing builds for each development branch helped in early detection of defects. Parallel builds on different branches reduced the wait time for deployment, improving the time to market. Auto configuration and updates to the testing server considerably reduced the manual intervention in test deployments. DEVOPS SOLUTION FOR ENTERPRISE SOFTWARE PRODUCTS BUSINESS NEED Identification of feature changes from source control history was implausible due to lack of validation of each commit to the source control server. The laborious tasks of triggering builds, preparation and management of test releases, deployment of new test releases to

6 testing servers and their configuration were performed manually by Test Leads and Test Engineers, resulting in wide gaps between production releases. Dev 1 Gap 1 User Gap 2 Gap 4 Testing Dev 2 SVN SERVER Triggered Build Build Server (custom) Gap 3 Deploy Staging Production THINKPALM SOLUTION The difficulties were overcome by implementing Integration using Jenkins, encompassing automated builds, test release automation and test deployment automation. A specific custom test release management tool was introduced and ports were added for multiple development branches. Version Control Server Test Release Management Test Deploy Management Dev Clients Test Clients Dev Clients Package Manager Build Automation Server Testing Server (s) Test Clients Jenkins Dev Clients release.thinkpalm.lan: , Test Clients

7 BENEFITS Automation of builds, test releases and deployments brought about higher frequency in production deployments. Implementation of automated control measures for code commits realized the tracking of feature changes together with clear visibility of feature developments. Daily automated builds and deployment to staging server resulted in early detection of defects and early checks/reviews on new features. A custom test release management tool was developed. Facility for remote triggering of builds and automation of test releases and deployments helped development leads and test engineers save considerable time in configuring and deploying custom builds. Website: marketing@thinkpalm.com

DevOps Course Content

DevOps Course Content 1. Introduction: Understanding Development Development SDLC using WaterFall & Agile Understanding Operations DevOps to the rescue What is DevOps DevOps SDLC Continuous Delivery model