June 3, 2016 How Can Testing Teams Play a Key Role in DevOps Adoption? Sujay Honnamane QA Director @sujayh Rameshkumar Bar Sr. Automation Architect @rameshbar 2016 Cognizant
Session take away DevOps Overview Challenges & Industry Trends Can testers lead DevOps adoption? - team s story Continuous Integration & Testing Ecosystem Tools & Techniques Intelligent Test Automation is Key Collaboration & team s attitude is all that matters
DevOps- Overview DevOps: Enterprise Capability for Continuous Integration & Delivery, enables teams to accelerate release of applications into production by sustaining continuous feedback and improvement across the software lifecycle Collaborative Development Increased collaboration between teams Continuous Integration &Testing Integration of software testing with development and operations for early feedback Continuous Release and Deployment for increased delivery speed and frequency Continuous monitoring Improve quality by monitoring performance feedback loops Plan & Measure Develop & Test Monitor & Optimize Release & Deploy
Reality Check Simplicity is highly overrated by Unicorns! Image source : https://paimeiitguy.wordpress.com/2008/07/28/a-beacon-of-hope-for-the-keep-it-simple-stupid-way-of-working/
Challenges for horses today Image source: http://legacyportfolio.co.uk/blog/2012/06/08/what-are-the-challenges-facing-corporate-occupiers-today/
The Solution One step at a time
The beginning first DevOps meeting What in the world? OPS Product owner QA Dev
First attempt to break the silos Who cares? Deployment is painful task, these folks won t ever get it! OPS Product owner QA Architect Dev There is a better way! & QA can help!! Oh Really?
A start... Constructive discussion testing gets Dev in alignment No kidding! We work hard to make everyone s life easy OPS Product owner QA Someone is making sense!! Dev Hmm! We are listening!
Continuous Integration &Testing Ecosystem Testing jobs Results Production Feedback Continuous Integration & Testing New User Stories / Defect Fixes Code Commit Dev Team Updated Automation Scripts Instant feedback on quality Test Lab Accessing Environments Production Monitoring Production Deployment Repeatable Predictable Version Control Updated utomation Scripts Test Team AutoDetect Build /Polling the latest code (Build Pipeline) Triggers Build Verification Tests Health Checks Smoke Tests Intelligent regression Build Quality In CI Server(Jenkins) Automated Security Scan Static Code analysis Unit Test Code Coverage analysis Automated Build Creation Code Deployments in autoprovisioned environment Dev/QA/ST Virtualized services Reliable On-Demand Test Data Management ( Environment Data provisioning) Infrastructure as code Cloud application management Build verification Results to stakeholders through email Smoke Results Critical Scenario Results Regression Results Stakeholders
Level #1 - Regression Model
Level #2 Flipping test pyramid GUI driven E2E tests Exploratory/ E2E tests GUI driven system tests Integration Tests Unit Tests GUI driven system tests API driven integration Tests Unit Tests
Level #3 Real-time dashboards for automation tests One source of truth for all types of tests running across the tools/environments/platforms Scripts failures are analyzed within minutes Improved visibility further boosted Dev-Test-Ops collaboration Executive support on your side
Breaking the barrier include Performance tests in CI Commit code Build Code (Maven) Unit tests (Junit) Deploy Code To CI Environment Smoke Tests Functional / Regression Tests 90% Tests Passed? No Yes E2E Build Flag =Y? Yes Deploy Code To Performance Environment Smoke Tests Performance Tests Repository Working Builds Mark the build as failed & review failures Performance test results analysis (manual)
Intelligent Test Automation is Key Repository Source code to test scripts mapping Intelligent test automation takes the code coverage analysis to next level
DevOps Dashboard
Can testers enable DevOps adoption? Yes, we can! Tester
Change is Difficult in the beginning.. Messy in the middle & Gorgeous in the end Robin Sharma We did it!
THANK YOU 19