Beyond Continuous Build: Build Grids. Darryl Bowler, CollabNet

Beynd Cntinuus Build: Build Grids Darryl Bwler, CllabNet

Presenters Clsing the Agile Lp Webinar Series Darryl Bwler, Senir Systems Architect, Services, CllabNet With mre than fifteen years f IT experience, Darryl Bwler leads the cnsulting services business fr CllabNet Lab Management, delivering high-value virtualizatin and test lab autmatin cnsulting services t majr enterprises. Darryl is an accmplished senir systems architect, specializing in sftware develpment methdlgies, virtualizatin, and clud cmputing, cmbined with applicatin lifecycle management and agile best practices. Brian Dawsn, Senir Cnsultant, CllabNet As a Sr. Slutins Cnsultant at CllabNet, fr 5 years Brian Dawsn has helped sftware develpment rganizatins large and small imprve the Applicatin Lifecycle Management prcess thrugh the use f TeamFrge. Prir t CllabNet, Brian spent 12 years in sftware develpment. Ten f thse years were spent at Sny Cmputer Entertainment where he wrked as the Directr f Tls and Technlgy and versaw the develpment and deplyment f TeamFrge as a wrldwide cllabratin prtal. 2

Agenda Perfrmance and Scale When is it time t scale Cst t CI value stream Evaluating yur pipeline Sequential vs. parallel build jbs Managing Multiple Platfrms and Cnfiguratins Life n the grid Distributed build jbs acrss multiple platfrms Distributed test Virtualizatin Elastic prvisining with the clud Dem 3

Pll Have yu adpted Clud technlgy fr builds? 4

Signs That Yu May Need a Build Grid Feedback Impairs Prductivity CI builds that take > 10-15 minutes Develper frustratin X-Platfrms Builds (Hardware Arch) x (OSes) x (Brwsers) System Resurce Bttlenecks Agenda CPU, Netwrk, Disk I/O Cmprehensive Testing Scale t Supprt Grwth Minimize X-team Impact Architecting / Designing an Enterprise Build System Supprting hundred's f develpers and build prjects Standardizatin 5

Impact t CI Value Stream (Cmmit phase) Value Cst Benefit = Up t date cnfidence in the quality f the cde base = Time = Value > Cst Tip: Mnlithic builds shuld be mdularized s nly changed mdules are built. Maven + Dependency Management OSGi Framewrk Shared resurce cnstraints Team level Enterprise level 6

Impact t CD Value Stream (Build Pipeline) The CD Pipeline is (much) mre cmplicated! Resurces fr lnger running functinal testing Mre extensive testing the clser t prductin Cmplex system cnfiguratin IMPACTS TIME TO RELEASE! Sequential Versus Parallel Dependencies e.g. Libraries used within ther prjects (dwnstream) Functinal Testing Nn Functinal Testing 7

Slw Builds Are Csting Yu Mney! CI Scenari: Small develpment team f 5 1 Build System Each cmmit twice a day Build takes 45 minute Cnsideratin: Best practice nt t leave wrk until yu cnfirm yur cmmits are gd Ttal Time Wasted: 10 cmmits x 45 minutes = 7.5hrs Cst Per Year: 7.5hrs x $40 x 340 = $102,000 Nte: This represent a small slice f the build pipeline; true csts are much higher. 8

Multiple Platfrms and Cnfiguratins It is prblem... Grwing list f platfrms that an applicatin must supprt t reach full client base especially with the advent f mbile cmpute Example OS: Windws XP, Windws 7, OSX Brwsers: IE 7 & 8, Firefx, Chme and Safari Up t 13 cmbinatins t supprt Excludes hardware architecture 32 bit versus 64bit Excludes IOS versus Andrid 9

Pll What mde f clud d yu intend t adpt? 10

Cnsideratins When Implementing a Build Grid Business Prblem Scale Imprve time t release Imprve develper prductivity Imprve prcess efficiency What is the ptential grwth base? Static versus Dynamic Bth mdes still imply autmatin Physical, Virtual and Clud Make sure yu understand TCO (True Cst f wnership) In sme cases virtual and clud can cst mre than physical with lwer perfrmance Licensing csts Initial Investment What are the measures f success? The success factrs are an essential part f the feedback lp. 11

Reasns t Build in the Clud Grid and Clud Cmplement Each Other Fllw principles f lean manufacturing a prductin practice that cnsiders the expenditure f resurces fr any gal ther than the creatin f value fr the end custmer t be wasteful, and thus a target fr eliminatin THIS IS OUR GOAL! Predictable resurce pl f cmpute Dynamic prvisining f system resurces Pay (use) as yu need mdel REAL-TIME!! Instant feedback True Clud Cmpute Aligns with the Lean Principles 12

Qualities f a Clud (fr sftware develpment) On-demand prvisining Crss platfrm Can prvisin a multitude f perating systems and stacks A Build and Test Grid Must Have the Same Qualities Rich API Ease f integratin int wrkflw System prvisining becme a service Multi-tenant Flexible RBAC t separate duties and peratins Measurable with a charge back reprting Library f pre-built (reusable) images (Service Catalg) Empwers develpers Increased prductivity Integrate clud capabilities int their develpment tls (IDE) 13

Cnsider the Release Unit Best Practice The Release Unit are all the cmpnents f a Release Deplyment Deplyment Scripts Applicatin Binaries Smke Tests Versined Cntrlled Applicatin Cnfiguratin Dependencies System Cnfiguratin Database Scripts 14

Pll What Clud vendrs d yu use t tday? 15

Reuse Applies t System Cnfiguratin... When yu repetitively manually create systems they have tendency t yield different results. Systems becme institutinalized 16

Use Cases fr Testing in the Clud All Testing Must Be Dne n Prductin-Like Systems Expensive and Resurce Intensive withut Clud High Peaks and lts f Trughs Typically high CPU/Disk but lw average utilizatin Ideally fr the spin up and tear dwn nature f Clud Web Testing Acrss Many Platfrms and Architectures Virtual Machine Images, Prfiles and Labels Nn Functinal Testing Capacity Lad Testing and Simulatin 17

A Web Testing Grid - Selenium A platfrm t autmate web tests Crss perating system and web brwser supprt An API that can be driven frm varius languages C#, Perl, Java, PHP Pythn and Ruby Can be used in tw ways Simple web autmatin via the Selenium IDS Or a cmprehensive web testing grid using WebDriver API Ggle prject Supprts many languages 18

Nn-Functinal Lad Generatin in the Clud 19

Dynamic Scalable Build Grid When build autmatin is cmbined with clud technlgy A build farm that scales depending n the build lad Requires pre-build Images, Prfiles r Labels Library f pre-built Images representing all build stacks Reasns Near real-time builds Pay fr what yu use N waiting n resurces Autmatin and reuse implied 20

Tls t Create an Elastic Build Grid Jenkins as a Distributed Build Grid Plug-ins Amazn EC2 Delta Clud Swarm vsphere CllabNet Lab Management with TeamFrge: Private enterprise build grid Supprt Physical, Virtual r Clud (different SLA s / Cst mdels) Dem 21