CONTINUOUS DELIVERY WITH EFFICIENT AUTOMATED TESTING IN CLOUD

Transcription

1 Budapest, October 2016 CONTINUOUS DELIVERY WITH EFFICIENT AUTOMATED TESTING IN CLOUD Presented by [Teresa Song] All rights reserved

2 Agenda Product Introduction Challenge & Solution 2 All rights reserved

3 Product Intro IOT PLATFORM Industry Solution UTILITIES TRANSPORT PUBLIC SAFETY SMART CITIES OTHER INDUSTRIES Ericsson Apps IoT Platform Device SDK Device Registry Device Management ERICSSON IOT APPLICATIONS MARKETPLACE Customer Apps M2M Data Management Partners Apps Network and Device Adaptation Device Authentication App SDK Real-Time Rule Execution Data Encryption ERICSSON PROFESSIONAL SERVICES Device 3 All rights reserved

4 Test Strategy Physical Server Virtualization KVM VMWare Openstack Support Multi-Cloud Openstack ECC AWS Docker Deployed Platform PER CHECK IN DAILY PER SPRINT PER RELEASE Unit Test Component Test High Priority Function Test All Function Test >98% Performance Test Stability Test Manual FT <2% Upgrade Test Document Test RBT 4 All rights reserved

5 Challenge & Solution Extract foundation modules as image > 98% automation rate Jenkins job, Longest > 2 hours Good Challenge CI with sufficient test 10,000+ test scripts more and more Introduce new CI framework 5 All rights reserved

6 Extract Foundation Image Customer Customer Sold by Value Package D B D B C A C E Customer A Check-in UT/CT is pass? Fail Send feedback Pass Hierarchical images are used here Image with component A+B FT/NFT is pass? Fail Send feedback Reduced, 38 Min 30% Pass Ready for Customer G F D B C A E Build A Check-in Build B Build C Build D Image Repo Image A Image AB 6 All rights reserved

7 Challenge & Solution Extract foundation modules as image > 98% automation rate Jenkins job, Longest > 2 hours Good Challenge CI with sufficient test 10,000+ test scripts more and more Introduce new CI framework 7 All rights reserved

8 Test CI Framework Support Image Launch OpenStack Jenkins Test Job Customized JClouds Plugin glance Image Interface Default Image Dispatch Slave Resource Helper create image Upload image delete image Component Image GIT Repo CI Script Frontend nova Exclusive Slave CI Script Invoker Server Interface create server delete server Slave instance -- Dispatcher Slave Reference Artifactory Default Action Library hook Slave instance -- Exclusive Slave Call Flow 8 All rights reserved

9 Exclusive Slave Unified CI API Smart Execute Test Dispatch Slave Resource Helper CI Script Frontend Jenkins Test Job Config Job on Dispatch Slave Exclusive Slave CI Script Invoker Config Default Action Action List Library Core Action List Script List hook Default config Hook List Invoke Layer Action Layer Library Layer Exclusive Slave CI Script Invoker Default Action Library hook Invoker Layer Jenkins job invoke Core script in CI invoker bring job s configuration as input parameter Core script combine Job s input and default configure to action invoke list Invoke action by list Action Layer Associate library script for default action invoke hook before and after action perform Library Layer Provide basic API 9 All rights reserved

10 Action Layer Example Invoke Layer Core Action List Master Function deploy verify gatherinfo appserver : occas Installation : m2m testinit : m2m functiontest: m2m Use to Locate branch or folder Action List function/ (ft/smoketest/upgrade) deploy network.py class ipv6 appserver.py class occas class jboss installation.py class m2m class messaging verify Use common testinit.py when not find class common functiontest.py class common class m2m class messaging Hook List function deploy installation.py class m2m pre class m2m post Dispatch Slave Exclusive Slave Resource Helper CI Script Frontend CI Script Invoker Default Action Library Library Layer Library hook DbExecution performmysql.py performoracle.py getcomponent getrpmfromrepo.py getwarfromrepo.py deployrpm installrpm.py installwar.py activecomponent activeoccas.py activejboss.py 10 All rights reserved

11 Challenge & Solution Extract foundation modules as image > 98% automation rate Time to Error Discovery is Good much shorten CI with sufficient test Jenkins job, Longest > 2 hours Average 38 minutes/30% are saved for each Jenkins test job Easy and flexible to support Challenge testing on future multi-cloud platform 10,000+ test scripts more and more Introduce new CI framework 11 All rights reserved

12 Changing On The Way Physical Server Virtualization KVM VMWare Openstack Support Multi-Cloud Openstack ECC AWS Docker Deployed Platform Q & A 12 All rights reserved