Live Webinar: Elevating Customer Experience with a Mobile QA Strategy That Works

Transcription

1 Live Webinar: Elevating Customer Experience with a Mobile QA Strategy That Works

2 Today s Speakers Guido Lubinski QA Principal Manager Kumaresan Narayanaswamy Head, Test Automation CoE Tal Barmeir CEO 2

3 AGENDA 1. How a mobile ecosystem is reshaping the organization priorities 5 min 2. Need of a comprehensive mobile testing strategy for superior customer experience 5 min 3. Key challenges and opportunities ahead for organizations in mobile-first world 5 min 4. Mobile 25 min 5. Mobile QA tools insights to action 10 min 6. Q&A 5 min 3

4 How a mobile ecosystem is reshaping the organization priorities (1/2) Digital Channels for Connected Experience Billion TouchPoints happening everyday on Mobile Apps Social Web Kiosk Digital Payments & Smart TV Signage Wearables 4

5 How a mobile ecosystem is reshaping the organization priorities (2/2) People & Culture Process & Governance Technology Diversity Competency Customer centricity Innovation Device policies, device ownership models Security, privacy Light-weight approach Diversity of Apps and Devices Mobile enabled BizOps Omni channel experience 5

6 Need of a comprehensive mobile testing strategy for superior CX High Velocity Quality Test strategy to be derived based on App analytics, Device Analytics and Monitoring as continuous process Comprehensive focus on functional and beyond-functional aspects like performance, security, compatibility, accessibility, usability Progressive automation with ever expanding coverage as continuous journey throughout lifecycle of mobile apps 6

7 Key challenges and opportunities ahead for organizations in mobile-first world Key Challenges Opportunities Anytime, Anywhere Access Fragmentation devices, OS, et al Recognize mobile app maturity curve Someone can snoop over Quality cannot be compromised for speed Personalized expectations Test beyond functional cover all types of persona for CEx Monitor the app throughout its life-cycle Tools and automation Enterprise Mobile app management and governance 7

8 Vodafone Case Study

9 Company Profile Major Telecommunication Company Headquartered in UK More than 100,000 employees Operates in around 80 countries Customer base of above 400 million worldwide 9

10 Is it easy to get into customers shoes? No! Various constraints when it comes to simulation of real customers behaviour: Scope Variety of (device specific) Mobile Services Various customer touchpoints and platforms Country specific SIM cards / roaming Logistics Location of testers globally distributed Shipping Confidentiality Local testing environments Business High quality demands Cost pressure Time-to-market Agility? 10

11 Device Cloud(s) to drive Customer Experience! Around devices in three flavors: QA Cloud QA Core business: ~ 70+ different devices Acceptance Testing, Managed Test Service Offshoring, Test Automation Global App Viewer 21 markets, 3 different SIMs, 130 devices Manual access for development teams Harmonization of local market look and feel Vodafone Device Cloud External vendors/suppliers: ~ 60+ devices Integrate into CI frameworks (Jenkins), fully supporting agile delivery Automated Device Certification 11

12 Further improvements of the Vodafone Device Cloud Some improvements already implemented: Operational improvements: Floating licenses: allowing flexibility, a unified environment and enables everyone from anywhere to use the cloud. Automated Device Management: discharging, brightness, WiFi Distributed Device Cloud: allows, on a need-basis, connecting to a satellite agent device in a different country and testing under real network conditions Automated SIM Switcher: that in conjunction with SeeTestCloud, enables testing multiple SIMs on a single device (up to 16 SIMs) Test Automation Framework: with full access for (external) teams and Jenkins integration 12

13 Apart from being close to the Customer other benefits What counts is the money: Enablement of off-shore model with avoiding roaming costs Reduce flying to different countries and locations High utilization of devices, # devices reduced significantly Result: tremendous cost reduction 13

14 Lessons learned Some hurdles we have overcome in setup and during run times: Plan for scalable architecture and optimal network connectivity Automate as much as possible operational support processes Plan and prepare for appropriate User Management and Access controls 14

15 Mobile QA Tools - Insights to Actions 15

16 Centralized, Onsite Mobile Device Lab Keep all your mobile devices in a centralized onsite location and allow remote access to them from anywhere at anytime Simple set-up software only solution running on standard Windows or Mac machines Enterprise level security, reside within your VPN High speed performance Full recovery, redundancy and no single point of failure 16

17 Remote Access to Mobile devices Fully control remote mobile devices from your browser anytime, anywhere Web access from any browser Immediate support for all mobile OS, incl. beta versions Support all mobile devices Fully integrates to all testing, dev & CI environments 17

18 Scalability Enable any number of mobile devices and users in any geography Mobile device lab Site A Site B Site N Cloud Server Device Host 1 (MAC/ Windows) Device Host 2 Device Host n Device Host 1 Device Host n Device Host 1 Device Host 2 Device Host n Corporate Network Site A Site N Auto. engineer (MAC/ Windows machine) Auto. engineer Auto. engineer Automation Team Manual Tester Manual Tester Manual QA Team Developer Developer Dev Team Auto. Auto. engineer engineer Automation Team Manual Tester Manual Tester Manual Tester Manual QA Team Developer Dev Team 18

19 Management Capabilities Effectively manage large scale mobile projects with advanced management tools Dashboard for quick overview Usage reports and alerts Enhanced user, device and application management capabilities 19

20 Manual Testing Perform manual testing on a remote mobile device, as though it was at the tester s hand Fast interaction Support for all manual gestures Control all physical and virtual device buttons Full control on device power cycle Visual reports 20

21 Mobile Test Automation Test all types of mobile applications, and automate advanced mobile application scenarios Use the test recorder, view device screen and add commands Integrate with any testing environment incl. Appium Run the same test on different mobile devices & OS s Test barcode & check scanning, audio, GPS simulation, TouchID Test Native, Web and Hybrid, system (setting, SMS) & 3rd party apps 21

22 CI/CD Integration Accelerate your testing cycles with a fully automated 24/7 continuous testing environment Seamless integration into CI environments Large scale parallel execution (Grid) Centralized, cloudbased execution, directly managed from the CI Real time view of all executions Centralized test reporting 22

23 Non-Functional Capabilities Test your application under different device conditions and network conditions Monitor consumption of the mobile device CPU, memory and battery Simulate different network conditions and on the-move scenarios that are unique to mobile users 23

24 Development & Debugging Provide developers with an advanced testing environment and access to real remote devices Simulators & emulators native support Integrate with XCode, eclipse, Android Studio and more Support UI/unit testing using XCUITest, Espresso and UIAutomator Integration with Appium, Calabash, Cucumber and more. Ability to share detailed reports and live sessions 24

25 Demo CI/CD integration

26 26 QA