MOBILE app testing tools & experience

Transcription

1 MOBILE app testing tools & experience Sandip Ghosh, Practice Lead, Global Testing Solutions, SAP Paul Jackson, Principal Consultant, SAP UK 2013 SAP AG or an SAP affiliate company. All rights reserved. 1

2 app y MOBILE testing A discussion on challenges in application testing different types of mobile applications we lead on to looking at different options for mobile application testing. The options will include using SAP Solution Manager, SAP Quality Center and other tools. This will then be followed by a Mobile Apps Test Automation Demo and opportunity to ask questions that will lead to app y MOBILE testing SAP AG or an SAP affiliate company. All rights reserved. 2

3 Agenda Challenges in mobile application testing Types of mobile applications Test management overview Mobile application testing Introducing SeeTest by experitest Mobile Apps Test Demo Questions & Summary 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 3

4 Challenges in mobile application testing

5 Key challenges in testing of mobile applications Functional testing Variety of mobile devices with different operating systems High number of combination (e.g. business process variants, devices, network) in case of changed business processes Test for user interactions 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 5

6 Mobile application testing Challenges Variety of mobile devices Many operating systems Numerous mobile operators Extremely dynamic space Different screen sizes, processing power,etc Different input types: Normal, Touch, Qwerty keyboards Different battery strength, etc Mobile OS is divided under the category of Smartphones and normal OS There are many vendors in Smartphone mobile OS space (fragmented market share) Each OS has many releases, and there are devices running on different version of the same mobile operators in the world with different communication technology like GSM, CDMA, LTE, etc. Each operator has his own unique combination of infrastructure based protocol The devices performance depends on the signal strength, location, time of day, etc Mobile devices are evolving very quickly Mobile OS versions and variety is increasing at rapid pace Fast changing market share for mobile devices, Operating Systems, etc. Variety of applications SAP, partner and customer applications Applications of kind: Web, Hybrid & native 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 6

7 Types of mobile applications

8 Types of mobile applications Browser-based Hybrid Native Accessed via internet on mobile browsers e.g. m.facebook.com User interface is native but content is loaded from web e.g. facebook app Standalone & server based applications 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 8

9 Architecture 1. Variety of mobile apps SAP, Partner, and Custom Apps Browser based Hybrid Native Apps Internet 2. Connectivity SAP Mobile Platform SAP NetWeaver Gateway 3. Backend SAP Business Suite 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 9

10 Test management overview

11 SAP Test Management Products and capabilities integrated with SAP Solution Manager 7.1 SP07+ New SAP Solution SAP Solution Update Business Blueprint Change Impact Analysis Test Planning/Management Test System Setup Test Execution Change Deployment Business Blueprint Test Option 1 Test Management Test Workbench Test Automation Test Automation Framework CBTA HP QTP 3 rd Party BPCA Test Option 2 Test Management Quality Center Test Automation Business Process Testing SAP TAO HP QTP Test Option 3 SAP Connector, Quality Manager, Requirements Composer, Team Concert, SAP AG or an SAP affiliate company. All rights reserved. Public 11

12 Mobile application testing

13 Test Management Products and capabilities of Test Option with SAP Solution Manager 7.1 Business Blueprint Change Impact Analysis Test Planning/Management Test System Setup Test Execution Reporting Change Deployment Test Option 2 Solution Manager Business Blueprint Process documentation Business requirements Adapter Test Requirement Defects / test results Quality Center by HP Requirement Test Plan Business Process Tests Quality Center by HP Test Lab Sprinter QTP Defect DEMO SAP TAO Solution Manager BPCA Change Impact Analysis Optimized SAP test scripts Accelerated maintenance 3rd party mobile automation tools e.g. SeeTest Test Scope Optimization SAP TDMS LoadRunner Setup of lean test systems Load and performance testing 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 13

14 Flow to create automated test for mobile applications Business Process SAP Quality Center Create Test Requirements Create Automated Test Script 1. Sign On to SeeTest 2. Access devices hosted on cloud or via USB connection On cloud devices Assign tests to requirements 3. Convert the script in QTP format On premise devices Store QTP Script DEMO SAP Quality Center by HP 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 14

15 Introducing SeeTest by experitest

16 experitest- Overview Company overview Mobile Test Products - Market leader in Mobile testing & Monitoring - 7 of 10 largest banks in the world base their mobile testing on experitest - HP Gold partner and HP Certified Application - Microsoft VSIP Premier partner Key functionalities Integration options Software only, simple and quick deployment Device connectivity: Local or Cloud (remote) Mobile OS: ios, Android, Blackberry and WindowsPhone Identification by Native/Web properties, inc Xpath Integrative to all test, monitoring & CI environments HP UFT/QTP as add-in which integrates with HP ALM and SAP Solution Manager HP Quality Center,Performance Center &LoadRunner Microsoft Visual Studio and TFS IBM Rational Junit, Perl and Python Jenkins, Team City 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 16

17 Example Customers Worldwide customer base of Fortune 500 companies Hundreds of users, thousands of 24/7 test users 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 17

18 7 out of the top 10 banks base their mobile testing on SeeTest Top 10 banks worldwide*: Barclays HSBC American Express Bank of America Bank of China Wells Fargo JPMorgan Westpac Citigroup TD Bank. Out of these, 7 (!) have large scale deployments of SeeTestAutomation for mobile testing. SeeTest from experitest is the tool of choice for the banking industry worldwide. *based on Wikipedia 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 18

19 Product Portfolio SeeTestAutomation Automation tool Records & Play on real devices and on emulators Plugs into UFT/QTP, Visual Studio, RFT, Junit, Python, Perl SeeTestManual Manual testing tool Test on one device manually, get results on 8 devices Integrated to QC SeeTestCloud Device hub located onsite (in the customer VPN) that can be remotely accessed 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 19

20 SeeTestCloud Approach for remote testing of mobile devices 1.Access SeeTestCloud via SeeTest tool and select an appropriate device Onsite Mobile cloud User 2.Device Visualization appears on the User machine 3. Over the air/remote installation of the mobile app Mobile devices hub HP ALM 4. Record, Execute and View repots on the User machine as though the device was locally connected 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 20

21 Mobile Apps Test Demo

22 Thank You For Your Time Questions 2013 SAP AG or an SAP affiliate company. All rights reserved. Public 22

23 app y MOBILE testing A discussion on challenges in application testing different types of mobile applications we lead on to looking at different options for mobile application testing. The options will include using SAP Solution Manager, SAP Quality Center and other tools. This will then be followed by a Mobile Apps Test Automation Demo and opportunity to ask questions that will lead to app y MOBILE testing SAP AG or an SAP affiliate company. All rights reserved. 23