Innovate 2013 Automated Mobile Testing

Size: px

Start display at page:

Download "Innovate 2013 Automated Mobile Testing"

Vivian Golden
6 years ago
Views:

1 Innovate 2013 Automated Mobile Testing Marc van Lint IBM Netherlands 2013 IBM Corporation

2 Please note the following IBM s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here. 2

3 Agenda Mobile Testing. 3

4 How is mobile application testing different? Device platforms, fragmentation, and growth ios, Android, BlackBerry, Windows Phone, Symbian, etc. Multiple form factors and screen resolutions Device refresh every 24 months In 2011, over 300 new devices released New capabilities to test Camera, GPS, orientation, voice, etc. More network considerations Multiple carriers, variable throughput and latency, disconnected use, network switching, etc. User experience is more critical Usability testing Translation testing In-network testing (average response time, QoS)

5 Testing the end-to-end mobile solution Client Tier Devices Middle Tier Server Back-end Data & Services Testing involves much more than just the mobile front-end RTW offers a complete solution

6 Testing the end-to-end mobile solution (cont) Client Tier Devices Middle Tier Server Back-end Data & Services Mobile & Web* Functional Test Service Functional Test Performance Test Service Virtualization MTWW RTW Rational CLM

Automated Mobile Functional Testing Delivering support for native, web, and hybrid

2+ IOS 6+ Android & ios hybrid apps HTML5/CSS3 JQuery Mobile Capture (record) a test from a

simplifies authoring and supports multi-language Shares multi-channel, Keyword, and execution

7 Automated Mobile Functional Testing Delivering support for native, web, and hybrid applications on Android and ios Supported Mobile Operating Systems Android 2.2+ IOS 6+ Android & ios hybrid apps HTML5/CSS3 JQuery Mobile Capture (record) a test from a physical device or mobile emulator Structured test definition language (ClearScript) simplifies authoring and supports multi-language Shares multi-channel, Keyword, and execution capabilities within the Rational Test Workbench & Rational Quality Manager Shell-share provides seamless transition from Worklight to RTW

script by adding verification points and others instructions Playback: run the test

8 RTW Main Features 4 steps-testing approach: Recording: play your test first with the recording-ready app and generate a test script Authoring: edit and enhance the test script by adding verification points and others instructions Playback: run the test script on a real device, a simulator or an emulator Reporting: generate an HTML report IBM Confidential

9 Key concepts Test Workbench Mobile Client Test Editor Test Reports An Integrated Development Environment (IDE) to prepare mobile applications for testing and create and modify mobile tests Allows the recording and playback of test scenarios on the mobile device Enable test creation using English narrative and application images to define test steps and verifications Visualize the test flow and report on test failures Prepare Target App Modified App (record, playback) Test Workbench Author Recorded Steps Mobile Test Test Workbench Execute Test Results Test Workbench

ClearScript Test Script A simple instruction set understandable by a nondeveloper In English and some other languages All instructions refer to UI Objects by a simple description of its content

10 ClearScript Test Script A simple instruction set understandable by a nondeveloper In English and some other languages All instructions refer to UI Objects by a simple description of its content and/or a localization with an other UI Object easier to describe A form-oriented editor allows to modify each instruction very easily The Test Script can be enhanced to support localized strings of the application under test The same script can be executed on devices with different locales without any modification Verification Points can be added an any property of any UI Objects Many way to substitute data in the script From datapool References can be created in the script and reuse in substitutions Instructions set Verification Points Command editor Localized string

corresponding action A tree view of all the UI Object The properties list of the selected

11 The Test Editor Select an instruction in the test script Update the form editor Update the mobile data view Mobile Data View contains A snapshot of the UI taken just before the corresponding action A tree view of all the UI Object The properties list of the selected UI Object Many shortcuts for creating Verification Points and Variable from any object and property

Executing a Test Script From the device Select a test and run it on the device No substitutions From the workbench Switch the device in passive mode The workbench select

12 Executing a Test Script From the device Select a test and run it on the device No substitutions From the workbench Switch the device in passive mode The workbench select automatically the right device corresponding to the test script (Android/iOS, API level...) From RQM Similar to the run from Workbench Possibility to have additional selection criteria

13 Integration with other tools RTW other extensions Usable with HTTP & SOA extensions Usable with RIT (services virtualization) RQM Integration Execution of existing recorded test script in regression Additional features for Mobile Test Workbench for Worklight Worklight Studio and RTW can shell-shared for a smooth integration between development and testing activities Availability on MacOS Better support for JQuery-based applications Applications under test can be uploaded from Worklight Application Center

15 Conclusion 2013 IBM Corporation

16 Rational is moving fast RTW is unique in the market Functional / Performance / Integration Web / Java / Mobile / 3270 etc.. RTW Mobile Really something new! No coding Android and ios CLM + RTW are major building blocks for continuous testing

17 Acknowledgements and disclaimers Availability: References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results. Copyright IBM Corporation All rights reserved. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. IBM, the IBM logo, ibm.com, Rational, the Rational logo, Telelogic, the Telelogic logo, Green Hat, the Green Hat logo, and other IBM products and services are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol ( or ), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at Copyright and trademark information at Other company, product, or service names may be trademarks or service marks of others. 17

http://business.vanlint5.nl Copyright IBM Corporation 2013. All rights reserved.

IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials.

conditions of the applicable license agreement governing the use of IBM software.

18 Copyright IBM Corporation All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others. 18

Lab DSE Designing User Experience Concepts in Multi-Stream Configuration Management

Lab DSE Designing User Experience Concepts in Multi-Stream Configuration Management Lab DSE-5063 Designing User Experience Concepts in Multi-Stream Configuration Management February 2015 Please Note IBM s statements regarding its plans, directions, and intent are subject to change or