Structured Approach to Testing - Android in an Agile Environment

Size: px

Start display at page:

Download "Structured Approach to Testing - Android in an Agile Environment"

Reynold Gibbs
6 years ago
Views:

1 Structured Approach to Testing - Android in an Agile Environment

2 Table of Contents 1 Mobile Marketplace Top Challenges & Goals Traditional vs Agile Mobile Testing Lifecycle Elements of a Structured Testing Approach Android Testing Methodology Model Based Testing Execution Tools Test Accelerators Test Service as a Platform 10 The Enablers 2 - Confidential

3 Mobile Marketplace 3 - Confidential

Top Challenges & Goals Meeting Testing Goals

Functional Testing Test Coverage Performing

4 Top Challenges & Goals Meeting Testing Goals Ensuring Zero Defects in Production Developing High Performance Apps Maximizing User Satisfaction Functional Testing Non Functional Testing Test Coverage Performing Regression Usability Compatibility Performance 4 - Confidential

Traditional vs Agile Testing Lifecycle 4 Week Lifecycle

Accelerators Assuming nearly 40% efforts goes into Testing

at least 8 days of testing required An agile development

Nearly 20% of TAT reduction Standard Process Implementation,

5 Traditional vs Agile Testing Lifecycle 4 Week Lifecycle Traditional Agile 2 Week Lifecycle Process Tools Accelerators Assuming nearly 40% efforts goes into Testing in a mobile lifecycle A traditional 4 week cycle would have at least 8 days of testing required An agile development cycle of 2 weeks would have only 4 days dedicated to testing Nearly 20% of TAT reduction Standard Process Implementation, 40% - Automation using Industry Tools & 20% to Usage of Accelerators 5 - Confidential

Best Practices & Reusable Assets W3C Industry Standards

Implementation Checks Tools include Test Case Designers

Accelerators include Test Accelerators Platform Accelerators

Results Reusable Test Design Models AutomationTool s Scenarios

PERFECTO HP 3i Infotech s Mobile Testing Elements Reports

6 User profile/trace Data Elements of a Structured Testing Approach Process Tools Accelerators Process Elements include Best Practices & Reusable Assets W3C Industry Standards Continuous Iterative Improvements Defined Controls Post Implementation Checks Tools include Test Case Designers Regression Automation Emulators Simulators Research Lab Accelerators include Test Accelerators Platform Accelerators Design Accelerators Test Accelerators Testing Lab Testing Results Reusable Test Design Models AutomationTool s Scenarios Templates Data State of Art Lab PARTNERS DEVICE ANYWHERE KEYNOTE PERFECTO HP 3i Infotech s Mobile Testing Elements Reports Recommendation Validations Defect State of Reduction Art Lab Users Global Standard Content Baselines Interface 6 - Confidential

7 Examples of Best Practices Process Elements Maximum Coverage Negative Test Requirements Business Scenario Positive Test Cases Test Steps Alternate Maximum Traceability Test Requirements Business Scenario / Test scenario Test Cases Defects Maximum Reuse Test Requirements Design Test Cases Review Test Cases Test Management Repository Extract Existing Test Cases Redefine Test Conditions Review Test Cases Redesign Test Cases 7 - Confidential

8 Android Testing Methodology[ATM] Analyze Plan & Design Execute Report Process Elements Tester connects to smartphones in remote locations to test and troubleshoot mobile apps Your Apps Here Carrier/Operator Mobile Content, Services & Applications 8 - Confidential

9 Model Based Testing Process Elements Models for automated test generation MBT Test Production Business Needs production engine MBT Automated Traceability Test Repository Business Analyst Collaboration Automated test execution Manual Test execution 9 - Confidential

10 Model Based Testing Illustrative 10 - Confidential

Test Design Automation Reporting - Traceability 1000 900 Cumulative effort per release 800 The

coverage 700 600 500 400 300 200 100 0 +50% test productivity increase Project Maintenance -70%

11 Test Design Automation Reporting - Traceability Cumulative effort per release 800 The test generation engine computes from the models all the test cases necessary to reach the defined coverage % test productivity increase Project Maintenance -70% maintenance cost reduction Source: Business Case Tool Smartesting Confidential

Tools for Execution Benefits Easy and efficient script creation Reduced

conditions, loops, flow commands, expressions and datatables Detailed reports

recording of the entire script and graphs showing statistics about the

by using real time online handset sharing with multiple participates Open API

12 Tools for Execution Benefits Easy and efficient script creation Reduced manual testing efforts on all platforms Full flow control Including conditions, loops, flow commands, expressions and datatables Detailed reports Reporting results, screen captures in digital format, continuous video recording of the entire script and graphs showing statistics about the execution Enhanced collaboration Save time and money on problem reproduction by using real time online handset sharing with multiple participates Open API Integration into 3rd party tools such as test management, monitoring and defect tracking 12 - Confidential

Test Accelerators Accelerators Elements Execution Automation Framework Process Test Accelerators Driver, Runtime, Logger, Exception Handler Library Framework Configuration Test Configuration Logging

13 Test Accelerators Accelerators Elements Execution Automation Framework Process Test Accelerators Driver, Runtime, Logger, Exception Handler Library Framework Configuration Test Configuration Logging Configurations Configurations Application Configuration Report Configuration Mailing Configuration Operating System Command Line Web Specific Excel Files Test Handlers File System Networks Mailing Utilities Logging 13 - Confidential

Test Platform as a Service [TaaS] Test Services on Hire CLIENT ORGANISATION Testing Team CLOUD CLIENT INTERFACE Account Mgmt Pay by Use Project Manager Process Assets COE TOOLS (SaaS)

14 Test Platform as a Service [TaaS] Test Services on Hire CLIENT ORGANISATION Testing Team CLOUD CLIENT INTERFACE Account Mgmt Pay by Use Project Manager Process Assets COE TOOLS (SaaS) Infrastructure SME s Domain Option 2 Hardware Software Test Data Access to Tools Access to SME s on various testing techniques Access to Domain Assets Proven Process/Methodology/Best practices 14 - Confidential

15 Chennai Virtual Labs Physical Labs Hyderabad Bangalore The Enablers Domain & Automation Lab Core Infrastructure 2 IBM X3650, Xeon Quad Core 1.60 GHz 16 GB RAM, 300 GB HDD*2 Hardware Extendable Infrastructure Infrastructure Management Services Mobile Testing Lab Cloud Infrastructure 2 AIX 5.3, IBM P510 Series,4 16 GB RAM, 300 GB HDD*2 2 IBM X3650, Xeon Quad Core 1.60 GHz 8GB RAM, 500 GB HDD*2 Testing Tools Tools (Software) Knowledge Management Performance & Compliance MS SharePoint Communication 15 - Confidential

16 THANK YOU

Copyright 2013 by AGILOD Consulting, LLC. All Rights Reserved. Test Automation. Done The AGILOD Way

Copyright 2013 by AGILOD Consulting, LLC. All Rights Reserved. Test Automation. Done The AGILOD Way All Rights Reserved. Test Automation Done The AGILOD Way What is The AGILOD Way? The AGILOD Way refers to a unique approach to test automation combined with a set of open source QTP actions & function