Structured Approach to Testing - Android in an Agile Environment
Table of Contents 1 Mobile Marketplace 2 3 4 5 6 7 8 9 Top Challenges & Goals Traditional vs Agile Mobile Testing Lifecycle Elements of a Structured Testing Approach Android Testing Methodology Model Based Testing Execution Tools Test Accelerators Test Service as a Platform 10 The Enablers 2 - Confidential
Mobile Marketplace 3 - Confidential
Top Challenges & Goals Meeting Testing Goals Ensuring Zero Defects in Production Developing High Performance Apps Maximizing User Satisfaction Functional Testing Non Functional Testing Test Coverage Performing Regression Usability Compatibility Performance 4 - Confidential
Traditional vs Agile Testing Lifecycle 4 Week Lifecycle Traditional Agile 2 Week Lifecycle Process Tools Accelerators Assuming nearly 40% efforts goes into Testing in a mobile lifecycle A traditional 4 week cycle would have at least 8 days of testing required An agile development cycle of 2 weeks would have only 4 days dedicated to testing Nearly 20% of TAT reduction Standard Process Implementation, 40% - Automation using Industry Tools & 20% to Usage of Accelerators 5 - Confidential
User profile/trace Data Elements of a Structured Testing Approach Process Tools Accelerators Process Elements include Best Practices & Reusable Assets W3C Industry Standards Continuous Iterative Improvements Defined Controls Post Implementation Checks Tools include Test Case Designers Regression Automation Emulators Simulators Research Lab Accelerators include Test Accelerators Platform Accelerators Design Accelerators Test Accelerators Testing Lab Testing Results Reusable Test Design Models AutomationTool s Scenarios Templates Data State of Art Lab PARTNERS DEVICE ANYWHERE KEYNOTE PERFECTO HP 3i Infotech s Mobile Testing Elements Reports Recommendation Validations Defect State of Reduction Art Lab Users Global Standard Content Baselines Interface 6 - Confidential
Examples of Best Practices Process Elements Maximum Coverage Negative Test Requirements Business Scenario Positive Test Cases Test Steps Alternate Maximum Traceability Test Requirements Business Scenario / Test scenario Test Cases Defects Maximum Reuse Test Requirements Design Test Cases Review Test Cases Test Management Repository Extract Existing Test Cases Redefine Test Conditions Review Test Cases Redesign Test Cases 7 - Confidential
Android Testing Methodology[ATM] Analyze Plan & Design Execute Report Process Elements Tester connects to smartphones in remote locations to test and troubleshoot mobile apps Your Apps Here Carrier/Operator Mobile Content, Services & Applications 8 - Confidential
Model Based Testing Process Elements Models for automated test generation MBT Test Production Business Needs production engine MBT Automated Traceability Test Repository Business Analyst Collaboration Automated test execution Manual Test execution 9 - Confidential
Model Based Testing Illustrative 10 - Confidential
Test Design Automation Reporting - Traceability 1000 900 Cumulative effort per release 800 The test generation engine computes from the models all the test cases necessary to reach the defined coverage 700 600 500 400 300 200 100 0 +50% test productivity increase Project Maintenance -70% maintenance cost reduction Source: Business Case Tool Smartesting 1 2 3 4 5 6 7 11 11 - Confidential
Tools for Execution Benefits Easy and efficient script creation Reduced manual testing efforts on all platforms Full flow control Including conditions, loops, flow commands, expressions and datatables Detailed reports Reporting results, screen captures in digital format, continuous video recording of the entire script and graphs showing statistics about the execution Enhanced collaboration Save time and money on problem reproduction by using real time online handset sharing with multiple participates Open API Integration into 3rd party tools such as test management, monitoring and defect tracking 12 - Confidential
Test Accelerators Accelerators Elements Execution Automation Framework Process Test Accelerators Driver, Runtime, Logger, Exception Handler Library Framework Configuration Test Configuration Logging Configurations Configurations Application Configuration Report Configuration Mailing Configuration Operating System Command Line Web Specific Excel Files Test Handlers File System Networks Mailing Utilities Logging 13 - Confidential
Test Platform as a Service [TaaS] Test Services on Hire CLIENT ORGANISATION Testing Team CLOUD CLIENT INTERFACE Account Mgmt Pay by Use Project Manager Process Assets COE TOOLS (SaaS) Infrastructure SME s Domain Option 2 Hardware Software Test Data Access to Tools Access to SME s on various testing techniques Access to Domain Assets Proven Process/Methodology/Best practices 14 - Confidential
Chennai Virtual Labs Physical Labs Hyderabad Bangalore The Enablers Domain & Automation Lab Core Infrastructure 2 IBM X3650, Xeon Quad Core 1.60 GHz 16 GB RAM, 300 GB HDD*2 Hardware Extendable Infrastructure Infrastructure Management Services Mobile Testing Lab Cloud Infrastructure 2 AIX 5.3, IBM P510 Series,4 16 GB RAM, 300 GB HDD*2 2 IBM X3650, Xeon Quad Core 1.60 GHz 8GB RAM, 500 GB HDD*2 Testing Tools Tools (Software) Knowledge Management Performance & Compliance MS SharePoint Communication 15 - Confidential
THANK YOU