WEB & MOBILE AUTOMATION

Size: px

Start display at page:

Download "WEB & MOBILE AUTOMATION"

Donna Arnold
5 years ago
Views:

1 WEB & MOBILE AUTOMATION 11 th Feb 2017 Presenter: (CoE) 9 Mansi, 5 th Floor, Cross Lane No. 1, Ram Maruti Road, Thane West info@educognitio.com Phone: +91 (0) Web:

01 Automation Testing 6 Choices Presented by Tripti Mittal TO AUTOMATE OR NOT? WHEN TO AUTOMATE? WHAT TO AUTOMATE? WHAT TO AUTOMATE WITH? VERTICAL or HORIZONTAL AUTOMATION?

Automation Testing Misconceptions Frequent Releases Quality of Manual Testing Process Stability of Module/ Application Goal: Achieve Quality & Coverage Desktop Application, Web Application, Web APIs,

2 01 Automation Testing 6 Choices Presented by Tripti Mittal TO AUTOMATE OR NOT? WHEN TO AUTOMATE? WHAT TO AUTOMATE? WHAT TO AUTOMATE WITH? VERTICAL or HORIZONTAL AUTOMATION? DATA DESIGNING CHOICE Why to Automate? Automation Testing Misconceptions Frequent Releases Quality of Manual Testing Process Stability of Module/ Application Goal: Achieve Quality & Coverage Desktop Application, Web Application, Web APIs, Database, Mobile Applications Build / Smoke / Regression Tests End to End Test / User Acceptance Tests Best-Fit Automation Tool Functionality Usability Maintainability Flexibility Affordability Compatibility Horizontal: Automation E2E where each TC is independent of each other Vertical: Automating TCs feature-wise to save execution time Hardcoded OR Parameterized Type of Data Volume of Data Dynamicity of Data AGILE TRADITIONAL TEST ASSESSMENT & CONSULTANCY 05

3 02 Automation Testing Challenges High Maintenance: App UI & Design Changes Frequently Lack of Reuse: Across Projects, Tools & Technology Complex: Need Technical Expertise! Framework: Need of Robust Framework Dependency: Build Stability, Functional Support

4 03 Automation Testing Process (contd..) Test Processes Tool Evaluation Test Identification for Automation Review current Test process, strategy and plan Understand Applications Identify testing inefficiencies, inconsistencies & challenges Review type of tests like Regression, ST, UAT Understand Technology stack Open Source V/S Commercial tools Tool Comparison Matrix Training & Skill Set Assessment Technical know-how Smoke and Build Tests Prioritized Regression Test cases Critical end to end scenarios from UAT Web services DB tests applicable to any of the above tests cases

5 04 Automation Testing Process Validate Benefits & Return On Investment (ROI) Create Automation Test Strategy Implement/Enhance Automation Framework Automation Scripting and Maintenance ROI Analysis with breakeven time and savings on each test cycle Proof of Concept (PoC) with relevant tools* Best-Fit Customized Automation Testing Solutions Develop/Maintain Test Strategy Setup Test environment, software and resources Include Software release plans and corresponding automation test coverage Use Available Frameworks Develop a new Framework Customized Solutions based on pros and cons of each tool and respective frameworks. Automation Test Script Development Automated Build Verification Suite Automated Regression Pack and UAT pack Development Continuous Integration with DevOps

6 05 Web Vs Mobile Vs Mobile Web Automation Presented by Tripti Mittal Functionality Automating the Page Object Locators Tools & Support Community Compatibility Application Development Expertise Testing Strategy Infrastructure Requirement Types of Testing to be performed Platform Complexities

7 06 Web Automation Strategies Presented by Tripti Mittal Automation Evaluation Understand Functionality Understand Testing Processes Current Automation Evaluation OR Identify Automation Opportunities Best-Fit Tool/Technologies Opensource / Commercial Tool Proof of Concept Show & Tell (Demos) Test Areas/ Test Case Evaluation for Automation Types of Tests to be Considered Scenarios/ Functionality Automation Test Estimations & ROI Identify Timelines & Milestones Tool & Resource Costing Return on Investment Identify Man Power Train OR Recruit Grooming of Application Tools Knowledge Acquisition Environment & Infrastructure Setup Controlled Environment Access Required Infrastructure Design & Implement Automation Tests Basic Automation Tests Refine & Modularize Build a Framework Maintain Automation Tests Update with the Application Time to Market Show & Tells Feedbacks Reporting & Tracking Validation of ROI Retrospection Continuous Integration

8 07 Web Automation Customer Requirements (Examples) Presented by Tripti Mittal UI-To-UI Automation Legacy Application to New Application Field to Field Verifications UI to Database Transaction performed on UI to Database Changes Web API Automation SOAP / RESTful Including Web API to UI Automation Web API to Database Dynamic Response, Responses Captured, Database Changes Parallel Execution Same TCs to be executed parallel on different Time Zones Headless Automation Don t want the systems to be blocked/ dedicated for Automation Robotic Process Automation 1000 of file uploads, Load Balancing, Beautiful Reports

9 08 Mobile Evolution Presented by Tripti Mittal The mobile industry is continuing to see rapid growth in connections, subscribers and data traffic, and is playing a pivotal role in unlocking socio-economic progress across the world G-64kbps Voice, Text G-2Mbps & Process Apps G-1Gbps Consumer grade apps 5G-more than 1Gbps Multichannel experience Many industry sectors are increasingly digitizing and mobilizing their products and services, reducing costs and providing compelling new experiences for consumers. Accelerating higher speed network deployments driving data growth In India smartphone users spend more than 3 hours a day on their phones 1G-2kbps Voice 2 Billion Smartphone Users By 2016 : 83% of Internet Usage From Mobiles

09 Mobile Platforms in Market Presented by Tripti Mittal Top 5 Operating systems, worldwide shipments and market share, 2015 Q2 (Units in millions) OS 2015 Shipment Volume 2015 Market Share(%) 2016

10 09 Mobile Platforms in Market Presented by Tripti Mittal Top 5 Operating systems, worldwide shipments and market share, 2015 Q2 (Units in millions) OS 2015 Shipment Volume 2015 Market Share(%) 2016 Shipment Volume 2016 Market Share (%) 2016/2015 Growth Android ios Windows Blackberry Others Total % % 25.3

11 10 Types of Mobile Applications Presented by Tripti Mittal

11 Mobile Application Testing Challenges Presented by Tripti Mittal Device Challenges

application runtime Memory constraints Touch, non-touch Battery drainage Hardware

protocols of devices WAP/HTTP Frequent OS changes Bluetooth, USB, earphones, front camera

keyboards (qwerty, touch) Network Challenges Multiple type of networks (GSM, GPRS, Wi-

) Unpredictable time taken for data transfer Different speed of connectivity across

12 11 Mobile Application Testing Challenges Presented by Tripti Mittal Device Challenges Multiple Platforms Multiple Browsers Rendering Differences Mobile devices have different application runtime Memory constraints Touch, non-touch Battery drainage Hardware Challenges Different Processing speed Memory size limitation Differences in communication protocols of devices WAP/HTTP Frequent OS changes Bluetooth, USB, earphones, front camera etc. User Challenges Ease of Handling User experience across various brands Different keyboards (qwerty, touch) Network Challenges Multiple type of networks (GSM, GPRS, Wi- Fi, Wi-Max etc. ) Unpredictable time taken for data transfer Different speed of connectivity across geographies Multiple network operators with customized network features Automation Challenges No automation for video/audio Device/OS specific tool constraints Low return on investment

13 12 Mobile App Testing Methods Presented by Tripti Mittal

14 13 Mobile Automation Challenges Presented by Tripti Mittal

15 14 Mobile Automation Tool Selection Criteria Presented by Tripti Mittal

16 15 Emulators versus Real Devices Presented by Tripti Mittal Manual Testing Approach Type of Testing Using Device Using Emulators Automated Testing on Device Unit Testing No Yes No Functional Testing Integration Testing No Yes No System Testing Yes No No Regression Testing Yes No Yes Acceptance Testing Yes No No Non Functional Testing Specialized for specific needs Performance Testing Yes No Yes Security Testing Yes No No Synchronisation Testing Yes No Yes Compatibility Testing Yes No Yes UI Testing Yes No No

17 16 Mobile App Automation Test Cycle Presented by Tripti Mittal

18 17 Mobile Automation Framework Presented by Tripti Mittal

19 18 Mobile Automation Benefits Presented by Tripti Mittal Increase Your Test Coverage. More Testing Means Less Bugs at the Point of Deployment Code Less, Test More Perform Parallel Testing and Watch Your Productivity Soar Test Automation Scripts Reduce the Regression Testing Monster to a Teddy Bear One of the Great Advantages to Test Automation is Greater Accuracy in Mobile Testing. By Reusing Test Scripts, every Testing Project Gets a Head Start. You can Quickly Identify When Your Mobile Testing Process has to Change You can Identify Problems Faster You can Shift Left Hand in Hand with Agile Development Faster Mobile Testing Let's You Update Your Mobile Applications More Frequently Developer Turnover is Less of a Problem

20 19 Mobile Automation Customer Requirements (Examples) Presented by Tripti Mittal Mobile-To-UI Automation Field-to-Field Verification, E2E Testing Mobile to Database Mobile App Transaction to Database Changes Mobile to Web API SOAP or RESTful Web API calls verification Multiple Device Automation Language / Geographical Diversity Automation via Commercial Tools Only Pre-Owned Licenses, Record & Playback (easier to maintain scripts)

21 Thank You! 9 Mansi, 5 th Floor, Cross Lane No. 1, Ram Maruti Road, Thane West info@educognitio.com Phone: +91 (0) Web:

Software Development for Mobile Devices

Software Development for Mobile Devices Operating System Diversity Many Operating Systems Google Android Apple ios Microsoft Windows Phone Nokia Symbian Linux RIM BlackBerry OS HP/Palm WebOS BREW Differences