Copyright 2013 by AGILOD Consulting, LLC. All Rights Reserved. Test Automation. Done The AGILOD Way

Transcription

1 All Rights Reserved. Test Automation Done The AGILOD Way

2 What is The AGILOD Way? The AGILOD Way refers to a unique approach to test automation combined with a set of open source QTP actions & function libraries, that when strategically applied, delivers optimal automation test coverage in a fraction of the time of traditional scripting efforts. AGILOD offers Phrase-Keyword processing capability that uses simple English phrases to drive automation. Phrase-Keywords are unique in that they enable the simultaneous creation of automation scripts during manual test case scripting process. AGILOD is packaged with accelerator tools that enable users to extract and manage object data, store application meta-data, and import automation scripts in bulk. These tools empowers a small team of testers to perform the work of many.

3 Our Unique Testing Approach The AGILOD Way refers to a unique approach to test automation. Utilize BPTM to structure an initial set of functional test scenarios and scripts. Setup & load the exported QTP Object Repository into the Phrase & Object Mgmt Tool. Add design steps for each test scenario using Phrase- Keywords listed in the ALM User Library. Run scripts and update script creation and execution status. Identify test data & opportunities for test reusability. Restructure them to utilize the Test Data Template and to Leverage QC features.

4 Our Testing Methodology: BPTM AGILOD utilizes the Basis Path Testing Method (BPTM). This approach combines the typical requirements statement branch testing with white/grey-box testing for optimal test coverage. Using BPTM, all tests are structured into a operational folder tree that segment tests based on the type of validation it is performing and its execution priority. The Test Designer analyzes how functionality should be tested and in which operational folder that test should be stored. Read NIST Special Publication to learn more about the Basis Path Testing Methodology.

5 Our Testing Tool: Quick Test Pro (QTP) AGILOD utilizes QTP (versions 9.5 & up) for the creation and execution of test automation scripts. QTP is a leading commercial tool that is useful for scripting complex multi-tier applications. The fundamental rule of thumb is that AGILOD can automate any application QTP can automate. QTP Add-Ins may be required.

6 Our Testing Platform: ALM AGILOD utilizes HP s Application Lifecycle Management (ALM) as the preferred testing platform for creating and executing QTP automation test scripts. The popular Design Step tab screen in ALM is the interface used to create both manual & AGILOD test cases.

7 AGILOD Phrase-Keywords AGILOD uses simple and easy to understand Phrase-Keywords to structure design steps in ALM. They require no technical knowledge and can be customized to support any project s needs. This Common Phrases folder is where commands and phrases are quickly referenced by testers.

8 AGILOD Phrase-Keywords Fig. 2 AGILOD s Phrase-Keywords are flexible and do not require using the exact wording from the Common Phrases folder. They should be copied into your script and then modified with parameter values. Here s a glimpse at how the Phrase- Keyword steps are displayed in ALM s Design Step tab.

9 AGILOD Phrase-Keywords Fig. 3 AGILOD translates Phrase-Keywords into the QTP VB scripting language which in turn, runs previously created functions in QTP that are stored in the shared function library. This Phrase-Keyword gets translated by AGILOD and executed as a QTP software component. Expert level coding is required for components that do not already exist in the AGILOD function library.

10 Phrase & Object Management Tool AGILOD is packaged with the Phrase & Object Management Tool that is used to maintain Phrase-Keywords and load exported QTP object repository files into the framework. The Load Repository utility imports the shared object repository from an exported XML file. Once loaded, the search utility is used to find objects using a variety of field combination and wildcard options.

11 Test Data Template Sheets AGILOD is packaged with script-ready Excel spreadsheets that can be used to centrally store test data and be shared my multiple groups, scripts, and/or machines in your test environment. AGILOD uses a criteria formula to identify one or many rows that meet a certain condition, i.e. UserID = AGLD1324

12 Leveraging ALM s Helpful Features The AGILOD Way leverages all of ALM s helpful features, with special emphasis on the following: Business Process Testing (BPT) Call To Test & Data Parameters Requirements Traceability Automation Status Workflow Test Lab Script Execution Test Lab Script Reporting Automated Defect Reporting

13 Business Process Testing (BPT) AGILOD can utilize ALM s BPT feature for optimal test coverage. Our code libraries integrate directly with the BPT component layer. <<< Return to Leveraging ALM s Helpful Features Note: Utilizing BPT will result is the inability to leverage certain ALM features that increase the speed and accuracy in which AGILOD scripts are created, i.e. Call To Test, Design Step copy/paste, Advanced Script Generation, etc.

14 Call To Test & Data Parameters AGILOD utilizes ALM s Parameter and Call To Test features. Strategic use of these features will optimize script reusability. <<< Return to Leveraging ALM s Helpful Features This Phrase-Keyword uses a Parameter named URL, that can be populated at a later time. This next step uses Call To Test for optimal script reusability and modularity.

15 Requirement Traceability AGILOD s scripts are linked directly to requirements to maximize traceability. Requirement Coverage reports enable us to identify script coverage as it pertains to application functionality. <<< Return to Leveraging ALM s Helpful Features The requirements are listed in a well organized folder tree structure based on functional area. The AGILOD script is linked to one or many requirements.

16 Automation Status Workflow The Automation Status & Status fields are used to track scripting progress. Work can be collaborated between the manual and automation teams by implementing a hand-off process. <<< Return to Leveraging ALM s Helpful Features Automation Status is used to report each script s state at any point in time. Status is used to report each script s hand-off status between the manual and automation teams.

17 Test Lab Script Execution AGILOD s scripts are executed by adding them to a Testset in the ALM Test Lab module. The Run AGILOD Scripts test is used to launch the scripts on the machine that has QTP already installed. <<< Return to Leveraging ALM s Helpful Features The Test Lab provides an easy way to locate any AGILOD script. AGILOD scripts can be executed with the Manual or Automatic Runner.

18 Test Lab Script Reporting AGILOD s scripts run in QTP and log reports in ALM s Test Lab module. The full detailed report that is standard for a QTP automated script is available in ALM immediately after script completion. <<< Return to Leveraging ALM s Helpful Features The script report can be launched from ALM or QTP. The Pass/Fail status is displayed for each script executed.

19 Automated Defect Reporting AGILOD s scripts can be configured to automatically send failed steps directly to ALM s Defect module. You can also manually create a defect with application images and video files attached. <<< Return to Leveraging ALM s Helpful Features Defects that are entered in ALM can be easily linked to an AGILOD script. The details tab can be customized to populate the steps, the machine, and other configuration settings used by the automation script.

20 AGILOD Feature Overview The AGILOD Way has features that can be leveraged to improve your automation effort. When compared to the typical automation process, our features deliver significant productivity increases. Features AGILOD Typical Basis Path Methodology Yes No Phrases-Keywords Use ALM Parameters Use ALM Call To Test Test Data Template Object Repo Mgmt Tools Offsite Expert Support Yes Yes Yes Yes Yes Yes No No No No No No

21 AGILOD Productivity Chart 500% 450% 400% 350% 300% 250% 200% 150% 100% 50% 0% 300% Test automation done The AGILOD Way provides a significant increase in coverage, speed, teamwork and overall productivity when compared to the typical automation record/playback method. 450% 200% 250% Scripting Speed Test Coverage Team Work Cost Savings AGILOD Typical

22 AGILOD Cost Savings Chart Fig. 2 AGILOD delivers significant per project cost savings based on an increase in scripting speed from 18 to 12 months with no change in the number of dedicated resources. Save: $190,000! Activity AGILOD Typical Savings Scripting Months Resources Cost per Hour $75 $75 $0 Cost per Day $2,400 $2,400 $0 Cost per Month $54,000 $54,000 $0 Service Tier 1 Fees $134,333 0 $0 Total Cost $782,333 $972,000 $189,667

23 AGILOD Offsite Expert Support In addition to the benefits you gain from using AGILOD, we provide expert level support to all clients. Our team have years of automation experience and are experts in doing it The AGILOD Way! AGILOD Clients receive: Script Library Updates Script Troubleshooting Script Maintenance

24 The AGILOD Way Highlights The AGILOD Way strategically delivers optimal automation test coverage while enhancing speed, teamwork, and overall productivity. AGILOD offers value added features to the standard automation process that can be leveraged to improve your automation effort. AGILOD delivers a significant increase to productivity of 200% - 450% when compared to the standard automation process. AGILOD delivers a significant per project cost savings based on an increase in speed with no change in resources. Save $190,000! Thank you for viewing this presentation. To learn more or to register for The AGILOD Way presentation, please visit our site at or sales@agilod.com.