1
Safe Harbour THE FOLLOWING IS INTENDED TO OUTLINE OUR GENERAL PRODUCT DIRECTION. IT IS INTENDED FOR INFORMATION PURPOSES ONLY, AND MAY NOT BE INCORPORATED INTO ANY CONTRACT. IT IS NOT A COMMITMENT TO DELIVER ANY MATERIAL, CODE, OR FUNCTIONALITY, AND SHOULD NOT BE RELIED UPON IN MAKING PURCHASING DECISIONS. THE DEVELOPMENT, RELEASE, AND TIMING OF ANY FEATURES OR FUNCTIONALITY DESCRIBED FOR ORACLE'S PRODUCTS REMAINS AT THE SOLE DISCRETION OF ORACLE. 2
Keyword-Driven Testing with Oracle Application Testing Suite: Application Testing Reinvented Mikael Fries Principal Product Manager Oracle ATS & TaaS Srikanth Krishnan Senior Director - Oracle EBS QA
Program Agenda How is testing done today? Testing challenges The Oracle solution Product Demo Real-world Case Study 4
How Is Testing Done Today? Typical scenario Testing team have to wait for application Test automation project is started once the application is available Teams of testers and application users are required for testing Test team works with application users to understand scenarios and flows for testing as well as the scope of the testing project Test automation begins Test team is provided access to a test environment Test team begins to build test automation scripts Test team consults application users for clarification of scenarios 5
Oracle Application Quality Solutions Application Testing Products Oracle Test Manager Application Testing Suite Oracle Functional Testing Oracle Load Testing Infrastructure Testing Products SQL Performance Analyzer Database Replay Application Replay Test Data and Lab Management Products Data Masking Data Discovery and Modeling Data Sub setting Cloud Delivery Platform Testing-as-a-Service Synthetic Workload Production Workload Test Data Management 6
Oracle Application Testing Suite Oracle s solution for testing Oracle Applications Oracle Functional Testing Suite for Oracle Applications Functional & regression testing Supports Web & Oracle Applications Oracle Load Testing Suite for Oracle Applications Load & Performance style testing Supports Web & Oracle Applications Smart integration with EM Diagnostics Test Management Test Process Management solution for Test Planing Requirements Test cases Defects tracking Reporting 7
Testing Challenges Growing complexity of applications requires more testing Manual testing takes too long Business users do not have time to test every change (repeatedly) Difficult to find technical resources for test automation Unable to leverage automated testing due to unavailability of technical resources Constant business process changes render test assets obsolete Scripts needs to be maintained/recreated after changes to the applications 8
New Approach to Testing Making sure your application is tested Dramatically reduces testing time? Minimizes the need for technical resources Reduces the testing complexity Minimizes the effort to keep you test assets current 9
INTRODUCING ORACLE FLOW BUILDER - KEYWORD DRIVEN TESTING 10
What Is Keyword Driven Testing? Keyword-driven testing is another way of creating automated tests It enables non-technical testers to compose test flows by defining series of user actions that together define an application user flow User actions are defined using pre-defined keywords such as Click, SetText, Select, etc. Test flows are then transformed into executable test automation scripts at run time 11
How Is Keyword Driven Testing Implemented? Example Use a Keyword driven testing framework as harness Testers analyze the application to test and define Keywords Technical testers implement Keywords and map these to code Keywords Click & Button could for example generate the code web.button(object).click(); Non-technical testers use Keywords to mimic actions in Flows SetText Id_UserName John Doe SetText Id_Password MyS3Cr3T Click Button OK Bind test data to Flows Generate test automation scripts 12
Pros and Cons of Keyword Driven Testing Keyword driven testing Pros Maintenance is lower (over time) Test cases are concise Readable test cases for stake holders Test cases are easy to modify Cons Requires technical resource for keyword implementation Test cases can reuse keywords Only suitable for applications where keywords / user actions can be re-used in many places More robust test scripts Framework may support multiple test automation tool Longer Time to Market Build framework Define keywords & code Steeper initial learning curve 13
Oracle Functional Testing Suite for Oracle Apps Includes both record/playback and keyword driven testing framework Your Flows Your Data Oracle Functional Testing Suite for Oracle Application ns Flows & Compoenents EBS Pre-Built Test Content Flow Builder Framework to combine flows and data to generate test scripts OpenScript Record & Playback + Advanced Scripting Generate Record Manually Test Automation Scripts Oracle EBS 14
Oracle Flow Builder New feature of Oracle Functional Testing Suite for Oracle Applications Keyword driven testing framework for non-technical testers Key differentiators for Oracle Flow Builder Optimized for Oracle e-business Suite (EBS) testing with predefined Keywords Rich library of pre-defined test flows & components 2100+ components 200+ sanity flows Supports all key EBS modules 15
Oracle Flow Builder Concept Component Set Component Component Component <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> Flow Component <Keyword> <Keyword> <Keyword> Test Script 16
Oracle Flow Builder Flow Component Set Component Component Component Component <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> <Keyword> Create components of commonly seen <Keyword> user actions through Flow Builder s Web UI or through MS Excel Components can be re-used Components can be easily changed when application changes or for customizations Test Script 17
Flow Builder How to define a component 18
How To Work With Components Sets Oracle Flow Builder components Components Login to App Update Item BOM Navigate to Form Assign Serial Tag Search Item Close Form Define Revision Logout of App 19
How To Work With Components Sets You can use the components to build Flows Components Login to App Update Item BOM Navigate to Form Assign Serial Tag Search Item Close Form Define Revision Logout of App Flow 1 Flow 2 20
How To Work With Components Sets You can use the components to build Flows Components Login to App Update Item BOM Navigate to Form Assign Serial Tag Search Item Close Form Define Revision Logout of App Flow 1 Flow 2 21
How To Work With Components Sets Use Component Sets to combine frequently used components Components Login to App Update Item BOM Navigate to Form Assign Serial Tag Search Item Close Form Define Revision Logout of App Flow 1 Flow 2 Login Login to App to App SAME Navigate Navigate to to Form Form Create Search Search Item Item Component Set Revision Revision Define Item Revision Update Assign Item BOM Serial Tag 22
How To Work With Components Sets Using Components Sets will simplify Flow creation Components Login to App Update Item BOM Navigate to Form Assign Serial Tag Search Item Close Form Define Revision Logout of App Flow 1 Component Set Login to App Navigate to Define FormItem Revision Search Item Define Revision Update Item BOM Flow 2 Component Set Login to App Navigate to Define FormItem Revision Search Item Define Revision Assign Serial Tag 23
Record/Playback vs Oracle Flow Builder Steps to automate a testing Traditional record / playback Deploy AuT Record Script(s) Add verifications Parametrize Synchronize Stabilize Keyword driven testing with Oracle Flow Builder (Create Components) Assemble Flows Bind test data Generate Script 24
What If The Application Changes? How To Handle Changes in Application Analyze and identify areas where application changed Update components or flow structure accordingly If required update test data Re-generate test automation scripts Changes in UI Changes in UI only only Where is the change? Update component Update test data Changes in UI & transactions/logic Update component Copy flow structure Enter test data Generate script Generate script 25
Record/Playback vs Oracle Flow Builder Steps to maintain test automation Traditional record / playback Re-record Script(s) Add verifications Parametrize Synchronize Stabilize Keyword driven testing with Oracle Flow Builder (Update Components) (Update Flows) (Bind test data) Generate Script 26
Oracle Flow Builder Architechture Web UI for creating components, component Sets, flows & user management MS Excel for creating components off-line http Notifications Users can create & upload Custom Function Libraries to extend Flow Builder functionality Application Server Repository Component & Flow Storage OFT Scripts Generated from Flows 27
Oracle Flow Builder How to install Setup a server with Oracle Linux 5.x Install Oracle 11g EE Database Extract Oracle Flow Builder Zip >unzip./ofb_main_generic_x.x.s.zip d /tmp/ofb_main Begin OFB Setup >./tmp/ofb_main/setup.sh install 28
Oracle Flow Builder How to install Enter configuration as prompted by the setup script Enter install directory: /scratch/myuser/oracle/oracleofb Create Administrator Password to access the application: oracle123 Enter Database host name (press enter to accept [auto-detected-hostname]): xxxxx.us.oracle.com Enter Database port (press enter to accept [1521]): 1521 Enter database SID (press enter to accept [orcl]): orcl Enter database admin user name: system Enter database admin Password: oracle123 Begin to use Oracle Flow Builder for test automation 29
Graphic Section Divider Case Study Oracle e-business Suite QA 30
Components Oracle Flow Builder PO Header 31
Components Oracle Flow Builder PO line type - Goods PO line type - Service 32
Component Definition 33
Graphic Section Divider DEMO 34
Addressing The Testing Challenges Oracle Flow Builder Manual testing takes too long Oracle Flow Builder can reduce the need for manual testing freeing the business users from manual testing Difficult to find technical resources for test automation Oracle Flow Builder requires less technical resources allowing testing team to work more efficiently Constant business process changes render test assets obsolete Oracle Flow Builder requires a fraction of maintenance compared to traditional scripts, allowing customers to keep up-to-date 35
Addressing The Testing Challenges Oracle Flow Builder Reduce test development effort Make use of pre-defined components Compress lead time for testing Test script development can begin before application is ready Easy maintenance Quick and easy changes of components and flows AUT* does not have to be available when creating the scripts When AUT* changes testers only have to update Keywords or flows 36 * Application Under Test
Addressing The Testing Challenges Oracle Flow Builder Eliminates the major drawbacks of keyword driven testing Pre-defined Keywords Pre-defined components & flows 37
With Oracle Flow Builder we address the key issue of automating EBS testing content and reusability. We have derived up to 60% savings using Oracle Flow Builder over traditional methods Srikanth Krishnan Senior Director, EBS QA, Oracle. 38
Re-inventing Application Testing Oracle Application Testing Suite Optimized testing solutions for Oracle applications Jump-start EBS testing with pre-built content Allow your organization to become truly agile Empower non-technical resources to create test automation flows Easy changes of existing components for your customizations Keep your testware current with a minimal effort Reduce complexity of testing Reduce test cycle effort - allows you to test every change! 39
40
41