Oracle Application Testing Suite: Introduction Student Guide D55447GC10 Edition 1.0 August 2008 D55981
Copyright 2008, Oracle. All rights reserved. Disclaimer This document contains proprietary information and is protected by copyright and other intellectual property laws. You may copy and print this document solely for your own use in an Oracle training course. The document may not be modified or altered in any way. Except where your use constitutes "fair use" under copyright law, you may not use, share, download, upload, copy, print, display, perform, reproduce, publish, license, post, transmit, or distribute this document in whole or in part without the express authorization of Oracle. The information contained in this document is subject to change without notice. If you find any problems in the document, please report them in writing to: Oracle University, 500 Oracle Parkway, Redwood Shores, California 94065 USA. This document is not warranted to be error-free. Restricted Rights Notice If this documentation is delivered to the United States Government or anyone using the documentation on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS The U.S. Government s rights to use, modify, reproduce, release, perform, display, or disclose these training materials are restricted by the terms of the applicable Oracle license agreement and/or the applicable U.S. Government contract. Trademark Notice Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners.
Contents 1 Oracle Application Testing Suite: Introduction Topics Covered 1-2 FMStocks 1-3 How to Access FMStocks 1-4 What Is FMStocks? 1-5 FMStocks Architecture 1-6 FMStocks Transactions 1-8 Testing Concepts 1-9 Importance of Testing 1-10 Testing Overview 1-12 When To Test 1-13 What Is A Test Plan? 1-14 Importance of Test Plan 1-15 Components of A Test Plan 1-16 Test Strategy 1-17 Test Objectives & Scope 1-18 Exercise 1 1-19 Test Requirements 1-20 Classification of Test Requirements 1-21 Think About The Requirements 1-22 Decomposition of Test Requirements 1-23 Exercise 2 1-24 Expected Results & Pass/Fail Criteria 1-25 Risk Assessment 1-26 Priority 1-28 Test Cases 1-29 Think About Test Cases 1-30 Exercise 3 1-31 Test Environment 1-32 Staffing & Responsibilities 1-33 Test Deliverables 1-34 Miscellaneous Components 1-35 Test Plan Example 1-36 Track Defects 1-37 Testing Approaches 1-38 iii
Functional Testing 1-39 Regression Testing 1-42 Questions? 1-43 2 e-tester Topics Covered 2-2 Uses of e-tester 2-3 User Interface 2-4 E-Tester Basics 2-5 How Scripts Are Created 2-6 Organize Script 2-7 The Workspace Manager 2-8 The Workspace Folder 2-10 What Is Kept In The Workspace 2-11 How to Open A Workspace 2-12 Things to Think About When Creating Scripts 2-13 Lets Start Scripting. 2-14 Start a New Script 2-15 Start Recording 2-16 Record Your Script 2-17 Recording Tips 2-18 Record a transaction 2-19 Stop The Recording 2-20 Save Your Script 2-21 Playback Your Script 2-23 Exercise 2-24 Review 1 2-25 3 Features of The Visual Script Script Views 3-2 Page Properties 3-3 Page Components (Nodes) 3-4 The Address Node 3-5 Address Node 3-6 Address Node Properties 3-7 Address Properties 3-8 Understanding Actions 3-9 Pages Without Actions 3-12 Dynamic Addresses 3-13 Capturing Events - Advanced 3-14 Events Capturing 3-15 iv
Advanced Actions In the Address Node 3-22 Advanced Actions 3-23 Review 2 3-30 4 The Frame Node Frame Node 4-2 Frame Sub-Nodes 4-3 Sub Nodes of the Frame Node 4-4 Sub Nodes 4-5 Manipulating the script s pages 4-6 Navigating to a Page in the Application 4-7 Edit The Visual Script 4-8 Appending Pages 4-10 Copy, Cut, Paste, or Delete a Page 4-11 Script Comments 4-12 Add Page Comments 4-14 Exercise 4-16 Review 3 4-17 5 Playback Results Analysis Playing back your script 5-2 Resource Validation 5-3 Resource Validation Status Codes 5-5 Show Resource Download Statistics Resource Validation 5-6 Resource Validation 5-7 The Results Report 5-8 Results Report 5-9 Tests Summary 5-10 Script Details 5-11 Iteration Details 5-12 HTML Differences 5-13 Results Report Options 5-14 The Results Log 5-16 Result Log Columns 5-17 Results Log Options 5-18 Analyzing Results Summary 5-20 Analysis with the Results Report 5-21 Analysis with the Results Log 5-22 Analyze The Visual Script 5-23 Visual Script Flags 5-24 Analyzing The Visual Script 5-25 v
Analyzing Text Differences 5-26 Analyze Text Differences 5-27 Error Resolution 5-28 Think About Failures/Warnings 5-29 Ignore Failures 5-30 Default Content Tests 5-31 Page Content Tests Manager 5-32 Global Content Tests Manager 5-33 Accept Differences 5-34 Disable Failing Default Tests 5-37 Review 4 5-38 6 Data Banks Data Banks 6-2 Data Driven Scripts 6-3 Automated Data Driven Tests 6-4 Think About What to Data Bank 6-5 Create A Data File 6-6 Save The Data File 6-7 Data Bank Wizard 6-8 Add Variable 6-9 Add Mapping 6-10 Data Binding 6-11 Add Binding 6-12 Overall Picture 6-13 Fetch Record 6-14 Edit & Update Databank File 6-15 Data Bank Node Indicators 6-16 Iterate 6-17 Playback with Data Bank 6-18 Exercise 6-19 Review 5 6-20 7 Advanced Data banking Advanced Data banking 7-2 Auto Map 7-3 Auto Bind 7-5 Databank Recommendations 7-6 Synthesize 7-7 Exercise 7-11 Review 6 7-12 vi
Data Bank Issues 7-13 Potential Data Bank Problems 7-14 Identify The Failure 7-15 View The Actions 7-16 View The Differences 7-17 Match The Failures And Differences 7-18 Understand What Happened 7-19 Solutions To Data Bank Problems 7-20 Resolution Considerations 7-21 Modifying Navigations 7-22 Modify The Action 7-23 Location Criteria 7-24 Think About Location Criteria 7-26 Modify Location Criteria 7-27 8 Inserting Specific Tests Test Cases 8-2 Text 8-3 Text Matching Test 8-4 Insert Text Matching Test 8-5 Exercise 1 8-9 Data Driven Text Matching Test 8-10 Using the Databank to Text Match 8-11 Data Driven Text Matching - Example 8-12 Exercise 2 8-13 Server Response Test 8-14 Insert Server Response Test 8-16 Multiple Page Server Response Test 8-18 Minimum Time Allowed For Playback 8-19 Maximum Time Allowed For Playback 8-20 Exercise 3 8-21 Form Element Test 8-22 Insert Form Element Test 8-23 Review 7 8-26 9 Custom Tests e-tester Programmability 9-2 Table Tests 9-3 Table Test 9-4 Table Tests 9-5 Select Table 9-7 vii
Table Tests 9-8 Dialog and Authentication Manager 9-10 Dialog Box 9-11 Automatically Dismiss Dialogs 9-12 Dialog Manager 9-13 Configure Dialog Manager 9-14 Dialog Box Selector 9-15 Dialog Definitions 9-16 Dialog Actions 9-17 Data Banked Dialog Actions 9-19 Authentication Manager 9-20 Configure Authentication Manager 9-21 Data Banked Username/Password 9-23 Review 8 9-24 10 Cookie Handling Cookies 10-2 Use Distinct Cookie Directory 10-3 Cookie Handling Options 10-4 Clear Session Cookies 10-5 Delete Persistent Cookies 10-6 Stand-Alone Scripts 10-7 Linked Scripts 10-8 Think About Linked Scripts 10-12 Job Scheduler 10-14 Job Scheduler Wizard - Step 1 10-16 Job Scheduler - Step 2a 10-17 Job Scheduler - Step 2b 10-18 Schedule Jobs 10-19 Using Job Scheduler 10-21 Miscellaneous Options 10-22 Comparison Exclusion 10-23 Regular Expressions 10-24 Comparison Exclusion Options 10-27 Comparison Exclusions Options 10-34 Comparison Exclusions Summary 10-35 Siebel Support 10-36 Settings Manager 10-37 Java Applets 10-40 Recording Java Applets 10-42 Java Options 10-43 viii
Java Object Node 10-44 Page Snapshot 10-45 Windows Event Recorder 10-46 Workshop 10-47 Support 10-48 11 e-load What This Class Module Will Cover 11-2 Performance Testing Basics 11-4 What is performance testing? 11-5 Why is performance testing necessary? 11-6 Performance Testing Methodology 11-10 Types of Performance Testing 11-11 Load Testing 11-12 Performance Testing 11-14 Stress Testing 11-16 Volume Testing 11-18 Capacity Planning vs. Performance Tuning 11-19 Setting up a Test Plan 11-20 Pointers to Keep in Mind 11-23 Review 1 11-26 Testing Environment Setup 11-27 Configuring the Load Test Hardware 11-29 12 Scenario Basics Introduction to e-load 12-2 Integrated Authentication in e-load 12-3 Key Concepts 12-4 Setting up a Test 12-7 Workspaces 12-8 Profiles 12-9 Using the Default Profiles 12-10 User-Defined Virtual User Profiles 12-11 Creating a User Defined Profile 12-12 User-Defined Profiles 12-13 Adding Visual Scripts 12-14 Adding Synchronization Points 12-15 Creating Scenario Profiles 12-17 Number of Virtual Users (per profile) 12-18 Delay Between Iterations 12-19 Virtual User Pacing 12-20 ix
Workstation 12-23 Adding New Workstations 12-24 Creating New Workstations 12-25 Configure all Parameters 12-28 Browser Emulation 12-29 Custom Browsers 12-30 Connection Speed 12-31 Caching Type 12-32 User Mode 12-33 Thick Client 12-34 Thin Client 12-35 Java Client 12-36 IP Spoofing 12-37 Use Download Manager 12-38 Content Download Manager 12-39 Download Rules 12-41 Download Manager 12-43 Data Bank Control 12-44 Databank Control 12-45 VU Display Options 12-46 Virtual User Display 12-47 Run User Defined Test Cases 12-48 Generating Page Timers 12-49 Add to Autopilot 12-50 Using the Autopilot 12-51 e-load Autopilot 12-52 Start and Stop Settings 12-53 Virtual User Rampup 12-54 Start and Stop the Test 12-55 Start and Pause Autopilot 12-56 Session Start/Stop 12-57 Scenario Configuration 12-61 Virtual User Grid 12-62 Test Starts 12-65 Load Test Errors 12-66 Repositories 12-67 Session Start/Stop 12-68 Reporting 12-70 Scenario Defaults 12-74 Scenario Defaults - Main 12-76 Scenario Defaults - Browser Settings 12-77 x
Scenario Defaults - Extensibility 12-78 Scenario Defaults VU Display 12-79 Scenario Defaults Reporting 12-80 Scenario Defaults Error Handling 12-81 Scenario Defaults Advanced 12-82 Exercise 2a 12-83 Exercise 2b 12-84 Review 2 12-85 View Run Graphs and Statistics 12-86 Real-time Load Results 12-87 e-load Results 12-88 Performance Statistics 12-90 13 ServerStats ServerStats 13-2 Back-End System Monitoring 13-3 What Systems to Monitor 13-4 Useful Counters on Web Server 13-5 Useful Counters on Application Servers 13-6 Useful Counters on Database Servers 13-7 Run-Time ServerStats Configuration 13-8 Add New ServerStats Configuration 13-9 ServerStats Configurations 13-10 Add New Monitor 13-11 Configure Data Sources 13-12 Metrics 13-16 Metric Profiles 13-17 Select ServerStats Configuration 13-18 Exercise 3 13-19 14 Reports & Graphs Reports & Graphs 14-2 Session Report 14-4 Create Graphs 14-5 Performance vs. Time 14-9 Errors vs. Time 14-11 Errors vs. Users 14-13 Performance vs. Users 14-15 Statistics vs. Time 14-17 Statistics vs. Users 14-19 Support 14-21 xi