Oracle Application Testing Suite: Introduction Student Guide

Transcription

1 Oracle Application Testing Suite: Introduction Student Guide D55447GC10 Edition 1.0 August 2008 D55981

2 Copyright 2008, Oracle. All rights reserved. Disclaimer This document contains proprietary information and is protected by copyright and other intellectual property laws. You may copy and print this document solely for your own use in an Oracle training course. The document may not be modified or altered in any way. Except where your use constitutes "fair use" under copyright law, you may not use, share, download, upload, copy, print, display, perform, reproduce, publish, license, post, transmit, or distribute this document in whole or in part without the express authorization of Oracle. The information contained in this document is subject to change without notice. If you find any problems in the document, please report them in writing to: Oracle University, 500 Oracle Parkway, Redwood Shores, California USA. This document is not warranted to be error-free. Restricted Rights Notice If this documentation is delivered to the United States Government or anyone using the documentation on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS The U.S. Government s rights to use, modify, reproduce, release, perform, display, or disclose these training materials are restricted by the terms of the applicable Oracle license agreement and/or the applicable U.S. Government contract. Trademark Notice Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners.

3 Contents 1 Oracle Application Testing Suite: Introduction Topics Covered 1-2 FMStocks 1-3 How to Access FMStocks 1-4 What Is FMStocks? 1-5 FMStocks Architecture 1-6 FMStocks Transactions 1-8 Testing Concepts 1-9 Importance of Testing 1-10 Testing Overview 1-12 When To Test 1-13 What Is A Test Plan? 1-14 Importance of Test Plan 1-15 Components of A Test Plan 1-16 Test Strategy 1-17 Test Objectives & Scope 1-18 Exercise Test Requirements 1-20 Classification of Test Requirements 1-21 Think About The Requirements 1-22 Decomposition of Test Requirements 1-23 Exercise Expected Results & Pass/Fail Criteria 1-25 Risk Assessment 1-26 Priority 1-28 Test Cases 1-29 Think About Test Cases 1-30 Exercise Test Environment 1-32 Staffing & Responsibilities 1-33 Test Deliverables 1-34 Miscellaneous Components 1-35 Test Plan Example 1-36 Track Defects 1-37 Testing Approaches 1-38 iii

4 Functional Testing 1-39 Regression Testing 1-42 Questions? e-tester Topics Covered 2-2 Uses of e-tester 2-3 User Interface 2-4 E-Tester Basics 2-5 How Scripts Are Created 2-6 Organize Script 2-7 The Workspace Manager 2-8 The Workspace Folder 2-10 What Is Kept In The Workspace 2-11 How to Open A Workspace 2-12 Things to Think About When Creating Scripts 2-13 Lets Start Scripting Start a New Script 2-15 Start Recording 2-16 Record Your Script 2-17 Recording Tips 2-18 Record a transaction 2-19 Stop The Recording 2-20 Save Your Script 2-21 Playback Your Script 2-23 Exercise 2-24 Review Features of The Visual Script Script Views 3-2 Page Properties 3-3 Page Components (Nodes) 3-4 The Address Node 3-5 Address Node 3-6 Address Node Properties 3-7 Address Properties 3-8 Understanding Actions 3-9 Pages Without Actions 3-12 Dynamic Addresses 3-13 Capturing Events - Advanced 3-14 Events Capturing 3-15 iv

5 Advanced Actions In the Address Node 3-22 Advanced Actions 3-23 Review The Frame Node Frame Node 4-2 Frame Sub-Nodes 4-3 Sub Nodes of the Frame Node 4-4 Sub Nodes 4-5 Manipulating the script s pages 4-6 Navigating to a Page in the Application 4-7 Edit The Visual Script 4-8 Appending Pages 4-10 Copy, Cut, Paste, or Delete a Page 4-11 Script Comments 4-12 Add Page Comments 4-14 Exercise 4-16 Review Playback Results Analysis Playing back your script 5-2 Resource Validation 5-3 Resource Validation Status Codes 5-5 Show Resource Download Statistics Resource Validation 5-6 Resource Validation 5-7 The Results Report 5-8 Results Report 5-9 Tests Summary 5-10 Script Details 5-11 Iteration Details 5-12 HTML Differences 5-13 Results Report Options 5-14 The Results Log 5-16 Result Log Columns 5-17 Results Log Options 5-18 Analyzing Results Summary 5-20 Analysis with the Results Report 5-21 Analysis with the Results Log 5-22 Analyze The Visual Script 5-23 Visual Script Flags 5-24 Analyzing The Visual Script 5-25 v

6 Analyzing Text Differences 5-26 Analyze Text Differences 5-27 Error Resolution 5-28 Think About Failures/Warnings 5-29 Ignore Failures 5-30 Default Content Tests 5-31 Page Content Tests Manager 5-32 Global Content Tests Manager 5-33 Accept Differences 5-34 Disable Failing Default Tests 5-37 Review Data Banks Data Banks 6-2 Data Driven Scripts 6-3 Automated Data Driven Tests 6-4 Think About What to Data Bank 6-5 Create A Data File 6-6 Save The Data File 6-7 Data Bank Wizard 6-8 Add Variable 6-9 Add Mapping 6-10 Data Binding 6-11 Add Binding 6-12 Overall Picture 6-13 Fetch Record 6-14 Edit & Update Databank File 6-15 Data Bank Node Indicators 6-16 Iterate 6-17 Playback with Data Bank 6-18 Exercise 6-19 Review Advanced Data banking Advanced Data banking 7-2 Auto Map 7-3 Auto Bind 7-5 Databank Recommendations 7-6 Synthesize 7-7 Exercise 7-11 Review vi

7 Data Bank Issues 7-13 Potential Data Bank Problems 7-14 Identify The Failure 7-15 View The Actions 7-16 View The Differences 7-17 Match The Failures And Differences 7-18 Understand What Happened 7-19 Solutions To Data Bank Problems 7-20 Resolution Considerations 7-21 Modifying Navigations 7-22 Modify The Action 7-23 Location Criteria 7-24 Think About Location Criteria 7-26 Modify Location Criteria Inserting Specific Tests Test Cases 8-2 Text 8-3 Text Matching Test 8-4 Insert Text Matching Test 8-5 Exercise Data Driven Text Matching Test 8-10 Using the Databank to Text Match 8-11 Data Driven Text Matching - Example 8-12 Exercise Server Response Test 8-14 Insert Server Response Test 8-16 Multiple Page Server Response Test 8-18 Minimum Time Allowed For Playback 8-19 Maximum Time Allowed For Playback 8-20 Exercise Form Element Test 8-22 Insert Form Element Test 8-23 Review Custom Tests e-tester Programmability 9-2 Table Tests 9-3 Table Test 9-4 Table Tests 9-5 Select Table 9-7 vii

8 Table Tests 9-8 Dialog and Authentication Manager 9-10 Dialog Box 9-11 Automatically Dismiss Dialogs 9-12 Dialog Manager 9-13 Configure Dialog Manager 9-14 Dialog Box Selector 9-15 Dialog Definitions 9-16 Dialog Actions 9-17 Data Banked Dialog Actions 9-19 Authentication Manager 9-20 Configure Authentication Manager 9-21 Data Banked Username/Password 9-23 Review Cookie Handling Cookies 10-2 Use Distinct Cookie Directory 10-3 Cookie Handling Options 10-4 Clear Session Cookies 10-5 Delete Persistent Cookies 10-6 Stand-Alone Scripts 10-7 Linked Scripts 10-8 Think About Linked Scripts Job Scheduler Job Scheduler Wizard - Step Job Scheduler - Step 2a Job Scheduler - Step 2b Schedule Jobs Using Job Scheduler Miscellaneous Options Comparison Exclusion Regular Expressions Comparison Exclusion Options Comparison Exclusions Options Comparison Exclusions Summary Siebel Support Settings Manager Java Applets Recording Java Applets Java Options viii

9 Java Object Node Page Snapshot Windows Event Recorder Workshop Support e-load What This Class Module Will Cover 11-2 Performance Testing Basics 11-4 What is performance testing? 11-5 Why is performance testing necessary? 11-6 Performance Testing Methodology Types of Performance Testing Load Testing Performance Testing Stress Testing Volume Testing Capacity Planning vs. Performance Tuning Setting up a Test Plan Pointers to Keep in Mind Review Testing Environment Setup Configuring the Load Test Hardware Scenario Basics Introduction to e-load 12-2 Integrated Authentication in e-load 12-3 Key Concepts 12-4 Setting up a Test 12-7 Workspaces 12-8 Profiles 12-9 Using the Default Profiles User-Defined Virtual User Profiles Creating a User Defined Profile User-Defined Profiles Adding Visual Scripts Adding Synchronization Points Creating Scenario Profiles Number of Virtual Users (per profile) Delay Between Iterations Virtual User Pacing ix

10 Workstation Adding New Workstations Creating New Workstations Configure all Parameters Browser Emulation Custom Browsers Connection Speed Caching Type User Mode Thick Client Thin Client Java Client IP Spoofing Use Download Manager Content Download Manager Download Rules Download Manager Data Bank Control Databank Control VU Display Options Virtual User Display Run User Defined Test Cases Generating Page Timers Add to Autopilot Using the Autopilot e-load Autopilot Start and Stop Settings Virtual User Rampup Start and Stop the Test Start and Pause Autopilot Session Start/Stop Scenario Configuration Virtual User Grid Test Starts Load Test Errors Repositories Session Start/Stop Reporting Scenario Defaults Scenario Defaults - Main Scenario Defaults - Browser Settings x

11 Scenario Defaults - Extensibility Scenario Defaults VU Display Scenario Defaults Reporting Scenario Defaults Error Handling Scenario Defaults Advanced Exercise 2a Exercise 2b Review View Run Graphs and Statistics Real-time Load Results e-load Results Performance Statistics ServerStats ServerStats 13-2 Back-End System Monitoring 13-3 What Systems to Monitor 13-4 Useful Counters on Web Server 13-5 Useful Counters on Application Servers 13-6 Useful Counters on Database Servers 13-7 Run-Time ServerStats Configuration 13-8 Add New ServerStats Configuration 13-9 ServerStats Configurations Add New Monitor Configure Data Sources Metrics Metric Profiles Select ServerStats Configuration Exercise Reports & Graphs Reports & Graphs 14-2 Session Report 14-4 Create Graphs 14-5 Performance vs. Time 14-9 Errors vs. Time Errors vs. Users Performance vs. Users Statistics vs. Time Statistics vs. Users Support xi

12