IBM Rational Functional Tester

Transcription

1 Infineon 11 th April 2006 IFPT IT MFG DC WT Table of contents Automatic GUI Testing Regression Testing IBM Rational FT Overview IBM Rational FT Main Features IBM Rational FT Demonstrations Q&A Pg 1

2 Table of contents Automatic GUI Testing Regression Testing Introduction IBM Rational FT Overview Concepts IBM Rational FT Main Features IBM Rational FT Demonstrations Q&A Introduction Information Systems increasing complexity Shorter development periods: Closer release dates Rapid Application Development Extreme Programming What about software quality and testing: Solution: Automatic Test Procedures The smallest change can wreak unpredictable havoc when implications of the change are not properly understood. IBM Pg 2

3 Concepts GUI Testing Tools Capture-Replay (Script Generation based on user s actions) Unit-Test Regression Testing Execute test scripting against application builds and test results comparison Techniques for script building: Linear Scripts Obtained from user actions on a given GUI Structured Scripts Previous + Flow Control Options Data-Driven User input data (Data Base, Spreadsheet, XML File ) is detached from user actions (usually hard-coded) Keyword-Driven User actions abstractions encapsulating long low-level scripting procedures Table of contents Automatic GUI Testing Regression Testing IBM Rational Product FT Presentation Overview Requirements Installation Guide IBM Rational FT Main Features IBM Rational FT Demonstrations Q&A Pg 3

4 Product Presentation Advanced tool for regression and functional testing for GUIs: Web based applications Microsoft Visual Studio.net Java Automated data-driven tests Recording function can generate Java and VB.net scripts Integrated with other Rational tools: Clear Case for concurrent script development Rational Test Manager Tutorials require an IBM user account (freely available) Downloadable trial version (30 days trial license): Requirements Web Browser Microsoft Visual Studio 2003 (or 2005 with patch) VB.net scripting usage.net Framework 1.1.net applications Web applications using activex controls VB.net scripting usage JRE 1.3.1_02 or better Required for test report application Java scripting usage Pg 4

5 Requirements Technical Requirements: In a standard IFPT DC machine some extra procedures are required: Removal of the Java default installation using NetInstall JRE install, downloaded directly from Sun Ensuring during installation the association of the Java Virtual Machine to a default Web Browser, preferably IE When the installation completes check the Control Panel and confirm the previous step Requirements In a standard IFPT DC machine some extra procedures are required: Add the Java lib location to the machine s System Variables Pg 5

6 Installation Guide 1. As there is no CD drive, a drive letter must be mapped to the CD Image location (My Computer->Tools->Map Network Drive) 2. Open Windows Explorer, go to mapped network drive and run: launchpad.exe 3. Click Install IBM Rational Functional Tester V6.X and wait for wizard to appear 4. Click next and accept terms and conditions 5. Choose target development IDE (Eclipse is included) 6. Confirm installation details and wait about 10 to 15 minutes (machine dependent) Table of contents Automatic GUI Testing Regression Testing IBM Rational Script FT Recording/Playback Overview Native Objects Object Maps IBM Rational FT Main Features Verification Points Datapools IBM Rational FT Demonstrations GUI Element Property Extraction Q&A Notes Pg 6

7 Script Recording/Playback (1/4) Before using record feature, make sure there are just a few processes running. Avoid having an overloaded desktop. 1. Open IBM Rational FT, either by opening Eclipse or Visual Studio. 2. Create a Functional Test Project. Script Recording/Playback (2/4) 3. Click Add Script Using Recorder 4. Recorder Console should appear after assigning a name to the script and accepting the default options. Application launcher. Target Test application or URL of Web Application should be declared here. Command Line Arguments possible Recording Console Event Logging Error Logging Pause Resume Recording Console is customizable Pg 7

8 Script Recording/Playback (3/4) 5. When finished click Stop and the target IDE will open a file with the generated script. IBM recommends the program to be closed before the script recording is paused. 6. To Run Script use the IDE s compile/execute functions Executed Actions Log 7. Results log is shown in the default web browser Script Recording/Playback (4/4) When recording, detected components are stored in a local object map GUI objects are related to native properties with a associated threshold Generated code can be edited to add flow control Abstract top layer is not directly supported During playback user should not interact with the application Same script can be used with different builds of the same application Target aplications must be added to application configuration manager Pg 8

9 Object Map - (1/2) Object Map (OM) creates a structure that maps detected graphical controls into IBM Rational FT native/abstract objects: Provide platform independent API for object manipulation OM sharing possible Create New OM Created OM Mapped objects into script Object Map (2/2) Object Map should only contain used objects in the script When an OM is created in the sequence of a Record Action, it only adds used objects to the OM Objects can be manually added GUI Controls hierarchy is preserved Detection parameters are editable either trough fixed parameters or regex (Perl Standart) patterns that are similar in both scripting languages. OM objects can be added to the script Pg 9

10 Verification Points (1/2) Used to compare actual data with expected data Check results of executed steps by analyzing GUI control s: Properties (All/Single) Data Timeout Values Automatic specification: 1. Choose object 2. Select VP type Verification Points (2/2) Verification points can also be manually specified: Only by code editing Useful when tester wants to perform the tests with its own data, which source may be: File Database Spreadsheet As properties may be extracted from components and then used in manual VPs this option is even more useful: IFtVerificationPoint vpmanual (Java.lang.String vpname, Java.lang.Object actual) IFtVerificationPoint vpmanual (Java.lang.String vpname, Java.lang.Object expected, Java.lang.Object actual) IFtVerificationPoint vpdynamic (Java.lang.String vpname) IFtVerificationPoint vpdynamic (Java.lang.String vpname, TestObject objectundertest) Pg 10

11 Datapool (1/2) A Datapool (DP) is a test dataset, a collection of related data records which supplies data values to the variables in a test script during test script playback. It is a key element to execute Data-Driven Tests. Automatic specification (manual inserted values are made redundant): 1. Choose to Data-Drive script 2. Choose top level component that includes all the others to contain the data (assuming many values as in a form) 3. Chose objects to data-drive 4. Insert Data Datapool (2/2) In playback mode tester can decide how many rows are to be processed from 1 to end of datapool DP can be created having a CSV (Comma Separated Value) file as its basis, which is a common export format supported by many Database query tools such as SQLNavigator: Pg 11

12 Native Objects Native objects are not stored as serialized objects but as XML files with different types of extensions. /resources - folder This makes it easy to build applications to process these files. Product package doesn t seem to provide these files DTD or schema. GUI Element Property Extraction Possible to extract properties and text values from GUI components and map them into script variables. control().getproperty( propertyname") A property VP specified with the IBM FT GUI lists all available properties for the object. If a kind of object takes some time to load (which is something that happens a lot in web applications due to browsers rendering engines), it is possible to specify component specific timeouts. waitforexistence(timeout_total, interval_per_try); Pg 12

13 Notes It is possible to call a script from another. Possible to pass arguments inside an object array. callscript( ScriptName",argument_array_object); Called script always has to cast abstract objects to desired type. Notes: Lines of Code are almost all of type: Guiobject.ActiontoPerform() Objects in OM must all have different names Although no defects have been found, product documentation suggests that there may be some problems when testing C++ based GUIs Table of contents Automatic GUI Testing Regression Testing IBM Rational Product FT Tutorial Overview 1 IBM Tutorial 1 IBM Tutorial 2 IBM Rational FT Main Features Web Application MoviesDB Paint.net Cube IBM Rational FT Demonstrations Q&A Pg 13

14 Table of contents Automatic GUI Testing Regression Testing IBM Rational Private FT Objects Overview Manipulation Object Map Datapools IBM Rational FT Main Features Custom.net Controls (MAC GUI Framework) IBM Rational FT Demonstrations Rational Test Manager Integration Q&A References Técnicas para Construção de Testes Funcionais Automáticos Simone Antunes Correia, Alberto Rodrigues da Silva Paint.net Pg 14

15 Never stop thinking Pg 15