Creating an Automation Framework to make Record and Play Automation practical for Test Use Cases

Transcription

1 Creating an Autmatin Framewrk t make Recrd and Play Autmatin practical fr Test Use Cases

2 Cpyright Ntice Gemetric Limited. All rights reserved. N part f this dcument (whether in hardcpy r electrnic frm) may be reprduced, stred in a retrieval system, r transmitted, in any frm r by any means, electrnic, mechanical, phtcpying, recrding, r therwise, t any third party withut the written permissin f Gemetric Limited. Gemetric Limited reserves the right t change the infrmatin cntained in this dcument withut prir ntice. The names r trademarks r registered trademarks used in this dcument are the sle prperty f the respective wners and are gverned/ prtected by the relevant trademark and cpyright laws. This dcument is prvided by Gemetric Limited fr infrmatinal purpses nly, withut representatin r warranty f any kind, and Gemetric Limited shall nt be liable fr errrs r missins with respect t the dcument. The infrmatin cntained herein is prvided n an AS-IS basis and t the maximum extent permitted by applicable law, Gemetric Limited hereby disclaims all ther warranties and cnditins, either express, implied r statutry, including but nt limited t, any (if any) implied warranties, duties r cnditins f merchantability, f fitness fr a particular purpse, f accuracy r cmpleteness f respnses, f results, f wrkmanlike effrt, f lack f viruses, and f lack f negligence, all with regard t the dcument. THERE IS NO WARRANTY OR CONDITION OF NON-INFRINGEMENT OF ANY INTELLECTUAL PROPERTY RIGHTS WITH REGARD TO THE DOCUMENT. IN NO EVENT WILL GEOMETRIC LIMITED BE LIABLE TO ANY OTHER PARTY FOR LOST PROFITS, LOSS OF USE, LOSS OF DATA, OR ANY INCIDENTAL, CONSEQUENTIAL, DIRECT, INDIRECT, OR SPECIAL DAMAGES WHETHER UNDER CONTRACT, TORT, WARRANTY, OR OTHERWISE, ARISING IN ANY WAY OUT OF THIS DOCUMENT, WHETHER OR NOT SUCH PARTY HAD ADVANCE NOTICE OF THE POSSIBILITY OF SUCH DAMAGES. Cnfidentiality Ntice This dcument is disclsed nly t the recipient pursuant t a cnfidentiality relatinship under which the recipient has cnfidentiality bligatins defined herein after. This dcument cnstitutes cnfidential infrmatin and cntains prprietary infrmatin belnging t Gemetric Limited, and the recipient, by its receipt f this dcument, acknwledges the same. The recipient shall use the cnfidential infrmatin nly fr the purpse defined abve fr which this dcument is supplied. The recipient must btain Gemetric Limited s written cnsent befre the recipient disclses any infrmatin n the cntents r subject matter f this dcument r part theref t any third party which may include an individual, firm r cmpany r an emplyee r emplyees f such a firm r cmpany. The recipient acknwledges its bligatin t cmply with the prvisins f this cnfidentiality ntice. 2

3 Cntents Executive Summary... 4 Intrductin... 4 Using Recrd and Play:... 4 Prblem Definitin... 4 Drawbacks f 'Recrd and Play':... 4 Autmatin Framewrk:... 5 High-Level Slutin... 5 Slutin Details... 6 Slutin Benefits... 7 Cnclusin... 8 Abut Authr... 8 Abut Gemetric

4 Executive Summary Test Autmatin is the develpment and usage f tls t determine success r failure f specified test cases against an applicatin withut human input. This whitepaper explres the use f 'recrd and play' fr autmating the executin f test use cases. Intrductin Fr any applicatin, ne f the majr tasks fr its smth usage is the perfrmance f functinal testing. Within functinal testing as well, the determinant f quality f the test lies in the design f its test cases. Hwever, the majrity f effrt is spent n executin f test cases. These effrts further multiply with the increase f cnfiguratins t be tested. In additin, the task is repetitive (testing required in cycles) and prne t human errrs. Als, prject(s) need t make a difficult chice n which platfrm t test during a cycle. Test autmatin ffers a way t handle the abve issues. Using autmatin als creates bandwidth fr the resurce t cncentrate n imprving the design f test cases. Using Recrd and Play: Several cmmercially available tls enable the recrding f user actins n the applicatin. This recrding generates simple scripts (QA readable scripts). These scripts can later be replayed withut human input. This is simple t use fr quality assurance (QA) and requires n additinal knwledge f scripting/prgramming. Prblem Definitin Using test autmatin (in 'Recrd and Play' mde), the prject can gain all the abve mentined benefits; despite that, it is bserved that the usage f such autmatin tls is nt cmmn. A likely cause fr the lack f use is due t the effrt required fr reusing and maintaining such 'Recrded' scripts. Drawbacks f 'Recrd and Play': Reusability: Changing the input data set - If the same test case has t be replayed with a different data set, then it wuld need t be re-recrded in the 'Recrd and Play' mdel Certain user actins are cmmn t several test cases, s these can be extracted and reused instead f recrding them multiple times Identificatin f UI elements will be arbitrary; nly user click/muse hver will be identified 4

5 Maintainability: T vercme the abve listed limitatins f 'Recde and Play', ne wuld have t recrd each test case separately. This will cnsiderably increase the vlume f the test cases, quickly rendering the library f test cases un-maintainable. Autmatin Framewrk: T realize the benefits f Autmatin Testing and avid the limitatins f 'Recrd and Play', ne needs t develp an 'Autmatin Framewrk'. But as the statement suggests, ne needs t 'develp' this framewrk, and wuld need a dedicated resurce with the develpment backgrund and training t develp and wrk n such suite. This additinal time generally acts as a radblck fr implementing any autmatin in prjects. The autmatin tl cnsidered in this paper is 'Selenium WebDriver'. This chice was based n the evaluatin f the said tl with ENOVIA V6 and Windchill. High-Level Slutin Develpment f an in-huse autmatin framewrk t cater t diverse prject needs must fit the fllwing criteria: Wrk with different PLM systems Easily cnfigurable Simple t use fr QA with n additinal develpment knwledge required Autmatin framewrks can be classified int three types: 1. Data Driven: test suite can be executed fr different data sets, and the data set can be prvided as a file 2. Keywrd Driven: typically uses 'mdular' prgramming. In this apprach, different steps f the test case are encded as 'keywrds'. A test case then becmes nthing mre than a set f 'keywrds'. These keywrds are independent f the applicatin r the PLM system. 3. Hybrid: This apprach cmbines the appraches utlined abve and delivers benefits derived frm bth 5

6 Slutin Details Framewrk Architecture: Cmpnents: Resurces: Object Repsitry: Makes the framewrk easily extendible and rbust. It is an XML file which cntains the UI elements identified as xpath/css. Using FirePath (add-n fr Firefx) can enable unifrm identificatin f the elements. Input and Expected Data Set: An Excel file with multiple sheets crrespnding t different test cases, each cntaining rws f input data and crrespnding expected results is used t incrprate features f a data driven framewrk. This file can als be used fr lgging a pass/fail status fr the test suite. Keywrd Steps: T incrprate features f a keywrd driven framewrk, this is an Excel file with multiple sheets crrespnding t different test cases, each cntaining steps written as pre-defined 'keywrds' and anntating input UI element as nde name frm an 'Object Repsitry' xml file. 6

7 Business Scripts: Cmmn Libraries: This mdule has all the framewrk-specific implementatin elements: Data Readers t enable parsing inputs Tl Utils t enable integratin f ther tl facilities (e.g. actual keybard events) Keywrd Implementatin - high level definitin f 'keywrds', fr example, createpart can be extracted as a keywrd and the implementatin fr this will be PLM independent (nt specific t any PLM and can be used fr any system), such as: clickcmmand(<input_xmlnode>) entertext(<input_xls_partname>) entertext(<input_xls_desc>) clickcmmand(<input_ XMLNODE) Applicatin Specific Scripts: Business Utilities - Additinal flw specific t the PLM system, if required Errr Handling - Any specific errr handling Executin and Reprting: Executin Framewrk - Different autmatin executin framewrks available like TestNG, Webdriver default t chse as needed Reprting: Infrmatin Lgging - string executin infrmatin in separate lgs as part f executin framewrk Errr Reprting - marking the failed cases Status update n Data - marking status against each data entry in input file(s) User Ntificatin - ntificatin t user abut status f executin Framewrk develpment is dne in JAVA Slutin Benefits 1. A framewrk, with the mdules listed abve, can be used acrss prjects and PLM envirnments. All the cmmn utilities wuld be readily available fr use. 2. Keywrds can be easily added by extending the given framewrk. And, newly added keywrds wuld increase the 'base' f the framewrk. 7

8 3. Writing test cases is simpler with this framewrk as it nly requires writing f scripts with defined keywrds. Hence, the framewrk is QA friendly and needs n additinal training. 4. Exceptin handling and lg generatin is already prvided. Reprts generated are detailed and every test script can be used fr further analysis f the issue. 5. Capturing f UI elements can be standardized with use f FirePath. This tl is simple t use and yields accurate xpath/css fr use. Key functinalities fr each PLM envirnment can be captured and prvided as simple base. 6. N hard cding is required Cnclusin Using this framewrk, the QA team can implement the test suite by adding their UI elements and writing test cases using already defined keywrds. This framewrk greatly reduces additinal effrts required t implement autmatin testing fr a prject. Abut Authr Amrita Deshingkar is a Develpment Lead with Gemetric and has been a part f its PLM Services grup fr the past 10 years. She has a very strng backgrund n the challenges faced in PLM services, as well as best practices fr prduct develpment. Abut Gemetric Gemetric is a specialist in the dmain f engineering slutins, services and technlgies. Its prtfli f Glbal Engineering services, Prduct Lifecycle Management (PLM) slutins, Embedded System slutins, and Digital Technlgy slutins enables cmpanies t frmulate, implement, and execute glbal engineering and manufacturing strategies aimed at achieving greater efficiencies in the prduct realizatin lifecycle. Listed n the Bmbay and Natinal stck exchanges in India, the cmpany recrded cnslidated revenues f Rupees billin (US Dllars millin) fr the year ended March It emplys ver 4800 peple acrss 13 glbal delivery lcatins in the US, France, Germany, Rmania, India, and China. Gemetric has been assessed at Maturity Level 3 fr CMMI 1.3- Develpment and CMMI 1.3-Services fr its Sftware and Engineering Services business units and is ISO 9001:2008 certified fr engineering peratins. The cmpany s peratins are als ISO 27001:2005 certified. The cpyright/ trademarks f all prducts referenced herein are held by their respective cmpanies. 8