Test Tools Meet-up. The Server Side Symposium Selenium, soapui, HTMLUnit, TestMaker, TestGen4Web

Transcription

1 The Server Side Symposium 2009 Test Tools Meet-up Selenium, soapui, HTMLUnit, TestMaker, TestGen4Web Frank Cohen, CEO (408) , March 18, 2009

2 Open Source Test Automation About PushToTest Mission: Make Internet Services Run Faster, More Reliably Founded by Frank Cohen in 2001 Functional Test, Load and Performance Test, Service Monitors Privately Held 2 Morgan Kaufmann 2007 Prentice Hall 2005 Sams 2003

3 Next let s talk about The Problem RIA and SOA Is Everywhere Complexity and Lack of Standards Driving Test Costs Up Solutions for Test Development 3

4 How do we achieve rapid test development in a haze of new protocols and techniques?

5 RIA, SOA Is Everywhere 5 AIR is only one RIA/SOA success story of Dozens More Everyone is building software this way.

6 6.7 Million People 1.6 Billion Internet Users 0 RIA, SOA Standards How Do I Test? 6

7 Test Biosphere Test Development/Authoring Protocols, Data, Events Record/Playback Scripting Deployment and Orchestration Repurposing Root Cause Analysis and Mitigation Automation, Continuous Build 7

8 Applies Everywhere Application Testing Model Build Tests and Monitors of Web 2.0, SOA, RIA, Ajax, Flex, Flash But Mostly... Environment Record/Playback, Unit Test, Object/Component Oriented Test Development Methodology Agile Test-First Methodology 8 Architecture Model Service-Oriented Architecture, All Tests are Implicitly SOAbased and Ready for Use

9 9 Open Source Test Automation

10 10 Open Source Test Automation

11 ➊Open Source Test Automation ➋ 11 ➌

12 Test Script (Selenium) Use Case ➊ Enter Search Text ➋ Click Item 6 ➌ AssertTextExists Selenium Script Runner HTMLUnit TestMaker Transformer: Java Unit Test 12 public class Check { public void setup() {}... public void runtest { selenium.setbaseurl( " ); selenium.open("/login.srf ); selenium.type("search", "ctest"); selenium.click("//item[6]"); selenium.asserttextexists("mytext"); } }

13 Deployment Your cloud or mine? Or both! 13

14 Clouds Enable New Levels Run At User Levels Never Before Possible Run From Multiple Locations Around The World Pay As You Go 14

15 Repurposing Investment Developers Unit Test Coverage, As Many As Possible, Jython= QA Functional Test Test Each Step In A Business Process 500 QA Load, Performance Test Test Heavyweight Tasks 100 Ops Production Monitoring Just Enough To Know The App is Up 10 15

16 Business Flow of a Test 16

17 Check-In Unit Test Using DPL Unit Test Data Production Library (DPL) Protocol Handler CSV RDBMS Object 17 Developer Data QA Load Data Preproduction Data Production Data

18 Unit Test Using Protocol Unit Test Data Production Library (DPL) Protocol Handler HTTP SOAP Telnet Extensible for other protocols 18

19 Unit Tests To Test Flows Data Production Library (DPL) and Protocol Handlers Enable Repurposing Check-in Buy Chips Buy Dinner 19

20 From Unit Tests To Functional Tests 20

21 From Unit Tests To Functional Tests 21

22 From Unit Tests To Functional Tests 22

23 Next let s talk about Results Oriented Approach Surface Performance Issues Quickly Automated Functional Tests SLA Compliance Monitoring 23

24 Surface and Solve Performance Issues in RIA, Ajax, SOA, Web apps Surface Issues Quickly Root Cause Analysis & Mitigation Product Search Latency Becomes The Problem Over Time Due To Network Saturation When Running More Than 500 Simulated Users 24

25 Surface and Solve Performance Issues in RIA, Ajax, SOA, Web apps Automated Functional Tests Avoid Manual Testing Functional Test Operates a Test Flow Multiple Steps In Flow Build, Test, Deploy, Monitor in One Script 25

26 Surface and Solve Performance Issues in RIA, Ajax, SOA, Web apps SLA Compliance Monitoring Reuse Tests To Monitor Compliance with SLAs Provide Immediate Dashboard To Surface Production Performance Issues 26

27 Next let s talk about Update On The Tools Selenium, soapui, HTMLUnit, TestMaker, TestGen4Web 27

28 Update On OST Tools HTMLUnit 2.3 = Ajax oriented release soapui 2.5 = REST Selenium RC 1.0 release candidate (finally) Windmill, PushToTest TestMaker 5.2 with Selenium 5.3 with Glassbox integration Appcelerator TestMonkey = Ajax unit testing in JavaScript 28

29 Open Source Build and Test Workshop Web Application Record/Playback Simple record/playback using TestGen4Web TestGen4Web from SpikeSource Firefox Plug-in Outputs TestGen4Web XML file format Reuse in PushToTest PushToTest TestGen4Web Script Runner Transform to Java or Jython and run using HTMLUnit Simple, Easy, Not Very Extensible 29

30 Record/Playback Only Gets Us So Far CoffeeMaker Example

31 Open Source Build and Test Workshop Ajax Record/Playback Simple record/playback using Selenium IDE Selenium from ThoughtWorks, OpenQA.org Largest Enterprise User: Google Selenium Core, Selenium RC, Selenium IDE Outputs Selenese HTML file format Reuse in PushToTest PushToTest Selenium Script Runner in TestMaker 5.2 Transform to Jython and run Complex DSL, Requires JavaScript Skills, XPath, Very Extensible 31

32 Open Source Build and Test Workshop Repurposing In Ajax Testing 32

33 Open Source Build and Test Workshop SOAP, REST, Web Service Testing Fast And Easy WSDL/SOAP Test Authoring Most Popular Open Source Test project for SOA soapui and soapui Pro from Eviware Outputs tests to soapui XML file format Reuse in PushToTest PushToTest soapui Script Runner in TestMaker 5.0 Ideal for Agile Test First Development with Mock Services 33 Show Mock Services

34 Where To Go From Here Attend a PushToTest Training (soapui, Selenium, TestMaker) Attend An Open Source Test Workshop Ask Peter Schumacher, (USA, Texas), peter@pushtotest.com, For A Proposal on Licenses, Training, Support, Consulting 34