Testing with Soap UI. Tomaš Maconko

Transcription

1 Testing with Soap UI Tomaš Maconko 1

2 Content What is Soap UI? What features does the Soap UI have? Usage in project context Pros and cons Soap UI alternatives 2

3 What is Soap UI? Open Source Testing Tool Built on Java platform Cross platform desktop based application Leading automation tool for inspecting, invoking, monitoring and simulating Used for wide area of testing Supports testing for both SOAP and REST based services 3

4 Features Functional testing Service simulation Security testing Load testing Automation Analytics Ecosystem Scripting 4

5 Functional testing features Make complex, black-box testing scenarios according to any possible sequence/flow diagrams. Debug your tests. Examine the input and output of API s in certain points of your flow. Connect and execute queries to import/export data to/from databases or files using JDBC driver. Analyze the coverage of your API s by tests. Prepare and configure the environments for testing (like test, staging, prod) and switch between them using dropdown. Do the functional testing towards SOAP or REST services. 5

6 Functional testing: Invoke API 6

7 Functional testing: DB queries 7

8 Service simulation Auto mock creation allows you to create fake service with custom responses for certain API to prepare the test cases (using full scenario) before the real service is implemented. Deploy faked services as WAR packages to hosting server to share the faked API between teams or team members. Soap UI allows to create faked API as for SOAP/WSDL as for RESP/HTTP. Simulation coverage shows the number of API covered by mocked services. 8

9 Service simulation 9

10 Security testing Test generation allows you to create security tests set for most of hacker attacks in wizards Soap UI allows to create testing for SQL Injection, XML Bomb, Cross Site Scripting attacks Provides random generated data attacks (fuzzing scan) to provoke system errors and make system vulnerable 10

11 Security testing: SQL Injection 11

12 Load testing Tool provides availability to set the load testing limits, values Run and analyze the provided charts for load testing Use different built-in strategies 12

13 Load testing: Run and monitor 13

14 Automation Soap UI tests are supported by Maven, ANT, Hudson, Bamboo continuous integration or build tools Can be configured to run on other CI/build tools, but needs additional configuration scripts. Automated test are run with Junit using Java VM 14

15 Analytics Provides the built-in and custom reports of testing results with full logs Allows to export reports in different formats Grouped and categorized metrics of tests, assertions, mocks, covered use cases numbers 15

16 Ecosystem Soap UI can be integrated into IntelliJ, NetBeans, Eclipse IDE Accepts third party plugins for rich testing experience Allows to create custom plugins for certain scenarios 16

17 Scripting: Groovy Groovy is an essential part of soapui, which was not incorporated before Groovy is used in soapui primarily as a control step, getting results from other steps and passing them to other steps. It can even be used to create new test steps, restart old ones or decide which steps to start based on the results of the old ones Nevertheless groovy s capabilities as a scripting language counter the native soapui problem and allow us to bypass this disadvantage 17

18 Scripting: Groovy 18

19 Project context 19

20 Project testing context 20

21 Pros Very simple and easy GUI Less cost compared to other tools in the marked Supports all standard protocols Created mocks where we can t use real applications Reduces the need to install and maintain hundreds of tools and databases locally on desktop Provides fast and efficient framework in generating a lot of tests Supports agile methodology as it helps in development of test cases even before the code is produced Teams can work in parallel developers and testers User friendly reporting 21

22 Cons You have to double work Differences between mocked and live environments Many features are available in Pro version only 22

23 Alternatives Postman REST only Fiddler REST only Wizdler SOAP only SoapSonar SOAP only 23

24 Q/A 24