SIGiST Conference Presentation March 2016

Transcription

1 SIGiST Conference Presentation March 2016

2 Introduction Founded in 2001 Test Lab in Central London Specialise in testing web-based applications and mobile applications Functionality, compatibility and accessibility, usability, performance and security Test consultancy division test management, test process reviews and automation projects 500+ clients Page 2

3 Page 3

4 SIGiST Summer Conference 09 June 2016 Page 4

5 SIGiST Summer Conference We are the sole sponsors for the next conference in June The theme of the whole day is usability and accessibility. We will be supporting this by running: an accessibility workshop during the day. a hands-on experience at lunchtime. Page 5

6 SIGiST Summer Conference We are sponsoring the next conference in June The theme of the whole day is usability and accessibility. We will be supporting this by running: an accessibility workshop during the day. a hands-on experience at lunchtime. Remember to fill in the accessibility questionnaire in your delegate pack and get free chocolate! Page 6

7 We re Always Recruiting Page 7

8 We re Always Recruiting Permanent and contract. Manual testers with 5+ years experience and demonstrable skill in exploratory testing. Automation engineers with 5+ years of Java development then 5+ years of Selenium and 2+ years of Cucumber. Page 8

9 Test Partners Approach to Testing Page 9

10 Quality, Value and Risk Quality is value to some person. Jerry Weinberg Quality is value to some person (that matters). Cem Kaner Page 10

11 Quality, Value and Risk Quality is value to some person. Jerry Weinberg Quality is value to some person (that matters). Cem Kaner Developers create value. Page 11

12 Quality, Value and Risk Quality is value to some person. Jerry Weinberg Quality is value to some person (that matters). Cem Kaner Developers create value. Testers protect that value. And identify and assess the risks that threaten it. Page 12

13 A Structured Approach Context time, resources, risks, constraints, objectives etc. Inventory what is there to test? Oracles how do we know if it s right? Test plan risk-based, lightweight and flexible Test approach - 8-layer testing model, automation (subject to ROI) Reporting minimal but sufficient Time management ad-hoc, formal or session-based Page 13

14 8-layer Testing Model Complexity Race conditions, URL editing, breaking it etc. Individual features and typical user behaviour. Can a user overload the system? Where does the data go? Is it corrupted? Business logic and rules. Do inputs interact as expected? Mandatory fields, validation rules etc. Gestures, drag and drop etc. Page 14

15 Mobile Application Security Testing Page 15

16 Online Security Testing Tool Simple web interface. Works with ios and Android apps. Download the app from an app store or upload a local file. Can also download the app using TestFlight or HockeyApp. Other tool support is coming soon. Page 16

17 Online Security Testing Tool Simple web interface. Works with ios and Android apps. Download the app from an app store or upload a local file. Can also download the app using TestFlight or HockeyApp. Other tool support is coming soon. Takes 2 minutes to automatically execute 80% of the tests a skilled security tester would do in 2 days. Low cost for the initial test. Nominal cost to test a new version of the same app. No cost to retest the same version. Tests the client app, not the server that still needs to be tested manually. Page 17

18 Session-based Test Management Tool Page 18

19 Timeboxing SBT is a method of managing exploratory testing projects by creating time boxes for all the activities, allowing you to plan your test coverage in advance and measure progress against that plan. 10 days Page 19

20 Timeboxing Divide the available time into 90-minute time boxes usually no more than 4 per day in order to allow 6 hours of uninterrupted testing. The other 1.5 or 2 hours are for admin. 90 minutes 90 minutes 90 minutes 90 minutes 90 minutes 90 minutes 90 minutes 90 minutes 90 minutes 90 minutes 90 minutes 90 minutes Page 20

21 Create Charters Create charters, which are top-level specifications of what is to be tested in each time box. Leave 10% of the time boxes unassigned in order to allow for contingencies you will need them! This example shows some typical charters for an e-commerce website. Registration Login & Forgot Pwd Search Filtering Options Add to Basket Basket & Checkout Basket & Checkout My Account Static Pages Page Loading Times Spare Spare Page 21

22 Session Records There is a test record for each charter, describing what was done, what was not done and other data such as the time, date, bug tracker numbers etc. Page 22

23 Folders & files created automatically Management Tool This all needs some sort of management tool. James Bach created one using Perl. We built a more elegant one using a custom application and Excel spreadsheets, and it is available free to anyone who wants to use it. Charter List (Excel) TPL SBTM Tool Reports Completed session data Page 23

24 UX Lab for Hire Page 24

25 Who would like to do usability testing but doesn t have the facilities in-house? Page 25

26 Our professional UX lab is available for hire including: Study lab with a top-end networked PC, cameras and microphones. Page 26

27 Our professional UX lab is available for hire including: Observation room with 3 monitors showing the participant s desktop, a headshot and a wide-angle view of the participant and moderator. Page 27

28 Our professional UX lab is available for hire including: Waiting room and break-out area with kitchen. Page 28

29 Pricing Duration Rate 4 hours morning or afternoon hours evening hours morning and afternoon hours afternoon and evening hours morning, afternoon and evening Page 29

30 London Open Device Lab Page 30

31 Who needs to test their mobile apps and websites on mobile phones and tablets? Page 31

32 Who needs to test their mobile apps and websites on mobile phones and tablets? And who has all the different models of mobile phones and tablets they need, with all the different operating system versions, screen resolutions etc? Page 32

33 London s Largest Mobile Device Lab We have approximately 90 mobile devices from the earliest to the very latest including: ios All phone models from iphone 3 All tablet models from ipad 1 Android Most Samsung and Nexus phone and tablet models from Android 1.6 Variety of Amazon Kindle Fire models with Silk browser Windows Variety of mobile phone and Surface tablet models from Windows 7 Page 33

34 London s Largest Mobile Device Lab Free of charge for reasonable use. Paid-for packages for more extensive use. Free of charge when hiring the UX Lab. Page 34

35 E-Access Accessibility Conference Page 35

36 The UK s Largest Accessibility Conference We will be hosting e-access 2016 towards the end of the year. Around 20 talks, discussions and workshops. Social and training events in the lead-up to the conference. See any of our team today to sign up to the list. Tickets will sell out so book early when they go on sale in a few months time. Page 36

37 BS8878 Accessibility Governance Page 37

38 BS8878 Overview It s a framework to help organisations to embed accessibility in everything they do so it becomes business as usual. Page 38

39 BS8878 Overview It s a framework to help organisations to embed accessibility in everything they do so it becomes business as usual. Designed to encourage organisations to take ownership of all their accessibility issues rather than outsource it all. Page 39

40 BS8878 Overview It s a framework to help organisations to embed accessibility in everything they do so it becomes business as usual. Designed to encourage organisations to take ownership of all their accessibility issues rather than outsource it all. Not just testing the scope includes training, policies, governance, procurement, development, content creation and much more. Page 40

41 BS8878 Overview It s a framework to help organisations to embed accessibility in everything they do so it becomes business as usual. Designed to encourage organisations to take ownership of all their accessibility issues rather than outsource it all. Not just testing the scope includes training, policies, governance, procurement, development, content creation and much more. An accessibility maturity model allows organisations to assess their progress and benchmark against other organisations. Page 41

42 Accessibility Governance - Overview Page 42

43 Accessibility Governance - Roadmap Page 43

44 Thank You Page 44