Partnering for User Acceptance Testing Success

Transcription

1 Partnering for User Acceptance Testing Success Jennifer Biewer, Senior Quality Assurance Manager Tim O Connor, Practice Manager Quality Assurance Services April 12, 2017

2 UAT is final testing performed when functional, system and regression testing is completed. The main purpose of UAT is to validate the software against the business requirements. This validation is carried out by end users who are familiar with the business requirements. Software Testing, December 2016

3 Why do UAT? Validates that your business needs are being met Increases your organization s confidence in new solutions Catches issues before your end-users or customers do 2

4 Complexity of testing process Banking solutions increase testing complexity Who knows what else? Smart house Smart cars IoT devices Smart glasses Smart appliances BlackBerry smartphones BlackBerry smartphones Wearables Windows smartphone Windows tablets Windows smartphone Windows tablets Android Tablets ios tablets Android Tablets ios tablets Android Smartphone ios smartphone Android Smartphone ios smartphone Chrome Firefox Chrome Firefox Chrome Firefox Internet Explorer Safari Internet Explorer Safari Internet Explorer Safari Windows 8.x Macintosh OS Windows 8.x Macintosh OS X Windows 8.x Macintosh OS X Windows 8.x Macintosh OS X Windows 3.1 Windows NT Windows XP Windows 7 Windows XP Windows 7 Time Windows XP Windows 7 Windows XP Windows 7 Forrester Research, December

5 How do we perform a successful UAT? Adhere to the Critical Success Factors 4

6 Critical Success Factors Resource Commitments Success! Defined Goals Organizational Structure Process & Structure 5

7 The Right Goals Key Products and Services Key Business Processes Your Definition of Quality 6

8 The Right Organizational Structure Bank CTO Line of Business Executives Program Management Subject Matter Expert (SME) Manager UAT QA Manager Systems Integration Testing Manager Track 1 Business SME Test Lead 1 Track 2 Business SME Test Lead 2 Track 3 Business SME Test Lead 3 Track x Business SME Test Lead X Tester 1 Tester 2 7

9 The Right People & Partnerships I don t have a QA Manager Or Test Leads? QA Manager & Business Owner (SME) Test Leads & Business SMEs QA Manager & Test/SME Leads 8

10 The Right Process 9

11 The Right Process QA Manager or Lead QA Role Documents & Communicates the QA processes Defines & gains buy-in for overall testing scope for UAT Schedules testing for all defined UAT business tracks/processes Aligns resources to all UAT business tracks for testing Monitors and reports on the success of the defined processes Test Lead and Business SME Team Leads a team of testers to: Execute the test plan Write test cases/scenarios Execute the testing Document the progress of testing & defect status Communicate issues/risks Modifies processes where necessary 10

12 The Right Structure Business Process Track Account Origination: Executive Owner Start End Test Lead Joan, Dana, Fred Business Lead SME Third-Party SME 5/20/17 10/23/17 Mabel Juan Jenny Wires: Doug, Joan 7/14/17 10/9/17 Amir Lilly Ling ebanking: Joan, Mae, Will 10/5/17 10/30/17 Monica Bob Carol Bill pay: Daphne, Hilary 10/5/17 1/18/18 Steve Steve Chad edelivery: Dan, Don, Sally 10/26/17 11/13/17 Frank Sally Rolf 11

13 Summary: Key Supporting Factors Quality Goals are clear to everyone Scope is defined and agreed upon, including approvals, and is traceable to the business requirements Committed resources and tools to support the processes Strong Partnerships between the Business Owners and UAT Lead, Test Leads, and SMEs Strong Reporting processes around: Schedule (test execution status) Defect Status Issue & Risk communication and mitigation Ability to recognize when a process needs to change & change it 12

14 Case Study Background: Obtaining a QA Expert: Organizational Structure: Executive Support: Business Analyst and Quality Assurance Collaboration: The Results: In late 2015, an East Coast bank was struggling with issues around their User Acceptance Testing (UAT). A Quality Assurance Manager from FIS who had been managing a different, but related project at the bank. The QA Manager implemented an organizational structure to support the goals of all stakeholders involved in the initiative. Linkage with executive management was strengthened by establishing a direct level of accountability and ownership. The pairing of Subject Matter Experts/Business Analysts with the QA Manager/Test Leads. The QA Manager drove the bank s UAT to a successful conclusion. 13

15 Jennifer Biewer Tim O Connor Tim.OConnor@fisglobal.com

16 2017 FIS and/or its subsidiaries. All Rights Reserved. FIS confidential and proprietary information.