Testing in a Test-driven World

Transcription

1 KW1 Keynote 5/1/2013 8:30:00 AM Testing in a Test-driven World Presented by: Jeff Payne Coveros, Inc. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL sqeinfo@sqe.com

2 Jeff Payne Jeff Payne is CEO and founder of Coveros, Inc., a software company that builds secure software applications using agile methods. Since its inception in 2008, Coveros has become a market leader in secure agile principles and has been recognized by Inc. magazine as one of the fastest growing private US companies. Prior to founding Coveros, Jeff was chairman of the board, CEO, and cofounder of Cigital, Inc., a market leader in software security consulting. Jeff has published more than thirty papers on software development and testing, and testified before Congress on issues of national importance, including intellectual property rights, cyberterrorism, and software quality.

3 Testing in a Test Driven World Jeffery Payne Chief Executive Officer Coveros, Inc. jeff.payne@coveros.com 1 A test driven world: Tests are used to specify behavior prior to development Automation is used to validate quality on an on-going basis Software is not done until tested/accepted by customers Everyone on the team is responsible for quality 2 1

4 The Good the Bad and the Ugly The Good Testing drives development. The Bad Lots of testing is needed in a short amount of time. The Ugly A belief by some that testers are not needed. 3 The Good Testing drives development instead of the other way around Testing is no longer at the end of the whip Testing doesn t get blamed when the software doesn t work Developers must test their own code 4 2

5 The Bad A lot of testing needs to be done in short amounts of time Everyone gets blamed when the software doesn t work Developers usually aren t very good tester Poor acceptance tests = incorrect code! 5 The Ugly Some believe testers are no longer necessary Recent conference talks: Testing is Dead Pursuing Quality? You won t get there with testing Death of the Testing Phase All that Testing is Getting in the way of Quality I can t wait to fire my testers! 6 3

6 WRONG 7 Reason #1 Mission-critical software Not all software is angry birds (or on-line maps) Protect critical / sensitive information Customer s can t effectively test this software 8 4

7 Reason #2 Delivery constraints Software delivery often depends upon other things Hardware manufacturing IT support Compliance with rules and regulations Some testing must wait for constraints to be resolved 9 Reason #3 Security is really important Security and privacy are essential aspects of quality today. Developers will locate implementation bugs but often not design flaws. Rigorous security testing is a must for critical software 10 5

8 Reason #4 Non-professional testers are bad at testing Happy path testing is common The chasm between what developers and customers test is enormous Most software needs professional test support to work 11 A Wakeup Call for Testers While a test driven world does not remove the need for testers, it does change their role This is an opportunity for those who wish to seize it or a challenge for those that don t 12 6

9 In a Test Driven World: Speed is King Automation is the saving grace for agile Test automation Continuous integration/delivery Effective automation is often implemented below the UI Learn to code = learn to script Don t pray for Y2K 13 The growing need for automation skills Analysis by Paul Moyer, TrustedQA ( 14 7

10 In a Test Driven World: Fill the Void Purpose-driven testing Testing with a particular intent Get smart about techniques Identify the area between what a developer is going to test and the customer s role Be flexible on a project by project basis but define roles up front Don t Hide Behind Testing Process Dogma 15 In a Test Driven World: Consider Specialization Non-functional requirements are becoming more and more important as software is embedded in our lives Security Privacy Performance/Load Become an expert in one of these areas and drive this expertise into Sprints Specialize to Thrive 16 8

11 In a Test Driven World: Own the Big Picture Business orientation / focus Mentor/train developers on testing techniques Take responsibility for understanding and meeting customer needs Take Charge of the Entire Quality Process 17 Thank You 18 9