ISTBQ Yesterday, Today, Tomorrow HUSTEF 2015, Budapest, November 2015 G. Bazzana ISTQB President
ISTQB Yesterday ISTQB 2015 2
WHAT IS THE ISTQB? ISTQB : International Software Testing Qualifications Board (www.istqb.org): Non-profit association Founded in 2002 Headquartered in Belgium Has its own constitution, rules and regulations Composed of volunteer international Testing Experts Responsible for the ISTQB Certified Tester scheme worldwide ISTQB is the world s leading organization for Software Testing Certification Advancing the software testing profession ISTQB 2015 3
ISTQB VISION To continually improve and advance the software testing profession by: Defining and maintaining a Body of Knowledge which allows testers to be certified based on best practices, connecting the international software testing community, and encouraging research. ISTQB 2015 4
ISTQB VALUE CHAIN Working Groups: http://www.istqb.org/about-istqb/working-groups.html Member Boards: http://www.istqb.org/istqb-where-you-are/your-local-member-board.html Training Providers: http://www.istqb.org/istqb-where-you-are/find-a-training-provider.html Exam Providers: http://www.istqb.org/istqb-where-you-are/find-an-exam-provider.html ISTQB Partners: http://www.istqb.org/partner/istqb-partners.html ISTQB 2015 5
ISTQB ECO-SYSTEM ISTQB 2015 6
ISTQB WORKING GROUPS (WGs) ISTQB 2015 7
ISTQB VIDEOS ISTQB Videos give you insights into the ISTQB Certified Tester scheme http://www.istqb.org/introduction-to-istqb.html ISTQB 2015 8
ISTQB LEVELS AND SYLLABI ISTQB 2015 9
Market trends current situation In accordance to Technavio Report «Global Software Testing Service Market» Outsourced Software Testing Services segment has a value of over 16B$ It is growing at a CAGR of 10% in 2014 and 2015 18 16 14 12 10 8 6 4 2 0 16,7 15,15 13,78 12,58 11,5 10,25% 9,90% 9,60% 9,35% 9,11% 2011 2012 2013 2014 2015 Market Value (US$) Growth Rate 11,50% 11,00% 10,50% 10,00% 9,50% 9,00% 8,50% 8,00% ISTQB 2015 10
World Quality Report Findings ISTQB 2015 11
ISTQB Today ISTQB 2015 12
Drivers COST QUALITY RISK AGILITY Competition Tightening margins Increasing dependency of business from SW Multiple platforms SW Intensive systems Knowledge retention Quicker time to market Consumption based pricing ISTQB 2015 13
APPLICABLE MARKETS Telco IT Engineering ISTQB 2015 14
Figures as of 2015Q2 Executive Summary More than 560.000 exams world wide! Close to Trend YOY is OK Wrt FL+AL+EL + 8,5% Adding-up Agile + 14,5% 410.000 certificates world wide! In 2015Q2, 18993 exams and 14036 certificates ISTQB 2015 15
Figures as of 2015Q2 Executive Summary (2) Agile uptake VERY Good: - Almost 2000 exams - 1600 certificates - By 33 Boards - Forecast for 2015: over 4000 exams Certificates issued in 108 countries ISTQB 2015 16
BENEFITS FOR PROFESSIONALS International recognition of acquired competencies and skills Authorized to use the Certified Tester logo (specifying the level of certification) Whole of career path support, from Foundation to Expert level Higher appeal in the labor market ISTQB 2015 17
BENEFITS FOR COMPANIES ISTQB certification can provide a competitive advantage for companies, promising a higher level of reliability of the applications being developed due to efficient and cost effective testing practices derived from the ISTQB competencies Consulting companies with certified staff can offer higher-level services to customers, increasing revenues and brand value ISTQB has defined a Partner Program for companies that engage a large number of certified testers ISTQB 2014 18
BENEFITS FOR ATPs (Accredited Training Providers) Educational institutions and consulting companies may become an ISTQB Accredited Trainer Provider (ATP) according to processes and rules defined at the international level Accredited Training Providers ensure a high standing of training is delivered through having: certified trainers the content, quality and syllabus coverage of training materials checked by ISTQB Boards advance notice of changes to the ISTQB Glossary and syllabi Accredited Training Providers are entitled to use relevant logos and are listed in the ISTQB Website ISTQB 2014 19
EXAM RELIABILITY - SURVEY To what extent do you feel the ISTQB Foundation Level certification exam reflects the knowledge of the candidates? 70% 60% 50% 40% 30% Test Engineers Test Managers 20% 10% 0% Exceedingly well Well Partially well Not very well More than 70% of respondents regard the ISTQB Foundation Level certification exam as fully or exceedingly reliable and these results are consistent throughout the world; only 6% found the exam not very reliable ISTQB 2015 20
BENEFITS FOR PROFESSIONALS ISTQB SURVEY Would you recommend the ISTQB Foundation Level (CTFL) certification to your colleagues? ISTQB 2015 21
EUROSTAR 2014 SURVEY SW TESTING CERTIFICATION VALUE Report: Practices & Attitudes in Software Testing (PAST) Study EUROSTAR Sw Testing Report 2014 Based on 630 respondents (85% CTFL and 26% also CTAL) ISTQB 2015 22
INCREASING PRODUCTIVITY OF SW PROJECTS CERTIFICATION OF TESTERS CAN HELP! Data collected and analysed by Capers Jones from 1984 through 2015 From About 725 companies (150 clients in Fortune 500) and 40 government/military groups for 25,000 total projects in 27 countries Factor Experienced test teams Testing by certified test personnel Testing by developers only Informal test case design Inexperienced test teams Truncating testing to "meet schedule" Impact on productivity 12% Improvement 7% Improvement 6% Worsening 8% Worsening 15% Worsening 45% Worsening (Capers Jones, Scoring and evaluating software methods, practices, and results, version 15.0, September 6, 2014) ISTQB 2015 23
ISTQB survey on Worldwide Software Testing Practices 2015 to be published soon This report has been produced by the ISTQB MWG Marketing Working Group as a result of a survey, characterized by the following quantitative data: - Period: 26 Feb - 22 May 2015 - Data collection method: Webbased at www.istqb.org - Target: Open to anybody - Number of respondents: 3294 - Number of countries represented: 89 - End user companies: 52% wrt 48% of IT companies Europe 36% Oceania 1% Asia 31% North America 22% South America 9% Africa 1% ISTQB 2015 24
What percentage of a typical IT/ R&D project budget is allocated to software testing? 45,0% 40,0% 35,0% 30,0% 25,0% 20,0% 15,0% 10,0% 5,0% 0,0% 0% - 10% 11% - 25% 26% - 40% More than 40% The large majority of respondents indicate budgets between 11% and 40%. This is in line with the World Quality Report 2014-15 that indicates an average expenditure of 26% ISTQB 2015 25
What is your expectation for your organization's software testing budget in the next 12 months? 35,0% 30,0% 25,0% 20,0% 15,0% 10,0% 5,0% 0,0% Average = 14% Decrease Stable Growth 9,8% 31% 59,2% About 60% of the respondents expect an increase of the budgets allocated to testing; this confirms the growing trend exhibited in the World Quality Report 2014-15, that is forecasting that by 2017 the IT budget allocated to QA & testing will rise to 29%. Average expected growth is 14% that is much pretty in line with the forecasted CAGR of the Global Testing Market in 2015-2019 in the Technavio Report (www.technavio.com) ISTQB 2015 26
Who is responsible for software testing in your company? 90,0% 80,0% 70,0% 60,0% 50,0% 40,0% 30,0% 20,0% 10,0% 0,0% Near-shore test team Off-shore test team Distributed test team In-sourced test team End Users Developers In-house test team In close to 80% of the cases, the responsibility of SW testing is assigned to an inhouse test teams; this confirms the increasing adoption of segregation of duties, that is one of the key factors for the effectiveness of testing activities ISTQB 2015 27
To whom do the test team report? Other 15% To Operation 51% To Business 18% To Development 16% Wide adoption of segregation of duties is confirmed by the fact that in most cases (84%) the test team does not report to Development ISTQB 2015 28
Which Software Development Lifecycle (SDLC) model are you using? Agile (Scrum, Extreme programming, Sequential (Waterfall, V-model) Iterative (RUP, Spiral) Other 0,0% 50,0% 100,0% Agile based SDLCs are being adopted ahead of traditional ones (Waterfall or V- Model) Agile methodologies are significantly increasing in popularity; this underlines the need to have appropriate testing processes and techniques also for Agile, combined with certification of testing competences ISTQB has recently launched a specific certification module for Agile Tester with a remarkable positive reply by the market, and in the near future will further extend the certifications on Agile testing at Advanced level ISTQB 2015 29
How many test cases do you automate? From 41% to 50% 8% More than 50% 17% From 21% - to 40% 15% No automation 28% Less then 20% 32% Test automation has become very widespread in the market, with 72% adoption in 40% of the cases the percentage of automated test cases is well beyond 20% ISTQB 2015 30
ISTQB Tomorrow ISTQB 2015 31
Market trends the future The trend is predicted to accelerate over the period 2015-2018 - Global Software Testing Service Market CAGR 11.15% - Global Software Testing System Integrator Market CAGR 21.53% ISTQB 2015 32
HIGHLIGHTS FROM THE 2015 WORLD SW QUALITY REPORT Budgets dedicated to QA&Testing are growing at warp speed, with a growth pace much higher than anticipated, reaching in average 35% of the IT budgets Test automation is increasing, jumping in one year from 28% to 45% of test cases Digital transformation is putting more and more emphasis on customer value and end-user experience as targets for testing Security is the most pressing concern Agile and DevOps adoption has become widespread and call for extreme level of speed and integration in testing practices; a lack of professionals with Agile Testing expertise is among the top-three challenges Mobile testing is maturing, being adopted by 92% of the organizations and consuming 35% of the QA&Testing Budgets for new projects Testing Centers of Excellence are widely adopted and are turning into more agile and hybridized forms Test environments are being enhanced with virtualization and cloud solutions ISTQB 2015 33
ISTQB Planned evolution ISTQB has defined an evolution of its product portfolio architecture and contents in order to: Maintain the mission and vision of ISTQB and keep the high quality of deliverables that has marked the success of the scheme worldwide Make the scheme more modular Make it easier for professionals to obtain the certification they are interested in Provide an overall framework in which all future potential modules may fit in a way which is coherent and understandable to our stakeholders Maintain the validity of certifications already obtained ISTQB 2015 34
The customer perspective Some people like to follow a breadth-first generalist approach (going from Foundation to the classic Advanced) Whereas others prefer to follow a depth-first approach (going from Foundation to Specialist) We have so many different professionals interested in our programme that we cannot think we can propose a one size fits all approach Indeed, it is exactly the goal of a modular approach to allow people to design their own training/ certification path and allow them to broaden their knowledge base ISTQB 2015 35
Evolution Axes The review of the product architecture and product portfolio embraces three aspects 1. The overall framework in which the various certification modules have to fit 2. The modules that populate the framework: fitting the current modules (the existing ones and those under development) and identifying/ positioning the potential new ones 3. The preconditions/ pre-requisites/ entry criteria ISTQB 2015 36
Overall Framework/ architecture Levels and categories The new ISTQB Portfolio is a Matrix characterized by: Levels (FL, AL, EL): they identify progressively increasing LOs Categories: they identify differing target groups of certification modules: Core: they cover a topic in a broad, horizontal way, valid for any technology/ methodology/ application domain Allowing for a common understanding Specialist: they cover a specific topic/ domain in a vertical way, using a drill down / deep-dive approach Agile It deserves an its own Stream ISTQB 2015 37
Identifying future modules that could fit into the Framework Potential Specialist Specialist modules may include Software Quality Characteristics Usability Security Performance Specific activities Test Automation Advanced Agile Mobile Testing User Acceptance Testing.. Domain Specific modules Automotive tester Pharma/ TechMed Tester.. ISTQB 2015 38
ISTQB Product Portfolio CORE AGILE SPECIALIST C T E L Improving the Test Process Test Management C T A L C T F L Test Manager Test Analyst Technical Test Analyst FOUNDATION Organizational Technical AGILE Tester Foundation In DEV In DEV Automotive Tester Security Tester Test Automation Engineer Model-Based Tester Usability Tester ISTQB 2015 39 In DEV In DEV NEW 2015 Q4 In DEV In DEV
ISTQB CONTACTS AND CHANNELS YouTube : http://www.youtube.com/user/istqborg Slide Share : http://www.slideshare.net/istqborg LinkedIn Twitter XING Facebook : http://www.linkedin.com/groups/istqb-international-software-testing-qualifications-99444 : http://twitter.com/istqborg : https://www.xing.com/net/istqb : http://www.facebook.com/istqborg ISTQB Smart Show