ISTBQ Yesterday, Today, Tomorrow. HUSTEF 2015, Budapest, November 2015 G. Bazzana ISTQB President

Transcription

1 ISTBQ Yesterday, Today, Tomorrow HUSTEF 2015, Budapest, November 2015 G. Bazzana ISTQB President

2 ISTQB Yesterday ISTQB

3 WHAT IS THE ISTQB? ISTQB : International Software Testing Qualifications Board ( Non-profit association Founded in 2002 Headquartered in Belgium Has its own constitution, rules and regulations Composed of volunteer international Testing Experts Responsible for the ISTQB Certified Tester scheme worldwide ISTQB is the world s leading organization for Software Testing Certification Advancing the software testing profession ISTQB

4 ISTQB VISION To continually improve and advance the software testing profession by: Defining and maintaining a Body of Knowledge which allows testers to be certified based on best practices, connecting the international software testing community, and encouraging research. ISTQB

5 ISTQB VALUE CHAIN Working Groups: Member Boards: Training Providers: Exam Providers: ISTQB Partners: ISTQB

6 ISTQB ECO-SYSTEM ISTQB

7 ISTQB WORKING GROUPS (WGs) ISTQB

8 ISTQB VIDEOS ISTQB Videos give you insights into the ISTQB Certified Tester scheme ISTQB

9 ISTQB LEVELS AND SYLLABI ISTQB

10 Market trends current situation In accordance to Technavio Report «Global Software Testing Service Market» Outsourced Software Testing Services segment has a value of over 16B$ It is growing at a CAGR of 10% in 2014 and ,7 15,15 13,78 12,58 11,5 10,25% 9,90% 9,60% 9,35% 9,11% Market Value (US$) Growth Rate 11,50% 11,00% 10,50% 10,00% 9,50% 9,00% 8,50% 8,00% ISTQB

11 World Quality Report Findings ISTQB

12 ISTQB Today ISTQB

13 Drivers COST QUALITY RISK AGILITY Competition Tightening margins Increasing dependency of business from SW Multiple platforms SW Intensive systems Knowledge retention Quicker time to market Consumption based pricing ISTQB

14 APPLICABLE MARKETS Telco IT Engineering ISTQB

15 Figures as of 2015Q2 Executive Summary More than exams world wide! Close to Trend YOY is OK Wrt FL+AL+EL + 8,5% Adding-up Agile + 14,5% certificates world wide! In 2015Q2, exams and certificates ISTQB

16 Figures as of 2015Q2 Executive Summary (2) Agile uptake VERY Good: - Almost 2000 exams certificates - By 33 Boards - Forecast for 2015: over 4000 exams Certificates issued in 108 countries ISTQB

17 BENEFITS FOR PROFESSIONALS International recognition of acquired competencies and skills Authorized to use the Certified Tester logo (specifying the level of certification) Whole of career path support, from Foundation to Expert level Higher appeal in the labor market ISTQB

18 BENEFITS FOR COMPANIES ISTQB certification can provide a competitive advantage for companies, promising a higher level of reliability of the applications being developed due to efficient and cost effective testing practices derived from the ISTQB competencies Consulting companies with certified staff can offer higher-level services to customers, increasing revenues and brand value ISTQB has defined a Partner Program for companies that engage a large number of certified testers ISTQB

19 BENEFITS FOR ATPs (Accredited Training Providers) Educational institutions and consulting companies may become an ISTQB Accredited Trainer Provider (ATP) according to processes and rules defined at the international level Accredited Training Providers ensure a high standing of training is delivered through having: certified trainers the content, quality and syllabus coverage of training materials checked by ISTQB Boards advance notice of changes to the ISTQB Glossary and syllabi Accredited Training Providers are entitled to use relevant logos and are listed in the ISTQB Website ISTQB

20 EXAM RELIABILITY - SURVEY To what extent do you feel the ISTQB Foundation Level certification exam reflects the knowledge of the candidates? 70% 60% 50% 40% 30% Test Engineers Test Managers 20% 10% 0% Exceedingly well Well Partially well Not very well More than 70% of respondents regard the ISTQB Foundation Level certification exam as fully or exceedingly reliable and these results are consistent throughout the world; only 6% found the exam not very reliable ISTQB

21 BENEFITS FOR PROFESSIONALS ISTQB SURVEY Would you recommend the ISTQB Foundation Level (CTFL) certification to your colleagues? ISTQB

22 EUROSTAR 2014 SURVEY SW TESTING CERTIFICATION VALUE Report: Practices & Attitudes in Software Testing (PAST) Study EUROSTAR Sw Testing Report 2014 Based on 630 respondents (85% CTFL and 26% also CTAL) ISTQB

23 INCREASING PRODUCTIVITY OF SW PROJECTS CERTIFICATION OF TESTERS CAN HELP! Data collected and analysed by Capers Jones from 1984 through 2015 From About 725 companies (150 clients in Fortune 500) and 40 government/military groups for 25,000 total projects in 27 countries Factor Experienced test teams Testing by certified test personnel Testing by developers only Informal test case design Inexperienced test teams Truncating testing to "meet schedule" Impact on productivity 12% Improvement 7% Improvement 6% Worsening 8% Worsening 15% Worsening 45% Worsening (Capers Jones, Scoring and evaluating software methods, practices, and results, version 15.0, September 6, 2014) ISTQB

24 ISTQB survey on Worldwide Software Testing Practices 2015 to be published soon This report has been produced by the ISTQB MWG Marketing Working Group as a result of a survey, characterized by the following quantitative data: - Period: 26 Feb - 22 May Data collection method: Webbased at - Target: Open to anybody - Number of respondents: Number of countries represented: 89 - End user companies: 52% wrt 48% of IT companies Europe 36% Oceania 1% Asia 31% North America 22% South America 9% Africa 1% ISTQB

25 What percentage of a typical IT/ R&D project budget is allocated to software testing? 45,0% 40,0% 35,0% 30,0% 25,0% 20,0% 15,0% 10,0% 5,0% 0,0% 0% - 10% 11% - 25% 26% - 40% More than 40% The large majority of respondents indicate budgets between 11% and 40%. This is in line with the World Quality Report that indicates an average expenditure of 26% ISTQB

26 What is your expectation for your organization's software testing budget in the next 12 months? 35,0% 30,0% 25,0% 20,0% 15,0% 10,0% 5,0% 0,0% Average = 14% Decrease Stable Growth 9,8% 31% 59,2% About 60% of the respondents expect an increase of the budgets allocated to testing; this confirms the growing trend exhibited in the World Quality Report , that is forecasting that by 2017 the IT budget allocated to QA & testing will rise to 29%. Average expected growth is 14% that is much pretty in line with the forecasted CAGR of the Global Testing Market in in the Technavio Report ( ISTQB

27 Who is responsible for software testing in your company? 90,0% 80,0% 70,0% 60,0% 50,0% 40,0% 30,0% 20,0% 10,0% 0,0% Near-shore test team Off-shore test team Distributed test team In-sourced test team End Users Developers In-house test team In close to 80% of the cases, the responsibility of SW testing is assigned to an inhouse test teams; this confirms the increasing adoption of segregation of duties, that is one of the key factors for the effectiveness of testing activities ISTQB

28 To whom do the test team report? Other 15% To Operation 51% To Business 18% To Development 16% Wide adoption of segregation of duties is confirmed by the fact that in most cases (84%) the test team does not report to Development ISTQB

29 Which Software Development Lifecycle (SDLC) model are you using? Agile (Scrum, Extreme programming, Sequential (Waterfall, V-model) Iterative (RUP, Spiral) Other 0,0% 50,0% 100,0% Agile based SDLCs are being adopted ahead of traditional ones (Waterfall or V- Model) Agile methodologies are significantly increasing in popularity; this underlines the need to have appropriate testing processes and techniques also for Agile, combined with certification of testing competences ISTQB has recently launched a specific certification module for Agile Tester with a remarkable positive reply by the market, and in the near future will further extend the certifications on Agile testing at Advanced level ISTQB

30 How many test cases do you automate? From 41% to 50% 8% More than 50% 17% From 21% - to 40% 15% No automation 28% Less then 20% 32% Test automation has become very widespread in the market, with 72% adoption in 40% of the cases the percentage of automated test cases is well beyond 20% ISTQB

31 ISTQB Tomorrow ISTQB

32 Market trends the future The trend is predicted to accelerate over the period Global Software Testing Service Market CAGR 11.15% - Global Software Testing System Integrator Market CAGR 21.53% ISTQB

33 HIGHLIGHTS FROM THE 2015 WORLD SW QUALITY REPORT Budgets dedicated to QA&Testing are growing at warp speed, with a growth pace much higher than anticipated, reaching in average 35% of the IT budgets Test automation is increasing, jumping in one year from 28% to 45% of test cases Digital transformation is putting more and more emphasis on customer value and end-user experience as targets for testing Security is the most pressing concern Agile and DevOps adoption has become widespread and call for extreme level of speed and integration in testing practices; a lack of professionals with Agile Testing expertise is among the top-three challenges Mobile testing is maturing, being adopted by 92% of the organizations and consuming 35% of the QA&Testing Budgets for new projects Testing Centers of Excellence are widely adopted and are turning into more agile and hybridized forms Test environments are being enhanced with virtualization and cloud solutions ISTQB

34 ISTQB Planned evolution ISTQB has defined an evolution of its product portfolio architecture and contents in order to: Maintain the mission and vision of ISTQB and keep the high quality of deliverables that has marked the success of the scheme worldwide Make the scheme more modular Make it easier for professionals to obtain the certification they are interested in Provide an overall framework in which all future potential modules may fit in a way which is coherent and understandable to our stakeholders Maintain the validity of certifications already obtained ISTQB

35 The customer perspective Some people like to follow a breadth-first generalist approach (going from Foundation to the classic Advanced) Whereas others prefer to follow a depth-first approach (going from Foundation to Specialist) We have so many different professionals interested in our programme that we cannot think we can propose a one size fits all approach Indeed, it is exactly the goal of a modular approach to allow people to design their own training/ certification path and allow them to broaden their knowledge base ISTQB

36 Evolution Axes The review of the product architecture and product portfolio embraces three aspects 1. The overall framework in which the various certification modules have to fit 2. The modules that populate the framework: fitting the current modules (the existing ones and those under development) and identifying/ positioning the potential new ones 3. The preconditions/ pre-requisites/ entry criteria ISTQB

37 Overall Framework/ architecture Levels and categories The new ISTQB Portfolio is a Matrix characterized by: Levels (FL, AL, EL): they identify progressively increasing LOs Categories: they identify differing target groups of certification modules: Core: they cover a topic in a broad, horizontal way, valid for any technology/ methodology/ application domain Allowing for a common understanding Specialist: they cover a specific topic/ domain in a vertical way, using a drill down / deep-dive approach Agile It deserves an its own Stream ISTQB

38 Identifying future modules that could fit into the Framework Potential Specialist Specialist modules may include Software Quality Characteristics Usability Security Performance Specific activities Test Automation Advanced Agile Mobile Testing User Acceptance Testing.. Domain Specific modules Automotive tester Pharma/ TechMed Tester.. ISTQB

39 ISTQB Product Portfolio CORE AGILE SPECIALIST C T E L Improving the Test Process Test Management C T A L C T F L Test Manager Test Analyst Technical Test Analyst FOUNDATION Organizational Technical AGILE Tester Foundation In DEV In DEV Automotive Tester Security Tester Test Automation Engineer Model-Based Tester Usability Tester ISTQB In DEV In DEV NEW 2015 Q4 In DEV In DEV

40 ISTQB CONTACTS AND CHANNELS YouTube : Slide Share : LinkedIn Twitter XING Facebook : : : : ISTQB Smart Show