testing standards and processes Nokia Solutions and Networks 2014 <Change information classification in footer>

Transcription

1 testing standards and processes

2 Agenda Purpose of Standards Motivation behind standard creation The Development of standards ISO/IEC/IEEE 29119

3 Pictures from:

4 What is a Standard? Guideline documentation that reflects agreements on products, practices, or operations by nationally or internationally recognised industrial, professional, trade associations or governmental bodies -ISO Guidelines documents because they are not compulsory unless mandated by an individual or an organization Agreements because commonly they reflect consensus on the part of a group

5 Standards Standards provide a body of knowledge that includes the basis for a professional discipline Standards are basis for: - Communication - common terms are used - Professional qualifications - Certification/compliance schemes - Benchmark of good industry practice - Contracts - Interoperability and consistency

6 Quality Good Practice Best Practice Current Practice

7 Professional Standards National Standards Industry Standards Market Standards Organizational Standards

8 ISO/IEC/IEEE ISO/IEC/IEEE Software Testing is an internationally agreed set of standards for software testing that can be used within any software development life cycle or organization. By implementing these standards, organizations will be adopting the only internationally-recognised and agreed standards for software testing, which will provide organizations with a high-quality approach to testing that can be communicated throughout the world. There are currently five standards.

9 The 5 Standards ISO/IEC : Concepts & Definitions (published September 2013) ISO/IEC : Test Processes (published September 2013) ISO/IEC : Test Documentation (published September 2013) ISO/IEC : Test Techniques (at DIS stage, anticipating publication in late 2014) ISO/IEC : Keyword Driven Testing (at CD stage, anticipating publication in 2015)

10 The ISO/IEC/IEEE standards replace a number of existing software testing standards: IEEE 829 Test Documentation IEEE 1008 Unit Testing BS Vocabulary of Terms in Software Testing BS Software Component Testing Standard

11 ISO/IEC/IEEE (Part 1) The aim of ISO/IEC/IEEE is to facilitate understanding and use of all other standars in the series. ISO/IEC/IEEE introduces the vocabulary on which all standards in the series are built and provides examples of the application of each concept in practice. Part 1 is informative and provides definitions, a description of the concepts of software testing and ways to apply the processes, documents and techniques defined in the series.

12 Part 1: Concepts and Vocabulary Software Testing Concepts Introduction to software testing Relationship between testing, development and maintenance Implication of lifecycle models Approaches to testing Testing vocabulary

13

14 ISO/IEC/IEEE (Part 2) The aim of ISO/IEC/IEEE is to define a generic process model for software testing that can be used within any software development life cycle. The model specifies test processes that can be used to govern, manage and implement software testing in any organisation, project or testing activity. The testing process is based on a threelayer process model that covers: - Organizational Test Specifications (e.g. Organizational Test Policy, Organizational Test Strategy) - Test Management - Dynamic Testing

15

16 Detailed View

17 Test Management Process

18 Test Planning Process

19 Test Monitoring and Control Process

20 Dynamic Test Process

21 ISO/IEC/IEEE (Part 3) The aim of ISO/IEC/IEEE is to define templates for test documentation that cover the entire software testing life cycle. Each template can be tailored to suit the unique needs of each organization implementing the standard, to support the standard's implementation within any software development life cycle model. All templates align with the test process defined in ISO/IEC/IEEE and can be produced by applying the processes that are defined in that standard.

22 ISO/IEC/IEEE (Part 4) The aim of ISO/IEC/IEEE Test Techniques is to define one international standard covering software test design techniques (also known as test case design techniques or test methods) that can be used during the test design and implementation process within any organisation or software development life cycle model. The test design techniques that are presented in this standard can be used to derive test cases that can be used to collect evidence that the requirements of each system under test have been met and/or that detects are present.

23 ISO/IEC/IEEE (Part 5) The aim of ISO/IEC/IEEE is to define an international standard for supporting Keyword- Driven Testing. Keyword-Driven Testing is a way of describing test cases by using a predefined set of Keywords. These Keywords are names which are associated with a set of actions that are required to perform a specific step in a test case. By using keywords to describe test steps instead of natural language, test cases can be easier to understand, to maintain and to automate.