An international Consensus on the Software Engineering Body of Knowledge

Transcription

1 An international Consensus on the Engineering Body of Knowledge Alain Abran P. Bourque, R. Dupuis, J. W. Moore, L. Tripp IWSS 2004 Istanbul, Turkey September 6, 2004 ÉTS 1

2 Presentation Objectives Give an overview of this international consensus on the core body of knowledge of software engineering Briefly present the development process used to reach this consensus Briefly present usages of SWEBOK Guide Next steps Including links to System Engineering 2

3 Presentation Plan Project background Project development process Contents of the Guide Usages of the Guide in organizations Next steps 3

4 Guide to the Engineering Body of Knowledge (SWEBOK ) Project initiated by the IEEE CS International participation from industry, professional societies, standards bodies, academia, authors Over 500 hundred software engineering professionals have been involved Release of Ironman Version in 2004 Registered in U.S. Patent Office 4

5 Corporate Support by: Project managed by: 5

6 2004 SWEBOK Guide Endorsed by the project s Industrial Advisory Board Approved by the IEEE Computer Society Board of Governors Adopted as ISO Technical Report Available on To be published in book format by the IEEE Computer Society Press 6

7 SWEBOK Guide = 10 Knowledge Areas Mapped TO ISO/IEC 12207:1995 processes Design Construction Testing Maintenance Configuration Management Engineering Management Engineering Process Engineering Tools and Methods Quality Primary Processes Supporting Processes 7

8 What is Engineering? IEEE : (1) The application of a systematic, disciplined, quantifiable approach to the development, operation, and maintenance of software; that is, the application of engineering to software. (2) The study of approaches as in (1). 8

9 Recognized Profession? Starr*: Knowledge and competence validated by the community of peers Consensually validated knowledge rests on rational, scientific grounds Judgment and advice oriented toward a set of substantive values * P. Starr, The Social Transformation of American Medicine: BasicBooks,

10 Development of a Profession Initial professional education Accreditation Skills Development One or both Certification Licensing Full Professional Status Professional development Code of ethics Professional societies Adapted from Steve McConnell, After the Gold Rush, Microsoft Press, 1999, p

11 Presentation Plan Project background Project development process Contents of the Guide Applications of the Guide in organizations Next steps 11

12 Project Objectives Characterize the contents of the Engineering Body of Knowledge Provide a topical access to the Engineering Body of Knowledge Promote a consistent view of software engineering worldwide 12

13 Project Objectives Clarify the place of, and set the boundary of, software engineering with respect to other disciplines (computer science, project management, computer engineering, mathematics, etc.) Provide a foundation for curriculum development and individual certification and licensing material 13

14 Intended Audience Public and private organizations Practicing software engineers Makers of public policy Professional societies engineering students Educators and trainers 14

15 What was out of scope? Not a curriculum development effort Not an all-inclusive description of the sum of knowledge in the field Not all categories of knowledge 15

16 Categories of Knowledge in the SWEBOK Specialized Generally Accepted Advanced and Research Target of the SWEBOK Guide «Applicable to most projects, most of the time, and widespread consensus about their value and usefulness» Project Management Institute - PMI North American Bachelor s degree + 4 years of experience 16

17 C.S. Application domain knowledge Specialized SE Knowledge Advanced SE Knowledge Guide to the SWEBOK Stoneman Knowledge of a Engineer Maths... 17

18 Three Underlying Principles of the Project Transparency: the development process is itself published and fully documented Consensus-building: the development process was designed to build, over time, consensus in industry, among professional societies and standards-setting bodies and in academia Available free on the web 18

19 Project Team Editorial Team of the Guide Industrial Advisory Board Associate Editors of the Knowledge Areas Reviewers 19

20 Roles of the Industrial Advisory Board Provide input to ensure relevance to various audiences Review and approve strategy and deliverables Oversee development process Assist in promoting the Guide to the Engineering Body of Knowledge Lend credibility to the project 20

21 A Three-Phase Approach for Developing the Guide Straw Man Phase Stone Man Phase Experimentation and Trial Usage Iron Man Phase (Sub-phase 1) Revision Iron Man Phase (Subphase 2) Trial Version Version 21

22 Version Review Process Transparency and consensus-building All intermediate versions of documents published and archived on All comments made public as well as the identity of the reviewers Detailed comment disposition reports 22

23 Version 0,1: 33 Data on reviewers Trial Version Version 0,5: 195 Version 0,7: ISO reviews from 5 countries 23

24 Reviewers (2004 Version) Registered reviewers: 573 Number of countries: 55 Number of comments: 1020 Number of reviewers submitting comments: 124 Number of represented countries: countries submitted comments through ISO voting process Adopted by + 25 ISO participating countries Number of Reviewers Number of Reviewers Years in the field years years years years years Years in industry years years years years 24

25 Project Overview Presentation Plan Project background Project development process Contents of the Guide Applications of the Guide Next steps 25

26 Deliverables: Consensus on a list of Knowledge Areas Consensus on a list of topics and relevant reference materials for each Knowledge Area Consensus on a list of Related Disciplines 26

27 Knowledge Areas and Related Disciplines Design Construction Testing Maintenance Configuration Management Eng. Management Eng. Tools & Methods Engineering Process Quality Related Disciplines Computer Engineering Computer Science Mathematics Project Management Management Quality Management Ergonomics Systems Engineering 27

28 Knowledge Area Description Classification of Topics Matrix of Topics & References References Topic Descriptions Classification by Vincenti s Taxonomy Classification by Bloom s Taxonomy Not implemented in Trial Version References to Related Disciplines 28

29 Guide to the Engineering Body of Knowledge 2004 Version Design Construction Testing Maintenance Fundamentals Design Fundamentals Basic Concepts of Construction Sofware Testing Fundamentals Maintenance Fundamentals Process Key Issues in Design Managing Construction Test Levels Key Issues in Maintenance Elicitation Structure and Architecture Practical Considerations Test Techniques Maintenance Process Analysis Design Quality Analysis and Evaluation Test Related Measures Techniques for Maintenance Specification Design Notations Test Process Validation Design Strategies and Methods Practical Considerations 29

30 Guide to the Engineering Body of Knowledge (2004 Version) Configuration Management Engineering Management Engineering Process Engineering Tools and Methods Quality Related Disciplines Configuration Management Fundamentals Keys Issues in SCM Configuration Control Configuration Status Accounting Initiation and Scope Definition Project Planning Project Enactment Review and Evaluation Process Implementation and Change Process Definition Process Assessment Process and Product Measurement Tools Tools Design Tools Construction Tools Testing Tools Maintenance Tools Engineering Process Tools Quality Tools Configuration Management Tools Quality Fundamentals Quality Management Processes Practical Considerations Computer Engineering Computer Science Management Mathematics Project management Configuration Auditing Release Management and Delivery Closure SW Engineering Measurement Engineering Management Tools Infrastructure Support Tools Miscellaneous Tool Issues Methods Heuristic Methods Quality management Ergonomics Systems engineering Formal Methods Prototyping Methods Miscellaneous Method Issues 30

31 Fundamentals Process Elicitation Analysis Specification Validation Practical Consideration Definition of Requirement Process Models Sources Classification System Definition Document Reviews Iterative Nature of Process Product and Process Process Actors Elicitation Techniques Conceptual Modeling Systems Specification Prototyping Change Management Functional and Non-functional Process Support and Management Architectural Design and Allocation Specification Model Validation Attributes Emergent Properties Process Quality and Improvement Negotiation Acceptance Tests Tracing Quantifiable Measuring System and 31

32 Quality Quality Fundamentals Quality Management Processes Practical Considerations Engineering Culture and Ethics Quality Assurance Application Quality Value and Costs of Quality Verification and Validation Defect Characterization Models and Quality Characteristics Reviews and Audits Quality Management Techniques Quality Improvement Quality Measurement 32

33 Summary of changes in 2004 Version Structural improvements in breakdown of topics: Construction, Management, Quality, Process Better representation of text in topic breakdown :, Testing, Maintenance Standardization of the contents of the chapters: topic breakdown, terminology, reference citations and writing style 33

34 Summary of changes in 2004 Version Better representation of standards in chapters and a new Appendix devoted to standards Updating of reference material Handling of trial usage feedback Handling of reviewers comments New chapter on Related Disciplines (instead of an appendix) 34

35 Presentation Plan Project background Project development process Contents of the Guide Applications of the Guide in organizations Next steps 35

36 Applications of the Guide Licensing & Certification IEEE CS CSDP exam and program Input in accreditation of software engineering programs in engineering faculties - CCPE Ordre des ingénieurs du Québec: Input to certify software engineers 36

37 Example Usages in Education Program Design/Assessment: National Technological University Monash University CRISTEL project Course Design/Assessment: A large number of universities École de technologie supérieure 37

38 Applications of the Guide Industry & Government Job description Bombardier Transportation Career planning Construx Input to Policy making Turkish Industry Survey 38

39 Applications of the Guide Professional development Security Industry Automation Corporation Construx Dissiminations of standards Introducing standards in software engineering curriculum 39

40 Presentation Plan Project background Project development process Contents of the Guide Usages of the Guide in organizations Next steps 40

41 Next steps: Specialized Generally Accepted Advanced and Research Target of the SWEBOK Guide «Applicable to most projects, most of the time, and widespread consensus about their value and usefulness» Project Management Institute - PMI North American Bachelor s degree + 4 years of experience 41

42 Evolution process for the Guide Copyright belongs to the IEEE Transition to self-supporting, volunteer-led process i.e. self-funded. Coordination with related IEEE-CS projects (internal and external) Time-boxed block updates Involvement with stakeholder groups Openness and transparency Technical excellence 42

43 Next Steps Research to strengthen the foundations of a body of knowledge: Vincenti s classification of engineering knowledge Fundamental design principles Criteria and specifications Theoretical tools Quantitative data Practical considerations Design instrumentalities Ontology of software engineering 43

44 Next Steps Being investigated at ISO level: Certification of software engineers ISO standard on content of certification ISO recognized certifying bodies International portability of certification of software engineers 44

45 Consensus on the core body of Next steps knowledge is key in all disciplines and pivotal for the evolution toward a professional status INCOSE Building a System Engineering Body of Knowledge - SEBOK 45

46 46

47 Presentation Plan Project background Project development process Contents of the Guide Usages of the Guide in organizations Next steps Appendix: Breakdown of topics 47

48 Guide to the Engineering Body of Knowledge 2004 Version Design Construction Testing Maintenance Fundamentals Design Fundamentals Basic Concepts of Construction Sofware Testing Fundamentals Maintenance Fundamentals Process Key Issues in Design Managing Construction Test Levels Key Issues in Maintenance Elicitation Structure and Architecture Practical Considerations Test Techniques Maintenance Process Analysis Design Quality Analysis and Evaluation Test Related Measures Techniques for Maintenance Specification Design Notations Test Process Validation Design Strategies and Methods Practical Considerations 48

49 Guide to the Engineering Body of Knowledge (2004 Version) Configuration Management Engineering Management Engineering Process Engineering Tools and Methods Quality Related Disciplines Configuration Management Fundamentals Keys Issues in SCM Configuration Control Configuration Status Accounting Initiation and Scope Definition Project Planning Project Enactment Review and Evaluation Process Implementation and Change Process Definition Process Assessment Process and Product Measurement Tools Tools Design Tools Construction Tools Testing Tools Maintenance Tools Engineering Process Tools Quality Tools Configuration Management Tools Quality Fundamentals Quality Management Processes Practical Considerations Computer Engineering Computer Science Management Mathematics Project management Configuration Auditing Release Management and Delivery Closure SW Engineering Measurement Engineering Management Tools Infrastructure Support Tools Miscellaneous Tool Issues Methods Heuristic Methods Quality management Ergonomics Systems engineering Formal Methods Prototyping Methods Miscellaneous Method Issues 49

50 Fundamentals Process Elicitation Analysis Specification Validation Practical Consideration Definition of Requirement Process Models Sources Classification System Definition Document Reviews Iterative Nature of Process Product and Process Process Actors Elicitation Techniques Conceptual Modeling Systems Specification Prototyping Change Management Functional and Non-functional Process Support and Management Architectural Design and Allocation Specification Model Validation Attributes Emergent Properties Process Quality and Improvement Negotiation Acceptance Tests Tracing Quantifiable Measuring System and 50

51 Design 1. Design Fundamentals 2. Key Issues in Design 3. Structure and Architecture 4. Design Quality Analysis and Evaluation 5. Design Notations 6. Design Strategies and Methods General design concepts The context of software design The software design process Enabling techniques Concurrency Control and handling of events Distribution of components Error and exception handline and fault tolerance Interaction and presentation Architectural structures and viewpoints Architectural styles (macroarchitectural patterns) Design patterns (microarchitectural patterns) Families of programs and frameworks Quality attributes Quality analysis and evaluation techniques Measures Structural descriptions (static view) Behavior descriptions (dynamic view) General Strategies Function-oriented (structured) design Object-oriented design Data-structrure centered design Component-based design (CBD) Data persistence Other methods Figure 1 Breakdown of topics for the Design KA 51

52 Construction Basic Concepts of Construction Reduction of Complexity Anticipation of Change Constructing for Validation Role of Standards in Construction Construction Languages Managing Construction Construction Methods Construction Planning Construction Measurement Practical Considerations Construction design Coding Construction Testing Construction Quality Integration Construction Tools Figure 1. Breakdown of topics for the Construction KA. 52

53 Testing 1. Testing Fundamentals 2. Test Levels 3. Test Techniques 4. Test Related Measures 5. Test Process Testing-Related Terminology Keys Issues The Target of the Test Objectives of Testing Based on tester's intuition and experience Specificationbased Evaluation of the Program Under Test Evaluation of the Tests Performed Management Concerns Test Activities Relationships of Testing to Other Activities Code-based Fault-based Usage-based Based on nature of application Selecting and Combining Techniques 53

54 Maintenance Fundamentals Key Issues in Maintenance Maintenance Process Techniques for Maintenance Definitions and Terminology Technical Maintenance Process Models Program Comprehension Nature of Maintenance Management Maintenance Activities Re-engineering Need for Maintenance Maintenance Cost and Maintenance Cost Estimation Reverse Engineering Majority of Maintenance Costs Maintenance Measurement Impact Analysis Evolution of Soffware Categories of Maintenance 54

55 Configuration Management 1. Configuration Management Fundamentals 2. Keys Issues in SCM 3. Configuration Control 4. Configuration Status Accounting 5. Configuration Auditing 6. Release Management and Delivery Identifying Items to be Controlled Configuration Configuration Items Configuration Item Relationships Versions Baseline Acquiring Configuration Items Library Organizational Context for SCM Constraints and Guidance for SCM Planning for SCM SCM Organization and Responsibilities SCM Resources and Schedules Tool Selection and Implementation Vendor/ Subcontractor Control Interface Control Configuration Management Plan Requesting, Evaluating and Approving Changes Configuration Control Board Change Request Process Implementing Changes Deviations and Waivers Configuration Status Information Configuration Status Reporting Functional Configuration Audit Physical Configuration Audit In-Process Audits of a Baseline Building Release Management Surveillance of Configuration Management SCM Measures and Measurement In-Process Audits of SCM 55

56 Engineering Management Initiation and Scope Definition Project Planning Project Enactment Review and Evaluation Closure SW Engineering Measurement Determination and Negotiation of Process Planning Implementation of Plans Determining Satisfaction of Determining Closure Establish and Sustain Measurement Commitment Feasibility Analysis Determine Deliverables Supplier Contract Management Reviewing and Evaluating Performance Closure Activities Plan the Measurement Process Process for Review/Revision Effort, Schedule and Cost Estimation Implementation of Measurement Process Perform the Measurement Process Resource Allocation Monitor Process Evaluate Measurement Risk Management Control Process Quality Management Reporting Plan Management 56

57 S oftware Engineering Process Process Implementation and Change Process Definition Process Assessment Process and Product Measurements Process Infrastructure Life Cycle Models Process Assessment Models Process Measurement Activities Life Cycle Processes Process Assessment Methods Products Measurement Models for Process Implementation and Change Notations for Process Definitions Quality of Measurement Results Practical Considerations Process Adaptation Information Models Automation Process Measurement Techniques 57

58 Engineering Tools and Methods I. Tools II. Methods Engineering Tools and Methods Tools modeling Traceability Design Tools Construction Tools Program editors Compilers Interpreters Debuggers Testing Tools Test generators Test execution frameworks Test evaluation Test management Performance analysis Maintenance Tools Comprehension Re-engineering Engineering Process Tools Process modeling Process management Integrated CASE environments Process-centered software engineering environments Quality Tools Inspection Static analysis Configuration Management Tools Defect, enhancement, issue and problem tracking Version managment Release and build Engineering Management Tools Project planning and tracking Risk management Measurement Infrastructure Support Tools Interpersonal communication Information retrieval System administrative and support Miscellaneous Tools Issues Tool integration techniques Meta tools Tool evaluation Heuristic Methods Structured methods Data-oriented methods Object-oriented methods Domain specific methods Formal Methods Specification languages Refinement Verification Prototyping Methods Styles Prototyping target Evaluation techniques Miscellaneous Method Issues Method evaluation 58

59 List of Knowledge Areas Design Construction Testing Maintenance Configuration Management Quality Engineering Tools & Methods Engineering Process Engineering Management 59

60 Formal resolutions Industrial Advisory Board (2001) IEEE CS Board of Governors (2001) "The Board of Governors of the IEEE Computer Society accepts the Guide to the Engineering Body of Knowledge (Trial Version) as fulfilling its development requirements and is ready for field trials for a period of two years IEEE CS Board of Governors (Feb. 2004) Officially approved the 2004 Version ISO Technical Report (upcoming) 60

61 Trial Version Review Process Version 0.1 Limited number of domain experts Review Cycle 1 Version 0.5 Selected users Review cycle 2 Version 0.7 Community Review Cycle 3 Version

62 Trial Version (2001) 62

63 63

64 Comment Resolution 64

65 Geographic Distribution of Reviewers Trial Version USA: 55% Europe: 18% 90 reviewers from 25 countries Canada: 10% Australia: 5% Asia: 5% Latin America: 4% 65

66 Education level of reviewers (Version 0,7) 24% 3% 34% Ph.D. Masters Bach 39% Other 66

67 Number of employees at reviewer location (Version 0,7) 31% 32% 37% Over

68 Number of years of practical experience (Version 0,7) 21% 9% 32% 38%