Advanced Validation Strategies for On-Board Satellite Software in the Galileo IOV Programme

Transcription

1 Olivier Croatto, Michael Uemminghaus Garching, Oct. 7th, 2008 Advanced Validation Strategies for On-Board Satellite Software in the Galileo IOV Programme Astrium Proprietary Information

2 Agenda 1 - Overview of the Galileo Program 2 - Applied Development and Validation Processes 3 - V & V Objectives and Test Strategies 4 - Experiences with Integration Tests and Validation Tests 5 - Questions Page 2 Astrium Proprietary Information

3 Overview of the Galileo Program Page 3 Astrium Proprietary Information

4 Overview of the Galileo Program GSTB (Galileo In Orbit Validation Elements) program ESNI contract signed in July 2003 for 2 satellites to be produced GIOVE-A (SSTL sub-contractor) and GIOVE-B (Astrium subcontractor) GIOVE-A launched 28 December 2005 GIOVE-B launched 27 April 2008 ESA contract signed in march 2007 GIOVE-A2 (SSTL subcontractor) to be launched mid 2009 IOV (In Orbit Validation) program ESA contract signed in 21 January 2006 First 4 satellites of the Galileo navigation system provided by ASTRIUM Associated ground systems to be produced FOC (Full Orbit Constellation) program Bids on-going to deliver the full operational constellation consisting of 24 satellites for Page 4 Astrium Proprietary Information

5 Equipment driven by Avionics Software Integrated Control and Data Unit Page 5 Astrium Proprietary Information

6 Avionics Software Components System AOCS Platform Payload DMS Application Layer IO Services Custom Custom operation support services Core DHS (PUS services) data exchange & storage Core DHS (packet busses ) Data Handling Service Layer BIOS (1) Core DHS (infrastructure) RTOS: RTEMS Product Low level Layer (1) Boot SW excluded (is a separate Software) Astrium Products Project / Mission dependent software HW / OBC dependent software Page 6 Astrium Proprietary Information

7 Avionics Software Life Cycle S/C PDR PHASE C/D S/C CDR S/C FAR V1 SW-SRR V1 SW-CDR V2 SW-CDR V3 SW-CDR SW-QR SW-AR V1 SRR V1 SW-PDR V1 development V1 SW-CDR V2 SW-SRR V2 SW-PDR V2 development V2 SW-CDR V3 SW-SRR V3 SW-PDR V3 development V3 SW-CDR Warranty V1 V2 V3 Avionics Test Bench activities System / software co-engineering SW development and validation Subcontractor selection Subcontractor training Subcontractor activity SW Maintenance preparation SW Maintenance Page 7 Astrium Proprietary Information

8 Applied Development and Validation Processes Page 8 Astrium Proprietary Information

9 Applied Development and Validation Processes During Project start, Generic processes were instantiated Supporting tools from the Astrium Onboard Processes Asset Library (OPAL) are used, certified on CMMI Level 3 quality maturity and fully compliant to ECSS-40 standard Processes are applied for each building stone of development Team was trained on theses processes prior to program start Focus on the validation processes is given in the following Page 9 Astrium Proprietary Information

10 Applied Development and Validation Processes Co-engineering Support Main activity phase Warranty Maintenance Requirement Baseline definition & planning phase SW-SRR SW-SRR 1 SW-SRR 1i Specification phase Design phase Production phase SW-SRR 1 SW-SRR 1 SW-PDR i DDKP i TRKP i Validation wrt TS phase SW-SRR 1 SW-SRR 1 SW-CDR i SW-TRR Validation wrt RB phase SW-QR Acceptance phase SW-AR System/SW Engineering Architectural design Technical Specification Detailed design Detailed Detailed design design Coding Coding Coding SVF Validation Unit Unit Tests Tests tests wrt wrt SDD-DDD SDD-DDD Analyses & Inspections Generation of integrated executables SVF Validation tests wrt wrt TS TS TS TS Analyses & Inspections Validation tests wrt wrt RB RB SVF RB RB Analyses & Inspections Subset of of TS TS or or RB RB validation tests tests ATB SW Acceptance Tests Page 10 Astrium Proprietary Information

11 Validation Process Approval SRD Test cases specification CKL2 Test Cases Design and writing of test cases Traceability SRD / Test cases Auto control check-list (ACL2) Completeness of test case Consistency of test cases w.r.t. input documents Verif. outputs Approval Test Cases Test cases realization CKL3 Test Proc Coding of the test procedures Code debugging and test results analysis Branch and decision coverage measurement and analysis Auto-control check-list (ACL3) Procedure design verification Compliance with V&V standard verification Test Results. Page 11 Astrium Proprietary Information

12 V & V Objectives and Test Strategies Page 12 Astrium Proprietary Information

13 V & V Objectives Objectives break-down: Structural objectives Testing of the avionics software against the detailed design Covering 100 % of the code statements and 100 % of branches Functional objectives Validation of 100 % of the SW user requirements Validation of 100 % of the SW technical specification Robustness and stress objectives Robustness : Testing the responses such as invalid inputs to ranges or HW failures Stress : Testing responses to extreme conditions such as high CPU load, memory load or high bus traffic Acceptance objectives Set of acceptance tests are executed in contractor environment Page 13 Astrium Proprietary Information

14 Test Strategies Component tests on simulated environment Validates the code against detailed design 100 % of code statements and code branches Software integration test on HW environment Validates the IO system drivers with HW in the loop Validate that the HW model of the computer is representative for the real on-board HW Validation tests on simulated environment Validates against the user requirement and technical specification Verification Check lists are used by tester and reviewer Global tests on simulated environment Perform CPU stress tests, user scenario Acceptance tests objectives on targeted HW Perform high level test on user test environment Page 14 Astrium Proprietary Information

15 Practical Experiences with Integration and Validation Tests Page 15 Astrium Proprietary Information

16 Integration Tests Test aims Tests are covering SW/HW interfaces including bus interfaces Tests results on HW are compared with results obtained from the components tests performed with the simulated environment Test means Tests are executed with HW in the loop on the avionic test bench Page 16 Astrium Proprietary Information

17 Integration Tests: Test Setup Page 17 Astrium Proprietary Information

18 Integration Tests : Lab Setup Test environment with ICDU and test benches Page 18 Astrium Proprietary Information

19 Validation Tests Test aims Validation of 100 % of the user requirements Validation of 100 % of the technical specification Covering 100 % of the algorithms Test specification Focused on a clearly defined functionality Structured with independent sub-parts Contains traceability to technical specification Specifications for algorithms are received by an external team Supported by auto-control and cross-checks Test content Black box oriented Sanity checks are systematically performed at the end of the test sequence Follow software coding rules Tests produce OK/ NOT OK, no interpretation necessary Building of a fully automatic regression test suite Page 19 Astrium Proprietary Information

20 Validation Tests: Test Setup Version Unit NEF Integration Validation Tests completed V Tests completed V SDE Simulated On-board Computer Simulated Spacecraft and Environment Test Console Page 20 Astrium Proprietary Information

21 Practical Experiences with Integration and Validation Tests Positive Outcomes Avionics SW development and validation for Galileo IOV is based on CMMI L3 standardized processes and tools and are fully compliant to ESA ECSS-40 standard Processes are introduced for the Galileo IOV avionics SW at start of the development Standard tools are used across all sites for development and verification Standardisation allows new testers getting productive very quickly Simulation and verification tools allows parallel testing to accelerate overall project schedule Version V1 delivery completed in end of summer 2007, Version V2 delivery completed in summer 2008 Applied processes have supported a high quality of the delivered software: Total non-conformances in V1 and V2 : 2 Page 21 Astrium Proprietary Information

22 Questions? Page 22 Astrium Proprietary Information