The PEGASUS-Method for HAD Assessment - Status Quo

Transcription

1 The PEGASUS-Method for HAD Assessment - Status Quo USA, San Francisco, 208 July th, Dr. Walther Wachenfeld

2 Introduction to the Research Project Project for the establishment of generally accepted quality criteria, tools and methods as well as scenarios and situations for the release of HAD functions. 42 Months Term 7 German Partners January st, 206 June 30 th, 209 OEM: Audi, BMW, Daimler, Opel, Volkswagen Tier : Bosch, Continental Test Lab: TÜV SÜD SMB: fka, imar, IPG, QTronic, TraceTronic, VIRES Scientific institutes: DLR, TU Darmstadt 2 Subcontracts Project Volume i.a. IFR, ika, OFFIS approx. 34,5 Mio. EUR Subsidies: 6,3 Mio. EUR Personnel Deployment approx..79 man-month or 49 man-years 2

3 PEGASUS FOCUS THE HIGHWAY-CHAUFFEUR Level of Automation: Level 3 Conditional Automated Source: PEGASUS-Symposium Nov. 207, Exhibition, Topic: The Highway-Chauffeur 3

4 Introduction to the Research Project Major Questions of the Project What level of performance is expected of an automated vehicle? How can we verify that it achieves the desired performance consistently? Scenario Analysis & Quality Measures Implementation Process Testing Reflection of Results & Embedding What human capacity does the application require? What about technical capacity? Is it sufficiently accepted? Which criteria and measures can be deducted from it? Which tools, methods and processes are necessary? How can complete-ness of relevant test runs be ensured? What do the criteria and measures for these test runs look like? What can be tested in labs or in simulation? What must be tested on proving grounds, what must be tested on the road? Is the concept sustainable? How does the process of embedding work? 4

5 High Level Requirements SOCIAL ACCEPTANCE FOR SAE L3+ What is accepted today? What might be acceptable for SAE L3+? Source: PEGASUS-Symposium Nov. 207, Exhibition, Topic: SOCIAL ACCEPTANCE FOR HAD 5

6 PEGASUS-Method Interaction for a Statement on Safety Argumentation Evidence Assessment of Highly Automated Driving Function (incl. Human) Database Use Case & Existing Data/ Knowledge Knowledge: Laws, Standards, Guidelines,... Requirementsdefintion & Conversion for Database Requirements Definition Techn. Requirements Data / Content Procedure Source: PEGASUS-Symposium Nov. 207, Exhibition, Topic: Approach-and-Consistency 6

7 Introduction to the Research Project Major Questions of the Project What level of performance is expected of an automated vehicle? How can we verify that it achieves the desired performance consistently? Scenario Analysis & Quality Measures Implementation Process Testing Reflection of Results & Embedding What human capacity does the application require? What about technical capacity? Is it sufficiently accepted? Which criteria and measures can be deducted from it? Which tools, methods and processes are necessary? How can complete-ness of relevant test runs be ensured? What do the criteria and measures for these test runs look like? What can be tested in labs or in simulation? What must be tested on proving grounds, what must be tested on the road? 2 Is the concept sustainable? How does the process of embedding work? 7

8 PEGASUS-Method Interaction for a Statement on Safety Argumentation Evidence Assessment of Highly Automated Driving Function (incl. Human) Database 2 Use Case & Existing Data/ Knowledge Data / Content Procedure Knowledge: Laws, Standards, Guidelines,... Data: Test Drive Simulator FOT/NDS Accident Requirementsdefintion & Conversion for Database Requirements Definition Systematic Identification of Preprocessing / Reconstruction Techn. Requirements Data in PEGASUS- Format Logical + Parameter Space Application of Metrics + Mapping to Logical Source of Information Evaluation & Conversion for Database Source: PEGASUS-Symposium Nov. 207, Exhibition, Topic: Approach-and-Consistency 8

9 PEGASUS-Method Interaction for a Statement on Safety Argumentation Evidence Assessment of Highly Automated Driving Function (incl. Human) Database Test Case Derivation Test Cases 2 Application of Test Concept incl. Variation Method Processing Space of Logical Test Cases Use Case & Existing Data/ Knowledge Data / Content Procedure Knowledge: Laws, Standards, Guidelines,... Data: Test Drive Simulator FOT/NDS Accident Requirementsdefintion & Conversion for Database Requirements Definition Systematic Identification of Preprocessing / Reconstruction Techn. Requirements Data in PEGASUS- Format Integration Pass Criteria Logical + Parameter Space Application of Metrics + Mapping to Logical Source of Information Evaluation & Conversion for Database Determination of Exposure Source: PEGASUS-Symposium Nov. 207, Exhibition, Topic: Approach-and-Consistency 9

10 Test Execution Test Concept Replay 2Sim Test object: Functional implementation of highway chauffeur Test level: Functional Test Test platform : all logical scenarios Test platform Automatized variation of parameter Specific scenarios Test execution looking for critical cases (e.g. accidents) Pass-/Fail- Criteria Space of logical test cases Allocation of test cases to test platform selected scenarios Test platform Test ground Manual selection of scenarios/ parameter (e.g. tests as per ECE R79, rating tests) Feedback Concrete scenarios Critical cases Comparison Test execution Driving on TG + validation simulation Evaluated concrete scenarios (Pass/Fail) Surprises Logical scenario + parameter space + exposure of parameter no direct link to space of logical test cases Test platform Field Test execution of real world drive with guidelines: Route Weather Time Specific features Test object: Overall system highway chaffeur including vehicle behavior Test level: Vehicle test Test platform : Test ground/ field Measured data for database Measured data for Replay 2Sim Source: PEGASUS-Symposium Nov. 207, Exhibition, Topic: TEST CONCEPT AND TEST CASE ALLOCATION 0

11 PEGASUS-Method Interaction for a Statement on Safety Argumentation Evidence Assessment of Highly Automated Driving Function (incl. Human) Database Release Test Evaluation Test Execution Test Case Derivation Processing Safety Statement Risk Assessment Test Results Evaluation and Classification Test Data Test HAD-F: Proving Ground Real World Drive Test Cases 2 Application of Test Concept incl. Variation Method Space of Logical Test Cases Extended Data & Knowledge Use Case & Existing Data/ Knowledge Data / Content Procedure Knowledge: Laws, Standards, Guidelines,... Data: Test Drive Simulator FOT/NDS Accident Requirementsdefintion & Conversion for Database Requirements Definition Systematic Identification of Preprocessing / Reconstruction Techn. Requirements Data in PEGASUS- Format Integration Pass Criteria Logical + Parameter Space Application of Metrics + Mapping to Logical Source of Information Evaluation & Conversion for Database Determination of Exposure Source: PEGASUS-Symposium Nov. 207, Exhibition, Topic: Approach-and-Consistency

12 PEGASUS-Method Interaction for a Statement on Safety Argumentation Evidence Assessment of Highly Automated Driving Function (incl. Human) Database Safety Argumentation Safety Statement Release Test Evaluation Test Execution Risk Assessment Test Results Evaluation and Classification Test Data Test HAD-F: Proving Ground Real World Drive Test Case Derivation Test Cases 2 Application of Test Concept incl. Variation Method Processing Space of Logical Test Cases Extended Data & Knowledge Use Case & Existing Data/ Knowledge Data / Content Procedure Knowledge: Laws, Standards, Guidelines,... Data: Test Drive Simulator FOT/NDS Accident Requirementsdefintion & Conversion for Database Requirements Definition Systematic Identification of Preprocessing / Reconstruction Techn. Requirements Data in PEGASUS- Format Integration Pass Criteria Logical + Parameter Space Application of Metrics + Mapping to Logical Source of Information Evaluation & Conversion for Database Determination of Exposure Source: PEGASUS-Symposium Nov. 207, Exhibition, Topic: Approach-and-Consistency 2

13 Contact: Dr. Walther Wachenfeld Continental Test Architect Corporate Systems & Technology 3