Automatic validation of diagnostics in ECUs CANoe.DiVa Diagnostic Integration and Validation Assistant V1.1 2016-10-10
Agenda Introduction CANoe.DiVa for Automated Diagnostics Validation Summary 2/22
Introduction Why Might We Want to Automate Validation? Let s look at a simple service, such as ReadDataByIdentifier, this has one good case, and (at first glance) five context sensitive bad cases : 3/22 Source: ISO 14229-1:2013 But consider, e.g. NRC 0x13, this is sent if the request is too long, too short or if too many DIDs are requested! > Excluding NRC 0x22, there are actually 8 bad cases that need to be considered, some of which are dependent on the DID being requested!
Introduction The Mission automated test generation test run broad and detailed CANoe.DiVa reproducible documented data driven diagnostic tests 4/22
Introduction CANoe.DiVa CANdelaStudio Diagnostic Authoring Tool Configurator CANoe.DiVa Runtime Library Report Analyzer ODX CDD Generator CANoe XML/ CAPL CANoe Test Feature Set CANoe HTML/ XML ECU Specification Test Module Test Report ECU System under Test 5/22
Introduction Where might we want to insert faults? Diagnostic exchange : Supported services and subfunctions, data content, state dependencies,... Diagnostic communication : Timings, message format, request/ response dependencies CANoe.DiVa Transport protocol (CAN): ISO network layer, parameters, timings, Flow Controls, Bus access: Communication CANoe/CANalyzer CAN LIN FlexRay DoIP K-Line 6/22
Introduction Protocols to consider during fault insertion ISO 14229 Unified Diagnostic Services (UDS): 2006/2013 ISO 15765 Diagnostics on CAN ISO 14230 Keyword Protocol 2000 (KWP) ISO 15031/J1979 On Board Diagnostics (OBD) ISO 27145 World-wide harmonized OBD (WWH-OBD) GMW3110 (including GM Node Verification Procedures) Various manufacturer specific test extensions (e.g. for Daimler, GM, VW, FCA, ) 7/22
Introduction Automated Tests Scalability of Automation Diagnostic Console CAPL Browser vteststudio CANoe.DiVa test creation n/a editing CAPL tool supported generated interactive automated automated automated test execution 8/22
Agenda Introduction CANoe.DiVa for Automated Diagnostics Validation Summary 9/22
CANoe.DiVa for Automated Diagnostics Validation Overview Automated generation of a CANoe test based on a diagnostic specification User interface to configure tests Generation of a test specification Clear and detailed report of test results Support of test report analysis Requirement traceability Extensible test functionality 10/22
CANoe.DiVa for Automated Diagnostics Validation Protocol Testing Diagnostic Message Flow Physical, functional addressing and timing DiVa ECU Diagnostic Protocol Format Valid, Combined and Invalid Requests Response (single, none, multiple) Data Type Checks Sessions and Security Levels Service execution in the different sessions and security levels Session and security state transitions 11/22
CANoe.DiVa for Automated Diagnostics Validation Application Testing: Diagnostic Parameter Passive parameter validation against Diagnostic values (e.g. read/write) Configured data ranges Expectation values CCP/XCP values CANoe System Variables Active control of I/Os to validate diagnostic parameter content CAN messages using CANoe rest bus simulation HW I/Os via VT System channels Any I/O using CANoe system variables 12/22
CANoe.DiVa for Automated Diagnostics Validation Application Testing: Fault Memory Provoke network signal failures Communication timeouts Data consistency failures Provoke hardware failures using the VT System: Short-circuits (Ground, UBatt, Pins) I/O failures (interruption, resistance, voltage) Individual error settings real node 1 simul. node 2 simul. node 3 Any other failures using user scripts 13/22
CANoe.DiVa for Automated Diagnostics Validation Application Testing control measure CANoe.DiVa control check IO Control (2F) Read (19,22) Temp. Sensor VT System ECU System under Test CANoe IL txmsgtemp 14/22
CANoe.DiVa for Automated Diagnostics Validation Software Download Test Supported Download Tests* Valid Flashing Overvoltage and under voltage tests Cancel data transfer (stop transmission or clamp reset) > Check that valid flashing is possible afterwards Additional flash tests available from DiVa v10 [some in SP2, Q3/4 2017)]: Security Access: Do no Security Access during flash sequence. Security Access: Send an invalid Key during flash sequence. Erase Memory: Do not send Erase Memory Routine during flash sequence. Erase Memory: Cancel after Erase Memory. Erase Memory: Cancel erasing after X milliseconds. TransferData: Increment one bit of data during flash sequence (CRC check must fail). TransferData: Increment one bit of data during flash sequence (Signature check must fail). Fingerprint: Do not send the specified Fingerprint. * With Vector vflash 15/22
CANoe.DiVa for Automated Diagnostics Validation User Interface 16/22
CANoe.DiVa for Automated Diagnostics Validation Test Reporting 17/22
CANoe.DiVa for Automated Diagnostics Validation Test Result Analysis Compare test runs Different Views on the test report Result (Pass/Fail) Service ECU State Issue Classification/Comment Requirements Identify error situations by combining Views Comment and classify test results Get one-page summary reports Forward and archive a complete test report or an excerpt 18/22
CANoe.DiVa for Automated Diagnostics Validation Requirements Tracking Link CANoe.DiVa tests with test- or specification requirements (automatically and manually) Documentation of requirements within test cases/results via prose, document references or links (e.g. DOORS, html) Requirement View for test analysis: In which tests is a requirement verified? Requirement Overview to document the verification result 19/22
Agenda Introduction CANoe.DiVa for Automated Diagnostics Validation Summary 20/22
Summary Benefits Significant savings of time and effort Further quality improvement of the ECU Software All development stages supported Excellent test coverage Efficient, generation-based approach Automated tests without user interaction User-defined tests allow tailoring Widely used by OEMs and suppliers already with a proven record of success Continuously enhanced features through implementation of customers requirements 21/22
For more information about Vector and our products please visit www.vector.com Author: Iain Cunningham Vector UK 2016. Vector GB Limited. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.1 2016-10-10