Silver + TestWeaver Tools for Simulation-Based Design System Test and Validation Mugur Tatar QTronic GmbH, Berlin SESP 2008, Noordwijk
Company Profile QTronic: Tools & Engineering for Simulation-Based Development Started 2006 offspring of DaimlerChrysler Research Expertize - Modeling for simulation - Co-simulation - Automatic test and validation Tools - Silver: virtual system integration - TestWeaver: system test and validation QTronic Headquaters in Berlin 7-9. Ocober 2008 SESP 2008 2
Development of control software Development with C/C++, Simulink,... Control SW Low-Level Simulation tools Modelica, Simulink,... fast feedback Control SW Adapter Simulation Model SiL co-simulation S i l v e r Prototype Test HiL Test SiL Test TestWeaver Virtual Integration 7-9. Ocober 2008 SESP 2008 3
Complex Systems - Challenge Interaction of Software Physical Systems Control and Mission Actions Environment Combinatorial interaction HW Faults Tolerances Aging Unintended interactions and faults happen... Important: Find all faults and weaknesses before release 7-9. Ocober 2008 SESP 2008 4
Traditional Test Automation - Manually Written Test Scripts Test #31 start_car(); shift_lever Test Test #31 #31 = D; while(gear<2) call call init(); a=...; accelpedal = 20; if(time>2) if(b<0.5)......... error( no... shift )... Control SW HW Model co-simulation HiL Test SiL Test Limitations High costs of production and maintenance of test scripts Test coverage 7-9. Ocober 2008 SESP 2008 5
Test Weaver - Automating System Test Idea intelligent generation of 1000s of differing test scenarios active attempt to: - maximize state coverage - drive the system in difficult situations Testing = playing against (simulated) system Benefit high coverage lower efforts for test specification Technology analyze results of past simulations to plan the future game moves 7-9. Ocober 2008 SESP 2008 6
Test Weaver - Generated Test Scenarios ok fault 1 rootinput a input b fault 2 input a input a input b alarm! input b input c t0 time 7-9. Ocober 2008 SESP 2008 7
Test Weaver - Technology control input component fault Control SW HW Model Instrumented Simulation alarm discrete state change Test Weaver discrete state space reached state State database reached state with alarm: scenario can be reproduced (replay) state trajectories 7-9. Ocober 2008 SESP 2008 8
Test Weaver - Result Analysis Overview report for all scenarios Detailed reports for individual scenarios Replay, plot, debug 7-9. Ocober 2008 SESP 2008 9
Test Weaver in Automotive Applications Software test with Test Weaver Co-simulation with Silver Every software release: 24h test in parallel on several PCs Thousands of driving situations generated and analyzed AMG SPEEDSHIFT MCT 7-speed sports transmission 7-9. Ocober 2008 SESP 2008 10
TestWeaver Runs with: Modelica/Dymola Matlab/Simulink Silver (co-simulation) C/C++ Easy integration with other simulation environments 7-9. Ocober 2008 SESP 2008 11
Conclusion Test automation based on computer chess principles High test coverage Reduced specification overhead TestWeaver 7-9. Ocober 2008 SESP 2008 12
Test Weaver Instrumentation Example two choosers control acceleration and brake pedal a reporter to monitor a temperature 7-9. Ocober 2008 SESP 2008 13
Test Weaver Instrumentation Example two choosers control acceleration and brake pedal a reporter to monitor a temperature 7-9. Ocober 2008 SESP 2008 14
Demo System Under Test SW Control Silver Simulation Model Co-Simulation of SW and HW Test Weaver Generation and assessment of tests 7-9. Ocober 2008 SESP 2008 15
Development of control software with Silver Matlab/Simulink, C/C++,... fast feedback SW Control Simulation Model Executable modules DLL binary format Silver Developer System Co-simulation of SW and HW model 7-9. Ocober 2008 SESP 2008 16
Test Results - What can we find out? Errors in the SW module: - div. by zero - overflows... Critical States: - overheating - loss of control - spec violations... Coverage: - what states were tested 7-9. Ocober 2008 SESP 2008 17