Increasing the Value of your Test System Investment

1

Increasing the Value of your Test System Investment Michael Hutton Senior Market Development Manager Real-Time Test National Instruments

NOW THEN 3

NOW THEN 4

Growth of Embedded Software Boeing 787 Dreamliner Smart Washing Machine ~6.5M lines ~100k lines 5

Growth of Embedded Software is Creating an Explosion in System Complexity Smart Washing Machine Commercial Aircraft Luxury Automobile Lines of Code 100k 6.5 Mil 10 Mil 10-20 defects produced per 1,000 lines of code* Defects 1k 2k 65k - 130k 100k 200k * The Economists.May 16 th, 2010. Tech.View: Cars and software bugs. www.economist.com 6

Growth of Embedded Software 120 000 000 100 000 000 80 000 000 60 000 000 40 000 000 20 000 000 0 Lines of Code 1970 1980 1990 2000 2010 2020 2030 2040 7

Embedded Software Development Process Requirements Gathering Field Test Calibration Model Simulation Controller Plant + - Controller Plant Physical Testing Test Cells + - Rapid Prototyping Code Generation and ECU Flashing Hardware in the Loop Testing (HIL) 8

The Crisis of Complexity A Wind River Market Survey of Device Software Testing Trends and Quality Concerns in the Embedded Industry Product Complexity Driving New Testing Challenges Shorter Testing and Defect Resolution Cycles Inadequate Visibility into Quality High Cost of Poor Quality Investing in Test Automation http://www.windriver.com/products/test_management/survey-0610.pdf 9

Diverging Challenges! The quality challenge is growing, but timelines and budgets are not increasing proportionally Cost Engineers must continue to innovate and harness the latest technologies to remain competitive 10

Keys to Staying Ahead of these Challenges The quality challenge is growing, but timelines and budgets are not increasing proportionally Test Automation! Test Component Re-use Cost Traceability and Collaboration Engineers must continue to innovate and harness the latest technologies to remain competitive 11

Test Automation

Test Automation Automated Test Profile Generation TestWeaver MaTeLo Boost your test efficiency 13

Test Automation Automated Test Profile Generation Automated Test System Configuration NI TestStand APIs NI VeriStand APIs LabVIEW APIs Hardware driver APIs 14

Test Automation Automated Test Profile Generation Automated Test System Configuration Automated Test Case Execution NI TestStand Test Sequences NI VeriStand Stimulus Profiles NI VeriStand Real-Time Sequences NI VeriStand Macros 15

Test Automation Automated Test Profile Generation Automated Test System Configuration Automated Test Case Execution Automated Test Results Processing and Report Generation NI DIAdem NI LabVIEW 16

Test Automation Automated Test Profile Generation Automated Test System Configuration Automated Test Case Execution Automated Test Results Processing and Report Generation Automated Requirements Coverage and Progress Analysis IBM Rational Quality Manager NI Requirements Gateway 17

Test Automation Automated Test Profile Generation Automated Test System Configuration Automated Test Case Execution Automated Test Results Processing and Report Generation Automated Requirements Coverage and Progress Analysis 18

Test Component Re-use

Staying Competitive in a Rapidly Evolving Market To keep quality and budgets under control amidst growing product and market complexities, engineering teams should view the software and hardware test components as a common DNA that persists throughout the entire development process, from requirements definition to production test. www./ato 20

Embedded Software Development Process Design Physical Testing Prototyping HIL Validation C Code Generation 21

Testing Throughout the Process Model-inthe-Loop Testing Physical Testing Lab or Field Evaluation HIL Validation Software-inthe-Loop Testing 22

Test Components User Interfaces Stimulus Requirements Models Analysis Reports 23

Test Continuity through Component Re-use System System System System ECU ECU ECU ECU Test Components Test Components Test Components Test Components Simulated User Interface Stimulus Analysis Reports Requirements Real 24

Consistency and Efficiency throughout the Process Requirements Design Physical Testing Data Logging Data Logging Stimulus Profile Prototyping HIL Validation Stimulus Profile Data Logging Stimulus Profile Deployment Data Logging Stimulus Profile 25

Traceability and Collaboration

Traditional Approach to Quality Management Project Management System Engineering Mechanical Engineering Application Lifecycle Management System Quality/Safety Engineering Software Engineering Test Engineering Hardware Engineering 27

Rational Solution for Systems & Software Engineering Aerospace and Defense DO-178B/C DoDAF, MODAF and UPDM SysML IBM Rational Solution for Systems and Software Engineering Architecture, Design & Development Automotive ISO 26262 AUTOSAR GENIVI Requirements Systems Lifecycle Management Quality Electronics Hardware software co-design EDA Integrations Change/ Configuration Management Best Practices and Services Open Lifecycle Integration Platform Medical Devices FDA QSR standard International standards (IEC 62304) 28

Embedded Software Development Process MIL Testing Demo Requirements Gathering Field Test Calibration Model Simulation Controller Plant + - Controller Plant Physical Testing Test Cells + - Rapid Prototyping Code Generation and ECU Flashing Hardware in the Loop Testing (HIL) 29

Test Continuity through Component Re-use System System System System ECU ECU ECU ECU Test Components Test Components Test Components Test Components Simulated User Interface Stimulus Analysis Reports Requirements Real 30

Control System Controller Plant setpoint error + - 31

Setpoint Driver Throttle RPM Load Torque Engine Control Unit Engine IMT IMP RPM 32

Application Software NI Requirements Gateway Requirements traceability Impact analysis Coverage reporting NI DIAdem Data management Data visualization Data Analysis and reporting 33

Application Software NI TestStand Test automation Production test optimization Batch test data collection and reporting NI VeriStand Real-Time control, stimulus, and data logging Simulation automation and visualization Control algorithm prototyping 34

Summary Keys to Staying ahead of challenges: Test Automation Test Component Re-use Traceability and Calibration Links: For complete demo: http://www./realtimetest/ http://www./veristand/ http://www./hil/ http://www./rcp/ Thank you 35

Stay Connected During and After the Symposium /nidayscommunity facebook.com/nidays twitter.com/#!/nidays youtube.com/nidays 36