Tool Qualification. Get the Most out of Development and Testing with the Maker of the Blue Box V11.01

Transcription

1 Tool Qualification Minimize the risk of systematic faults in the developed product due to malfunctions of the software tool (introduce or fail to detect errors)

2 The Blue Box

3 Reference V ISO ISO , 10 Hardware

4 isystem Tools within a Safety Project Software Development (ISO , 9) Not so critical Assembler (interrupt handler, time-critical algorithms, ) Software Test (ISO , 9) Unit Testing Integration Testing Hardware-Software Integration and Testing (ISO , 10/-4,8) System Integration Testing (ISO ,8) ISO mentions: The test environment shall correspond as closely as possible to the target environment

5 isystem Tools and Unit Testing isystem.connect

6 isystem Tools and Unit Testing isystem.connect + Trace & Object Code Level Coverage

7 isystem Tools and Integration Testing isystem.connect

8 isystem Tools and Hardware-Software Integration Testing isystem.connect + Trace & Profiler isystem.connect + Trace & I/O Module

9 Confidence in the use of software tools ISO Minimize the risk of systematic faults in the developed product due to malfunctions of the software tool (introduce or fail to detect errors) Evaluation of a software tool by analysis: Level of Confidence Tool Impact (TI): TI1, TI2 (general estimation) Tool error Detection (TD): TD1, TD2, TD3 TD1, high degree of confidence that a malfunction will be prevented or detected Methods for Qualification TCL3, TCL2

10 Confidence in the use of software tools ISO * TCL3 * TCL2 * isystem Regression Test Tool Suite may increase confidence from use

11 Company Management System 25+ years R&D and production of embedded systems development & test tools ISO 9001:2008 Company management system isystem has been certified in the field of the following activities: Design, development, production and sales of embedded microcontroller development and test tools, managing custom projects and providing professional services related to such tools

12 Background Information Tool Qualification-API Architecture isystem.connect for Python wrapper isystem.connect for Python wrapper isystem.connect for Python wrapper isystem.connect debug isystem.connect isystem IDE & Debugger winidea

13 Remote Control API Verwendung isystem.connect debug debug.download(); debug.setbp("myfunction"); debug.run(); debug.waituntilstopped(0, 200); debug.deletebp("myfunction"); Use of isystem.connect m_piconnectdebug.runcontrol(iconnectdebug::rdownload, 0, 0); m_piconnectdebug.setbreakpoint(iconnectdebug::bsymbol IConnectDebug::bSet, 0, 0, "myfunction", 0); m_piconnectdebug.runcontrol(iconnectdebug::rrun, 0, 0); IConnectDebug::SStatus status; do { m_piconnectdebug.getstatus(iconnectdebug::tcpu, &status); Sleep(200); } while (status.m_bystatus!= IConnectDebug::stStopped); isystem IDE & Debugger winidea m_piconnectdebug.setbreakpoint(iconnectdebug::bsymbol IConnectDebug::bClear, 0, 0, "myfunction", 0);

14 Remote Control API + Python Use of isystem.connect debug debug.download(); debug.setbp("myfunction"); debug.run(); debug.waituntilstopped(0, 200); debug.deletebp("myfunction"); Use of isystem.connect m_piconnectdebug.runcontrol(iconnectdebug::rdownload, 0, 0); m_piconnectdebug.setbreakpoint(iconnectdebug::bsymbol IConnectDebug::bSet, 0, 0, "myfunction", 0); m_piconnectdebug.runcontrol(iconnectdebug::rrun, 0, 0); IConnectDebug::SStatus status; do { m_piconnectdebug.getstatus(iconnectdebug::tcpu, &status); Sleep(200); } while (status.m_bystatus!= IConnectDebug::stStopped); isystem IDE & Debugger winidea m_piconnectdebug.setbreakpoint(iconnectdebug::bsymbol IConnectDebug::bClear, 0, 0, "myfunction", 0);

15 Read variable 'icounter' on the target and print its value until it reaches value of import isystem.connect from isystem import icutils from isystem.connect import IConnectDebug # First we obtain controller objects icfactory = icutils.getfactory() dbg = icfactory.getdebugfacade() ide = icfactory.getidectrl() import time # Initialize dbg.download() dbg.deleteall() dbg.setbp('main') dbg.run() dbg.waituntilstopped() # Set global variable 'isdebugtest' to 1 and run the target dbg.modify(iconnectdebug.fmonitor, 'isdebugtest', '1') dbg.run() py_icounter = 0 # Read value of 'icounter' until condition is met while py_icounter < : evalresult = dbg.evaluate(iconnectdebug.frealtime, 'icounter') py_icounter = evalresult.getint() print py_icounter time.sleep(1) dbg.stop() print "Target stopped, 'icounter' reached the limit:", py_icounter raw_input('press ENTER to exit')

16 Conclusion Generic API enables you to setup an automation scenario for Development Testing Effort doing it in C/C++ is a bit higher than using abstraction layers as well as script languages Based on this technology isystem implemented the isystem Regression Test Tool Suite to test our own products Tool Qualification Scenario for pre-qualification purposes, e.g., according to standards such as ISO26262 or DO178B/C

17 Regression Test Tool Suite

18 Regression Test Tool Suite Implementation of Python Test Scripts import sys import os import inspect import time import array import isystem.connect from isystem import icutils from isystem.connect import IConnectDebug from isystem.connect import IConnect import common.resultcomparators import common.workspacehandler from common.reportwriter import ReportWriter from common.utilclasses import TestStatus from common.testbaseex import TestBaseEx def testreadwritememory(self): aaddress = self.addressctrl.getvariableaddress("iforrwmemtest") nummaus = self.testconfig.nummaus bybytespermau = self.testconfig.bybytespermau #$ Debug: Read Memory #! Tested method: readmemory() origmembytes = self.datactrl.readmemory(self.testconfig.accessflagsrwmemory, aaddress.getmemarea(), aaddress.getaddress(), nummaus, bybytespermau) self.logc("read/write Memory") mb = [] for byte in origmembytes: mb.append(byte) self.log('read mem = ', str(mb))

19 Tool Qualification Safety Manual Test GUI Test Specification, Test Cases, Test Reports Reference-Target + Consulting/Integration Services isystem.connect for Python wrapper isystem.connect debug isystem.connect isystem Development Environment & Debugger winidea Reference Application Reference Target

20 Safety Manual Description of features/functions (to be used in a safety project or to be qualified) Manuals: User Manual, Hardware Reference Manual, Getting Started Guides, PCB Desing Guidelines,... System Requirements in general or specific to a micro controller Description of known workarounds dedicated to a specific micro controller