Verification, Validation & Traceability Nightmares? 5-ways to streamline these processes
Make life easier as a test engineer Use Technology to Help with Common Activities 1. Test Coverage 2. Gauge R & R 3. Verification of deployed solution 4. Regulatory compliance 5. Test History: servicing, repairs & returns
Quick Background Specialists in automated test solution provision Services Bespoke systems, support, training Products SW Tools for better ATE Dev
Test Coverage Have I got coverage of all test requirements? How can I demonstrate this? Test Requirements Test Solution Test results Image Placeholder
Test Coverage Ensure compliance from both ends How to ensure from the beginning of a project? Reduce the chance of omissions Create well defined software development program How to verify when complete? Get a measure of coverage Identify non-compliances
Verify when complete Requirements Requirements Gateway Test Software
At Start of Project Auto-code Generation Requirements Test Software
Gauge R+R Gauge R&R a requirement for quality Needed before live production use Requires considerable amounts of results Data Processing
Gauge R & R Definition Looking at measurement variation in automated test Repeatability Variation of a measure under the same conditions Reproducibility Variation when some conditions change
Gathering Data Item Repeatability Reproducibility Operator SAME SAME/DIFFERENT Instruments SAME SAME/DIFFERENT Test Fixture SAME SAME/DIFFERENT Unit Under Test SAME SAME
Measurement Variation 53 70 52 60 51 50 50 40 49 30 48 20 47 10 46 0 5 10 15 0 0 10 20 30 40 Short Term Variation Long Term Variation
Automating Data Collection Automated Execution - Workflow
Bringing Together Data Manual Spreadsheet Automated Database Warning: Spreadsheet method can be very resource intensive
Our Solution with DB
Deployment Validation Verification Protection Traceability
Deployment Check Post-Deployment Runtime Multi-File Auto-Repair
Our Deployment Solution
Regulatory Compliance Production Test Stage Completion Data Retention Control of Records Sub Component Tracing Aerospace Medical Rail Automotive
Production Test Stage Completion End of Line Burn-in/ESS Completed Unit Sub-Assemblies Components
Production Test Stage Completion Manufacturing Process Operation 1 Operation 2 Operation 3 Operation 4 Unit Rework Rework Process
Production Test Stage Completion 1. Determine the identity of subcomponents 2. Check they have all successfully passed their required tests 3. Identify subcomponents in completed unit test results
Production Test Stage Completion Built Stage 1 Test Built Stage 2 Test Complete Unit Test
Retention Period 10-Years+ Paper Vs Electronic File vs Database Data Obsolescence Data Retention
Data Obsolescence Media cannot be read Documents of that format cannot be opened Documents wrongly formatted in new software version
Control of Test Records Identification Prevent Modification Control Access Controlled and Uncontrolled Versions
Test Results Protect against tampering Don t shouldn t need modifying Text, graphical and tabular data Portable
Using Technology DO Create report documents in PDF format Protect report archive directories from modification Store data in databases Avoid Text type files which can be easily modified Test reports without adequate identification information
Our Solution PDF Reporting
Unit Test History What is the testing history of a production unit? Useage: Production Repairs Servicing Compliance Requirements Enabling design improvement
PSU Voltage Example Stage Unit 1 Unit 2 Unit 3 Unit 4 Initial Test 23.8V 24.1V 24.3V 23.7V After Burn-in 23.7V 24.0V 24.2V 23.7V 1st Year Service 23.5V 24.0V 24.1V 24.4V 2nd Year Service 23.7V 24.0V 24.2V 23.9V 3rd Year Service 22.5V 24.1V 24.2V 22.8V Repair 24.1V - - 24.0V PSU 24V Voltage Test: Acceptable Limits 23.5V -24.5V
Test History Via File Archive Initial Production 14/01/13 After Re-work 20/01/13 Servicing 02/02/14 Returned - Fault Repair 06/05/14 Sub Assembly Replaced 21/05/14
Use Results Data Archive Initial Production 14/01/13 After Re-work 20/01/13 Servicing 02/02/14 Returned - Fault Repair 06/05/14 Sub Assembly Replaced 21/05/14
Find out More Discuss these areas in more detail Visit us at Stand 1 in the exhibition area Browse to www.simplicityai.com Call Us: 0845 468 2886 Email Us: info@simplicityai.com