Test Lab Audit Manual. Version [TLAM] NFCForum_ Test_Lab_Audit_Manual NFC Forum TM

Transcription

1 Test Lab Audit Manual Version [TLAM] NFCForum_ Test_Lab_Audit_Manual TM

2 RESTRICTIONS ON USE This document is copyright 2016 by the, and is made available subject to the following terms: 1. You may, without charge, copy (for internal purposes only) and share this document with your members, employees, and (to the extent related to the use of this document on your behalf) consultants. You may not modify or create derivative works of this document for external distribution. 2. THIS DOCUMENT IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, ACCURACY, COMPLETENESS AND NONINFRINGEMENT OF THIRD PARTY RIGHTS. IN NO EVENT SHALL NFC FORUM, ITS MEMBERS OR ITS CONTRIBUTORS BE LIABLE FOR ANY CLAIM, OR ANY DIRECT, SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES, OR ANY DAMAGES WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF OR IN CONNECTION WITH THE USE OF THIS DOCUMENT., Inc. 401 Edgewater Place, Suite 600 Wakefield, Massachusetts USA Last published May 28, 2014

3 Contents Contents 1 Introduction Background Objective Applicable Documents or References Glossary Special Word Usage Test Lab Audit Questions Mandatory Interpretations of Management Section ISO/IEC Organization ISO/IEC Management System ISO/IEC Document Control ISO/IEC Review of Requests, Tenders, and Contracts ISO/IEC Subcontracting of Tests ISO/IEC Purchasing Services and Supplies ISO/IEC Service to the Customer ISO/IEC Complaints ISO/IEC Control of Non-conforming Testing ISO/IEC Improvement ISO/IEC Corrective Action ISO/IEC Preventive Action ISO/IEC Control of Records ISO/IEC Internal Audits ISO/IEC Management Reviews Mandatory Interpretations of Management Section ISO/IEC General ISO/IEC Personnel ISO/IEC Accommodation and Environmental Conditions ISO/IEC Test Methods and Method Validation ISO/IEC Equipment ISO/IEC Measurement Uncertainty ISO/IEC Sampling ISO/IEC Handling of Test Items ISO/IEC Assuring the Quality of Test Results ISO/IEC Reporting the Results A. Revision History Figures Figure 1: Close Environment Requirement Against Conductive Materials and Active Devices... 7 Test Lab Audit Manual Page i

4 Introduction 1 Introduction 1.1 Background The was formed to advance the use of Near Field Communication (NFC) technology by developing specifications, ensuring interoperability among devices and services, and educating the market about NFC technology. Formed in 2004, manufacturers, application developers, financial services institutions, and more all work together to promote the use of NFC technology in consumer electronics, mobile devices, PCs, and more. The fundamental mission of the s Certification Program is to perform sufficient testing on NFC-enabled devices in order to protect the brand of the, while at the same time helping to grow the global market for certified devices, products, and services. The Certification Policy defines the policies that govern the operation of the Certification Program, including what can be certified, what it means to be certified, and the process for achieving and maintaining certification. This manual contains the Audit requirements to be taken into account by Qualified Auditors for both ATL (Authorized Test Lab), performing Certification Testing according to an Device Requirement and GCF RTO (Recognized Test Organization), performing certification testing for GCF (Global Certification Forum). 1.2 Objective This document is intended for candidate and existing Authorized Test Laboratories, as well as GFC Recognized Testing Organizations (RTOs) seeking authorization to conduct selected test cases for GCF certification, and sets forth the requirements that must be satisfied during an NFC auditor assessment in order to qualify for and maintain NFC Forum authorization. This document, in conjunction with [CERT_POL] and [ATLR], and in the case of RTOs the License Agreement, constitutes the set of requirements and obligations for Authorized Test Laboratories and GCF(Global Certification Forum) Recognized Test Organizations. The objective evidence collected during the assessment will be a checklist derived from this document, as well as a method matrix showing what was witnessed during the assessment. This information is held secure and in confidence. 1.3 Applicable Documents or References [ANALOG] [ANALOG_TC] [ATLR] [TLAM] [TLAC] [CERT_POL] NFC Analog Technical Specification, Test Cases for Analog Technical Specification, Authorized Test Lab Requirements, Test Lab Audit Manual, Test Lab Audit Checklist, Certification Policy, Test Lab Audit Manual Page 2

5 Introduction [DEVREQS] [DIGITAL] [DIGITAL_TC] [DTA] [ICS] Device Requirements, NFC Digital Protocol Technical Specification, Test Cases for Digital Protocol and Activity Technical Specifications, Latest version, Device Test Application Specification for Digital Protocol and Type 1/2/3/4 Tag Operation, Implementation Conformance Statement (ICS) for Digital Protocol, LLCP, and SNEP, [ISO/IEC_17025] ISO/IEC 17025, General requirements for the competence of testing and calibration laboratories, Latest Version, ISO/IEC [IXIT] [LLCP] [LLCP_TC] [REVT] [RFC2119] [SNEP] [SNEP_TC] [TCMT] [TCCL] [T1TOP] [T1T_TC] Implementation extra Information for Testing (IXIT), Logical Link Control Protocol (LLCP) Technical Specification, Test Cases for Logical Link Control Protocol Technical Specification, Reference Equipment Verification Tests, Key words for use in RFCs to Indicate Requirement Levels, RFC 2119, S. Bradner, March 1997, Internet Engineering Task Force Simple NDEF Exchange Protocol (SNEP) Technical Specification, Test Cases for SNEP Test Case Mapping Table for Digital Protocol, LLCP, and SNEP, and Test Case Mapping Table for Analog Test Case Category List, Type 1 Tag Operation Technical Specification Test Cases for the Type 1 Tag Operation, Test Lab Audit Manual Page 3

6 Introduction [T2TOP] [T3TOP] [T4TOP] [T1T_TC] [T2T_TC] [T3T_TC] [T4T_TC] Type 2 Tag Operation Technical Specification, Type 3 Tag Operation Technical Specification, Type 4 Tag Operation Technical Specification, Test Cases for the Type 1 Tag Operation, Test Cases for the Type 2 Tag Operation, Test Cases for the Type 3 Tag Operation, Test Cases for the Type 4 Tag Operation, 1.4 Glossary ATL GCF RTO A Authorized Test Laboratory Global Certification Forum A GCF Recognized Test Organization See also [ATLR] for Glossary. 1.5 Special Word Usage The key words MUST, MUST NOT, REQUIRED, SHALL, SHALL NOT, SHOULD, SHOULD NOT, RECOMMENDED, MAY, and OPTIONAL in this document are to be interpreted as described in [RFC2119]. Test Lab Audit Manual Page 4

7 Test Lab Audit Questions 2 Test Lab Audit Questions The purpose of the [TLAM] is to provide a high level requirement and the purpose of the [TLAC] is to provide a detail checklist for the audit 2.1 Mandatory Interpretations of Management Section ISO/IEC Organization ISO/IEC Management System ISO/IEC Document Control a) The [DEVREQS] and [TCCL] are considered external documents, and the lab should ensure that they are using the latest editions ISO/IEC Review of Requests, Tenders, and Contracts b) The contract shall define which components of the test environment are being supplied by the laboratory and which are being supplied by the client. This includes hardware and software. The test environment boundary interface points shall also be clearly defined ISO/IEC Subcontracting of Tests ISO/IEC Purchasing Services and Supplies ISO/IEC Service to the Customer ISO/IEC Complaints ISO/IEC Control of Non-conforming Testing ISO/IEC Improvement ISO/IEC Corrective Action Test Lab Audit Manual Page 5

8 Test Lab Audit Questions ISO/IEC Preventive Action ISO/IEC Control of Records ISO/IEC Internal Audits ISO/IEC Management Reviews 2.2 Mandatory Interpretations of Management Section ISO/IEC General ISO/IEC Personnel ISO/IEC Accommodation and Environmental Conditions Test Lab Audit Manual Page 6

9 Test Lab Audit Questions c) Certification Testing should be performed under an environment that limits noise from 1MHz to 100MHz to avoid interference during testing. d) To avoid disturbing the magnetic field, the first free guard distance must be observed around Reference Equipment (This area must not contain any other conductive materials than what is needed for certification testing e) In addition to the second free guard distance, no active electrical device, such as a cell phone, should be within 1 meter from the Reference Equipment, the DUT and the robot. f) There shall be limited access to the laboratory. 1* A* B* C* 2* Notes: A*: Reference Equipment B*: Operating Volume C*: DUT 1*: The first free guard distance against conductive materials: 150mm 2*: The second free guard distance against active devices: 1M Figure 1: Close Environment Requirement against Conductive Materials and Active Devices ISO/IEC Test Methods and Method Validation Test Lab Audit Manual Page 7

10 Test Lab Audit Questions g) Certification Testing shall be performed based on all procedures and the latest test specifications, [ICS], [IXIT], [TCMT], and [TCCL]. h) Certification Testing must be performed and executing in each applicable and available test specification by using the latest [TCCL] as a checklist. i) The Test Lab must possess the procedure and solution to generate an Implementation Test Plan based on IUT s ICS values and applicable test specifications, [ICS], [IXIT], [TCMT], and [TCCL] ISO/IEC Equipment a) Certification testing shall be performed using approved and validated test platforms as listed on the website. b) Software Tool validation confirms that the software tools meet the specified requirements. Software tools shall be validated and documented, and should include the following objective evidence: Custom software testing tools: Full validation effort. Commercial off the Shelf (COTS) software tools used as is: Acceptance testing for each installed instance. Modified off the Shelf (MOTS) software tools: Acceptance testing for each installed instance along with validation of the modification or tailoring. Test Lab Audit Manual Page 8

11 Test Lab Audit Questions c) Each software test tool installation (or instance ) shall undergo a documented installation/operational qualification prior to use. d) Software test tools can be installed on many systems. Each instance of the test tool software shall be uniquely identified on each target environment and be under configuration management. e) There shall be documented evidence of the configuration and inventory of each specific installed software or system, and suitable tests should be performed to confirm functionality. f) The Test Lab shall perform a reference antenna verification testing based on [REVT] before certification testing. g) When software test tools are used by others outside of the laboratory s control, configurations and adaptations shall be checked and possibly reset to ensure proper functioning. For example, Test Labs should verify configurations and adaptations when another group outside of the lab s control has access rights to the testing environment. h) Software test tool configurations shall be safeguarded by user roles or other appropriate means. i) Software test tools significant to testing are considered equipment and shall follow the appropriate clauses in [ISO/IEC_17025], Section 5.5. j) The equipment records requirements in [ISO/IEC_17025] are defined here as follows: Identity: Each instance of software/hardware Manufacturer: Include manufacturer name, program name, and version number Checks: Installation/operational qualifications Location: Target system name or location Manufacturer s instructions: User manuals Calibrations: Applicable for Analog test equipment only Maintenance Plan: None normally required Damage: Applicable ISO/IEC Measurement Uncertainty k) The concept of Measurement Uncertainty (MU) is applicable to Analog testing.the concept of MU is not applicable to [DIGITAL], [SNEP], and [LLCP] testing ISO/IEC Sampling ISO/IEC Handling of Test Items Test Lab Audit Manual Page 9

12 Test Lab Audit Questions ISO/IEC Assuring the Quality of Test Results a) The quality control monitoring in this clause can be satisfied using retained artifact control charting or another method for Analog testing only. Quality control efforts for [DIGITAL], [SNEP], and [LLCP] testing is where possible by the lab. b) There are no commercial proficiency testing providers for NFC testing. Proficiency testing is not applicable. The, from time-to-time, may commission [ILCT] ISO/IEC Reporting the Results a) The Reporting results will be covered by Certification Policy documents and [ATLR]. Test Lab Audit Manual Page 10

13 Test Lab Audit Questions 2.3 General Requirements a) Is the lab s ISO17025 accreditation include the following NFC Test Methods? Digital protocol Type 1/2/3/4 tag operation ANALOG LLCP SNEP b) Do you have a process and a solution to generate Implementation Test Plan based on IUT s ICS values and the latest test specification, ICS, IXIT, TCMT, and TCCL? Highly recommendation is to possess automation solution to avoid human error. c) Does the Test Lab know whether to check if the DUT supports the DTA or not? d) Do you have ability and evidence for performing of Pre-scan service for finding reference position on IUT? [TLR] 2.4 Digital Protocol Testing This part is mandatory for ATLs, but optional for RTOs Test Lab Audit Manual Page 11

14 Test Lab Audit Questions a) Is the test lab familiar with NFC Digital Protocol Specification and NFC Forum test case for Digital Protocol? b) Does the lab know the default environmental test conditions? c) Does the test lab know the default protocol test conditions? d) Does the test lab know the pre- and post-processing default timings? e) Does the test lab know the types of frames in the Scenarios? f) Does the test lab know the definitions for sequences timings application and measurement? g) Does the test lab know the parameters Values? h) Can the test lab perform and verify all the DP test cases? i) If failed test case occurred, can the test lab give the comment to the client? 2.5 Type 1/2/3/4 Tag Operations a) Is the test lab familiar with NFC-Forum Type 1/2/3/4 Tag Operation Specification and NFC-Forum Test Case for Type 12/3/4 Tag operation? b) Does the test lab know the default environmental test conditions? c) Does the test lab know the default protocol test conditions? d) Does the test lab know the default timings? e) Does the test lab know the types of frames in the Scenarios? f) Does the test lab know the definitions for sequences timings application and measurement? g) Does the test lab know the T1T/T2T/T3T/T4T Memory Layouts? h) Does the test lab know the ICS parameters and options? i) Can the test lab perform the manipulation of the IUT before and during the testing? j) Does the test lab know the Type 1/2/3/4 Tag Command/Response Exchanges? k) Does the test lab know the parameters Values? l) Can the test lab perform and verify all the T1TOP/T2TOP/T3TOP/T4TOP test cases? m) If the case is a FAIL, can the test lab give the comment to the client? 2.6 Logical Link Control Protocol [LLCP] Testing Test Lab Audit Manual Page 12

15 Test Lab Audit Questions This part is mandatory for ATLs, but optional for RTOs. a) Is the Test Lab familiar with NFC-Forum Logical Link Control Protocol Specification and NFC-Forum Test Case for LLCP? b) Does the test lab know the default environmental test conditions? c) Does the test lab know the default test conditions for LT as target? d) Does the test lab know the default test conditions for LT as initiator? e) Does the test lab know the pre-and post-processing? f) Does the test lab know the default timing? g) Does the test lab know the parameters Values? h) Does the test lab know the definitions for sequences timings application and measurement? i) Can the test lab perform and verify all the LLCP test cases? j) If the case is FAIL, can the test lab give the comment to the client? 2.7 Simple NDEF Exchange Protocol Testing This part is mandatory for ATLs, but optional for RTOs Test Lab Audit Manual Page 13

16 Test Lab Audit Questions a) Is the test lab familiar with NFC-Forum Simple NDEF Exchange Protocol Specification and NFC-Forum Test Case for SNEP? b) Does the test lab know the default environmental test conditions? c) Does the test lab know the default protocol test conditions? d) Does the test lab know the pre-and post-processing? e) Does the test lab know the default timing? f) Does the test lab know the parameters Values? g) Does the test lab know the definitions for sequences timings application and measurement? h) Can the test lab perform and verify all the SNEP test cases? i) If the case is FAIL, can the test lab give the comment to the client? 2.8 Analog Testing a) Is the test lab familiar with NFC-Forum Analogue Specification and NFC-Forum Test Case for Analogue? b) Does the test lab know the default environmental test conditions? c) Does the test Lab know Reference Equipment Verification Tests and has process and required facilities also verification records? d) The Test Lab shall perform a reference antenna verification based on calibration procedures defined in Analog technical specification, Annex B.4 and B.5, before certification testing. e) Does the test lab know the default protocol values and test scenarios? f) Does the test lab know the default timing? g) Does the test lab know the positioning conventions and requirements? h) Does the test lab know the geometrical naming conventions? i) Does the test lab know the operating volume? j) Does the test lab know the position of each test point? k) Do you have a verification process to control positioning deviation before testing? l) Do you have solution to control positioning accuracy within 95% confidence level? m) Does the test lab know the signals description? Test Lab Audit Manual Page 14

17 Test Lab Audit Questions n) Does the lab calculate the uncertainties? Is there the uncertainty evaluation process and document for the ANALOG test tool? o) When a test case contains at least one position where the communication or where criteria are not met, can the lab judge the test case? p) Can the lab perform the power level measurement? q) Can the lab perform the waveform characteristics measurement? r) Can the lab perform the load modulation measurement for NFC-A, B? s) Can the lab perform the carrier frequency measurement? t) If the tool requires the 8-shape coil, can the lab demonstrate how and when to use the 8- shape coil? u) Can the lab perform the power level adjustment? v) Can the lab perform the waveform characteristics adjustment? w) Can the lab perform the load modulation adjustment? x) Can the test lab perform and verify all the analogue test cases? y) If the case is a FAIL, can the test lab give the comment to the client? Test Lab Audit Manual Page 15

18 Revision History A. Revision History The following table outlines the revision history. Table 1: Revision History Document Name Authorized Test Lab Audit Manual Revision & Release Date Version , May 6, 2014 Status Change Notice Supersedes Final Authorized Test Lab Audit Manual Version , July 8, 2014 Draft Version , May 6, 2014 Authorized Test Lab Audit Manual Version November 20,2014 Final Version , July 8, 2014 Test Lab Audit manual Version , Final Changed name of document from ATLM to TLM to include both ATLs and RTO. Version November 20,2014 Test Lab Audit Manual Page 16