Compliance & Certification Phase 2 Path to Certification

Transcription

1 Compliance & Certification Phase 2 Path to Certification Jose A. Rodrigo, AT4 wireless 11 November November 2014 AllSeen Alliance 1

2 Agenda 1. C&C Process Overview 2. Prepare / Apply / Test / Certify 3. Certification Releases 4. Product Categories 5. Certification Categories 6. C&C Process Documents 7. Glossary 20 November 2014 AllSeen Alliance 2

3 C&C Process Overview 1 Prepare Verification of the OEM readiness Preparation for the product Certification 2 Apply Submission of the Certification Application Arrangement of the Certification Testing 4 Certify Compliance assessment and Certificate grant Registration of the product in database 3 Test Execution of Certification Testing in the 3rd Party Test Lab Fix of failures and re-test 20 November 2014 AllSeen Alliance 3

4 C&C Process: Prepare 1 Prepare 4 Certify 2 Apply 3 Test Internal verification of the OEM readiness for product certification: Perform internal verification testing of the product Become familiar with the C&C process, requirements and documents Select the Certification Release to be used for the product certification Produce documents required for C&C process including ICS and IXIT Develop a Candidate Test Plan in order to identify the applicable tests Perform pretesting according to the Candidate Test Plan covering Conformance and Interoperability testing using either the Self- Certification Test Tool or the Certification Test Tool Do NOT need to be a member of AllSeen as pre-requisite of the C&C process 20 November 2014 AllSeen Alliance 4

5 C&C Process: Prepare Prepare Certification Agreement Certification Program Guide Pre-testing (optional) Certification Policy ICS/IXIT Template ICS/IXIT Certification Preparation Process Start OEM performs Development and QA testing OEM becomes familiar with program requirements OEM selects Certification Release OEM completes the Implementation Conformance Statement 1 Prepare 4 Certify - Interface Definitions - Test Case Specs Certification Release - Interface Specification - Test Specs & TCMT - TCCL 2 Apply 3 Test Test Tool Candidate Test Plan OEM develops Candidate Test Plan OEM performs Test Plan pre-testing using Test Tool Apply Inherited Test Results 20 November 2014 AllSeen Alliance 5

6 C&C Process: Apply 1 Prepare 4 Certify 2 Apply 3 Test OEM submits the Certification Application to Certification Authority and arranges the testing with the 3rd Party Test Lab: Select the Certification Release to be used for the product certification Select the Certification Categories that are applicable to the product certification: End Product Module Product Integration New Product Product Variant Product Update Rebranding Select the 3rd Party Test Lab to be used for the Certification Testing Fill and submit the Certification Application with details of the product to certify, attaching associated documents (ICS/IXIT, User Manual, etc.) 20 November 2014 AllSeen Alliance 6

7 1 Prepare 2 Apply C&C Process: Apply Apply Prepare Certification Process Start 4 Certify 3 Test Certification Release Selection Certification Category Selection Certification Application Assessment Certification Application Template Authorized Laboratory Selection Certification Application Filling Certification Application Filled Certification Application Submission Certification Documents Generation ICS/IXIT User Manual Declarations Parent Product Reference Application Approval? Yes Submission of Documents to Certification Body Test No 20 November 2014 AllSeen Alliance 7

8 C&C Process: Test 1 Prepare 4 Certify 2 Apply 3 Test Certification Testing in the 3rd Party Test Lab when required: OEM: Arranges shipment of product samples to the 3rd Party Test Lab Can be present during testing to investigate potential failures Fixes such failures and 3rd Party Test Lab re-tests the fixes Pays Testing Fee to the 3rd Party Test Lab 3rd Party Test Lab: Generates the Test Plan applicable to product testing Executes Conformance and Interoperability testing (few days) Stores results in a repository place to allow OEM to consult them Issues a Test Report 20 November 2014 AllSeen Alliance 8

9 C&C Process: Test 1 Prepare 4 Certify 2 Apply 3 Test Test Apply Technical Assessment Certification Release - Test Specs & TCMT - TCCL Generation of Test Plan Waivers Test Report(s) Test Plan Testing Fee Payment Issues Fixing Detailed Test Results Conformance & Interoperability Testing Certify Fail Test Result? Pass 20 November 2014 AllSeen Alliance 9

10 C&C Process: Test 1 Prepare 4 Certify 2 Apply 3 Test The Confidentiality of the 3rd Party Test Lab can be ensured by means of any (or all) of the following actions: ISO accreditation of the 3rd Party Test Lab by an internationally recognized accreditation body. Confidentiality is mandatory: To have policies and procedures to ensure the protections of its customers confidential information and proprietary rights, including procedures for protecting the electronic storage and transmission of results Confidentiality agreement between the 3rd Party Test Lab and the AllSeen Alliance covering all testing operations of the C&C Program Confidentiality agreement between the 3rd Party Test Lab and each OEM before starting the testing of its product 20 November 2014 AllSeen Alliance 10

11 C&C Process: Certify 1 Prepare 4 Certify 2 Apply 3 Test Compliance assessment by the AllSeen Alliance, granting of the Certificate and registration of the product as certified: Assessment of the product documentation to prove its compliance When testing is required, assessment of the Test Report of the product OEM pays the Certification Fee to the AllSeen Alliance (decision needed by WG) Certification Authority issues the Certificate of Conformity based on the assessment of the evidences submitted by the OEM and the 3rd Party Test Lab Certification Authority registers the product in the Certified Products Registry Database 20 November 2014 AllSeen Alliance 11

12 C&C Process: Certify 1 Prepare 4 Certify 2 Apply 3 Test Certify Test No Submission of Documents to Certification Body Certification Documents Assessment Technical Approval? Yes Certification Fee Payment Submission of Documents to Certification Authority Certification Assessment Certification Approval? Yes Issue of Certificate of Conformity Product Registration in AllSeen Alliance Cert. Products Database No Certificate of Conformity AllSeen Alliance Cert. Products Database 20 November 2014 AllSeen Alliance 12

13 Certification Releases 20 November 2014 AllSeen Alliance 13

14 Product Categories End Product AllSeen Product No Intended to be sold as a certified product to be embedded in other device? No Includes and already certified module/device? Yes Yes Module Integrated Product 20 November 2014 AllSeen Alliance 14

15 Product Categories End Product An End Product is a product including AllJoyn functionality intended to be sold to the final customer and subject to AllSeen certification Module A Module is a product with AllJoyn functionality that can be embedded in another Product Integration A Module can be AllSeen Certified on its own allowing Product Integrations reuse the Module certification process Product Integration A Product Integration is a product that embeds an already certified Module, or another certified End Product, to create a new End Product 20 November 2014 AllSeen Alliance 15

16 Product Categories End Product An End Product is a product including AllJoyn functionality intended to be sold to the final customer and subject to AllSeen certification Module A Module is a product with AllJoyn functionality that can be embedded in another Product Integration A Module can be AllSeen Certified on its own allowing Product Integrations reuse the Module certification process Product Integration A Product Integration is a product that embeds an already certified Module, or another certified End Product, to create a new End Product 20 November 2014 AllSeen Alliance 16

17 Certification Categories Product ready for certification No Similar to an already validated product? No HW/SW modification of an already validated product? No Brand change of an already validated product? Yes Yes New Product Yes Parent Variant Product Variant Product Update Product Rebranding MyBrand Hw/Sw: Rev. 1 Original Original New Product MyBrand Hw/Sw: Rev. 1 Update MyBrand MyBrand Hw/Sw: Rev. 1 Hw/Sw: Rev. 2 MyBrand Hw/Sw: Rev. 1 MyBrand Hw/Sw: Rev. 1 Rebranding NewBrand 20 November 2014 AllSeen Alliance 17

18 Certification Categories New Product New Product A new product Certification is the first AllSeen certification for a product of any category Model A Hw/Sw: Rev. 1 Product Variant Certification of a new product with software and/or hardware set of modifications from an already certified product from which some certification testing could be reused Parent Product Model A Hw/Sw: Rev. 1 Product Variant Model B Hw/Sw: Rev November 2014 AllSeen Alliance 18

19 Certification Categories Original Product Product Update Product Update Certification of a new release of an already certified product with a modification compared to the certified product Product Re-branding Certification of a product whose differences related to an already certified product affect the branding of the product, upper applications, packaging and cosmetics Model A Hw/Sw: Rev. 1 Original Product Model A Hw/Sw: Rev. 1 Model A Hw/Sw: Rev. 2 Product Re-branding AnotherBrand Model Ω Hw/Sw: Rev November 2014 AllSeen Alliance 19

20 Certification Scenarios Examples Example 1 OEM: Product: Revision: Model A 1 Details: New AllJoyn product, which is not a derivative product from any other already certified Model A Rev. 1 Certification Scenario Product Category: End Product Certification Category: New Product Testing Needed: Complete 20 November 2014 AllSeen Alliance 20

21 Certification Scenarios Examples Example 2 OEM: Product: Revision: Model A 2 Details: OEM updates the Rev. 1 of Model A product creating Rev. 2 with Model A some changes (e.g. to solve some bugs) not affecting AllJoyn Rev. 1 functionality Certification Scenario Product Category: Certification Category: Testing End Product Product Update Model A Rev November 2014 AllSeen Alliance 21

22 Certification Scenarios Examples Example 3 OEM: Product: Revision: Model A 3 Details: OEM updates the Rev. 2 of Model A product creating Rev. 3 with Model A some changes (e.g. to solve some bugs in AllJoyn implementation Rev. 2 or adding AllJoyn functionality) Certification Scenario affecting AllJoyn Product Category: End Product functionality Certification Category: Product Update Testing Model A Rev November 2014 AllSeen Alliance 22

23 Certification Scenarios Examples Example 4 OEM: Product: Revision: Model B 1 Details: OEM develops a new Model B product which is based on or is Model A similar to Model A product, and intends to reuse testing from the Rev. 1 Certification of Model A Certification Scenario Product Category: End Product Certification Category: Testing Product Variant Partial or Model B Rev November 2014 AllSeen Alliance 23

24 Certification Scenarios Examples Example 5 OEM: Product: Revision: ModBrand & Model C 1 Details: New AllJoyn product, which is not a derivative product from any other already certified product Model C intended to be sold to other OEMs, so they can integrate Model C Certification Scenario in their products Product Category: Module Certification Category: Testing Needed: New Product Complete & 20 November 2014 AllSeen Alliance 24

25 Certification Scenarios Examples Example 6 OEM: Product: Revision: IntBrand β Model D 1 Details: OEM β develops a Model D & product, and buys Model C Model C product (Module) to OEM & to integrate it into Model D product to provide AllJoyn functionality Certification Scenario Product Category: Integrated Product Certification Category: Testing Needed: New Product Partial or None β Model D Rev November 2014 AllSeen Alliance 25

26 Certification Scenarios Examples Example 7 OEM: Product: Revision: NewBrand Model E 1 Details: OEM agrees with to Model A market Model A product with the brand of OEM. Model A product is rebranded to Model E product but AllJoyn functionality is Certification Scenario not affected in Product Category: End Product the rebranding Certification Category: Product Rebranding process Testing Needed: Rev. 1 Rev. 1 Model E 20 November 2014 AllSeen Alliance 26

27 C&C Process Documents Document Purpose Release Business Model Program Management Document Staffing Requirements Interoperability Event Rules Considerations to define the business model to be used by the Compliance & Certification Program Rules for OEMs, Authorized 3 rd Party Test Labs and AllSeen Alliance to manage certification of products Description of the profiles of the resources needed o setup and manage the AllSeen Alliance Compliance & Certification Program Definition of the elements required to organize and setup AllSeen Alliance interoperability events and participation rules November 2014 AllSeen Alliance 27

28 C&C Process Documents Document Purpose Release Operational Management Document Information Conformance Statement (ICS) Test Case Mapping Table (TCMT) Description of the activities to be performed by all involved parties to follow the Program Management Document rules Definition of the mandatory and optional statements that define the AllSeen functionality supported by each product Definition of the correspondence between each test case and the specific ICS items and features November 2014 AllSeen Alliance 28

29 Glossary Conformance Testing Testing performed using the Test Tool to verify the compliance an applicant AllJoyn implementation with AllJoyn features and service framework interface definitions Interoperability Testing Testing performed according to AllSeen Alliance Interoperability test cases to verify that an applicant AllJoyn implementation can interoperate with other applicant AllJoyn devices 20 November 2014 AllSeen Alliance 29

30 Glossary Authorized 3 rd Party Test Laboratory ISO accredited entity authorized by AllSeen Alliance to perform certification testing Certification Authority Entity responsible for supplying product certificates for the use of AllJoyn functionality Certification Body Entity that assesses the documentation submitted for product certification, reviewing the correctness of the generation of the Test Plan, the applicability of the test cases to the products, the execution of the tests according to the Test Plan and the results of the tests 20 November 2014 AllSeen Alliance 30

31 Glossary Implementation Conformance Statement (ICS) Table that indicates if the mandatory and optional features and functionalities that could be implemented in the product to test are supported or not Implementation extra Information for Testing (IXIT) List of additional parameters that together with the ICS defines completely the features and functionalities supported by the product to test Test Case Mapping Table (TCMT) Defines test structures, sequence charts and test procedures for testing the Interface Definitions of the product to test. It also maps test cases to specific ICS items and features 20 November 2014 AllSeen Alliance 31

32 Glossary Test Case Control List (TCCL) Lists all Test Cases and their associated test category. It serves as a reference document that can be updated at short notice without any update to the Test Specifications Waiver The waiver allows an OEM seeking product certification to request an exemption from a specific certification requirement that will prevent or delay certification. The AllSeen Alliance will approve or reject the waiver request based on both technical and commercial criteria 20 November 2014 AllSeen Alliance 32

33 Thank you Follow us on For more information on AllSeen Alliance, visit us at: allseenalliance.org & allseenalliance.org/news/blogs 20 November 2014 AllSeen Alliance 33