Next Steps for WHOIS Accuracy Global Domains Division. ICANN June 2015

Transcription

1 Next Steps for WHOIS Accuracy Global Domains Division ICANN June 2015

2 Agenda: Next Steps for WHOIS Accuracy Reporting System Introduction and Implementation Approach Pilot Project and Lessons Learned Phase 1 Status Phase 2 Status and Compliance Q & A 2

3 Introduction

4 Background and Goals WHOIS activities at ICANN Policy, Implementation, Technical Where does fit? Major implementation initiative 2012 WHOIS RT and GAC Advice Key objective: systematically improve accuracy Multi-phase project Public reports Compliance component And now for the detail. 4

5 Background and Goals Mandate The Board directed the CEO to establish a project to: Proactively identify inaccurate gtld registration data, exploring the use of automated tools Forward potentially inaccurate records to registrars for action Publicly report on the resulting actions to encourage improvement Objective Identify and report in a way to improve quality of the data in the WHOIS 5

6 Phased Implementation of Project NOW Pilot: Proof of Concept Tested processes for data collection and validation. Completed March 2015 Phase 1: Syntax Validation Is the record correctly formatted? Target Report: August 2015 Phase 2: Operational Validation Does the go through, phone ring, mail deliver? Target Report: December Phase 3: Identity Validation, TBD, if at all: Is the contacted individual responsible for the domain? 6

7 Utilizing a Cross-Functional Team!"#$$%&'()% *++%,-./#&!,$0% ",$&/#"&1#2%",3-2!#$".% /.*!0&/#/%0./4!".0% 2.*#2%!&%5%-/,+1"&% 3#$#*.3.$&% $,/"% :;!<0.% +!*!"./&% 1-1% 4'6789%&'()% Accuracy Reports 7

8 ARS Project Approach Identify sample records Collect WHOIS records for sample Select subsample for accuracy testing Perform accuracy testing Analyze results & produce report Compliance follow up with registrars 8

9 Roadmap for Phases 1 & 2 1Q 15 2Q 15 3Q 15 4Q 15 1Q 16 2Q 16 3Q 16 4Q 16 1Q 17 2Q 17 Pilot Public Comment Phase 1 Phase 2 Report Publication!! Pilot is complete!! Phase 1 Syntax Report on track for publication in August 2015!! Phase 2 Operational report, expected in December 2015! Followed by new Phase 2 reports each six months 9

10 Lessons Learned from the Pilot

11 Opportunities for Improvement from the Pilot Pilot was successful as a proof of concept. Two major areas of learning:!"#$%"#&'! Align to RAA! Respect effective date! Registrant, Tech & Admin contacts (%)*"+,-'! Statistical significance! Reasons for inaccuracy! Actionable data 11

12 Phase 1 Syntactic Accuracy

13 Phase 1 - Building on Lessons Learned from Pilot Registrar Accreditation Agreement Requirements Phone Postal!! Criteria posted to Knowledge Center on: whois.icann.org Syntactic Accuracy Range (0-9) 13

14 ARS Phase 1 Report Expectations Accuracy Statistics by Segment 95% confidence intervals, +/- 5% margin of error Reporting syntactic accuracy for the following segments: The gtld space, by region and in total New gtlds compared to prior (legacy) gtlds 2013 RAA records compared to 2009 RAA records Compliance will be provided report of all inaccurate records for registrar follow up Summary Report will Focus on Why Records are Inaccurate Understanding the errors can enable: Registrar improvements Registrant updates / corrections Community to consider improvement initiatives based on data 14

15 Phase 1 On Track for Publication in Mid-August NOW Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Lessons Learned & Vendor Coordination Accuracy Criteria Refinement Data Collection Accuracy Testing Data Analysis & Report Development Report Publication!! Phase 1 Criteria published to: Knowledge Center on whois.icann.org!! Accuracy Testing of 10k records underway, expected completion in early July 2015!! Planning a webinar in August 2015 after publication to explain results 15

16 Phase 1 Demographics At Time of Sample Records in gtlds Prior TLDs New gtlds 2013 RAA Registrar 100k Sample 157M 96.85% 3.15% +95%* AFR LAC EUR APAC N.A RAA GF 2013 RAA 2013 RAA New gtlds Prior gtlds.07% 3% 23% 24% 49% 3% 51% 46% 25% 75% 10k Sub-sample AFR LAC EUR APAC N.A RAA GF 2013 RAA 2013 RAA New gtlds Prior gtlds 7% 18% 19% 21% 35% 18% 44% 38% 20% 80% * Majority of these are grandfathered 2013 RAA records, record created prior to effective date of 2013 RAA 16

17 Phase 2 Operational Accuracy

18 Phase 2 Operational Accuracy Phase 2 = Syntax + Operability Examples of operability tests: Does the go through / not bounced back? Phone: Does the number ring when dialed? Postal: Is the address deliverable? Phase 2 Criteria Aligned to RAA Obligations Contact information in the WHOIS must be accurate Working standard is used for intended purpose, i.e. contactable Lessons learned from Phase 1 will be incorporated & criteria updated for Phase 2 18

19 Phase 2 Implementation Plan $,:% Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Accuracy Criteria Refinement Data Collection Accuracy Testing Data Analysis & Report Development Report Publication 19

20 and Compliance

21 Compliance Pilot Goal of Compliance Pilot: Test the proof of concept: Use data to generate and forward WHOIS inaccuracy and WHOIS format complaints to registrars. Summary of Events from January April 2015: Telephone and inaccuracy reports sent to contractual compliance Conducted initial review and validation of the data and collaboration with the ICANN and vendors. Uploaded the data into the complaint processing system. Began processing complaints. Stopped processing to address data issues based on registrar feedback. Resumed complaint processing. Closed complaints in system if data was incomplete or did not meet the contractual criteria. 21

22 Compliance Pilot Overview Complaint volume and outcome 10,510 complaints tickets created 71 tickets sent to registrars 10,439 closed before sending to Registrars (see below) Top Closure Resolve Codes: Incomplete (9941) Domain not registered (337) Domain suspended or canceled (208) Complaint inconsistent with current WHOIS (12) Data changed (9) Registrar verified correct (8) Note: some complaints are closed with mul+ple closure codes; total will not equal to 10,510 22

23 Compliance Pilot (continued) Lessons Learned Inaccuracy criteria used for the sampling was not aligned with RAA/ICANN process: Cross-team collaborated to align on test criteria. Phase 1 Validation Criteria published at: validation-criteria-01jun15-en.pdf Ensure future reports are complete. Large complaint ticket influx burdened the complaint processing system. Separate data files from vendors caused inefficiency and duplication. Request to consolidate the reports and where appropriate all identified inaccuracies for a domain are placed in one record. 23

24 WHOIS Accuracy Reporting System Enforcing Contractual Obligations Registrars must investigate and correct inaccurate WHOIS data per: Section of 2009 and 2013 RAA and WHOIS Accuracy Program Specification of 2013 RAA. Registrars under 2013 RAA must use WHOIS format and layout required by Registration Data Directory Service (WHOIS) Specification. WHOIS inaccuracy and WHOIS format complaints created from data will follow the Contractual Compliance Approach and Process as published at: Failure to respond or demonstrate compliance during complaint processing will result in a Notice of Breach (and publication of notice on icann.org). ICANN will continue to give priority to complaints submitted by community members. 24

25 Community Input Processes Registrar Advisory Panel Topics Accuracy criteria (which were also published) Method/mechanism for delivering inaccurate WHOIS records to registrars Method/mechanism for registrar reporting to ICANN Compliance on actions taken Public Comment Outcomes / metrics Compliance enforcement process and results General feedback Could lead to formation of advisory group, depending on issue complexity or contentiousness. 25

26 Summary 1 Phased approach to ARS implementation. 2 Phase 1 Syntax on track for report in August Phase 2 Operational Kicking off in Q Report in December Compliance to follow up with Registrars. Questions? 3 26