ArcGIS Data Reviewer: Ensuring Accurate and Complete Data to Meet Your Mission. John Grammer Kevin Pusey

Transcription

1 ArcGIS Data Reviewer: Ensuring Accurate and Complete Data to Meet Your Mission John Grammer Kevin Pusey

2 Workshop agenda Defining data quality What is ArcGIS Data Reviewer? Automated review Semi-automated review Managing errors What s New Summary/resources

3 Defining data quality

4 Defining quality A technical perspective ISO-19157:2013 Geographic information Data quality

5 Defining quality A technical perspective Spatial Accuracy Lake feature has been shifted ISO-19157:2013 Geographic information Data quality

6 Defining quality A technical perspective Spatial Accuracy Thematic Accuracy Swimming pool captured as wetland ISO-19157:2013 Geographic information Data quality

7 Defining quality A technical perspective Spatial Accuracy Thematic Accuracy Completeness Neighborhood with missing building footprint ISO-19157:2013 Geographic information Data quality

8 Defining quality A technical perspective Spatial Accuracy Thematic Accuracy Completeness Logical Consistency Highway with road surface type gravel ISO-19157:2013 Geographic information Data quality

9 Defining quality A technical perspective Spatial Accuracy Thematic Accuracy Completeness Outdated chart showing open runway Logical Consistency Temporal Quality Updated chart should show closed runway ISO-19157:2013 Geographic information Data quality

10 Defining quality A technical perspective Spatial Accuracy Thematic Accuracy Completeness Logical Consistency Used to route emergency vehicles Temporal Quality Usability ISO-19157:2013 Geographic information Data quality Used to map National Parks

11 Defining quality Sources of data quality requirements Industry standards / specifications

12 Defining quality Sources of data quality requirements Industry standards / specifications Subject matter experts

13 Defining quality Sources of data quality requirements Industry standards / specifications Subject matter experts Training and experience

14 Defining quality Sources of data quality requirements Industry standards / specifications Subject matter experts Training and experience Quality assurance plan

15 Data quality management Capabilities of the ArcGIS platform Geodatabase integrity Schema constraints Attribute rules Versioning Advanced data types ArcGIS Data Reviewer Automated review Semi-automated review Error management Quality reporting Topologies Parcel fabric Geometric/Utility network

16 What is ArcGIS Data Reviewer? Data quality management in the ArcGIS platform Apps Data Reviewer for Desktop - ArcGIS Pro - ArcMap Desktop APIs Data Reviewer for Server - ArcGIS Server (standard or higher) Online Enterprise Data Reviewer API - JavaScript - ArcGIS Pro SDK for Microsoft.NET Web AppBuilder for ArcGIS

17 Managing quality control Quality control processes Semi-automated review Automated review Quality reporting

18 Automated review

19 Types of quality control Automated review Fast Consistent and repeatable Objective 100% coverage

20 Automating data validation Implementing quality requirements configurable checks - Feature integrity - Collection rules - Attribution - Feature and table values - Spatial - Spatial relationships

21 Implementing data quality rules Rule implementation workflow Authoring workflow - Identify and document requirements - Identify relevant validation methods in ArcGIS - Implement data quality rules Industry standards / specifications Subject matter experts Training and experience Quality assurance plans

22 Where to start Leveraging templates Data Reviewer templates - Local government - Topographic mapping - Utilities - Electric - Gas - Water - Water resources solutions.arcgis.com Based on Esri industry models Use as starting point

23 Authoring Data Quality Rules Demo

24 Automating feature validation

25 Methods for executing data validation Validating features using Reviewer Rules Validation in ArcGIS Pro Run Reviewer Rules

26 Methods for executing data validation Validating features using Reviewer Batch Jobs Validation in ArcGIS Pro Run Reviewer Rules Geoprocessing

27 Validating Features Demo

28 Semi-Automated Review

29 Types of quality control Semi-automated review Guided Workflows Streamlined processes Subjective Sampling

30 Semi-automated review Leveraging ArcGIS Desktop Tools supporting semi-automated review - Redlining missing features - Flagging existing features in error - Random sampling

31 Types of Quality Control Cheyne Cl MAJOR ROAD MINOR ROAD UNPAVED ROAD Inconsistent attributes Missing features Misplaced features

32 Semi Automated Review Demo

33 Managing Errors

34 Managing quality control QC lifecycle management Review Correct Verify Find and record errors Perform edits or Note exceptions Acceptable or Unacceptable

35 Managing Errors Demo

36 What s New 10.7 / 2.3

37 Automated review Key enhancements in ArcGIS Pro Attribute Rule integration - Attribute (constraint) Rules enforce data integrity during editing - Reviewer checks assess a feature s - Integrity - Spatial relationships Domain Cutbacks Finds attribute segments values where that the do angle not comply between with segments coded value in a or range polygon domains or polyline that are is below associated a specified with an minimum attribute value. field. Query Duplicate Attributes Vertex Finds features vertices from based the on same a query feature WHERE that are clause collocated run against or row within attributes. a specified tolerance of one another. Feature on Feature Finds features that have a specific relationship, either from two different feature layers or within the same feature layer. Monotonicity Searches Z or M-enabled polylines for vertices that are not strictly increasing or decreasing in value or are trending based on specified conditions. Polyline or Path Closes on Self Finds paths or lines in polyline features that close themselves.

38 Automated review Key enhancements in ArcGIS Pro Evaluate Polyline Length Finds polyline segments, parts or features that have a line length within a specified tolerance. Attribute Rule integration - Attribute (constraint) Rules enforce data integrity during editing - Reviewer checks assess a feature s - Integrity - Spatial relationships - Geometric properties Evaluate Part Count Finds features with a part count that is within a specified value. Evaluate Polygon Perimeter and Area Finds polyline segments, parts, or features that have a line length within a specified tolerance. Evaluate Vertex Count Finds polyline or polygon features that have a vertex count within a specified tolerance.

39 ArcGIS Workflow Manager integration Results management Reviewer Custom Steps - Create Reviewer Session - Run Reviewer Batch Job - Delete Reviewer Sessions Provide - Return codes for branching - Configurable messaging - Detailed logging - ArcMap/Pro/Server execution

40 Workshop review Defining data quality Forms of data quality control - Automated review - Semi-automated review ArcGIS Data Reviewer - Automated validation checks - Semi-automated tools - Error management

41 Want to learn more? Documentation - Desktop desktop.arcgis.com

42 Want to learn more? Documentation - Desktop - Server enterprise.arcgis.com

43 Want to learn more? Documentation - Desktop - Server Training (training.esri.com) - Assessing Data Quality using ArcGIS Data Reviewer (Seminar) - Evaluating Positional Accuracy Using ArcGIS Data Reviewer for Desktop (Seminar) - Data QC with ArcGIS: Automating Validation (Web Course) - Data QC with ArcGIS: Visual Review (Web Course) - Quality Control Using ArcGIS Data Reviewer for Desktop (Instructor-Led)

44 Want to learn more? Documentation - Desktop - Server Training - Assessing Data Quality using ArcGIS Data Reviewer - Evaluating Positional Accuracy Using ArcGIS Data Reviewer for Desktop - Data QC with ArcGIS: Automating Validation - Data QC with ArcGIS: Visual Review - Quality Control Using ArcGIS Data Reviewer for Desktop GeoNet (community.esri.com) - Data Reviewer place

45 Questions?

46 Please Take Our Survey on the App Download the Esri Events app and find your event Select the session you attended Scroll down to find the feedback section Complete answers and select Submit

47