Applied Data Governance - Part 3

Size: px

Start display at page:

Download "Applied Data Governance - Part 3"

Warren Barton
5 years ago
Views:

1 Applied Data Governance - Part 3 Day in the Life of a Reference Data Steward Jesse Lambert and Jack Spivak, TopQuadrant Inc. May 17, 2018

Questions and Answers Jesse Lambert Previous Webinar: Applied Data Governance - Part 1 A Day in the Life of a Business Steward https://www.topquadrant.

2 Today s Program 1. Introduction: Benefits of Managing Reference Data in a Comprehensive Governance Environment 2. Quick Poll 3. Demo: Day in the life of a Reference Data Steward Jack Spivak 4. Quick Poll 5. Questions and Answers Jesse Lambert Previous Webinar: Applied Data Governance - Part 1 A Day in the Life of a Business Steward Previous Webinar: Applied Data Governance - Part 2 A Day in the Life of a Technical Data Steward Copyright 2018 TopQuadrant Inc. Slide 2

Empower people and drive results by making enterprise information meaningful

3 TOPQUADRANT COMPANY TOPQUADRANT COMPANY FOUNDATION TopQuadrant was founded in 2001 Strong commitment to standards-based approaches to data semantics MISSION Empower people and drive results by making enterprise information meaningful FOCUS Provide comprehensive data governance solutions Copyright 2018 TopQuadrant Inc. Slide 3

Introduction: Reference Data in TopBraid EDG What is Reference Data?

6 Increasing: Per Value Data Quality Importance Semantic Content Reference Data: Critical Data with Critical Impact Increasing: Volume of Data Population Later in Time Shorter Life Span Metadata Reference Data Transaction Structure Data Enterprise Structure Data Transaction Activity Data Transaction Audit Data Classifies and categorizes other data Often includes look-up table and codetable data across the enterprise. May include internally developed (private) codes or externally maintained (public) codes 6 Reproduced with permission from Malcolm Chisholm Copyright 2018 TopQuadrant Inc. Slide 6

7 Why Govern Reference Data? Reference Data is Pervasive 20-50% of tables in a database are Reference Data 40% to 70% of the data used in financial transactions Reference Data has Major Impact The same table occurs in many diverse applications "Faulty reference data can cause monetary loss to a financial services organization. For example, misidentified products or data mismatching can cause transaction failures. (CapGemini report: Reference Data and its Role in Operational Risk Management ) Copyright 2018 TopQuadrant Inc. Slide 7

The Problem Confusion, wasted resources and errors when users can t understand the meaning of codes and how they are used Errors Waste Confusion Delay Our MRP application needs product codes to

8 The Problem Confusion, wasted resources and errors when users can t understand the meaning of codes and how they are used Errors Waste Confusion Delay Our MRP application needs product codes to schedule manufacturing runs and stage related materials I think this is the right product code set. How do you know? These codes relate to manufacturing country. Haven t our country codes changed recently? How do I find out? Copyright 2018 TopQuadrant Inc. Slide 8

of existing reference data sources with master Distribute centralized reference data where possible and

10 The Solution Centralize Reference Data, Enforce Governance Catalog existing usage of reference data Centralize definition, management and distribution of master reference data Systematize synchronization of existing reference data sources with master Distribute centralized reference data where possible and appropriate Standardize formal approval workflows to manage change Copyright 2018 TopQuadrant Inc. Slide 10

12 Today s TopBraid EDG Demo Harvested Data: Fictitious Corporate Manufacturing Dept. Example: ProductID Codes Internal Country Codes Use EDG to: Explore Relevant Data Assets Import Reference Data about ProductID Codes Connect with Internal Country Codes Link Internal Country Codes to Standard ISO 3166 Country Codes ISO 3166 Country Codes Copyright 2018 TopQuadrant Inc. Slide 12

EDG Reference Data Management 1 Preparation: Identify existing

into EDG Reference Data sets Create EDG Crosswalks.

Enterprise Master Reference Data Standard Reference Data Why?

Identify Reference Data and where it s used Why?

13 EDG Reference Data Management 1 Preparation: Identify existing reference data sources and usage 2 3 Import discovered reference data into EDG Reference Data sets Create EDG Crosswalks. Connect to standard reference data. Enterprise Master Reference Data Standard Reference Data Why? Interactively explore integrated view of enterprise data structure. Identify Reference Data and where it s used Why? Manage, control, govern, centralize distribution Why? Analyze, Compare, Understand Other Internal Reference Data Copyright 2018 TopQuadrant Inc. Slide 13

14 A Day in the Life Company TopBraid EDG centralizes authority and distribution for master copies of reference datasets. Already engaged in Reference Data Governance Initiative Have reference data used in a variety of ways and stored in a variety of locations Need a "gold standard" source of authority managed centrally that can be used to update the various reference datasets Copyright 2018 TopQuadrant Inc. Slide 14

15 A Day in the Life Personas Tony Reference Data Steward responsible for standardizing governance of ProductID codes and Country Codes Data Governance Officer responsible for assigning task Bob Copyright 2018 TopQuadrant Inc. Slide 15

16 A Day in the Life Governance Tasks Task 1: Bring ProductID codes under governance Tony Task 2: Update ISO 3166 Country Codes with new version Task 3: Create crosswalk between internal country codes and ISO 3166 Copyright 2018 TopQuadrant Inc. Slide 16

18 Demo Review The Reference Data Steward used EDG features: To locate reference data storage and usages Formalize workflows for notification, review, approval Import reference data Automated crosswalks Standard models connect reference data to usages for understanding and meaningful use Tony Copyright 2018 TopQuadrant Inc. Slide 18

19 A Day in the Life Governance Tasks Task 1: Bring ProductID codes under governance Navigate to areas of responsibility see related assets Create approval workflow for task Automatically model product reference data Link model to existing reference data about countries Create a new reference data container Import existing reference data to centralize management Tony Copyright 2018 TopQuadrant Inc. Slide 19

20 A Day in the Life Governance Tasks Task 2: Update ISO 3166 Country Codes Areas of responsibility collect related assets Create approval workflow for task Clone and version existing ISO country reference data Import updated ISO reference data to existing ISO dataset Comparison report to verify changes against prior version Verify automatic distribution to linked assets Update crosswalk from internal country codes to updated ISO 3166 Tony Copyright 2018 TopQuadrant Inc. Slide 20

21 A Day in the Life Governance Tasks Task 3: Update Internal to ISO 3166 Crosswalk Areas of responsibility collect related assets Create approval workflow for task Clone and version existing ISO country reference data Import updated ISO reference data to existing ISO dataset Comparison report to verify changes against prior version Verify automatic distribution to linked assets Update crosswalk from internal country codes to updated ISO 3166 Tony Copyright 2018 TopQuadrant Inc. Slide 21

23 TopBraid EDG Reference Data Update Support Applications, services, datasets and reports using reference data can be updated from: 1) exports of Reference Datasets from EDG Local variants of enterprise reference data Enterprise reference data 2) direct API access to Reference Datasets in EDG Copyright 2018 TopQuadrant Inc. Slide 23

24 EDG Connects - Webinar Series: Applied Data Governance Previous Webinar - Part 1: Business Stewardship Previous Webinar - Part 2: Technical Data Stewardship Business Glossary describing terminology Metadata about applications Metadata about data elements Today s Webinar - Part 3: Reference Data Stewardship Enterprise Reference Data (example: Internal Country Codes) Enterprise Standard Reference Data (example: ISO 3166 Country Codes) Copyright 2018 TopQuadrant Inc. Slide 24

Vocabulary: Shared terms we can use Statements: Saying things OWL SHACL RDFS SPARQL RDF Query: What

25 Graph Representation + Semantic Open Standards Things Relationships Classification: What is this thing? Rules: Is that term used correctly? What do you need to know? You can't say that here! Vocabulary: Shared terms we can use Statements: Saying things OWL SHACL RDFS SPARQL RDF Query: What did you say? Relationships tame complexity and pave the road to governance Copyright 2018 TopQuadrant Inc. Slide 25

27 Reference Data in TopBraid EDG - Benefits Reduce independent maintenance of code tables Reduce data quality problems due to coding errors Reduce the cost of designing code tables for databases Reduce data integration issues due to inconsistent codes Make informed decisions based on reference data Copyright 2018 TopQuadrant Inc. Slide 27

28 Governing Reference Data - Bottom Line Benefits Increased Quality and Efficiency Enhanced value and reduced cost Preserve meaning across the enterprise for understanding and reuse Understanding and insight to respond to opportunities Copyright 2018 TopQuadrant Inc. Slide 28

29 Core flexibility and extensibility Add user defined models, assets and properties as needed (model-driven) Models: pre-built and user defined Support multiple types of governance assets and activities Flexible Connections: describe relation between any type of assets or activity Enable people (UI) and software (APIs/web services) to view, follow and query the connections to answer core questions, e.g. Where did this come from? Bridge data silos for comprehensive data governance TopBraid EDG Governance - Benefits Copyright 2018 TopQuadrant Inc. Slide 29

30 Questions?

TopBraid EDG Governance - Features Metadata and Data Ingestion Discovery, Profiling and Enrichment Governance Search, Reporting and Visualization

31 TopBraid EDG Governance - Features Metadata and Data Ingestion Discovery, Profiling and Enrichment Governance Search, Reporting and Visualization Collaboration Systems Integration Enterprise-ready Copyright 2017 TopQuadrant Inc. Slide 31

32 Thank You! To Learn More Contact us: at to: Discuss our governance capabilities Request a more targeted demo of TopBraid EDG Ask for a free EDG evaluation account EDG Product Info: Other EDG demos/webinar recordings: Previous Webinar: Applied Data Governance Part 1: A Day in the life of a Business Steward Previous Webinar: Applied Data Governance Part 2: A Day in the life of a Technical Data Steward Webinar: Data Governance for the Connected Enterprise: TopBraid EDG in Action Using TopBraid Reference Data Manager 5.0 Webinar: The Foundations of Successful Reference Data Management with Malcolm Chisholm Webinar: Why is Reference Data Governance Mission Critical? with Aaron Zornes Copyright 2018 TopQuadrant Inc. Slide 32

Real World Data Governance- Part 1

Real World Data Governance- Part 1 Day in the Life of a Business Steward Jesse Lambert and Jack Spivak, TopQuadrant Inc. November 30, 2017 Today s Program TopBraid EDG: A Day in the Life of a Business