Oregon SQL Welcomes You to SQL Saturday Oregon

Transcription

1 Oregon SQL Welcomes You to SQL Saturday Oregon

2 Introduction to SQL Server 2012 MDS and DQS Peter Myers Bitwise Solutions

3 Presenter Introduction Peter Myers BI Expert, Bitwise Solutions BBus, MCSE, MCT, SQL Server MVP 15 years of experience designing, developing and maintaining software solutions based on Microsoft database and development platforms Based in Melbourne, Australia BID-399-P

4 Session Objectives To introduce SQL Server 2012 Master Data Services, with an emphasis on what is new in SQL Server 2012 To introduce SQL Server 2012 Data Quality Services To demonstrate how the two services can work together 5

5 Session Outline Enterprise Information Management SQL Server 2012 Master Data Services SQL Server 2012 Data Quality Services Demonstrations Developer Opportunities Resources 6

6 Enterprise Information Management TDWI Philip Russom Enterprise Information Management (EIM) is a best practice for creating, managing, sharing, and leveraging information in an enterprise, holistic manner that s aligned with strategic, datadriven business objectives Through team collaboration and tool interoperability, EIM seeks to improve the four Cs, namely the Completeness, Cleanliness, Consistency, and Currency of structured and unstructured data 7

7 SQL Server 2012 EIM SQL Server 2012 has evolved to include a rich set of services designed to improve the overall relevance and value of organizational information Empowers people to: Discover and resolve problems with data Streamline existing data management processes using familiar tools like Excel Provisions and manages enterprise information: Manage more effective data integration and management across the organization Deliver trusted information for Business Intelligence, data warehouse, and transaction processing workloads 8

8 SQL Server 2012 EIM Products Data Quality Services Master Data Services Integration Services Complete, Clean, Consistent and Current Data 9

9 SQL Server 2012 Master Data Services Master Data Services (MDS) is a SQL Server product for Master Data Management (MDM) MDS addresses several problems: No authoritative source reports can t be trusted No formal dimension maintenance capability Multiple stakeholders for the same record Inability to enforce data stewardship processes First released in SQL Server 2008 R2 The SQL Server 2012 release includes many new improvements and features 10

10 SQL Server 2012 Master Data Services Functionality Store Integrate & Share Enable Processes Identity, Attributes, Hierarchies WCF API Stewardship UI Secure by role Tables & Views Validation & Versions Manage Transactions Notifications & Workflows 11

11 SQL Server 2012 Master Data Services Sample Implementation ERP or other LOB System(s) SSIS MDM Server Application (Service) Administration Data Changes Web User Database Notification Outlook Cube Dimension SSIS 12

12 SQL Server 2012 Master Data Services New Improvements The Master Data Manager web interface has been improved and now uses Silverlight Microsoft Excel add-in to support: Easier data updates and management Simplified data model creation Integration with SQL Server 2012 Data Quality Services New staging interface (entity-based staging) New subscription views to export list data Numerous improvements centered around usability, robustness, security, scale and performance 13

13 SQL Server 2012 Master Data Services New Microsoft Excel Add-in Master lists of reference data can be distributed to anyone in the organization who uses Microsoft Excel For data stewards and administrators, supports: Creating entities and attributes Using DQS to match data before loading it into MDS For general users, supports: Retrieving, updating and publishing list data Working offline and publishing changes when ready Permissions determine the data users can view and update 14

14 Demonstration Introducing SQL Server 2012 Master Data Services 15

15 SQL Server 2012 Data Quality Services Data Quality Services (DQS) is a new knowledge-driven data cleansing product delivered in SQL Server 2012 Supports building Knowledge Bases that support correction and de-duplication of data Knowledge in a Knowledge Base can improve over time and can be reused by many solutions Integration Services 2012 includes a DQS Cleansing transform The Master Data Services Excel Add-in can leverage DQS 16

16 SQL Server 2012 Data Quality Services Data Quality Process Build Discover / Explore Data / Connect Knowledge Management Integrated Profiling Use Data Quality Projects 17

17 SQL Server 2012 Data Quality Services Components DQS consists of a Data Quality Server and the Data Quality Client The Data Quality Server is a SQL Server instance feature that consists of three SQL Server catalogs with data-quality functionality and storage The Data Quality Client is a standalone Windows application that allows data stewards, data experts, and IT Professionals to perform data quality operations, and supports: Creating and maintaining Knowledge Bases Creating and maintaining Data Quality Projects Monitoring data quality activities Managing system settings 18

18 SQL Server 2012 Data Quality Services Knowledge Bases Rationale: To cleanse data you need knowledge about it The Knowledge Base is a data repository of knowledge that enables professionals to understand their data and maintain its integrity Knowledge in a Knowledge Base is maintained in Domains, each of which is specific to a data field Domains capture the semantics of the data Domains can use online reference data Online DataMarket Reference Data Service Direct Online 3rd Party Reference Data Services 19

19 SQL Server 2012 Data Quality Services Knowledge Bases Composite Domains Values Matching Policy Knowledge Base Domains Rules & Relations Domains Represent the data type Reference Data 20

20 SQL Server 2012 Data Quality Services Data Quality Project A Data Quality Project is a means of using a Knowledge Base to improve the quality of source data by performing data cleansing and data matching activities Created and managed in the Data Quality Client Results can be exported to a SQL Server table or CSV file Two types: Cleansing Activity processed data is categorized as new, invalid, corrected, and correct Matching Activity used to prevent data duplication by identifying exact and approximate matches 21

21 SQL Server 2012 Data Quality Services DQS Cleansing SSIS Transform Implements data cleansing in an Integration Services 2012 data flow Configuration involves: 1. Defining a connection to a Data Quality Server 2. Selecting a knowledge base 3. Mapping input columns to domains 4. Selecting advanced statistical columns The output includes the original data and corrected data, together with status 22

22 Demonstration Introducing SQL Server 2012 Data Quality Services 23

23 Summary MDS is a next-generation MDM product delivered in SQL Server 2012 Leverage MDS to connect disparate information systems that share common master data DQS is a new knowledge-driven data cleansing product delivered in SQL Server 2012 Knowledge Bases support correction and/or de-duplication of data Knowledge in a Knowledge Base can improve over time and can be reused by many solutions SSIS 2012 includes a DQS Cleansing transform The MDS Excel Add-in can leverage DQS 24

24 Resources MDS Team Blog DQS Team Blog Publication: Data Quality and Master Data Management with Microsoft SQL Server 2008 R2 Advanced Techniques & Tools for Storing, Maintaining, Cleansing, and Merging Master Data Authors: Dejan Sarka and Davide Mauri 25

25 Resources Continued SQL Server 2012 Early Adoption Cook Book Free downloads of training content consisting of videos, presentations, demonstrations and hands on labs Based on all new SQL Server 2012 features not just BI Includes instructions to build your own virtual machine SQL Server 2012 Developer Training Kit Feedback Your feedback is valuable to improve the training kit 26

26 Thank You PASS Oregon SQL Oregon SQL LinkedIn 27