Oliver Engels & Tillmann Eitelberg. Big Data! Big Quality?
|
|
- Sophia Atkinson
- 5 years ago
- Views:
Transcription
1 Oliver Engels & Tillmann Eitelberg Big Data! Big Quality?
2 Sponsors help us to run this event! THX! You Rock! Sponsor Gold Sponsor Silver Sponsor Bronze Sponsor
3 You Rock! Sponsor Session 13:45 Track 1 Das super nerdige Solisyon Film- und Serienquiz
4 Save the date for exiting upcoming events PASS Camp 2017 Main Camp (4.12 Kick Off Abends) Lufthansa Training & Conference Center, Seeheim SQL Konferenz 2018 PreCon: MainCon: Darmstadmium, Darmstadt More information at PASS booth
5
6 Big Data Big Quality?
7 DQM Theory: What is Data Quality? Data Quality represents the degree to which the data is suitable for business usages Data Quality is built through People + Technology + Processes Bad Bata = Bad Business
8
9 DQM Theory: Cost of Data Quality The costs of bad data quality are most of the time hidden or implicite accepted Data quality cost Costs because of bad data quality Cost of optimizing data quality Direct Indirect Prevention Discovery Cleansing
10 DQM Theory: Cost of Data Quality Cost Costs due to bad data quality Costs to avoid or correct bad data quality 80% Quality 100%
11 DQM Theory: Reasons for bad data quality Data Capturing Expiration Usage Data Quality Processes Architecture Definition
12 DQM Theory: Tasks to solve bad Data Quality Standard Workflow in Data Quality Optimization Validation & Profiling
13 Big Data Big Quality?
14 No! Even more problems!
15 PAC 2012
16 Big Data Even more problems! Volume: Increase of volume More to process Velocity: Realtime processing concepts for quality check and improvement Variety: Variety = More complexity for quality processes
17 Big Data Even more problems! Veracity: The accuracy of data is in doubt by default in Big Data Value: New business models relying on Big Data exponentially create the financial impact for data quality problems
18 Big Data - Tasks to solve bad Data Quality
19 Findings Bad Data Bad Business Data Quality is still a problem in most cases underestimated or hidden Big Data = The 5 V s = Even more problems!
20 OK! Let s see, if we have possibilities to solve problems
21 Check What has the MS Data Platform to offer?
22 Modern Data Platform Landscape Cloud born data Hybrid & Hyperscale Data Platform Landscape External Data File, WebServices (e.g. Market Research) IaaS Data (e.g. Hosted Custom Application) Presentation Layer Visualization Layer Visual Output PaaS Data (e.g. Custom Application) Governance Layer SaaS Data (e.g. CRM, Logistics) Analytical Layer Analytical Output Streaming Data (e.g. Sensor, Devices) Unstructured / Semi-structured (e.g. Video, Image) Storage Layer Ingest Layer Integration Layer Raw Output On Prem born data Legacy systems (e.g. ERP, CRM) Relational and Multi Dimensional Data (e.g. Custom App) Document based data (e.g. XLS, DOC, PPT, PDF, CSV) Document based data (e.g. XLS, DOC, PPT, PDF, CSV)
23 Modern Data Platform Landscape # Layer Function 1 Ingest Ingestion of data to a centralized storage environment (ETL, ELT, Raw data pump, Replication) 2 Storage Data Lake with unlimited data capacity and storage of structured, semi-structured and unstructured data 3 Integration Integration of Meta-, Master data as well as Data Quality, Profiling and Lineage 4 Analytical Relational, Multidimensional, Predictive, Stream analytical compute systems with distributed or in-memory capabilities 5 Governance Data Governance and Data Catalog incl. KPI portfolio, Corporate Identify, Security 6 Visualization Explorational data discovery and standard reporting 7 Presentation Any device & multi platform presentation layer
24 Modern Data Platform Landscape Portal Integration App Integration Search Integration Mobile Client Broadcast and Subscriber Pixel Perfect Visualization Explorative Visualization Statistic Visualization (R) Spatial Visualization Ad-hoc Functional Mapping Data Governance Record Management Performance Management Compliance Visual Master Data Text and Media Analytics Cognitive Analytics Predictive Analytics Azure Stream Analytics Transactional Analytics Multidimensional Analytics Statistic Stream Analytics Federated Search Master Data Management Meta Data Data Lineage Data Profiling Relational Storage Semi Structured Data Storage Unstructured Data Storage Data Lake ETL and ELT Replication and Sync Raw Data Pump
25 Microsoft Data Platform Landscape On Prem Cloud (Hyperscale) SharePoint SQL Server SSRS Portal Power BI Mobile Client Office 365 SharePoint Azure Apps R-Visual Studio or R-Studio Power BI Desktop (+R) SQL Server Reporting Services (+R) Excel Power BI Service Power BI Embedded SQL Server Master Data Services SQL Server Data Quality Services Azure Data Catalog Power BI Content Packs Power Apps Common Data Services SQL Server Polybase Engine SQL Server R-Server Engine Azure Machine Learning Azure HDInsight Spark/Hadoop Azure Stream Analytics / Storm SQL Server Operational Analytics Engine SQL Server Multidimensional Tabular Engine Azure SQL Database Azure SQL Data Warehouse Azure Data Lake Analytics (U-SQL) SQL Server Master Data Services SQL Server Data Quality Services Azure Data Catalog Power Apps Common Data Services SQL Server Relational Engine File Storage Azure SQL DB & Data Warehouse Azure Data Lake Azure BLOB Storage SQL Server Integration Services Azure Data Factory Azure Logic Apps
26 Microsoft Data Platform Landscape: Tools you can use for DQ by Layer MS Data Platform Service Layer SQL Server Integration Service (SSIS) Azure Logic Apps SQL Server Master Data Services SQL Server Data Quality Services Azure Data Catalog Power Apps Common Data Services Ingest Ingest Integration & Governance Integration & Governance Integration & Governance Integration & Governance
27 Microsoft Data Platform Landscape: Tools you can use by DQ Function MS Data Platform Service SQL Server Integration Service (SSIS) x x x x x x Azure Logic Apps (x) x SQL Server Master Data Services x x x x SQL Server Data Quality Services x x x x x Azure Data Catalog x x x Power Apps Common Data Services x x x Azure Data Lake Analytics x x x x SQL Server R / P Integration x x x x x x Azure HDInsight Spark (R) x x x x x x
28 NOW! Let s look into some solutions in detail!
29 Let s take these:
30 SQL Server R Language integration
31 This is R! R is an interpreted language Mostly R is used through a command-line interpreter Like other scientific languages e.g. MATLAB, R supports matrix arithmetic R uses procedural programming with functions In some cases object-oriented programming is possible The capabilities of R are extended through user-created packages, which allow specialized statistical techniques, graphical devices, import/export capabilities etc These packages are developed primarily in R A core set of packages is included with the installation of R Nearly 8000 (May 2016) packages are available via the Comprehensive R Archive Network (CRAN)
32 Microsoft is now a R company
33 This is R! R has a lot of libraries that also include functions you can use for data quality e.g.: summary distribution histograms regressions dataqualityr or datacheck These libraries / packages are not always per default for DQ purpose, but they enable you to build a nice framework for functions to monitor or improve DQ.
34 SQL Server Master Data Services
35 MDS: Main features from a data quality perspective - Versioning - Archiving / historical background - Applications can still work with historic versions of the data if necessary - Safe-keeping ofvalidated versions - Transactions / Change Sets - Log and manage changes - Central Approver can either approve and commit or rollback changes - Business Rules - Check data for validity while entering data - Only valid versions can be commited - Define rules by pre-defined editor or define logic with User functions in T-SQL 35
36 DEMO!
37 Azure Data Catalog Data Repository
38 What is Azure Data Catalog? An enterprise-wide catalog in Azure that enables selfservice discovery of data from any source A metadata repository that allow users to register, enrich, understand, discover, and consume data sources
39 Azure Data Catalog is part of Cortana Intelligence
40 What can Azure Data Catalog do for DQ?
41 What can Azure Data Catalog do for DQ? Publisher Consumer IT Admin Publish Enrich Discover Understand Govern Register Data Sources Browse -Search Apply Policies -Control Access Categorize Annotate Get context Identify Intent Extend Analyze Track and monitor usage Use open REST APIs to integrate data publishing and discovery into existing applications and processes
42 What can Azure Data Catalog do for DQ? Programmability Scenarios Incorporating data source discovery into client applications Future: Defining custom data source and data asset types ( type extensibility ) REST APIs Register data asset operations: Register Data Asset, Delete Data Asset, and Search Data Asset Annotate data asset operations: Annotate Data Asset, Update Annotation, Get Data Asset with Annotations, and Delete Annotation Search API uses familiar, powerful, search syntax
43 What can Azure Data Catalog do for DQ?
44 What can Azure Data Catalog do for DQ? Search Browse Filter Discover Understand Analyze Metadata Experts Context Your data Your tools Your way Consume Contribute Tag Document Publish
45 DEMO!
46 What can Azure Data Catalog do for DQ? Register data sources Registration stores key information (metadata) about the data source such as names, types of data, and location of data in the catalog. Only information about the data source is stored in Data Catalog. Use the Data Source Registration tool to register data sources.
47 What can Azure Data Catalog do for DQ? Data Catalog has multiple ways to discover data assets, including Simple keyword search Interactive filters An advanced search syntax for power users.
48 What can Azure Data Catalog do for DQ? Annotations enhance information about data sources so that they are easier to discover and understand. Any Data Catalog user can provide annotations, so it s easy for every user with a perspective on the data to share it. Annotation Expert Annotation
49 Power Apps Common Data Service PASS CAMP 2016 Session -
50 Common Data Services: What they are intended to do! A library of entities that represent the most commonly used entities across business and productivity applications The library is organized for simplicity and rapid discoverability Typical solutions will revolve around core elements of enterprise data for example, an employee, a customer, a product, or a supplier Applications across the enterprise will drive updates to that data The model is implemented to simplify the challenges of data management.
51 Common Data Services: What they are intended to do! Connect to Common Data Model or existing systems and data sources Build apps, forms, and workflows without writing code Publish apps instantly for web and mobile
52 Common Data Services: What they are intended to do! Build modern business apps fast Compose analytics, user experiences, and automation using an integrated set of services from Microsoft Empower line of business Power users who understand their business needs best can now build solutions quickly without writing code Enable developers to extend Seamlessly provide capabilities and components for power users leveraging Azure platform services Azure Data analytics SQL Server BI Azure AppServices Azure Functions Azure Logic Apps Azure API Management Connect to data across apps and platforms Whether built on the Common Data Model or integrated with existing systems and services, get more value from your data
53 Common Data Services: What they are intended to do! Backbone for all business data
54 Common Data Services: What they are intended to do! User Security: Users who can use apps and flows that are shared with them Creators who can create and edit apps and flows Administrators who manage environments including data security Database Owners who can access all data and change entity schema
55 Common Data Services: What they can do for DQ Entity Model with Attributes, Relationships? Like MDS = Master Data Capabilities Centralized Services that can be connected via Flow and Logic Apps from all data sources on prem and in the cloud = Data Hub = Enrichment and Meta Data Management Can be directly used by Power BI as a Model = Standardization, High Quality Datasource
56 DEMO!
57 Findings Bad Data Bad Business Not all is DQS Microsoft offers a variety of tools to solve DQ Problems A lot!= well integrated A real suite or workbench is completely missing R or Python Integration is helpful Common Data Services should be considered MDS, DQS and SSIS have still their existence! Microsoft should take DQ more seriously = Strategy
58 Don t forget...aftershow party!!! 5 Jahre SQLSaturday an der Hochschule Bonn-Rhein-Sieg SQLSatBruzzler - Grillparty Würstchen & Bier ab ca Uhr am Ende der Hochschulstraße
59 Sponsors You Rock! Sponsor Gold Sponsor Silver Sponsor Bronze Sponsor
Oliver Engels & Tillmann Eitelberg. Big Data! Big Quality?
Oliver Engels & Tillmann Eitelberg Big Data! Big Quality? Like to visit Germany? PASS Camp 2017 Main Camp 5.12 7.12.2017 (4.12 Kick Off Evening) Lufthansa Training & Conference Center, Seeheim SQL Konferenz
More informationTake P, R or U. and solve your data quality problems Oliver Engels & Tillmann Eitelberg, OH22
Take P, R or U and solve your data quality problems Oliver Engels & Tillmann Eitelberg, OH22 Oliver Engels CEO, oh22data AG @oengels Datamonster from Germany MS Data Platform MVP President of PASS Germany
More informationAlexander Klein. ETL in the Cloud
Alexander Klein ETL in the Cloud Sponsors help us to run this event! THX! You Rock! Sponsor Gold Sponsor Silver Sponsor Bronze Sponsor You Rock! Sponsor Session 13:45 Track 1 Das super nerdige Solisyon
More informationModern Data Warehouse The New Approach to Azure BI
Modern Data Warehouse The New Approach to Azure BI History On-Premise SQL Server Big Data Solutions Technical Barriers Modern Analytics Platform On-Premise SQL Server Big Data Solutions Modern Analytics
More informationAlexander Klein. #SQLSatDenmark. ETL meets Azure
Alexander Klein ETL meets Azure BIG Thanks to SQLSat Denmark sponsors Save the date for exiting upcoming events PASS Camp 2017 Main Camp 05.12. 07.12.2017 (04.12. Kick-Off abends) Lufthansa Training &
More informationMicrosoft Developer Day
Microsoft Developer Day Pradeep Menon Microsoft Developer Day Solutions Architect Agenda Microsoft Developer Day Traditional Business Intelligence Architecture Structured Sources Extract Transform Structurize
More informationCOURSE 20466D: IMPLEMENTING DATA MODELS AND REPORTS WITH MICROSOFT SQL SERVER
ABOUT THIS COURSE The focus of this five-day instructor-led course is on creating managed enterprise BI solutions. It describes how to implement multidimensional and tabular data models, deliver reports
More informationCOURSE 10977A: UPDATING YOUR SQL SERVER SKILLS TO MICROSOFT SQL SERVER 2014
ABOUT THIS COURSE This five-day instructor-led course teaches students how to use the enhancements and new features that have been added to SQL Server and the Microsoft data platform since the release
More informationPřehled novinek v SQL Server 2016
Přehled novinek v SQL Server 2016 Martin Rys, BI Competency Leader martin.rys@adastragrp.com https://www.linkedin.com/in/martinrys 20.4.2016 1 BI Competency development 2 Trends, modern data warehousing
More information17/05/2017. What we ll cover. Who is Greg? Why PaaS and SaaS? What we re not discussing: IaaS
What are all those Azure* and Power* services and why do I want them? Dr Greg Low SQL Down Under greg@sqldownunder.com Who is Greg? CEO and Principal Mentor at SDU Data Platform MVP Microsoft Regional
More informationData 101 Which DB, When. Joe Yong Azure SQL Data Warehouse, Program Management Microsoft Corp.
Data 101 Which DB, When Joe Yong (joeyong@microsoft.com) Azure SQL Data Warehouse, Program Management Microsoft Corp. The world is changing AI increased by 300% in 2017 Data will grow to 44 ZB in 2020
More informationOverview of Data Services and Streaming Data Solution with Azure
Overview of Data Services and Streaming Data Solution with Azure Tara Mason Senior Consultant tmason@impactmakers.com Platform as a Service Offerings SQL Server On Premises vs. Azure SQL Server SQL Server
More informationBIG DATA COURSE CONTENT
BIG DATA COURSE CONTENT [I] Get Started with Big Data Microsoft Professional Orientation: Big Data Duration: 12 hrs Course Content: Introduction Course Introduction Data Fundamentals Introduction to Data
More informationIan Choy. Technology Solutions Professional
Ian Choy Technology Solutions Professional XML KPIs SQL Server 2000 Management Studio Mirroring SQL Server 2005 Compression Policy-Based Mgmt Programmability SQL Server 2008 PowerPivot SharePoint Integration
More informationFrom Single Purpose to Multi Purpose Data Lakes. Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019
From Single Purpose to Multi Purpose Data Lakes Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019 Agenda Data Lakes Multiple Purpose Data Lakes Customer Example Demo Takeaways
More informationWhite Paper / Azure Data Platform: Ingest
White Paper / Azure Data Platform: Ingest Contents White Paper / Azure Data Platform: Ingest... 1 Versioning... 2 Meta Data... 2 Foreword... 3 Prerequisites... 3 Azure Data Platform... 4 Flowchart Guidance...
More informationMicrosoft Power BI for O365
Microsoft Power BI for O365 Next hour.. o o o o o o o o Power BI for O365 Data Discovery Data Analysis Data Visualization & Power Maps Natural Language Search (Q&A) Power BI Site Data Management Self Service
More information"Charting the Course... MOC B Updating Your SQL Server Skills to Microsoft SQL Server 2014 Course Summary
Course Summary Description This five-day instructor-led course teaches students how to use the enhancements and new features that have been added to SQL Server and the Microsoft data platform since the
More informationData sources. Gartner, The State of Data Warehousing in 2012
data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing. Gartner, The State of Data Warehousing
More information20463C-Implementing a Data Warehouse with Microsoft SQL Server. Course Content. Course ID#: W 35 Hrs. Course Description: Audience Profile
Course Content Course Description: This course describes how to implement a data warehouse platform to support a BI solution. Students will learn how to create a data warehouse 2014, implement ETL with
More informationHeute in der Suppenküche: Cognitive Services Allerlei
Heute in der Suppenküche: Cognitive Services Allerlei Marcel Tilly Microsoft marcel.tilly@microsoft.com Constantin Kostja Klein Freudenberg IT @KostjaKlein ckl@sqlpass.de Our Sponsors What product is Joe
More informationBI ENVIRONMENT PLANNING GUIDE
BI ENVIRONMENT PLANNING GUIDE Business Intelligence can involve a number of technologies and foster many opportunities for improving your business. This document serves as a guideline for planning strategies
More informationWHAT S NEW IN SQL SERVER 2016 REPORTING SERVICES?
WHAT S NEW IN SQL SERVER 2016 REPORTING SERVICES? Timothy P. McAliley CISA, CISM, CISSP, ITIL V3, MCSA, MCSE, MCT, PMP Microsoft Account Technology Strategist Try It Yourself! Two TechNet Virtual Labs
More informationSQL Server SQL Server 2008 and 2008 R2. SQL Server SQL Server 2014 Currently supporting all versions July 9, 2019 July 9, 2024
Current support level End Mainstream End Extended SQL Server 2005 SQL Server 2008 and 2008 R2 SQL Server 2012 SQL Server 2005 SP4 is in extended support, which ends on April 12, 2016 SQL Server 2008 and
More informationEnterprise Information Management with SQL Server 2016
Enterprise Information Management with SQL Server 2016 Dejan Sarka @DejanSarka http://sqlblog.com/blogs/dejan_sarka/default.aspx February 27, 2016 #sqlsatpordenone #sqlsat495 Organizers February 27, 2016
More informationMicrosoft Azure Databricks for data engineering. Building production data pipelines with Apache Spark in the cloud
Microsoft Azure Databricks for data engineering Building production data pipelines with Apache Spark in the cloud Azure Databricks As companies continue to set their sights on making data-driven decisions
More informationSQL Server 2017 Power your entire data estate from on-premises to cloud
SQL Server 2017 Power your entire data estate from on-premises to cloud PREMIER SPONSOR GOLD SPONSORS SILVER SPONSORS BRONZE SPONSORS SUPPORTERS Vulnerabilities (2010-2016) Power your entire data estate
More informationData Architectures in Azure for Analytics & Big Data
Data Architectures in for Analytics & Big Data October 20, 2018 Melissa Coates Solution Architect, BlueGranite Microsoft Data Platform MVP Blog: www.sqlchick.com Twitter: @sqlchick Data Architecture A
More informationImproving Your Business with Oracle Data Integration See How Oracle Enterprise Metadata Management Can Help You
Improving Your Business with Oracle Data Integration See How Oracle Enterprise Metadata Management Can Help You Özgür Yiğit Oracle Data Integration, Senior Manager, ECEMEA Safe Harbor Statement The following
More informationEnterprise Data Catalog for Microsoft Azure Tutorial
Enterprise Data Catalog for Microsoft Azure Tutorial VERSION 10.2 JANUARY 2018 Page 1 of 45 Contents Tutorial Objectives... 4 Enterprise Data Catalog Overview... 5 Overview... 5 Objectives... 5 Enterprise
More informationAsanka Padmakumara. ETL 2.0: Data Engineering with Azure Databricks
Asanka Padmakumara ETL 2.0: Data Engineering with Azure Databricks Who am I? Asanka Padmakumara Business Intelligence Consultant, More than 8 years in BI and Data Warehousing A regular speaker in data
More informationBest practices for building a Hadoop Data Lake Solution CHARLOTTE HADOOP USER GROUP
Best practices for building a Hadoop Data Lake Solution CHARLOTTE HADOOP USER GROUP 07.29.2015 LANDING STAGING DW Let s start with something basic Is Data Lake a new concept? What is the closest we can
More informationUpdating your Business Intelligence Skills to Microsoft SQL Server 2012
Course 40009A: Updating your Business Intelligence Skills to Microsoft SQL Server 2012 Course Details Course Outline Module 1: Introduction to SQL Server 2012 for Business Intelligence This module provides
More informationUnderstanding the latent value in all content
Understanding the latent value in all content John F. Kennedy (JFK) November 22, 1963 INGEST ENRICH EXPLORE Cognitive skills Data in any format, any Azure store Search Annotations Data Cloud Intelligence
More informationModeling. Preparation. Operationalization. Profile Explore. Model Testing & Validation. Feature & Algorithm Selection. Transform Cleanse Denormalize
Preparation Modeling Ingest Transform Cleanse Denormalize Profile Explore Visualize Feature & Algorithm Selection Model Testing & Validation Operationalization Models Visualizations Deploy Apps, Services
More informationHDInsight > Hadoop. October 12, 2017
HDInsight > Hadoop October 12, 2017 2 Introduction Mark Hudson >20 years mixing technology with data >10 years with CapTech Microsoft Certified IT Professional Business Intelligence Member of the Richmond
More informationAzure Data Lake Store
Azure Data Lake Store Analytics 101 Kenneth M. Nielsen Data Solution Architect, MIcrosoft Our Sponsors About me Kenneth M. Nielsen Worked with SQL Server since 1999 Data Solution Architect at Microsoft
More informationData sources. Gartner, The State of Data Warehousing in 2012
data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing. Gartner, The State of Data Warehousing
More informationAgenda. Future Sessions: Azure VMs, Backup/DR Strategies, Azure Networking, Storage, How to move
Onur Dogruoz Agenda Provide an introduction to Azure Infrastructure as a Service (IaaS) Walk through the Azure portal Help you understand role-based access control Engage in an overview of the calculator
More informationData Management Glossary
Data Management Glossary A Access path: The route through a system by which data is found, accessed and retrieved Agile methodology: An approach to software development which takes incremental, iterative
More informationGet ready to be what s next.
Get ready to be what s next. Jared Shockley http://jaredontech.com Senior Service Engineer Prior Experience @jshoq Primary Experience Areas David Leveille http://www.linkedin.com/in/leveille Senior Solutions
More informationImplement a Data Warehouse with Microsoft SQL Server
Implement a Data Warehouse with Microsoft SQL Server 20463D; 5 days, Instructor-led Course Description This course describes how to implement a data warehouse platform to support a BI solution. Students
More informationUpdating your Business Intelligence Skills to Microsoft SQL Server 2012 Course 40009A; 3 Days, Instructor-led
Updating your Business Intelligence Skills to Microsoft SQL Server 2012 Course 40009A; 3 Days, Instructor-led Course Description This three-day instructor-led course provides existing SQL Server Business
More informationThe Cortana Intelligence Suite
Slide 1 The Cortana Intelligence Suite Foundations Data Discovery and Ingestion Microsoft Machine Learning and Data Science Team CortanaIntelligence.com Main page: http://cortanaanalytics.com To begin
More informationImplementing a Data Warehouse with Microsoft SQL Server
Course 20463C: Implementing a Data Warehouse with Microsoft SQL Server Page 1 of 6 Implementing a Data Warehouse with Microsoft SQL Server Course 20463C: 4 days; Instructor-Led Introduction This course
More informationStages of Data Processing
Data processing can be understood as the conversion of raw data into a meaningful and desired form. Basically, producing information that can be understood by the end user. So then, the question arises,
More informationMigrating Enterprise BI to Azure
Migrating Enterprise BI to Azure Best Practices Wlodek Bielski SQLSat Kyiv Team Yevhen Nedashkivskyi Mykola Pobyivovk Denis Reznik Eugene Polonichko Oksana Borysenko Oksana Tkach Sponsors Session will
More informationAzure Data Lake Analytics Introduction for SQL Family. Julie
Azure Data Lake Analytics Introduction for SQL Family Julie Koesmarno @MsSQLGirl www.mssqlgirl.com jukoesma@microsoft.com What we have is a data glut Vernor Vinge (Emeritus Professor of Mathematics at
More informationCONSOLIDATING RISK MANAGEMENT AND REGULATORY COMPLIANCE APPLICATIONS USING A UNIFIED DATA PLATFORM
CONSOLIDATING RISK MANAGEMENT AND REGULATORY COMPLIANCE APPLICATIONS USING A UNIFIED PLATFORM Executive Summary Financial institutions have implemented and continue to implement many disparate applications
More information##SQLSatMadrid. Project [Vélib by Cortana]
Project [Vélib by Cortana] BIG Thanks to SQLSatMadrid Sponsors Speakers Agenda Presentation of the Project Cortana Intelligent Suite Creation of the architecture Purpose of the Project Get a descriptive
More informationSAP Agile Data Preparation Simplify the Way You Shape Data PUBLIC
SAP Agile Data Preparation Simplify the Way You Shape Data Introduction SAP Agile Data Preparation Overview Video SAP Agile Data Preparation is a self-service data preparation application providing data
More informationSwimming in the Data Lake. Presented by Warner Chaves Moderated by Sander Stad
Swimming in the Data Lake Presented by Warner Chaves Moderated by Sander Stad Thank You microsoft.com hortonworks.com aws.amazon.com red-gate.com Empower users with new insights through familiar tools
More informationFrom the Source to the Dashboard: SAP Agile Data Warehousing for Self-Service BI
From the Source to the Dashboard: SAP Agile Data Warehousing for Self-Service BI Michael D Rutland, Sr SE, SAP / @TDWI, 9 October 2017, Savannah Disclaimer The information in this presentation is confidential
More informationMicrosoft vision for a new era
Microsoft vision for a new era United platform for the modern service provider MICROSOFT AZURE CUSTOMER DATACENTER CONSISTENT PLATFORM SERVICE PROVIDER Enterprise-grade Global reach, scale, and security
More informationThe Now Platform Reference Guide
The Now Platform Reference Guide A tour of key features and functionality START Introducing the Now Platform Digitize your business with intelligent apps The Now Platform is an application Platform-as-a-Service
More informationMaking Data Integration Easy For Multiplatform Data Architectures With Diyotta 4.0. WEBINAR MAY 15 th, PM EST 10AM PST
Making Data Integration Easy For Multiplatform Data Architectures With Diyotta 4.0 WEBINAR MAY 15 th, 2018 1PM EST 10AM PST Welcome and Logistics If you have problems with the sound on your computer, switch
More informationAzure Data Factory VS. SSIS. Reza Rad, Consultant, RADACAD
Azure Data Factory VS. SSIS Reza Rad, Consultant, RADACAD 2 Please silence cell phones Explore Everything PASS Has to Offer FREE ONLINE WEBINAR EVENTS FREE 1-DAY LOCAL TRAINING EVENTS VOLUNTEERING OPPORTUNITIES
More informationSQL Server 2019 Big Data Clusters
SQL Server 2019 Big Data Clusters Ben Weissman @bweissman > SOLISYON GMBH > FÜRTHER STRAßE 212 > 90429 NÜRNBERG > +49 911 990077 20 Who am I? Ben Weissman @bweissman b.weissman@solisyon.de http://biml-blog.de/
More informationAzure Integration Services
Azure Integration Services 2018 Microsoft Corporation. All rights reserved. This document is provided "as-is." Information and views expressed in this document, including URL and other Internet Web site
More informationData 101 Which DB, When Joe Yong Sr. Program Manager Microsoft Corp.
17-18 March, 2018 Beijing Data 101 Which DB, When Joe Yong Sr. Program Manager Microsoft Corp. The world is changing AI increased by 300% in 2017 Data will grow to 44 ZB in 2020 Today, 80% of organizations
More informationDell Boomi Cloud MDM Overview
Dell Boomi Cloud MDM Overview Dell Boomi s Multi-Purpose PaaS Boomi as the Multi-Purpose PaaS for enterprise data management Move: AtomSphere Integration Manage: Master Data Management (MDM) Govern: API
More informationWKU-MIS-B10 Data Management: Warehousing, Analyzing, Mining, and Visualization. Management Information Systems
Management Information Systems Management Information Systems B10. Data Management: Warehousing, Analyzing, Mining, and Visualization Code: 166137-01+02 Course: Management Information Systems Period: Spring
More informationCloudSwyft Learning-as-a-Service Course Catalog 2018 (Individual LaaS Course Catalog List)
CloudSwyft Learning-as-a-Service Course Catalog 2018 (Individual LaaS Course Catalog List) Microsoft Solution Latest Sl Area Refresh No. Course ID Run ID Course Name Mapping Date 1 AZURE202x 2 Microsoft
More informationCapture Business Opportunities from Systems of Record and Systems of Innovation
Capture Business Opportunities from Systems of Record and Systems of Innovation Amit Satoor, SAP March Hartz, SAP PUBLIC Big Data transformation powers digital innovation system Relevant nuggets of information
More informationCloudy with 100% chance of data
# T C 1 8 Cloudy with 100% chance of data Phillip Cheung Technical Program Manager Tableau Kevin Boske Analytics Manager Tableau SUPPORTING 3,300 EMPLOYEES 196 SERVER CORES 150 EXTERNAL FACING TABLEAU
More informationVisualizing PI System Data with Dashboards and Reports
Visualizing PI System Data with Dashboards and Reports Presented by Mike Wood Product Manager Experience COLLECT HISTORIZE FIND ANALYZE DELIVER VISUALIZE What s New with Visualization in PI System 2010?
More informationMicrosoft Analytics Platform System (APS)
Microsoft Analytics Platform System (APS) The turnkey modern data warehouse appliance Matt Usher, Senior Program Manager @ Microsoft About.me @two_under Senior Program Manager 9 years at Microsoft Visual
More informationHosted Azure for your business. Build virtual servers, deploy with flexibility, and reduce your hardware costs with a managed cloud solution.
Hosted Azure for your business Build virtual servers, deploy with flexibility, and reduce your hardware costs with a managed cloud solution. Azure is approximately 50 percent cheaper than other cloud services
More informationProcessing Unstructured Data. Dinesh Priyankara Founder/Principal Architect dinesql Pvt Ltd.
Processing Unstructured Data Dinesh Priyankara Founder/Principal Architect dinesql Pvt Ltd. http://dinesql.com / Dinesh Priyankara @dinesh_priya Founder/Principal Architect dinesql Pvt Ltd. Microsoft Most
More informationTraining 24x7 DBA Support Staffing. MCSA:SQL 2016 Business Intelligence Development. Implementing an SQL Data Warehouse. (40 Hours) Exam
MCSA:SQL 2016 Business Intelligence Development Implementing an SQL Data Warehouse (40 Hours) Exam 70-767 Prerequisites At least 2 years experience of working with relational databases, including: Designing
More informationData Governance for the Connected Enterprise
Data Governance for the Connected Enterprise Irene Polikoff and Jack Spivak, TopQuadrant Inc. November 3, 2016 Copyright 2016 TopQuadrant Inc. Slide 1 Data Governance for the Connected Enterprise Today
More informationProcessing Big Data. with AZURE DATA LAKE ANALYTICS. Sean Forgatch - Senior Consultant. 6/23/ TALAVANT. All Rights Reserved.
Processing Big Data with AZURE DATA LAKE ANALYTICS Sean Forgatch - Senior Consultant 6/23/2018 2018 TALAVANT. All Rights Reserved. 1 SQL Saturday Iowa 2018 6/23/2018 2018 TALAVANT. All Rights Reserved.
More informationAzure Data Factory. Data Integration in the Cloud
Azure Data Factory Data Integration in the Cloud 2018 Microsoft Corporation. All rights reserved. This document is provided "as-is." Information and views expressed in this document, including URL and
More informationComputer Vision and Media Analytics
1 Computer Vision and Media Analytics Creating New Opportunities for Value-Add Connected TV Services Tony Emerson Managing Director Worldwide Media and Cable Our OTT Vision Capitalize on existing content
More informationAzure File Sync. Webinaari
Azure File Sync Webinaari 12.3.2018 Agenda Why use Azure? Moving to the Cloud Azure Storage Backup and Recovery Azure File Sync Demo Q&A What is Azure? A collection of cloud services from Microsoft that
More informationImplementing a Data Warehouse with Microsoft SQL Server 2012
Implementing a Data Warehouse with Microsoft SQL Server 2012 Course 10777A 5 Days Instructor-led, Hands-on Introduction Data warehousing is a solution organizations use to centralize business data for
More informationPlaying Outside Your Sandbox INTERACTING WITH OTHER SYSTEMS USING SHAREPOINT BCS
Playing Outside Your Sandbox INTERACTING WITH OTHER SYSTEMS USING SHAREPOINT BCS David Drever o Digital Workplace Services Lead o Office Servers & Services MVP o Saskatchewan SharePoint/O365 User Group
More informationMaster BIG DATA with SQL Server 2012
Roy Pasternak Data Platform & BI Lead Ori Weinroth Product Marketing Manager, SQL Server Master BIG DATA with SQL Server 2012 Characteristics of Big Data Large Data Volumes The Twitter Community generates
More informationOregon SQL Welcomes You to SQL Saturday Oregon
Oregon SQL Welcomes You to SQL Saturday Oregon 2012-11-03 Introduction to SQL Server 2012 MDS and DQS Peter Myers Bitwise Solutions Presenter Introduction Peter Myers BI Expert, Bitwise Solutions BBus,
More informationETL is No Longer King, Long Live SDD
ETL is No Longer King, Long Live SDD How to Close the Loop from Discovery to Information () to Insights (Analytics) to Outcomes (Business Processes) A presentation by Brian McCalley of DXC Technology,
More informationMOC 20463C: Implementing a Data Warehouse with Microsoft SQL Server
MOC 20463C: Implementing a Data Warehouse with Microsoft SQL Server Course Overview This course provides students with the knowledge and skills to implement a data warehouse with Microsoft SQL Server.
More informationR Language for the SQL Server DBA
R Language for the SQL Server DBA Beginning with R Ing. Eduardo Castro, PhD, Principal Data Analyst Architect, LP Consulting Moderated By: Jose Rolando Guay Paz Thank You microsoft.com idera.com attunity.com
More informationBuild an open hybrid cloud and paint it red and blue
Build an open hybrid cloud and paint it red and blue Khaled Elbedri Technical sales lead, Microsoft Ismail Dhaoui EMEA Senior Specialist Solutions Architect, Red Hat Tuesday, May 8, 2018 Agenda RH & MS
More informationAzure Stack with Azure CSP/EA Azure Active Directory. Azure Stack with disconnected model ADFS
Azure Stack with Azure CSP/EA Azure Active Directory Azure Stack with disconnected model ADFS Fee only for consumption Same Azure invoice, monetary commitment, subscriptions Prices typically lower than
More informationVishesh Oberoi Seth Reid Technical Evangelist, Microsoft Software Developer, Intergen
Vishesh Oberoi Technical Evangelist, Microsoft VishO@microsoft.com @ovishesh Seth Reid Software Developer, Intergen contact@sethreid.co.nz @sethreidnz Vishesh Oberoi Technical Evangelist, Microsoft VishO@microsoft.com
More informationThe Emerging Data Lake IT Strategy
The Emerging Data Lake IT Strategy An Evolving Approach for Dealing with Big Data & Changing Environments bit.ly/datalake SPEAKERS: Thomas Kelly, Practice Director Cognizant Technology Solutions Sean Martin,
More informationEXPLORE MICROSOFT SHAREPOINT SERVER 2016 AND BEYOND #ILTAG70
EXPLORE MICROSOFT SHAREPOINT SERVER 2016 AND BEYOND #ILTAG70 EXPLORE MICROSOFT SHAREPOINT SERVER 2016 In this session, we ll cover: Mike Ammerlaan Director Office Ecosystem Microsoft SharePoint Server
More informationCortana Intelligence Suite; Where the Magic Happens
Cortana Intelligence Suite; Where the Magic Happens Reza Rad, Leila Etaati #509 Brisbane 2016 About Us Reza Rad Leila Etaati MVP BI Consultant and Trainer Author of Books Speaker in conferences; PASS Summit,
More informationBI, Big Data, Mission Critical. Eduardo Rivadeneira Specialist Sales Manager
BI, Big Data, Mission Critical Eduardo Rivadeneira Specialist Sales Manager Required 9s & Protection Blazing-Fast Performance Enhanced Security & Compliance Rapid Data Exploration & Visualization Managed
More informationMAPR DATA GOVERNANCE WITHOUT COMPROMISE
MAPR TECHNOLOGIES, INC. WHITE PAPER JANUARY 2018 MAPR DATA GOVERNANCE TABLE OF CONTENTS EXECUTIVE SUMMARY 3 BACKGROUND 4 MAPR DATA GOVERNANCE 5 CONCLUSION 7 EXECUTIVE SUMMARY The MapR DataOps Governance
More informationGetting personal with your customers and GDPR
Getting personal with your customers and GDPR A practical approach to a secure, governed 360 degree customer view Darren Brunt Presales Director UK&I, Talend Colm Moynihan Partner Presales Manager EMEA,
More informationFIVE BEST PRACTICES FOR ENSURING A SUCCESSFUL SQL SERVER MIGRATION
FIVE BEST PRACTICES FOR ENSURING A SUCCESSFUL SQL SERVER MIGRATION The process of planning and executing SQL Server migrations can be complex and risk-prone. This is a case where the right approach and
More informationProduct Documentation. ER/Studio Portal. User Guide. Version Published February 21, 2012
Product Documentation ER/Studio Portal User Guide Version 1.6.3 Published February 21, 2012 2012 Embarcadero Technologies, Inc. Embarcadero, the Embarcadero Technologies logos, and all other Embarcadero
More informationBig Data For Oil & Gas
Big Data For Oil & Gas Jay Hollingsworth - 郝灵杰 Industry Principal Oil & Gas Industry Business Unit 1 The following is intended to outline our general product direction. It is intended for information purposes
More informationData Protection Modernization: Meeting the Challenges of a Changing IT Landscape
Data Protection Modernization: Meeting the Challenges of a Changing IT Landscape Tom Clark IBM Distinguished Engineer, Chief Architect Software 1 Data growth is continuing to explode Sensors & Devices
More information@Pentaho #BigDataWebSeries
Enterprise Data Warehouse Optimization with Hadoop Big Data @Pentaho #BigDataWebSeries Your Hosts Today Dave Henry SVP Enterprise Solutions Davy Nys VP EMEA & APAC 2 Source/copyright: The Human Face of
More informationAgile Data Management Challenges in Enterprise Big Data Landscape
Agile Data Management Challenges in Enterprise Big Data Landscape Eric Simon, SAP Big Data October, 2017 1 Evolution Towards Enterprise Big Data Landscape administrator Data analyst Athena Redshift #123
More informationGood analytics needs good data and that needs good metadata
Good analytics needs good data and that needs good metadata 28 th February 2018 Mandy Chessell CBE FREng CEng FBCS Distinguished Engineer, Master Inventor Analytics Chief Data Office mandy_chessell@uk.ibm.com
More informationLambda Architecture for Batch and Stream Processing. October 2018
Lambda Architecture for Batch and Stream Processing October 2018 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Notices This document is provided for informational purposes only.
More informationMicrosoft End to End Business Intelligence Boot Camp
Microsoft End to End Business Intelligence Boot Camp 55045; 5 Days, Instructor-led Course Description This course is a complete high-level tour of the Microsoft Business Intelligence stack. It introduces
More information