Size: px
Start display at page:

Download ""

Transcription

1

2 GARTNER MAGIC QUADRANT DW & BI Data Warehouse Database Management Systems Business Intelligence and Analytics Platforms * Disclaimer: Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. 2

3 The Traditional Data Warehouse 3

4

5 Breaking Points of The Traditional Data Warehouse

6 Introducing The Modern Data Warehouse Business Intelligence Data Sources 6

7 Microsoft Hadoop Vision Insights to all users by activating new types of data

8 Limitations: Performance and Scale today Diminishing performance Scale UP Rowstore Existing Tables (Partitions) Diminishing Scale as requirements grow Non-optimal performance for many DW queries

9 SQL Server 2012 Parallel Data Warehouse (PDW) Insights on any data of any size Next-generation Performance At Scale Built For Big Data

10 Manageable Costs Scale Out MPP versus Scale Up SMP Big Data Integration Query Performance Updateable xvelocity Columnstore Appliance Simplicity: HW + SW

11 What is Parallel Data Warehouse? Shared-nothing parallel database system» Massively parallel processing (MPP)» A Control server that accepts user queries, generates a plan, and distributes operations in parallel to compute nodes» Multiple Compute servers running SQL Server» A Management server for administering the system» A Data Movement Service that facilitates parallel SQL operations Delivered as an appliance» Balanced and pre-configured software and industry standard hardware from Dell or HP» Single Call Support» Fastest Time to Market» Scales from 2 to 56 Nodes HP Example

12 Key Design Elements Modular Design High Density Leverage latest Microsoft software features» Windows Server 2012 Storage Spaces» Windows Server 2012 Hyper-V» SQL Server 2012 xvelocity ColumnStore HP Example

13 Ultra Shared Nothing architecture: Distribution Larger Fact Table is Hash Distributed Across All Compute Nodes Time Dim Product Dim TD SD SF PD MD Date Dim ID Calendar Year Calendar Qtr Calendar Mo Calendar Day Prod Dim ID Prod Category Prod Sub Cat Prod Desc TD SD SF PD MD Store Dim Store Dim ID Store Name Store Mgr Store Size Sales Facts Date Dim ID Store Dim ID Prod Dim ID Mktg Camp ID Qty Sold Dollars Sold Mktg Campaign Dim Mktg Camp ID Camp Name Camp Mgr Camp Start Camp End TD SD TD SD TD SD SF SF SF 33-n PD MD PD MD PD MD

14 In-Memory Columnstore in PDW V2 & SQL Server 2014 xvelocity in-memory columnstore in PDW columnstore index as primary data store in a scale-out MPP Data Warehouse - PDW V2 Appliance Updateable clustered columnstore index (CCI) Support for bulk load and insert/update/delete Extended data types decimal/numeric for all precision and scale Query processing enhancements for more batch mode processing (for example, Outer/Semi/Antisemi joins, union all, scalar aggregation) Customer benefits Outstanding query performance from in-memory columnstore index 600 GB per hour for a single 12-core server Significant hardware cost savings due to high compression 4 15x compression ratio Improved productivity through updateable index Ships in PDW V2 appliance and SQL Server

15 Introducing PolyBase Fundamental breakthrough in data processing SQL SQL Server 2012 PDW Powered by PolyBase Single Query; Structured and Unstructured Query and join Hadoop tables with Relational Tables Use Standard SQL language Select, From Where Database HDFS (Hadoop) Existing SQL Skillset No IT Intervention Save Time and Costs Analyze All Data Types

16 External Tables» An external table is PDW s representation of data residing in HDFS» The table (metadata) lives in the context of a SQL Server database» The actual table data resides in HDFS CREATE EXTERNAL TABLE table_name ({<column_definition>} [,...n ]) {WITH (LOCATION = <URI>,[FORMAT_OPTIONS = (<VALUES>)])} [;] Required to indicate location of Hadoop cluster Optional format options associated with parsing of data from HDFS (e.g. field delimiters & reject-related thresholds)

17 Native Query Across Hadoop and PDW Parallel Data Import from HDFS into PDW Persistently storing data from HDFS in PDW tables Fully parallelized via CREATE TABLE AS SELECT (CTAS) with external tables as source table and PDW tables (either distributed or replicated) as destination CREATE TABLE ClickStream_PDW WITH DISTRIBUTION = HASH(url) AS SELECT url, event_date, user_ip FROM ClickStream Retrieval of data in HDFS on-the-fly Sensor & RFID Web Apps Social Apps Mobile Apps Hadoop Unstructured data Parallel HDFS Reads CTAS External Table Enhanced PDW query engine HDFS bridge Results DMS DMS Reader Reader 1 N Parallel Importing Traditional DW applications PDW Structured data

18 Native Query Across Hadoop and PDW Parallel Data Export from PDW into HDFS Fully parallelized via CREATE EXTERNAL TABLE AS SELECT (CETAS) with external tables as destination table and PDW tables as source Round-trip of data possible with first importing data from HDFS, joining it with relational data, and then exporting results back to HDFS CREATE EXTERNAL TABLE ClickStream (url, event_date, user_ip) WITH (LOCATION = hdfs://myhadoop:5000/users/outputdir, FORMAT_OPTIONS (FIELD_TERMINATOR = ' ')) AS SELECT url, event_date, user_ip FROM ClickStream_PDW Sensor & RFID Web Apps Social Apps Mobile Apps HDFS data nodes Unstructured data Parallel HDFS Writes CETAS External Table Enhanced PDW query engine HDFS bridge DMS Writer 1 Results DMS Writer N Parallel Reading Traditional DW applications PDW Structured data

19 PDW V2.0 Management Dashboard

20 PDW V2.0 Management Dashboard

21 PDW V2.0 Management Dashboard

22 Microsoft Business Intelligence Platform

23

Master BIG DATA with SQL Server 2012

Master BIG DATA with SQL Server 2012 Roy Pasternak Data Platform & BI Lead Ori Weinroth Product Marketing Manager, SQL Server Master BIG DATA with SQL Server 2012 Characteristics of Big Data Large Data Volumes The Twitter Community generates

More information

The Microsoft Big Data architecture approach

The Microsoft Big Data architecture approach The Microsoft Big ata architecture approach Marc Schöni (Microsoft) Meinrad Weiss (Trivadis) 7. February 2014 BASEL BERN BRUGG LAUSANNE ZUERICH UESSELORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MUNICH STUTTGART

More information

Microsoft Analytics Platform System (APS)

Microsoft Analytics Platform System (APS) Microsoft Analytics Platform System (APS) The turnkey modern data warehouse appliance Matt Usher, Senior Program Manager @ Microsoft About.me @two_under Senior Program Manager 9 years at Microsoft Visual

More information

SQL Server Pre Lanzamiento. Federico Marty. Mariano Kovo. Especialista en Plataforma de Aplicaciones Microsoft Argentina & Uruguay

SQL Server Pre Lanzamiento. Federico Marty. Mariano Kovo. Especialista en Plataforma de Aplicaciones Microsoft Argentina & Uruguay 2016 Pre Lanzamiento Federico Marty Especialista en Plataforma de Aplicaciones Microsoft Argentina & Uruguay Mariano Kovo Especialista en Precision IT 2016: Everything built-in built-in built-in built-in

More information

SQL Server Everything built-in

SQL Server Everything built-in 2016 Everything built-in 2016: Everything built-in built-in built-in built-in built-in built-in $2,230 80 70 60 50 43 69 49 40 30 20 10 0 34 6 0 1 29 4 22 20 15 5 0 0 2010 2011 2012 2013 2014 2015 18 3

More information

SQL 2016 Performance, Analytics and Enhanced Availability. Tom Pizzato

SQL 2016 Performance, Analytics and Enhanced Availability. Tom Pizzato SQL 2016 Performance, Analytics and Enhanced Availability Tom Pizzato On-premises Cloud Microsoft data platform Transforming data into intelligent action Relational Beyond relational Azure SQL Database

More information

Přehled novinek v SQL Server 2016

Přehled novinek v SQL Server 2016 Přehled novinek v SQL Server 2016 Martin Rys, BI Competency Leader martin.rys@adastragrp.com https://www.linkedin.com/in/martinrys 20.4.2016 1 BI Competency development 2 Trends, modern data warehousing

More information

WHAT S NEW IN SQL SERVER 2016 REPORTING SERVICES?

WHAT S NEW IN SQL SERVER 2016 REPORTING SERVICES? WHAT S NEW IN SQL SERVER 2016 REPORTING SERVICES? Timothy P. McAliley CISA, CISM, CISSP, ITIL V3, MCSA, MCSE, MCT, PMP Microsoft Account Technology Strategist Try It Yourself! Two TechNet Virtual Labs

More information

Bull Fast Track/PDW and Big Data

Bull Fast Track/PDW and Big Data Bull Fast Track/PDW and Big Data Add High Performance BI to your Big Data Roger Van Unen Expert Microsoft / BI roger.van-unen@bull.net http://www.bull.fr/bi/fastrack.html Michael Schmitter BI Sales Germany

More information

From Single Purpose to Multi Purpose Data Lakes. Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019

From Single Purpose to Multi Purpose Data Lakes. Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019 From Single Purpose to Multi Purpose Data Lakes Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019 Agenda Data Lakes Multiple Purpose Data Lakes Customer Example Demo Takeaways

More information

Modern Data Warehouse The New Approach to Azure BI

Modern Data Warehouse The New Approach to Azure BI Modern Data Warehouse The New Approach to Azure BI History On-Premise SQL Server Big Data Solutions Technical Barriers Modern Analytics Platform On-Premise SQL Server Big Data Solutions Modern Analytics

More information

UNE APPROCHE CONVERGÉE AVEC LES SOLUTIONS VCE JEUDI 19 NOVEMBRE Olivier LE ROLLAND : varchitecte Manager, VCE France

UNE APPROCHE CONVERGÉE AVEC LES SOLUTIONS VCE JEUDI 19 NOVEMBRE Olivier LE ROLLAND : varchitecte Manager, VCE France UNE APPROCHE CONVERGÉE AVEC LES SOLUTIONS VCE JEUDI 19 NOVEMBRE 2015 Olivier LE ROLLAND : varchitecte Manager, VCE France VCE SUMMARY A HIGHLY SUCCESSFUL AND INNOVATIVE TECHNOLOGY COMPANY 2009: Joint venture

More information

Pervasive Insight. Mission Critical Platform

Pervasive Insight. Mission Critical Platform Empowered IT Pervasive Insight Mission Critical Platform Dynamic Development Desktop & Mobile Server & Datacenter Cloud Over 7 Million Downloads of SQL Server 2008 Over 30,000 partners are offering solutions

More information

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Copyright 2012, Oracle and/or its affiliates. All rights reserved. 1 Big Data Connectors: High Performance Integration for Hadoop and Oracle Database Melli Annamalai Sue Mavris Rob Abbott 2 Program Agenda Big Data Connectors: Brief Overview Connecting Hadoop with Oracle

More information

One is the Loneliest Number: Scaling out your Data Warehouse

One is the Loneliest Number: Scaling out your Data Warehouse One is the Loneliest Number: Scaling out your Data Warehouse Greg Galloway SQL Saturday Dallas #396 BI Edition Page 1 Agenda Common data warehouse pain points Analytics Platform System (APS) overview Analytics

More information

SQL Server 2017 Power your entire data estate from on-premises to cloud

SQL Server 2017 Power your entire data estate from on-premises to cloud SQL Server 2017 Power your entire data estate from on-premises to cloud PREMIER SPONSOR GOLD SPONSORS SILVER SPONSORS BRONZE SPONSORS SUPPORTERS Vulnerabilities (2010-2016) Power your entire data estate

More information

Gerhard Brueckl. Deep-dive into Polybase

Gerhard Brueckl. Deep-dive into Polybase Gerhard Brueckl Deep-dive into Polybase Sponsors Many thanks to our sponsors, without whom such an event would not be possible. Sponsors Many thanks to our sponsors, without whom such an event would not

More information

Stages of Data Processing

Stages of Data Processing Data processing can be understood as the conversion of raw data into a meaningful and desired form. Basically, producing information that can be understood by the end user. So then, the question arises,

More information

SQT03 Big Data and Hadoop with Azure HDInsight Andrew Brust. Senior Director, Technical Product Marketing and Evangelism

SQT03 Big Data and Hadoop with Azure HDInsight Andrew Brust. Senior Director, Technical Product Marketing and Evangelism Big Data and Hadoop with Azure HDInsight Andrew Brust Senior Director, Technical Product Marketing and Evangelism Datameer Level: Intermediate Meet Andrew Senior Director, Technical Product Marketing and

More information

Shine a Light on Dark Data with Vertica Flex Tables

Shine a Light on Dark Data with Vertica Flex Tables White Paper Analytics and Big Data Shine a Light on Dark Data with Vertica Flex Tables Hidden within the dark recesses of your enterprise lurks dark data, information that exists but is forgotten, unused,

More information

Drawing the Big Picture

Drawing the Big Picture Drawing the Big Picture Multi-Platform Data Architectures, Queries, and Analytics Philip Russom TDWI Research Director for Data Management August 26, 2015 Sponsor 2 Speakers Philip Russom TDWI Research

More information

Tomasz Libera. Azure SQL Data Warehouse

Tomasz Libera. Azure SQL Data Warehouse Tomasz Libera Azure SQL Data Warehouse Thanks to our partners! About me Microsoft MVP Data Platform Microsoft Certified Trainer SQL Server Developer Academic Trainer datacommunity.org.pl One of the leaders

More information

SQL Server 2014 Column Store Indexes. Vivek Sanil Microsoft Sr. Premier Field Engineer

SQL Server 2014 Column Store Indexes. Vivek Sanil Microsoft Sr. Premier Field Engineer SQL Server 2014 Column Store Indexes Vivek Sanil Microsoft Vivek.sanil@microsoft.com Sr. Premier Field Engineer Trends in the Data Warehousing Space Approximate data volume managed by DW Less than 1TB

More information

Increase Value from Big Data with Real-Time Data Integration and Streaming Analytics

Increase Value from Big Data with Real-Time Data Integration and Streaming Analytics Increase Value from Big Data with Real-Time Data Integration and Streaming Analytics Cy Erbay Senior Director Striim Executive Summary Striim is Uniquely Qualified to Solve the Challenges of Real-Time

More information

Overview of Data Services and Streaming Data Solution with Azure

Overview of Data Services and Streaming Data Solution with Azure Overview of Data Services and Streaming Data Solution with Azure Tara Mason Senior Consultant tmason@impactmakers.com Platform as a Service Offerings SQL Server On Premises vs. Azure SQL Server SQL Server

More information

*Gartner Magic Quadrant for Business Intelligence and Analytics Platforms, by Rita L. Sallam, Cindi Howson, Carlie J. Idoine, Thomas W.

*Gartner Magic Quadrant for Business Intelligence and Analytics Platforms, by Rita L. Sallam, Cindi Howson, Carlie J. Idoine, Thomas W. *Gartner Magic Quadrant for Business Intelligence and Analytics Platforms, by Rita L. Sallam, Cindi Howson, Carlie J. Idoine, Thomas W. Oestreich, James Laurence Richardson, and Joao Tapadinhas February

More information

CAST(HASHBYTES('SHA2_256',(dbo.MULTI_HASH_FNC( tblname', schemaname'))) AS VARBINARY(32));

CAST(HASHBYTES('SHA2_256',(dbo.MULTI_HASH_FNC( tblname', schemaname'))) AS VARBINARY(32)); >Near Real Time Processing >Raphael Klebanov, Customer Experience at WhereScape USA >Definitions 1. Real-time Business Intelligence is the process of delivering business intelligence (BI) or information

More information

SQL Server Evolution. New innovations. George Walters. Sr. Technical Solutions Professional, Data Platform Microsoft

SQL Server Evolution. New innovations. George Walters. Sr. Technical Solutions Professional, Data Platform Microsoft SQL Server Evolution New innovations George Walters Sr. Technical Solutions Professional, Data Platform Microsoft george.walters@microsoft.com https://www.linkedin.com/in/georgewalters @gwalters69 on twitter

More information

Transform the datacenter Help your customers move forward in the age of the cloud

Transform the datacenter Help your customers move forward in the age of the cloud tomorrow Transform the datacenter Help your customers move forward in the age of the cloud Darian Mack Datacenter Solution Specialist Louis Janse van Noordwyk Partner Technology Strategist Microsoft Momentum

More information

VOLTDB + HP VERTICA. page

VOLTDB + HP VERTICA. page VOLTDB + HP VERTICA ARCHITECTURE FOR FAST AND BIG DATA ARCHITECTURE FOR FAST + BIG DATA FAST DATA Fast Serve Analytics BIG DATA BI Reporting Fast Operational Database Streaming Analytics Columnar Analytics

More information

Analyze Big Data Faster and Store It Cheaper

Analyze Big Data Faster and Store It Cheaper Analyze Big Data Faster and Store It Cheaper Dr. Steve Pratt, CenterPoint Russell Hull, SAP Public About CenterPoint Energy, Inc. Publicly traded on New York Stock Exchange Headquartered in Houston, Texas

More information

Ta kontroll över er data! Christofer Jensen Client Technical Specialist. Stockholm

Ta kontroll över er data! Christofer Jensen Client Technical Specialist. Stockholm Ta kontroll över er data! Christofer Jensen Client Technical Specialist Stockholm IBM Storage: Named a Leader in 13 Gartner and IDC Reports in,, and 2016 #1 in Mainframe Storage, Enterprise Data Protection,

More information

Non-relational Lift and Shift. Cheap, flexible Access Customer managed 250GB PB+

Non-relational Lift and Shift. Cheap, flexible Access Customer managed 250GB PB+ SQL Data Warehouse OLTP / DW workloads OLTP/ DW workloads DW workloads only Non-relational Lift and Shift Net new development Fully managed Cheap, flexible Access Customer managed Fully managed service

More information

Azure SQL Data Warehouse. Andrija Marcic Microsoft

Azure SQL Data Warehouse. Andrija Marcic Microsoft Azure SQL Data Warehouse Andrija Marcic Microsoft End to end platform built for the cloud Hadoop SQL Azure SQL Data Warehouse Azure SQL Database App Service Intelligent App Azure Machine Learning Power

More information

StarWind Virtual SAN Getting Started

StarWind Virtual SAN Getting Started #1 HyperConverged Appliance for SMB and ROBO StarWind Virtual SAN JUNE 2015 TECHNICAL PAPER Trademarks StarWind, StarWind Software and the StarWind and the StarWind Software logos are registered trademarks

More information

Ransomware & Modern DR: Risky Business

Ransomware & Modern DR: Risky Business Ransomware & Modern DR: Risky Business Matt Tyrer: Manager, Solutions Marketing - Americas 2016 COMMVAULT SYSTEMS, INC. ALL RIGHTS RESERVED. Agenda New-ish Risks New Answers to Old-ish Problems Old Problems

More information

ColumnStore Indexes. מה חדש ב- 2014?SQL Server.

ColumnStore Indexes. מה חדש ב- 2014?SQL Server. ColumnStore Indexes מה חדש ב- 2014?SQL Server דודאי מאיר meir@valinor.co.il 3 Column vs. row store Row Store (Heap / B-Tree) Column Store (values compressed) ProductID OrderDate Cost ProductID OrderDate

More information

Future of Database. - Journey to the Cloud. Juan Loaiza Senior Vice President Oracle Database Systems

Future of Database. - Journey to the Cloud. Juan Loaiza Senior Vice President Oracle Database Systems Future of Database - Journey to the Cloud Juan Loaiza Senior Vice President Oracle Database Systems Copyright 2016, Oracle and/or its affiliates. All rights reserved. Safe Harbor Statement The following

More information

HP Integration with Incorta: Connection Guide. HP Vertica Analytic Database

HP Integration with Incorta: Connection Guide. HP Vertica Analytic Database HP Integration with Incorta: Connection Guide HP Vertica Analytic Database HP Big Data Document Release Date: July, 2015 Legal Notices Warranty The only warranties for HP products and services are set

More information

WHAT AI AND THE CLOUD REVOLUTION MEAN FOR BUSINESS COMMUNICATIONS

WHAT AI AND THE CLOUD REVOLUTION MEAN FOR BUSINESS COMMUNICATIONS WHAT AI AND THE CLOUD REVOLUTION MEAN FOR BUSINESS COMMUNICATIONS Curtis Peterson SVP Cloud Operations 1 2017 RingCentral, Inc. All rights reserved. If the rate of change on the outside exceeds the rate

More information

28 February 1 March 2018, Trafo Baden. #techsummitch

28 February 1 March 2018, Trafo Baden. #techsummitch #techsummitch 28 February 1 March 2018, Trafo Baden #techsummitch Transform your data estate with cloud, data and AI #techsummitch The world is changing Data will grow to 44 ZB in 2020 Today, 80% of organizations

More information

Combine Native SQL Flexibility with SAP HANA Platform Performance and Tools

Combine Native SQL Flexibility with SAP HANA Platform Performance and Tools SAP Technical Brief Data Warehousing SAP HANA Data Warehousing Combine Native SQL Flexibility with SAP HANA Platform Performance and Tools A data warehouse for the modern age Data warehouses have been

More information

VxRail: Level Up with New Capabilities and Powers GLOBAL SPONSORS

VxRail: Level Up with New Capabilities and Powers GLOBAL SPONSORS VxRail: Level Up with New Capabilities and Powers GLOBAL SPONSORS VMware customers trust their infrastructure to vsan #1 Leading SDS Vendor >10,000 >100 83% vsan Customers Countries Deployed Critical Apps

More information

Top Five Reasons for Data Warehouse Modernization Philip Russom

Top Five Reasons for Data Warehouse Modernization Philip Russom Top Five Reasons for Data Warehouse Modernization Philip Russom TDWI Research Director for Data Management May 28, 2014 Sponsor Speakers Philip Russom TDWI Research Director, Data Management Steve Sarsfield

More information

Swimming in the Data Lake. Presented by Warner Chaves Moderated by Sander Stad

Swimming in the Data Lake. Presented by Warner Chaves Moderated by Sander Stad Swimming in the Data Lake Presented by Warner Chaves Moderated by Sander Stad Thank You microsoft.com hortonworks.com aws.amazon.com red-gate.com Empower users with new insights through familiar tools

More information

Designing a Modern Data Warehouse + Data Lake

Designing a Modern Data Warehouse + Data Lake Designing a Modern Warehouse + Lake Strategies & architecture options for implementing a modern data warehousing environment Melissa Coates Analytics Architect, SentryOne Blog: sqlchick.com Twitter: @sqlchick

More information

Netezza The Analytics Appliance

Netezza The Analytics Appliance Software 2011 Netezza The Analytics Appliance Michael Eden Information Management Brand Executive Central & Eastern Europe Vilnius 18 October 2011 Information Management 2011IBM Corporation Thought for

More information

Big Data Architect.

Big Data Architect. Big Data Architect www.austech.edu.au WHAT IS BIG DATA ARCHITECT? A big data architecture is designed to handle the ingestion, processing, and analysis of data that is too large or complex for traditional

More information

Application Visibility in Virtualized Environment

Application Visibility in Virtualized Environment Application Visibility in Virtualized Environment Application Visibility in Virtualized Environment Today, most enterprises run their business in virtualized infrastructure. Heterogeneous application workloads

More information

April Copyright 2013 Cloudera Inc. All rights reserved.

April Copyright 2013 Cloudera Inc. All rights reserved. Hadoop Beyond Batch: Real-time Workloads, SQL-on- Hadoop, and the Virtual EDW Headline Goes Here Marcel Kornacker marcel@cloudera.com Speaker Name or Subhead Goes Here April 2014 Analytic Workloads on

More information

Data 101 Which DB, When. Joe Yong Azure SQL Data Warehouse, Program Management Microsoft Corp.

Data 101 Which DB, When. Joe Yong Azure SQL Data Warehouse, Program Management Microsoft Corp. Data 101 Which DB, When Joe Yong (joeyong@microsoft.com) Azure SQL Data Warehouse, Program Management Microsoft Corp. The world is changing AI increased by 300% in 2017 Data will grow to 44 ZB in 2020

More information

Big Data com Hadoop. VIII Sessão - SQL Bahia. Impala, Hive e Spark. Diógenes Pires 03/03/2018

Big Data com Hadoop. VIII Sessão - SQL Bahia. Impala, Hive e Spark. Diógenes Pires 03/03/2018 Big Data com Hadoop Impala, Hive e Spark VIII Sessão - SQL Bahia 03/03/2018 Diógenes Pires Connect with PASS Sign up for a free membership today at: pass.org #sqlpass Internet Live http://www.internetlivestats.com/

More information

SAP HANA Scalability. SAP HANA Development Team

SAP HANA Scalability. SAP HANA Development Team SAP HANA Scalability Design for scalability is a core SAP HANA principle. This paper explores the principles of SAP HANA s scalability, and its support for the increasing demands of data-intensive workloads.

More information

Designing your BI Architecture

Designing your BI Architecture IBM Software Group Designing your BI Architecture Data Movement and Transformation David Cope EDW Architect Asia Pacific 2007 IBM Corporation DataStage and DWE SQW Complex Files SQL Scripts ERP ETL Engine

More information

StarWind Virtual SAN Free

StarWind Virtual SAN Free #1 HyperConverged Appliance for SMB and ROBO StarWind Virtual SAN Free Value Proposition For virtualization admins, IT geeks, bloggers, students or those who look to build and maintain virtualization infrastructure

More information

FAST SQL SERVER BACKUP AND RESTORE

FAST SQL SERVER BACKUP AND RESTORE WHITE PAPER FAST SQL SERVER BACKUP AND RESTORE WITH PURE STORAGE TABLE OF CONTENTS EXECUTIVE OVERVIEW... 3 GOALS AND OBJECTIVES... 3 AUDIENCE... 3 PURE STORAGE INTRODUCTION... 4 SOLUTION SUMMARY... 4 FLASHBLADE

More information

REFERENCE ARCHITECTURE Microsoft SQL Server 2016 Data Warehouse Fast Track. FlashStack 70TB Solution with Cisco UCS and Pure Storage FlashArray//X

REFERENCE ARCHITECTURE Microsoft SQL Server 2016 Data Warehouse Fast Track. FlashStack 70TB Solution with Cisco UCS and Pure Storage FlashArray//X REFERENCE ARCHITECTURE Microsoft SQL Server 2016 Data Warehouse Fast Track FlashStack 70TB Solution with Cisco UCS and Pure Storage FlashArray//X FLASHSTACK REFERENCE ARCHITECTURE September 2018 TABLE

More information

L300 deck. Paul Duffett Mar2017

L300 deck. Paul Duffett Mar2017 L300 deck Paul Duffett (paduffet@microsoft.com) Twitter: @paulduffett Mar2017 Contents In presentation mode click on any box to jump to that section Introduction Use case, pattern and adoption Scenarios

More information

Big Data with Hadoop Ecosystem

Big Data with Hadoop Ecosystem Diógenes Pires Big Data with Hadoop Ecosystem Hands-on (HBase, MySql and Hive + Power BI) Internet Live http://www.internetlivestats.com/ Introduction Business Intelligence Business Intelligence Process

More information

Part 1: Indexes for Big Data

Part 1: Indexes for Big Data JethroData Making Interactive BI for Big Data a Reality Technical White Paper This white paper explains how JethroData can help you achieve a truly interactive interactive response time for BI on big data,

More information

Temenos Bringing banking to millions through Cloud Scale Innovation

Temenos Bringing banking to millions through Cloud Scale Innovation Temenos Bringing banking to millions through Cloud Scale Innovation Cloud is supporting the next wave of Business Innovation Cloud is a given. CIOs no longer ask whether they should use the cloud, but

More information

Leading Innovation in the Data Center

Leading Innovation in the Data Center Leading Innovation in the Data Center Bjørn R. Martinussen Technical Solutions ArchitectARCHITECT Oslo, October 2012 1 Agenda IT Challenges Today EMC + Cisco + Intel Cisco Unified Data Center Joint DC

More information

Microsoft certified solutions associate

Microsoft certified solutions associate Microsoft certified solutions associate MCSA: BI Reporting This certification demonstrates your expertise in analyzing data with both Power BI and Excel. Exam 70-778/Course 20778 Analyzing and Visualizing

More information

Big Data and Enterprise Data, Bridging Two Worlds with Oracle Data Integration

Big Data and Enterprise Data, Bridging Two Worlds with Oracle Data Integration Big Data and Enterprise Data, Bridging Two Worlds with Oracle Data Integration WHITE PAPER / JANUARY 25, 2019 Table of Contents Introduction... 3 Harnessing the power of big data beyond the SQL world...

More information

THE EMC ISILON STORY. Big Data In The Enterprise. Deya Bassiouni Isilon Regional Sales Manager Emerging Africa, Egypt & Lebanon.

THE EMC ISILON STORY. Big Data In The Enterprise. Deya Bassiouni Isilon Regional Sales Manager Emerging Africa, Egypt & Lebanon. THE EMC ISILON STORY Big Data In The Enterprise Deya Bassiouni Isilon Regional Sales Manager Emerging Africa, Egypt & Lebanon August, 2012 1 Big Data In The Enterprise Isilon Overview Isilon Technology

More information

Modernize Your Infrastructure

Modernize Your Infrastructure Modernize Your Infrastructure The next industrial revolution 3 Dell - Internal Use - Confidential It s a journey. 4 Dell - Internal Use - Confidential Last 15 years IT-centric Systems of record Traditional

More information

VLDB. Partitioning Compression

VLDB. Partitioning Compression VLDB Partitioning Compression Oracle Partitioning in Oracle Database 11g Oracle Partitioning Ten Years of Development Core functionality Performance Manageability Oracle8 Range partitioning

More information

SAP HANA Update. Saul Cunningham SAP Big Data Centre of Excellence

SAP HANA Update. Saul Cunningham SAP Big Data Centre of Excellence SAP HANA Update Saul Cunningham SAP Big Data Centre of Excellence The first 35 years: innovated with ERP & LOB apps Data In ERP + LOB Systems of Record Five years ago: innovated with analytics Data In

More information

Aruba ridefinisce il futuro del Mobile, Cloud e IoT

Aruba ridefinisce il futuro del Mobile, Cloud e IoT Reimagine 2018 Aruba ridefinisce il futuro del Mobile, Cloud e IoT Alessandro Ercoli Team Leader Systems Engineer HPE Aruba Italy 24 maggio 2018 DIGITAL WORKPLACE EXPERIENCES POWERED BY ARUBA MOBILE FIRST

More information

Big Data Technology Ecosystem. Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara

Big Data Technology Ecosystem. Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara Big Data Technology Ecosystem Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara Agenda End-to-End Data Delivery Platform Ecosystem of Data Technologies Mapping an End-to-End Solution Case

More information

Oracle Big Data SQL. Release 3.2. Rich SQL Processing on All Data

Oracle Big Data SQL. Release 3.2. Rich SQL Processing on All Data Oracle Big Data SQL Release 3.2 The unprecedented explosion in data that can be made useful to enterprises from the Internet of Things, to the social streams of global customer bases has created a tremendous

More information

Microsoft Exam

Microsoft Exam Volume: 42 Questions Case Study: 1 Relecloud General Overview Relecloud is a social media company that processes hundreds of millions of social media posts per day and sells advertisements to several hundred

More information

No Trade Secrets. Microsoft does not claim any trade secret rights in this documentation.

No Trade Secrets. Microsoft does not claim any trade secret rights in this documentation. [MS-DPPDW]: Intellectual Property Rights Notice for Open Specifications Documentation Technical Documentation. Microsoft publishes Open Specifications documentation for protocols, file formats, languages,

More information

Processing Unstructured Data. Dinesh Priyankara Founder/Principal Architect dinesql Pvt Ltd.

Processing Unstructured Data. Dinesh Priyankara Founder/Principal Architect dinesql Pvt Ltd. Processing Unstructured Data Dinesh Priyankara Founder/Principal Architect dinesql Pvt Ltd. http://dinesql.com / Dinesh Priyankara @dinesh_priya Founder/Principal Architect dinesql Pvt Ltd. Microsoft Most

More information

Oracle Big Data Connectors

Oracle Big Data Connectors Oracle Big Data Connectors Oracle Big Data Connectors is a software suite that integrates processing in Apache Hadoop distributions with operations in Oracle Database. It enables the use of Hadoop to process

More information

Copyright 2015 EMC Corporation. All rights reserved. STRATEGIC FORUM PAT GELSINGER CEO, VMware

Copyright 2015 EMC Corporation. All rights reserved. STRATEGIC FORUM PAT GELSINGER CEO, VMware STRATEGIC FORUM 2015 PAT GELSINGER CEO, VMware Federation: VMware Perspective In a Period of Industry Tumult Being bigger and more strategic is good Customers Get Better Together Customers want choice

More information

Ian Choy. Technology Solutions Professional

Ian Choy. Technology Solutions Professional Ian Choy Technology Solutions Professional XML KPIs SQL Server 2000 Management Studio Mirroring SQL Server 2005 Compression Policy-Based Mgmt Programmability SQL Server 2008 PowerPivot SharePoint Integration

More information

September 2013 Alberto Abelló & Oscar Romero 1

September 2013 Alberto Abelló & Oscar Romero 1 duce-i duce-i September 2013 Alberto Abelló & Oscar Romero 1 Knowledge objectives 1. Enumerate several use cases of duce 2. Describe what the duce environment is 3. Explain 6 benefits of using duce 4.

More information

Polybase In Action. Kevin Feasel Engineering Manager, Predictive Analytics ChannelAdvisor #ITDEVCONNECTIONS ITDEVCONNECTIONS.COM

Polybase In Action. Kevin Feasel Engineering Manager, Predictive Analytics ChannelAdvisor #ITDEVCONNECTIONS ITDEVCONNECTIONS.COM Polybase In Action Kevin Feasel Engineering Manager, Predictive Analytics ChannelAdvisor Who Am I? What Am I Doing Here? Catallaxy Services Curated SQL We Speak Linux @feaselkl Polybase Polybase is Microsoft's

More information

CIS 601 Graduate Seminar. Dr. Sunnie S. Chung Dhruv Patel ( ) Kalpesh Sharma ( )

CIS 601 Graduate Seminar. Dr. Sunnie S. Chung Dhruv Patel ( ) Kalpesh Sharma ( ) Guide: CIS 601 Graduate Seminar Presented By: Dr. Sunnie S. Chung Dhruv Patel (2652790) Kalpesh Sharma (2660576) Introduction Background Parallel Data Warehouse (PDW) Hive MongoDB Client-side Shared SQL

More information

5 Fundamental Strategies for Building a Data-centered Data Center

5 Fundamental Strategies for Building a Data-centered Data Center 5 Fundamental Strategies for Building a Data-centered Data Center June 3, 2014 Ken Krupa, Chief Field Architect Gary Vidal, Solutions Specialist Last generation Reference Data Unstructured OLTP Warehouse

More information

[MS-DPPDW]: Parallel Data Warehouse Data Portability Overview. Intellectual Property Rights Notice for Open Specifications Documentation

[MS-DPPDW]: Parallel Data Warehouse Data Portability Overview. Intellectual Property Rights Notice for Open Specifications Documentation [MS-DPPDW]: Intellectual Property Rights Notice for Open Specifications Documentation Technical Documentation. Microsoft publishes Open Specifications documentation ( this documentation ) for protocols,

More information

Impala. A Modern, Open Source SQL Engine for Hadoop. Yogesh Chockalingam

Impala. A Modern, Open Source SQL Engine for Hadoop. Yogesh Chockalingam Impala A Modern, Open Source SQL Engine for Hadoop Yogesh Chockalingam Agenda Introduction Architecture Front End Back End Evaluation Comparison with Spark SQL Introduction Why not use Hive or HBase?

More information

BIG DATA COURSE CONTENT

BIG DATA COURSE CONTENT BIG DATA COURSE CONTENT [I] Get Started with Big Data Microsoft Professional Orientation: Big Data Duration: 12 hrs Course Content: Introduction Course Introduction Data Fundamentals Introduction to Data

More information

WHITEPAPER. MemSQL Enterprise Feature List

WHITEPAPER. MemSQL Enterprise Feature List WHITEPAPER MemSQL Enterprise Feature List 2017 MemSQL Enterprise Feature List DEPLOYMENT Provision and deploy MemSQL anywhere according to your desired cluster configuration. On-Premises: Maximize infrastructure

More information

Rickard Linck Client Technical Professional Core Database and Lifecycle Management Common Analytic Engine Cloud Data Servers On-Premise Data Servers

Rickard Linck Client Technical Professional Core Database and Lifecycle Management Common Analytic Engine Cloud Data Servers On-Premise Data Servers Rickard Linck Client Technical Professional Core Database and Lifecycle Management Common Analytic Engine Cloud Data Servers On-Premise Data Servers Watson Data Platform Reference Architecture Business

More information

Guide Users along Information Pathways and Surf through the Data

Guide Users along Information Pathways and Surf through the Data Guide Users along Information Pathways and Surf through the Data Stephen Overton, Overton Technologies, LLC, Raleigh, NC ABSTRACT Business information can be consumed many ways using the SAS Enterprise

More information

Built for Speed: Comparing Panoply and Amazon Redshift Rendering Performance Utilizing Tableau Visualizations

Built for Speed: Comparing Panoply and Amazon Redshift Rendering Performance Utilizing Tableau Visualizations Built for Speed: Comparing Panoply and Amazon Redshift Rendering Performance Utilizing Tableau Visualizations Table of contents Faster Visualizations from Data Warehouses 3 The Plan 4 The Criteria 4 Learning

More information

Zero Trust in Healthcare Centrify Corporations. All Rights Reserved.

Zero Trust in Healthcare Centrify Corporations. All Rights Reserved. Zero Trust in Healthcare 1 CYBER OFFENSE REDEFINED: TRANSFORM YOUR SECURITY POSTURE WITH ZERO TRUST 2 What Keeps CIOs Up at Night? How exposed are we, anyway? Who can access what? Can we trust our partners?

More information

SQL SERVER Lubo Goryl Solution Professional Microsoft Slovakia

SQL SERVER Lubo Goryl Solution Professional Microsoft Slovakia SERVER 2012 Lubo Goryl Solution Professional Microsoft Slovakia AGENDA Prehlaď noviniek v 2012 Nové technológie pre HA & DR Výkonové zlepšenia a možnosti škálovateľnosti Nové technológie pre DWH (FastTrack,

More information

COMPANY VISION 기업의생산성향상에기여하는최고의협업솔루션을제공하는최고의클라우드기업솔루션공급사

COMPANY VISION 기업의생산성향상에기여하는최고의협업솔루션을제공하는최고의클라우드기업솔루션공급사 COMPANY VISION 기업의생산성향상에기여하는최고의협업솔루션을제공하는최고의클라우드기업솔루션공급사 Become the world s largest enterprise communications cloud provider, bringing best-in-class productivity and collaboration tools to businesses 1

More information

PUBLIC SAP Vora Sizing Guide

PUBLIC SAP Vora Sizing Guide SAP Vora 2.0 Document Version: 1.1 2017-11-14 PUBLIC Content 1 Introduction to SAP Vora....3 1.1 System Architecture....5 2 Factors That Influence Performance....6 3 Sizing Fundamentals and Terminology....7

More information

FlashStack 70TB Solution with Cisco UCS and Pure Storage FlashArray

FlashStack 70TB Solution with Cisco UCS and Pure Storage FlashArray REFERENCE ARCHITECTURE Microsoft SQL Server 2016 Data Warehouse Fast Track FlashStack 70TB Solution with Cisco UCS and Pure Storage FlashArray FLASHSTACK REFERENCE ARCHITECTURE December 2017 TABLE OF CONTENTS

More information

Safe Harbor Statement

Safe Harbor Statement Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment

More information

1 Dulcian, Inc., 2001 All rights reserved. Oracle9i Data Warehouse Review. Agenda

1 Dulcian, Inc., 2001 All rights reserved. Oracle9i Data Warehouse Review. Agenda Agenda Oracle9i Warehouse Review Dulcian, Inc. Oracle9i Server OLAP Server Analytical SQL Mining ETL Infrastructure 9i Warehouse Builder Oracle 9i Server Overview E-Business Intelligence Platform 9i Server:

More information

Interactive SQL-on-Hadoop from Impala to Hive/Tez to Spark SQL to JethroData

Interactive SQL-on-Hadoop from Impala to Hive/Tez to Spark SQL to JethroData Interactive SQL-on-Hadoop from Impala to Hive/Tez to Spark SQL to JethroData ` Ronen Ovadya, Ofir Manor, JethroData About JethroData Founded 2012 Raised funding from Pitango in 2013 Engineering in Israel,

More information

SQL Server Evolution. SQL 2016 new innovations. Trond Brande

SQL Server Evolution. SQL 2016 new innovations. Trond Brande SQL Server Evolution SQL 2016 new innovations Trond Brande SQL Server 2016 Editions Enterprise Express SMALL-SCALE DATABASES Development and management tools Easy backup and restore to Microsoft Azure

More information

What is Gluent? The Gluent Data Platform

What is Gluent? The Gluent Data Platform What is Gluent? The Gluent Data Platform The Gluent Data Platform provides a transparent data virtualization layer between traditional databases and modern data storage platforms, such as Hadoop, in the

More information

Answer: A Reference:http://www.vertica.com/wpcontent/uploads/2012/05/MicroStrategy_Vertica_12.p df(page 1, first para)

Answer: A Reference:http://www.vertica.com/wpcontent/uploads/2012/05/MicroStrategy_Vertica_12.p df(page 1, first para) 1 HP - HP2-N44 Selling HP Vertical Big Data Solutions QUESTION: 1 When is Vertica a better choice than SAP HANA? A. The customer wants a closed ecosystem for BI and analytics, and is unconcerned with support

More information

Amazon Web Services. For Government, Education, and Nonprofit Organizations

Amazon Web Services. For Government, Education, and Nonprofit Organizations Amazon Web Services For Government, Education, and Nonprofit Organizations Max Peterson GM EMEA, LATAM and Global Contracts maxpete@amazon.co.uk +44 (0)7342 079563 2015, Amazon Web Services, Inc. or its

More information