Copyright 2015, Oracle and/or its affiliates. All rights reserved.

Size: px
Start display at page:

Download "Copyright 2015, Oracle and/or its affiliates. All rights reserved."

Transcription

1

2 DB12c on SPARC M7 InMemory PoC for Oracle SPARC M7 Krzysztof Marciniak Radosław Kut CoreTech Competency Center 26/01/2016

3 Agenda Oracle Database 12c In-Memory Option Proof of Concept what is the concept to proof Test Methodology Results Summary 26/01/2016

4 Oracle Database 12c In-Memory Option Real Time Analytics Accelerate Mixed Workload OLTP No Changes to Applications Trivial to Implement 100x 2x

5 Row Format Databases vs. Column Format Databases Row SALES Transactions run faster on row format Example: Insert or query a sales order Fast processing few rows, many columns Column SALES Analytics run faster on column format Example : Report on sales totals by region Fast accessing few columns, many rows 5

6 Row Format Databases vs. Column Format Databases Row INSERT SALES Insert a new sales order on row format One row insert = FAST Column SALES Stores Insert a new sales order in Column Format Many column inserts = SLOW INSERT INSERT INSERT INSERT Until Now Must Choose One Format and Suffer Tradeoffs 6

7 Breakthrough: Dual Format Database Normal Buffer Cache SALES Row Format New In-Memory Format SALES Column Format BOTH row and column formats for same table Simultaneously active and transactionally consistent Analytics & reporting use new in-memory Column format OLTP uses proven row format SALES 7

8 Agenda Oracle Database 12c In-Memory Option Proof of Concept what is the concept to proof Test Methodology Results Summary 26/01/2016 8

9 Proof of Concept what is the concept to proof Thanks to new SPARC dedicated acceleration engines built on chip scalability and performance of processing data with InMemory option should give much better results than compared to other CPU platform (in this case Intel ) 9

10 Proof of Concept what is the concept to proof Performance Reliability DB In-Memory Acceleration Application Data Integrity PoC Software in Silicon Decompression Engines Capacity Sub-microsecond Cluster Messages Communication

11 Software in Silicon: Improving Performance Reduce processing time by off-loading simple tasks to special purpose hardware Processing time Software processing Hardware processing Without Software in Silicon Application performance improves because software processing supported by Software in Silicon is processed by hardware Software processing Hardware processing With Software in Silicon 11

12 Read DAX Write Read Write Software in Silicon: Accelerating Oracle Database 12c Decompress at memory speed >120 GB/sec Decompress More than Doubles data size Write Read Software scan Multiple steps t One step faster SQL: SELECT count(*) WHERE lo_orderdate = d_datekey AND lo_partkey = AND d_year_monthnum BETWEEN AND ;

13 Database In-Memory Acceleration Engines Core SPARC CPU Core Core Core Shared Cache New SPARC chip uses dedicated acceleration engines built on chip Independently process streams of unaligned database column elements of any size E.g. find all values that match penguins Frees CPU cores to run higher level SQL functions DB Accel DB Accel DB Accel DB Accel Reads data directly from memory and places results in cache for core consumption Shared cache provides ultra-fast communication

14 DAX DB Acceleration in High Performance Kernel Decompression and Query (Query Pipeline of DAX) SQL made up from few basic ops: Filter/Search/Sort or Join/Group/Aggregate First generation DAX (Query pipe) accelerates Translate: HASH JOINs Scan: search ( WHERE clause) Select: filter to reduce a column Decompression more important than compression Reading outweighs writing Accelerate RLE, N gram, OZIP Core Core DAX Engine(s) CPU

15 Agenda Oracle Database 12c In-Memory Option Proof of Concept what is the concept to proof Test Methodology Results Summary 26/01/

16 Methodology Tests were issued with following criteria: Identical schemas with the same size were generated on both platforms within a single database instance Data generated with SSB ( - SCALEFACTOR=100 Instance caging used to reference to 6 oracle db cpu licenses (resource_manager_plan=default_plan): M7 cpu_count = 96 Intel Xeon X5670 Processors (2.93 GHz): cpu_count = 24 Intel Xeon E v3 Processors (2.3 GHz) cpu_count = 24 All data populated for in-memory Tables compressed with MEMCOMPRESS FOR QUERY HIGH for in-memory DOP used with DEGREE 8 on LINEORDER table TABLE_NAME INMEMORY INMEMORY_COMPRESS NUM_ROWS CUSTOMER ENABLED FOR QUERY HIGH DATE_DIM ENABLED FOR QUERY HIGH 2556 LINEORDER ENABLED FOR QUERY HIGH PART ENABLED FOR QUERY HIGH SUPPLIER ENABLED FOR QUERY HIGH /4/2016 Public 16

17 Methodology JMeter used to simulate users traffic with following settings: simulation iterations for simultaneous users 10,20,30,40,50,60,70,80,90,100 following query was used: select count(distinct(lo_custkey)) from( select lo_custkey from lineorder,date_dim where lo_orderdate = d_datekey and d_weeknuminyear = :1 and d_year = :2 and lo_orderpriority <> :3 and lo_ordtotalprice between 7000 and group by lo_orderkey, lo_custkey having count(lo_linenumber) =1); Bind variables values randomly picked from external.csv file Performance of InMemory processing analyzed with two metrics: Query Throughput (tps) and Query Response Time (ms) 2/4/2016 Public 17

18 Agenda Oracle Database 12c In-Memory Option Proof of Concept what is the concept to proof Test Methodology Results Summary 26/01/

19 SPARC M7: Throughput and Response Time for 10,20,30,40,50,60,70,80,90,100 users

20 SPARC M7: Response Time (ms) for 10,20,30,40,50,60,70,80,90,100 users

21 Intel Xeon X5670 : Throughput and Response Time for 10,20,30,40,50 users

22 Intel Xeon X5670 : Response Time(ms) for 10,20,30,40,50 users

23 Intel Xeon E v3 : Throughput and Response Time for 10,20,30,40,50,60,70,80,90,100 users

24 Intel Xeon E v3 : Throughput and Response Time for 10,20,30,40,50,60,70,80,90,100 users

25 Agenda Oracle Database 12c In-Memory Option Proof of Concept what is the concept to proof Test Methodology Results Summary 26/01/

26 Summary SPARC M7 shows significantly better results in terms of Throughput and Response Time for InMemory operations. Thanks to Data Analytics Accelerators (DAX), which are in-memory query acceleration engines performance is many times faster compared to other processors. It is noticeable for InMemory operations also in compressed format (DAX is able to operate directly upon compressed IMCUs). This makes SPARC M7 possible to perform real time analysis and fulfill business demands. 2/4/2016 Public 26

27

Oracle Database In-Memory

Oracle Database In-Memory Oracle Database In-Memory Mark Weber Principal Sales Consultant November 12, 2014 Row Format Databases vs. Column Format Databases Row SALES Transactions run faster on row format Example: Insert or query

More information

Recent Innovations in Data Storage Technologies Dr Roger MacNicol Software Architect

Recent Innovations in Data Storage Technologies Dr Roger MacNicol Software Architect Recent Innovations in Data Storage Technologies Dr Roger MacNicol Software Architect Copyright 2017, Oracle and/or its affiliates. All rights reserved. Safe Harbor Statement The following is intended to

More information

Oracle Database In-Memory

Oracle Database In-Memory Oracle Database In-Memory Under The Hood Andy Cleverly andy.cleverly@oracle.com Director Database Technology Oracle EMEA Technology Safe Harbor Statement The following is intended to outline our general

More information

Oracle Database In-Memory By Example

Oracle Database In-Memory By Example Oracle Database In-Memory By Example Andy Rivenes Senior Principal Product Manager DOAG 2015 November 18, 2015 Safe Harbor Statement The following is intended to outline our general product direction.

More information

Real-World Performance Training Star Query Prescription

Real-World Performance Training Star Query Prescription Real-World Performance Training Star Query Prescription Real-World Performance Team Dimensional Queries 1 2 3 4 The Dimensional Model and Star Queries Star Query Execution Star Query Prescription Edge

More information

Oracle Database In-Memory What s New and What s Coming

Oracle Database In-Memory What s New and What s Coming Oracle Database In-Memory What s New and What s Coming Andy Rivenes Product Manager for Database In-Memory Oracle Database Systems DOAG - May 10, 2016 #DBIM12c Safe Harbor Statement The following is intended

More information

Copyright 2014, Oracle and/or its affiliates. All rights reserved.

Copyright 2014, Oracle and/or its affiliates. All rights reserved. 1 Oracle Database 12c Preview In-Memory Column Store (V12.1.0.2) Michael Künzner Principal Sales Consultant The following is intended to outline our general product direction. It is intended for information

More information

Insider s Guide on Using ADO with Database In-Memory & Storage-Based Tiering. Andy Rivenes Gregg Christman Oracle Product Management 16 November 2016

Insider s Guide on Using ADO with Database In-Memory & Storage-Based Tiering. Andy Rivenes Gregg Christman Oracle Product Management 16 November 2016 Insider s Guide on Using ADO with Database In-Memory & Storage-Based Tiering Andy Rivenes Gregg Christman Oracle Product Management 16 November 2016 Safe Harbor Statement The following is intended to outline

More information

Real Time Summarization. Copyright 2014, Oracle and/or its affiliates. All rights reserved.

Real Time Summarization. Copyright 2014, Oracle and/or its affiliates. All rights reserved. Real Time Summarization Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract.

More information

Oracle CoreTech Update OASC Opening 17. November 2014

Oracle CoreTech Update OASC Opening 17. November 2014 Oracle CoreTech Update OASC Opening 17. November 2014 Roger Wullschleger Senior Manager Sales Consulting CoreTech Oracle Software (Schweiz) GmbH Copyright 2014, Oracle and/or its affiliates. All rights

More information

Real-World Performance Training Exadata and Database In-Memory

Real-World Performance Training Exadata and Database In-Memory Real-World Performance Training Exadata and Database In-Memory Real-World Performance Team Agenda 1 2 3 4 5 The DW/BI Death Spiral Parallel Execution Loading Data Exadata and Database In-Memory Dimensional

More information

Real-World Performance Training SQL Performance

Real-World Performance Training SQL Performance Real-World Performance Training SQL Performance Real-World Performance Team Agenda 1 2 3 4 5 6 The Optimizer Optimizer Inputs Optimizer Output Advanced Optimizer Behavior Why is my SQL slow? Optimizer

More information

In-Memory is Your Data Warehouse s New BFF

In-Memory is Your Data Warehouse s New BFF In-Memory is Your Data Warehouse s New BFF Michelle Kolbe medium.com/@datacheesehead @MeKolbe linkedin.com/in/michelle.kolbe Michelle.Kolbe@RedPillAnalytics.com www.redpillanalytics.com info@redpillanalytics.com

More information

Real-World Performance Training Star Query Edge Conditions and Extreme Performance

Real-World Performance Training Star Query Edge Conditions and Extreme Performance Real-World Performance Training Star Query Edge Conditions and Extreme Performance Real-World Performance Team Dimensional Queries 1 2 3 4 The Dimensional Model and Star Queries Star Query Execution Star

More information

Real-World Performance Training SQL Performance

Real-World Performance Training SQL Performance Real-World Performance Training SQL Performance Real-World Performance Team Agenda 1 2 3 4 5 6 SQL and the Optimizer You As The Optimizer Optimization Strategies Why is my SQL slow? Optimizer Edges Cases

More information

Copyright 2018, Oracle and/or its affiliates. All rights reserved.

Copyright 2018, Oracle and/or its affiliates. All rights reserved. Oracle Database In- Memory Implementation Best Practices and Deep Dive [TRN4014] Andy Rivenes Database In-Memory Product Management Oracle Corporation Safe Harbor Statement The following is intended to

More information

Database In-Memory: A Deep Dive and a Future Preview

Database In-Memory: A Deep Dive and a Future Preview Database In-Memory: A Deep Dive and a Future Preview Tirthankar Lahiri, Markus Kissling Oracle Corporation Keywords: Database In-Memory, Oracle Database 12c, Oracle Database 12.2 1. Introduction The Oracle

More information

Oracle Database In-Memory

Oracle Database In-Memory Oracle Database In-Memory A Focus On The Technology Andy Rivenes Database In-Memory Product Management Oracle Corporation Email: andy.rivenes@oracle.com Twitter: @TheInMemoryGuy Blog: blogs.oracle.com/in-memory

More information

Safe Harbor Statement

Safe Harbor Statement Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment

More information

1/3/2015. Column-Store: An Overview. Row-Store vs Column-Store. Column-Store Optimizations. Compression Compress values per column

1/3/2015. Column-Store: An Overview. Row-Store vs Column-Store. Column-Store Optimizations. Compression Compress values per column //5 Column-Store: An Overview Row-Store (Classic DBMS) Column-Store Store one tuple ata-time Store one column ata-time Row-Store vs Column-Store Row-Store Column-Store Tuple Insertion: + Fast Requires

More information

Oracle Database In-Memory Hands-on Lab

Oracle Database In-Memory Hands-on Lab Andy Rivenes Database In-Memory Product Manager Systems Technology Group October 2018 Table of Contents HOL Overview... 3 Setup... 4 Part 1: Monitoring the In-Memory Column Store... 5 Part 2: Querying

More information

Was ist dran an einer spezialisierten Data Warehousing platform?

Was ist dran an einer spezialisierten Data Warehousing platform? Was ist dran an einer spezialisierten Data Warehousing platform? Hermann Bär Oracle USA Redwood Shores, CA Schlüsselworte Data warehousing, Exadata, specialized hardware proprietary hardware Introduction

More information

Data Modeling and Databases Ch 7: Schemas. Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich

Data Modeling and Databases Ch 7: Schemas. Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich Data Modeling and Databases Ch 7: Schemas Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich Database schema A Database Schema captures: The concepts represented Their attributes

More information

Optimize OLAP & Business Analytics Performance with Oracle 12c In-Memory Database Option

Optimize OLAP & Business Analytics Performance with Oracle 12c In-Memory Database Option Optimize OLAP & Business Analytics Performance with Oracle 12c In-Memory Database Option Kai Yu, Senior Principal Engineer Dell Oracle Solutions Engineering Dell, Inc. ABSTRACT By introducing the In-Memory

More information

Optimize OLAP & Business Analytics Performance with Oracle 12c In-Memory Database Option

Optimize OLAP & Business Analytics Performance with Oracle 12c In-Memory Database Option Optimize OLAP & Business Analytics Performance with Oracle 12c In-Memory Database Option Session ID: 1571 Prepared by: Kai Yu Senior Principal Engineer Dell Oracle Solutions Engineering Dell, Inc. @ky_austin1

More information

Optimize Oracle Business Intelligence Analytics with Oracle 12c In-Memory Database option

Optimize Oracle Business Intelligence Analytics with Oracle 12c In-Memory Database option Optimize Oracle Business Intelligence Analytics with Oracle 12c In-Memory Database option Prepared by: Kai Yu Senior Principal Architect, Dell Oracle Solutions Engineering @ky_austin REMINDER Check in

More information

Using Druid and Apache Hive

Using Druid and Apache Hive 3 Using Druid and Apache Hive Date of Publish: 2018-07-12 http://docs.hortonworks.com Contents Accelerating Hive queries using Druid... 3 How Druid indexes Hive data... 3 Transform Apache Hive Data to

More information

Optimize Oracle Business Intelligence Analytics with Oracle 12c In-Memory Database Option. Kai Yu Oracle Solutions Engineering Dell Inc

Optimize Oracle Business Intelligence Analytics with Oracle 12c In-Memory Database Option. Kai Yu Oracle Solutions Engineering Dell Inc Optimize Oracle Business Intelligence Analytics with Oracle 12c In-Memory Database Option Kai Yu Oracle Solutions Engineering Dell Inc About Author Kai Yu, Senior Principal Architect, Dell Database Engineering

More information

Oracle In-Memory & Data Warehouse: The Perfect Combination?

Oracle In-Memory & Data Warehouse: The Perfect Combination? : The Perfect Combination? UKOUG Tech17, 6 December 2017 Dani Schnider, Trivadis AG @dani_schnider danischnider.wordpress.com BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA HAMBURG COPENHAGEN

More information

Real-World Performance Training Dimensional Queries

Real-World Performance Training Dimensional Queries Real-World Performance Training al Queries Real-World Performance Team Agenda 1 2 3 4 5 The DW/BI Death Spiral Parallel Execution Loading Data Exadata and Database In-Memory al Queries al Queries 1 2 3

More information

Column Stores vs. Row Stores How Different Are They Really?

Column Stores vs. Row Stores How Different Are They Really? Column Stores vs. Row Stores How Different Are They Really? Daniel J. Abadi (Yale) Samuel R. Madden (MIT) Nabil Hachem (AvantGarde) Presented By : Kanika Nagpal OUTLINE Introduction Motivation Background

More information

Oracle Database In-Memory Hands-on Lab

Oracle Database In-Memory Hands-on Lab Table of Contents HOL Overview... 3 Setup... 4 Part 1: Monitoring the In-Memory Column Store... 4 Part 2: Querying In-Memory Column Store Tables... 14 Part 3: In-Memory Joins and Aggregation... 33 Page

More information

Introduction to column stores

Introduction to column stores Introduction to column stores Justin Swanhart Percona Live, April 2013 INTRODUCTION 2 Introduction 3 Who am I? What do I do? Why am I here? A quick survey 4? How many people have heard the term row store?

More information

Safe Harbor Statement

Safe Harbor Statement Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment

More information

Oracle Database Database In-Memory Guide. 12c Release 2 (12.2)

Oracle Database Database In-Memory Guide. 12c Release 2 (12.2) Oracle Database Database In-Memory Guide 12c Release 2 (12.2) E85772-05 January 2018 Oracle Database Database In-Memory Guide, 12c Release 2 (12.2) E85772-05 Copyright 2016, 2018, Oracle and/or its affiliates.

More information

Oracle Exadata: Strategy and Roadmap

Oracle Exadata: Strategy and Roadmap Oracle Exadata: Strategy and Roadmap - New Technologies, Cloud, and On-Premises Juan Loaiza Senior Vice President, Database Systems Technologies, Oracle Safe Harbor Statement The following is intended

More information

Spark-GPU: An Accelerated In-Memory Data Processing Engine on Clusters

Spark-GPU: An Accelerated In-Memory Data Processing Engine on Clusters 1 Spark-GPU: An Accelerated In-Memory Data Processing Engine on Clusters Yuan Yuan, Meisam Fathi Salmi, Yin Huai, Kaibo Wang, Rubao Lee and Xiaodong Zhang The Ohio State University Paypal Inc. Databricks

More information

Using the In-Memory Columnar Store to Perform Real-Time Analysis of CERN Data. Maaike Limper Emil Pilecki Manuel Martín Márquez

Using the In-Memory Columnar Store to Perform Real-Time Analysis of CERN Data. Maaike Limper Emil Pilecki Manuel Martín Márquez Using the In-Memory Columnar Store to Perform Real-Time Analysis of CERN Data Maaike Limper Emil Pilecki Manuel Martín Márquez About the speakers Maaike Limper Physicist and project leader Manuel Martín

More information

Oracle Platform Performance Baseline Oracle 12c on Hitachi VSP G1000. Benchmark Report December 2014

Oracle Platform Performance Baseline Oracle 12c on Hitachi VSP G1000. Benchmark Report December 2014 Oracle Platform Performance Baseline Oracle 12c on Hitachi VSP G1000 Benchmark Report December 2014 Contents 1 System Configuration 2 Introduction into Oracle Platform Performance Tests 3 Storage Benchmark

More information

Upgrade to Microsoft SQL Server 2016 with Dell EMC Infrastructure

Upgrade to Microsoft SQL Server 2016 with Dell EMC Infrastructure Upgrade to Microsoft SQL Server 2016 with Dell EMC Infrastructure Generational Comparison Study of Microsoft SQL Server Dell Engineering February 2017 Revisions Date Description February 2017 Version 1.0

More information

Reduce Costs & Increase Oracle Database OLTP Workload Service Levels:

Reduce Costs & Increase Oracle Database OLTP Workload Service Levels: Reduce Costs & Increase Oracle Database OLTP Workload Service Levels: PowerEdge 2950 Consolidation to PowerEdge 11th Generation A Dell Technical White Paper Dell Database Solutions Engineering Balamurugan

More information

SUPERMICRO, VEXATA AND INTEL ENABLING NEW LEVELS PERFORMANCE AND EFFICIENCY FOR REAL-TIME DATA ANALYTICS FOR SQL DATA WAREHOUSE DEPLOYMENTS

SUPERMICRO, VEXATA AND INTEL ENABLING NEW LEVELS PERFORMANCE AND EFFICIENCY FOR REAL-TIME DATA ANALYTICS FOR SQL DATA WAREHOUSE DEPLOYMENTS TABLE OF CONTENTS 2 THE AGE OF INFORMATION ACCELERATION Vexata Provides the Missing Piece in The Information Acceleration Puzzle The Vexata - Supermicro Partnership 4 CREATING ULTRA HIGH-PERFORMANCE DATA

More information

Consolidating OLTP Workloads on Dell PowerEdge R th generation Servers

Consolidating OLTP Workloads on Dell PowerEdge R th generation Servers Consolidating OLTP Workloads on Dell PowerEdge R720 12 th generation Servers B Balamurugan Phani MV Dell Database Solutions Engineering March 2012 This document is for informational purposes only and may

More information

Addressing the Memory Wall

Addressing the Memory Wall Lecture 26: Addressing the Memory Wall Parallel Computer Architecture and Programming CMU 15-418/15-618, Spring 2015 Tunes Cage the Elephant Back Against the Wall (Cage the Elephant) This song is for the

More information

Database In-Memory Workshop

Database In-Memory Workshop Database In-Memory Workshop Student Workshop Lab Guide Creation Date [September 2014] Last Modified Date - 11/10/2014 Comments? Questions? Stay Connected! osc_us@oracle.com #osc_us OracleSolutionCenter

More information

Fast, In-Memory Analytics on PPDM. Calgary 2016

Fast, In-Memory Analytics on PPDM. Calgary 2016 Fast, In-Memory Analytics on PPDM Calgary 2016 In-Memory Analytics A BI methodology to solve complex and timesensitive business scenarios by using system memory as opposed to physical disk, by increasing

More information

Session 201-B: Accelerating Enterprise Applications with Flash Memory

Session 201-B: Accelerating Enterprise Applications with Flash Memory Session 201-B: Accelerating Enterprise Applications with Flash Memory Rob Larsen Director, Enterprise SSD Micron Technology relarsen@micron.com August 2014 1 Agenda Target applications Addressing needs

More information

CIS 601 Graduate Seminar. Dr. Sunnie S. Chung Dhruv Patel ( ) Kalpesh Sharma ( )

CIS 601 Graduate Seminar. Dr. Sunnie S. Chung Dhruv Patel ( ) Kalpesh Sharma ( ) Guide: CIS 601 Graduate Seminar Presented By: Dr. Sunnie S. Chung Dhruv Patel (2652790) Kalpesh Sharma (2660576) Introduction Background Parallel Data Warehouse (PDW) Hive MongoDB Client-side Shared SQL

More information

Oracle Database In-Memory with Oracle Database 18c

Oracle Database In-Memory with Oracle Database 18c Oracle Database In-Memory with Oracle Database 18c Technical Overview ORACLE WHITE PAPER FEBRUARY 2018 Disclaimer The following is intended to outline our general product direction. It is intended for

More information

COLUMN-STORES VS. ROW-STORES: HOW DIFFERENT ARE THEY REALLY? DANIEL J. ABADI (YALE) SAMUEL R. MADDEN (MIT) NABIL HACHEM (AVANTGARDE)

COLUMN-STORES VS. ROW-STORES: HOW DIFFERENT ARE THEY REALLY? DANIEL J. ABADI (YALE) SAMUEL R. MADDEN (MIT) NABIL HACHEM (AVANTGARDE) COLUMN-STORES VS. ROW-STORES: HOW DIFFERENT ARE THEY REALLY? DANIEL J. ABADI (YALE) SAMUEL R. MADDEN (MIT) NABIL HACHEM (AVANTGARDE) PRESENTATION BY PRANAV GOEL Introduction On analytical workloads, Column

More information

Oracle Exadata X7. Uwe Kirchhoff Oracle ACS - Delivery Senior Principal Service Delivery Engineer

Oracle Exadata X7. Uwe Kirchhoff Oracle ACS - Delivery Senior Principal Service Delivery Engineer Oracle Exadata X7 Uwe Kirchhoff Oracle ACS - Delivery Senior Principal Service Delivery Engineer 05.12.2017 Oracle Engineered Systems ZFS Backup Appliance Zero Data Loss Recovery Appliance Exadata Database

More information

Cloud Computing with FPGA-based NVMe SSDs

Cloud Computing with FPGA-based NVMe SSDs Cloud Computing with FPGA-based NVMe SSDs Bharadwaj Pudipeddi, CTO NVXL Santa Clara, CA 1 Choice of NVMe Controllers ASIC NVMe: Fully off-loaded, consistent performance, M.2 or U.2 form factor ASIC OpenChannel:

More information

Oracle Database In-Memory

Oracle Database In-Memory Oracle Database In-Memory Powering the Real-Time Enterprise KEY FEATURES In-Memory Column Format accelerates Analytics by orders of magnitude Dual-format architecture combines the best of column and row

More information

Columnstore and B+ tree. Are Hybrid Physical. Designs Important?

Columnstore and B+ tree. Are Hybrid Physical. Designs Important? Columnstore and B+ tree Are Hybrid Physical Designs Important? 1 B+ tree 2 C O L B+ tree 3 B+ tree & Columnstore on same table = Hybrid design 4? C O L C O L B+ tree B+ tree ? C O L C O L B+ tree B+ tree

More information

Kaisen Lin and Michael Conley

Kaisen Lin and Michael Conley Kaisen Lin and Michael Conley Simultaneous Multithreading Instructions from multiple threads run simultaneously on superscalar processor More instruction fetching and register state Commercialized! DEC

More information

Oracle Database In-Memory with Oracle Database 12c Release 2

Oracle Database In-Memory with Oracle Database 12c Release 2 Oracle Database In-Memory with Oracle Database 12c Release 2 Technical Overview O R A C L E W H I T E P A P E R A U G U S T 2 0 1 7 Table of Contents Executive Overview 1 Intended Audience 1 Introduction

More information

HyPer-sonic Combined Transaction AND Query Processing

HyPer-sonic Combined Transaction AND Query Processing HyPer-sonic Combined Transaction AND Query Processing Thomas Neumann Technische Universität München December 2, 2011 Motivation There are different scenarios for database usage: OLTP: Online Transaction

More information

88X + PERFORMANCE GAINS USING IBM DB2 WITH BLU ACCELERATION ON INTEL TECHNOLOGY

88X + PERFORMANCE GAINS USING IBM DB2 WITH BLU ACCELERATION ON INTEL TECHNOLOGY 05.11.2013 Thomas Kalb 88X + PERFORMANCE GAINS USING IBM DB2 WITH BLU ACCELERATION ON INTEL TECHNOLOGY Copyright 2013 ITGAIN GmbH 1 About ITGAIN Founded as a DB2 Consulting Company into 2001 DB2 Monitor

More information

In-Memory Data Management

In-Memory Data Management In-Memory Data Management Martin Faust Research Assistant Research Group of Prof. Hasso Plattner Hasso Plattner Institute for Software Engineering University of Potsdam Agenda 2 1. Changed Hardware 2.

More information

TPC-E testing of Microsoft SQL Server 2016 on Dell EMC PowerEdge R830 Server and Dell EMC SC9000 Storage

TPC-E testing of Microsoft SQL Server 2016 on Dell EMC PowerEdge R830 Server and Dell EMC SC9000 Storage TPC-E testing of Microsoft SQL Server 2016 on Dell EMC PowerEdge R830 Server and Dell EMC SC9000 Storage Performance Study of Microsoft SQL Server 2016 Dell Engineering February 2017 Table of contents

More information

Leveraging Oracle Database In-Memory to Accelerate Business Analytic Applications

Leveraging Oracle Database In-Memory to Accelerate Business Analytic Applications Leveraging Oracle Database In-Memory to Accelerate Business Analytic Applications MAY 16 & 17, 2018 CLEVELAND PUBLIC AUDITORIUM, CLEVELAND, OHIO WWW.NEOOUG.ORG/GLOC Kai Yu Technical Staff, Dell EMC Database

More information

Heckaton. SQL Server's Memory Optimized OLTP Engine

Heckaton. SQL Server's Memory Optimized OLTP Engine Heckaton SQL Server's Memory Optimized OLTP Engine Agenda Introduction to Hekaton Design Consideration High Level Architecture Storage and Indexing Query Processing Transaction Management Transaction Durability

More information

Oracle Database Exadata Cloud Service Exadata Performance, Cloud Simplicity DATABASE CLOUD SERVICE

Oracle Database Exadata Cloud Service Exadata Performance, Cloud Simplicity DATABASE CLOUD SERVICE Oracle Database Exadata Exadata Performance, Cloud Simplicity DATABASE CLOUD SERVICE Oracle Database Exadata combines the best database with the best cloud platform. Exadata is the culmination of more

More information

Hewlett Packard Enterprise HPE GEN10 PERSISTENT MEMORY PERFORMANCE THROUGH PERSISTENCE

Hewlett Packard Enterprise HPE GEN10 PERSISTENT MEMORY PERFORMANCE THROUGH PERSISTENCE Hewlett Packard Enterprise HPE GEN10 PERSISTENT MEMORY PERFORMANCE THROUGH PERSISTENCE Digital transformation is taking place in businesses of all sizes Big Data and Analytics Mobility Internet of Things

More information

Quantifying Load Imbalance on Virtualized Enterprise Servers

Quantifying Load Imbalance on Virtualized Enterprise Servers Quantifying Load Imbalance on Virtualized Enterprise Servers Emmanuel Arzuaga and David Kaeli Department of Electrical and Computer Engineering Northeastern University Boston MA 1 Traditional Data Centers

More information

The Role of Database Aware Flash Technologies in Accelerating Mission- Critical Databases

The Role of Database Aware Flash Technologies in Accelerating Mission- Critical Databases The Role of Database Aware Flash Technologies in Accelerating Mission- Critical Databases Gurmeet Goindi Principal Product Manager Oracle Flash Memory Summit 2013 Santa Clara, CA 1 Agenda Relational Database

More information

Oracle Database 10g The Self-Managing Database

Oracle Database 10g The Self-Managing Database Oracle Database 10g The Self-Managing Database Benoit Dageville Oracle Corporation benoit.dageville@oracle.com Page 1 1 Agenda Oracle10g: Oracle s first generation of self-managing database Oracle s Approach

More information

Copyright 2017, Oracle and/or its affiliates. All rights reserved.

Copyright 2017, Oracle and/or its affiliates. All rights reserved. Using Oracle Columnar Technologies Across the Information Lifecycle Roger MacNicol Software Architect Data Storage Technology Safe Harbor Statement The following is intended to outline our general product

More information

Trouble-free Upgrade to Oracle Database 12c with Real Application Testing

Trouble-free Upgrade to Oracle Database 12c with Real Application Testing Trouble-free Upgrade to Oracle Database 12c with Real Application Testing Kurt Engeleiter Principal Product Manager Safe Harbor Statement The following is intended to outline our general product direction.

More information

An Oracle White Paper June Exadata Hybrid Columnar Compression (EHCC)

An Oracle White Paper June Exadata Hybrid Columnar Compression (EHCC) An Oracle White Paper June 2011 (EHCC) Introduction... 3 : Technology Overview... 4 Warehouse Compression... 6 Archive Compression... 7 Conclusion... 9 Introduction enables the highest levels of data compression

More information

Performance Innovations with Oracle Database In-Memory

Performance Innovations with Oracle Database In-Memory Performance Innovations with Oracle Database In-Memory Eric Cohen Solution Architect Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information

More information

M7: Next Generation SPARC. Hotchips 26 August 12, Stephen Phillips Senior Director, SPARC Architecture Oracle

M7: Next Generation SPARC. Hotchips 26 August 12, Stephen Phillips Senior Director, SPARC Architecture Oracle M7: Next Generation SPARC Hotchips 26 August 12, 2014 Stephen Phillips Senior Director, SPARC Architecture Oracle Safe Harbor Statement The following is intended to outline our general product direction.

More information

Implementing SQL Server 2016 with Microsoft Storage Spaces Direct on Dell EMC PowerEdge R730xd

Implementing SQL Server 2016 with Microsoft Storage Spaces Direct on Dell EMC PowerEdge R730xd Implementing SQL Server 2016 with Microsoft Storage Spaces Direct on Dell EMC PowerEdge R730xd Performance Study Dell EMC Engineering October 2017 A Dell EMC Performance Study Revisions Date October 2017

More information

Evolving To The Big Data Warehouse

Evolving To The Big Data Warehouse Evolving To The Big Data Warehouse Kevin Lancaster 1 Copyright Director, 2012, Oracle and/or its Engineered affiliates. All rights Insert Systems, Information Protection Policy Oracle Classification from

More information

What is QES 2.1? Agenda. Supported Model. Live demo

What is QES 2.1? Agenda. Supported Model. Live demo What is QES 2.1? Agenda Supported Model Live demo QES-Based Unified Storage Windows Server Block File iscsi CIFS NFS QES 2.1 One Architecture & Three Configurations SSD SSD Spinning Disk Hybrid All Flash

More information

Oracle Rdb on OpenVMS Galaxy

Oracle Rdb on OpenVMS Galaxy http://www.oracle.com/rdb Oracle Rdb on OpenVMS Galaxy Norman Lastovica Oracle Rdb Engineering norman.lastovica@oracle.com www.oracle.com/rdb April 2, 2002 2 Agenda Existing performance implications Database

More information

Leveraging Oracle Database In- Memory to accelerate Oracle Business Intelligence Analytics Applications

Leveraging Oracle Database In- Memory to accelerate Oracle Business Intelligence Analytics Applications Leveraging Oracle Database In- Memory to accelerate Oracle Business Intelligence Analytics Applications Kai Yu Oracle Solutions Engineering Dell EMC Linkedin: https://www.linkedin.com/in/kaiyu1/ Twitter

More information

Oracle Tuning. Ashok Kapur Hawkeye Technology, Inc.

Oracle Tuning. Ashok Kapur Hawkeye Technology, Inc. Oracle Tuning Ashok Kapur Hawkeye Technology, Inc. Agenda Oracle Database Structure Oracle Database Access Tuning Considerations Oracle Database Tuning Oracle Tuning Tools 06/14/2002 Hawkeye Technology,

More information

Exadata Implementation Strategy

Exadata Implementation Strategy Exadata Implementation Strategy BY UMAIR MANSOOB 1 Who Am I Work as Senior Principle Engineer for an Oracle Partner Oracle Certified Administrator from Oracle 7 12c Exadata Certified Implementation Specialist

More information

Intel and SAP Realising the Value of your Data

Intel and SAP Realising the Value of your Data Intel and SAP Realising the Value of your Data Scott Pendrey Intel EMEA, Server Product Manager In the Future Systems will be workload optimized Infrastructure will be software defined Analytics will be

More information

Oracle Database 11g: SQL Tuning Workshop

Oracle Database 11g: SQL Tuning Workshop Oracle University Contact Us: Local: 0845 777 7 711 Intl: +44 845 777 7 711 Oracle Database 11g: SQL Tuning Workshop Duration: 3 Days What you will learn This Oracle Database 11g: SQL Tuning Workshop Release

More information

Column-Stores vs. Row-Stores: How Different Are They Really?

Column-Stores vs. Row-Stores: How Different Are They Really? Column-Stores vs. Row-Stores: How Different Are They Really? Daniel J. Abadi, Samuel Madden and Nabil Hachem SIGMOD 2008 Presented by: Souvik Pal Subhro Bhattacharyya Department of Computer Science Indian

More information

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material,

More information

7. Query Processing and Optimization

7. Query Processing and Optimization 7. Query Processing and Optimization Processing a Query 103 Indexing for Performance Simple (individual) index B + -tree index Matching index scan vs nonmatching index scan Unique index one entry and one

More information

Sort vs. Hash Join Revisited for Near-Memory Execution. Nooshin Mirzadeh, Onur Kocberber, Babak Falsafi, Boris Grot

Sort vs. Hash Join Revisited for Near-Memory Execution. Nooshin Mirzadeh, Onur Kocberber, Babak Falsafi, Boris Grot Sort vs. Hash Join Revisited for Near-Memory Execution Nooshin Mirzadeh, Onur Kocberber, Babak Falsafi, Boris Grot 1 Near-Memory Processing (NMP) Emerging technology Stacked memory: A logic die w/ a stack

More information

Concurrent execution of an analytical workload on a POWER8 server with K40 GPUs A Technology Demonstration

Concurrent execution of an analytical workload on a POWER8 server with K40 GPUs A Technology Demonstration Concurrent execution of an analytical workload on a POWER8 server with K40 GPUs A Technology Demonstration Sina Meraji sinamera@ca.ibm.com Berni Schiefer schiefer@ca.ibm.com Tuesday March 17th at 12:00

More information

Key to A Successful Exadata POC

Key to A Successful Exadata POC BY UMAIR MANSOOB Who Am I Oracle Certified Administrator from Oracle 7 12c Exadata Certified Implementation Specialist since 2011 Oracle Database Performance Tuning Certified Expert Oracle Business Intelligence

More information

Hadoop 2.x Core: YARN, Tez, and Spark. Hortonworks Inc All Rights Reserved

Hadoop 2.x Core: YARN, Tez, and Spark. Hortonworks Inc All Rights Reserved Hadoop 2.x Core: YARN, Tez, and Spark YARN Hadoop Machine Types top-of-rack switches core switch client machines have client-side software used to access a cluster to process data master nodes run Hadoop

More information

Oracle Performance on M5000 with F20 Flash Cache. Benchmark Report September 2011

Oracle Performance on M5000 with F20 Flash Cache. Benchmark Report September 2011 Oracle Performance on M5000 with F20 Flash Cache Benchmark Report September 2011 Contents 1 About Benchware 2 Flash Cache Technology 3 Storage Performance Tests 4 Conclusion copyright 2011 by benchware.ch

More information

An Oracle White Paper. Released April 2013

An Oracle White Paper. Released April 2013 Performance and Scalability Benchmark: Siebel CRM Release 8.1.1.4 Industry Applications and Oracle 11.2.0.3 Database on Oracle's SPARC T5 Servers and Oracle Solaris An Oracle White Paper Released April

More information

ISA-L Performance Report Release Test Date: Sept 29 th 2017

ISA-L Performance Report Release Test Date: Sept 29 th 2017 Test Date: Sept 29 th 2017 Revision History Date Revision Comment Sept 29 th, 2017 1.0 Initial document for release 2 Contents Audience and Purpose... 4 Test setup:... 4 Intel Xeon Platinum 8180 Processor

More information

QLIKVIEW SCALABILITY BENCHMARK WHITE PAPER

QLIKVIEW SCALABILITY BENCHMARK WHITE PAPER QLIKVIEW SCALABILITY BENCHMARK WHITE PAPER Hardware Sizing Using Amazon EC2 A QlikView Scalability Center Technical White Paper June 2013 qlikview.com Table of Contents Executive Summary 3 A Challenge

More information

Oracle Server Benchmark with In-Memory SQL Processing Exadata X2-2 half-rack high-capacity

Oracle Server Benchmark with In-Memory SQL Processing Exadata X2-2 half-rack high-capacity Oracle Server Benchmark with In-Memory SQL Processing Exadata X2-2 half-rack high-capacity Benchware Performance Suite Release 8.4 (Build 130630) June 2013 Contents 1 Introduction to Tests 2 CPU and Server

More information

Lenovo Database Configuration for Microsoft SQL Server TB

Lenovo Database Configuration for Microsoft SQL Server TB Database Lenovo Database Configuration for Microsoft SQL Server 2016 22TB Data Warehouse Fast Track Solution Data Warehouse problem and a solution The rapid growth of technology means that the amount of

More information

DESIGNING FOR PERFORMANCE SERIES. Smokin Fast Queries Query Optimization

DESIGNING FOR PERFORMANCE SERIES. Smokin Fast Queries Query Optimization DESIGNING FOR PERFORMANCE SERIES Smokin Fast Queries Query Optimization Jennifer Smith, MCSE Agenda Statistics Execution plans Cached plans/recompilation Indexing Query writing tips New performance features

More information

Application-Tier In-Memory Analytics Best Practices and Use Cases

Application-Tier In-Memory Analytics Best Practices and Use Cases Application-Tier In-Memory Analytics Best Practices and Use Cases Susan Cheung Vice President Product Management Oracle, Server Technologies Oct 01, 2014 Guest Speaker: Kiran Tailor Senior Oracle DBA and

More information

Data Warehousing 11g Essentials

Data Warehousing 11g Essentials Oracle 1z0-515 Data Warehousing 11g Essentials Version: 6.0 QUESTION NO: 1 Indentify the true statement about REF partitions. A. REF partitions have no impact on partition-wise joins. B. Changes to partitioning

More information

COLUMN STORE DATABASE SYSTEMS. Prof. Dr. Uta Störl Big Data Technologies: Column Stores - SoSe

COLUMN STORE DATABASE SYSTEMS. Prof. Dr. Uta Störl Big Data Technologies: Column Stores - SoSe COLUMN STORE DATABASE SYSTEMS Prof. Dr. Uta Störl Big Data Technologies: Column Stores - SoSe 2016 1 Telco Data Warehousing Example (Real Life) Michael Stonebraker et al.: One Size Fits All? Part 2: Benchmarking

More information

Data Warehouse Tuning. Without SQL Modification

Data Warehouse Tuning. Without SQL Modification Data Warehouse Tuning Without SQL Modification Agenda About Me Tuning Objectives Data Access Profile Data Access Analysis Performance Baseline Potential Model Changes Model Change Testing Testing Results

More information

Accelerating Microsoft SQL Server Performance With NVDIMM-N on Dell EMC PowerEdge R740

Accelerating Microsoft SQL Server Performance With NVDIMM-N on Dell EMC PowerEdge R740 Accelerating Microsoft SQL Server Performance With NVDIMM-N on Dell EMC PowerEdge R740 A performance study with NVDIMM-N Dell EMC Engineering September 2017 A Dell EMC document category Revisions Date

More information