Automating Information Lifecycle Management with

Similar documents
Copyright 2013, Oracle and/or its affiliates. All rights reserved.

10/29/2013. Program Agenda. The Database Trifecta: Simplified Management, Less Capacity, Better Performance

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Insider s Guide on Using ADO with Database In-Memory & Storage-Based Tiering. Andy Rivenes Gregg Christman Oracle Product Management 16 November 2016

Automatic Data Optimization with Oracle Database 12c O R A C L E W H I T E P A P E R S E P T E M B E R

Copyright 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12

Implementing Oracle database12c s Heat Map and Automatic Data Optimization to optimize the database storage cost and performance

Implementing Oracle database12c s Heat Map and Automatic Data Optimization to Optimize the Database Storage Cost and Performance

Implementing Storage Tiering in Data Warehouse with Oracle Automatic Data Optimization. Kai Yu Oracle Solutions Engineering Dell Inc

Recent Innovations in Data Storage Technologies Dr Roger MacNicol Software Architect

Copyright 2014, Oracle and/or its affiliates. All rights reserved.

Oracle Database 18c and Autonomous Database

Implementing Oracle database12c s Heat Map and Automatic Data Optimization to optimize the database storage cost and performance

1 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Oracle Database In-Memory What s New and What s Coming

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into

Oracle Database 12c R2: New Features for Administrators Part 2 Ed 1

Oracle Database 12c R2: New Features for Administrators Part 2 Ed 1 -

1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. reserved. Insert Information Protection Policy Classification from Slide 8

Oracle Exadata: Strategy and Roadmap

Performance Innovations with Oracle Database In-Memory

Copyright 2011, Oracle and/or its affiliates. All rights reserved.

Implementing Oracle Database 12c s Heat Map and Automatic Data Optimization to optimize the database storage cost and performance

Oracle Advanced Compression: Reduce Storage, Reduce Costs, Increase Performance Bill Hodak Principal Product Manager

Evolving To The Big Data Warehouse

Storage Optimization with Oracle Database 11g

Oracle Advanced Compression with Oracle Database 12c Release 2 O R A C L E W H I T E P A P E R M A R C H

An Oracle White Paper July Oracle Advanced Compression with Oracle Database 12c

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into

Oracle Enterprise Data Architecture

Information Lifecycle Management for Business Data. An Oracle White Paper September 2005

An Oracle White Paper June Oracle Advanced Compression with Oracle Database 12c

Oracle Database Exadata Cloud Service Exadata Performance, Cloud Simplicity DATABASE CLOUD SERVICE

Table Compression in Oracle9i Release2. An Oracle White Paper May 2002

Oracle Secure Backup 12.2 What s New. Copyright 2018, Oracle and/or its affiliates. All rights reserved.

EMC XTREMCACHE ACCELERATES ORACLE

Oracle Advanced Compression with Oracle Database 12c Release 2 O R A C L E W H I T E P A P E R S E P T E MB E R

Real Time Summarization. Copyright 2014, Oracle and/or its affiliates. All rights reserved.

Memory Without Bounds: Policy- Based Automation in In-Memory Column Store Content

Was ist dran an einer spezialisierten Data Warehousing platform?

Hybrid Columnar Compression (HCC) on Oracle Database 18c O R A C L E W H IT E P A P E R FE B R U A R Y

Data Warehousing 11g Essentials

Oracle Database 12c: New Features For Administrators

Copyright 2018, Oracle and/or its affiliates. All rights reserved.

An Oracle White Paper June Exadata Hybrid Columnar Compression (EHCC)

Oracle 11g Partitioning new features and ILM

Implementing Information Lifecycle Management (ILM) with Oracle Database 18c O R A C L E W H I T E P A P E R F E B R U A R Y

In-Memory Data Management Jens Krueger

Javaentwicklung in der Oracle Cloud

<Insert Picture Here> Introducing Exadata X3

ORACLE DATA SHEET ORACLE PARTITIONING

THE HYBRID CLOUD DATA STRATEGY

Oracle Exadata: The World s Fastest Database Machine

May 22, 2013 Ronald Reagan Building and International Trade Center Washington, DC USA

5/24/ MVP SQL Server: Architecture since 2010 MCT since 2001 Consultant and trainer since 1992

Exadata Implementation Strategy

DBAs can use Oracle Application Express? Why?

Oracle Database 12c: New Features for Administrators (40 hrs.) Prerequisites: Oracle Database 11g: Administration Workshop l

<Insert Picture Here> South Fla Oracle Users Group Oracle/Sun Exadata Database Machine June 3, 2010

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Exadata Implementation Strategy

Oracle CoreTech Update OASC Opening 17. November 2014

<Insert Picture Here> Controlling resources in an Exadata environment

OpenWorld 2018 SQL Tuning Tips for Cloud Administrators

An Oracle White Paper February Optimizing Storage for Oracle PeopleSoft Applications

Oracle Database In-Memory

Oracle Database 12c R2: New Features for 12c R1 Administrators Ed 1

Convergence and Collaboration: Transforming Business Process and Workflows

Oracle Multitenant What s new in Oracle Database 12c Release ?

Oracle Exadata X7. Uwe Kirchhoff Oracle ACS - Delivery Senior Principal Service Delivery Engineer

Provisioning with SUSE Enterprise Storage. Nyers Gábor Trainer &

Oracle Zero Data Loss Recovery Appliance (ZDLRA)

Achieving Memory Level Performance: Secrets Beyond Shared Flash

Agenda. AWS Database Services Traditional vs AWS Data services model Amazon RDS Redshift DynamoDB ElastiCache

FAST & Furious mit EMC² VNX

Oracle Database 12c: New Features for Administrators NEW

Oracle Database 12c: New Features for Administrators Ed 2 NEW

Private Cloud Database Consolidation Name, Title

Top Trends in DBMS & DW

Oracle 12C Administration Course Content:

Oracle #1 for Data Warehousing. Data Warehouses Growing Rapidly Tripling In Size Every Two Years

SQL Server SQL Server 2008 and 2008 R2. SQL Server SQL Server 2014 Currently supporting all versions July 9, 2019 July 9, 2024

Introduction to Database Services

Welcome to the presentation. Thank you for taking your time for being here.

Moving Databases to Oracle Cloud: Performance Best Practices

Oracle Enterprise Manager 12c Sybase ASE Database Plug-in

Backup Strategies with MySQL Enterprise Backup

Safe Harbor Statement

<Insert Picture Here> DBA Best Practices: A Primer on Managing Oracle Databases

SAP IQ - Business Intelligence and vertical data processing with 8 GB RAM or less

Oracle Database In-Memory

Oracle Autonomous Database

Object Storage Level 100

Data Protection Modernization: Meeting the Challenges of a Changing IT Landscape

REST APIs on z/os. How to use z/os Connect RESTful APIs with Modern Cloud Native Applications. Bill Keller

Oracle Enterprise Manager 12c IBM DB2 Database Plug-in

Copyright 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12

The Role of Database Aware Flash Technologies in Accelerating Mission- Critical Databases

Improving Your Business with Oracle Data Integration See How Oracle Enterprise Metadata Management Can Help You

<Insert Picture Here> DBA s New Best Friend: Advanced SQL Tuning Features of Oracle Database 11g

Transcription:

Automating Information Lifecycle Management with Oracle Database 2c

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 2 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Agenda Data Growth Heat Map Automatic Data Optimization Benefits of Heat Map and ADO 3 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Growth in Data Diversity and Usage,8 Exabytes of Data in 2, 2x Growth by 22 Today s Drivers Emerging Growth Factors Enterprise 45% per year growth in database data Cloud 8% of new applications and their data Regulation 3 exabytes in archives by 25 Mobile # Internet access device in 23 Big Data Large customers top 5PB Social Business $3B/year in commerce by 25 4 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Managing Storage Challenges Manage more data without incurring additional cost Compress data, without impacting performance Tier and compress data based on usage 5 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Data Compression Reduce storage footprint, read compressed data faster Hot Data 3X Advanced Row Compression Warm Data X Columnar Query Compression Archive Data 5X Columnar Archive Compression 7 Copyright 23, 22, Oracle and/or its affiliates. All rights reserved. Confidential Oracle Restricted

Oracle Advanced Compression Transparent, Smaller, Faster % Application Transparent End-to-end Cost/Performance Benefits across CPU, DRAM, Flash, Disk & Network Runs Faster: OLTP Apps (Transactional & Analytics) & DW Reduces Database Footprint CapEx & OpEx savings Increases Cloud ROI through Database Footprint reduction in DRAM Memory 8 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Understanding Data Usage Patterns Database heat map Copyright 23, Oracle and/or its affiliates. All rights reserved.

Understanding Data Usage Patterns Database heat map Copyright 23, Oracle and/or its affiliates. All rights reserved.

Heat Map What it tracks Active Frequent Access Occasional Access Dormant HOT Actively updated Infrequently updated, Frequently queried Infrequent access for query and updates Long term analytics & compliance COLD Heat Map tracking Database level Heat Map shows which tables and partitions are being used Block level Heat Map shows last modification at the block level Comprehensive Segment level shows both reads and writes Distinguishes index lookups from full table scans Automatically excludes stats gathering, DDLs, table redefinitions, etc High Performance Object level at no cost Block level < 5% cost 2 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Heat Map Enterprise Manager 3 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Automatic Data Optimization Usage Based Data Compression Hot Data Warm Data Archive Data 3X Advanced Row Compression X Columnar Query Compression 5X Columnar Archive Compression 4 Copyright 23, 22, Oracle and/or its affiliates. All rights reserved. Confidential Oracle Restricted

Simple Declarative SQL extension Automatic Data Optimization ALTER TABLE sales ILM add Active Frequent Access Occasional Access Dormant OLTP Compressed (2-4x) Affects ONLY Candidate Rows Cached in DRAM & FLASH Warehouse Compressed (x) High Performance Storage Warehouse Compressed (x) Low Cost Storage Archive Compressed (5-5X) Archival Storage row store compress advanced row after 2 days of no update compress for query low after week of no update tier to SATA Tablespace compress for archive high after 6 months no access 5 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Automatic Data Optimization Add compression and tiering policies to tables Policy Policy 2 Compress Partitions with columnar compression if they haven t been modified in 8 days Compress Partitions with row compression if they haven t been modified in 3 days Oldest Data Most Recent Data 6 Copyright 23, 22, Oracle and/or its affiliates. All rights reserved.

Automatic Data Optimization A heat map tracks the activity of segments and blocks Policy Policy 2 Oldest Data Most Recent Data 7 Copyright 23, 22, Oracle and/or its affiliates. All rights reserved.

Automatic Data Optimization Policies are automatically applied to tables Policy Policy 2 Oldest Data Most Recent Data 8 Copyright 23, 22, Oracle and/or its affiliates. All rights reserved.

Automatic Data Optimization Policies are automatically applied to tables Policy Policy 2 Oldest Data Most Recent Data 9 Copyright 23, 22, Oracle and/or its affiliates. All rights reserved.

Automatic Data Optimization Policies are automatically applied to tables Policy Policy 2 Oldest Data Most Recent Data 2 Copyright 23, 22, Oracle and/or its affiliates. All rights reserved.

Automatic Data Optimization Reduce storage footprint, read compressed data faster Policy Policy 2 Oldest Data Most Recent Data 2 Copyright 23, 22, Oracle and/or its affiliates. All rights reserved. Confidential Oracle Restricted

Automatic Data Optimization Automatically tier data to lower cost storage Policy Policy 2 Policy 2 Policy 3 Oldest Data If the tablespace is nearly full compress the oldest partition with archive compression and move it to Tier 2 Storage Most Recent Data 22 Copyright 23, 22, Oracle and/or its affiliates. All rights reserved.

Automatic Data Optimization OLTP Reporting Compliance & Reporting x compressed 5x compressed This Quarter This Year Prior Years Row Store for fast OLTP Compressed Column Store for fast analytics Archive Compressed Column Store for max compression As data cools down, Advanced Data Optimization automatically converts data to columnar compressed Online 23 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Powerful Policy Specification Automatic Data Optimization Declarative Policy Specification: Condition Action alter table sales ilm add policy row store compress advanced segment after 3 days of no modification; Conditions are time period after creation, access, modification of data Actions can be Compression Tiering or Tablespace Tiering Policies are inherited from the tablespace or table New tables inherit from tablespace; can also be applied to existing tables New partitions (including interval partitions) inherit from table 24 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Up to 5x Smaller Footprint & Faster Queries Automatic Data Optimization for OLTP Both Columnar & Archive Compression now complement Advanced Row Compression Best Practice: Step : Use Advanced Row Compression for entire DB and then Step 2: ADO automatically converts into columnar compressed once the updates cool down, and is used mainly for reporting => Query speed of Columnar & x smaller footprint Step 3: ADO automatically converts into archive compressed once data cools down further and is no longer frequently queried => 5-5x smaller footprint 25 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Optimizes Data Based on Heat Map Automatic Data Optimization for DW Data generally comes in via Bulk Loading Workload dominated by queries, even during loading Step : Bulk Load directly into Columnar Compressed x smaller footprint, Query speed of Columnar Step 2: ADO automatically converts to Archive Compressed and moves to Lower Cost Storage once its queried infrequently Data remains online, with 5-5x smaller footprint, & lower storage cost 26 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Fast, Flexible Loads & Queries on Columnar Automatic Data Optimization Mixed Use Fastest Load with uncompressed & Fastest Queries with columnar Mixed workloads often use Java app or 3rd party tools to insert and update data that does not use Bulk Loads, so cannot use Columnar Step : Load into uncompressed, conventional inserts & updates Fast loading, & flexibility of using a regular OLTP app for loading Step 2: ADO moves to Row Compressed or Columnar Compressed or Low Cost Storage once updates cool down Faster Queries, 3-x smaller footprint 27 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Scheduled Policy Execution Automatic Data Optimization Immediate and background policy execution Policies are executed in maintenance windows Can be manually executed as needed Policies can be extended to incorporate Business Rules Users can add custom conditions to control placement (e.g. 3 months after the ship date of an order) 28 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Optimized Backups Automated READONLY Data Movement SQL> ALTER TABLE EMPLOYEE ILM ADD POLICY TIER TO DATA2 READ ONLY AFTER 8 DAYS OF NO MODIFICATION 29 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Backup & Recovery Automatic Data Optimization OLTP Reporting Compliance & Reporting Read / Write Tablespace x compressed Read-mostly data is moved to a READONLY Tablespace 5x compressed READONLY TBS As data cools down, Automatic Data Optimization automatically moves it to a READONLY TBS, it s backed up only once after that 3 Copyright 23, Oracle and/or its affiliates. All rights reserved.

Summary Heat Map & Automatic Data Optimization Heat Map Automatically tracks access Database-aware: maintenance jobs, backups, etc. don t affect Heat Map Automatic Data Optimization Declarative easy-to-use syntax to define data compression & movement policies Extensible with business-specific logic Automates and simplifies ILM for Oracle Database data 3 Copyright 23, Oracle and/or its affiliates. All rights reserved.

32 Copyright 23, Oracle and/or its affiliates. All rights reserved.