Oracle ZFS Storage Database Integration

Transcription

1

2 Oracle ZFS Storage Database Integration The only Oracle database aware NAS storage in the industry Ravi Renganathan ZFS Product Management March, 2017 Copyright 2017, Oracle and/or its affiliates. All rights reserved.

3 Speaker Bio Name : Ravi Renganathan Experience: 10+ years as DBA managing and tuning Databases in the field across many verticals. Currently focussed on best practices for deploying and administering Oracle databases on Oracle ZFS storage appliance. 3

4 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 4

5 What Keeps IT Administrators up at Night? 60% companies under-staffed for effective database storage management 60% indicate DB storage administration and maintenance increasing > 30% of time spent addressing storage related performance issues 49% say storage management tools DO NOT give enough visibility in DB effects on storage 5

6 IOUG Survey Results: Today s Environment More Data 31% of enterprises store >100TB of Oracle Database data More Uses 30% store 6 or more copies of each database More Demands Cost and Performance are the top two challenges Cloud Steps Up As A Data Storage Platform

7 Technology Advantage Database Co-Engineering Oracle Co-Engineering dnfs, IB Superior performance and efficiency HCC Superior database, data warehousing compression ADO Advanced and dynamic database (data) Optimization OISP Dynamic and automatic database-to- storage tuning OEM Centrally Monitor and Manage ZFS Storage Appliance through OEM SMU Faster & simpler way to copy, clone & manage DB using ZFS

8 Program Agenda 1 Direct NFS Data Protection Data Management Database Administration Problem Resolution 8

9 Direct NFS Optimized database client for NAS storage 9

10 Using Direct NFS for our Oracle Database 12c environment with Oracle ZFS Storage Appliance accelerated our database performance while simplifying storage management. - Duanne O Brien,CTO, Loyalty NZ

11 Standard NFS Architecture Database LGWR I/O queue Standard NFS client Linux NFS client RPC daemon NAS Storage DBWR I/O queue PQ slave I/O queue RMAN I/O queue Each Oracle process can issue 100s of concurrent I/Os Just 1 TCP connection per mount RPC I/O daemon limits number of concurrent I/Os 11

12 Direct NFS Architecture Database LGWR I/O queue Direct NFS client LGWR TCP connection NAS Storage DBWR I/O queue DBWR TCP connection PQ slave I/O queue RMAN I/O queue PQ slave TCP connection RMAN TCP connection Direct NFS can issue 1000s of concurrent operations due to the parallel architecture Every Oracle process has its own TCP connection 12

13 Direct NFS : Scalability and High Availability Direct NFS improves HA and optimizes server scalability Supports up to 4 parallel network paths to storage Displays linear scaling over both 1GbE and 10GbE paths Automatically load balances across all network paths No extra configuration necessary Failover messages in the event of a path failure Automatic load balancing across 7 3 all paths Path 3 goes down

14 How to enable and verify Direct NFS Commands to enable and disable dnfs library cd $ORACLE_HOME/rdbms/lib make -f ins_rdbms.mk dnfs_on make -f ins_rdbms.mk dnfs_off Following lines seen in alert log if dnfs library is linked Oracle instance running with ODM Oracle Direct NFS ODM Library Version 3.0 Verify Direct NFS is being used Check view v$dnfs_servers for entries pertaining to NFS server Check view v$dnfs_files for files opened by Direct NFS 14

15 Direct NFS Client in Oracle Database 12.2 Direct NFS Dispatcher architecture Direct NFS allows each Oracle process to connect directly to the NFS server This can cause problems in some scenarios Oracle Database 12.2 allows for one or more dispatchers and I/O slave processes Each Oracle foreground process will send I/O s to a dispatcher process Each dispatcher process will execute its I/O s in the order they are received 15

16 Direct NFS : Why is there a 3X increase in adoption????? Easy to deploy and administer Eliminate operating system write-ordering locks Reduce system CPU by bypassing file system stack Massively parallel I/O architecture Superior RMAN backup and restore performance Direct NFS provides significant cost savings Simple Ethernet for Storage Connectivity Eliminates expensive components in storage stack 16

17 Data Protection 17

18 ZFS: High Value Backup, Restore and Beyond Optimized for Oracle and Non-Oracle Workloads Oracle Engineered Systems Non-Oracle Backups Oracle Databases Fast Backup and Restore for Mixed Workloads High-throughput inmemory architecture Database: Maintains RMAN, Compression & Encryption best practices. Optimizes storage configuration on-the-fly. Detailed 12c backup insights Non-Database backups: including Symantec, CommVault, Avamar ZFS for Backup Extends ROI Beyond Backup Virtually unlimited snaps/clones for test, dev, QA analytics, reporting Maintains HCC compression even for extensions Ideal for heavily virtualized environments 18

19 Oracle RMAN Integration Database Integrated Backup and Recovery Highly parallel application that resides within the Oracle Database Optimized backup and recovery operations Database backup mode not necessary Oracle block validation Oracle ZFS Backup Appliance is designed to integrate with RMAN by utilizing thousands of concurrent threads Distributed I/O across many channels Spread across multiple storage controllers

20 Competitive Advantage: Hybrid Storage Pool RMAN issues predominately asynchronous writes Aggressive pre-fetch helps optimize read path Incoming Writes All writes whether synchronous or asynchronous are first written to the ARC Synchronous Writes Synchronous writes are committed to the ZIL before an acknowledgement is returned to the client TXG Transaction groups transfer data from the ARC to HDD (Oracle Cloud Backup Service)

21 Competitive Advantage: InfiniBand InfiniBand fabric provides an extremely high performance network for transferring backup data CPU Peak throughput per controller with low CPU overhead Low-latency, high-bandwidth, low CPU utilization Seamless integration with Exadata Use an active/active IPMP configuration Backup 60 TB/hr ; Restore 62 TB/hr Active/Active Active/active IPMP group provides performance and redundancy

22 Direct NFS over RDMA High throughput, low latency, reduced CPU utilization Very fast and efficient RMAN backup to and restore from ZFS SA Remote Direct Memory Access (RDMA) over Infiniband network Optimal path auto-chosen (TCP/IP or RDMA) Efficient bulk data transport between Exadata and ZFS SA HCA HCA Available in Exadata image [July 2016 DBPP] / DB version _ IPoIB TCP/IP HCA DNFS Buffer Kernel HCA RDMA ZFS Storage 22

23 Direct NFS over RDMA: Performance DB Server Environment Exadata X5-2 ¼ rack DB size : 4.7TB # of RMAN channels: 16 Storage Environment ZFS Storage 7420 / 8 Tray Mirrored Pool of 90 disks (4 spares); Share configured with LZJB 2000 compression 1000 log bias of Throughput 1MB stripe size In Seconds Total CPU Time (usr+sys) in Seconds DB Server (Compute) CPU Storage Cell CPU DNFS DNFS/RDMA In Seconds Elapsed Backup Time DNFS DNFS/RDMA 20 % - 40% Performance improvement observed 23

24 Direct NFS over RDMA: Value Proposition Improves Return on Investment on ZFS Storage Superior Performance High Throughput Low Latency Reduced CPU Performance For more information on DNFS/RDMA Configuring Exadata for Direct NFS with RDMA Document MOS FAQ: Exadata RMAN Backup with The Oracle ZFS Storage Appliance MOS Whitepaper: Protecting Exadata with the Oracle ZFS Storage Appliance 24

25 Data Management 25

26 Oracle 12c Compression Techniques Advanced Compressio on Option Oracle Storage COMPRESSION TYPE: Basic Table Compression Advanced Row Compression Advanced LOB Compression and Deduplication Advanced Index Compression Advanced Network Compression and Data Guard Redo Transport Compression RMAN/Data Pump Backup Compression Index Key Compression Hybrid Columnar Compression Warehouse Level Hybrid Columnar Compression Archive Level SUITABLE FOR: Mostly read tables and partitions in Data Warehouse environments or inactive data partitions in OLTP environments Active tables and partitions in OLTP and Data Warehouse environments Non-relational data in OLTP and Data Warehouse environments Suitable for all supported indexes, not key dependent. All environments All environments Indexes on tables for OLTP and Data Warehouse Mostly read tables and partitions in Data Warehouse environments columnar queries for analytics Inactive data partitions in OLTP and Data Warehousing environments maximum compression 26

27 Oracle Database 12c Information Lifecycle Management Partition databases to help facilitate lifecycle management Automatic Data Optimization automates data placement and compression levels based on policies Heat Map keeps track of data access over time Hybrid Columnar Compression massively compresses colder data 27

28 Integration Hybrid Columnar Compression Store Less Data AND Run Faster Oracle Database Hybrid Columnar Compression Up to 50x space reduction Average 5x faster queries Only available on Oracle storage Retail Data Warehouse Example Uncompressed 735GB 94% Less Storage Hybrid Columnar Compression 38GB ZFS supports block (ASM) and File (dnfs) attach for HCC Increases performance for most data warehouse and data protection x Faster Query 2 Hours, 22 Min, 44 Sec 16 Min, 50 Sec

29 Integration Optimize 12c Database Performance Automatic Data Optimization: Heat Maps & Usage Patterns

30 Automatic Data Optimization Add compression and tiering policies to tables P ol ic y 1 P ol ic y 2 Compress Partitions with columnar compression if they haven t been modified in 180 days Oldest Data Compress Partitions with row compression if they haven t been modified in 30 days Most Recent Data 30

31 Automatic Data Optimization Policies are automatically applied to tables P ol ic y 1 P ol ic y 2 Oldest Data Most Recent Data 31

32 Automatic Data Optimization Automatically tier data to lower cost storage 1 P olicy 2 P olicy 3 P olicy Oldest Data If the tablespace is nearly full compress the oldest partition with archive compression and move it from Exadata to ZFS Storage Most Recent Data 32

33 Database Administration 33

34 Oracle Intelligent Storage Protocol Oracle Database 12c IO cues exchanged with ZFS Storage Appliance ZFS Storage Appliance Dynamically Tunes Critical Storage Parameters Database and Storage Co-engineering Intelligence is in the code within both the database and storage Available ONLY with Oracle Database 12c and Oracle ZFS Storage Appliance OS 8 and above Storage Awareness of Database Workload Database sends cues about each IO to the storage Over 70 database IO types are recognized Cues grouped into 5 distinct categories by storage Information used by storage to adaptively and automatically adjust for optimal efficiency

35 Without Oracle Intelligent Storage Protocol Standard NFS server I/O I/O I/O I/O I/O I/O All I/Os look the same {size, read vs. write, filehandle} I/O 35

36 With Oracle Intelligent Storage Protocol Builds an Intelligent Storage Array fine tuned for database performance RMAN full backup RMAN apply RAC voting disk I/O Buffer Cache read for OLTP transaction, PDB #2 Each I/O is tagged with: -- Who issued it -- What it s for -- Its priority -- Other interesting metadata Buffer Cache read for OLTP transaction, PDB #3 Temp write from DB #1 Table scan read from DB#2 LGWR redo write Archive log write DBWR write - no threat of free buffer wait DBWR write to resolve free buffer wait 36

37 OISP Technology: DB + ZFS Co-engineering - Reduces time to provision 12c databases by 50% - Improves Database Performance upto 3X - Improves Troubleshooting effectiveness by 75% OISP dnfs TCP IP Network IP TCP dnfs OISP Oracle Database OISP Extensions built on top of NFSv4 protocol Each I/O is tagged with data context I/O reason I/O priority File type (redo log, data file, control file, backup file) Database block size for file Database and/or pluggable database id Cache hints Prefetch hints ZFS Storage Appliance Dynamic Actions Dynamically set Record Size, log bias Pluggable Database Analytics Database OEM provisioning Database Snap Management Analytics AWR Feed I/O FSS & DB Priority I/O Caching/Prefetch 37

38 OISP 1.0 Auto tuning simplifies Database Administration Reduces manual tuning efforts by 3X Without Oracle Intelligent Storage Protocol With Oracle Intelligent Storage Protocol OISP Tunes Logfile share NFS Server Multiple shares, each with its own Record Size and LogBias setting mnt/dbname/redo (Admin sets RS, LB) mnt/dbname/control (Admin sets RS, LB) mnt/dbname/archivelog (Admin sets RS, LB) mnt/dbname/datafile (Admin sets RS, LB) mnt/dbname/tempfile (Admin sets RS, LB) mnt/dbname/chgtrack (Admin sets RS, LB) mnt/dbname/undo (Admin sets RS, LB) NFS Server Datafile share Two shares: logfile and datafile mnt/dbname/logfile (RS, LB automatic) redo control chgtrack archivelog mnt/dbname/datafile (RS, LB automatic) datafile tempfile undo

39 OISP 2.0 Efficient Cache Management Simultaneous RMAN + OLTP workloads Negative cache hints for RMAN and Archivelog I/O ARC growth rate steady for OLTP Minimal ARC growth for RMAN, Archivelog I/O Minimal ARC evictions! Bounded latency for high priority I/O OLTP START Without OISP With OISP RMAN START OLTP START RMAN START ARC Evictions 39

40 OISP 2.0 Consistent Database performance OISP 2.0 Extensions Before OISP 2.0 Extensions Bounded latency for higher priority DB I/O RPC Fair Share Scheduler with DB I/O Prioritization Separate thread pools for READs, WRITEs and OISP high priority I/O 86% reduction in LGWR latency 33% faster Data File Backup 40 40

41 Problem Resolution 42

42 Problems with Non-Oracle Storage and Containerization Non-Oracle Storage has no container-awareness All containers look like one database instance Results in guesswork and constantly tuning storage Reactive to complaints, issues, slow downs, troubleshooting Manually labor-intensive tasks 43

43 OISP 1.1: Database Analytics Database 12C Multitenant Oracle Database Analytics PDB Data OISP Easiest and Most Efficient Software Real-time PDB and system-wide analytics PDBs Root CDB Automatically sets and tunes Database I/O latency and record-size Eliminates over 70% of time spent trouble-shooting 44

44 OISP 2.0: Database Analytics Extension Problem: Matching the DB I/O to what the DB Administrator knows Database I/O Statistics by File Type Data File Temp File Archive Log Data Pump/Dump Log Files Backups Control File Flashback Log Database I/O Statistics by Function DBWR Direct Writes LGWR Archive RMAN Recovery Streams/AQ XDB 45

45 New OISP Analytics in OEM 3.0 plug-in Breakdowns by database filetype : Data, log, control, archive log Breakdowns by database function: DWBR, LGWR, ARCH 46

46 OISP Use cases Provision Oracle 12c databases on Oracle ZFS storage appliance with couple shares whose properties are managed automatically Troubleshoot more effectively with Advanced analytics that gives DBAs and Storage Administrators granular level of detail on the IO. Deployments Analytics Oracle Intelligent Storage Protocol Workloads Backups Run OLTP and DW workloads as Fair share scheduling algorithm will manage thread priorities effectively Run RMAN backups at the same time as critical workloads. Negative caching hints passed to ZFS Storage Appliance will evict RMAN workload from ARC and avoid any impact to critical workloads. 47

47 Conclusion Take the stress out of database tuning, management and performance with 12c storage optimizations Look into technologies co- engineered with the Database & Cloud like Exadata and ZFS Storage Appliance

48 51

49