NAS and Data Protection

Transcription

1 NAS and Data Protection Oracle ZFS Storage OS8.7 Nidhi Kannoujia Principal Product Manager Carlos Ortiz - Sr. Principal Product Strategy Mgr May 25, 2017 Copyright 2017 Oracle and/or its affiliates. All rights reserved.

2 Agenda Review OS8.7 New Features Hear about tips and tricks when upgrading Learn about software and hardware compatibility Copyright 2017 Oracle and/or its affiliates. All rights reserved. 2

3 OS8.7 Features/Enhancements Copyright 2017, Oracle and/or its affiliates. All rights reserved. 3

4 OS8.7 Revolutionary Cloud Scale Software Oracle s OS8.7 Introduces 4 Breakthrough Cloud-driven Innovations for On-Premises and Cloud ZFS New zfscloud technology enables transparently moving data between the datacenter and the cloud without a gateway New data reduction technology reduces cloud storage footprint up to 9x and bandwidth demands by up to 4x New flash technology integrated with a full range of data services and realtime analytics. New OISP technology dynamically optimizes cache use for optimal database efficiency and QoS AVAILABLE 2 nd Half 2017

5 OS 8.7 New Features New Features Oracle Intelligent Storage Protocol v2.0 Deduplication 2.0 LZ4 Compression algorithm SMB 3.0 support LUN I/O throttle Object API Oracle ZFS Cloud Benefit Improves management efficiency with deep Oracle Database integration with I/O prioritization, dynamic tuning, more granular feed data for better analytics reports, etc. Increases performance and efficiency. Integration and support for Oracle Recovery Manager (Oracle RMAN), NetBackup, and Veeam software; requires use of DDT-SSD More efficient compression ratios at lower CPU utilization Supports Hyper-V and other applications that require the SMB 3.0 protocol, which improves security and performance Keeps key applications at high performance by limiting LUN throughput to lower priority applications Enables Oracle ZFS Storage Appliance to provide cloud object storage with Swift API Supports cloud storage as local pool (to be delivered post RR) Copyright 2016 Oracle and/or its affiliates. All rights reserved. 5

6 OISP 2.0 Database I/O Prioritization On Non-Oracle Storage: All database I/Os look the same On Oracle ZFS Storage Appliance: Each database I/O is tagged and can be prioritized I/O I/O I/O I/O I/O I/O I/O RMAN full backup RMAN apply RAC voting disk I/O Buffer Cache read for OLTP transaction, PDB #2 Buffer Cache read for OLTP transaction, PDB #3 Temp write from DB #1 Table scan read from DB#2 LGWR redo write Archive log write DBWR write to resolve free buffer wait DBWR write no threat of free buffer wait Resulting in Lower Latency for Critical IOs 86% Lower LGWR Latency Copyright 2016 Oracle and/or its affiliates. All rights reserved. 6

7 OISP 2.0 Faster Performance with Database IO Prioritization 13.5x Faster 27.95ms 3.9x Faster 28.95ms 19% Faster 197,274 TPM 235,549 TPM 2.07ms Control File Latency Log File Latency 7.29ms OLTP Transactions Per Minute Copyright 2016 Oracle and/or its affiliates. All rights reserved. 7

8 OISP 2.0 Database Analytics Extension Problem: Matching the DB I/O to what the DB Administrator knows Database I/O Statistics by File Type Data File Temp File Archive Log Data Pump/Dump Log Files Backups Control File Flashback Log Database I/O Statistics by Function DBWR Direct Writes LGWR Archive RMAN Recovery Streams/AQ XDB Copyright 2016 Oracle and/or its affiliates. All rights reserved. 8

9 OISP 2.0 Efficient Cache Management Simultaneous Oracle RMAN + OLTP workloads Before Extensions With Extensions RPC fair share scheduler with DB I/O prioritization Negative cache hints for lower priority like Oracle RMAN and archivelog I/O OLTP START Oracle RMAN START OLTP START Oracle RMAN START ARC Evictions Copyright 2017 Oracle and/or its affiliates. All rights reserved. 9

10 OS 8.7 ZFS Deduplication Details Hybrid storage pool model reduces data ingest penalty Dedup performance scales with meta devices (DDT SSDs) Dedup per share or project provides flexibility Dedup and LZ4 compression recommended for backup use cases (enabled with block size 128KB to 1MB) NEW: LZ4 provides good compression ratios with reduced CPU overhead WRITE I/O Cache SSD Memory/RAM Dedup Table DDT SSD Log SSD Copyright 2017, Oracle and/or its affiliates. All rights reserved. 10

11 OS 8.7 ZFS Deduplication Requirements Dedup is supported on ZS5-2 and ZS5-4 No software license Requires use of DDT-SSDs, supported only in DE3 3.2 TB SSDs are required - Order 2 DDT SSDs per 4 enclosures for new systems (and per pool) If using old dedup and want to upgrade to OS8.7: If system is ZS4-4, ZS5-2 or ZS5-4, recommended to get SSDs If system is ZS3 or older, software will convert to new table (only for existing systems with deduplication enabled) Copyright 2017, Oracle and/or its affiliates. All rights reserved. 11

12 Data Reduction Ratio OS 8.7 6x Improvement in Data Reduction Deduplication Plus Compression Compression average 0 Perform Snapshot Increase VMDK Size Change a File VM+34 Dataset Add 1GB File Actions Taken Prior to Full Backup Measured results in Veaam backup environment Copyright 2017 Oracle and/or its affiliates. All rights reserved. 12

13 ZFS Cloud Object API Object API NFS / SMB FC / iscsi FTP / WebDav Etc. Object API s directly provided by ZFSSA appliance (Swift and later S3) Provides plug-n-play object storage solution Utilizes ZFS filesystem as the object store solution Supports all ZFS data services Provides unified solution i.e. Store objects but still accessible as read-only over NFS, SMB, etc. Integration with Keystone and LDAP Copyright 2016 Oracle and/or its affiliates. All rights reserved.

14 ZFS Cloud Hybrid Cloud Pool (HCP) Technology as a Bridge Advanced NAS and Data Protection storage systems will expand into Public Clouds natively to provide virtually unlimited Data Protection scalability Object API Hybrid Storage Pool Application Hybrid Cloud Pool (HCP) SMB/NFS HCP HSPs serve 85-90% of I/O from L1 cache/arc HCP FC/iSCSI 0.01ms latency ARC/DRAM ARC/DRAM FTP/Web Dav 0.10ms latency L2ARC SSD WriteZIL SSD WriteZIL SSD L2ARC SSD System Storage Pool HDD blocks 512/4K Record Size Cloud Storage Pool Objects 4K-1M Record Size Copyright 2016 Oracle and/or its affiliates. All rights reserved.

15 ZFS Cloud Use Cases Basic Cloud Gateway: Moves data from on-prem to OPC/object storage. ARC/DRAM L2ARC SSD WriteZIL SSD HCP Data Protection using Replication: Create a DR copy in the cloud. ARC/DRAM WriteZIL SSD L2ARC SSD HCP Data Protection/Backup: Local/Remote Targets for NBU, Commvault, and Veeam. ARC/DRAM WriteZIL SSD ARC/DRAM L2ARC SSD WriteZIL SSD L2ARC SSD HCP Copyright 2016 Oracle and/or its affiliates. All rights reserved.

16 OS 8.7 New Enhancements New Enhancements Benefit NFS v4.1 support Improves protocol reliability and availability for applications that require v4.1 Analytics enhancements Certificate management Replication Enhancements Scripting enhancements Deletion performance Kerberos service enhancement Provides enhancements for Oracle Intelligent Storage Protocol, storage usage trends, deduplication SSD, etc. Simplifies management and improve security with support for trusted certificates [See Replication enhancement matrix] Simplifies scripting through list enhancements for programmatic APIs Improves dataset deletion performance Simplifies management and support for HTTP/HTTPS and FTP/SFTP Copyright 2016 Oracle and/or its affiliates. All rights reserved. 16

17 OS 8.7 Replication Replication Enhancements Raw send Deduplicated replication Auto-snapshot management Replica lag alert Single-stream performance Capacity increase Resumable replication Schedule Extended replication reverse Multitenant scripting Benefit Improves performance and bandwidth by sending compressed data without rehydration Improves performance by sending only unique data blocks and only metadata for duplicate data blocks Enables efficient storage utilization and allows customers to keep data at the remote site for backup while deleting it at the source to free space for newer data Simplifies management by setting an alert if the data at the target gets behind the source data by a specified amount of time Improves performance up to 68 percent for single-replication streams Supports up to 120 replication streams in parallel for increased scalability Enhances data protection; resumes replication where it left off after a failure Provides higher granularity with support for five-minute intervals Simplifies administration when performing reverse replication process Eases management with simpler scripting to automate DR process Copyright 2016 Oracle and/or its affiliates. All rights reserved. 17

18 OS 8.7 Replication: Raw Send Replicate in-disk compressed data to the remote site Copyright 2016 Oracle and/or its affiliates. All rights reserved. 18

19 OS 8.7 Replication: Raw Send Performance Makes the update process more efficient by including compression in the send stream as-is Improves network performance, reduces replication time, and saves appliance CPU time Results with 7320 connected through a 10 GB Network Switch over 10 GB Ethernet link; Datasets are generated by vdbench and are 3 time LZ-compressible; 10GB data sent per replication stream Copyright 2016 Oracle and/or its affiliates. All rights reserved. 19

20 OS 8.7 Replication: Deduplicated Replication Primary Business Values: Bandwidth cost savings Dramatically benefit RMAN Backup use case Increase DR protection by network-efficient replication Powerful tool when replicating VDI workloads Features: Create Hash Table before each replication to send only the deduplicated data to the target side After replication update completes, replication statistics show the original dataset size and the size of the deduplicated data sent Performance highly data dependent Copyright 2016 Oracle and/or its affiliates. All rights reserved.

21 9 Week OLTP Database Backup Offsite Replication Characterization w/50ms Latency (RT) 4 TB source database w/tpc-c workload (OLTP schema); 3% average daily change of each datafile WAN emulation with 50ms round-trip delay was used; Limits average project replication throughput to no more than 159MB/s Copyright 2017, Oracle and/or its affiliates. All rights reserved.

22 OS 8.7 Replication: Auto Snapshot Management Copyright 2015, Oracle and/or its affiliates. All rights reserved. 22

23 OS8.7 Replica Lag Alerts Use Case: Disaster Recovery Mission Critical Data Protection Issue: No direct way to know if meeting RPO Benefits: Simplify Storage Admin s tasks to meet RPO Real-time detection and reporting of an excessive replica lag Enhance visibility of configuration or communication issues Copyright 2015, Oracle and/or its affiliates. All rights reserved. 23

24 OS 8.7 Replication/Single Stream Performance 128 k block size OS 8.6 OS 8.7 Improvement 20 G single file 349 MB/sec 574 MB/sec +64% 20,000 1 M files 341 MB/sec 574 MB/sec +68% Crypto+20,000 files 338 MB/sec 434 MB/sec +28% Copyright 2017 Oracle and/or its affiliates. All rights reserved.

25 OS 8.7 New Platform-Components New Platform/Components Benefit All Flash -- SSD storage pool Provides high performance at low latency with support for SSD storage pools 40 GbE dual-port NIC Delivers higher performance with support for 40 Gb Ethernet Deduplication SSD Increases performance with the use of SSD to store the deduplication table SAS-2 SAS-3 intermix Supports intermixing of SAS-2 and SAS-2 components Copyright 2016 Oracle and/or its affiliates. All rights reserved. 25

26 All Flash Flexibility to Grow as Your Needs Evolve Grow All Flash Multiple All Flash Combine With Disk Extend to Cloud Flash Storage Pool Disk Storage Pool Flash Storage Pool ZFS Cloud Storage Pool Flash Storage Pool Flash Storage Pool Flash Storage Pool Flash Storage Pool Flash Storage Pool Flash Storage Pool Disk Storage Pool Disk Storage Pool All Flash Array Hybrid On-Premises Storage Hybrid Cloud Copyright 2017 Oracle and/or its affiliates. All rights reserved. 26

27 All Flash Configuration Details Flash Storage Pools SSD capacities: 800GB, 3.2TB From 8TB to 2.5PBs of Flash Storage Maximum 2U Disk Enclosures (DE): ZS5-4: 32 (4 per SAS chain) ZS5-2: 16 (4 per SAS chain) Disk Enclosure Configuration Config#1: 24x SSDs Config#2: 20x SSDs + 2x or 4x Logzillas No need for Readzilla or DDT-flash in SSD Pool Pool Configuration All-Flash (SSD pools only) cannot mix with HDD media SSD pool and HDD pool can mix in the same system Copyright 2016 Oracle and/or its affiliates. All rights reserved. 27

28 All Flash Performance Details Extreme Performance ZS5-2 > 1.5 TB DRAM, 128 TB Flash 8 K (60% R/40% W): 322 K IOPS 8 K (100% read): 1.43 M IOPS 1 MB sequential: 24 GB/sec ZS5-4 > 3 TB DRAM, 256 TB Flash 8 K (60% R/40% W): 483 K IOPS 8 K (100% read): 2.1 M IOPS 1 MB sequential: ~40 GB/sec Proven Service Uptime Best real-time analytics 20 second failover (1,600 LUNs) Rapid RAID rebuilds In-line dedupe and compression Fastest create/delete capability Dynamic database optimizations Most scalable snaps/clone capability Copyright 2017 Oracle and/or its affiliates. All rights reserved. 28

29 All Flash HDD vs SSD Comparison $/IOP Storage capacity 8K read/write 1 hr. (IOPs) 8K read/write 24hr (IOPs) 8K read (IOPs) 1MB sequential Failover Resilver time Admin operations LUN data delete Upgrade time Snapshot and clone Snapshot for DR Volume expansion HDD/SSD Difference 6.9x more efficient 3.58x less 23x faster ~20x faster 19.2x faster 14.1x faster 5.5x faster 38x faster 30x more efficient 25x more efficient 4x more efficient 2.1x faster 5.6x faster 6x faster I/O Efficiency Operation Efficiency Copyright 2017 Oracle and/or its affiliates. All rights reserved. 29

30 UPGRADING YOUR OS Copyright 2017, Oracle and/or its affiliates. All rights reserved. 30

31 OS 8.7 Software Update Oracle ZFS Storage Appliance: Software Updates (MOS Doc ID: ) Purpose Details - Downloading and Installing a Software Update - Minimum Fully Supported Software Version per Product - Storage Management Software - Independent Licenses - Product Documentation - Notification for Changes to This Document - Current Releases - Previous Releases References Copyright 2016 Oracle and/or its affiliates. All rights reserved. 31

32 OS 8.7 Minimum Software version Copyright 2016 Oracle and/or its affiliates. All rights reserved. 32

33 OS 8.7 Minimum to Upgrade to OS8.7 Copyright 2016 Oracle and/or its affiliates. All rights reserved. 33

34 OS 8.7 Software Update Copyright 2016 Oracle and/or its affiliates. All rights reserved. 34

35 OS 8.7 Mapping Version String to Release Name Copyright 2016 Oracle and/or its affiliates. All rights reserved. 35

36 OS 8.7 Preparing for SW Upgrade Oracle ZFS Storage Appliance Customer Service Manual (Page 421) 1. Verify your current software version. 2. Remove extraneous system updates. 3. Check the most recent release notes for additional preconditions that should be observed for the software release. If skipping some software releases, also review the release notes from all applicable previous releases. 4. Disable non-critical data services. These services may include replication, NDMP, shadow migration, or others. Disabling these services can shorten the upgrade time, and ensures that the system has a minimal operation load during the update. 5. Create a backup copy of the management configuration to minimize downtime in the event of an unforeseen failure. 6. Ensure that any resilvering and scrub operations have completed. The scrub property indicates whether scrub or resilver operations are active or completed. 7. Ensure that there are no active problems. For more information, see Active Problems Display on page Perform a health check. See Checking System Health BUI, CLI. A health check is automatically run as part of the update process, but should also be run independently to check storage health prior to entering a maintenance window. If a problem is encountered, it needs to be corrected before the upgrade can continue. Refer to the Customer Service manual for directions on addressing any issues. 9. Schedule a maintenance window of at least one hour to allow for disruptions in storage performance and availability during update. - Upgrading Software on a Standalone Controller on page Upgrading Software on Clustered Controllers on page 427 Always keep backup or DR-site/Replica of your data Copyright 2016 Oracle and/or its affiliates. All rights reserved. 36

37 OS 8.7 Deferred Updates Each update may come with new firmware or updates to external resources. In general, these updates are backward compatible and applied automatically without user intervention. There are exceptions, however, for non-reversible updates. These updates involve updating a resource external to the system software in a way that is incompatible with older software releases. Once the update is applied, rolling back to previous versions will result in undefined behavior. For these updates, you will always be given an explicit option of applying them automatically during upgrade or applying them after the fact. They are therefore referred to as "deferred updates". Copyright 2016 Oracle and/or its affiliates. All rights reserved. 37

38 COMPATIBILITY Copyright 2017, Oracle and/or its affiliates. All rights reserved. 38

39 Investment Protection MODEL RR DE2 DE3 EL2ARC MIX DE2/DE3 SAS3 I/O card Flash Pool DDT- SSD 40GbE NIC NIC/HBA Upgrade ZS5-2/ZS5-4 (SAS-2) Sept-2016 yes ZS5-2/ZS5-4 (SAS-3) Dec-2016 yes ZS /31/18 ZS /31/18 ZS No 7*20 series /31 No Racked System versions of ZS5 available now (Flash Pool, 1.2TB HDD coming June 2017) Copyright 2016 Oracle and/or its affiliates. All rights reserved.

40 Software Features MODEL RR ZFS Cloud Deduplicated Replication Encryption Flash Pool Dedup 2.0 (with DDT-SSD) ZS5-2/ZS5-4 (SAS-2) Sept-2016 ZS5-2/ZS5-4 (SAS-3) Dec-2016 ZS ZS ZS *20 series 2010 Copyright 2016 Oracle and/or its affiliates. All rights reserved.

41 Oracle Systems Manager for Oracle ZFS Storage N-way management for data center administrators New! Stand-alone, light weight application Cluster-aware Inventory management Replication monitoring Capacity monitoring and trending Health checks Supported OS: Oracle Linux 7.x, RHEL 7.x Storage OS pre-requisite: OS8.7 Copyright 2017, Oracle and/or its affiliates. All rights reserved. 41

42 OS 8.7 Resources Oracle ZFS Storage Appliance: Software Updates (MOS Doc ID: ) ZFS Storage End User Documentation Click on OS8.7 documentation, and refer to the Oracle ZFS Storage Appliance Customer Service Manual Sun ZFS Storage Appliances Troubleshooting Resource Center (Doc ID ) Oracle Technology Network: ZFS Storage Appliance page Download Systems Manager, Plug-ins, Simulator, etc. Download White Papers/How to Guides Join My Oracle Support Community for ZFS Storage space, to communicate with other users To learn more about upcoming Oracle ZFS Storage webcasts, events, workshops, hands on lab focus groups, Beta access and POCs, please join our Oracle ZFS Storage User Group! How to Become an OZUG member! Copyright 2016 Oracle and/or its affiliates. All rights reserved. 42

43 Copyright 2017 Oracle and/or its affiliates. All rights reserved.