NAS and Data Protection

Transcription

1 NAS and Data Protection ZFS Storage Appliance Racked System Update Michael Wojnar, Principal Product Manager ZFS Storage Group January 2017 Copyright Copyright 2017, Oracle 2017 Oracle and/or and/or its affiliates. its affiliates. All rights All rights reserved. reserved. 1

2 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 2

3 Oracle ZFS storage systems have earned a reputation for performance, efficiency, and application-engineered storage. 3

4 Built on a Decade of Storage Innovation Zettabyte File System Analytics Hybrid Storage Pools (HSPs) Unified Storage Flash Storage Analytic Bundles Inifiband Triple Mirroring Inline Deduplication Inline Compression Triple Parity RAID Antivirus Integration Database HCC Shadow Migration REST/Open Interfaces Database OISP Flexible Encryption Database SMU Database EM Provisioning Hybrid Cloud Pools (HCPs) External L2ARC 7*10 series 7*20 series ZS3 series ZS4 series ZS5 series 256GB DRAM 1TB Read Flash 280TB Capacity 2.5GB/s 1TB DRAM 4TB Read Flash 3PB Capacity 10GB/s 2TB DRAM 12TB Read Flash 4PB Capacity 17GB/s 3TB DRAM 230TB Read Flash 7PB Capacity 32GB/s 3TB DRAM 307TB Read Flash 9PB Capacity 41GB/s 4

5 Oracle ZFS Racked System Technical Innovations Accumulating differentiation over NetApp and EMC Record-setting Storage Performance DRAM/Flash architecture (HSPs), SMP RTOS, Most scalable Filesystem (ZFS) Industry-leading Storage Efficiency Real-time analytics, clone/snap, compression, deduplication, HSP Cloud-Proven Security Share/LUN encryption, 2-tiered key management, end-to-end integrity checks Oracle Database Co-Engineering OISP, HCC, ADO, OEM Provisioning, SMU, Pluggable Database Analytics Oracle Cloud Co-Engineering Shadow Migration and Rolling Upgrades, User-level analytics, Workflows 5

6 ZS5 is DRAM Storage DRAM not to scale Up to 90% of system I/O is delivered from memory (DRAM is 1000x faster than flash) Flash Disk 6

7 4 Write or Read SSDs per Tray (max) 3TB DRAM ZS5 Engineered for Extreme Performance Most Horsepower Possible Hybrid Storage Pool WRITE FLASH SSD 3TB DRAM 144 Cores Processing Power 307TB Read Flash 38TB Write Flash 3TB DRAM 10K SAS 7.2K SAS 10K SAS Adaptive I/O Staging LRU LFU (Evicted) MRU MFU High Endurance Sync I/O Only Adaptive Throttle Algorithm Determines Pipe Size READ FLASH SSD Read Intensive L2ARC SAS (10K, 7K) Automated, real-time data migration from DRAM to multi-class flash, to multi-class disk storage Software specifically engineered for multi-level flash and disk storage 7

8 ZFS Storage Software Hybrid Storage Pools (HSP) DRAM and Flash Centric Caching Architecture Automated Data Placement over Tiered Caches Primary Cache (Memory/DRAM) Secondary Cache (Flash SSD) Write Cache (Flash SSD) Adapts to workload changes, using fastest media Read Performance Optimization 3TB Primary Cache, 12TB Secondary Cache Read performance comes from Cache 70-90% from Primary Write Performance Optimization Small sync random IOPS go to Write Flash SSD Large Streaming writes go straight to disk Capacity Optimized Storage Pool Over 7 PB capacity, low energy consumption disks High density disks optimized for $/GB Performance media for extreme performance conditions Customer Benefits RAM and SSD response time with spinning disk capacity Automatic optimization, no involvement required Best Application Performance, $/IOP, $/GB in its class 8

9 OS8.6 Comprehensive Suite of Enterprise Software Data protocols Data services Management OISP Fibre channel iscsi Infiniband - NFS/RDMA - IPoIB - iser - SRP NFS V3 and V4 SMB/CIFS HTTP WebDAV FTP/SFTP/FTPS ZFS NDMP V4 Hybrid columnar compression (HCC) Hybrid storage pools (HSP) Single, double and triple-parity RAID Mirroring and triple mirroring End-to-end data integrity Local and Remote replication Snapshots and clones Quota(s) Deduplication Compression Encryption Thin provisioning Antivirus via ICAP protocol Online data migration RESTful API, OpenStack/Cinder Browser and CLI interface Management dashboard Hardware/component view Role-based access control Phone home Event and threshold based alerting Dtrace analytics Scripting Workflow automation Advanced networking Snap Management Utility Source aware routing 9

10 Introducing 3 New ZFS Storage Appliance Racked Systems ZS5-4 Racked System ZS5-2 Racked System ZFS Backup Appliance ZS5-4 and ZS5-2 10

11 Oracle ZFS Storage Appliance Racked System ZS5 Summary SSD SSD 60 Cores 1.5 TB DRAM 60 Cores 1.5 TB DRAM SSD SSD SSD SSD SSD SSD Up to 6 additional disk enclosures 12 Gb/sec SAS3 DE3 20x HDD: 8 TB HDDs: 20x HDD: Multi rack configurations supported 8 TB HDDs: RAID-protected disk pool SSD Optimized & built to ensure highest level of performance Built to ensure high availability (HA) Replication, Cloning and Encryption software included at no additional cost Enhanced Serviceability & Quality Platinum Service Reduced configuration complexity Optimize for Performance and HA HDD:... NSPOF configurations 11

12 Oracle ZFS Storage Appliance Racked System ZS5 Platinum Service Specialized ZFS Storage support and escalation teams 24/7 support Complete. Proactive. 2-hour onsite response to hardware issues Proactive support portal (MOS) "Phone home" automated service requests (ASR) PLATINUM SERVICES Integrated. No Additional Cost. Only available for Engineered Systems and ZFS Storage Appliance Racked System and ZFS Backup Appliance Oracle engineers perform quarterly patching and 24/7 fault monitoring Faster response and restore service: 5 Minute Fault Notification 15 Minute Restoration or Escalation to Development 30 Minute Joint Debugging with Development Available now for certified configurations of Oracle ZFS Storage 12

13 Oracle ZFS Storage Appliance Racked System ZS5 Storage based data at rest encryption Simple Granular encryption for better efficiency, controls and manageability Project level, Share level or LUN level Easy and flexible to use and manage vis BUI or CLI Allows Encrypted and Clear Text data in same system Secure Strong AES 256-bit encryption keys Integrated local key management Centralized key management (OKM) Two tier encryption key architecture Authorization and access controls Available High Availability architecture DR and Backup support Capacity and drive independent Minimal key latency Encryption included at no additional cost 13

14 Oracle ZFS Storage Appliance Racked System ZS5 Customer Results Value Enhanced Security & Data Protection No single point of failure configurations ZFS Racked System ZS5 Replication, Cloning, Encryption, included, no additional cost All configurations optimized for HA Customer Experience Large Australian Bank realized over $100K in reduced costs Insurance company experienced enhanced levels performance and availability Performance Performance optimized in the factory Video ASIC company realized significantly improved performance; resulting in over 2+ PB installed Serviceability Oracle Service Level Platinum Service Large Financial institution experienced enhanced quality by leveraging Platinum Service Quality Enhanced quality, factory configured & built Large credit card company experienced 90% reduction of configuration issues Installation Configuration complexity Customer deployment time Eliminated, pre-configured at the factory Large Telco reduced installations time by greater than 70% Fast; Hours; un-box and power up, connect & go Large chip manufacture benefited from 60% reduction deployment time 14

15 Next Generation ZFS Storage Appliance ZS5 ZS4-4 Controller ZS5-4 Controller Form Factor 3U 3U Readzilla (L2ARC) SSDs 4 x TB SSD Internal to controller 152 x TB SSD Readzillas External CPU 4x 15-Core, 2.8G 4 x 18 Core, (72 Core) 2.6 GHz Max QPI 8GT/s, Dual QPI 9.6GT/s, Dual QPI Max Memory (dual controller): 3 TB 3TB Networking Connectivity InfiniBand, 16Gb FC, 10GbE InfiniBand, 16Gb FC, 10GbE Larger Read Cache More CPU Cores Faster Performance Disk Enclosure Technology SAS2 with DE2 disk enclosures SAS3 with DE3 disk enclosures PCIe Free Option Card Slots Backup Performance (Dual controllers with 8 DE) 2x PCIe 16x Lanes 5x PCIe 8x Lanes 42 TB/ hr backup 55 TB/hr restore 2x PCIe 16x Lanes 5x PCIe 8x Lanes 60 TB/ hr backup 62 TB/hr restore 15

16 Oracle ZFS Storage plus Engineered Systems Engineered Efficiency 16

17 Oracle ZFS Racked System Eliminates Complexity Optimized for Oracle Engineered Systems Oracle Exadata Oracle Exalogic Oracle Exalytics ZFS Storage Appliance Racked System ZS5 Oracle SuperCluster Oracle PCA Oracle Database Appliance ZFS Storage Appliance Racked System RESTORES DATA AT 62TB PER HOUR 17

18 Oracle ZFS Storage Appliance Racked System Seamless Engineered Systems Integration InfiniBand 40 Gb InfiniBand provides an high performance network for transferring data Low-latency, high-bandwidth, low CPU utilization Ideal for dev / test Full snapshot and clone capability 10GbE connectivity also supported Exadata ZFS Storage Appliance Racked System 18

19 Oracle ZFS Storage Appliance Racked System and Exadata Dev/ Test and RMAN backup Dev / Test ZFS clones Thin cloning of RMAN image files using ZFS snapshots and clones Mount thin clones via Direct NFS Client Prod Database RMAN RMAN Image Native IB connection to Exadata No initial space consumption for Dev Test thin clones Exadata ZFS Storage Appliance Racked System Increases ROI on your backup storage investment Direct NFS 19

20 Oracle ZFS Storage Appliance Racked System and Exadata Technical Description Pool configuration 2x IB switches 4x IB ports Slots 11,9 Exadata ZFS Storage Appliance Racked System ZS5 Software data services used: LZJB compression: typical 1.4x to 2.1x efficiency HCC, OISP: Database integration features Snapshot/Cloning (for Database copies) Expansion Over 7 PBs backup storage and storage expansion Support 4 Exadatas per appliance 20

21 Oracle ZFS Storage Appliance Racked System and Exadata Use Cases and Best Practices Use Case Purpose Customer Advantage Best Practice Database Backup Protect Exadata production DB s Native InfiniBand connectivity RMAN integration: 2000 threads 1MB block size HCC, OISP, Compression ZFS Backup Utility Change threads to 2000 Ensure MTU set to Use Backup utility Test & Dev Storage expansion DB Migration to Exadata Disaster Recovery Enable multiple DB copies for testing, development, reporting. Free up Exadata space by moving old data/partitions to ZFS Storage Migrate Oracle DB s from any platform (i.e. HP) to Exadata Maintain stand-by remote database on ZFS Storage using DataGuard HCC, OISP, LZJB Compression dnfs/performance Snap Managment Utility (SMU) dnfs/performance HCC, Compression Native InfiniBand dnfs/performance HCC, Compression Native InfiniBand SMU integration with DataGuard High Performance Use SMU to easily provision unlimited DB copies Move tier-2 or low-use DBs Move cold-data partition (may impact workload) Bridge FC (old server) to InfiniBand (Exadata) Use SMU to automate Standby site creation Set expectation: performance < Exadata. 21

22 ZFS Storage Appliance Racked System and SuperCluster SuperCluster Storage Expansion and Backup InfiniBand SuperCluster with Oracle ZFS Storage Appliance Racked System InfiniBand high-performance network dnfs over IPoIB network Ideal for development/test Full snapshot and clone capability Local and remote replication 10 GbE connectivity (NFS and iscsi) and 16 Gb FC supported Storage use cases: SuperCluster storage expansion and backup Oracle SuperCluster Oracle ZFS Storage Appliance Racked System ZS5 22

23 ZFS Storage Appliance Racked System and SuperCluster Technical Description Switch Configuration SuperCluster 2x IB switches 4x IB ports Slots 11,9 ZFS Storage Appliance Racked System ZS5 Pool Configuration RAIDZ-1, Two pools Software data services used: LZJB compression: typical 1.4x to 2.1x efficiency HCC, OISP: Database integration features Replication, Snapshot/Cloning (for Database copies) Expansion Over 7 PBs storage expansion and backup storage Support 4 SuperClusters per appliance 23

24 ZFS Storage Appliance Racked System and SuperCluster Use Cases and Best Practices Use Case Purpose Customer Advantage Best Practice Database Backup Protect RAC 11gR2 and 12c Oracle Database services Test & Dev Storage expansion Disaster Recovery Enable multiple DB copies for testing, development, reporting. Add storage capacity using dnfs/iboip Replicate embedded ZS-ES and also maintain a stand-by remote site using DataGuard Native InfiniBand connectivity RMAN integration: 2000 threads 1MB block size HCC, Compression ZFS Backup Utility HCC, OISP, LZJB Compression dnfs/performance Snap Managment Utility (SMU) dnfs/performance HCC, LZJB compression Native InfiniBand SMU integration with DataGuard High Performance Change threads to 2000 Ensure MTU set to Use Backup utility Use SMU to easily provision unlimited DB copies Save additional space by enabling HCC (if applicable) and/or LZJB compression Use SMU to automate standby site creation 24

25 ZFS Storage Appliance Racked System and PCA PCA Storage Expansion and Backup Shared Storage for Guest OSs InfiniBand connectivity for storage expansion and backup of system disk Compute Nodes Pool_N 10 GbE for guest OS file sharing High availability High storage performance for 1,000s of VMs Powerful storage analytics VM-level visibility Rapid storage provisioning and management OVN OVN Compute Nodes System Disk 10 GbE / FC InfiniBand Controller_0 Controller_1 Pool_1 (Dom0) DTrace Analytics System Disk Expansion and Backup 25

26 ZFS Storage Appliance Racked System and PCA Technical Description Pool configuration Software data services used: LZJB compression: typical 1.4x to 2.1x efficiency HCC, OISP: Database integration features Replication, Snapshot/Cloning (for Database copies) Expansion Over 7 PBs storage expansion and backup storage Support 2 PCAs per appliance PCA ZFS Storage Appliance Racked System ZS5 26

27 ZFS Storage Appliance Racked System and PCA Use Cases and Best Practices Use Case Purpose Customer Advantage Best Practice VM Image repository Expand storage to support thousands of images Virtual machine guest storage Provide each VM guest OS with a storage share or LUN High Performance (boot 20K VMs in ~20minutes) Native InfiniBand connectivity High performance caching architecture NFS, iscsi, InfiniBand, FC direct from the guest VMs for supplementary OVM repository Use 10GbE with NFS or iscsi Backup and DR Replicate embedded ZS5-ES System Disk for backup and DR purposes Native infiniband connectivity Compression, Replication Leverage Replication with intelligent compression 27

28 ZFS Backup Appliance ZS5 Data Protection Advantage 28

29 Oracle Database Protection Solutions Production Databases Highest Availability RTO: Minutes/seconds RPO: Current Mission Critical Recovery RTO: Hours/Minutes RPO: sub-second DBaaS: Consolidation & Service on demand Oracle Data Guard Exadata Extreme Performance ZFS Storage Appliance Racked System ZS5 General Backup RTO: Hours/Minutes RPO: As of last backup ZDLRA Fast Database copies: Test/Dev Environment Non-Oracle workloads Unlimited copies Other: Storage for Bfiles/Flat files Multi-purpose storage Backup of data files, control files, archive log files, parameter files ZFS Backup Appliance ZS5 Disaster Recovery 3 rd Copy: Tape 29

30 Oracle ZFS Backup Appliance Real World Backup Results Never Lost a POC to Major Competitor $30 Billion Cloud Provider Competition Oracle ZFS Storage Oracle Advantage Backup 8 hours 87 minutes 5.5X Restore 40 hours 127 minutes 19.0X Fortune 500 Insurance Company $200 Billion Financial Services Leader Backup 48 hours 44 minutes 65X Backup 2 TB/hr 13 TB/hr 6.5X Restore 1 TB/hr 7 TB/hr 7.0X $100 Billion Financial Services Leader Backup 555MB/s 3.5GB/s 6.2X 30

31 ZFS Storage Restores Data Exponentially Faster than the competition Backup is One Thing, Restore is Everything ORACLE RESTORE ORACLE BACKUP Throughput Rates (TB/hr) Competition RESTORE Competition BACKUP Competition *A dedicated media server is required for competition to achieve claimed higher backup rates 31

32 ZFS Backup Appliance ZS5 vs. Competition Data Protection Appliance High Availability Performance CPU Processor Maximum Capacity Data Protection (RAID) ZFS Backup Appliance (ZS5-4, ZS5-2) Integrated high-performance Data Protection Solution that can also provide other storage needs. Cache centric design. Dual Active/Active Cluster Standard Up to 60TB/hour backup speed Up to 62TB/hour restore speed 4 x 18-core (ZS5-2), 8 x 18-core (ZS5-4) 3 PB Raw Capacity (ZS5-2), 7+ PB Raw Capacity (ZS5-4) Striping, Mirroring Triple Mirroring, RAID Z1, Z2, Z3 (Single/Dual/Triple-Parity RAID) Competition Dedicated Data Protection Solution Optional Controller for Active/Standby configuration for competitive configurations up to 31TB/hour for competition and restore can be significantly slower 4 Intel Processors per controller on large backup appliance 2 processors on mid range backup appliance Up to 1PB Usable Capacity for large backup appliance RAID 6 (Double Parity) Host Connectivity 10GbE, 16Gb FC, 40GbE InfiniBand 1GbE, 10GbE, 8 & 16Gb FC Drive Types 1.2TB, 8TB HDD; 400GB, 1.6TB SSD 2TB, 3TB, 4TB HDD; 400TB, 800TB SSD 32

33 Oracle ZFS Storage Appliance Racked System ZS5 Summary Superior performance High availability and fully redundant with built in security features Scalability far beyond the competition Co-engineered capabilities with Oracle Database and Oracle Engineered Systems. Architected for high throughput Superior processing power, high bandwidth interconnects, dynamic caching, and automatic parallelization Fast customer deployments Fully tested, assembled and integrated storage appliance 33

34 Oracle s NAS and Data Protection System Best Performance. Best Efficiency. Trusted by a majority of the F100 and Oracle IT Foundation storage for Oracle Cloud Engineered for Oracle Software 34