Huawei Unified Storage Software Features Hyper and Smart Series

Transcription

1 Huawei Unified Storage Software Features Hyper and Smart Series Date: Mar. 18,

2 Teacher name Background Project Experience Teacher name position Specialist Skills 1 Page 1

3 Content 1 Software Features Overview 2 Hyper Series Introduction 3 Smart Series Introduction 2

4 Hyper Series Software Overview Local data protection Block File HyperSnap HyperSnap HyperClone HyperMirror Remote data protection(metro) Block HyperReplication/S Remote data protection(global) Block&File HyperReplication/A <=100km Same-city DR center >100km Remote DR center Production center 3

5 Content 1 Software Features Overview 2 Hyper Series Introduction 3 Smart Series Introduction

6 HyperSnap overview Before Snapshot Source Volume Snapshot Mapping table After Snapshot Source Volume Host write to D Snapshot Mapping table After data changed Source Volume Copy-on-Write (CoW) A B C D A B C D A B C D1 Data D is copied out and relations in mapping table is modified Modified data D Old data Before Snapshot After Snapshot After data changed Active File System Snapshot Active File System Snapshot Active File System Redirect-on-Write (RoW) A B C D A B C D A B C D B D1 E1 E2 Deleted data Modified data New data 6

7 7 HyperSnap(for block) Features -1 9:00-9:59 10am A D G J B E H K C F I L 10:00-10:59 11:00-11:59 Original data is copied to the snapshot resource pool Time Table Resource Pool Source volume A D G J B E H K C I L D H B F M N A D G J B E H K C F I L M N O P A O G J M E P K C N I L G Q K L S R 12:10pm Application error, need to revert to the status 10am. A O G J M E P K C N I L G Q K L S R A O G J M E P K C N I L G Q K L S R D G H K L 10:00am! 11am 12am 09:00 10:00 11:00 12:00 9am Fast Recovery: Source Volume can rollback to any Snapshot, the differential data are copied back to Source Volume in background so that the source Volume can provide IO service instantly.

8 HyperSnap(for block) Features -2 High Frequency The interval between two snapshot can be set to15 minutes minimal (by Replication Director), and max snapshot number of a single LUN can be up to Writeable Snapshot User can read from/write into snapshot volume, so the snapshot volume can be used in many ways (Data Mining, Testing, etc.) Shared Resource Pool COW data are stored automatically in source volume s storage pool, no independent resource volume is needed easy planning of resource pool. Periodic Snapshot Depending on strategy, continuously generate multiple snapshots on the same source volume to achieve continuous data protection Multiple snapshot replica User can activate multiple snapshot volume of single LUN at a same time, each snapshot can be read/write, so that they can be used in different way. Source Volume Source Volume 10:30 11:00 11:30 12:00 Snapshot Snapshot Snapshot 8

9 HyperSnap (for block) Application Scenarios Backup & Restoration Testing & Mining Source Volume Activate a snapshot Fast rollback Snapshot Copy snapshot to backup volume Rapid online data backup and restoration Backup Volume Source Volume Activate a snapshot Test or mine anytime Snapshot Zero backup and rollback window Space efficiency, Snapshot volume writable 9

10 HyperSnap (for file system) Application Scenarios Local Backup File System-level Data Recovery Rapid data backup Zero backup window and rapid data recovery 10

11 HyperSnap Competitive Analysis Competitive Advantages: Periodical snapshot via ReplicationDirector, protecting the data continuously; Consistent activation of the snapshot, ensuring the same time-point of the data even though distributed onto multiple LUNs; Snapshot replica function, providing multiple copies of the same snapshot for different usage. Item Huawei EMC VNX NetApp FAS HDS HUS Snapshot number per LUN 64/128/ COW/ROW COW ROW ROW COW Periodical snapshot Cascaded snapshot Consistency group Snapshot replica uncertain 11

12 HyperClone Overview Host Write HyperClone Brief: Keep the consistency between primary and secondary LUN at all time Clone Generate a complete physical copy of primary LUN when HyperClone pair spitted Primary LUN Secondary LUN 12

13 HyperClone Principle The bitmaps for the same data blocks are 0 and for different data blocks are 1. a b c d j e f g h i Primary LUN m n k j l Progress bitmap Initial synchro Double Split nization Write a b c Double write after synchronization Secondary LUN 13

14 HyperClone Principle 1. Configue Host IO not affected 2. Maintain the consistency 3. Split Host IO Host IO Online Initial Synchronization Double Write Split X Primary LUN Secondary LUN Primary LUN Secondary LUN Primary LUN Secondary LUN 5.2 Online Reverse Synchronization 5.1 Online Reinitialize 4. Record Difference Primary LUN Host IO not affected Only changed data copied Secondary LUN Primary LUN Host IO not affected Only changed data copied Secondary LUN Primary LUN Differential Bitmap Secondary LUN 14

15 HyperClone Features Adjustable Copy Speed Copy speed can be manually adjusted to avoid performance influence caused by copy process. Four speed levels: Low (< 5MB/s), Middle (10MB/s 20MB/s), High (50MB/s 70MB/s), Ultra High (> 100MB/s) 1-to-16 A clone in 1-to-16 mode is able to back up 16 copies of data simultaneously. These data copies are applicable to various forms of data analysis Primary LUN LUN 1 LUN 2 LUN 16 Online Reverse Synchronization Consistency Group If the data on the primary LUN is damaged, an incremental reverse synchronization from the secondary LUN to the primary LUN can be implemented to restore the original service data instantly. The copy process is in background so the host IO is not affected. Associated data scattered in different LUNs can be kept consistent at the same split time 15

16 HyperClone Application Scenarios HyperClone HyperSnap Reliability high normal Time spent long few Continuous data protection Space efficency yes no no yes Testing & Mining HyperClone or HyperSnap? 16

17 HyperClone Competitive Analysis Competitive Advantages: Ensuring the data availability in case of the physical failure on the source volume. Item Huawei HyperReplicati on EMC Timefinder/mirr or EMC SnapVie w VSP Shadowima ge HP VirtualCop y NetApp Flexclon e Source volume and the cloned volume located in different Disk Array Enclosure/Rack N/A Cloned volume readable N/A N/A cloned volume can resync with/incremental restore to the source volume After split N/A Cascaded clone N/A 17

18 HyperCopy Overview HyperCopy Brief: Source LUN 1 Source LUN 2 Target LUN 1 Target LUN 2 LUN copy is a process of copying data from a source LUN to a target LUN. The LUN copy is able to copy data in a storage system or between storage systems, including a third-party storage system. 18

19 HyperCopy Principle Service interruption Source LUN Target LUN LUN Copy 19

20 HyperCopy Features Multiple Copy Approaches Data copy inside a storage system Data copy between storage systems (including the other vendors storage system) Dynamic Adjustment of the Copy Speed When a storage system detects that the service load is heavy, it dynamically lowers the LUN copy speed to make system resources available to services. When the service load is light, the copy speed increases dynamically. It is recommended that data be copied during off-peak hours. IP Network based LUN Copy Huawei unified storage systems support both the traditional FC link based and IP-based LUN copy, providing flexible choices for customers. Furthermore, with the popularization of IP networks, IP network based LUN copy features low costs, easy deployment, and simple maintenance. 20

21 HyperCopy Application Scenarios Data Backup Data Migration Suspend the host service to ensure the data replicated will be available. 21

22 HyperCopy Competitive Analysis Competitive Advantages: Allow the inter-array data copy, using the third-party device as either the source or target. Items Architecture The target volume is in a heterogeneous device The source volume is in a heterogeneous device Huawei HyperReplication LUN-based Block Copy EMC Open replicator LUN-based Block Copy EMC SAN copy LUN-based Block Copy HDS N/A N/A N/A N/A N/A HP N/A NetApp Volume copy LUN-based Block Copy Incremental copy N/A N/A Broken-point resume N/A N/A unknown 22

23 Remote Replication Overview Remote Replication Brief: Server Server Server Server Remote replication is the core technology for data backup and recovery caused by a disaster. Synchronous mode Asynchronous mode Remote Replication Storage Array DC Storage Array DR DC 23

24 HyperReplication/S (for block) Principle Cache Synchronous remote replication 2 Cache 3 LUN A LUN B Array A/Primary site Array B/Secondary site 24

25 HyperReplication/A (for block) Principle Main Site DR Site Host 2 T1 1 T1 1 T0 T0 3 Cache Cache 5 Asynchronous 5 remote replication 4 LUN A Array A Main tasks of Array A: a. Set timestamp to the data block b. Replicate data to Array B c. Save the replication failed data to data change log and resend d. Flush data to LUN LUN B Array B Main tasks of Array B: a. Set timestamp to the data block b. Reply replication results to Array A c. Flush data to LUN 25

26 HyperReplication/A (for file systems) Principle Technical principle Asynchronous replication based on the file 1 system object layer Host 2 Primary file system Primary file system snapshot Production Storage Incremental data replication Secondary file system Secondary file system snapshot Disaster Recovery Storage Periodic replication based on ROW snapshots Private snapshots created for the primary file system as a replication source Private snapshots created for the secondary file system to ensure replication consistency Restrictions Only file system level snapshots are supported. Directory- or file-level snapshots are not supported. 26

27 HyperReplication/A or HyperReplication/S? Replication Bandwidth Requirement HyperReplication/S high, >= host business bandwidth HyperReplication/A medium, complete the transfer of the changed data within the replication cycle Host IO latency HyperReplication/S > HyperReplication/A RPO 0 Depends on the replication cycle. Networking The longest distance HyperReplication/S HyperReplication/A Direct attached(iscsi) m Direct attached(multimode fiber) Through long-distance transportation device (switch, repeater, DWDM, FC/IP gateway) 100km 500m Unlimited 27

28 HyperReplication(for block) Features Bad sector repairment of Primary LUN Data replication from 32 storage devices to one storage device for central backup (32:1 replication ratio) Resource sharing and cost saving Consistency Group 512 Consistency Group per system Maxim 32K Replication Pair in one CG 28 Secondary LUN Protection In HyperReplication/A mode, at the beginning of each replication cycle, the OceanStor system will trigger a snapshot of secondary LUN, maintaining a consistency copy of secondary LUN. In case of the replication failure, system will rollback the secondary LUN to the snapshot, hence the secondary LUN is usable, reducing the recovering time of host service. Adjustable Replication Speed Replication speed can be manually adjusted to avoid performance influence caused by copy process. Four speed levels: Low (< 5MB/s), Middle (10MB/s 20MB/s), High (50MB/s 70MB/s), Ultra High (> 100MB/s)

29 HyperReplication (for block) Features 32:1 High Replication Ratio Data replication from 32 storage devices to one storage device for central backup (32:1 replication ratio) Resource sharing and cost saving fan-out fan-in Replication between high-end/midrange/entry-level storage systems Simple and hierarchical low-tco disaster recovery solutions High-end High-end High-end High-end Highend Mid-range Entry-level High-end Mid-range Entry-level 29

30 HyperReplication (for block) Application Scenarios Continuous Service HyperReplication/S: 100km HyperReplication/A: >100km Second-level RPO, the secondary LUN will take over the primary LUN when disaster occur 30

31 HyperReplication (for block) Application Scenarios Central Backup 32:1 High Replication Ratio 31

32 HyperReplication (for file systems) Application Scenarios Continuous Service Central Backup Production center DR center FS Service site 01 NFS/ CIFS FS FC/ iscsi NFS/ CIFS FS FS Service site 02 FS Service site 03 FC/ iscsi FS FS FS Central DR site Second-level RPO, the secondary FS will take over the primary FS when disaster occur 32 32:1 High Replication Ratio

33 HyperReplication Competitive Analysis Competitive Advantages: Second-level RPO for asynchronic replication, ensuring close-to-zero DR data loss; Interworking of high-end, mid-range and entry-level storage arrays, lowering the DR center construction by 50%; Unique bad block repair tech, recovering the bad blocks of the primary LUN using the data on the secondary LUN; SCSI SiRT, reducing the interaction cycles and lowering the write latency. Item Huawei EMC HDS HP NetApp Name HyperReplication SRDF Univesral replicator Remote Copy SnapMirror Replication Mode Switch Automatic from sync to asyn Inter-switch using CLI Asyn to sync via configuration and restart RPO 3s 6s 1s 2s uncertain 10 min 2 min bad block repair SiRT interworking 33

34 HyperMirror Overview A Mirror copy Mirror LUN B Mirror copy HyperMirror Brief: 1. HyperMirror is a high availability technology that provides two mirror copies for a local LUN or external LUN. 2. If a mirror copy of a LUN is unavailable, a host can still access the LUN, and services on the host are not affected. 34

35 HyperMirror Principle Host Mirror LUN A Mirror copy B Mirror copy 35

36 HyperMirror Features Data reliability in a storage system After a volume mirror is created for a service LUN, the service LUN can have two independent data copies. The failure of a data copy does not interrupt host services. Data reliability between heterogeneous storage systems By leveraging SmartVirtualization, HyperMirror creates mirror copies for LUNs of heterogeneous storage systems. Service continuity is ensured when heterogeneous storage systems are unstable or a link exception occurs. Improved performance Round-robin read is implemented between mirror copies, improving read performance by 80%. Priority read in mirror copies is also implemented, improving read performance in tiered storage solution. Host service continuity Mirror copies can be created online for running service LUNs. The process is transparent to host services. 36

37 HyperMirror Application Scenarios Continuous Service Central Backup 1. Redundant data backups for heterogeneous storage systems 2. Accelerate the performance of heterogeneous storage systems. High Availability Protection for Local LUNs Protect the data in heterogeneous storage and improve performance High availability due to double data copy 37

38 HyperMirror Competitive Analysis Competitive Advantages: Ensure the business continuity and data reliability by shielding a single LUN failure from the host; Guarantee the reliability of the heterogeneous devices, by allowing mirroring with a LUN from them; Provide more possibilities in data protection solutions, by being compatible with the snapshot and replication features. Item Architecture Source Volume Concurrent Read Non-disruptively real-time switch to Mirror Volume Online incremental restore Compatible with the snapshot/replication Huawei HyperReplication An IO is mirrored directly to the two LUNs in the device from the parent LUN EMC VPLEX Local VSP HP An IO is written through to the backend device LUN via the gateway without write cache. N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A NetApp Syncmirror Two disk groups implements the mirror after the RAID. 38

39 HyperLock Features HyperLock file system Ordinary file system Write Once Read Many Sharing one storage pool CV EC TSM LN HyperLock Security Clock administrator Regulations clock Preventing clock tampering 39 Compatible with mainstream backup software

40 HyperLock Competitive Analysis Competitive Advantages: Maintain a global secure clock and a per File System clock, so as to eliminate the illegal modification of File s protection period; Integrate with the mainstream archiving software such as Enterprise Vault, Commvault Simpana, etc. Item Huawei HyperLock EMC VNX FLR HDS WORM NetApp Snap-Lock Regulatory Compliance FLR-C Strict WORM SnapLock Compliance Enterprise Compliance FLR-E Non-strict WORM SnapLock Enterprise 40

41 Hyper Series Software Summary Type Feature Name Description Local Data Protection Remote Data Protection High Availability HyperSnap HyperClone HyperReplication/S HyperReplication/A HyperMirror Virtual snapshot: Quickly generates a consistent virtual copy of a source LUN at a point in time LUN clone: Generates a complete physical copy of a source LUN at a point in time Synchronous remote replication: Maintains data consistency between a primary LUN and its secondary LUN Asynchronous remote replication: Data is synchronized periodically between a primary LUN and its secondary LUNs Volume mirror: create two physical copies of either a local LUN or LUN on a third party storage system DR Management Replication Director Simplified DR management and switchover procedure Regulation Compliance HyperLock 42 WORM: Write Once Read Many, Write-once technology

42 Q&A Does HyperReplication support one-to-many replication? For each source LUN: Synchronous: 1:1 Asynchronous: 1:2 For each storage system: HyperReplication supports data replication from 32 storage systems to one storage system for centralized backup. What is the distance and latency supported by HyperReplication? For HyperReplication/S: Distance between the primary and secondary sites < 100 km Unidirectional transmission latency < 1 ms For HyperReplication/A: No explicit limit on the WAN distance between the primary and secondary sites Unidirectional transmission latency < 50 ms 43

43 Thank you Copyright 2014 Huawei Technologies Co.,Ltd. All Rights Reserved. The information contained in this document is for reference purpose only, and is subject to change or withdrawal according to specific customer requirements and conditions 华为技术有限公司版权所有本资料仅供参考, 不构成任何承诺及保证 44