What is QES 2.1? Agenda. Supported Model. Live demo

Transcription

1

2 What is QES 2.1? Agenda Supported Model Live demo

3 QES-Based Unified Storage Windows Server Block File iscsi CIFS NFS

4 QES 2.1 One Architecture & Three Configurations SSD SSD Spinning Disk Hybrid All Flash

5 QES 2.1 One Architecture & Three Configurations SSD SSD Spinning Disk Hybrid All Flash

6 SSD Block Y SSD Block X Write Amplification An undesirable phenomenon associated with SSD Host Wants to write 4KB to SSD New data G in cache A B C D E F A B C D E F 1. Data A is marked for deletion. No space in X to write G. 3. Whole block is erased. 5. Block may now be written with new data. B C D E F G B C D E F G B C D E F WAI = 6 Written 24KB to SSD 2. Valid data is copied to another block. 4. New data G store in free space.

7 64KB 64KB Copy-on- Write Fault 4KB Writing a small-block data would cause dozens of times I/O amplification. Read block from zpool Actual I/O in ZFS I/O Request by client Modify Data in RAM 64KB + 4KB 64KB = Write bolock to zpool 4KB I/O Amplification=32x The schematic diagram of copy-on-write fault

8 4KB 4KB Penalty for Partial Stripe SSD SSD SSD SSD SSD D P SSD SSD SSD SSD SSD D P Blocks can be over-written on traditional RAID 5 stripe. However, blocks cannot be over-written on ZFS RAID Z1. 4KB 4KB 4KB 4KB SSD SSD SSD SSD SSD SSD SSD SSD SSD SSD D D D D P D D P P 4KB 4KB 4KB Instead, the system needs to find empty space to write new data. Extra parity blocks SSD SSD SSD SSD SSD The smaller I/O block size, the lower space efficiency. Traditional RAID5 ZFS RAID Z1 D D P D P D P P P D

9 Compaction Improves Ineffectiveness with Deduplication & Compression In-line Deduplication In-line Compression In-line Compaction

10 User Applications Small Block Access Write Coalescing Indirect DMU Small I/Os are coalesced into larger blocks and written to SSDs sequentially. Shadow DMU ZFS internal 256K 256K Large Block Access Pool SSD SSD SSD SSD SSD SSD SSD SSD

11 Random Access Application Write Coalescing Benefits Random Access Applications (More benefiting From SSD cache) Exchange Mail Random 64K Exchange Mail Random 64K OLTP Random 4-8K Media Streaming Mixed 128K-1M VDI Random 4-8K Video Editing Sequential 1-2M Archive Sequential 1-2M File Server Mixed K Backup Sequential 64K-1M Web Server Mixed 8-64K SQL Log Sequential 8K Medical imaging Sequential 1-2M QLAP Sequential K Small Block Application (More benefiting From SSD cache)

12 Write Coalescing Grows Random Write IOPS iscsi (Unit: IOPS) SMB (Unit: IOPS) K Block I/O 32K Block I/O 0 4K Block I/O 32K Block I/O W/O Coalescing W/ Coalescing W/O Coalescing W/ Coalescing Additional Information Windows Server 12 OS IOmeter : Random I/O TES-3085U 24 x SATA SSD

13 QES 2.1 With Multiple Space Saving Technologies QES makes the storage space more efficient Space Saving Technologies 3 x 3U ES 1640dc 3 x 42U Traditional Storage Deduplication Compression Compaction Thin provisioning Snapshot Fast Clone

14 Over Provisioning Over-provisioning reserves free space for better performance and SSD endurance. SSD works on a similar principle of the traditional 15 squares puzzle.

15 QES With Flexibly Configurable Over-Provisioning Setting Layer 1 pool over-provisioning Pool Usable pool capacity Dynamic OP Usable SSD capacity Dynamic OP Factoryset OP Usable SSD capacity Dynamic OP Factoryset OP Usable SSD capacity Dynamic OP Factoryset OP SSD 2 Layer 2 SSD over-provisioning

16 Why Non-TRIM Storage Suffer Slow Writes? SSD Cache 1 New Data Write two pages 2 3 : Valid Data 4 : Invalid Data : New Data

17 TRIM-Enabled QES Accelerates Write Performance SSD Cache 1 Delete two pages 2 3 Write two pages 1 New Data

18 System Max I/O Capacity System Max I/O Capacity System Max I/O Capacity To Avoid Noisy Neighbor Effect Well-Performing Array Increasing Workload Noisy Neighbor Impacting Everyone Workload 5 2 ms Workload 5 5 ms Workload 4 < 1 ms Workload 4 < 1 ms Workload 4 4 ms Workload 3 < 1 ms Workload 3 < 1 ms Workload 3 4 ms Workload 2 < 1 ms Workload 2 < 1 ms Workload 2 4 ms Workload 1 < 1 ms Workload 1 < 1 ms Workload 1 4 ms

19 QoS Ensures Workloads Serviced Properly Maximum IOPS Maximum IOPS Minimum IOPS Workload 2 Minimum IOPS Workload 1 Workload 2 Workload 1 Noisy neighbor QoS protects against noisy neighbor

20 VMWare Achieves Higher Performance with iser

21 iser VS. iscsi (VMware) VMWare (Unit : IOPS) Additional Information ESXi OS Iometer : Random I/O 100% Read 100% Write 70% Read / 30% Write TES-3085U 24 x SATA SSD iscsi iser

22 iser VS. iscsi (Linux) Linux (Unit : IOPS) Additional Information Ubuntu OS Fio : Random I/O 0 100% Read 100% Write 70% Read / 30% Write TES-3085U 24 x SATA SSD iscsi iser

23 iser VS. iscsi (Linux) Linux (Unit : IOPS) % Read Additional Information Ubuntu OS TES-3085U Fio : Random I/O 24 x SATA SSD 100% Write iscsi iser 70% Read / 30% Write

24 QNAP QES Products TES-3085U TES-1885U ES1640dc v2

25 Dual OS Options System for Versatility QTS QNAP Turbo NAS System Complementary QES QNAP Enterprise NAS System Application Diversity Business Contiunity

26 TES-3085U Best Choice for All Flash Storage 2U Rackmount Front Front: 2.5 x Gb/s SAS Controller Rear: 2.5 6Gb/s SATA SSD slot x 6 Rear Intel Xeon D-1548, 8-core 2.0 GHz 128GB RAM

27 TES-1885U Best Choice for Data Backup 2U Rackmount Front Front: 2.5 / 3.5 x Gb/s SAS Controller Rear: 2.5 6Gb/s SATA SSD slot x 6 Intel Xeon D-1531, 6-core 2.2 GHz Rear 128GB RAM

28 TES-3085U / TES-1885U 2X SFP+ 10GbE 4x PCIe Single controller Built-in o 2 x 10 GbE SFP+ ports o 4 x 1 Gb ports o 4 x PCIe 3.0 slots o 6 x 2.5 SSD bays 2X SFP+ 10GE

29 ES1640dc v2 3U rack mount Front: 2.5 / 3.5 x 16 Front 12 Gb/s SAS Controller Intel Xeon E5 6-core CPU 64GB RAM + 16GB Write Cache (per controller) Cache Protection with BBU Rear

30 ES1640dc v2 2 Port 10GbE RJ45 雙控制器 內建 8 x 10 GbE SFP+ ports 4 x 10 GBASE-T ports 4 x SAS 12Gbps ports 4 Port 10GbE SFP+

31 ES1640dc v2 Hardware Design Main Memory DIMM DDR3 Memory Dual-channel DDR3 system each channel supports 16GB, up to 32GB total capacity. Intel Xeon E v2 series processor Provides the performance required commercial mission-critical applications Write Cache DIMM DDR3 RAMDISK NVRAM dedicated DDR3 memory modules Supports 16GB.

32 ES Keeps Data Integrity With NVRAM Battery Backup Unit (BBU) BBU supplies power to maintain NVRAM during power outage. NVRAM w/ Copy-to-Flash DDR3 RAM DISK Module Supports 16GB, powered by C2F is supplied with BBU.

33 High Availability Network Failure HA Network connection is LOST File Server Availability Network Connection Lost MySQL ORACLE SQL Server

34 High Availability Controller Failure HA Controller is LOST Controller Lost VM VM VM Hypervisor NFS / iscsi Database

35 High Availability Rolling Upgrade Non-stop firmware upgrade Upgrade Firmware

36 Best Choice For Enterprise Enterprise-class Storage System High-performance yet cost-effective ES1640dc v2 High-Availability NAS (QES Ready) enterprise storage center TES-1885U TES-3085U (QTS / QES Ready) Intel Xeon E5 Intel Xeon D processor dual active-active controllers Up to 128G DDR4 Memory 40GbE Ready Dual QNAP OS ready to use 96G Memory 40GbE Ready

37 QES: ZFS Based, Enterprise Class Storage Customer s best choice