What is QES 2.1? Agenda Supported Model Live demo
QES-Based Unified Storage Windows Server Block File iscsi CIFS NFS
QES 2.1 One Architecture & Three Configurations SSD SSD Spinning Disk Hybrid All Flash
QES 2.1 One Architecture & Three Configurations SSD SSD Spinning Disk Hybrid All Flash
SSD Block Y SSD Block X Write Amplification An undesirable phenomenon associated with SSD Host Wants to write 4KB to SSD New data G in cache A B C D E F A B C D E F 1. Data A is marked for deletion. No space in X to write G. 3. Whole block is erased. 5. Block may now be written with new data. B C D E F G B C D E F G B C D E F WAI = 6 Written 24KB to SSD 2. Valid data is copied to another block. 4. New data G store in free space.
64KB 64KB Copy-on- Write Fault 4KB Writing a small-block data would cause dozens of times I/O amplification. Read block from zpool Actual I/O in ZFS I/O Request by client Modify Data in RAM 64KB + 4KB 64KB = Write bolock to zpool 4KB I/O Amplification=32x The schematic diagram of copy-on-write fault
4KB 4KB Penalty for Partial Stripe SSD SSD SSD SSD SSD D P SSD SSD SSD SSD SSD D P Blocks can be over-written on traditional RAID 5 stripe. However, blocks cannot be over-written on ZFS RAID Z1. 4KB 4KB 4KB 4KB SSD SSD SSD SSD SSD SSD SSD SSD SSD SSD D D D D P D D P P 4KB 4KB 4KB Instead, the system needs to find empty space to write new data. Extra parity blocks SSD SSD SSD SSD SSD The smaller I/O block size, the lower space efficiency. Traditional RAID5 ZFS RAID Z1 D D P D P D P P P D
Compaction Improves Ineffectiveness with Deduplication & Compression In-line Deduplication In-line Compression In-line Compaction
User Applications Small Block Access Write Coalescing Indirect DMU Small I/Os are coalesced into larger blocks and written to SSDs sequentially. Shadow DMU ZFS internal 256K 256K Large Block Access Pool SSD SSD SSD SSD SSD SSD SSD SSD
Random Access Application Write Coalescing Benefits Random Access Applications (More benefiting From SSD cache) Exchange Mail Random 64K Exchange Mail Random 64K OLTP Random 4-8K Media Streaming Mixed 128K-1M VDI Random 4-8K Video Editing Sequential 1-2M Archive Sequential 1-2M File Server Mixed 64-256K Backup Sequential 64K-1M Web Server Mixed 8-64K SQL Log Sequential 8K Medical imaging Sequential 1-2M QLAP Sequential 64-512K Small Block Application (More benefiting From SSD cache)
Write Coalescing Grows Random Write IOPS iscsi (Unit: IOPS) SMB (Unit: IOPS) 140000 70000 120000 60000 100000 50000 80000 40000 60000 30000 40000 20000 20000 10000 0 4K Block I/O 32K Block I/O 0 4K Block I/O 32K Block I/O W/O Coalescing W/ Coalescing W/O Coalescing W/ Coalescing Additional Information Windows Server 12 OS IOmeter : Random I/O TES-3085U 24 x SATA SSD
QES 2.1 With Multiple Space Saving Technologies QES makes the storage space more efficient Space Saving Technologies 3 x 3U ES 1640dc 3 x 42U Traditional Storage Deduplication Compression Compaction Thin provisioning Snapshot Fast Clone
Over Provisioning Over-provisioning reserves free space for better performance and SSD endurance. SSD works on a similar principle of the traditional 15 squares puzzle.
QES With Flexibly Configurable Over-Provisioning Setting Layer 1 pool over-provisioning Pool Usable pool capacity Dynamic OP Usable SSD capacity Dynamic OP Factoryset OP Usable SSD capacity Dynamic OP Factoryset OP Usable SSD capacity Dynamic OP Factoryset OP SSD 2 Layer 2 SSD over-provisioning
Why Non-TRIM Storage Suffer Slow Writes? SSD Cache 1 New Data Write two pages 2 3 : Valid Data 4 : Invalid Data : New Data
TRIM-Enabled QES Accelerates Write Performance SSD Cache 1 Delete two pages 2 3 Write two pages 1 New Data
System Max I/O Capacity System Max I/O Capacity System Max I/O Capacity To Avoid Noisy Neighbor Effect Well-Performing Array Increasing Workload Noisy Neighbor Impacting Everyone Workload 5 2 ms Workload 5 5 ms Workload 4 < 1 ms Workload 4 < 1 ms Workload 4 4 ms Workload 3 < 1 ms Workload 3 < 1 ms Workload 3 4 ms Workload 2 < 1 ms Workload 2 < 1 ms Workload 2 4 ms Workload 1 < 1 ms Workload 1 < 1 ms Workload 1 4 ms
QoS Ensures Workloads Serviced Properly Maximum IOPS Maximum IOPS Minimum IOPS Workload 2 Minimum IOPS Workload 1 Workload 2 Workload 1 Noisy neighbor QoS protects against noisy neighbor
VMWare Achieves Higher Performance with iser
iser VS. iscsi (VMware) 250000 VMWare (Unit : IOPS) 200000 150000 100000 50000 0 Additional Information ESXi OS Iometer : Random I/O 100% Read 100% Write 70% Read / 30% Write TES-3085U 24 x SATA SSD iscsi iser
iser VS. iscsi (Linux) 160000 Linux (Unit : IOPS) 140000 120000 100000 80000 60000 40000 20000 Additional Information Ubuntu OS Fio : Random I/O 0 100% Read 100% Write 70% Read / 30% Write TES-3085U 24 x SATA SSD iscsi iser
iser VS. iscsi (Linux) Linux (Unit : IOPS) 160000 140000 120000 100000 80000 60000 40000 20000 0 100% Read Additional Information Ubuntu OS TES-3085U Fio : Random I/O 24 x SATA SSD 100% Write iscsi iser 70% Read / 30% Write
QNAP QES Products TES-3085U TES-1885U ES1640dc v2
Dual OS Options System for Versatility QTS QNAP Turbo NAS System Complementary QES QNAP Enterprise NAS System Application Diversity Business Contiunity
TES-3085U Best Choice for All Flash Storage 2U Rackmount Front Front: 2.5 x 24 12 Gb/s SAS Controller Rear: 2.5 6Gb/s SATA SSD slot x 6 Rear Intel Xeon D-1548, 8-core 2.0 GHz 128GB RAM
TES-1885U Best Choice for Data Backup 2U Rackmount Front Front: 2.5 / 3.5 x 12 12 Gb/s SAS Controller Rear: 2.5 6Gb/s SATA SSD slot x 6 Intel Xeon D-1531, 6-core 2.2 GHz Rear 128GB RAM
TES-3085U / TES-1885U 2X SFP+ 10GbE 4x PCIe Single controller Built-in o 2 x 10 GbE SFP+ ports o 4 x 1 Gb ports o 4 x PCIe 3.0 slots o 6 x 2.5 SSD bays 2X SFP+ 10GE
ES1640dc v2 3U rack mount Front: 2.5 / 3.5 x 16 Front 12 Gb/s SAS Controller Intel Xeon E5 6-core CPU 64GB RAM + 16GB Write Cache (per controller) Cache Protection with BBU Rear
ES1640dc v2 2 Port 10GbE RJ45 雙控制器 內建 8 x 10 GbE SFP+ ports 4 x 10 GBASE-T ports 4 x SAS 12Gbps ports 4 Port 10GbE SFP+
ES1640dc v2 Hardware Design Main Memory DIMM DDR3 Memory Dual-channel DDR3 system each channel supports 16GB, up to 32GB total capacity. Intel Xeon E5-2400 v2 series processor Provides the performance required commercial mission-critical applications Write Cache DIMM DDR3 RAMDISK NVRAM dedicated DDR3 memory modules Supports 16GB.
ES Keeps Data Integrity With NVRAM Battery Backup Unit (BBU) BBU supplies power to maintain NVRAM during power outage. NVRAM w/ Copy-to-Flash DDR3 RAM DISK Module Supports 16GB, powered by C2F is supplied with BBU.
High Availability Network Failure HA Network connection is LOST File Server Availability Network Connection Lost MySQL ORACLE SQL Server
High Availability Controller Failure HA Controller is LOST Controller Lost VM VM VM Hypervisor NFS / iscsi Database
High Availability Rolling Upgrade Non-stop firmware upgrade Upgrade Firmware
Best Choice For Enterprise Enterprise-class Storage System High-performance yet cost-effective ES1640dc v2 High-Availability NAS (QES Ready) enterprise storage center TES-1885U TES-3085U (QTS / QES Ready) Intel Xeon E5 Intel Xeon D processor dual active-active controllers Up to 128G DDR4 Memory 40GbE Ready Dual QNAP OS ready to use 96G Memory 40GbE Ready
QES: ZFS Based, Enterprise Class Storage Customer s best choice