PSAM, NEC PCIe SSD Appliance for Microsoft SQL Server (Reference Architecture) September 4 th, 2014 NEC Corporation

Transcription

1 PSAM, NEC PCIe SSD Appliance for Microsoft SQL Server (Reference Architecture) September 4 th, 2014 NEC Corporation

2 1. Overview of NEC PCIe SSD Appliance for Microsoft SQL Server Page 2 NEC Corporation 2014

3 NEC PCIe SSD Appliance for Microsoft SQL Server - Customer s Pain : Background of the Solution - System bottleneck from performance gap between in-box memory / storage and external disks Performance tuning is getting more complicated, needs a lot of external storage and Host Bus Adapters to provide enough IO bandwidth for a high-performance system (Storage Capacity) Balanced CPU-IO configuration restricted by the latest QPI architecture-based processors The architecture requires extra CPU sockets, even if customer just wants to have more IO slots (or memory). The extra CPU sockets contribute to increased power consumption and system cost 1PB 100TB 10TB 1TB D Huge Performance gap PCIe SSD SAS SSD SAS Disk Array SATA Disk Array QPI QPI QPI CPU IO Controller PCIe slot PCIe slot Memory Controller Memory Controller PCIe slot DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM QPI based CPU CPU Cache <ns <1us <150us ~2ms ~8ms ~20ms Page 3 NEC Corporation 2014 (Access latency) * QPI = Quick Path Interconnect (Interconnect between CPUs) PCIe SSD (server-mounted flash storage) and Rich IO slots (per CPU) are the keys to solve those issues

4 NEC PCIe SSD Appliance for Microsoft SQL Server - Overview - Proven performance reference architecture for TCO optimization - Best fit for High-Performance & Scalable DWH/BI/OLTP system - NEC Solution Platforms の露出用記載文言は検討中 High-performance and high availability appliance system (reference architecture) with no external storage ü NEC Express5800 Scalable Enterprise Server-based all in a box solution combined with high-performance HGST FlashMAX II PCIe server-mounted flash storage Best practice configuration fully utilizing NEC s knowledge of SQL Server ü Support the latest Microsoft SQL Server SQL Server 2014 ü Balanced CPU-IO performance depending on number of Flash MAX II (i.e., depending on data size ) ü No data lost by utilizing mirrored storage pool feature of Windows OS Single Node model AlwaysOn AG two node cluster model Express5800 Scalable Enterprise Server Max. 4 Intel Xeon Processor E7 v2 family CPU Max. 4TB memory Max. 16 slots of PCI-Express 3.0 (Class No.1 rich IO slots) 10G Ether High band width Low Latency Page 4 NEC Corporation 2014

5 2. Reference configuration of NEC PCIe SSD Appliance for Microsoft SQL Server Page 5 NEC Corporation 2014

6 NEC PCIe SSD Appliance for Microsoft SQL Server - Reference configuration per node - Optimized performance combining fast clock CPU (E v2:6c, 3.4GHz) and high-performance HGST FlashMAX II PCIe server-mounted flash storage (FM2) No data loss by utilizing software-mirrored storage pool feature of Windows OS Balanced CPU-IO performance depending on number of FM2 (i.e., data size ) 1CPU (3.4GHz, 6C) 128GB 2x FM2 in mirrored storage pool 4CPU (3.4GHz, 6C) 512GB 8x FM2 in mirrored storage pool Express5800 Scalable Enterprise Server 128GB 128GB FlashMAX II SW Mirroring FlashMAX II E v2 E v2 FlashMAX II SW Mirroring FlashMAX II QPI Scale Up 2CPU (3.4GHz, 6C) 256GB 4x FM2 in mirrored storage pool Scale Up Scale Up 3CPU (3.4GHz, 6C) 384GB 6x FM2 in mirrored storage pool FlashMAX II SW Mirroring FlashMAX II Internal Drive E v2 128GB E v2 128GB FlashMAX II SW Mirroring FlashMAX II Page 6 NEC Corporation 2014

7 Reference configuration as single node Data Warehouse system CPU and Memory 1CPU 128GB 2CPU 256GB 3CPU 384GB 4CPU 512GB Express5800 Scalable Enterprise Server Built-in DVD-ROM Drive Additional CPU (E v2, 6 core) Memory Riser GB additional memory (8GB DIMM x2) KRPM 600GB HDD RAID SAs-Controller (1GB, RAID 0/1/5/6) BASE-T Network Adopter (4 port) TB FlashMAX II # of card Maximum Physical Storage Capacity per node * Max capacity mode Mirrored Storage Pool 1.1TB 2.2TB 3.3TB 4.4TB * Data capacity after compression. About 1/3.5 of logical user data capacity before compression Page 7 NEC Corporation 2014

8 Reference configuration as single node OLTP system CPU and Memory 1CPU 128GB 2CPU 256GB 3CPU 384GB 4CPU 512GB Express5800 Scalable Enterprise Server Built-in DVD-ROM drive Additional CPU (E v2, 6 core) Memory Riser GB additional memory (8GB DIMMx2) krpm 600GB SAS-HDD RAID SAS-Controller (1GB, RAID 0/1/5/6) BASE-T Network Adopter (4 port) TB Flash MAXII # of card Maximum Physical Storage Capacity per node Max Performance mode Mirrored Storage Pool 0.9TB 1.7TB 2.6TB 3.4TB Page 8 NEC Corporation 2014

9 Reference configuration as two node OLTP system (configuration per node) CPU and Memory 2CPU 256GB 3CPU 384GB 4CPU 512GB Express5800 Scalable Enterprise Server Built-in DVD-ROM drive Additional CPU (E v2, 6 core) Memory Riser GB additional memory (8GB DIMMx2) krpm 600GB SAS-HDD RAID SAS-Controller (1GB, RAID 0/1/5/6) BASE-T Network Adopter (4 port) TB FlashMAXII # of card Maximum Physical Storage Capacity per node Max Performance mode Mirrored Storage Pool 1.7TB 2.6TB 3.4TB 10GBASE Network Adopter (SFP+/2 port) Page 9 NEC Corporation 2014

10 3. Performance of NEC PCIe SSD Appliance for Microsoft SQL Server as Dara Warehouse system Page 10 NEC Corporation 2014

11 Single Node DWH Performance (1/2) DWH performance comparison with Express5800/A1080a based FTRA DWH using Microsoft Fast-track Data Warehouse Benchmark tool. (FTRA DWH =Microsoft SQL Server Fast Track Data Warehouse) Configuration for DWH performance comparison NEC PCIe SSD Appliance for Microsoft SQL Server Express5800/A1080a-S FTRA DWH CPU E v2 (6C, 3.4GHz) E (10C, 2.4GHz) CPU socket count Total core count Physical memory capacity 128GB 256GB 384GB 512GB 128GB Storage configuration 1.1TB FlashMAX II (Max Capacity Mode) Mirrored storage pool configuration 1set 2 sets 3sets 4 sets istorage M100 x3 (72 450GB 10krpm SAS-HDD) RAID pair Physical Storage Capacity 1.1TB 2.2TB 3.3TB 4.4TB 16.2TB Physical Capacity per Usage User data* * Data capacity after compression About 1/3.5 of logical user data ~0.5TB ~1.0TB ~1.5TB ~2.0TB 8.0TB capacity before compression. Transaction log ~0.2TB ~0.4TB ~0.6TB ~0.8TB 3.5TB tempdb ~0.3TB 0.6TB ~0.9TB ~1.2TB 4.5TB Page 11 NEC Corporation 2014

12 Single Node DWH Performance (2/2) Performance comparison using Microsoft Fast-track Data Warehouse benchmark tool 8,000 8, ,000 Benchmark Logical Scan rate [MB/s] Read time to scan all user data [s] , ,000 4,820 4, ,000 3,000 2,000 1, ,422 1, P6C 2P12C 3P18C 4P24C 2P20C NEC PCIe SSD Appliance for Microsoft SQL Server (E7-8893v2 3.4GHz) Fast-track Data ware house NEC Express5800 A1080a-S (E GHz) Page 12 NEC Corporation 2014

13 Benefit as Data Warehouse system Performance boost with significant TCO saving Express5800 A1080a-S base Microsoft Fast-track Data Warehouse NEC PCIe SSD Appliance for Microsoft SQL Server To Balance CPU power and IO bandwidth, 12 FC channels and 72 HDDs are required 2P20C (2.4GHz) + 128GB 8G-FC channels x12 (2p 8G-FC HBA x6) 4P24C (3.4GHz) + 512GB All-n-a-box Solution Total 72 SAS-HDD drives Rack space 13U 69% less rack space 4U Power Consumption 2,125W 27% less power consumption 1,551W Benchmark logical scan rate Microsoft Fast-track Data ware house benchmark tool 4,759MB/s 173% better performance 8,234MB/s Page 13 NEC Corporation 2014

14 4. Performance of NEC PCIe SSD Appliance for Microsoft SQL Server as single node OLTP system Page 14 NEC Corporation 2014

15 Single Node OLTP Performance (1/2) OLTP performance comparison with Express5800/A1080a-S + external FC storage system using Hammer DB benchmark tool. Configuration for OLTP performance Comparison NEC PCIe SSD Appliance for Microsoft SQL Server Express5800/A1080a-S + External FC storage CPU E v2 (6C, 3.4GHz) E (10C, 2.4GHz) CPU socket count Total core count Physical memory capacity 128GB 256GB 384GB 512GB 256GB Storage configuration 1.1TB FlashMAX II (Max Performance Mode) Mirrored storage pool configuration 1set 2 sets 3sets 4 sets istorage M100 x1 (24 450GB 10krpm SAS-HDD) RAID-10 6 pair Physical Storage Capacity 0.9TB 1.7TB 2.6TB 3.4TB 5.4TB Physical Capacity per Usage User data ~0.5TB ~1.0TB ~1.5TB ~2.0TB 3.6TB Transaction log ~0.2TB ~0.4TB ~0.6TB ~0.8TB 1.0TB tempdb ~0.2TB ~0.3TB ~0.5TB ~0.6TB 0.8TB Page 15 NEC Corporation 2014

16 Single Node OLTP Performance (2/2) Relative performance Performance comparison using HammerDB benchmark tool Relative performance of Optimized I/O scenario Relative performance of Non-Optimized I/O scenario Performance down rate between 2 scenarios (%) 50% % 46% % P6C 2P12C 3P18C 4P24C 2P20C NEC PCIe SSD Appliance for Microsoft SQL Server (E7-8893v2 3.4GHz) Performance down rate 96% 4 100% 75% 50% 25% ü NEC Express5800 A1080a-S performance of optimized I/O scenario is the base performance of the relative performance comparison ü Optimized IO scenario : Minimize IO by enabling Server side memory caches and Storage side cache. ü Non-optimized IO scenario: Maximize IO by disabling Server side memory caches and Storage side cache. 0% NEC Express5800 A1080a-S (E GHz) + istorage M100 x1 Page 16 NEC Corporation 2014

17 Benefit as single node OLTP system Achieve high performance even in heavy IO stress, requires less DB tuning cost (i.e., less system integration cost) Express5800 A1080a-S +istorage M100 NEC PCIe SSD Appliance for Microsoft SQL Server 2P20C (2.4GHz) + 256GB 4P24C (3.4GHz) + 512GB 8G-FC channels x 4 (2p 8G-FC HBA x 2) Total 24 SAS-HDD drives All-in-a-box solution Relative OLTP performance (TPS) comparison for optimized I/O scenario *1, *2 OLTP performance down ratio between the optimized IO scenario And Non-optimized IO scenarios *1, % better performance % 53% less impact of IO 49% *1 Relative performance comparison using HammerDB benchmark tool *2 Optimized IO scenario : Minimize IO by enabling Server side memory caches and Storage side cache. *3 Non-optimized IO scenario: Maximize IO by disabling Server side memory caches and Storage side cache. Page 17 NEC Corporation 2014

18 5. Performance of NEC PCIe SSD Appliance for Microsoft SQL Server as two node cluster OLTP system Page 18 NEC Corporation 2014

19 Two Node OLTP Performance (1/2) OLTP performance comparison with Express5800/A1080a-S + external FC storage system using Hammer DB benchmark tool. Configuration (per node) for OLTP performance Comparison NEC PCIe SSD Appliance for Microsoft SQL Server Express5800/A1080a-S + External FC storage CPU E v2 (6C, 3.4GHz) E (10C, 2.4GHz) CPU socket count Total core count Physical memory capacity 256GB 384GB 512GB 256GB Storage configuration 1.1TB FlashMAX II (Max Performance Mode) Mirrored storage pool configuration 2 sets 3sets 4 sets istorage M100 x1 (24 450GB 10krpm SAS-HDD) RAID-10 6 pair Physical Storage Capacity 1.7TB 2.6TB 3.4TB 5.4TB Physical Capacity per Usage User data ~1.0TB ~1.5TB ~2.0TB 3.6TB Transaction log ~0.4TB ~0.6TB ~0.8TB 1.0TB tempdb ~0.3TB ~0.5TB ~0.6TB 0.8TB Page 19 NEC Corporation 2014

20 Two Node OLTP Performance (2/2) Performance comparison using HammerDB benchmark tool Relative performance 200 Relative performance of Optimized I/O scenario Relative performance of Non-Optimized I/O scenario Performance down rate between 2 scenarios (%) % 29% 32% Performance down rate 100% 98% 75% % 25% 0 2P12C 3P18C 4P24C 2P20C 2 0% ü NEC Express5800 A1080a-S performance of optimized I/O scenario is the base performance of the relative performance comparison ü Optimized IO scenario : Minimize IO by enabling Server side memory caches and Storage side cache. ü Non-optimized IO scenario: Maximize IO by disabling Server side memory caches and Storage side cache. Page 20 NEC Corporation 2014 NEC PCIe SSD Appliance for Microsoft SQL Server (E7-8893v2 3.4GHz) NEC Express5800 A1080a-S (E GHz) + istorage M100 x1

21 Benefit as two node OLTP system Achieve high performance even in heavy IO stress, requires less DB tuning cost (i.e., less system integration cost) Express5800 A1080a-S +istorage M100 NEC PCIe SSD Appliance for Microsoft SQL Server 2P20C (2.4GHz) + 256GB 4P24C (3.4GHz) + 512GB 8G-FC channels x 4 (2p 8G-FC HBA x 2) Total 24 SAS-HDD drives All-in-a-box solution Relative OLTP performance (TPS) comparison for optimized I/O scenario *1, *2 OLTP performance down ratio between the optimized IO scenario And Non-optimized IO scenarios *1, % better performance % 34% less impact of IO 32% *1 Relative performance comparison using HammerDB benchmark tool *2 Optimized IO scenario : Minimize IO by enabling Server side memory caches and Storage side cache. *3 Non-optimized IO scenario: Maximize IO by disabling Server side memory caches and Storage side cache. Page 21 NEC Corporation 2014

22 6. Recommendation to improve availability of the system Page 22 NEC Corporation 2014

23 EXPRESSCLUSTER X SingleServerSafe (SSS) To reinforce availability of the system, it is recommended to install EXPRESSSLUSTER X SSS What is EXPRESSCLUSTER X SSS? EXPRESSCLUSTER X SSS is a program product which monitors abnormality of HW & SW, recovers them from failure, and improves availability of the system. EXPRESSCLUSTER X SSS contributes to reinforce fault resiliency of 2 node AlwaysON AG system also. üadditional to monitoring targets of the AlwaysOn, improve fault resiliency of the 2 node system by monitoring Disk failure: Restarts the node, then fail over to the secondary node to continue operation. LAN failure of the secondary read only node: Change routing of read only access from the faulty node to the other heathy node (in 2 node system, primary node) to continue system operation. Application layer Presence monitoring OS layer Stall monitoring OS space Hardware layer Router, other network devices Ping check monitoring System disk App Monitoring agent X SingleServerSafe Access Check PCIeSSD Response monitoring NIC Link-down monitoring NIC Page 23 NEC Corporation 2014

24 Accurate monitoring to check the actual status Application layer OS layer EXPRESSCLUSTER X SSS s target of monitoring Presence monitoring Stall monitoring OS space Hardware layer Router, other network devices Ping check monitoring System disk App Monitoring agent X SingleServerSafe Access check PCIeSSD Response monitoring NIC Link-down monitoring NIC Application layer: Presence monitoring of process Restarts when process abnormality is detected Monitoring agent Restarts when abnormality in SQL, HTTP and so on is detected OS layer User space monitoring Restarts when abnormality in AP layer such as hang-up is detected. Hardware layer Access check Restarts when disk/pciessd access abnormality is detected. Ping monitoring Restarts when ping abnormality is detected. NIC Link UP/DOWN monitoring Restarts when link-down is detected. Availability can be improved by NIC duplication. Page 24 NEC Corporation 2014

25 7. Summary Benefit of NEC PCIe SSD Appliance for Microsoft SQL Server Page 25 NEC Corporation 2014

26 Benefit of NEC PCIe SSD Appliance for Microsoft SQL Server Express5800 Scalable Enterprise Server High-performance PCIe server-mounted flash storage X Balanced and Predictable Performance Balanced and Proven CPU-IO Performance depending on number of Flash MAX II. Consistent high-performance even under heavy IO load. Easy to introduce Customer can choose best practice configuration depending on data size. Cook book (Configuration guide, including best parameter setting) will be available * * Pre-configuration and Pre-installation Are subject of discussion TCO reduction Less platform integration cost Less Rack apace Less Power Consumption Initial Cost Operating Cost Time to introduction Down Page 26 NEC Corporation 2014

27 08/07 Image of Big Data Analytics Solution built on NEC PCIe SSD Appliance for Microsoft SQL Server Microsoft SQL Server 2014 equipped with ETL, DB, BI, Data Mining, easy-to-use Excel & Power BI and NEC PCIe SSD Appliance for Microsoft SQL Server provide Low-Cost All-in-One Big Data Analysis Platform INPUT Data Extract Big Data Analytics Platform Process & Aggregation Store data into High-Performance PCIe server-mounted flash storage End user Enterprise System TARO SUZUKI Customer Data NEC PCIe SSD Appliance for Microsoft SQL Server Web site Blog SMS Data Scientist SQL Server 2014 Analysis Services Smart Device Page 27 NEC Corporation 2014

28 NEC brings together and integrates technology and expertise to create the ICT-enabled society of tomorrow. We collaborate closely with partners and customers around the world, orchestrating each project to ensure all its parts are fine-tuned to local needs. Every day, our innovative solutions for society contribute to greater safety, security, efficiency and equality, and enable people to live brighter lives. Page 28 NEC Corporation 2014

29 Page 29 NEC Corporation 2014