Andrzej Jakowski, Armoun Forghan. Apr 2017 Santa Clara, CA

Transcription

1 Andrzej Jakowski, Armoun Forghan Apr 2017 Santa Clara, CA

2 Legal Disclaimers Intel technologies features and benefits depend on system configuration and may require enabled hardware, software or service activation. Learn more at intel.com, or from the OEM or retailer. No computer system can be absolutely secure. Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. Cost reduction scenarios described are intended as examples of how a given Intel-based product, in the specified circumstances and configurations, may affect future costs and provide cost savings. Circumstances will vary. Intel does not guarantee any costs or cost reduction. This document contains information on products, services and/or processes in development. All information provided here is subject to change without notice. Contact your Intel representative to obtain the latest forecast, schedule, specifications and roadmaps. No license (express or implied, by estoppel or otherwise) to any intellectual property rights is granted by this document. Intel does not control or audit third-party benchmark data or the web sites referenced in this document. You should visit the referenced web site and confirm whether referenced data are accurate. Intel, 3D XPoint, Xeon, and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries. *Other names and brands may be claimed as the property of others Intel Corporation. 2

3 Agenda Introduction Intel CAS Overview & Benefits Ceph* Use Cases Swift* Use Cases Intel CAS with Intel Optane SSDs Summary *Other names and brands may be claimed as the property of others. 3

4 New Data Centers & Software-Defined Storage New storage architectures (commodity hardware and open source software solutions) Storage SW Acceleration Data Analytics Cloud Storage Orchestrated Data Center Software-Defined Storage Converged Infrastructure Flexible, cost effective solutions to drive valueadd and differentiation DPDK/SPDK Storage Libraries (ISA-L) Ceph*, Swift* Hadoop*, Lustre* Intel CAS Rack Scale Multi-Core Processor Memory SSD NVM Quick Assist I/O Bandwidth Networking *Other names and brands may be claimed as the property of others. 4

5 The Problem: Software has Become the Bottleneck 100% 80% Hardware vs. Software Latency Historically, storage media was many orders of magnitude slower than software and memory 60% 40% 20% 0% 7200 RPM RPM SATA NAND Enterprise NAND Drive Read Latency Intel Optane SSD Software Overhead 3D XPoint 3D XPoint memory media approaches DRAM latencies, blurring the lines between storage media and memory latency Storage software stacks optimized for efficiency on spinning disks will obscure the value of new storage media The Opportunity: Optimize for new storage technologies Disclaimer: Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. 5

6 Intel CAS: Cost-Effective Way to Benefit from NVM Technology Intel Data Center SSD P3700/P3600 S3700 Intel Cache Acceleration Software (Intel CAS) Up to 1400x IOPS 1 3x OLTP 2 57x OLAP 2 Quickly Improve Application SLA No Application Modification No External Storage Modification 1. Configuration used: Intel Server model 2600GZ (Grizzly Pass); Dual Intel E processor (2.7GHz), 32GB memory; Seagate* ST1000NC000 SATA HDD Microsoft* Windows 2012R2 SP1, Intel SSD DC P GB, Intel CAS 2.6 release, L2 cache on; IOmeter ; 4K Random Read test; 8-queue depth x 8 workers 2. Configuration used: Intel server model 2600GZ (Grizzly Pass); Dual Intel Xeon E processor (2.7GHz), 96GB DDR3, VMware* 5.5, Intel SSD DC P GB, Intel CAS 2.6, L2 cache off, 8x Seagate 146GB SAS in RAID5, VMs: Microsoft* Server 2008R2, 8GB, 2 Cores, IOMeter workloads: Media Player, Exchange Server, Web Server, 4K OLTP using QD4.1 worker *Other names and brands may be claimed as the property of others. 6

7 Intel CAS Linux* Overview Features Caching approach featuring I/O classification The ability to selectively cache I/O by size & type Improves I/O efficiency overall -> spinning disks remain spinning for large data blocks Intel CAS Architecture Write-Back Mode (Other modes: WT, WA, PT) Application Writes Initial Read Subsequent Reads 2 Read & write caching addresses I/O bottlenecks Intel CAS 3 Selectable cache line sizes 1 In-flight upgrades Multi-Level caching for added performance Accelerate Your Data Center Without Application or Infrastructure Changes *Other names and brands may be claimed as the property of others. Backend Storage (HDD) Cache (SSD) 1. Data is read from backend storage and copied to the cache partition on the SSD 2. All writes are completed at SSD speeds 3. Subsequent reads of cached data are returned at highperformance SSD speed 4. Dirty data is written opportunistically to backend storage 7

8 Intel CAS Linux* Benefits & Recent Features In Flight Upgrade Capability: Enables SW upgrade w/o impacting application/service availability Selectable Cache Line Size: Reduces DRAM footprint via increased cache block size Improved cost efficiency Optimized for low latency medium Intel Optane SSD I/O path in the SW is optimized for the latest, next gen storage -> Intel Optane SSD *Other names and brands may be claimed as the property of others. 8

9 Intel CAS Linux* Telemetry Information Performance counters: Cache usage statistics I/O request statistics Block statistics Health information: Number of I/O errors on SSD, primary storage Ability to export data to tabular and CSV formats Option to drill-down: per cache, per primary store, per I/O-class Enables performance analysis & tuning 9

10 Intel CAS Linux* I/O Classes Ability to apply different I/O processing policies based on the type of I/O Operator defines policies for I/O classes SW detects I/O class and enforces the policy Possibility to control eviction priority and cache insertion Benefits Improved cache space usage Improved cost-effectiveness *Other names and brands may be claimed as the property of others. CAS I/O Classes Unclassified Filesystem metadata (SB, inode, directory) <=4KiB <=16KiB <=64KiB <=256KiB <=1MiB <=4MiB <=16MiB <=64MiB <=256MiB <=1GiB >1GiB O_DIRECT MISC 10

11 Software Defined Storage: Ceph*/Swift* Industry Challenge Software Defined Storage Challenge Standard industry architectures result in high latency, low throughput, and limited flexibility for specific workloads Continuous Storage Acquisitions Large number of metadata from Replication or Erasure Coding Small random files create large performance issues for spinning drives Regulatory need to store data Gateway/proxy bottlenecks Must Meet Customer SLAs I/O bottlenecks due to expanding apps 11

12 Ceph* Challenges: (Yahoo!* Use Case) Environment & Problem Yahoo* Mail, Flickr*, and Tumblr* storage requirements (cold, warm, hot data) Cost-effective solution to meet user SLAs Technology Benefits Cost reduction by less overprovisioning Improved deployment with more predictable & less varied latencies Ceph cluster performance: >2X throughput & <½ the latency 1 Solution Intel CAS + NVMe* SSDs An Intel DC SSD with NVMe* and Intel CAS utilizes a tunable and selective I/O classification caching approach increasing storage cluster performance while saving cost. 1 Based on internal Yahoo measurements, Using a 600 OSD Ceph* cluster, 3PB storage, erasure coding 8+3 (Ten) 8T SATA disk, 1MB object size, Intel CAS 3.0, Intel P TB NVMe* SSD, single reads and writers. Testing done with and without Intel CAS/SSD components. Each OSD node in the cluster contained: SERVER:HP ProLiant DL180 G6 yspec 39.5; CPU:2x Intel Xeon X GHz (HT enabled, total 12 cores, 24 threads); NETWORK: (2) HP NC362i/Intel Gigabit, (2) Intel 82599EB 10Gbe; OS:RHEL 6.5, kernel el7. The Intel CAS 3.0 configuration added an SSD to each node in the system: SSD:(1)1.6TB Intel P3600 SSD (10GB journal per OSD, 1.5TB cache). *Other names and brands may be claimed as the property of others. 12

13 Swift* Challenges: Environment & Problem Large amount of file system metadata required for reading & writing objects Replication processes are time consuming & require intensive use of metadata Technology Benefits Swift cluster performance: >3x throughput & <½ the latency 1 Swift replication performance > 5x (ex. 29hrs decreased to 5hrs. ) 1 Solution Intel CAS + NVMe* SSDs Cache filesystem metadata to eliminate inefficient disk accesses Improve replication by caching the Swift* replication metadata and hash files 1 Based on internal Intel measurements, Using a 15 node Swift* cluster with replication, 8x 2T SATA disks, 64k to 1MB object sizes, Intel CAS using one Intel SSD DC P3520 Series 1TB with NVMe*. Testing done with and without Intel CAS/SSD components. Each storage node server in the cluster; CPU:2x Intel Xeon E (2.3 GHz, 18 cores, 45MB cache); NETWORK:2x Intel X540 & 2x Intel X520 10Gbe; OS:Ubuntu , kernel generic, Swift trusty & controller *Other names and brands may be claimed as the property of others. 13

14 Validated Solution: Apache Hadoop* with Ceph* Storage Optimized proof-of-concept (POC) has been built by Intel and QCT Disaggregate storage and compute in Hadoop* by using Ceph* storage instead of direct-attached storage (DAS) Optimize performance with Intel CAS and Intel SSDs using NVMe* Resolve input/output (I/O) bottlenecks Provide better customer service-level-agreement (SLA) support Provide up to a 60- percent I/O performance improvement 2 * * HDFS replication 1, Ceph* replication 2 Based on Intel & QCT measurements, Using an 8 storage node Ceph* cluster with replication, each with 24x6T SATA disks, 2x Intel SSD DC P3700 Series, CPU: Intel Xeon E (2.5 GHz, 12 cores, 30MB cache), NETWORK:2x Intel X Hadoop* data nodes using Ceph* RBD for storage, with CPU: Intel Xeon E (2.6GHz, 12 cores, 30MB cache), NETWORK:2x Intel X540. Testing done with and without Intel CAS/SSD components. OS: Ubuntu 14.04, Ceph Hammer*.94, Cloudera* CDH 5.7, Intel CAS 3.0 *Other names and brands may be claimed as the property of others. 14

15 Intel Optane SSD DC P4800X Series Low Queue Depth Performance vs. Intel SSD DC P /30 Mixed up to 8x faster Random Read Random Write up to 10x faster up to 3x faster Quality of Service vs. Intel SSD DC 70/30 1 Responsiveness Under Load vs. Intel SSD DC P MB/s write pressure 400MB/s write pressure 600MB/s write pressure Form Factors and Capacities Form Factor Capacity Availability 375GB up to 12.5x faster up to 25x faster up to 35x faster Initial Mar 19, broad 2H 99% QoS up to 60x better AIC 750GB Initial Q % QoS up to 77x better 1.5TB 2H 375GB Initial Q2 U.2 750GB Initial Q2 1. Common Configuration - Intel 2U PCSD Server ( Wildcat Pass ), OS CentOS 7.2, kernel el7.x86_64, CPU 2 x Intel Xeon E GHz (22 cores), RAM 396GB 2133MHz. Intel Optane Configuration Intel Optane SSD DC P4800X 375GB. NAND Configuration Intel SSD DC P GB. Performance measured under 4K workload at QD1-16 using fio QoS measures 99% QoS under 4K workload at QD1 using fio Latency Average read latency measured at QD1 during 4K Random Write operations using fio Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. 1.5TB 2H 15

16 Intel Optane SSD + Intel CAS Faster Transactions in MySQL* Sustained performance under load accelerates large batch Queries per Second Accelerating All-Flash Database Storage with Intel Optane SSD and Intel CAS Time to Complete 1 Million Transactions in MySQL Intel SATA SSD RAID w/ Intel Optane SSD + Intel CAS Intel SATA SSD RAID up to workloads x faster results Time (s) *Other names and brands names may be claimed as the property of others 1. System configuration - Intel Server System R2208WT2YS, 2x Intel Xeon E5 2699v4, 128 GB DDR4 DRAM, boot drive- 1x Intel SSD S3500 Series (240GB), database drives- 3x RAID 5 Intel SSD S3520 Series (1.6 TB) with 1x Intel RAID Controller RS3DC080, cache drive- Intel SSD DC P4800X Series (375 GB), CentOS 7.3, MySQL Server , Sysbench 0.5 configured for 70/30 R/W OLTP transaction split using a 1500GB database. 16

17 Summary & Call to Action Intel CAS: Performance: Optimized for the latest storage technologies Intel Optane SSD Shows significant improvement (2x throughput & ½ latency) in SDS solutions Compelling features: I/O classification Robust installation and SW upgradability Call to Action: Download Intel CAS free 120 day trial software and try it out today! 17

18