Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme

Transcription

1 FUT3056BU VMware vsphere Scales on the Amazing Next-Gen Intel Xeon Architecture VMworld 2017 Content: Not for publication Tom Adelmeyer, Richard A. Brunner, Principal Engineer, Intel Principal Engineer, VMware #VMworld #FUT3056BU

2 Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitment from VMware to deliver these features in any generally available product. Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind. Technical feasibility and market demand will affect final delivery. Pricing and packaging for any new technologies or features discussed or presented have not been determined. #FUT3056BU CONFIDENTIAL 2

3 Agenda 1 Introduction to the Intel Xeon Scalable Processor 2 Modernize Your Datacenter 3 Simplify Your Datacenter 4 Accelerate Your Datacenter 5 Summary #FUT3056BU CONFIDENTIAL 3

4 July 2017: Intel Xeon Scalable platform Supported now by VMware vsphere 6.0.u3 and vsphere 6.5 Modernize TCO / Security Simplify Deployment / Provisioning Accelerate Compute, Storage, and Network Delivers 1.65x average performance boost over prior Generation 1 1 Up to 1.65x Geomean based on Normalized Generational Performance going from Intel Xeon processor E5-26xx v4 to Intel Xeon Scalable processor (estimated based on Intel internal testing of OLTP Brokerage, SAP SD 2-Tier, HammerDB, Server-side Java, SPEC*int_rate_base2006, SPEC*fp_rate_base2006, Server Virtualization, STREAM* triad, LAMMPS, DPDK L3 Packet Forwarding, Black-Scholes, Intel Distribution for LINPACK Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more information go to Intel does not control or audit the design or implementation of third party benchmark data or Web sites referenced in this document. Intel encourages all of its customers to visit the referenced Web sites or others where similar performance benchmark data are reported and confirm whether the referenced benchmark data are accurate and reflect performance of systems available for purchase.. Configurations: see slides 32, 33 #FUT3056BU CONFIDENTIAL 4

5 Intel Processor Development* Thurley Platform Nehalem 45nm New Microarchitecture Westmere 32nm New Process Technology Romley Platform Intel Xeon Processor Sandy Bridge 32nm New Microarchitecture Ivy Bridge 22nm New Process Technology Grantley Platform Haswell 22nm New Microarchitecture Broadwell 14nm New Process Technology Purley Platform Intel Xeon Scalable Processor Skylake 14nm New Microarchitecture Rapid Technology Innovation * Source: Intel, edited by VMware #FUT3056BU CONFIDENTIAL 5

6 Day 0 Support by VMware vsphere 6.0.u3, 6.5.ga, and vsan 6.2 and 6.6 Intel Xeon Platinum 8100 Intel Xeon Gold 6100/5100 Intel Xeon Silver 4100 or Intel Xeon Bronze 3100 distribution #FUT3056BU CONFIDENTIAL 6

7 Intel Xeon Scalable Processor Re-architected from the Ground Up (Code name Skylake-SP ) 6 Channels DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 DDR4 48 Lanes PCIe* 3.0 Shared L3 Omni-Path HFI 2 or 3 UPI DMI3 UPI UPI UPI Omni-Path Intel AVX-512 with 32 DP flops per core Data center optimized cache hierarchy: 1MB L2 per core, non-inclusive L3 New mesh interconnect architecture Enhanced memory subsystem Features Intel Xeon Processor E v4 Intel Speed Shift Technology Optional Integrated Intel Omni-Path Fabric (Intel OPA) Modular IO with integrated devices Intel Xeon Scalable Processor s Per Socket Up to 22 Up to 28 Threads Per Socket Up to 44 threads Up to 56 threads Last-level Cache Up to 55 MB Up to 38.5 MB (non-inclusive) QPI/UPI Speed (GT/s) 2x QPI 9.6 GT/s Up to 3x 10.4 GT/s PCIe* Lanes/ Controllers/ Speed(GT/s) Memory Population 40 / 10 / PCIe* 3.0 (2.5, 5, 8 GT/s) 4 channels up to 3 RDIMMs, LRDIMMs, or 3DS LRDIMMs 48 / 12 / PCIe 3.0 (2.5, 5, 8 GT/s) 6 channels up to 2 RDIMMs, LRDIMMs, or 3DS LRDIMMs Max Memory Speed Up to 2400 Up to 2666 TDP (W) 55W-145W 70W-205W 7

8 Breakthrough CPU Design: Intel Mesh Architecture Ring Architecture Mesh Architecture Maximizes performance Enables consistent, low latencies Optimized for data sharing and memory access between all CPU cores/threads for ideal memory bandwidth and capacity Data flows scale efficiently for 2, 4 & 8+ socket configurations Designed for modern virtualized and hybrid cloud implementations Designed for next-generation Data Centers 8

9 Intel Mesh Architecture: Distributed Caching Home Agent Intel UPI caching and home agents are now distributed with each LLC bank Distributed CHA benefits Reduces traffic on mesh by eliminating home agent to LLC interaction Reduces latency by launching snoops earlier; obviates need for different snoop modes DIMM0 DIMM0 DIMM0 DIMM1 DIMM1 DIMM1 UPI 0/1 CHA / IMC 0 PCIe-2 (x16) CHA / CHA / PCIe-3 (x16) CHA / CHA / DMI Mesh Stop CHA / CHA / Mesh Stop CHA / CHA / PCIe-3 (x16) CHA / IMC 1 DIMM1 DIMM1 DIMM1 LLC: MB CHA DIMM0 DIMM0 DIMM0 (10-core, 2 UPI Example) Source: Intel 9

10 Re-Architected L2 & LLC (Last-Level) Cache Hierarchy L2 (256KB private) Previous Architectures Shared LLC 2.5MB/core (inclusive) L2 (256KB private) L2 (256KB private) Intel Xeon Scalable Processor L2 (1MB private) Shared LLC 1.375MB/core (non-inclusive) L2 (1MB private) On-chip cache balance (Previous) shifted from shared-distributed (Skylake-SP): Shared-distributed shared-distributed LLC is primary cache Private-local private L2 becomes primary cache with shared LLC used as overflow cache VMworld 2017 Shared LLC changed from inclusive to non-inclusive: Inclusive (prior architectures) LLC has copies of all lines in L2 Non-inclusive (Skylake architecture) lines in L2 may not exist in LLC Skylake-SP cache hierarchy architected specifically for Data center use case L2 (1MB private) Content: Not for publication 10

11 Modernize Your Datacenter

12 Modernize Your Datacenter: Lower Operational Expenses Considerations Deployment ease Server utilization Energy costs Space Up to 4.2x more VMs per server compared to 4 year old server1 Up to 65% lower total cost of ownership2 Support More Virtual Machines Per Server 4-5 Year Old System Intel Xeon processor E [Sandy Bridge: Launch Q1 12] 4.2 : 1 consolidation 1 Upgrading from a 4 year old server to the Intel Xeon Scalable processor VMworld 2017 Reduced software and OS licensing fees, acquisition, maintenance and infrastructure costs Intel Xeon Platinum 8180 processor Content: Not for publication #FUT3056BU CONFIDENTIAL 12

13 Modernize Your DC w/ Intel Solid State Drives New For Intel Xeon Scalable Processors Intel SSD DC S3700 Series 3D NAND New line of Intel 3D NAND SATA SSDs with the same rock-solid reliability, enterprise RAS features, and consistent performance Intel SSD DC P4600 Series Packed with a deep feature set, Intel 3D NAND SSDs for data centers are optimized for the data caching needs of cloud storage and softwaredefined infrastructures. INTEL SOLID-STATE DRIVE 3D NAND TM Intel Optane SSD DC P4800X Series 3D XPoint Technology Intel Optane SSDs help eliminate data center storage bottlenecks and allows bigger, more affordable data sets. Its can accelerate applications, and reduce transactions costs for latency sensitive workloads TM #FUT3056BU CONFIDENTIAL 13

14 The Right Solution with Intel SSDs Data Tiers Memory Expansion Caching & Fast Storage Mainstream Storage DRAM + Intel Optane SSD Intel Memory Drive Technology SW Intel Optane SSD DC P4800X Intel SSD DC P4600 Series Dual Port versions of the Intel Data Center SSD family for PCIe Intel SSD DC P4500 Series Dual Port versions of the Intel Data Center SSD family for PCIe Solution Bigger memory for new insights from larger working sets New caching or fast storage tier for the most latency sensitive applications Accelerate cache tier and mixed workloads for faster results and increased storage scaling Hot tier and mixed workloads for Enterprise High Availability Storage Solutions High performance, massively scalable storage Enterprise High Availability Storage Solutions #FUT3056BU CONFIDENTIAL 14

15 Secure your DC with Intel Trusted Execution Technology (Intel TXT) 2. Hypervisor measure does not match 3. Policy action enforced, known untrusted POSSIBLE EXPLOIT! + Server with TPM/Intel TXT 1. System powers on and Intel TXT verifies BIOS/OS MATCH! APPS + OS 2. Hypervisor measure matches 3. OS and applications are launched, known trusted System boot stack gets cryptohashed before execution Hash values get safely stored in a Trusted Platform Module (TPM) Match to known-good values determines system trust status One-Touch Activation: OOB TXT/TPM remote discovery, enablement, activation independent of OEM/OS NEW #FUT3056BU CONFIDENTIAL 15

16 Simplify Your Datacenter

17 Simplifying Deployment For any specific workload or application that I manage.? What are the best hardware and software components to deploy? How do I get everything integrated and working well together?? How can I go faster??? How do I optimize and tune settings for best performance? What happens when something changes?? #FUT3056BU CONFIDENTIAL 17

18 Simplify Deployment with Intel Select Solutions Intel Select Solutions for VMware vsan Simplified evaluation Fast & easy to deploy Workload optimized Tightly-specified HW and SW components, eliminating guesswork Pre-defined settings and systemwide tuning, enabling smooth deployment Designed and benchmarked to perform optimally for specific workloads All Intel Select Solution configurations and benchmark results are verified by Intel Visit #FUT3056BU CONFIDENTIAL 18

19 Accelerate Your Applications

20 Delivering Performance Beyond Benchmarks #FUT3056BU CONFIDENTIAL 20

21 Intel Advanced Vector Extensions-512 (AVX-512) double *x,*y, *z; for (i=0; i<n; i++) { z[i] = x[i] + y[i]; } AVX-512 (512-bit) x7 x6 x5 x4 x3 x2 x1 x0 AVX-512 performance: + y7 y6 y5 y4 y3 y2 y1 y0 = AVX (256-bit) SSE (128-bit) x7 + y7 x6 + y6 x5 + y5 x4 + y4 x3 + y3 x2 + y2 x1 + y1 x0 + y0 Vectorized loop using SSE, AVX, and AVX Achieves more work per cycle (doubles width of data registers versus Prior CPU) Minimizes latency & overhead (doubles the number of registers) 2x FMA processing engines are available on Intel Xeon Platinum and Intel Xeon Gold VMworld 2017 Family Skylake Haswell / Broadwell Instruction Set Intel AVX-512 & FMA SP FLOPs / cycle DP FLOPs / cycle Intel AVX2 & FMA Sandybridge Intel AVX (256b) 16 8 GFLOPs Nehalem SSE4.2 (128b) 8 4 Accelerates performance for demanding computational tasks LINPACK Performance Content: Not for publication SSE4.2 AVX AVX2 AVX512 Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. (1) Source as of June 2017: Intel internal measurements on platform with Xeon Platinum 8180, Turbo enabled, UPI=10.4, SNC1, 6x32GB DDR per CPU, 1 DPC 21

22 VMmark 3.0 Improvement VMmark 3.0 Results Xeon ~19% Improvement From Previous Xeon For two very similar high-performance 2-socket servers VMworld 2017 Content: Not for Previous Intel Xeon E5-2699A v4 ~19% VMmark 3.0 Improvement Over New Intel Xeon Platinum 8180 CPU Configuration Intel Xeon Platinum 8180, 2-socket, 56-cores/112-threads, 2.5 GHz Intel Xeon E5-2699A v4, 2-socket, 44-cores / 88-threads, 2.4 GHz publication #FUT3056BU CONFIDENTIAL 22

23 Accelerate VMware vsan with Intel 3D NAND SSDs vsan Node Intel 2D NAND SSDs Server: 2 x Intel Xeon E5 Cache Tier: 2x Intel SSD DC 800 GB Capacity Tier: 8x Intel SSD DC 2TB Transition to Intel 3D NAND SSDs vsan Node Intel 3D NAND SSDs Server: 2 x Intel Xeon E5 Cache Tier: 2x Intel SSD DC 1.6 TB Capacity Tier: 8x Intel SSD DC 4TB Increase Storage Capacity Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more complete information visit System Configuration: 4 Node vsan* Cluster. Per Node configuration: Supermicro* SuperServer 2028U-TN24R4T+ Dual Intel Xeon E5-2687Wv4 3.0 Ghz), Supermicro* Server Board, 256 GB DDR4 RAM, Boot Drive, 1x Intel SSD DC S3710 Series (200 GB, 2.5 ), vsan Intel 3D NAND Cluster: Virtual SAN SSDs - 2 Disk Groups comprised of 2x Intel SSD DC P4600 Series (1.6TB, 2.5 SFF), 8x Intel SSD DC P4500 Series (4 TB, 2.5 SFF), vsan Intel 2D NAND Cluster: Virtual SAN SSDs - 2 Disk Groups comprised of 2x Intel SSD DC P3700 Series (800GB, 2.5 SFF), 8x Intel SSD DC P3500 Series (2 TB, 2.5 SFF), Intel Ethernet Server Adapter X540-DA2 up to 2x Increase IOPs up to 63% Increased Storage Capacity & Efficiency with Lower Cost up to 6% Lower Cost/GB #FUT3056BU CONFIDENTIAL 23

24 Intel S2600WF (Wolf Pass) 4 Occulinks for NVMe U.2 drives Per-socket: 2 Memory Controllers, 6 Memory Channels 12 DIMM slots Intel Purley Design Recommendation: Support a minimum of four U.2 NVMe SSDs in cabled PCIe topology directly from CPU #FUT3056BU CONFIDENTIAL 24

25 Intel Skylake-SP Volume Management Device (VMD) PCIe Config Errors & Events NVMe SSD vsphere Storage Interface PCIe Config Intel VMD Driver PCIe Domain Mgmt NVMe SSD Block I/O Intel VMD HW NVMe SSD Switch I/O Intel NVMe Driver vsphere Storage Interface NVMe SSD I/O VMD is a mode of the Skylake-SP integrated PCIe Root Complex. It requires a Special VMD Driver. VMD allows vsan to support NVMe Hotplug and LED management VMD intercepts all PCIe hotplug events Hotplug looks like SAS LUN add/subtract LED management uses a script or ESXcli tool vsphere ESXi sees only a VMD PCIe HW RAID device and loads the VMD driver VMD driver for ESXi scans PCI, finds the nvme controllers and enumerate the nvme devices Performed by VMD driver built into NVMe driver VMD driver exposes each NVMe devices namespace as a SCSI LUN on the VMD controller Similar to the LUNs on a SAS controller Only the VMD driver knows how to access the NVMe controller memory and config space #FUT3056BU CONFIDENTIAL 25

26 Intel QuickAssist Technology (Intel QAT) Intel QAT is a set of scalable hardware accelerators first introduced in Intel QAT offers higher performance than software for: Symmetric cryptography functions including cipher operations and authentication operations Public key functions including RSA, Diffie-Hellman, and elliptic curve cryptography Compression and decompression functions including DEFLATE and LZS Intel QAT on Skylake-SP offers outstanding capabilities: 100Gbs Crypto, 100Gbs Compression, 100kops RSA, 2k Decrypt. Offered in two forms: VMworld 2017 Integrated in a SKU of the C620 Series Platform Chipset ( Lewisburg ), and Add-in PCIe card using the same Lewisburg chipset. Chipset Option HOW IS IT OFFERED? PCIe* Card Option Content: Not for publication #FUT3056BU CONFIDENTIAL 26 26

27 Accelerate with Intel QuickAssist Technology RSA 2K Decrypt (kops/s) Security Benchmarks IPSec3 Forwarding (Gbps) Software-based OpenSSL SSL WebProxy (Gbps) 1 1 with Intel QAT 1. NGINX* and OpenSSL* connections/second. Conducted by Intel Applications Integration Team. Claim is actual performance measurement. Intel microprocessor. Processor: Intel Xeon processor Scalable family with C6xxB0 ES2. Performance tests use cores from a single CPU, Memory configuration:, DDR Populated with 1 (16 GB) DIMM per channel, total of 6 DIMMs. Intel QuickAssist Technology driver: QAT1.7.Upstream.L Fedora* 22 (Kernel 4.2.7) BIOS: PLYDCRB1.86B.0088.D Cloudera* with Snappy* Software vs. Intel QuickAssist Technology hardware solution. Conducted by Intel Applications Integration Team. Claim is actual performance measurement. Intel Xeon processor E v4 (56 cores enabled) 256 GB DDR4 1.6 TB NVMe SSD 1 Intel C6xxx-based card (24x). 10 Gbps CentOS* 6.7 w/ kernel Cloudera* 5.4.2; QAT driver Snappy* (popular, fast compression codec); One NameNode Eight DataNodes 10 Gbps network Intel(r) Xeon Scalable Platform Single (UP) Processor configuration. Intel(r) C627 PCH with crypto acceleration capability (in x16 mode) Neon City platform. DDR4 2400MHz RDIMMs 6x16GB(total 96 GB), 6 Channels, 1 x Intel Corporation Red Rock Canyon 100GbE Ethernet Switch in the x16 PCIe slot on Socket 0. 8 cache ways allocated for DDIO. Revision

28 Broad VMware Support For The Intel Xeon Scalable Processor Long History of Collaborating Together VMware vsphere 6.5 and 6.0.u3 provided Day 0 (launch) Support For Servers using the Intel Xeon Scalable Processor. vsphere 6.5 supports using AVX-512 in a Virtual Machine. 56 Server Designs were listed on Day 0 of launch. Currently at 103 Server Designs across 15 Server OEMs vsan 6.6 provided support for Ready Node Models using the Intel Xeon Scalable Processor running VMware vsphere 6.5.u1 and 6.0.u3 30 vsan Ready Node Models listed today #FUT3056BU CONFIDENTIAL 28

29 Summary: Time to Upgrade! Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more information go to Configurations: see slide 35. *Other names and brands may be claimed as the property of others. 29

30

31