Revolutionizing Data-Centric Transformation

Transcription

1 2016 OpenPOWER Foundation Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta Vice President, High Performance Computing and Analytics IBM Power Systems

2 OpenPOWER: Catalyst for Open Innovation Market Shifts Processors Not Keeping up with Workload Performance Needs Numerous IT consumption models Fast Growing Open Software Ecosystem OpenPOWER Strategy Vibrant ecosystem through open collaborative, development Accelerated innovation through collaboration of partners Accelerators for driving industry performance leadership Cloud Computing Hyperscale & Large scale Datacenters High Performance Computing & Analytics Domestic IT Agendas 2

3 3 OpenPOWER Development Community

4 200+ OpenPOWER Members 4

5 Fast Progress Leading to 200+ Members April Public launch in San Francisco and Beijing with 6 demos and first hardware from Google and Tyan 26 members October Offerings from Canonical, IBM, NVIDIA, OVH, Redis Labs, and Tyan 70 members November DoE chose OpenPOWER design for CORAL supercomputers; Nallatech CAPI developer kit released 77 members March First OpenPOWER Summit 50+ presentations and solution demos 15 hardware reveals 100+ projects 112 members June 313m UK collaboration with STFC; 630+ attendees at China OP Summit 136 members November 46 member solutions at SC15, numerous accelerated computing announcements 170+ members December Incorporated Foundation and elected officers 5 members July IBM, with Google, released 420,00 lines of firmware code 44 members October China gov endorsed OP with formation of China Power Tech Alliance 70 members December Rackspace declares Open Compute, OpenPOWER strategy; 7 work groups chartered 84 members March SoftLayer announces 1st OpenPOWER bare metal as a service offering 112 members May Chartered nine work groups; Member solutions unveiled at 6k attendee IT event 130 members September GENCI OpenPOWER HPC investment; chartered 11 workgroups; 1600 ISVs developing Linux on POWER 153 members 5

6 New Chips & Components DMI connection between an Altera Stratix V FPGA accelerator and a POWER8 CPU Convey s CAPI developer kit based on the company s Xilinixbased co-processors First China local POWER derivative chip, CP1 Components & Systems First commercially available OpenPOWER third-party server New CAPI-based solution: the ConnectX-4 adapter card by Mellanox Nallatech s OpenPOWER CAPI Developer Kit New Systems & Platforms First Open server specification and motherboard combining OpenPOWER, Open Compute and OpenStack (mock-up) First GPU-accelerated OpenPOWER developer platform Prototype of a new high-performance server on the path to exascale First commercially available OpenPOWER server RedPower, the first China OpenPOWER 2-socket system coming in 2015 Inspur 2-socket POWER8 Server ChuangHe China-branded OpenPOWER system with POWER8 Data Engine for NoSQL with 40TB CAPI-attached flash Bringing It All Together Clustering Open Source Redis 192 Vcores + CAPI 40TB in 2U 24:1 Server consolidation for 3x lower cost per user 6

7 11 Workgroups Evolving Infrastructure Standards 11 Work Groups Personalized Medicine Integrated Solutions System SW 25g IO Compatibility Charter Charter Charter CAPI Linux SDK 64b ABI Platform Ref 25g IO Spec Charter Pers Med Integrated Solutions OpenPOWER I/O Charter Sys I/O Enablement Guide Accelerator Charter CAPI AFU Intf Spec V1 OpenCL SDK CAPI AFU Intf Spec V2 Memory Charter OPMB Intf. Spec V1 FSI Specification Charter FSI Spec Developer Platform Charter P8 SP010 Data P8 2U2S Reference P8+ 1U1S Reference P8+ 2U2S Reference HW Architecture Charter OpenPOWER ISA Profile V1 IO Device Architecture V2 Coherent Accel Intf Arch OpenPOWER ISA Profile V2 IO Device Architecture V3 Coherent Accel Intf Arch Compliance Charter Compliance Specification Draft Review WG Spec Comp STD 7 SP010 Tyan OpenPOWER Customer Reference System CAPI Coherent Accelerator Processor Interface AFU Accelerator Function Unit FSI Field Replaceable Unit (FRU) Service Interface OPMB OpenPOWER Memory Bus ABI Application Binary Interface SDK Software Developer Kit

8 OpenPOWER Foundation reach 200+ members 50+ Innovations 24 countries 6 continents 8

9 OpenPOWER Open Software and University Cloud Environments Oregon State North America UNICAMP Brazil, SA cloud/index.html SuperVessel USA and China OpenPOWER Platforms Open Stack Software University research Open Development & Ecosystem Support Brno University / RedHat. Czech Republic IIT Bombay, India HPC Center University of Texas- TACC 9

10 OpenPOWER Developer Ecosystem Growing Fast

11 OUTCOME ACTION INTEREST Engage in the OpenPOWER community Technology and Software Innovators Innovators, Integrators, and Partners End Users Discuss areas of collaboration and synergy in OpenPOWER. Sign up for membership and join a work group. Build technical and business relationships. Deep understanding of workload demands and consumption preferences of end users. Team with innovators and end users to drive requirements, engage in specific projects. Strategic imperatives and workload demands for performance and cost optimization. Require open software and systems with choice and flexibility. Engage directly on system design options. Develop collaborative innovations with compelling value Deliver collaborative innovations with compelling value Deploy collaborative innovations with compelling value 11

12 12 OpenPOWER For Data Analytics and High Performance Computing

13 POWER8: Processor Performance Leadership Faster Cores 8 Threads Per Core Larger Caches Direct Accelerator Interconnect 3x Higher Memory Bandwidth, 1 TB Memory per Socket 13 DRAM Chips Memory Buffer POWER8 12 Cores, 96 Threads 4 Level Large Caches Up to 1 TB per socket Up to 230 GB/s sustained

14 NVLink 40 GB/s 2.5x Faster CPU-GPU Connection via NVLink Graphics Memory GPU Graphics Memory PCIe 16 GB/s System bottleneck CPU System Memory GPU GPU POWER8 System Memory Graphics Memory GPUs Limited by PCIe Bandwidth From CPU-System Memory NVLink Enables Fast Unified Memory Access between CPU & GPU Memories 14

15 US & UK Research Establishments Select OpenPOWER-Based Supercomputers IBM, Mellanox, and NVIDIA awarded $325M U.S. Department of Energy s CORAL Supercomputers CORAL: Leadership Class Supercomputers 5X 10X HIGHER APP PERF THAN CURRENT SYSTEMS IBM & UK s STFC Partner for Big Data & Cognitive Computing Research in 313M Partnership 15

16 3x Lower Cost for NoSQL Databases using CAPI-Attached Flash Before: NoSQL In-Memory (x86) After: NoSQL POWER8 + CAPI Flash Load Balancer 500GB Cache 500GB Node Cache 500GB Node Cache 500GB Node Cache 500GB Node Cache Server Node 24U POWER8 Server CAPI Device Flash Array w/ up to 40TB 4U Backup Nodes Flash Acts As Extension of System Memory

17 17 Application Benchmarks

18 Compelling Solution Performance on Power Data Engine for NoSQL with Redis Labs Turbo LAMP on Linux on Power MariaDB on Linux on Power SAP HANA on Linux on Power POWER8 + CAPI FLASH as RAM 24:1 server consolidation Up to 3x lower TCA Next generation integrated LAMP stack Accelerated Dev/Ops for Mobile Apps 53% less $$ per user / hour with Magento running on Turbo LAMP Up to 2.2x better per core performance Up to 1.9x better per system performance Designed for mission critical 7X24 Enterprise customer operations Outstanding throughput per core Virtualization out of the box 18

19 GPUdb in-memory Accelerated Database Ultrafast ingest and analysis of billions of objects In-memory distributed database using GPUs for processing Order of magnitude gains: Performance over CPU solutions Power reduction Cost savings Anticipate order of magnitude gains with POWER based NVLink solutions in

20 Over 2350 Linux ISVs on Power 100,000+ Open-Source Packages CHARMM GROMACS NAMD AMBER RTM GAMESS WRF HYCOM HOMME LES MiniGhost AMG2013 OpenFOAM HPC minidft CTH BLAST Bowtie BWA FASTA HMMER GATK SOAP3 STAC-A2 SHOC Graph500 Ilog Cloud Big Data & Machine Learning Mobile Enterprise Major Linux Distros 20

21 Superior Cloud Economics SoftLayer Bare Metal POWER cloud Rackspace declares Open Compute OpenPOWER system Docker, OpenStack HEAT, and Chef Server for Power Bluemix Cloud Integration and SQLDB Services with Power Systems for SOE/SOR integration Power Cloud environments in Europe IBM Watson Developer s Cloud for cognitive computing 21

22 New IBM LC Power Systems for Linux 822LC HPC 822LC CPU CPU Memory GPU GPU CPU CPU Memory 2x POWER8 CPU 10 cores each, GHz Up to 1 TeraByte Memory 230 GB/s Memory Bandwith 2x NVIDIA Tesla K80 GPUs 2x POWER8 CPU 10 cores each, GHz Up to 1 TeraByte Memory 230 GB/s Memory Bandwith 2 Drives (2 TB, HDD, SSD) Built for HPC and Deep Learning Optimized for Databases and Cloud Workloads 812LC CPU Memory 1x POWER8 CPU 10 cores, GHz Up to 1 TeraByte Memory 115 GB/s Memory Bandwith 14 Drives (84TB, HDD, SSD) Optimized for Hadoop, Spark, In-Memory Analytics

23 Leading Technology roadmap Mellanox Interconnect Connect-IB FDR Infiniband PCIe Gen3 ConnectX-4 EDR Infiniband CAPI over PCIe Gen3 ConnectX-5 Next-Gen Infiniband Enhanced CAPI over PCIe Gen4 NVIDIA GPUs Kepler PCIe Gen3 Pascal NVLink Volta Enhanced NVLink IBM CPUs POWER8 OpenPower CAPI Interface POWER8 with NVLink NVLink POWER9 Enhanced CAPI & NVLink IBM Systems OpenPOWER Foundation

24 Portfolio of HPC & HPDA Offerings Processors & Systems High Performance Processors & Systems Accelerator, networking, storage integration via CAPI & NVLink Innovative solutions like CAPI Flash Cluster & Development Software Platform LSF & Symphony workflow and resource management Compilers: gcc, IBM XLC, PGI Fortran/C/C++, Java, OpenACC, OpenMP Debuggers, Profilers, Math libraries, MPI & HPC apps High Performance File System & Storage Highest Performance HPC Storage: Elastic Storage Server High Performance Spectrum Scale (GPFS) Parallel File System Flash Storage 24

25 Join the conversation at #OpenPOWERSummit Two tracks to challenge and win: 1. The Open Road Test Port and optimize for OpenPOWER Go faster with accelerators (optional) 2. The Spark Rally Train accelerated DNN and recognize objects with greater accuracy Show you can scale with Spark Key Dates Register at openpower.devpost.com Sun May 1 st : Submission periods opens Tue Aug 2 nd : Submission period closes Grand prizes include a trip to Supercomputing 2016 Other prizes include ipads, Apple Watches

26 26 Thank you.