IBM Power User Group - Atlanta

Transcription

1 IBM Power User Group - Atlanta Wes Showfety Open Source Database & HPC strategist, North America showfety@us.ibm.com LinkedIn:

2 Two Major New Product Announcements New Chip POWER8 with NVLink New Power LC Linux Servers Novel Embedded NVLink Interface to Tightly Integrate with NVIDIA Tesla s 3 New Linux Servers Built for Big Data, Analytics, Machine Learning, and HPC 2

3 New Power Linux Servers S822LC for High Performance Computing S822LC for Big Data S821LC New POWER8 with NVLink Processor New Tesla P100 with NVLink System Details 2-socket, 2U Up to 20 cores ( Ghz) 1 TB Memory (32 DIMMs) 230GB/sec memory bandwidth 2x SFF (HDD/SSD), SATA Up to 4 integrated NVIDIA Pascal s 3 PCIe slots, 3 CAPI enabled, IB Add-in Air or water cooled System Details 2-socket, 2U Up to 20 cores ( Ghz) 512 GB Memory (16 DIMMs) 115GB/sec memory bandwidth 12 SFF/LFF (HDD/SSD) 96 TB storage 5 PCIe slots, 4 CAPI enabled 2 NVIDIA K80 capable System Details 2 socket, 1U Up to 20 cores ( Ghz) 512 GB Memory (16 DIMMs) 115 GB/sec memory bandwidth 4 SFF/LFF (HDD/SSD), 32 TB Storage 4 PCIe slots, 3 CAPI enabled 1 NVIDIA K80 capable 3

4 250+ OpenPOWER Foundation Members Implementation, HPC & Research Software System Integration I/O, Storage & Acceleration Boards & Systems 4 Chips & SoCs

5 2300+ Linux Applications on POWER HPC Cloud Big Data & Machine Learning Mobile Enterprise CHARMM GROMACS NAMD AMBER RTM GAMESS WRF HYCOM HOMME LES MiniGhost AMG2013 OpenFOAM minidft CTH BLAST Bowtie BWA FASTA HMMER GATK SOAP3 STAC-A2 SHOC Graph500 Ilog Major Linux Distros 5

6 Emerging technologies drive business transformation Analytics Moving to real time +7.6% in customer lifetime value for firms using engagement analytics $226B annual cost of health care fraud Mobile 35% transaction growth driven through mobile annually through 2017 Big Data 2.5 billion gigabytes of data generated every day Cloud 60% of banks process most transactions in cloud by 2016 Intelligent/ Connected Systems 7.9 million in U.S. adopted NFC e-wallets Collaboration 60 million US households conducting P2P payments Security $5.65 million average cost of a security breach in the US

7 Enterprises must learn to Innovate FROM.. TO The Uber syndrome where a competitor with a completely different business model enters your industry and flattens you. Judy Lemke, CIO, Schneider, United States 52% of the Fortune 500 firms since 2000 are gone. R. Ray Wang

8 What does High Performance Computing mean to you? It is no longer limited to the Federal Government and Research Universities. Perception of HPC should be changing a bit Advanced Business Intelligence, Streaming Analytics, Big Data Visualization, Real-Time Fraud Detection Logistics - Inventory Tracking, IoT, Etc When you hear these terms, think HPC...

9 IBM Innovates with POWER8 Designed for Big Data Core, cache and memory design all suited to HPC Matched to markets where HPC and Big Data Intersect: High Performance Data Analytics Life Sciences Oil and Gas/Seismic Processing Machine Learning Business Intelligence Insights at the speed of thought Mem. Ctrl. Cor e L2 L2 Cor e Cor e L2 8M L3 Region L2 Cor e Cor e L2 L2 Cor e SMP Links Accelerators Cor e L2 L3 Cache & Chip Interconnect SMP Links PCIe L2 Cor e Cor e L2 L2 Cor e Cor e L2 Mem. Ctrl. L2 Cor e Processors flexible, fast execution of analytics algorithms Memory large, fast workspace to maximize business insight Cache ensure continuous data load for fast responses Continuous data load Massive IO bandwidth Superior parallel processing Large-scale memory processing How?

10 And that equals MINSKY and the P

11 Tesla P100 accelerator Pascal Architecture NVLink CoWoS HBM2 Page Migration Engine CPU Tesla P100 Unified Memory Highest Compute Performance Compute Memory Interconnect Interconnect for Maximum Scalability Unifying Compute & Memory in Single Package 5.3 TF DP 10.6 TF SP 21.2 TF HP HBM2: 720 GB/s 16 GB NVLink (up to 8 way) + PCIe Gen3 Simple Parallel Programming with Virtually Unlimited Memory Space Programmability Page Migration Engine Unified Memory Availability Ships in IBM 822LC for HPC System: September

12 But its not all about Hardware right??? What s the SOLUTION? Introducing (formerly GIS Federal and db) who have the industry s first -powered full enterprise database and visualization engine for exploring, analyzing, and visualizing petabyte-scale data 100 to 1,000x faster than traditional in-memory data systems. Originally developed as a geospatial and temporal computational engine for the United States Army Intelligence and Security Command (INSCOM), It has the addition of a fully integrated and rich visualization engine, including native geospatial object type support.

13 *** Please click on 30 second Kinetica white board video below. ***

14 Introducing New POWER8 with NVLink Chip First CPU Designed for Accelerated Computing POWER8 P8 CAPI NVLink PCIe High Performance Cores Faster Cores than x86 Fast & Large Memory System Larger Caches Per Core than x86 Fast PowerAccel Interconnects for Accelerators 5x Faster Data Communication between POWER8 & s 14

15 Introducing 822LC Power System for HPC First Custom-Built Accelerator Server with NVLink Custom-built Accelerator Server High-Speed NVLink Connections between CPUs & s and among s Features novel NVIDIA P100 Tesla accelerator NVIDIA P100 Tesla 2.5x Faster CPU- Data Communication via NVLink P8 P8 Minsky POWER8 NVLink Server NVLink 80 GB/s No NVLink between CPU & for x86 Servers: PCIe Bottleneck x86 x86 x86 Servers with PCIe PCIe 32 GB/s 15

16 Detailed Diagram of 822LC for HPC NVLink P100 Memory System Memory POWER8 CPU 115 GB/s NVLink 80 GB/s 80 GB/s P100 P100 P100 NVLink NVLink 720GB/s Memory Memory System Memory POWER8 CPU Up to 0.5 TB 115 GB/s Memory 16GB HBM2 NVLink between CPUs and s enables fast memory access to large data sets in system memory 16

17 Kinetica s CTO on IBM Power servers with NVlink vs. x86 17

18 Kinetica is already seeing a three- to four-times performance increases using Power chips with NVLink as well as significant gains in other areas. Amit Vij CEO & Co-Founder Kinetica Accelerated Database Company 18

19 Kinetica: 10x Faster Relational Database w/ Analytics Retail / Supply Chain Use Case Example Fuse real-time data from multiple sources Point-of-Sale (POS) data Distribution centers inventory Historical buying patterns Demographics What s trending on Twitter Weather data Logistics Use Case Example Delivery route planning Monitor delivery / collection Contingency planning (traffic, accidents, employee sickness) Telcos: Analyze log information from OTA cell phone updates Many more use cases for Finance, Defense, Healthcare, Ad-tech, Insurance, etc. 19

20 High Performance Data Analysis Kinetica Ultrafast ingest and analysis of billions of objects using s Advantage Performance, Cost, Scale Logistics United States Postal Service was billed $100M by Oracle for Exadata and could only get 20% of their 220,000 mail carriers online with real-time Geospatial before it would crash. db does 100% at 95% less cost. Retail Large retailer estimates $3B in lost sales last year due to empty shelves and lost purchase opportunities. They spend $100M on HANA, and could ingest 1B purchase records per hour. With Kinetica they did 4.5-6B records per minute.

21 Performance Leadership Roadmap for HPC / HPDA Mellanox Interconnect Technology Connect-IB FDR Infiniband PCIe Gen3 ConnectX-4 EDR Infiniband CAPI over PCIe Gen3 ConnectX-5 Next-Gen Infiniband Enhanced CAPI over PCIe Gen4 NVIDIA s Kepler PCIe Gen3 Pascal &Tesla NVLink Volta NVLink Next Gen IBM CPUs POWER8 OpenPower CAPI Interface POWER8 with NVLink PowerAccel Interfaces: NVLink, CAPI, PCIe Gen3 POWER9 PowerAccel: Enhanced CAPI, NVLink Next Gen, PCIe Gen IBM Nodes 21

22 Accelerating NoSQL Databases with CAPI-Attached Flash Before: NoSQL In-Memory (x86) 3x Lower Cost After: NoSQL POWER8 + CAPI Flash Load Balancer 500GB Cache 500GB NodeCache 500GB NodeCache 500GB NodeCache 500GB NodeCache Server Node 24U POWER8 Server CAPI Device Flash Array w/ up to 40TB 4U Backup Nodes Flash Acts As Extension of System Memory 22

23 From Technical Computing to Machine Learning High Performance Computing Research + Commercial HPC Seismic Processing Reservoir Simulation Risk Analytics Options Pricing Scientific Research Genomics Accelerated Databases 10x Faster Databases Kinetica, BlazeGraph Logistics Retail Utilities Telcos Finance Defense Machine Learning Deep Learning Computer vision, Speech, NLP Use cases: Retail, Customer Service, Text Analytics 23

24 HPC Pre-Sales Centers and Technical Support PADC centers with IBM, NVIDIA and Mellanox focused on accelerated applications and technical collaborations IBM Systems Client Centers HPC Briefings HPC Workshops HPC Benchmarks UK Science and Technology Facilities Council (STFC) PADC IBM Poughkeepsie POWER HPC Benchmark Center IBM Austin POWER HPC Executive Briefing Center NEW! NVIDIA/IBM Acceleration Lab IBM PADC Boeblingen joint center with NVIDIA IBM PADC Montpellier joint center with NVIDIA and Mellanox For latest HPC information refer to the IBM Systems Client Centers HPC page 24

25 IBM Research Paving the Path to Next-Generation HPC Data Centric System Node, & Processor Innovations Programming Models for Exascale Enhancing Open Interconnects Scalable High Performance Storage & File Systems POWER 25

26 Integrated Clusters: Validated, Tested, Complete The Power Systems HPC Cluster is a modular solution combines High performance compute nodes Low latency interconnect fabric High performance parallel storage System software In to a single, integrated solution; scale from 5 to 64 compute nodes Assembled, tested, and provisioned in IBM manufacturing for faster time to compute Modular and available with or without and FPGA accelerators for compute intensive, data intensive, or balanced cluster performance 26

27 Questions? - Thanks! 27