Stephen Lutz Deep Learning mit PowerAI - Open Group Master Certified IT Specialist Technical Sales IBM Cognitive Infrastructure IBM Germany Ein Überblick Stephen.Lutz@de.ibm.com
What s that?
and what s that?
and what s that?
Overall Artificial Intelligence (AI) Space Cognitive / ML/DL Human Intelligence Exhibited by Machines Machine Learning Trained using large amounts of data & ability to learn how to perform the task Deep Learning Break tasks into Artificial Neural Networks New Data Sources: NoSQL, Hadoop & Analytics New class of applications Opportunity in ML Training Pattern matching Image matching (Consumer Photos) Real-time decision support Complex workflows Data Lakes Extend Enterprise applications Finance: Fraud detection / prevention Retail: shopping advisors Healthcare: Diagnostics and treatment Supply chain and logistics Extend Predictive Analytics to Advance Analytics with AI Growing across Compute, Middleware, and Storage
Target Industries Deep Learning Automotive and Transportation Security and Public Safety Consumer Web, Mobile, Retail Medicine and Biology Broadcast, Media and Entertainment Autonomous driving: Pedestrian detection Accident avoidance Video Surveillance Image analysis Facial recognition and detection Image tagging Speech recognition Natural language Sentiment analysis Drug discovery Diagnostic assistance Cancer cell detection Captioning Search Recommendations Real time translation Auto, trucking, heavy equipment, Tier 1 suppliers Local and national police, public and private safety/ security Hyperscale web companies, large retail Pharmaceutical, Medical equipment, Diagnostic labs Consumer facing companies with large streaming of existing media, or real time content
Introducing PowerAI: Get Started Fast with Deep Learning Package of Pre-Compiled Major Deep Learning Frameworks Easy to install & get started with Deep Learning with Enterprise-Class Support Optimized for Performance To Take Advantage of NVLink Enabled by High Performance Computing Infrastructure
PowerAI Platform Deep Learning Frameworks Caffe NVCaffe IBMCaffe Torch TensorFlow Distributed TensorFlow Theano Chainer Supporting Libraries OpenBLAS Bazel Distributed Communications NCCL DIGITS Accelerated Servers and Infrastructure for Scaling Cluster of NVLink Servers Spectrum Scale: High-Speed Parallel File System Scale to Cloud
PowerAI Enterprise: Enhancing Developer Experience Data Science Experience (DSX) PowerAI Enterprise (Coming) DL Developer Tools PowerAI DL Frameworks + Libraries (TensorFlow, CAFFE,..) Application Dev Services IBM Enterprise Support Distributed Computing with Spark & MPI Cluster of NVLink Servers Spectrum Scale High-Speed File System via HDFS APIs Scale to Cloud
Fastest GPU Server with NVLink: S822LC for HPC 2.5x Faster Data Throughput High-Speed NVLink Connections between CPUs & GPUs and among GPUs Features Latest NVIDIA P100 Pascal GPU NVIDIA P100 Pascal GPU 2.5x Faster CPU-GPU Data Communication via NVLink No NVLink between CPU & GPU for x86 Servers: PCIe Bottleneck GPU P8 GPU GPU P8 GPU NVLink 80 GB/s (3x) x86 GPU GPU x86 GPU GPU PCIe 32 GB/s Minsky POWER8 NVLink Server x86 Servers with PCIe
NVIDIA P100 Pascal GPUs inside a Minsky system
S822LC for HPC: recommended configuration for PowerAI 2 Socket, 4 GPU System with NVLink Required: 2 POWER8 10 Core CPUs 4 NVIDIA P100 Pascal GPUs 256 GB System Memory 2 SSD storage devices High-speed interconnect (IB or Ethernet, depending on infrastructure) Optional: Up to 1 TB System Memory PCIe attached NVMe storage
Introducing the IBM Power Systems LC Line OpenPOWER servers for cloud and cluster deployments that are different by design High Performance Computing NEW S822LC For Big Data NEW S822LC For High Performance Computing NEW S821LC S812LC S822LC Storage rich single socket system for big data applications Memory Intensive workloads Ideal for storage-centric and high data throughput workloads Brings 2 POWER8 sockets for Big Data workloads Big data acceleration with work CAPI and GPUs Incorporates the new POWER8 processor with NVIDIA NVLink Delivers 2.8X the bandwidth to GPUs accelerators Up to 4 integrated NVIDIA Pascal GPUs 2 POWER8 sockets in a 1U form factor Ideal for environments requiring dense computing 2X memory bandwidth of Intel x86 systems Memory Intensive workloads
Performance Leadership Roadmap for HPC / HPDA Mellanox Interconnect Technology Connect-IB FDR Infiniband PCIe Gen3 ConnectX-4 EDR Infiniband CAPI over PCIe Gen3 ConnectX-5 Next-Gen Infiniband Enhanced CAPI over PCIe Gen4 NVIDIA GPUs Kepler PCIe Gen3 Pascal NVLink Volta NVLink Next Gen IBM CPUs POWER8 OpenPower CAPI Interface POWER8 with NVLink PowerAccel Interfaces: NVLink, CAPI, PCIe Gen3 POWER9 PowerAccel: OpenCAPI, NVLink 2.0, PCIe Gen4 2015 2016 2017 IBM Nodes
Getting Started with PowerAI Install PowerAI on your existing S822LC for HPC server http://ibm.biz/powerai Don t have an S822LC for HPC? Reference architecture / system requirements are available for the first system shipping with POWER8, NVLink, and Tesla P100 Visit IBM POWER HPC Cloud partners to test drive these frameworks on POWER8/P100 today https://power.jarvice.com/ (Nimbix HPC Cloud)
IBM Systems for Cognitive Solutions Registration: https://www- 01.ibm.com/events/wwe/grp/grp308.nsf/Agenda.xsp?openform&seminar=A98AJKES&locale=de_DE Die Anmeldung zum DLI-Workshop am 13.07. ist nur per Mail möglich! Bitte schreiben Sie eine E-Mail mit dem Subject "Anmeldung DLI Workshop" an folgende E-Mail-Adresse: s.mueller1@de.ibm.com
Questions? Stephen Lutz Open Group Master Certified IT Specialist Technical Sales IBM Cognitive Infrastructure IBM Germany Stephen.Lutz@de.ibm.com