Roadmapping of HPC interconnects
|
|
- James Patrick
- 5 years ago
- Views:
Transcription
1 Roadmapping of HPC interconnects MIT Microphotonics Center, Fall Meeting Nov. 21, 2008 Alan Benner,
2 Outline Top500 Systems, Nov Review of most recent list & implications on interconnect design Review of various high-end machines designs - RoadRunner: Hybrid Opteron & Cell blades - Cray XT3/4/5 - Blue Gene & Blue Gene/P - Ranger - SunBlade x Power 575 Summary Systems & Interconnect Characteristics 2
3 Top500 list, Nov /08 includes 2 machines at >1 PFLOP/s, top 6 machines together at >4 PFLOPs. Top 6 systems are each *quite* different from each other -- Aggregation of outliers Countries: Top 9 in US, #10 in China. (#11 is Germany, #13 is India, #14 is France) H. Meuer, E. Strohmaier, J. Dongarra, H. Simon Top500.org SC08 BOF Presentation 3
4 Top500 list, Development in time Steady development in time: 95%/year CAGR for N=500, 88%/yr for N=1 ~half of improvement from faster cores & more core/chip, ~half from more chips & better interconnect Note: N=500 grows slightly faster than N=1. Quicker adoption of best-practices? "If you have a job that runs a week on this new Roadrunner system and you took that job on the fastest computer 10 years ago, you would only be half done today. - Herb Schultz, IBM's director of marketing for deep computing 4
5 Top500 list some other interesting statistics Total number of CPU cores in all 500 systems: 3.12 Million Total power: between 91 & 150 MegaWatts - This is the first year that electrical power was explicitly measured data is very incomplete - By comparison: New York City uses 10,000-15,000 MegaWatts, - Note: 1 MW is $1M / year at $0.114 / [kw*hour] roughly US avg. rate Total system value at average of $500 to $1,000 per core (including memory, storage, interconnect, packaging, ): $1.5B to $3B - Not the whole IT market, by a long shot, but a significant slice Top 6 of 500 systems comprise nearly 25% of full list performance (~4 PF out of 16.7) System sizes roughly follow an inverse power law (more small systems, fewer large systems) but with significant outliers 1000 Histogram of System Sizes (by # cores) Frequency (log scale) # cores in system More 5
6 Top500 List, November 2008 Interconnects in Top500 Measured by the number of systems using a particular interconnect, Gigabit Ethernet is the leader, with ~56% of systems using it. InfiniBand 2 nd, at 28% - other negligible. Only 3 significant networks: Gigabit Ethernet, InfiniBand, & Proprietary (IBM Blue Gene/L /P or Cray XT4/XT5) - Myrinet, Quadrics, SP Switch, etc. have nearly disappeared Market matured to ~3-4 players Interconnects in Top500 by # of systems BG & XT4/5 IB Gigabit Enet 6
7 Top500 List, November 2008 Interconnects in Top500..But measured by total performance share, higher-performance networks show more Again, 3-4 HPC interconnect options: - High/Middle: IBM Blue Gene / Blue Gene/P & Cray XT4 / XT5 - Middle/High: InfiniBand SDR/DDR (No QDR showing yet) - Low: Gigabit Ethernet (No 10G yet cost/performance not good enough) Interconnects in Top500 by # of systems Interconnects in Top500 by total performance share Performance share = # cores * Linpack Ops/s per core BG & XT4/5 IB BG & XT4/5 IB Gigabit Enet Gigabit Enet 7
8 Interconnects: # Systems vs. Total performance (# cores) in 2008 Left chart below shows interconnect share by # of systems. Right shows share by perf. Gigabit Ethernet dominates in smaller systems, with fewer numbers of processors and fewer numbers of links. Note: # of links scales super-linearly with system size, so share of Interconnect BW (links) is higher for Proprietary and InfiniBand than shown at right. Gigabit Ethernet 56.4% InfiniBand 28.2% Proprietary 8.4% Cray Interconnect 1.2% Myrinet 2.0% SP Switch 2.0% Others 1.8% Gigabit Ethernet 29.18% InfiniBand 38.82% Proprietary 24.42% Cray Interconnect 2.12% Myrinet 2.06% SP Switch 1.35% Others 2.05% 8
9 Value of a Cluster Network: Network-Dependent Scalability, Linpack: Peak vs. Actual Performance-2005 Actual Max Performance (GF) # of CPUs Ethernet-Interconnected Myrinet-Interconnected InfiniBand-Interconnected ,00 1,500 2,000 Data: Nov ,200 8, Theoretical Peak Performance (GF) Average efficiency (Actual/Peak) across all system sizes GigEthernet: (1+1) Gbps, µs 54.1% Myrinet- 2000: (2+2) Gb/s, 5-6 us 64.1% IB-4x-SDR: (8+8) Gbps, 5-6 usec 73.2% Application= Linpack, Nodes: dual-processor, Intel Xeon ( GHz), Opteron ( GHz), or Power (2.3 GHz) Systems interconnected with higher-performance networks get better use out of processors on parallel applications Benefit of cluster network grows with system size - 25% difference at 1,000 CPUs, >100% at >2,000 Benefits will also, of course, be application-dependent. - Embarrassingly-parallel codes depend less on the network; tightly-coupled apps depend more than Linpack 9
10 Value of a Cluster Network: Network-Dependent Scalability, Linpack: Peak vs. Actual Performance-2008 Actual Max Performance (GF) Ethernet-Interconnected InfiniBand-Interconnected # of CPU cores (approx.) Data: Nov Average efficiency (Actual/Peak) across all system sizes Gig Ethernet: (1+1) Gbps, 8-12 µs 51.0% IB-4x-DDR: (16+16) Gbps, 1-2 usec 76.0% Application = Linpack Nodes: Various -- Intel Xeon, Opteron, or Power 2,000 4,000 8,000 16,000 32, Theoretical Peak Performance (GF) 3 years later all numbers are bigger, but trends & effects are same or amplified since Fewer imbalanced systems but still a few outliers. IB-linked systems (higher BW, lower latency) get ~1.5x performance from same # of CPU cores - Similar benefits in energy efficiency & cost-efficiency 10
11 Outline Top500 Systems, Nov Review of most recent list & implications on interconnect design Review of various high-end machines designs - RoadRunner: Hybrid Opteron & Cell blades - Cray XT3/4/5 - Blue Gene & Blue Gene/P - Ranger - SunBlade x Power 575 Summary Systems & Interconnect Characteristics 11
12 Roadrunner at a glance: Statistics as of 11/2008 Cluster of 18 Connected Units - 12,960 IBM PowerXCell 8i accelerators - 6,480 AMD dual-core Opterons (comp) AMD dual-core Opterons (I/O) - 36 AMD dual-core Opterons (man) Petaflop/s peak (PowerXCell) Teraflop/s peak (Opteron-comp) Petaflop/s sustained Linpack InfiniBand 4x DDR fabric - 2-stage fat-tree; all-optical cables - Full CU bi-section bi-directional BW GB/s (CU) TB/s (system) - Non-disruptive expansion to 24 CUs (1/3 bigger) 103 TB aggregate memory TB Opteron TB Cell 432 GB/s peak File System I/O: - 216x2 10G Ethernets to Panasas RHEL & Fedora Linux SDK for Multicore Acceleration xcat Cluster Management - System-wide GigEnet network 2.48 MW Power (Linpack): Megaflop/s per Watt - most power-efficient, other than Cell-only systems Other: racks ft 2-500,000 lbs. - >55 miles of InfiniBand cables TRIBLADE Operated by Los Alamos National Security, LLC for NNSA 12
13 Roadrunner Packaging & Topology 2-layer Clos-style network, using 288-port IB switches for both leaf and core - 6 levels of switch, altogether. All Interconnect cables are optical. - Copper could have worked for some but optical is easier to deal with, more reliable, & lower power. - Homogeneity of technology is a huge plus Connected Unit 1 ISR9288 IB4x Switch 96 optical Connected Unit 576 unused ISR9288 IB4x DDR Switch Misc Connected Unit 18 ISR9288 IB4x Switch 96 optical I/O + Compute x8 Compute x6 Service + Compute Switch + Compute 13
14 Roadrunner Blades, Racks, Switches, & Cables Hybrid Blades Opteron + Cell Combination BladeCenter Racks Core Switches 288- port IB 4x DDR Active Optical Cables & more Active Optical Cables (20+20) Gb/s each During Build in Poughkeepsie, NY 14
15 Cray XT3/XT4/XT5 AMD Opteron quad-core sockets, connected to Seastar / Seastar 2, Seastar2+ Bridge/Router/DMA ASIC. 3-D torus topology (6-port routers) allows <6meter cables - Little or no fiber, except to storage. Photos: Dave Bullock / eecue eecue.com 15
16 Blue Gene & Blue Gene/P SoC chip: 4 CPU cores+memory interface+router 3-D torus topology (plus extra low-bw networks) - no optics needed in this generation Blue Gene/P 16
17 Ranger, UT Austin SunBlade x6420, InfiniBand Opteron quad-core blades. Top-of-rack IB leaf switches 1 st level of switching. Core IB switch 3,456 ports to leaf switches, at 4x-DDR (20+20) Gb/s each, using 12x connectors 3-level Clos, built with 24-port DDR switch chips - Still all copper - *heavy* & large cables - QDR will need optical cables 17
18 BlueFire, NCAR - P5-575 Rackmount Drawer, 16 2-core MCMs per drawer InfiniBand network direct to Core switches - Copper used in this machine, Active optical is possible Water-cooling to all processors - 40% savings in power delivery efficiency. - Other advantages: better reliability, density, impact on data center environment / temperature 18
19 Outline Top500 Systems, Nov Review of most recent list & implications on interconnect design Review of various high-end machines designs - RoadRunner: Hybrid Opteron & Cell blades - Cray XT3/4/5 - Blue Gene & Blue Gene/P - Ranger - SunBlade x Power 575 Summary Systems & Interconnect Characteristics 19
20 Take-home messages Supercomputer and HPC architecture is still heterogeneous (i.e., interesting) - Processors: Intel / AMD / Power, - Co-processors: Vector Units, Cell processors, FPGAs, GPUs,.. - Networks: Torus, Clos, mixtures,.. - Scalability design Networks are still heterogeneous as well (with some signs of maturing) Overall system design topology (torus/clos /..), packaging (blades/drawers/racks/..), and usage (convenience of installation,..) -- all affect use of optics vs. copper. Active optical cabling makes system design much easier. Steady & fast progress towards more optics The limit of 10 [meters*gigabits/sec] as the cross-over point it still pretty valid. - CTR-I used same number, in different units: 10 [kilometers* Megabits/sec] 20
21 Appendix: The downside of Massive Parallelism A few real-world scenarios 21
22 and the Upside of Massive Parallelism: More Insight 22
23 and the Upside of Massive Parallelism: More Insight For example: Weather Simulation ~2005 ~1995 ~
IBM HPC DIRECTIONS. Dr Don Grice. ECMWF Workshop November, IBM Corporation
IBM HPC DIRECTIONS Dr Don Grice ECMWF Workshop November, 2008 IBM HPC Directions Agenda What Technology Trends Mean to Applications Critical Issues for getting beyond a PF Overview of the Roadrunner Project
More informationScaling to Petaflop. Ola Torudbakken Distinguished Engineer. Sun Microsystems, Inc
Scaling to Petaflop Ola Torudbakken Distinguished Engineer Sun Microsystems, Inc HPC Market growth is strong CAGR increased from 9.2% (2006) to 15.5% (2007) Market in 2007 doubled from 2003 (Source: IDC
More informationHigh Performance Computing: Blue-Gene and Road Runner. Ravi Patel
High Performance Computing: Blue-Gene and Road Runner Ravi Patel 1 HPC General Information 2 HPC Considerations Criterion Performance Speed Power Scalability Number of nodes Latency bottlenecks Reliability
More informationReal Parallel Computers
Real Parallel Computers Modular data centers Background Information Recent trends in the marketplace of high performance computing Strohmaier, Dongarra, Meuer, Simon Parallel Computing 2005 Short history
More informationReal Parallel Computers
Real Parallel Computers Modular data centers Overview Short history of parallel machines Cluster computing Blue Gene supercomputer Performance development, top-500 DAS: Distributed supercomputing Short
More information2008 International ANSYS Conference
2008 International ANSYS Conference Maximizing Productivity With InfiniBand-Based Clusters Gilad Shainer Director of Technical Marketing Mellanox Technologies 2008 ANSYS, Inc. All rights reserved. 1 ANSYS,
More informationInfiniBand Strengthens Leadership as The High-Speed Interconnect Of Choice
InfiniBand Strengthens Leadership as The High-Speed Interconnect Of Choice Providing the Best Return on Investment by Delivering the Highest System Efficiency and Utilization Top500 Supercomputers June
More informationBlueGene/L. Computer Science, University of Warwick. Source: IBM
BlueGene/L Source: IBM 1 BlueGene/L networking BlueGene system employs various network types. Central is the torus interconnection network: 3D torus with wrap-around. Each node connects to six neighbours
More informationThe Stampede is Coming Welcome to Stampede Introductory Training. Dan Stanzione Texas Advanced Computing Center
The Stampede is Coming Welcome to Stampede Introductory Training Dan Stanzione Texas Advanced Computing Center dan@tacc.utexas.edu Thanks for Coming! Stampede is an exciting new system of incredible power.
More informationParallel Computer Architecture II
Parallel Computer Architecture II Stefan Lang Interdisciplinary Center for Scientific Computing (IWR) University of Heidelberg INF 368, Room 532 D-692 Heidelberg phone: 622/54-8264 email: Stefan.Lang@iwr.uni-heidelberg.de
More informationPreparing GPU-Accelerated Applications for the Summit Supercomputer
Preparing GPU-Accelerated Applications for the Summit Supercomputer Fernanda Foertter HPC User Assistance Group Training Lead foertterfs@ornl.gov This research used resources of the Oak Ridge Leadership
More informationStockholm Brain Institute Blue Gene/L
Stockholm Brain Institute Blue Gene/L 1 Stockholm Brain Institute Blue Gene/L 2 IBM Systems & Technology Group and IBM Research IBM Blue Gene /P - An Overview of a Petaflop Capable System Carl G. Tengwall
More informationInfiniBand Strengthens Leadership as the Interconnect Of Choice By Providing Best Return on Investment. TOP500 Supercomputers, June 2014
InfiniBand Strengthens Leadership as the Interconnect Of Choice By Providing Best Return on Investment TOP500 Supercomputers, June 2014 TOP500 Performance Trends 38% CAGR 78% CAGR Explosive high-performance
More informationInterconnect Your Future
Interconnect Your Future Gilad Shainer 2nd Annual MVAPICH User Group (MUG) Meeting, August 2014 Complete High-Performance Scalable Interconnect Infrastructure Comprehensive End-to-End Software Accelerators
More informationEN2910A: Advanced Computer Architecture Topic 06: Supercomputers & Data Centers Prof. Sherief Reda School of Engineering Brown University
EN2910A: Advanced Computer Architecture Topic 06: Supercomputers & Data Centers Prof. Sherief Reda School of Engineering Brown University Material from: The Datacenter as a Computer: An Introduction to
More informationOutline. Execution Environments for Parallel Applications. Supercomputers. Supercomputers
Outline Execution Environments for Parallel Applications Master CANS 2007/2008 Departament d Arquitectura de Computadors Universitat Politècnica de Catalunya Supercomputers OS abstractions Extended OS
More informationCAS 2K13 Sept Jean-Pierre Panziera Chief Technology Director
CAS 2K13 Sept. 2013 Jean-Pierre Panziera Chief Technology Director 1 personal note 2 Complete solutions for Extreme Computing b ubullx ssupercomputer u p e r c o p u t e r suite s u e Production ready
More informationThe Red Storm System: Architecture, System Update and Performance Analysis
The Red Storm System: Architecture, System Update and Performance Analysis Douglas Doerfler, Jim Tomkins Sandia National Laboratories Center for Computation, Computers, Information and Mathematics LACSI
More informationCommunication has significant impact on application performance. Interconnection networks therefore have a vital role in cluster systems.
Cluster Networks Introduction Communication has significant impact on application performance. Interconnection networks therefore have a vital role in cluster systems. As usual, the driver is performance
More informationCray XC Scalability and the Aries Network Tony Ford
Cray XC Scalability and the Aries Network Tony Ford June 29, 2017 Exascale Scalability Which scalability metrics are important for Exascale? Performance (obviously!) What are the contributing factors?
More informationIBM Virtual Fabric Architecture
IBM Virtual Fabric Architecture Seppo Kemivirta Product Manager Finland IBM System x & BladeCenter 2007 IBM Corporation Five Years of Durable Infrastructure Foundation for Success BladeCenter Announced
More informationVoltaire Making Applications Run Faster
Voltaire Making Applications Run Faster Asaf Somekh Director, Marketing Voltaire, Inc. Agenda HPC Trends InfiniBand Voltaire Grid Backbone Deployment examples About Voltaire HPC Trends Clusters are the
More informationIt s a Multicore World. John Urbanic Pittsburgh Supercomputing Center
It s a Multicore World John Urbanic Pittsburgh Supercomputing Center Waiting for Moore s Law to save your serial code start getting bleak in 2004 Source: published SPECInt data Moore s Law is not at all
More informationBlue Gene/Q. Hardware Overview Michael Stephan. Mitglied der Helmholtz-Gemeinschaft
Blue Gene/Q Hardware Overview 02.02.2015 Michael Stephan Blue Gene/Q: Design goals System-on-Chip (SoC) design Processor comprises both processing cores and network Optimal performance / watt ratio Small
More informationHPC Architectures. Types of resource currently in use
HPC Architectures Types of resource currently in use Reusing this material This work is licensed under a Creative Commons Attribution- NonCommercial-ShareAlike 4.0 International License. http://creativecommons.org/licenses/by-nc-sa/4.0/deed.en_us
More informationParallel Computing: From Inexpensive Servers to Supercomputers
Parallel Computing: From Inexpensive Servers to Supercomputers Lyle N. Long The Pennsylvania State University & The California Institute of Technology Seminar to the Koch Lab http://www.personal.psu.edu/lnl
More informationHPC and Accelerators. Ken Rozendal Chief Architect, IBM Linux Technology Cener. November, 2008
HPC and Accelerators Ken Rozendal Chief Architect, Linux Technology Cener November, 2008 All statements regarding future directions and intent are subject to change or withdrawal without notice and represent
More informationTOP500 List s Twice-Yearly Snapshots of World s Fastest Supercomputers Develop Into Big Picture of Changing Technology
TOP500 List s Twice-Yearly Snapshots of World s Fastest Supercomputers Develop Into Big Picture of Changing Technology BY ERICH STROHMAIER COMPUTER SCIENTIST, FUTURE TECHNOLOGIES GROUP, LAWRENCE BERKELEY
More informationThe Impact of Optics on HPC System Interconnects
The Impact of Optics on HPC System Interconnects Mike Parker and Steve Scott Hot Interconnects 2009 Manhattan, NYC Will cost-effective optics fundamentally change the landscape of networking? Yes. Changes
More informationBrand-New Vector Supercomputer
Brand-New Vector Supercomputer NEC Corporation IT Platform Division Shintaro MOMOSE SC13 1 New Product NEC Released A Brand-New Vector Supercomputer, SX-ACE Just Now. Vector Supercomputer for Memory Bandwidth
More informationJack Dongarra University of Tennessee Oak Ridge National Laboratory University of Manchester
Jack Dongarra University of Tennessee Oak Ridge National Laboratory University of Manchester 12/24/09 1 Take a look at high performance computing What s driving HPC Future Trends 2 Traditional scientific
More informationMellanox Technologies Maximize Cluster Performance and Productivity. Gilad Shainer, October, 2007
Mellanox Technologies Maximize Cluster Performance and Productivity Gilad Shainer, shainer@mellanox.com October, 27 Mellanox Technologies Hardware OEMs Servers And Blades Applications End-Users Enterprise
More informationJohn Fragalla TACC 'RANGER' INFINIBAND ARCHITECTURE WITH SUN TECHNOLOGY. Presenter s Name Title and Division Sun Microsystems
TACC 'RANGER' INFINIBAND ARCHITECTURE WITH SUN TECHNOLOGY SUBTITLE WITH TWO LINES OF TEXT IF NECESSARY John Fragalla Presenter s Name Title and Division Sun Microsystems Principle Engineer High Performance
More informationCreating High Performance Clusters for Embedded Use
Creating High Performance Clusters for Embedded Use 1 The Hype.. The Internet of Things has the capacity to create huge amounts of data Gartner forecasts 35ZB of data from things by 2020 etc Intel Putting
More informationThe Road from Peta to ExaFlop
The Road from Peta to ExaFlop Andreas Bechtolsheim June 23, 2009 HPC Driving the Computer Business Server Unit Mix (IDC 2008) Enterprise HPC Web 100 75 50 25 0 2003 2008 2013 HPC grew from 13% of units
More informationJack Dongarra University of Tennessee Oak Ridge National Laboratory University of Manchester
Jack Dongarra University of Tennessee Oak Ridge National Laboratory University of Manchester 12/3/09 1 ! Take a look at high performance computing! What s driving HPC! Issues with power consumption! Future
More informationCluster Network Products
Cluster Network Products Cluster interconnects include, among others: Gigabit Ethernet Myrinet Quadrics InfiniBand 1 Interconnects in Top500 list 11/2009 2 Interconnects in Top500 list 11/2008 3 Cluster
More information2008 International ANSYS Conference
28 International ANSYS Conference Maximizing Performance for Large Scale Analysis on Multi-core Processor Systems Don Mize Technical Consultant Hewlett Packard 28 ANSYS, Inc. All rights reserved. 1 ANSYS,
More informationMELLANOX EDR UPDATE & GPUDIRECT MELLANOX SR. SE 정연구
MELLANOX EDR UPDATE & GPUDIRECT MELLANOX SR. SE 정연구 Leading Supplier of End-to-End Interconnect Solutions Analyze Enabling the Use of Data Store ICs Comprehensive End-to-End InfiniBand and Ethernet Portfolio
More informationLinux Networx HPC Strategy and Roadmap
Linux Networx HPC Strategy and Roadmap Eric Pitcher October 2006 Agenda Business Update Technology Trends Linux Networx Drivers Hardware Roadmap Software Highlights Linux Networx Overview Founded in 1989,
More informationAbout Us. Are you ready for headache-free HPC? Call us and learn more about our custom clustering solutions.
About Us Advanced Clustering Technologies customizes solutions to meet your exact specifications. For more information regarding our services, email us at sales@advancedclustering.com Advanced Clustering
More informationSlides compliment of Yong Chen and Xian-He Sun From paper Reevaluating Amdahl's Law in the Multicore Era. 11/16/2011 Many-Core Computing 2
Slides compliment of Yong Chen and Xian-He Sun From paper Reevaluating Amdahl's Law in the Multicore Era 11/16/2011 Many-Core Computing 2 Gene M. Amdahl, Validity of the Single-Processor Approach to Achieving
More informationIBM s Data Warehouse Appliance Offerings
IBM s Data Warehouse Appliance Offerings RChaitanya IBM India Software Labs Agenda 1 IBM Smart Analytics System (D5600) System Overview Technical Architecture Software / Hardware stack details 2 Netezza
More informationHow то Use HPC Resources Efficiently by a Message Oriented Framework.
How то Use HPC Resources Efficiently by a Message Oriented Framework www.hp-see.eu E. Atanassov, T. Gurov, A. Karaivanova Institute of Information and Communication Technologies Bulgarian Academy of Science
More informationData Transport: Defining the Problem and the Solution for Photonics in servers
Ronald Luijten Data Motion Architect lui@zurich.ibm.com IBM Research Lab Switzerland 5 October 2010 Data Transport: Defining the Problem and the Solution for Photonics in servers 1 MIT microphotonics Fall
More informationInterconnect Your Future
Interconnect Your Future Smart Interconnect for Next Generation HPC Platforms Gilad Shainer, August 2016, 4th Annual MVAPICH User Group (MUG) Meeting Mellanox Connects the World s Fastest Supercomputer
More informationResources Current and Future Systems. Timothy H. Kaiser, Ph.D.
Resources Current and Future Systems Timothy H. Kaiser, Ph.D. tkaiser@mines.edu 1 Most likely talk to be out of date History of Top 500 Issues with building bigger machines Current and near future academic
More informationWhat have we learned from the TOP500 lists?
What have we learned from the TOP500 lists? Hans Werner Meuer University of Mannheim and Prometeus GmbH Sun HPC Consortium Meeting Heidelberg, Germany June 19-20, 2001 Outlook TOP500 Approach Snapshots
More informationInterconnect Your Future Enabling the Best Datacenter Return on Investment. TOP500 Supercomputers, November 2017
Interconnect Your Future Enabling the Best Datacenter Return on Investment TOP500 Supercomputers, November 2017 InfiniBand Accelerates Majority of New Systems on TOP500 InfiniBand connects 77% of new HPC
More informationResources Current and Future Systems. Timothy H. Kaiser, Ph.D.
Resources Current and Future Systems Timothy H. Kaiser, Ph.D. tkaiser@mines.edu 1 Most likely talk to be out of date History of Top 500 Issues with building bigger machines Current and near future academic
More informationThe Future of High Performance Interconnects
The Future of High Performance Interconnects Ashrut Ambastha HPC Advisory Council Perth, Australia :: August 2017 When Algorithms Go Rogue 2017 Mellanox Technologies 2 When Algorithms Go Rogue 2017 Mellanox
More informationCOSC 6385 Computer Architecture - Multi Processor Systems
COSC 6385 Computer Architecture - Multi Processor Systems Fall 2006 Classification of Parallel Architectures Flynn s Taxonomy SISD: Single instruction single data Classical von Neumann architecture SIMD:
More informationPractical Scientific Computing
Practical Scientific Computing Performance-optimized Programming Preliminary discussion: July 11, 2008 Dr. Ralf-Peter Mundani, mundani@tum.de Dipl.-Ing. Ioan Lucian Muntean, muntean@in.tum.de MSc. Csaba
More informationAim High. Intel Technical Update Teratec 07 Symposium. June 20, Stephen R. Wheat, Ph.D. Director, HPC Digital Enterprise Group
Aim High Intel Technical Update Teratec 07 Symposium June 20, 2007 Stephen R. Wheat, Ph.D. Director, HPC Digital Enterprise Group Risk Factors Today s s presentations contain forward-looking statements.
More informationACCRE High Performance Compute Cluster
6 중 1 2010-05-16 오후 1:44 Enabling Researcher-Driven Innovation and Exploration Mission / Services Research Publications User Support Education / Outreach A - Z Index Our Mission History Governance Services
More informationSupercomputing with Commodity CPUs: Are Mobile SoCs Ready for HPC?
Supercomputing with Commodity CPUs: Are Mobile SoCs Ready for HPC? Nikola Rajovic, Paul M. Carpenter, Isaac Gelado, Nikola Puzovic, Alex Ramirez, Mateo Valero SC 13, November 19 th 2013, Denver, CO, USA
More informationThe Spider Center-Wide File System
The Spider Center-Wide File System Presented by Feiyi Wang (Ph.D.) Technology Integration Group National Center of Computational Sciences Galen Shipman (Group Lead) Dave Dillow, Sarp Oral, James Simmons,
More informationThe Stampede is Coming: A New Petascale Resource for the Open Science Community
The Stampede is Coming: A New Petascale Resource for the Open Science Community Jay Boisseau Texas Advanced Computing Center boisseau@tacc.utexas.edu Stampede: Solicitation US National Science Foundation
More informationWhat does Heterogeneity bring?
What does Heterogeneity bring? Ken Koch Scientific Advisor, CCS-DO, LANL LACSI 2006 Conference October 18, 2006 Some Terminology Homogeneous Of the same or similar nature or kind Uniform in structure or
More informationPerformance of Variant Memory Configurations for Cray XT Systems
Performance of Variant Memory Configurations for Cray XT Systems presented by Wayne Joubert Motivation Design trends are leading to non-power of 2 core counts for multicore processors, due to layout constraints
More informationPrototypes Systems for PRACE. François Robin, GENCI, WP7 leader
Prototypes Systems for PRACE François Robin, GENCI, WP7 leader Outline Motivation Summary of the selection process Description of the set of prototypes selected by the Management Board Conclusions 2 Outline
More informationHIGH PERFORMANCE COMPUTING FROM SUN
HIGH PERFORMANCE COMPUTING FROM SUN Update for IDC HPC User Forum, Norfolk, VA April 2008 Bjorn Andersson Director, HPC and Integrated Systems Sun Microsystems Sun Constellation System Integrating the
More informationOCP Engineering Workshop - Telco
OCP Engineering Workshop - Telco Low Latency Mobile Edge Computing Trevor Hiatt Product Management, IDT IDT Company Overview Founded 1980 Workforce Approximately 1,800 employees Headquarters San Jose,
More informationJeff Kash, Dan Kuchta, Fuad Doany, Clint Schow, Frank Libsch, Russell Budd, Yoichi Taira, Shigeru Nakagawa, Bert Offrein, Marc Taubenblatt
IBM Research PCB Overview Jeff Kash, Dan Kuchta, Fuad Doany, Clint Schow, Frank Libsch, Russell Budd, Yoichi Taira, Shigeru Nakagawa, Bert Offrein, Marc Taubenblatt November, 2009 November, 2009 2009 IBM
More informationOverview of Tianhe-2
Overview of Tianhe-2 (MilkyWay-2) Supercomputer Yutong Lu School of Computer Science, National University of Defense Technology; State Key Laboratory of High Performance Computing, China ytlu@nudt.edu.cn
More informationDynamical Exascale Entry Platform
DEEP Dynamical Exascale Entry Platform 2 nd IS-ENES Workshop on High performance computing for climate models 30.01.2013, Toulouse, France Estela Suarez The research leading to these results has received
More informationThe Road to ExaScale. Advances in High-Performance Interconnect Infrastructure. September 2011
The Road to ExaScale Advances in High-Performance Interconnect Infrastructure September 2011 diego@mellanox.com ExaScale Computing Ambitious Challenges Foster Progress Demand Research Institutes, Universities
More informationQLogic BS21, , and InfiniBand Switches IBM Power at-a-glance guide
QLogic 12200-BS21, 12800-040, and 12800-180 InfiniBand Switches IBM Power at-a-glance guide InfiniBand is an industry-standard high-performance interconnect for clusters and enterprise grids. This industry-standard
More informationIt s a Multicore World. John Urbanic Pittsburgh Supercomputing Center Parallel Computing Scientist
It s a Multicore World John Urbanic Pittsburgh Supercomputing Center Parallel Computing Scientist Waiting for Moore s Law to save your serial code started getting bleak in 2004 Source: published SPECInt
More informationPRACE prototypes. ICT 08, Lyon, Nov. 26, 2008 Dr. J.Ph. Nominé, CEA/DIF
PRACE prototypes ICT 08, Lyon, Nov. 26, 2008 Dr. J.Ph. Nominé, CEA/DIF jean-philippe.nomine@cea.fr Credits and acknowledgements: FZJ, CEA, NCF/SARA, HLRS, BSC, CSC, CSCS F. Robin (PRACE WP7 Leader) 2 PRACE
More informationPedraforca: a First ARM + GPU Cluster for HPC
www.bsc.es Pedraforca: a First ARM + GPU Cluster for HPC Nikola Puzovic, Alex Ramirez We ve hit the power wall ALL computers are limited by power consumption Energy-efficient approaches Multi-core Fujitsu
More informationOncilla - a Managed GAS Runtime for Accelerating Data Warehousing Queries
Oncilla - a Managed GAS Runtime for Accelerating Data Warehousing Queries Jeffrey Young, Alex Merritt, Se Hoon Shon Advisor: Sudhakar Yalamanchili 4/16/13 Sponsors: Intel, NVIDIA, NSF 2 The Problem Big
More informationMaking a Case for a Green500 List
Making a Case for a Green500 List S. Sharma, C. Hsu, and W. Feng Los Alamos National Laboratory Virginia Tech Outline Introduction What Is Performance? Motivation: The Need for a Green500 List Challenges
More informationCRAY XK6 REDEFINING SUPERCOMPUTING. - Sanjana Rakhecha - Nishad Nerurkar
CRAY XK6 REDEFINING SUPERCOMPUTING - Sanjana Rakhecha - Nishad Nerurkar CONTENTS Introduction History Specifications Cray XK6 Architecture Performance Industry acceptance and applications Summary INTRODUCTION
More informationDesign and Evaluation of a 2048 Core Cluster System
Design and Evaluation of a 2048 Core Cluster System, Torsten Höfler, Torsten Mehlan and Wolfgang Rehm Computer Architecture Group Department of Computer Science Chemnitz University of Technology December
More informationAn Overview of High Performance Computing and Challenges for the Future
An Overview of High Performance Computing and Challenges for the Future Jack Dongarra University of Tennessee Oak Ridge National Laboratory University of Manchester 6/15/2009 1 H. Meuer, H. Simon, E. Strohmaier,
More informationSolutions for Scalable HPC
Solutions for Scalable HPC Scot Schultz, Director HPC/Technical Computing HPC Advisory Council Stanford Conference Feb 2014 Leading Supplier of End-to-End Interconnect Solutions Comprehensive End-to-End
More informationSun Lustre Storage System Simplifying and Accelerating Lustre Deployments
Sun Lustre Storage System Simplifying and Accelerating Lustre Deployments Torben Kling-Petersen, PhD Presenter s Name Principle Field Title andengineer Division HPC &Cloud LoB SunComputing Microsystems
More informationrepresent parallel computers, so distributed systems such as Does not consider storage or I/O issues
Top500 Supercomputer list represent parallel computers, so distributed systems such as SETI@Home are not considered Does not consider storage or I/O issues Both custom designed machines and commodity machines
More informationAn Overview of High Performance Computing
IFIP Working Group 10.3 on Concurrent Systems An Overview of High Performance Computing Jack Dongarra University of Tennessee and Oak Ridge National Laboratory 1/3/2006 1 Overview Look at fastest computers
More informationFuture Routing Schemes in Petascale clusters
Future Routing Schemes in Petascale clusters Gilad Shainer, Mellanox, USA Ola Torudbakken, Sun Microsystems, Norway Richard Graham, Oak Ridge National Laboratory, USA Birds of a Feather Presentation Abstract
More informationS THE MAKING OF DGX SATURNV: BREAKING THE BARRIERS TO AI SCALE. Presenter: Louis Capps, Solution Architect, NVIDIA,
S7750 - THE MAKING OF DGX SATURNV: BREAKING THE BARRIERS TO AI SCALE Presenter: Louis Capps, Solution Architect, NVIDIA, lcapps@nvidia.com A TALE OF ENLIGHTENMENT Basic OK List 10 for x = 1 to 3 20 print
More informationOverview. CS 472 Concurrent & Parallel Programming University of Evansville
Overview CS 472 Concurrent & Parallel Programming University of Evansville Selection of slides from CIS 410/510 Introduction to Parallel Computing Department of Computer and Information Science, University
More informationFuture Trends in Hardware and Software for use in Simulation
Future Trends in Hardware and Software for use in Simulation Steve Feldman VP/IT, CD-adapco April, 2009 HighPerformanceComputing Building Blocks CPU I/O Interconnect Software General CPU Maximum clock
More informationMaking Supercomputing More Available and Accessible Windows HPC Server 2008 R2 Beta 2 Microsoft High Performance Computing April, 2010
Making Supercomputing More Available and Accessible Windows HPC Server 2008 R2 Beta 2 Microsoft High Performance Computing April, 2010 Windows HPC Server 2008 R2 Windows HPC Server 2008 R2 makes supercomputing
More informationRoadrunner. By Diana Lleva Julissa Campos Justina Tandar
Roadrunner By Diana Lleva Julissa Campos Justina Tandar Overview Roadrunner background On-Chip Interconnect Number of Cores Memory Hierarchy Pipeline Organization Multithreading Organization Roadrunner
More informationAcuSolve Performance Benchmark and Profiling. October 2011
AcuSolve Performance Benchmark and Profiling October 2011 Note The following research was performed under the HPC Advisory Council activities Participating vendors: AMD, Dell, Mellanox, Altair Compute
More informationUpdate on Cray Activities in the Earth Sciences
Update on Cray Activities in the Earth Sciences Presented to the 13 th ECMWF Workshop on the Use of HPC in Meteorology 3-7 November 2008 Per Nyberg nyberg@cray.com Director, Marketing and Business Development
More informationCray XD1 Supercomputer Release 1.3 CRAY XD1 DATASHEET
CRAY XD1 DATASHEET Cray XD1 Supercomputer Release 1.3 Purpose-built for HPC delivers exceptional application performance Affordable power designed for a broad range of HPC workloads and budgets Linux,
More informationTop500
Top500 www.top500.org Salvatore Orlando (from a presentation by J. Dongarra, and top500 website) 1 2 MPPs Performance on massively parallel machines Larger problem sizes, i.e. sizes that make sense Performance
More informationIBM Information Technology Guide For ANSYS Fluent Customers
IBM ISV & Developer Relations Manufacturing IBM Information Technology Guide For ANSYS Fluent Customers A collaborative effort between ANSYS and IBM 2 IBM Information Technology Guide For ANSYS Fluent
More informationIntel Connects Cables & HPCC Growth
Intel Connects Cables & HPCC Growth Tom Rossi April 28 th 2008 Legal Disclaimers Copyright 2008. All rights reserved. Intel and the Intel logo are trademarks or registered trademarks of or its subsidiaries
More informationHP Update. Bill Mannel VP/GM HPC & Big Data Business Unit Apollo Servers
Update Bill Mannel VP/GM C & Big Data Business Unit Apollo Servers The most exciting shifts of our time are underway Cloud Security Mobility Time to revenue is critical Big Data Decisions must be rapid
More informationLecture 20: Distributed Memory Parallelism. William Gropp
Lecture 20: Distributed Parallelism William Gropp www.cs.illinois.edu/~wgropp A Very Short, Very Introductory Introduction We start with a short introduction to parallel computing from scratch in order
More informationTechnology Trends IT ELS. Kevin Kettler Dell CTO
Technology Trends IT ELS Kevin Kettler Dell CTO Core Technology Building Blocks Processor Chipset Graphics Memory I/O Subsystems Process Technology.13µ 2001 90nm 2003 65nm 2005 45nm 2007 32nm ~2009 22nm
More informationAccelerating Real-Time Big Data. Breaking the limitations of captive NVMe storage
Accelerating Real-Time Big Data Breaking the limitations of captive NVMe storage 18M IOPs in 2u Agenda Everything related to storage is changing! The 3rd Platform NVM Express architected for solid state
More informationInterconnect Challenges in a Many Core Compute Environment. Jerry Bautista, PhD Gen Mgr, New Business Initiatives Intel, Tech and Manuf Grp
Interconnect Challenges in a Many Core Compute Environment Jerry Bautista, PhD Gen Mgr, New Business Initiatives Intel, Tech and Manuf Grp Agenda Microprocessor general trends Implications Tradeoffs Summary
More information2-Port 40 Gb InfiniBand Expansion Card (CFFh) for IBM BladeCenter IBM BladeCenter at-a-glance guide
2-Port 40 Gb InfiniBand Expansion Card (CFFh) for IBM BladeCenter IBM BladeCenter at-a-glance guide The 2-Port 40 Gb InfiniBand Expansion Card (CFFh) for IBM BladeCenter is a dual port InfiniBand Host
More informationCustomer Success Story Los Alamos National Laboratory
Customer Success Story Los Alamos National Laboratory Panasas High Performance Storage Powers the First Petaflop Supercomputer at Los Alamos National Laboratory Case Study June 2010 Highlights First Petaflop
More informationTianhe-2, the world s fastest supercomputer. Shaohua Wu Senior HPC application development engineer
Tianhe-2, the world s fastest supercomputer Shaohua Wu Senior HPC application development engineer Inspur Inspur revenue 5.8 2010-2013 6.4 2011 2012 Unit: billion$ 8.8 2013 21% Staff: 14, 000+ 12% 10%
More information