What have we learned from the TOP500 lists?
|
|
|
- Todd Lee
- 5 years ago
- Views:
Transcription
1 What have we learned from the TOP500 lists? Hans Werner Meuer University of Mannheim and Prometeus GmbH Sun HPC Consortium Meeting Heidelberg, Germany June 19-20, 2001
2 Outlook TOP500 Approach Snapshots in Time Development over Time Customer Types TOP500 Plans
3 TOP500 Motivation Basis for analyzing the HPC market Quantification of observations Detection of trends Market Architecture Technology
4 TOP500 Procedure Listing of the 500 most powerful computers in the world Yardstick: R max from LINPACK Ax=b, dense problem TPP performance Rate Size Updated twice a year
5 Fastest Computer Over Time GFlop/s Cray Y-MP (8) Fujitsu VP-2600 TMC CM-2 (2048) In 1980 a computation that took 1 full year to complete can now be done in 1 month!
6 GFlop/s Fastest Computer Over Time Cray Y-MP (8) Fujitsu VP-2600 TMC CM-2 (2048) NEC SX-3 (4) Fujitsu VPP-500 (140) TMC CM-5 (1024) Intel Paragon (6788) Hitachi CP-PACS (2040) In 1980 a computation that took 1 full year to complete can now be done in 4 days!
7 GFlop/s Fastest Computer Over Time Cray Y-MP (8) Fujitsu VP-2600 TMC CM-2 (2048) NEC SX-3 (4) TMC CM-5 (1024) Fujitsu VPP-500 (140) Intel Paragon (6788) In 1980 a computation that took 1 full year to complete can now be done in 1 hour! Hitachi CP-PACS (2040) Intel ASCI Red Xeon ASCI Blue (9632) Pacific SST Intel ASCI Red (9152) ASCI White Pacific (8192) (5808) SGI ASCI Blue Mountain (5040)
8 TOP500 Status 1st List in June th List on November 3, 2000 in Dallas 17th List on June 21, 2001 in Heidelberg Accepted by users and manufacturers
9
10 TOP500 Authors - Started in spring 1993 by: Hans W. Meuer and Erich Strohmaier - Authors since 06/1993 and 11/2000 Jack Dongarra Horst Simon
11
12 Outlook TOP500 Approach Snapshots in Time Development over Time Customer Types TOP500 Plans
13 TOP500 list - data shown Manufacturer Manufacturer or vendor Computer Type Indicated by manufacturer or vendor Installation Site Customer Location Location and country Year Year of installation/last major update Customer Segment Academic, Research, Industry, Vendor, Class. # Processors Number of processors R max Maximal LINPACK performance achieved R peak Theoretical peak performance N max N 1/2 N world Problemsize for achieving R max Problemsize for achieving half of R max Position within the TOP500 ranking
14 RANK TOP10 06/2001 MANU- FACTURER 1 IBM 2 IBM COMPUTER ASCI White SP Power3 375 MHz SP Power3 375 MHz 16 way R MAX [TF/S] Intel ASCI Red IBM ASCI Blue Pacific SST, IBM SP 604E INSTALLATION SITE Lawrence Livermore National Laboratory COUNTRY YEAR USA 2000 AREA OF INSTALLATION Research Energy # PROC NERSC/LBNL, Berkeley USA 2001 Research Sandia National Laboratory, Albuquerque Lawrence Livermore National Laboratory USA 1999 Research 9632 USA 1999 Research Energy 5 Hitachi SR8000/MPP 1.71 University of Tokyo Japan 2001 Academic SGI 7 IBM 8 NEC 9 IBM 10 IBM ASCI Blue Mountain SP Power3 375 MHz SX-5/128 M3 3.2 ns SP Power3 375 MHz SP Power3 375 MHz Los Alamos National Laboratory Naval Oceanographic Office, Bay St. Louis 5808 USA 1998 Research 6144 USA 2000 Research Aerospace Osaka University Japan 2001 Academic National Centers for Environmental Predicition National Centers for Environmental Predicition USA 2000 USA 2001 Research Weather Research Weather
15 TOP10 - Sun 06/2001 RANK MANU- FACTURER 57 Sun 58 Sun 59 Sun 60 Sun 61 Sun 168 Sun 169 Sun 170 Sun 171 Sun 172 Sun COMPUTER HPC MHz Cluster HPC MHz Cluster HPC MHz Cluster HPC MHz Cluster HPC MHz Cluster HPC MHz Cluster HPC MHz Cluster HPC MHz Cluster HPC MHz Cluster HPC MHz Cluster R MAX [TF/S] INSTALLATION SITE COUNTRY YEAR AREA OF INSTALLATION # PROC 0.42 Defense, Stockholm Sweden 1999 Classified Service Provider USA Service Provider USA 2000 Industry WWW Industry WWW 0.42 Sun, Burlington USA 2000 Vendor Sun, Sunnyvale USA 2000 Vendor Clearstream Services, Grande Duchesse Luxemburg Motorola, Scottsdale USA New York City Human Resources 0.14 Sun, Broomfield USA US Army Research Laboratory, Aberdeen Industry Finance Industry Electronics USA 1999 Government 256 Industry WWW 256 USA 1999 Research 256
16 Systems installed 06/2001 Industrial/Commercial 49 % Research 22 % Academic 18 % Total 500 Classified 7 % Government 1 % Vendor 3 %
17 Systems installed 06/1995 Industrial/Commercial 20 % Research 38 % Vendor 12 % Classified 5 % Academic 31 % Total 500
18 Outlook TOP500 Approach Snapshots in Time Development over Time Customer Types TOP500 Plans
19 Performance Development 100 Tflop/s 10 Tflop/s 1 Tflop/s 100 Gflop/s 10 Gflop/s 1 Gflop/s 100 Mflop/s TF/s 59.7 GF/s Intel XP/S140 Sandia 0.4 GF/s SNI VP200EX Uni Dresden Jun 93 Nov 93 Jun 94 Fujitsu 'NWT' NAL SUM N=1 Hitachi/Tsukuba CP-PACS/2048 N=500 Intel ASCI Red Sandia Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov TF/s 4.94 TF/s IBM ASCI White LLNL 55.1 GF/s IBM SP PC604e 130 processors Alcatel Jun 99 Nov 99 Jun 00 Nov 00
20 Performance Development 1 PFlop/s 100 TFlop/s 10 TFlop/s Earth Simulator ASCI 1 TFlop/s SUM 100 GFlop/s N=1 10 GFlop/s N=10 1 GFlop/s 100 MFlop/s N=500 Jun 93 Jun 94 Jun 95 Jun 96 Jun 97 Jun 98 Jun 99 Jun 00 Jun 01 Jun 02 Jun 03 Jun 04 Jun 05
21 Moore s Law and Peak Performance of Various Computers over Time ASCI White 1 TFlop/s ASCI Red TMC CM-5 Cray T3D 1 GFlop/s TMC CM-2 Cray 2 Cray X-MP Cray 1 1 MFlop/s CDC 6600 CDC 7600 IBM 360/195 IBM KFlop/s UNIVAC 1 EDSAC
22 Continents others Japan 300 Europe USA/Canada 0 Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
23 Producers 500 Europe Japan USA Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
24 Europe - Countries others Switzerland Benelux Scandinavia France UK Germany 0 Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
25 Kflops per Inhabitant USA Scandinavia Germany UK Japan Switzerland France New Zealand Luxembourg 0 11/2000
26 Manufacturers others Fujitsu Intel TMC SGI Cray Hitachi NEC Convex/HP Sun IBM Systems 0 Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
27 100% 90% 80% 70% Manufacturers - Performance others Convex/HP Sun Hitachi NEC Fujitsu 60% Intel 50% 40% TMC IBM SGI 30% 20% 10% Cray 0% Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
28 Cray Cray Computer SGI CDC/ETA Fujitsu NEC Hitachi Convex/HP TMC Intel ncube Alliant FPS Meiko Parsytec MasPar DEC/Compaq KSR IBM Sun
29 Processor Type SIMD Vector Scalar Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
30 Chip Technology 500 other COTS proprietary 400 Sparc MIPS HP Power intel Alpha Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
31 Architectures 500 SIMD Constellation Cluster - NOW MPP Single Processor SMP Jun-93 Nov-93 Jun-94 Nov-94 Jun-95 Nov-95 Jun-96 Nov-96 Jun-97 Nov-97 Jun-98 Nov-98 Jun-99 Nov-99 Jun-00 Nov-00
32 Outlook TOP500 Approach Snapshots in Time Development over Time Customer Types TOP500 Plans
33 500 Customer Types Vendor Classified 400 Academic Industrial/Commercial 100 Research 0 Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
34 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Customer Types - Performance Vendor Classified Academic Research Industrial/Commercial Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
35 Industrial/Commercial Applications Unknown 100 Commercial 50 0 Engineering Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
36 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Customer Types - USA Other Academic Industrial/Commercial Research Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
37 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Customer Types - Europe Other Academic Industrial/Commercial Research Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
38 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Customer Types - Japan Other Academic Industrial/Commercial Research Jun 93 Nov 93 Jun 94 Nov 94 Jun 95 Nov 95 Jun 96 Nov 96 Jun 97 Nov 97 Jun 98 Nov 98 Jun 99 Nov 99 Jun 00 Nov 00
39 Manufacturers 45% 40% 35% 30% Total % 20% 15% 10% 5% 0% Compaq Cray Inc. Fujitsu Hitachi IBM NEC SGI SUN Self Made Others 11/2000
40 11/2000 Share of Customer Types 100% Σ % 80% 70% 60% 50% 40% 30% 20% Other Academic Research Industrial/Commercial 10% 0% Compaq Cray Inc. Fujitsu Hitachi IBM NEC SGI SUN
41 Industrial/Commercial Other Share of Customer Types Japan Inc 11/97 Japan Inc 11/98 Japan Inc 11/99 Japan Inc 11/00 IBM 11/97 IBM 11/98 IBM 11/99 IBM 11/00 SUN 11/97 SUN 11/98 SUN 11/99 SUN 11/00 Total 11/97 Total 11/98 Total 11/99 Total 11/00 0 0
42 Industrial/Commercial Other 100% Share of Customer Types 100 % 90% 90 % 80% 80 % 70% 70 % 60% 60 % 50% 50 % 40% 40 % 30% 30 % 20% 20 % 10% 10 % Japan Inc 11/97 Japan Inc 11/98 Japan Inc 11/99 Japan Inc 11/00 IBM 11/97 IBM 11/98 IBM 11/99 IBM 11/00 SUN 11/97 SUN 11/98 SUN 11/99 SUN 11/00 Total 11/97 Total 11/98 Total 11/99 Total 11/00 0% 0 %
43 Share of Customer Types - Sun 100% 90% 80% 70% 60% 50% SUN 11/98 SUN 11/99 SUN 11/00 SUN 06/01 Total 11/97 Total 11/98 Total 11/99 Total 11/00 Total 06/01 SUN 11/97 40% 30% 20% 10% 0% SUN 11/97 SUN 11/98 SUN 11/99 SUN 11/00 SUN 06/01 Total 11/97 Total 11/98 Total 11/99 Total 11/00 Total 06/01 + Industrial/Commercial + Other
44 Outlook TOP500 Approach Snapshots in Time Development over Time Customer Types TOP500 Plans
45 clusters.top500.org
46 17th TOP500 list to be published at SC2001 in Heidelberg we are just finalizing the work with the 17th list here are some speculations about the new list: - we expect again IBM to dominate the list as far as the number of systems is concerned and as a performance leader - we believe that the Supercomputer System NEC SX5/128 M8 at Osaka University will make the TOP10 of the new list exceeding 1 Tflop/s R max performance - we expect an entry level performance for the new list lower than 70 Gflop/s
47
48 TOP500 Limitations Snapshot in time LINPACK R max overestimates MPP systems Actual usage is unknown
49 LINPACK Efficiency Vector All Scalar SIMD Jun-93 Nov-93 Jun-94 Nov-94 Jun-95 Nov-95 Jun-96 Nov-96 Jun-97 Nov-97 Jun-98 Nov-98 Jun-99 Nov-99 Jun-00 Nov-00
50 Processor Performance Vector Scalar Peak Performance [GFlop/s] 0.01 Jun-93 Nov-93 Jun-94 Nov-94 Jun-95 Nov-95 Jun-96 Nov-96 Jun-97 Nov-97 Jun-98 Nov-98 Jun-99 Nov-99 Jun-00 Nov-00
51 Problems with LINPACK Commercial DB systems don t care about floating point New architectures - compute farms not designed to run LINPACK Self-made cluster no vendor to measure LINPACK every system is different
52 TOP500 Plans Talks with experts since 3 years on how to resolve these issues Q: How can we provide better information for different application and architecture domains? A: Make additional lists
53 TOP500 Plans Collaborate with research centers (NERSC, ICL,...) which develop new benchmarks Feedback about benchmarks TOP500.org will provide free access to benchmark results and possibilities for re-ranking
54 Thank you! The PowerPoint slides of this presentation can be downloaded at:
High Performance Computing in Europe and USA: A Comparison
High Performance Computing in Europe and USA: A Comparison Hans Werner Meuer University of Mannheim and Prometeus GmbH 2nd European Stochastic Experts Forum Baden-Baden, June 28-29, 2001 Outlook Introduction
Presentation of the 16th List
Presentation of the 16th List Hans- Werner Meuer, University of Mannheim Erich Strohmaier, University of Tennessee Jack J. Dongarra, University of Tennesse Horst D. Simon, NERSC/LBNL SC2000, Dallas, TX,
TOP500 Listen und industrielle/kommerzielle Anwendungen
TOP500 Listen und industrielle/kommerzielle Anwendungen Hans Werner Meuer Universität Mannheim Gesprächsrunde Nichtnumerische Anwendungen im Bereich des Höchstleistungsrechnens des BMBF Berlin, 16./ 17.
The TOP500 list. Hans-Werner Meuer University of Mannheim. SPEC Workshop, University of Wuppertal, Germany September 13, 1999
The TOP500 list Hans-Werner Meuer University of Mannheim SPEC Workshop, University of Wuppertal, Germany September 13, 1999 Outline TOP500 Approach HPC-Market as of 6/99 Market Trends, Architecture Trends,
The TOP500 Project of the Universities Mannheim and Tennessee
The TOP500 Project of the Universities Mannheim and Tennessee Hans Werner Meuer University of Mannheim EURO-PAR 2000 29. August - 01. September 2000 Munich/Germany Outline TOP500 Approach HPC-Market as
Supercomputing im Jahr eine Analyse mit Hilfe der TOP500 Listen
Supercomputing im Jahr 2000 - eine Analyse mit Hilfe der TOP500 Listen Hans Werner Meuer Universität Mannheim Feierliche Inbetriebnahme von CLIC TU Chemnitz 11. Oktober 2000 TOP500 CLIC TU Chemnitz View
Das TOP500-Projekt der Universitäten Mannheim und Tennessee zur Evaluierung des Supercomputer Marktes
Das TOP500-Projekt der Universitäten Mannheim und Tennessee zur Evaluierung des Supercomputer Marktes Hans-Werner Meuer Universität Mannheim RUM - Kolloquium 11. Januar 1999, 11:00 Uhr Outline TOP500 Approach
TOP500 List s Twice-Yearly Snapshots of World s Fastest Supercomputers Develop Into Big Picture of Changing Technology
TOP500 List s Twice-Yearly Snapshots of World s Fastest Supercomputers Develop Into Big Picture of Changing Technology BY ERICH STROHMAIER COMPUTER SCIENTIST, FUTURE TECHNOLOGIES GROUP, LAWRENCE BERKELEY
High Performance Computing in Europe and USA: A Comparison
High Performance Computing in Europe and USA: A Comparison Erich Strohmaier 1 and Hans W. Meuer 2 1 NERSC, Lawrence Berkeley National Laboratory, USA 2 University of Mannheim, Germany 1 Introduction In
An Overview of High Performance Computing
IFIP Working Group 10.3 on Concurrent Systems An Overview of High Performance Computing Jack Dongarra University of Tennessee and Oak Ridge National Laboratory 1/3/2006 1 Overview Look at fastest computers
Presentations: Jack Dongarra, University of Tennessee & ORNL. The HPL Benchmark: Past, Present & Future. Mike Heroux, Sandia National Laboratories
HPC Benchmarking Presentations: Jack Dongarra, University of Tennessee & ORNL The HPL Benchmark: Past, Present & Future Mike Heroux, Sandia National Laboratories The HPCG Benchmark: Challenges It Presents
Jack Dongarra University of Tennessee and Oak Ridge National Laboratory
Seminario EEUU/Venezuela de Computación de Alto Rendimiento 2000 US/Venezuela Workshop on High Performance Computing 2000 - WoHPC 2000 4 al 6 de Abril del 2000 Puerto La Cruz Venezuela Jack Dongarra University
An Overview of High Performance Computing. Jack Dongarra University of Tennessee and Oak Ridge National Laboratory 11/29/2005 1
An Overview of High Performance Computing Jack Dongarra University of Tennessee and Oak Ridge National Laboratory 11/29/ 1 Overview Look at fastest computers From the Top5 Some of the changes that face
The marketplace of high-performance computing
Parallel Computing 25 (1999) 1517±1544 www.elsevier.com/locate/parco The marketplace of high-performance computing Erich Strohmaier a, *, Jack J. Dongarra a,b, Hans W. Meuer c, Horst D. Simon d a Computer
Fabio AFFINITO.
Introduction to High Performance Computing Fabio AFFINITO What is the meaning of High Performance Computing? What does HIGH PERFORMANCE mean??? 1976... Cray-1 supercomputer First commercial successful
Real Parallel Computers
Real Parallel Computers Modular data centers Overview Short history of parallel machines Cluster computing Blue Gene supercomputer Performance development, top-500 DAS: Distributed supercomputing Short
Recent Trends in the Marketplace of High Performance Computing
Recent Trends in the Marketplace of High Performance Computing Erich Strohmaier 1, Jack J. Dongarra 2, Hans W. Meuer 3, and Horst D. Simon 4 High Performance Computing, HPC Market, Supercomputer Market,
Making a Case for a Green500 List
Making a Case for a Green500 List S. Sharma, C. Hsu, and W. Feng Los Alamos National Laboratory Virginia Tech Outline Introduction What Is Performance? Motivation: The Need for a Green500 List Challenges
High Performance Computing
CSC630/CSC730: Parallel & Distributed Computing Trends in HPC 1 High Performance Computing High-performance computing (HPC) is the use of supercomputers and parallel processing techniques for solving complex
Recent trends in the marketplace of high performance computing
Parallel Computing 31 (2005) 261 273 www.elsevier.com/locate/parco Recent trends in the marketplace of high performance computing Erich Strohmaier a, *, Jack J. Dongarra b,c, Hans W. Meuer d, Horst D.
Supercomputers. Alex Reid & James O'Donoghue
Supercomputers Alex Reid & James O'Donoghue The Need for Supercomputers Supercomputers allow large amounts of processing to be dedicated to calculation-heavy problems Supercomputers are centralized in
ECE5610/CSC6220 Models of Parallel Computers. Recap: What is Parallel Computer?
ECE5610/CSC6220 Models of Parallel Computers Professor Cheng-Zhong Xu Department of Electrical/Computer Engineering Wayne State University Recap: What is Parallel Computer? A parallel computer is a collection
The Center for Computational Research
The Center for Computational Research Russ Miller Director, Center for Computational Research UB Distinguished Professor, Computer Science & Engineering Senior Research Scientist, Hauptman-Woodward Medical
Multi-core Programming - Introduction
Multi-core Programming - Introduction Based on slides from Intel Software College and Multi-Core Programming increasing performance through software multi-threading by Shameem Akhter and Jason Roberts,
The Mont-Blanc approach towards Exascale
http://www.montblanc-project.eu The Mont-Blanc approach towards Exascale Alex Ramirez Barcelona Supercomputing Center Disclaimer: Not only I speak for myself... All references to unavailable products are
Self Adapting Numerical Software. Self Adapting Numerical Software (SANS) Effort and Fault Tolerance in Linear Algebra Algorithms
Self Adapting Numerical Software (SANS) Effort and Fault Tolerance in Linear Algebra Algorithms Jack Dongarra University of Tennessee and Oak Ridge National Laboratory 9/19/2005 1 Overview Quick look at
Jack Dongarra University of Tennessee Oak Ridge National Laboratory University of Manchester
Jack Dongarra University of Tennessee Oak Ridge National Laboratory University of Manchester 12/24/09 1 Take a look at high performance computing What s driving HPC Future Trends 2 Traditional scientific
It s a Multicore World. John Urbanic Pittsburgh Supercomputing Center
It s a Multicore World John Urbanic Pittsburgh Supercomputing Center Waiting for Moore s Law to save your serial code start getting bleak in 2004 Source: published SPECInt data Moore s Law is not at all
Advanced Topics in Computer Architecture
Advanced Topics in Computer Architecture Lecture 7 Data Level Parallelism: Vector Processors Marenglen Biba Department of Computer Science University of New York Tirana Cray I m certainly not inventing
CS 5803 Introduction to High Performance Computer Architecture: Performance Metrics
CS 5803 Introduction to High Performance Computer Architecture: Performance Metrics A.R. Hurson 323 Computer Science Building, Missouri S&T hurson@mst.edu 1 Instructor: Ali R. Hurson 323 CS Building hurson@mst.edu
Parallel computer architecture classification
Parallel computer architecture classification Hardware Parallelism Computing: execute instructions that operate on data. Computer Instructions Data Flynn s taxonomy (Michael Flynn, 1967) classifies computer
Jack Dongarra INNOVATIVE COMP ING LABORATORY. University i of Tennessee Oak Ridge National Laboratory
Computational Science, High Performance Computing, and the IGMCS Program Jack Dongarra INNOVATIVE COMP ING LABORATORY University i of Tennessee Oak Ridge National Laboratory 1 The Third Pillar of 21st
Outline. Execution Environments for Parallel Applications. Supercomputers. Supercomputers
Outline Execution Environments for Parallel Applications Master CANS 2007/2008 Departament d Arquitectura de Computadors Universitat Politècnica de Catalunya Supercomputers OS abstractions Extended OS
Overview. High Performance Computing - History of the Supercomputer. Modern Definitions (II)
Overview High Performance Computing - History of the Supercomputer Dr M. Probert Autumn Term 2017 Early systems with proprietary components, operating systems and tools Development of vector computing
Trends in HPC (hardware complexity and software challenges)
Trends in HPC (hardware complexity and software challenges) Mike Giles Oxford e-research Centre Mathematical Institute MIT seminar March 13th, 2013 Mike Giles (Oxford) HPC Trends March 13th, 2013 1 / 18
Dr. Joe Zhang PDC-2: Introduction
CSC630/CSC730: Parallel & Distributed Computing Introduction to PDC 1 Contents Basic concept of parallel computing Need for parallel computing Classification of parallel computer system Hardware architecture
Confessions of an Accidental Benchmarker
Confessions of an Accidental Benchmarker http://bit.ly/hpcg-benchmark 1 Appendix B of the Linpack Users Guide Designed to help users extrapolate execution Linpack software package First benchmark report
Leistungsanalyse von Rechnersystemen
Center for Information Services and High Performance Computing (ZIH) Leistungsanalyse von Rechnersystemen 10. November 2010 Nöthnitzer Straße 46 Raum 1026 Tel. +49 351-463 - 35048 Holger Brunst (holger.brunst@tu-dresden.de)
Dheeraj Bhardwaj May 12, 2003
HPC Systems and Models Dheeraj Bhardwaj Department of Computer Science & Engineering Indian Institute of Technology, Delhi 110 016 India http://www.cse.iitd.ac.in/~dheerajb 1 Sequential Computers Traditional
It s a Multicore World. John Urbanic Pittsburgh Supercomputing Center Parallel Computing Scientist
It s a Multicore World John Urbanic Pittsburgh Supercomputing Center Parallel Computing Scientist Waiting for Moore s Law to save your serial code started getting bleak in 2004 Source: published SPECInt
Roadmapping of HPC interconnects
Roadmapping of HPC interconnects MIT Microphotonics Center, Fall Meeting Nov. 21, 2008 Alan Benner, bennera@us.ibm.com Outline Top500 Systems, Nov. 2008 - Review of most recent list & implications on interconnect
Commodity Cluster Computing
Commodity Cluster Computing Ralf Gruber, EPFL-SIC/CAPA/Swiss-Tx, Lausanne http://capawww.epfl.ch Commodity Cluster Computing 1. Introduction 2. Characterisation of nodes, parallel machines,applications
Stockholm Brain Institute Blue Gene/L
Stockholm Brain Institute Blue Gene/L 1 Stockholm Brain Institute Blue Gene/L 2 IBM Systems & Technology Group and IBM Research IBM Blue Gene /P - An Overview of a Petaflop Capable System Carl G. Tengwall
European energy efficient supercomputer project
http://www.montblanc-project.eu European energy efficient supercomputer project Simon McIntosh-Smith University of Bristol (Based on slides from Alex Ramirez, BSC) Disclaimer: Speaking for myself... All
During 1995, Cray Research, Fujitsu, IBM, Intel, NEC, and Silicon Graphics introduced new
view point Gordon Bell Photo illustration by Robert Vizzini 1995 Observations on Supercomputing Alternatives: Did the MPP Bandwagon Lead to a Cul-de-Sac? or over a decade, governf ment and the technical
Start Voyager: Message Passing and DSM on SMP Clusters
HPCS 97 --1 Start Voyager: Message Passing and DSM on SMP Clusters Laboratory for Computer Science Massachusetts Institute of Technology Massively Parallel Processors Shared Memory Cache-coherent KSR HP-Convex
CSE 260 Introduction to Parallel Computation
CSE 260 Introduction to Parallel Computation Larry Carter carter@cs.ucsd.edu Office Hours: AP&M 4101 MW 10:00-11 or by appointment 9/20/2001 Topics Instances Principles Theory Hardware specific machines
represent parallel computers, so distributed systems such as Does not consider storage or I/O issues
Top500 Supercomputer list represent parallel computers, so distributed systems such as SETI@Home are not considered Does not consider storage or I/O issues Both custom designed machines and commodity machines
Japanese Supercomputer Project. Jun Makino. University of Tokyo
Japanese Supercomputer Project Jun Makino University of Tokyo Japanese Supercomputer Project is the title of my talk in the program Japanese Supercomputer Project is the title of my talk in the program
CSE5351: Parallel Procesisng. Part 1B. UTA Copyright (c) Slide No 1
Slide No 1 CSE5351: Parallel Procesisng Part 1B Slide No 2 State of the Art In Supercomputing Several of the next slides (or modified) are the courtesy of Dr. Jack Dongarra, a distinguished professor of
20 Jahre TOP500 mit einem Ausblick auf neuere Entwicklungen
20 Jahre TOP500 mit einem Ausblick auf neuere Entwicklungen Hans Meuer Prometeus GmbH & Universität Mannheim hans@meuer.de ZKI Herbsttagung in Leipzig 11. - 12. September 2012 page 1 Outline Mannheim Supercomputer
NOW Handout Page 1 NO! Today s Goal: CS 258 Parallel Computer Architecture. What will you get out of CS258? Will it be worthwhile?
Today s Goal: CS 258 Parallel Computer Architecture Introduce you to Parallel Computer Architecture Answer your questions about CS 258 Provide you a sense of the trends that shape the field CS 258, Spring
The next generation supercomputer. Masami NARITA, Keiichi KATAYAMA Numerical Prediction Division, Japan Meteorological Agency
The next generation supercomputer and NWP system of JMA Masami NARITA, Keiichi KATAYAMA Numerical Prediction Division, Japan Meteorological Agency Contents JMA supercomputer systems Current system (Mar
An Overview of Computational Science (Based on CSEP)
An Overview of Computational Science (Based on CSEP) Craig C. Douglas January 20-22, 2004 CS 521, Spring 2004 What Is Computational Science? There is no uniformly accepted definition!!! Ken Wilson s definition,
Number of processing elements (PEs). Computing power of each element. Amount of physical memory used. Data access, Communication and Synchronization
Parallel Computer Architecture A parallel computer is a collection of processing elements that cooperate to solve large problems fast Broad issues involved: Resource Allocation: Number of processing elements
It s a Multicore World. John Urbanic Pittsburgh Supercomputing Center Parallel Computing Scientist
It s a Multicore World John Urbanic Pittsburgh Supercomputing Center Parallel Computing Scientist Waiting for Moore s Law to save your serial code started getting bleak in 2004 Source: published SPECInt
Parallel Machines. Lecture 6
Lecture 6 Parallel Machines A parallel computer is a connected configuration of processors and memories. The choice space available to a computer architect includes the network topology, the node processor,
Real Parallel Computers
Real Parallel Computers Modular data centers Background Information Recent trends in the marketplace of high performance computing Strohmaier, Dongarra, Meuer, Simon Parallel Computing 2005 Short history
Top500
Top500 www.top500.org Salvatore Orlando (from a presentation by J. Dongarra, and top500 website) 1 2 MPPs Performance on massively parallel machines Larger problem sizes, i.e. sizes that make sense Performance
What are Clusters? Why Clusters? - a Short History
What are Clusters? Our definition : A parallel machine built of commodity components and running commodity software Cluster consists of nodes with one or more processors (CPUs), memory that is shared by
MIMD Overview. Intel Paragon XP/S Overview. XP/S Usage. XP/S Nodes and Interconnection. ! Distributed-memory MIMD multicomputer
MIMD Overview Intel Paragon XP/S Overview! MIMDs in the 1980s and 1990s! Distributed-memory multicomputers! Intel Paragon XP/S! Thinking Machines CM-5! IBM SP2! Distributed-memory multicomputers with hardware
Chapter 1. Introduction To Computer Systems
Chapter 1 Introduction To Computer Systems 1.1 Historical Background The first program-controlled computer ever built was the Z1 (1938). This was followed in 1939 by the Z2 as the first operational program-controlled
Technologies for Information and Health
Energy Defence and Global Security Technologies for Information and Health Atomic Energy Commission HPC in France from a global perspective Pierre LECA Head of «Simulation and Information Sciences Dpt.»
Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory
Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory Title TOP500 Supercomputers for June 2005 Permalink https://escholarship.org/uc/item/4h84j873 Authors Strohmaier, Erich Meuer,
Introduction of Fujitsu s next-generation supercomputer
Introduction of Fujitsu s next-generation supercomputer MATSUMOTO Takayuki July 16, 2014 HPC Platform Solutions Fujitsu has a long history of supercomputing over 30 years Technologies and experience of
CS 267: Introduction to Parallel Machines and Programming Models Lecture 3 "
CS 267: Introduction to Parallel Machines and Programming Models Lecture 3 " James Demmel www.cs.berkeley.edu/~demmel/cs267_spr16/!!! Outline Overview of parallel machines (~hardware) and programming models
Kengo Nakajima Information Technology Center, The University of Tokyo. SC15, November 16-20, 2015 Austin, Texas, USA
ppopen-hpc Open Source Infrastructure for Development and Execution of Large-Scale Scientific Applications on Post-Peta Scale Supercomputers with Automatic Tuning (AT) Kengo Nakajima Information Technology
Comparison of Parallel Processing Systems. Motivation
Comparison of Parallel Processing Systems Ash Dean Katie Willis CS 67 George Mason University Motivation Increasingly, corporate and academic projects require more computing power than a typical PC can
Early Evaluation of the Cray X1 at Oak Ridge National Laboratory
Early Evaluation of the Cray X1 at Oak Ridge National Laboratory Patrick H. Worley Thomas H. Dunigan, Jr. Oak Ridge National Laboratory 45th Cray User Group Conference May 13, 2003 Hyatt on Capital Square
Supercomputing with Commodity CPUs: Are Mobile SoCs Ready for HPC?
Supercomputing with Commodity CPUs: Are Mobile SoCs Ready for HPC? Nikola Rajovic, Paul M. Carpenter, Isaac Gelado, Nikola Puzovic, Alex Ramirez, Mateo Valero SC 13, November 19 th 2013, Denver, CO, USA
Building supercomputers from commodity embedded chips
http://www.montblanc-project.eu Building supercomputers from commodity embedded chips Alex Ramirez Barcelona Supercomputing Center Technical Coordinator This project and the research leading to these results
CS 267: Introduction to Parallel Machines and Programming Models Lecture 3 "
CS 267: Introduction to Parallel Machines and Lecture 3 " James Demmel www.cs.berkeley.edu/~demmel/cs267_spr15/!!! Outline Overview of parallel machines (~hardware) and programming models (~software) Shared
COSC6365. Introduction to HPC. Lecture 21. Lennart Johnsson Department of Computer Science
Introduction to HPC Lecture 21 Department of Computer Science Most slides from UC Berkeley CS 267 Spring 2011, Lecture 12, Dense Linear Algebra (part 2), Parallel Gaussian Elimination. Jim Demmel Dense
Brand-New Vector Supercomputer
Brand-New Vector Supercomputer NEC Corporation IT Platform Division Shintaro MOMOSE SC13 1 New Product NEC Released A Brand-New Vector Supercomputer, SX-ACE Just Now. Vector Supercomputer for Memory Bandwidth
HPCS HPCchallenge Benchmark Suite
HPCS HPCchallenge Benchmark Suite David Koester, Ph.D. () Jack Dongarra (UTK) Piotr Luszczek () 28 September 2004 Slide-1 Outline Brief DARPA HPCS Overview Architecture/Application Characterization Preliminary
Overview. CS 472 Concurrent & Parallel Programming University of Evansville
Overview CS 472 Concurrent & Parallel Programming University of Evansville Selection of slides from CIS 410/510 Introduction to Parallel Computing Department of Computer and Information Science, University
Jack Dongarra University of Tennessee Oak Ridge National Laboratory
Jack Dongarra University of Tennessee Oak Ridge National Laboratory 3/9/11 1 TPP performance Rate Size 2 100 Pflop/s 100000000 10 Pflop/s 10000000 1 Pflop/s 1000000 100 Tflop/s 100000 10 Tflop/s 10000
Chapter 5b: top500. Top 500 Blades Google PC cluster. Computer Architecture Summer b.1
Chapter 5b: top500 Top 500 Blades Google PC cluster Computer Architecture Summer 2005 5b.1 top500: top 10 Rank Site Country/Year Computer / Processors Manufacturer Computer Family Model Inst. type Installation
Overview and history of high performance computing
Overview and history of high performance computing CPS343 Parallel and High Performance Computing Spring 2018 CPS343 (Parallel and HPC) Overview and history of high performance computing Spring 2018 1
The Supercomputer Industry in Light of the Top500 Data
The Supercomputer Industry in Light of the Top500 Data Dror G. Feitelson School of Computer Science and Engineering The Hebrew University of Jerusalem 91904 Jerusalem, Israel Abstract The Top500 list lists
An Overview of High Performance Computing and Challenges for the Future
An Overview of High Performance Computing and Challenges for the Future Jack Dongarra University of Tennessee Oak Ridge National Laboratory University of Manchester 6/15/2009 1 H. Meuer, H. Simon, E. Strohmaier,
CS267 / E233 Applications of Parallel Computers. Lecture 1: Introduction 1/18/99
CS267 / E233 Applications of Parallel Computers Lecture 1: Introduction 1/18/99 James Demmel demmel@cs.berkeley.edu http://www.cs.berkeley.edu/~demmel/cs267_spr99 CS267 L1 Intro Demmel Sp 1999 Outline
SC2002, Baltimore (http://www.sc-conference.org/sc2002) From the Earth Simulator to PC Clusters
SC2002, Baltimore (http://www.sc-conference.org/sc2002) From the Earth Simulator to PC Clusters Structure of SC2002 Top500 List Dinosaurs Department Earth simulator US -answers (Cray SX1, ASCI purple),
HPC Technology Trends
HPC Technology Trends High Performance Embedded Computing Conference September 18, 2007 David S Scott, Ph.D. Petascale Product Line Architect Digital Enterprise Group Risk Factors Today s s presentations
Intro to Multiprocessors
The Big Picture: Where are We Now? Intro to Multiprocessors Output Output Datapath Input Input Datapath [dapted from Computer Organization and Design, Patterson & Hennessy, 2005] Multiprocessor multiple
CS 252 Graduate Computer Architecture. Lecture 17 Parallel Processors: Past, Present, Future
CS 252 Graduate Computer Architecture Lecture 17 Parallel Processors: Past, Present, Future Krste Asanovic Electrical Engineering and Computer Sciences University of California, Berkeley http://www.eecs.berkeley.edu/~krste
Parallel Languages: Past, Present and Future
Parallel Languages: Past, Present and Future Katherine Yelick U.C. Berkeley and Lawrence Berkeley National Lab 1 Kathy Yelick Internal Outline Two components: control and data (communication/sharing) One
Fujitsu's Approach to High Performance Computing
Preface Fujitsu's Approach to High Performance Computing Yoshihiro Kosaka General anager HPC ivision 1. Introduction he demand for increasing calculation capability in the High Performance Computing (HPC)
ECE 574 Cluster Computing Lecture 2
ECE 574 Cluster Computing Lecture 2 Vince Weaver http://web.eece.maine.edu/~vweaver vincent.weaver@maine.edu 24 January 2019 Announcements Put your name on HW#1 before turning in! 1 Top500 List November
Linux Networx HPC Strategy and Roadmap
Linux Networx HPC Strategy and Roadmap Eric Pitcher October 2006 Agenda Business Update Technology Trends Linux Networx Drivers Hardware Roadmap Software Highlights Linux Networx Overview Founded in 1989,
Future planning of the next generation supercomputing in Japan. Yoshio Oyanagi Kobe University
Future planning of the next generation supercomputing in Japan - Historical overview of Japan and US HPC s - What is the difference between Japan and US trends? - How can we go beyond Petaflops? Yoshio
Introduction to Parallel Programming
Introduction to Parallel Programming ATHENS Course on Parallel Numerical Simulation Munich, March 19 23, 2007 Dr. Ralf-Peter Mundani Scientific Computing in Computer Science Technische Universität München
An Overview of High Performance Computing and Future Requirements
An Overview of High Performance Computing and Future Requirements Jack Dongarra University of Tennessee Oak Ridge National Laboratory 1 H. Meuer, H. Simon, E. Strohmaier, & JD - Listing of the 500 most
ECE 574 Cluster Computing Lecture 1
ECE 574 Cluster Computing Lecture 1 Vince Weaver http://web.eece.maine.edu/~vweaver vincent.weaver@maine.edu 22 January 2019 ECE574 Distribute and go over syllabus http://web.eece.maine.edu/~vweaver/classes/ece574/ece574_2019s.pdf
Node Hardware. Performance Convergence
Node Hardware Improved microprocessor performance means availability of desktop PCs with performance of workstations (and of supercomputers of 10 years ago) at significanty lower cost Parallel supercomputers
The Bulk Synchronous Parallel Model (PSC 1.2) Lecture 1.2 Bulk Synchronous Parallel Model p.1
The Bulk Synchronous Parallel Model (PSC 1.2) Lecture 1.2 Bulk Synchronous Parallel Model p.1 What is a parallel computer? switch switch switch switch PC PC PC PC PC PC PC PC A parallel computer consists
6.189 IAP Lecture 3. Introduction to Parallel Architectures. Prof. Saman Amarasinghe, MIT IAP 2007 MIT
6.189 IAP 2007 Lecture 3 Introduction to Parallel Architectures 1 6.189 IAP 2007 MIT Implicit vs. Explicit Parallelism Implicit Explicit Hardware Compiler Superscalar Processors Explicitly Parallel Architectures
The Center for Computational Research & Grid Computing
The Center for Computational Research & Grid Computing Russ Miller Center for Computational Research Computer Science & Engineering SUNY-Buffalo Hauptman-Woodward Medical Inst NSF, NIH, DOE NIMA, NYS,
Introduction to Parallel Processing
Introduction to Parallel Processing Parallel Computer Architecture: Definition & Broad issues involved A Generic Parallel Computer Architecture The Need And Feasibility of Parallel Computing Scientific
Practical Scientific Computing
Practical Scientific Computing Performance-optimized Programming Preliminary discussion: July 11, 2008 Dr. Ralf-Peter Mundani, mundani@tum.de Dipl.-Ing. Ioan Lucian Muntean, muntean@in.tum.de MSc. Csaba