High Performance Computing

Transcription

1 CSC630/CSC730: Parallel & Distributed Computing Trends in HPC 1 High Performance Computing High-performance computing (HPC) is the use of supercomputers and parallel processing techniques for solving complex computational problems. HPC technology focuses on developing parallel processing algorithms and systems by incorporating both administration and parallel computational techniques. 2 1

2 Relation with Other Paradigms Grid Computing, MIERSI, DCC/FCUP 3 Grid Computing Grid computing A form of distributed and parallel computing, whereby a 'super and virtual computer' is composed of a cluster of networked, loosely coupled computers acting in concert to perform very large tasks. - wikipedia.org Grid Information Service Grid Resource Broker database R 2 R 3 R 4 Application Grid Resource Broker R 5 R 6 R N R 1 Resource Broker Grid Information Service 2

3 Grid Infrastructure 5 Many Grid Projects & Initiatives Australia Nimrod-G GridSim Virtual Lab Gridbus DISCWorld..new coming up Europe UNICORE MOL UK escience Poland MC Broker EU Data Grid EuroGrid MetaMPI Dutch DAS XW, JaWS Japan Ninf DataFarm Korea... N*Grid USA Globus Legion OGSA Javelin AppLeS NASA IPG Condor-G Jxta NetSolve AccessGrid TeraGrid (NSF) Cycle Stealing &.com Initiatives Distributed.net SETI@Home,. Entropia, UD, Parabon,. Public Forums Global Grid Forum P2P Working Group IEEE TFCC Grid & CCGrid conferences 3

4 Many Testbeds GUSTO 7 Legion Testbed NASA IPG SURAGrid SURAgrid is a consortium of organizations collaborating and combining resources to help bring grid technology to the level of seamless, shared infrastructure. Capabilities to be cultivated include locally contributed resources, project-specific tools and environments, highly specialized or HPC access, and gateways to national and international cyberinfrastructure

5 Cloud Computing Cloud computing is the delivery of computing as a service rather than a product, whereby shared resources, software and information are provided to computers and other devices as a utility (like the electricity grid) over a network (typically the Internet). - wikipedia.org In March 2007, Dell applied to trademark the term "cloud computing" (U.S. Trademark 77,139,082) in the United States 9 Major Applications of Next Generation Supercomputer Targeted as grand challenges 5

6 Basic Concept for Simulations in Life Sciences Meso Organ Organism Vascular Blood System Micro-machine vale.edu/ Circulation Tissue Multi-physics Structure HIFU Cell Tissue Catheter Chemical Bio-MD Process Protein DDS Genome Gene Therapy Macro RIKEN Genes Micro RIKEN Top Trends in HPC The global economy in HPC is growing again: 2010 grew by 10%, to reach $9.5 billion 2011 grew by 8.4% to reach $10.3 billion HPC revenue for 2012 exceeded $11B ~7% growth over the next 5 years Major challenges for datacenters Power, cooling, real estate, system management Storage and data management continue to grow in importance Software hurdles continue to grow The worldwide Petascale Race is in full speed Big Data and accelerators are hot new technologies 12 6

7 A Growth-Factor of a Billion in Performance in a Career Super Scalar/Vector/Parallel 1 PFlop/s (10 15 ) IBM Parallel BG/L 1 TFlop/s (10 12 ) 1 GFlop/s (10 9 ) 2X Transistors/Chip Every 1.5 Years Super Scalar Vector Cray 1 TMC CM-5 Cray T3D Cray 2 Cray X-MP TMC CM-2 ASCI Red ASCI White Pacific 1 MFlop/s Scalar (10 6 ) IBM KFlop/s (10 3 ) UNIVAC 1 EDSAC 1 CDC 7600 CDC 6600 IBM 360/ (Floating Point operations / second, Flop/s) ,000 (1 KiloFlop/s, KFlop/s) , , ,000,000 (1 MegaFlop/s, MFlop/s) ,000, ,000, ,000,000,000 (1 GigaFlop/s, GFlop/s) ,000,000, ,000,000, ,000,000,000,000 (1 TeraFlop/s, TFlop/s) ,000,000,000, ,000,000,000,000 (131 Tflop/s) PDC-2: 1980 Introduction HPC Performance Development 7

8 Internal Parallelism CPU chip Multi-core processors: Intel dual-core, quad-core Multiple execution cores (functional units, registers, L1 cache) Multiple cores share L2 cache, memory Lower energy consumption Need FAST memory access to provide data to multiple cores Effective memory bandwidth per core is reduced Limiting factor: memoryprocessor bandwidth Functional units + L1 cache 15 Shared L2 cache Between cores Intel Many Core Systems Intel Many Integrated Core Architecture or Intel MIC[Link] Intel MIC Architecture combines many Intel processor cores onto a single chip. Developers interested in programming these cores can use standard C, C++, and FORTRAN source code. 16 8

9 Top 500 Supercomputers (2012) 17 Top 500 Supercomputers (11/2014) 9

10 Tianhe-2 Supercomputer Has retained its position as the world s No. 1 system with a performance of petaflop/s (quadrillions of calculations per second) on the Linpack benchmark System Tianhe-2 (MilkyWay-2) - TH-IVB-FEP Cluster, Intel Xeon E C 2.200GHz, TH Express-2, Intel Xeon Phi 31S1P Cores: 3,120,000 HPC in Mississippi 10

11 HPC at MCSR Available high performance computers Redwood Mimosa Sweetgum A 128-CPU SGI Origin 2800 supercomputer at MCSR School of Computing Clusters Albacore primary HPC cluster in the School of Computing. 22 nodes and 224 cores 216 GB of RAM 8 TB of storage Thanks to Dr. Glover George for technical support! 22 11

12 Research Opportunities DoD The Department of Defense (DOD) High Performance Computing Modernization Program (HPCMP) just completed its fiscal year 2014 investment in supercomputing capability supporting the DOD science, engineering, test and acquisition communities. NSF 23 CSC630/CSC730: Parallel & Distributed Computing Questions? 24 12