SARA SUPERDAG. Amsterdam NL. December 1, Merle Giles Private Sector Program & Economic Development

Transcription

1 SARA SUPERDAG Amsterdam NL December 1, 2010 Merle Giles Private Sector Program & Economic Development National Center for Supercomputing Applications University of Illinois at Urbana-Champaign

2 Industrial Engagement Economic Development Blue Waters Circuitous Knowledge Transfer National Center for Supercomputing Applications University of Illinois at Urbana-Champaign

3 Strategic Value Proposition 1. Return on investment 2. Investment rationale 3. Strategic imperative 4. Cause for collaboration 5. Leverage 6. Utilization metrics 7. Coherent vision Industrial Engagement

4 Industrial Engagement National Center for Supercomputing Applications University of Illinois at Urbana-Champaign

5 NCSA Industrial Engagement 1. engagement model is based on partnership and joint discovery 2. knowledge transfer is circuitous, not unilateral 3. projects are not limited to pure HPC 4. Most projects involve data 5. projects routinely involve academic domain experts Industrial Engagement

6 Design it Build it Fly it " Crash it " " Fix it Yesterday s Innovation Cycle Courtesy: Tom Lange, Procter & Gamble

7 Learning Loop Must Change Costs too much. Takes too long. Development is sequential. Process is NOT innovative. Kills the hired help! Courtesy: Tom Lange, Procter & Gamble

8 Engineering Design is Informed by HPC CAD / CAE HPC But lacks workflow integration. Industrial Engagement

9 Pre-mesh is often 60% of the design cycle CAD / CAE HPC Pre-mesh 60% DATA DATA DATA BladeCenter BladeCenter BladeCenter Industrial Engagement

10 Product Lifecycle Management Bills Of Materials CAD/CAE Information Platform Product Specification Product Design Technical Regs and Standards Product Modeling Production Planning Manufacturing Assembly Quality Assurance Shipping PLM Process Platform Supply Chain Mgmt Cost Accounting data integration Industrial Engagement

11 CLASSICAL HPC MISSION Historically, HPC has focused on science discovery Economic value has also been achieved in HPC derivatives Industrial value keys on discovery and design optimization Increasingly, industry brings world-class problems Industrial Engagement

12 Tomorrow s Engineering Challenge FIDELITY today TIME tomorrow s HPC Challenge Source: Rolls-Royce Shyam Neerarambam COMPLEXITY

13 Discovery is No Longer Sufficient FIDELITY today TIME Industrial Design Cycle tomorrow s HPC Challenge Source: Rolls-Royce Shyam Neerarambam COMPLEXITY

14 Economic Development National Center for Supercomputing Applications University of Illinois at Urbana-Champaign

15 NCSA Bridges Basic Research and Commercialization with Application Over the horizon development Phase 0 Concept/ Vision Phase 1 Feasibility Phase 2 Design/ Development Phase 3 Prototyping Phase 4 Production/ Deployment Product Life Cycle Theoretical & Basic Research Applied Prototyping & Development NCSA Bridges the Gap BETWEEN Basic Research & Commercialization Optimization & Robustification Commercialization & Production (.com or.org) Universities & Labs Application Private Industry Economic Development

16 CSL Digital Computer Lab Basic & Applied Research College of Engineering NCSA ECE Computer Science Imaginations unbound Beckman Institute Institute for Genomic Biology Biotechnology Center

17 Value Creation 3D virtual prototyping at NCSA => Caterpillar s Global Simulation Center in Champaign Full-scale simulation of cell tower activity Reduced reliance on wet labs thru computation Cluster design and architecture HPC-capable fast-network hard drives World s first Internet GUI interface Prototyping Windows HPC Operating System Economic Development

18 Value Creation The HDF Group (pdf-equivalent for data) Linux OS made standard for HPC Apache server software Telnet remote access R-systems hosts Wolfram Alpha Music data analytics at One Llama River Glass spinout recent Boeing buyout TOTAL $$ $1 Trillion per founder Larry Smarr Economic Development

19 Economic Development Industry Partners over time

20 Economic Development CURRENT PARTNERS

21 Headlines (Fall 2010) GERMANY Trade & Invest Partnership is the key to country s thriving R&D landscape. IBM Smarter Planet Thanks to pervasive instrumentation and global interconnection, we are now capturing data in unprecedented volume and variety. IDC Steve Conway There is growing recognition of the close link between supercomputing and scientific advancement as well as industrial competitiveness. Forbes Magazine Consumer technology is now ahead of most industrial technology. Economic Development

22 Increased Attention to Economic Development Impact of global recession Proprietary code is insufficient for economic development Global nature of key commercial codes (ISVs) Increased complexity & need for multi-discipline physics Paradigm shift to data-intensive computing Shared interest in effective software Burden of investment cannot be carried by a single: Community Company Country Economic Development

23 Imaginations unbound

24 Blue Waters National Center for Supercomputing Applications University of Illinois at Urbana-Champaign

25 Leading-Edge Collaboration Yotta Zetta Exa Peta (Bits, Bytes, Flop/s) Tera Mega Giga Blue Waters

26 Blue Waters Expected to Beat 2008 s TOP500 COMBINED! Blue Waters

27 New Performance Driver NCSA s Blue Waters is the first open-access system tasked to achieve 1 petaflop/s on a wide variety of applications. Blue Waters

28 2 Paths to Blue Waters NSF Allocation! Allocation 80%! Peer Review! Faculty, Labs! Industry! Tech Support! FREE cycles PSP! Allocation 7%! Proprietary work! Supply Chain! Com l licensing! Tech Support! Cost-Recovery Blue Waters

29 Integrated/Scalable System +,-%#./0%&1#:>AA"9/"C=/"5-'C"?-:/.H<A",-5?<C/.">F"C=/":-.AJ" H-."',>/FC>M>,"./'/E.,=":=/F">C",-5/'"-F"A>F/">F")N33L" 2)3%&4#5678#!",-./'O"P)"C=./EJ'" Q3O"Q)O"QP",E,=/"(P)"%40" R?"C-")*+"S2"(?/ET0" 3)!"S98'"5/5-.6"9:" Blue Waters Quad-chip Module 4 Power7 chips 128 GB memory 512 GB/s memory bw 1 TF (peak) Hub Chip TB/s bw!"#$%&'%&#()*%#!"#$%&'"()*+",-./'0" "!"12"(!"#$0" %&''()*#+",)-..'"/) +,-%#./0%&1#+-7,*79:#+,);<# P)"B;"'/.I/."F-J/'" ")*+"12"(?/ET0" "P)"14"5/5-.6" "3)!"148'"5/5-.6"9:" 7"YC-.EW/"'6'C/5'"(V*NN"140" 3N"1E?/"J.>I/",-FF/,C>-F' "" +,-%#./0%&1# U3N"@2"@/ET" U3"@2"'<'CE>F/J" VPNNONNN",-./'" U3L)"@4"-H"5/5-.6" V3!"@4"-H"J>'T"'C-.EW/" *NN"@4"-H"E.,=>IEA"'C-.EW/" X3NN"S9?'",-FF/,C>I>C6" +,-%#./0%&1#<C>A>D/'"",-55/.,>EA",-5?-F/FC'"" C=EC":>AA"?-:/."-C=/."'6'C/5'"G" H.-5"'/.I/.'"C-"9/6-FJ"4A</"KEC/.'L"

30 IBM P7IH Supernode = 128 CPUs/1024 cores Blue Waters

31 Rack 990.6w x d x w x 72 d x 83 h ~2948kg (~6500lbs) Data Center In a Rack Compute Storage Switch 100% Cooling PDU Eliminated Input: 8 Water Lines, 4 Power Cords Out: ~100TFLOPs / 24.6TB / 153.5TB 192 PCI-e 16x / 12 PCI-e 8x WCU Facility Water Input 100% Heat to Water Redundant Cooling CRAH Eliminated Data Center in a Rack BPA 200 to 480Vac 370 to 575Vdc Redundant Power Direct Site Power Feed PDU Elimination Storage Unit 4U 0-6 / Rack Up To 384 SFF DASD/Unit File System CECs 2U 1-12 CECs/Rack 256 Cores 128 SN DIMM Slots / CEC 8,16, (32) GB DIMMs 17 PCI-e Slots Imbedded Switch Redundant DCA NW Fabric Up to: 3072 cores, 24.6TB (49.2TB) 31

32 Machine Comparison SYSTEM ATTRIBUTE ORNL Jaguar CRAY NCSA Blue Waters (est.) IBM Year Deployed Processor AMD IBM Power7 # Cores 224,256 (0.3X) 300,000+ Peak Performance (Petaflop/s) 2.33 (4.3X) Disk Storage (Petabytes) 7.0 (2.6X) # Disk drives?? 40,000 Main Memory (Terabytes) 300 (4.0X) 1,200 Blue Waters

33 Diverse Large Scale Computational Science (Both Academic and Industrial) Blue Waters

34 Wide Range of Codes on Blue Waters ~ 7 PF: Dense matrix-matrix multiply ~ 1 PF: FFT ~ 1 PF: Sparse matrix Cray can sustain 1PF only utilizing DMMM WRF on Jaguar ~ 50 TF; on Blue Waters much higher Cray cannot achieve 10X or 100X on applications that are more sensitive to memory or interconnect bandwidth, such as solving PDEs for either time-independent or timedependent applications. Bill Gropp, NCSA Imaginations unbound

35 National Petascale Computing Facility $72.5M, 25MW, LEED Gold+, 88,000 ft 2 Blue Waters

36 Circuitous Knowledge Transfer National Center for Supercomputing Applications University of Illinois at Urbana-Champaign

37 Use Case #1 - Freezing Water Scientific discovery led by GE Water freezes at random time steps Desire exists for temporal modeling of freezing molecules Requires 10+ petaflop/s of parametric modeling Scientific modeling at molecular level has not been done Dominant access method to computation is single run on large fraction of leadership class machine Does desire to build better, safer, more efficient products qualify for industrial science on a government resource? How much collaboration with academic scientists will this require? Circuitous Knowledge Transfer

38 Use Case #2 - Combustion Scientific discovery involves multiphysics and turbulence Turbulence code is an acceptance metric for Blue Waters Can the code be used by engine manufacturers? Would global automotive manufacturers share an interest? Would Airbus/EADS and Boeing share an interest? Does any ISV have adequate multiphysics software? Does any academic researcher? What is the gap between basic research and application? Who will lead the world in a breakthrough? Circuitous Knowledge Transfer

39 U.S. Leadership Computing Programs U.S. Department of Energy Oak Ridge National Laboratory: Jaguar + Follow-on Argonne National Laboratory: Intrepid + Follow-on Lawrence Livermore National Lab: Dawn + Sequoia U.S. Department of Defense National Science Foundation University of Illinois/NCSA: Blue Waters NASA: Ames Research Center: Pleiades Circuitous Knowledge Transfer

40 Industrial Engagement Methods Differ USG (Cooperative Research & Development Agreements) Federal funds cannot benefit private sector partner U.S. Federal Labs (Tech Transfer, startups, software) Universities (IP, Tech Transfer, startups) NCSA (private sector partnership, startups, spinouts, opensource software) HPC Centers (academic collaboration) Circuitous Knowledge Transfer

41 Integrated/Scalable/Circuitous Workflow!! BladeCenter!!! 1!!!!! 1!! Imaginations unbound! 2! 3! 4! 5! 6! 7! 8! 9! 10! ! 4! 5! 6! 7! 8! 9! 10! ! 4! 5! 6! 7! 8! 9! 10! BladeCenter! 2! 3 BladeCenter!!! 1! 2! 3

42 Questions/Observations/Issues Will industry & academia collaborate in the software age? How will Blue Waters be a game-changer? For computation? For data analytics? What can be done with petabytes of data in main memory? with increasing demand for more integrated data? How will industrial use of new tools and capabilities inform academic science? Can the commercial yield of academic code be increased? Do sufficient research incentives exist to collaborate? Circuitous Knowledge Transfer

43 Circuitous Knowledge Transfer

44 Is the computational community prepared? To perform and innovate based on new software? To parallelize legacy codes? To systematically conduct post-theoretical research? To share scientific and engineering breakthroughs? To pursue engineering discovery w/parametric modeling? To encourage engineering at the same level of science? To require computational modeling for new science grants? To integrate HPC more fully with workflow? With data? To teach parallelization and educate SMEs? For exascale computing? Circuitous Knowledge Transfer

45 Computational Advantage Ecosystem Petascale, ISV code, data management, architecture, etc. Domain Materials, fluids, mechanical, aerothermal, electrical, etc. HPC Applied CSE Computer Science Shared strategy, bilateral services, partnerships, etc. Consulting Parallelization, scaling, multiphysics, algorithms, etc. Circuitous Knowledge Transfer

46 Conclusions/Recommendations Competitive advantage is real & reality is not an option Cannot supercompute tomorrow with yesterday s model Blue Waters is a game changer Flop/s must work with memory and bandwidth Data is king; Software is king Climate modeling isn t enough High definition modeling needs more science Accessibility must reach more communities Computing is central to ALL science & engineering Supercomputing is the only centralized community Circuitous Knowledge Transfer