Fast computers, big/fast storage, fast networks Marla Meehl
|
|
|
- Sydney Jones
- 6 years ago
- Views:
Transcription
1 Fast computers, big/fast storage, fast networks Marla Meehl Manager, Network Engineering and Telecommunications, NCAR/UCAR, Manager of the Front Range GigaPoP Computational & Information Systems Laboratory National Center for Atmospheric Research
2 History of Supercomputing at NCAR Production Systems new NWSC IBM p6 p575/4096 (bluefire) Experimental/Test Systems that became Production Systems IBM p6 p575/192 (firefly) IBM p5+ p575/1744 (blueice) Experimental/Test Systems IBM p5 p575/624 (bluevista) Aspen Nocona-IB/40 (coral) IBM BlueGene-L/8192 (frost) Red text indicates those systems that are currently in operation within the IBM BlueGene-L/2048 (frost) NCAR Computational and Information Systems Laboratory's computing facility. IBM e1350/140 (pegasus) IBM e1350/264 (lightning) IBM p4 p690-f/64 (thunder) IBM p4 p690-c/1600 (bluesky) IBM p4 p690-c/1216 (bluesky) SGI Origin 3800/128 (tempest) Compaq ES40/36 (prospect) IBM p3 WH2/1308 (blackforest) IBM p3 WH2/604 (blackforest) IBM p3 WH1/296 (blackforest) Linux Networx Pentium-II/16 (tevye) SGI Origin2000/128 (ute) Cray J90se/24 (chipeta) HP SPP-2000/64 (sioux) Marine St. Mesa Lab I Mesa Lab II NWSC CDC 6600 CDC 3600 CDC 7600 Cray 1-A S/N 3 (C1) Cray C90/16 (antero) Cray J90se/24 (ouray) Cray J90/20 (aztec) Cray J90/16 (paiute) Cray T3D/128 (T3) Cray T3D/64 (T3) Cray Y-MP/8I (antero) CCC Cray 3/4 (graywolf) IBM SP1/8 (eaglesnest) TMC CM5/32 (littlebear) IBM RS/6000 Cluster (CL) Cray Y-MP/2 (castle) Cray Y-MP/8 (shavano) TMC CM2/8192 (capitol) Cray X-MP/4 (CX) Cray 1-A S/N 14 (CA) 35 systems over 35 years 27 Oct '
3 Current HPC Systems at NCAR System Name Vendor System # Frames # Proces sors Processor Type GHz Peak TFLOPs Production Systems bluefire (IB) IBM p6 Power POWER Research Systems, Divisional Systems & Test Systems Firefly (IB) IBM p6 Power POWER frost (BG/L) IBM BlueGene/L PowerPC
4 High Utilization, Low Queue Wait Times 100.0% Bluefire System Utilization (daily average) Bluefire system utilization is routinely >90% Average queue-wait time < 1hr 90.0% 80.0% 70.0% 60.0% 50.0% 40.0% 30.0% Spring ML Powerdown May 3 Firmware & Software Upgrade 20.0% % # of Jobs Premium Regular Economy Standby 0.0% Nov-08 Dec-08 Jan-09 Feb-09 Mar-09 Apr-09 May-09 Jun-09 Jul-09 Aug-09 Sep-09 Oct-09 Nov Average Queue Wait Times for User Jobs at the NCAR/CISL Computing Facility 0 <2m <5m <10m <20m <40m <1h Queue-Wait Time <2h <4h <8h <1d <2d >2d Queue 4 bluefire lightning blueice bluevista since Jun'08 since Dec'04 Jan'07-Jun'08 Jan'06-Sep'08 Peak TFLOPs > 77.0 TFLOPs 1.1 TFLOPs 12.2 TFLOPs 4.4 TFLOPs all jobs all jobs all jobs all jobs Premium 00:05 00:11 00:11 00:12 Regular 00:36 00:16 00:37 01:36 Economy 01:52 01:10 03:37 03:51 Stand-by 01:18 00:55 02:41 02:14
5 IP Bluefire Usage Climate 49.3% Accelerated Scientific Discovery 18.0% Weather 10 Upper Atmosphere 0.3% Miscellaneous 0.3% Cloud Physics 1.3% Basic Fluid Dynamics 2.6% Oceanograph 4.0% Atmospheric Chemistry 3.5% Astrophysics 4.4%
6 CURRENT NCAR COMPUTING >100TFLOPS Peak TFLOPs at NCAR (All Systems) 100 ICESS Phase 2 IBM POWER6/Power575/IB (bluefire) IBM POWER6/Power575/IB (firefly) IBM POWER5+/p575/HPS (blueice) 80 IBM POWER5/p575/HPS (bluevista) IBM BlueGene/L (frost) 60 IBM Opteron/Linux (pegasus) IBM Opteron/Linux (lightning) ICESS Phase 1 IBM POWER4/Federation (thunder) 40 ARCS Phase 3 ARCS Phase 4 bluefire IBM POWER4/Colony (bluesky) IBM POWER4 (bluedawn) 20 ARCS Phase 2 Linux blueice SGI Origin3800/128 ARCS Phase 1 lightning/pegasus frost bluevista firefly bluesky blackforest 0 Jan-00 Jan-01 Jan-02 Jan-03 Jan-04 Jan-05 Jan-06 Jan-07 Jan-08 Jan-09 Jan-10 IBM POWER3 (blackforest) IBM POWER3 (babyblue)
7 CISL Computing Resource Users 1347 Users in FY09 Other, 13, 1% Univ Research Associates, 280, 21% Univ Faculty, 191, 14% Government, 108, 8% NCAR Assoc Sci & Support Staff, 252, 19% NCAR Scientists & Proj Scientists, 160, 12% Graduate and Undergrad Students, 343, 25%
8 120 Universities with largest number of users in FY Number of Users Users are from 114 U.S. Universiti 0
9 Disk Storage Systems Current Disk Storage for HPC and Data Collections: 215 TB for Bluefire (GPFS) 335 TB for Data Analysis and Vis (DAV) (GPFS) 110 TB for Frost (Local) 152 TB for Data Collections (RDA, ESG) (SAN) Undergoing extensive redesign and expansion. Add ~2PB to (existing GPFS system) to create large central (xmounted) filesystem
10 Data Services Redesign Near-term Goals: Creation of unified and consistent data environment for NCAR HPC High-performance availability of central filesystem from many projects/systems (RDA, ESG, CAVS, Bluefire, TeraGrid) Longer-term Goals: Filesystem cross-mounting Global WAN filesystems Schedule: Phase 1: Add 300TB (now) Phase 2: Add 1 PB (March 2010 ) Phase 3: Add.75 PB (TBD)
11 Mass Storage Systems NCAR MSS (Mass Storage System) In Production since 70s Transitioning from the NCAR Mass Storage System to HPSS Prior to NCAR-Wyoming Supercomputer Center (NWSC) commissioning in 2012 Cutover Jan 2011 Transition without data migration Silos/Tape Drives Tape Drives/Silos Sun/StorageTek T10000B (1 TB media) with SL8500 libraries Phasing out tape silos Q Oozing 4 PBs (unique), 6 PBs with duplicates Online process Optimized data transfer Average 20 TB/day with 10 streams
12
13 Estimated Growth Total PBs Stored (w/ DSS Stewardship & IPCC AR5) Oct'07 Oct'08 Oct'09 Oct'10 Oct'11 Oct'12
14 Facility Challenge Beyond 2011 NCAR Data Center NCAR data center limits of power/cooling/space have been reached Any future computing augmentation will exceed existing center capacity Planning in progress Partnership Focus on Sustainability and Efficiency Project Timeline
15 NCAR-Wyoming Supercomputer Center (NWSC) Partners NCAR & UCAR University of Wyoming State of Wyoming Cheyenne LEADS Wyoming Business Council Cheyenne Light, Fuel & Power Company National Science Foundation (NSF) University of Wyoming Cheyenne NCAR Mesa Lab
16 Focus on Sustainability Maximum energy efficiency LEED certification Achievement of the smallest possible carbon footprint Adaptable to the ever-changing landscape of High- Performance Computing Modular and expandable space that can be adapted as program needs or technology demands dictate
17 Focus On Efficiency Don t fight mother nature The cleanest electron is an electron never used The computer systems drive all of the overhead loads NCAR will evaluate in procurement Sustained performance / kw Focus on the biggest losses Compressor based cooling UPS losses Transformer losses 65.9% Typical Modern Data Center 0.1% 15.0% 6.0% 13.0% NWSC Design 91.9% Lights Cooling Fans Electrical Losses IT Load Lights Cooling Fans Electrical Losses IT Load
18 Design Progress Will be one of the most efficient data centers Cheyenne Climate Eliminate refrigerant based cooling for ~98% of the year Efficient water use Minimal transformations steps electrically Guaranteed 10% Renewable Option for 100% (Wind Power) Power Usage Effectiveness (PUE) PUE = Total Load / Computer Load = 1.08 ~ 1.10 for WY Good data centers 1.5 Typical Commercial 2.0
19 Expandable and Modular Long term 24 acre site Dual substation electrical feeds Utility commitment up to 36MW Substantial capability fiber optics Medium term Phase I / Phase II Can be doubled Enough structure for three or four generations Future container solutions or other advances Short term Module A Module B Each Module 12,000 sq.ft. Install 4.5MW initially can be doubled in Module A Upgrade Cooling and Electrical systems in 4.5MW increments
20 Project Timeline 65% Design Review Complete (October 2009) 95% Design Complete 100% Design Complete (Feb 2010) Anticipated Groundbreaking (June 2010) Certification of Occupancy (October 2011) Petascale System in Production (January 2012)
21 NCAR-Wyoming Supercomputer Center
22 HPC services at NWSC PetaFlop Computing 1 PFLOP peak minimum 100 s PetaByte Archive (+20 PB yearly growth) HPSS Tape archive hardware acquisition TBD PetaByte Shared File System(s) (5-15PB) GPFS/HPSS HSM integration (or Lustre) Data Analysis and Vis Cross Mounting to NCAR Research Labs, others Research Data Archive data servers and Data portals High-Speed Networking and some enterprise services
23 NWSC HPC Projection Peak PFLOPs at NCAR NWSC HPC (uncertainty) NWSC HPC IBM POWER6/Power5 (bluefire) 1.2 IBM POWER5+/p575/H (blueice) 1.0 IBM POWER5/p57 (bluevista) 0.8 IBM BlueGene/L 0.6 IBM Opteron/Linu (pegasus) 0.4 ICESS Phase ARCS Phase 4 ICESS Phase 1 IBM Opteron/Linu (lightning) 0.0 bluesky Jan-04 Jan-05 Jan-06 Jan-07 Jan-08 Jan-09 Jan-10 Jan-11 Jan-12 Jan-13 Jan bluefire frost IBM POWER4/Co (bluesky)
24 NCAR Data Archive Projection Total Data in the NCAR Archive (Actual and Projected) 120 Total Unique Jan-99 Jan-00 Jan-01 Jan-02 Jan-03 Jan-04 Jan-05 Jan-06 Jan-07 Jan-08 Jan-09 Jan-10 Jan-11 Jan-12 Jan-13 Jan-14 Jan-15 Petabytes 24
25 Tentative Procurement Timeline NWSC Production Installation & ATP Award NSF Approval Negotiations Proposal Evaluation RFP Release Benchmark Refinement RFP Refinement RFP Draft RFI Evaluation RFI NDA's Jul-09 Jan-10 Jul-10 Dec-10 Jul-11 Jan
26
27 Front Range GigaPoP (FRGP) 10 years of operation by UCAR 15 members NLR, I2, Esnet 10Gbps Commodity Qwest and Level3 CPS and TransitRail Peering Intra-FRGP peering Akamai 10Gbps ESnet peering
28
29 Fiber, fiber, fiber NCAR/UCAR intra-campus fiber 10Gbps backbone Boulder Research and Administration Network (BRAN) Bi-State Optical Network (BiSON) upgrading to 10/40/100Gbps capable Enables 10Gbps NCAR/UCAR Teragrid connection Enable 10Gbps NOAA/DC link via NLR lifetime lambda DREAM 10Gbps SCONE 1Gbps
30
31
32 Western Regional Network (WRN) A multi-state partnership to ensure robust, advanced, high-speed networking available for research, education, and related uses Increased aggregate bandwidth Decreased costs
33
34 Questions
2012 AIA Wyoming Winter Conference
2012 AIA Wyoming Winter Conference CONFERENCE SPONSORS: ADDITIONAL SPONSORS: Designing a New Type of Data Center Designing a New Type of Data Center Learning Objectives 1. Identify the sustainable design
13 th ECMWF Workshop on the Use of HPC in Meteorology
13 th ECMWF Workshop on the Use of HPC in Meteorology Al Kellie Associate Director, National Center for Atmospheric Research (NCAR) Director, Computation and Information Systems Lab (CISL) (Kellie@ucar.edu)
Cheyenne NCAR s Next-Generation Data-Centric Supercomputing Environment
Cheyenne NCAR s Next-Generation Data-Centric Supercomputing Environment David Hart, NCAR/CISL User Services Manager June 23, 2016 1 History of computing at NCAR 2 2 Cheyenne Planned production, January
NCAR s Data-Centric Supercomputing Environment Yellowstone. November 28, 2011 David L. Hart, CISL
NCAR s Data-Centric Supercomputing Environment Yellowstone November 28, 2011 David L. Hart, CISL dhart@ucar.edu Welcome to the Petascale Yellowstone hardware and software Deployment schedule Allocations
CISL Update. 29 April Operations and Services Division
CISL Update Operations and Services CISL HPC Advisory Panel Meeting Anke Kamrath anke@ucar.edu Operations and Services Division Computational and Information Systems Laboratory 1 CHAP Meeting 14 May 2009
NCAR s Data-Centric Supercomputing Environment Yellowstone. November 29, 2011 David L. Hart, CISL
NCAR s Data-Centric Supercomputing Environment Yellowstone November 29, 2011 David L. Hart, CISL dhart@ucar.edu Welcome to the Petascale Yellowstone hardware and software Deployment schedule Allocations
CISL Update Operations and Yellowstone. CISL HPC Advisory Panel Meeting 18 October 2012
CISL Update Operations and Yellowstone CISL HPC Advisory Panel Meeting 18 October 2012 Anke Kamrath anke@ucar.edu Operations and Services Division Computational and Information Systems Laboratory Much
A visual interface for the analysis of turbulent structure statistics
A visual interface for the analysis of turbulent structure statistics Astronum2009 Chamonix, France 29 June 3 July 2009 Mark Rast Laboratory for Atmospheric and Space Physics Department of Astrophysical
Marla Meehl. UCAR/FRGP/UPoP/BiSON Manager UCAR/NCAR
Front Range GigaPoP (FRGP), UCAR Point of Presence (UPoP), Bi-State Optical Network (BiSON) Marla Meehl UCAR/FRGP/UPoP/BiSON Manager UCAR/NCAR 2014-04-04 1 Acronym soup University Corporation for Atmospheric
Transitioning NCAR MSS to HPSS
Transitioning NCAR MSS to HPSS Oct 29, 2009 Erich Thanhardt Overview Transitioning to HPSS Explain rationale behind the move Introduce current HPSS system in house Present transition plans with timelines
The Blue Water s File/Archive System. Data Management Challenges Michelle Butler
The Blue Water s File/Archive System Data Management Challenges Michelle Butler (mbutler@ncsa.illinois.edu) NCSA is a World leader in deploying supercomputers and providing scientists with the software
The NCAR Yellowstone Data Centric Computing Environment. Rory Kelly ScicomP Workshop May 2013
The NCAR Yellowstone Data Centric Computing Environment Rory Kelly ScicomP Workshop 27 31 May 2013 Computers to Data Center EVERYTHING IS NEW 2 NWSC Procurement New facility: the NWSC NCAR Wyoming Supercomputing
Storage Technology Requirements of the NCAR Mass Storage System
Storage Technology Requirements of the NCAR Mass Storage System Gene Harano National Center for Atmospheric Research (NCAR) 1850 Table Mesa Dr. Boulder, CO 80303 Phone: +1-303-497-1203; FAX: +1-303-497-1848
Networking updates: Westnet
Networking updates: Westnet Marla Meehl UCAR/FRGP/UPoP/BiSON Manager UCAR/NCAR 2014-01-08 1 Acronym soup University Corporation for Atmospheric Research (UCAR; http://www.ucar.edu) National Center for
Information Technology Services. Informational Report for the Board of Trustees October 11, 2017 Prepared effective August 31, 2017
Information Technology Services Informational Report for the Board of Trustees October 11, 2017 Prepared effective August 31, 2017 Information Technology Services TABLE OF CONTENTS UPDATE ON PROJECTS &
The Architecture and the Application Performance of the Earth Simulator
The Architecture and the Application Performance of the Earth Simulator Ken ichi Itakura (JAMSTEC) http://www.jamstec.go.jp 15 Dec., 2011 ICTS-TIFR Discussion Meeting-2011 1 Location of Earth Simulator
Overview of HPC at LONI
Overview of HPC at LONI Le Yan HPC Consultant User Services @ LONI What Is HPC High performance computing is to use supercomputers to solve problems computationally The most powerful supercomputer today
NCEP HPC Transition. 15 th ECMWF Workshop on the Use of HPC in Meteorology. Allan Darling. Deputy Director, NCEP Central Operations
NCEP HPC Transition 15 th ECMWF Workshop on the Use of HPC Allan Darling Deputy Director, NCEP Central Operations WCOSS NOAA Weather and Climate Operational Supercomputing System CURRENT OPERATIONAL CHALLENGE
Introduction to FREE National Resources for Scientific Computing. Dana Brunson. Jeff Pummill
Introduction to FREE National Resources for Scientific Computing Dana Brunson Oklahoma State University High Performance Computing Center Jeff Pummill University of Arkansas High Peformance Computing Center
Resources Current and Future Systems. Timothy H. Kaiser, Ph.D.
Resources Current and Future Systems Timothy H. Kaiser, Ph.D. tkaiser@mines.edu 1 Most likely talk to be out of date History of Top 500 Issues with building bigger machines Current and near future academic
Pushing the Limits. ADSM Symposium Sheelagh Treweek September 1999 Oxford University Computing Services 1
Pushing the Limits ADSM Symposium Sheelagh Treweek sheelagh.treweek@oucs.ox.ac.uk September 1999 Oxford University Computing Services 1 Overview History of ADSM services at Oxford October 1995 - started
Shared Services Canada Environment and Climate Change Canada HPC Renewal Project
Shared Services Canada Environment and Climate Change Canada HPC Renewal Project CUG 2017 Redmond, WA, USA Deric Sullivan Alain St-Denis & Luc Corbeil May 2017 Background: SSC's HPC Renewal for ECCC Environment
Integrating Fibre Channel Storage Devices into the NCAR MSS
Integrating Fibre Channel Storage Devices into the NCAR MSS John Merrill National Center for Atmospheric Research 1850 Table Mesa Dr., Boulder, CO, 80305-5602 Phone:+1-303-497-1273 FAX: +1-303-497-1848
WVU RESEARCH COMPUTING INTRODUCTION. Introduction to WVU s Research Computing Services
WVU RESEARCH COMPUTING INTRODUCTION Introduction to WVU s Research Computing Services WHO ARE WE? Division of Information Technology Services Funded through WVU Research Corporation Provide centralized
400G: Deployment at a National Lab
400G: Deployment at a National Lab Chris Tracy (Esnet) *Jason R. Lee (NERSC) June 30, 2016-1 - Concept - 2 - Concept: Use case This work originally began as a white paper in December 2013, in which Esnet
Storage Supporting DOE Science
Storage Supporting DOE Science Jason Hick jhick@lbl.gov NERSC LBNL http://www.nersc.gov/nusers/systems/hpss/ http://www.nersc.gov/nusers/systems/ngf/ May 12, 2011 The Production Facility for DOE Office
Network updates. CHECO CIO Meeting. December 2010 Marla Meehl Jeff Custard
Network updates CHECO CIO Meeting December 2010 Marla Meehl Jeff Custard Acronym soup University Corporation for Atmospheric Research (UCAR; http://www.ucar.edu) National Center for Atmospheric Research
NCAR Workload Analysis on Yellowstone. March 2015 V5.0
NCAR Workload Analysis on Yellowstone March 2015 V5.0 Purpose and Scope of the Analysis Understanding the NCAR application workload is a critical part of making efficient use of Yellowstone and in scoping
A More Realistic Way of Stressing the End-to-end I/O System
A More Realistic Way of Stressing the End-to-end I/O System Verónica G. Vergara Larrea Sarp Oral Dustin Leverman Hai Ah Nam Feiyi Wang James Simmons CUG 2015 April 29, 2015 Chicago, IL ORNL is managed
ALICE Grid Activities in US
ALICE Grid Activities in US 1 ALICE-USA Computing Project ALICE-USA Collaboration formed to focus on the ALICE EMCal project Construction, installation, testing and integration participating institutions
Data Management Components for a Research Data Archive
Data Management Components for a Research Data Archive Steven Worley and Bob Dattore Scientific Computing Division Computational and Information Systems Laboratory National Center for Atmospheric Research
Resources Current and Future Systems. Timothy H. Kaiser, Ph.D.
Resources Current and Future Systems Timothy H. Kaiser, Ph.D. tkaiser@mines.edu 1 Most likely talk to be out of date History of Top 500 Issues with building bigger machines Current and near future academic
Big Data 2015: Sponsor and Participants Research Event ""
Big Data 2015: Sponsor and Participants Research Event "" Center for Large-scale Data Systems Research, CLDS! San Diego Supercomputer Center! UC San Diego! Agenda" Welcome and introductions! SDSC: Who
N-Wave Overview. Westnet Boulder, CO 5 June 2012
N-Wave Overview Mark Mutz Westnet Boulder, CO 5 June 2012 mark.mutz@noaa.gov Outline Background Network Design & Operation Uptime and Traffic Stats Futures NOAA s Mission To understand and predict changes
Outline. March 5, 2012 CIRMMT - McGill University 2
Outline CLUMEQ, Calcul Quebec and Compute Canada Research Support Objectives and Focal Points CLUMEQ Site at McGill ETS Key Specifications and Status CLUMEQ HPC Support Staff at McGill Getting Started
Early Operational Experience with the Cray X1 at the Oak Ridge National Laboratory Center for Computational Sciences
Early Operational Experience with the Cray X1 at the Oak Ridge National Laboratory Center for Computational Sciences Buddy Bland, Richard Alexander Steven Carter, Kenneth Matney, Sr. Cray User s Group
Networking updates: CHECO CIO meeting
Networking updates: CHECO CIO meeting Marla Meehl Network Engineering Manager UCAR/NCAR 2013-06-04 1 Acronym soup University Corporation for Atmospheric Research (UCAR; http://www.ucar.edu) National Center
First Experience with LCG. Board of Sponsors 3 rd April 2009
First Experience with LCG Operation and the future... CERN openlab Board of Sponsors 3 rd April 2009 Ian Bird LCG Project Leader The LHC Computing Challenge Signal/Noise: 10-9 Data volume High rate * large
NCAR Computation and Information Systems Laboratory (CISL) Facilities and Support Overview
NCAR Computation and Information Systems Laboratory (CISL) Facilities and Support Overview NCAR ASP 2008 Summer Colloquium on Numerical Techniques for Global Atmospheric Models June 2, 2008 Mike Page -
2014 Bond Technology Update Progress of the Technology Network Infrastructure Upgrades Long Range Planning Committee March 4, 2015
2014 Bond Technology Update Progress of the Technology Network Infrastructure Upgrades Long Range Planning Committee March 4, 2015 2014 Bond Technology Update Progress of the Technology Network Infrastructure
SME License Order Working Group Update - Webinar #3 Call in number:
SME License Order Working Group Update - Webinar #3 Call in number: Canada Local: +1-416-915-8942 Canada Toll Free: +1-855-244-8680 Event Number: 662 298 966 Attendee ID: check your WebEx session under
Part 2: Computing and Networking Capacity (for research and instructional activities)
National Science Foundation Part 2: Computing and Networking Capacity (for research and instructional activities) FY 2013 Survey of Science and Engineering Research Facilities Who should be contacted if
NOAA N-Wave Update N-WAVE V. NOAA Research Network. Joint Techs Columbus 13 July 2010
NOAA N-Wave Update N-WAVE V NOAA Research Network Joint Techs Columbus 13 July 2010 Mark Mutz, NOAA mark.mutz@noaa.gov Caren Litvanyi, N-Wave NOC litvanyi@grnoc.iu.edu NOAA s Mission To understand and
Outline. Execution Environments for Parallel Applications. Supercomputers. Supercomputers
Outline Execution Environments for Parallel Applications Master CANS 2007/2008 Departament d Arquitectura de Computadors Universitat Politècnica de Catalunya Supercomputers OS abstractions Extended OS
NCAR Globally Accessible Data Environment (GLADE) Updated: 15 Feb 2017
NCAR Globally Accessible Data Environment (GLADE) Updated: 15 Feb 2017 Overview The Globally Accessible Data Environment (GLADE) provides centralized file storage for HPC computational, data-analysis,
The Red Storm System: Architecture, System Update and Performance Analysis
The Red Storm System: Architecture, System Update and Performance Analysis Douglas Doerfler, Jim Tomkins Sandia National Laboratories Center for Computation, Computers, Information and Mathematics LACSI
Managing HPC Active Archive Storage with HPSS RAIT at Oak Ridge National Laboratory
Managing HPC Active Archive Storage with HPSS RAIT at Oak Ridge National Laboratory Quinn Mitchell HPC UNIX/LINUX Storage Systems ORNL is managed by UT-Battelle for the US Department of Energy U.S. Department
The Hopper System: How the Largest* XE6 in the World Went From Requirements to Reality! Katie Antypas, Tina Butler, and Jonathan Carter
The Hopper System: How the Largest* XE6 in the World Went From Requirements to Reality! Katie Antypas, Tina Butler, and Jonathan Carter CUG 2011, May 25th, 2011 1 Requirements to Reality Develop RFP Select
Tuning I/O Performance for Data Intensive Computing. Nicholas J. Wright. lbl.gov
Tuning I/O Performance for Data Intensive Computing. Nicholas J. Wright njwright @ lbl.gov NERSC- National Energy Research Scientific Computing Center Mission: Accelerate the pace of scientific discovery
Council, 26 March Information Technology Report. Executive summary and recommendations. Introduction
Council, 26 March 2014 Information Technology Report Executive summary and recommendations Introduction This report sets out the main activities of the Information Technology Department since the last
COURSE LISTING. Courses Listed. with SAP HANA. 15 February 2018 (05:18 GMT) HA100 - SAP HANA. HA250 - Migration to SAP HANA using DMO
with SAP HANA COURSE LISTING Courses Listed HA100 - SAP HANA HA240 -, SAP HANA HA250 - Migration to SAP HANA using DMO C_HANATEC_13 - SAP Certified Technology Associate - SAP HANA 2.0 HA200 - SAP HANA
Data Serving Climate Simulation Science at the NASA Center for Climate Simulation (NCCS)
Data Serving Climate Simulation Science at the NASA Center for Climate Simulation (NCCS) MSST2011, May 24-25, 2011 Ellen Salmon ( Ellen.Salmon@nasa.gov ) High Performance Computing, Code 606.2 Computational
High Performance Computing at Mississippi State University
High Performance Computing at Mississippi State University Building Facilities HPC Building - Starkville o CCS, GRI, PET, SimCtr o 71,000 square feet o 3,500 square ft. data center 600 KW generator 60
Networking updates: CHECO CIO meet ing
Networking updates: CHECO CIO meet ing Jeff Custard Network Engineering Manager UCAR/NCAR 2013-03-05 1 Acronym soup University Corporation for Atmospheric Research (UCAR; http:/ / www.ucar.edu) National
Green Supercomputing
Green Supercomputing On the Energy Consumption of Modern E-Science Prof. Dr. Thomas Ludwig German Climate Computing Centre Hamburg, Germany ludwig@dkrz.de Outline DKRZ 2013 and Climate Science The Exascale
The Stampede is Coming Welcome to Stampede Introductory Training. Dan Stanzione Texas Advanced Computing Center
The Stampede is Coming Welcome to Stampede Introductory Training Dan Stanzione Texas Advanced Computing Center dan@tacc.utexas.edu Thanks for Coming! Stampede is an exciting new system of incredible power.
High Performance Computing Data Management. Philippe Trautmann BDM High Performance Computing Global Research
High Performance Computing Management Philippe Trautmann BDM High Performance Computing Global Education @ Research HPC Market and Trends High Performance Computing: Availability/Sharing is key European
Shared Parallel Filesystems in Heterogeneous Linux Multi-Cluster Environments
LCI HPC Revolution 2005 26 April 2005 Shared Parallel Filesystems in Heterogeneous Linux Multi-Cluster Environments Matthew Woitaszek matthew.woitaszek@colorado.edu Collaborators Organizations National
Update on Cray Activities in the Earth Sciences
Update on Cray Activities in the Earth Sciences Presented to the 13 th ECMWF Workshop on the Use of HPC in Meteorology 3-7 November 2008 Per Nyberg nyberg@cray.com Director, Marketing and Business Development
Council, 8 February 2017 Information Technology Report Executive summary and recommendations
Council, 8 February 2017 Information Technology Report Executive summary and recommendations Introduction This report provides the Council with an update into the work of the Information Technology Directorate
The Center for Computational Research
The Center for Computational Research Russ Miller Director, Center for Computational Research UB Distinguished Professor, Computer Science & Engineering Senior Research Scientist, Hauptman-Woodward Medical
SPARC 2 Consultations January-February 2016
SPARC 2 Consultations January-February 2016 1 Outline Introduction to Compute Canada SPARC 2 Consultation Context Capital Deployment Plan Services Plan Access and Allocation Policies (RAC, etc.) Discussion
Office 365. It s Past, Present and Future at UW
Office 365 It s Past, Present and Future at UW What we are going to talk about today What is Office 365 Timeline for Office 365 on Campus Overview of the O365 services provided and who gets them How we
University at Buffalo Center for Computational Research
University at Buffalo Center for Computational Research The following is a short and long description of CCR Facilities for use in proposals, reports, and presentations. If desired, a letter of support
Freedom of Information Act 2000 reference number RFI
P. Norris By email to: xxxxxxxxxxxxxxxxxxxxxx@xxxxxxxxxxxxxx.xxm 02 November 2011 Dear P. Norris Freedom of Information Act 2000 reference number RFI20111218 Thank you for your request under the Freedom
RESEARCH DATA DEPOT AT PURDUE UNIVERSITY
Preston Smith Director of Research Services RESEARCH DATA DEPOT AT PURDUE UNIVERSITY May 18, 2016 HTCONDOR WEEK 2016 Ran into Miron at a workshop recently.. Talked about data and the challenges of providing
NERSC Site Update. National Energy Research Scientific Computing Center Lawrence Berkeley National Laboratory. Richard Gerber
NERSC Site Update National Energy Research Scientific Computing Center Lawrence Berkeley National Laboratory Richard Gerber NERSC Senior Science Advisor High Performance Computing Department Head Cori
Innovation and the Internet
Innovation and the Internet 29 April 2005 Christopher Buja, Deputy Director Academic Research & Technology Initiatives, Cisco cbuja@cisco.com 2004, Cisco Systems, Inc. All rights reserved. 1 Agenda Introduction
COURSE LISTING. Courses Listed. Training for Database & Technology with Modeling in SAP HANA. 20 November 2017 (12:10 GMT) Beginner.
Training for Database & Technology with Modeling in SAP HANA Courses Listed Beginner HA100 - SAP HANA Introduction Advanced HA300 - SAP HANA Certification Exam C_HANAIMP_13 - SAP Certified Application
Cluster Network Products
Cluster Network Products Cluster interconnects include, among others: Gigabit Ethernet Myrinet Quadrics InfiniBand 1 Interconnects in Top500 list 11/2009 2 Interconnects in Top500 list 11/2008 3 Cluster
CISL Update Operations and Services
CISL Update Operations and Services CISL HPC Advisory Panel Meeting Anke Kamrath anke@ucar.edu Operations and Services Division Computational and Information Systems Laboratory 1 CHAP Meeting A lot happening
InfiniBand Strengthens Leadership as the Interconnect Of Choice By Providing Best Return on Investment. TOP500 Supercomputers, June 2014
InfiniBand Strengthens Leadership as the Interconnect Of Choice By Providing Best Return on Investment TOP500 Supercomputers, June 2014 TOP500 Performance Trends 38% CAGR 78% CAGR Explosive high-performance
Using Quality of Service for Scheduling on Cray XT Systems
Using Quality of Service for Scheduling on Cray XT Systems Troy Baer HPC System Administrator National Institute for Computational Sciences, University of Tennessee Outline Introduction Scheduling Cray
Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners
Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners 24th Forum ORAP Cite Scientifique; Lille, France March 26, 2009 Don Middleton National
JÜLICH SUPERCOMPUTING CENTRE Site Introduction Michael Stephan Forschungszentrum Jülich
JÜLICH SUPERCOMPUTING CENTRE Site Introduction 09.04.2018 Michael Stephan JSC @ Forschungszentrum Jülich FORSCHUNGSZENTRUM JÜLICH Research Centre Jülich One of the 15 Helmholtz Research Centers in Germany
High Performance Computing
CSC630/CSC730: Parallel & Distributed Computing Trends in HPC 1 High Performance Computing High-performance computing (HPC) is the use of supercomputers and parallel processing techniques for solving complex
Networking updates: Westnet
Networking updates: Westnet Marla Meehl Network Engineering Manager UCAR/NCAR 2013-06-12 1 Acronym soup University Corporation for Atmospheric Research (UCAR; http://www.ucar.edu) National Center for Atmospheric
ADDENDUM #2 TO REQUEST FOR PROPOSAL (RFP) #2252 Institutional Network Service, Data Center Co-location Service, and High-Speed Internet Service
CITY OF CONCORD, CALIFORNIA March 13, 2013 ADDENDUM #2 TO REQUEST FOR PROPOSAL (RFP) #2252 Institutional Network Service, Data Center Co-location Service, and High-Speed Internet Service NOTICE TO PROPOSERS
SLIDE 1 - COPYRIGHT 2015 ELEPHANT FLOWS IN THE ROOM: SCIENCEDMZ NATIONALLY DISTRIBUTED
SLIDE 1 - COPYRIGHT 2015 ELEPHANT FLOWS IN THE ROOM: SCIENCEDMZ NATIONALLY DISTRIBUTED SLIDE 2 - COPYRIGHT 2015 Do you know what your campus network is actually capable of? (i.e. have you addressed your
Jülich Supercomputing Centre
Mitglied der Helmholtz-Gemeinschaft Jülich Supercomputing Centre Norbert Attig Jülich Supercomputing Centre (JSC) Forschungszentrum Jülich (FZJ) Aug 26, 2009 DOAG Regionaltreffen NRW 2 Supercomputing at
The LHC Computing Grid. Slides mostly by: Dr Ian Bird LCG Project Leader 18 March 2008
The LHC Computing Grid Slides mostly by: Dr Ian Bird LCG Project Leader 18 March 2008 The LHC Computing Grid February 2008 Some precursors Computing for HEP means data handling Fixed-target experiments
The Center for High Performance Computing. Dell Breakfast Events 20 th June 2016 Happy Sithole
The Center for High Performance Computing Dell Breakfast Events 20 th June 2016 Happy Sithole Background: The CHPC in SA CHPC User Community: South Africa CHPC Existing Users Future Users Introduction
Engagement With Scientific Facilities
Engagement With Scientific Facilities Eli Dart, Network Engineer ESnet Science Engagement Lawrence Berkeley National Laboratory Global Science Engagement Panel Internet2 Technology Exchange San Francisco,
Scaling a Global File System to the Greatest Possible Extent, Performance, Capacity, and Number of Users
Scaling a Global File System to the Greatest Possible Extent, Performance, Capacity, and Number of Users Phil Andrews, Bryan Banister, Patricia Kovatch, Chris Jordan San Diego Supercomputer Center University
Organizational Update: December 2015
Organizational Update: December 2015 David Hudak Doug Johnson Alan Chalker www.osc.edu Slide 1 OSC Organizational Update Leadership changes State of OSC Roadmap Web app demonstration (if time) Slide 2
Oak Ridge National Laboratory Computing and Computational Sciences
Oak Ridge National Laboratory Computing and Computational Sciences OFA Update by ORNL Presented by: Pavel Shamis (Pasha) OFA Workshop Mar 17, 2015 Acknowledgments Bernholdt David E. Hill Jason J. Leverman
Building Self-Healing Mass Storage Arrays. for Large Cluster Systems
Building Self-Healing Mass Storage Arrays for Large Cluster Systems NSC08, Linköping, 14. October 2008 Toine Beckers tbeckers@datadirectnet.com Agenda Company Overview Balanced I/O Systems MTBF and Availability
DVS, GPFS and External Lustre at NERSC How It s Working on Hopper. Tina Butler, Rei Chi Lee, Gregory Butler 05/25/11 CUG 2011
DVS, GPFS and External Lustre at NERSC How It s Working on Hopper Tina Butler, Rei Chi Lee, Gregory Butler 05/25/11 CUG 2011 1 NERSC is the Primary Computing Center for DOE Office of Science NERSC serves
USGv6: US Government. IPv6 Transition Activities 11/04/2010 DISCOVER THE TRUE VALUE OF TECHNOLOGY
USGv6: US Government Dale Geesey Chief Operating Officer Auspex Technologies, LLC Phone: 703.319.1925 Fax: 866.873.1277 E-mail: dgeesey@auspextech.com Web: www.auspextech.com IPv6 Transition Activities
An Overview of CSNY, the Cyberinstitute of the State of New York at buffalo
An Overview of, the Cyberinstitute of the State of New York at buffalo Russ Miller Computer Sci & Eng, SUNY-Buffalo Hauptman-Woodward Medical Res Inst NSF, NYS, Dell, HP Cyberinfrastructure Digital Data-Driven
AMI Applications at SDG&E Metering America March 24, 2009 Ted M. Reguly Smart Meter Program Director SDG&E
AMI Applications at SDG&E Metering America March 24, 2009 Ted M. Reguly Smart Meter Program Director SDG&E 2008 San Diego Gas & Electric Company. All copyright and trademark rights reserved About Sempra
Sun Lustre Storage System Simplifying and Accelerating Lustre Deployments
Sun Lustre Storage System Simplifying and Accelerating Lustre Deployments Torben Kling-Petersen, PhD Presenter s Name Principle Field Title andengineer Division HPC &Cloud LoB SunComputing Microsystems
Communication has significant impact on application performance. Interconnection networks therefore have a vital role in cluster systems.
Cluster Networks Introduction Communication has significant impact on application performance. Interconnection networks therefore have a vital role in cluster systems. As usual, the driver is performance
Current Status of the Next- Generation Supercomputer in Japan. YOKOKAWA, Mitsuo Next-Generation Supercomputer R&D Center RIKEN
Current Status of the Next- Generation Supercomputer in Japan YOKOKAWA, Mitsuo Next-Generation Supercomputer R&D Center RIKEN International Workshop on Peta-Scale Computing Programming Environment, Languages
Networking updates: Westnet
Networking updates: Westnet Marla Meehl UCAR/FRGP/BiSON/WRN/RMCMOA Manager UCAR/NCAR 2016-01-06 Acronym soup University Corporation for Atmospheric Research (UCAR; http://www.ucar.edu) National Center
Data storage services at KEK/CRC -- status and plan
Data storage services at KEK/CRC -- status and plan KEK/CRC Hiroyuki Matsunaga Most of the slides are prepared by Koichi Murakami and Go Iwai KEKCC System Overview KEKCC (Central Computing System) The
Energy Engineering: Tools and Trends
Energy Engineering: Tools and Trends AEE Northeast Ohio Chapter Meeting March 27, 2008 1 Introduction Background and Experience Energy Engineer for Trane 20 years in HVAC Industry Equipment design and
Blue Waters Super System
Blue Waters Super System Michelle Butler 4/12/12 NCSA Has Completed a Grand Challenge In August, IBM terminated their contract to deliver the base Blue Waters system NSF asked NCSA to propose a change
2014 Bond Technology Infrastructure Status Report. March 10, 2016
Status Report March 10, 2016 Agenda and Status Items Network Hubs High Schools Middle Schools Elementary Schools Alternate Schools Service Centers District Level Expenditure Report Two Categories of Funding
W&M General Government. Phase II Budget Presentation. 25 April 2017
W&M General Government. Phase II Budget Presentation 25 April 2017 Phone Transition (Project MUSIC) transitioning from decentralized and outdated phone systems to an integrated VOIP solution Phone Transition