MGHPCC: A Platform for Collaboration. Jim Culbert Director of IT Services MGHPCC 10/30/2018

Transcription

1 MGHPCC: A Platform for Collaboration Jim Culbert Director of IT Services MGHPCC 10/30/2018

2 The MGHPCC Data Center and Consortium A partnership between 5 universities. The Commonwealth, and industrial sponsors 2

3 Platform for Collaborative Research Computing RC Requirements High density Experimental by definition flexibility Regulatory and grant constraints Collaboration Requirements Low friction interactions 3 rows is easier than 3 counties. Low friction infrastructure Low friction process Collaborative design, construction, operation, governance if it s not working we can change it

4 MGHPCC By the Numbers 100k square feet total - 30k square feet of computer room space (~1 acre), 15k admin, 55k everything else (entry rooms, loading docks, staging, recycling, MEP) 10mW* compute power (14kW compute 6kW networking) - standard cabinet densities up to 25kW, custom designs for 100kW. 758 (33k U) total pre-installed cabinets = 568 (25k U) of space for computing and storage, 190 (8.4k U) for networking and critical storage 1000 strands (2-3mi) pre-installed OM2/OM3, structured cabling for tenant use 1000 linear feet of tenant accessible, inter-cabinet cable tray High Capacity WAN Networking 150 strands in MGHPCC manhole - ~10Pb/s (if all were put in service) Providers- MIT, UMass, VZ, Comcast, CrownCastle Multiple 10G WAN paths to members home locations, 100G to I2, redundant commodity 200M internet Room to expand - Site power and space to build another MGHPCC * 20% UPS/Critical Power

5 How we re Green Power portfolio is greater 94% carbon free 1.2 PUE (yearly average) - comparable to best in class Free Cooling (a.k.a water-side economizer) In row cooling Hot aisle containment 400V power distribution Continuous improvement - Monitor, modify, measure, repeat Plus a lot of small things (no conditioning in electrical rooms, VFDs, trim chiller, ECO mode UPS, motion sensors, etc.) US Green Building Council, LEED Platinum Certified

6 Collaborative Projects C3DDB:: Dedicated to Life Sciences research University and industry user community Mix of conventional and forward-looking hardware Mass Open Cloud:: New approach to cloud computing infrastructure. More than a dozen university, industry and government collaborators Northeast Storage Exchange Massive shared storage pool Jointly develop approaches to protecting sensitive data; retaining research data engaging1:: Science via traditional workflows and systems. Non-traditional workflows and technologies. Experiments with joint facilities integrated across universities 6 Cyber Team: Improving Access to Regional and National Cyberinfrastructure for Small and Mid-Sized Institutions New! Open Storage Network:: Distributed National-Scale Storage for Research data MGHPCC is one of seven pilot sites nationwide

7 MGHPC Living Lab NEU Senior Capstone Project

8 What s going on behind the rack doors? BU and Harvard participate in experiments with the Large Hadron Collider. Higgs Boson anyone? Li-Jun Ma at UMass helps protect world-wide wheat production from killer fungi. Adam Willard, a theoretical chemist at MIT tweaks molecules for novel, organic, photovoltaic materials. Dr. Saritha Nellutla, uses C3DDB at the MGHPCC to carry out virtual lab experiments in the chemistry course she teaches at Bridgewater State. Entrepreneurs at Silicon Therapeutics, a MA based R&D company, model proteins to drive drug discovery.

9 More Projects Mass DOT:: Storage and analytics for DOT acquired data products (MBTA data below). New! MADrones:: Work with state of Mass to leverage Drone data and assets. 9

10 Education and Economic Development Holyoke Codes Community Meeting and Classroom space Science in the Cloud Scholarship Fund Innovation District Task Force Cisco Networking Academy Girls Connect (Robotics) Transform 8 downtown acres Internship Program Smart Meter Project New! 5 new interns (added to our 7 alumns) Anchor Tenant for the Innovation District 10 Solar Powered Computing

11 11