Assume a Supercomputer (and a bunch of other stuff)

Transcription

1 Assume a Supercomputer (and a bunch of other stuff)

2 Earthcube & Other Origins Achieving the EarthCube goal of an integrated system to access, analyze and share information that is used by the entire geosciences community will require transformative advances in approaches to data collection, integration, analysis, and curation. Success depends on identifying productive solutions from inside and outside the community while building on decades of effort in developing the existing community cyberinfrastructure.

3 Hyak & Other Origins Cyberinfrastructure is the coordinated aggregate of software, hardware and other technologies, as well as human expertise, required to support current and future discoveries in science and engineering. The challenge of Cyberinfrastructure is to integrate relevant and often disparate resources to provide a useful, usable, and enabling framework for research and discovery characterized by broad access and end-to-end coordination. * Francine Berman (February 18, 2005). "SBE/CISE Workshop on Cyberinfrastructure for the Social Sciences". San Diego Supercomputer Center.

4 Assume a Can Opener

5 Good & Improving Networking Internet2 Network Connections July of 2015 Pacific Northwest GigaPOP 2-100G, Seattle/Chicago OARnet 100G, 10G Cleveland/Chicago University of Montana Drexel Oregon Gigapop UIUC 2-10G, Seattle/LA MREN NSHE 2-100G, Boston/New York 3ROX 100G, Starlight 100G, Pttisburgh 100G, Starlight UEN NOX 100G, Philadelphia 100G, Missoula CEN 100G, Hartford 100G, Salt Lake City NYSERNet 2-100G, Reno, Las Vegas 2-100G, 10G New York City/Buffalo CIC OmniPOP 2-100G, Chicago/Starlight MAGPI 100G, Philadelphia KyRON GPN CENIC 10G, Louisville 2-100G, Kansas City/Tulsa 100G, LA Sun Corridor 2-100G Tucson/Phoenix Indiana GigaPOP MAX 100G, 10G Chicago/Indianapolis 100G, 10G, McLean/McLean CAAREN 100G, McLean MCNC/C-Light U of Memphis MissiON 10G, Memphis 2-10G, Jackson/Jackson 2-100G, Raleigh/Charlotte MARIA 100G, Ashburn IP router site SOX Connector site 100G, Atlanta LEARN Connection LEARN Connector name 2-100G No. of connections x speed Houston/Dallas First/second port city 2-100G Houston/Dallas NETWORK PARTNERS LONI 100G, Baton Rouge FLR 100G, Jacksonville

6 Globaly! THE INTERNATIONAL REACH OF THE INTERNET2 NETWORK NSF IRNC-sponsored connections Other international connections For further information regarding the international programs of Internet2, visit or contact Heather Boyles, International Relations Director, A listing of networks reachable via the Internet2 Network is found on the back of this page. U.S. Exchange Points PacificWave PacificWave-North PacificWave-Bay Area PacificWave-South StarLight AtlanticWave MANLAN NGIX-East AMPATH

7 And Locally! R&E Networks at Starlight 10G via Northern Wave Internet Pacific Rim R&E Networks 100G via Pacific Wave Pacific Northwest Gigapop 100G via Internet2 AL2S US R&E Networks Typical campus user UW Campus 40G MPLS Network PerfSonar High Speed Research Network (HSRN) lolo Hyak Co- Located Research Equipment Nx10G/40G/100G Campus Researcher Nx10G/40G to campus research labs NSF CC- NIE funding supports 10G/40G/100G interconnect components in the green devices.

8 The Networking Business Model Or, how successful efforts are funded > Partner with researchers with leading needs > Design a solution that satisfies their needs > Apply for funding > Let everyone else come along FOR FREE

9 An assumed Supercomputer Or, what we learned from Hyak > Transfers from Outside to Central HPC > Transfers from Campus to Central HPC > Transfers from Outside to Campus

10 SIZE isn t the only important dimension

11 Not a Can Opener, supercomputer But which supercomputer? > It s not about the cycles, it s the data that matters Assumes magic? > Take the CPU to the data Origin s in MapReduce & Hadoop, irrelevant today Assumes a single-purpose system Assumes each researcher has one > CLOUD! Assumes one cloud Assumes you can pay for it Assumes it does what you want

12 CLOUD! Is Always Cheaper!!!! errrrr, just kidding Hyak"/"AWS"Effective"Hourly"Rates %"Usage Hyak AWS"On0 AWS"10year" AWS"30year" Demand Reservation Reservation 100% % % % % % % % % %

13 CLOUD! Is Always Cheaper!!!! errrrr, just kidding, in a plot $12.00$ Hyak'and'AWS'Effec%ve'Hurly'Rates'Compared' $10.00$ $8.00$ Effec%ve'$/Node/Hr' $6.00$ $4.00$ Hyak$ AWS$On8Demand$ AWS$18year$ReservaAon$ AWS$38year$ReservaAon$ $2.00$ $0.00$ 100%$ 90%$ 80%$ 70%$ 60%$ 50%$ 40%$ 30%$ 20%$ 10%$ %'Usage'Over'Time'

14 But what about XSEDE? Top$10$Users$+$Hyak$vs$XSEDE$+$2014$ 7,259,042' Hyak' XSEDE' 18,298,792'

15 Distributed Supercomputing Doesn t Work

16 EFFECTIVE throughput still poor

17 CLOUDY storage still slow

18 The Use Cases > Prep for Petascale P4P Campus<->Hyak<->Outside Immediate, on-demand access Traditional queue useful for testing at larger scales > Speed of Science SoS Campus<->Hyak<->Outside Immediate, on-demand access Traditional queue useful for parameter sweeps, etc. > Big Data Pipelines Catchy Abbreviation Pending Campus<->Hyak Immediate, on-demand access Traditional queue useful exploration

19 The Campus Condo Cluster

20 Is a collection of Personal Supercomputers

21 With a traditional supercomputer FOR FREE 100%# Hyak'Elas.c'Usage'' 90%# 80%# 70%# 60%# 50%# 40%# 30%# TOTAL# Std# Backfill# Interac>ve# GPU# 20%# 10%# 0%# 1# 7# 13# 19# 25# 31# 37# 43# 49# Months'

22 Supporting DIVERSE Workloads Hyak'Core5Hours'Used'in'Standard'Queues' by'job'core5count'&'run$me' 8.00%" 7.00%" %'of'std.'queue'core5hours' 6.00%" 5.00%" 4.00%" 3.00%" 2.00%" 1.00%" 0.00%" 8" 16" 32" 64" 128" 256" 512" 1024" 2048" 4" 8" 256" 128" 64" 32" 16" Run$me'in'Hours' Core'Count'

23 Partnering with Anchor Tenants Works for STORAGE Too! %# 90.00%# 80.00%# 70.00%# 60.00%# 50.00%# 40.00%# 30.00%# 20.00%# 10.00%# 0.00%# Users%vs%Bytes% UW%Libraries%Data%Repository%Survey%Results% KB# MB# GB# TB# PB# >PB# %#Respondents# 5.10%# 28.23%# 45.92%# 18.37%# 1.36%# 1.02%# %#Bytes# 0.00%# 0.00%# 0.00%# 0.16%# 11.75%# 88.10%#

24 Files vs Bytes It s the same story everywhere % Files % Bytes Percentage log(2) filesize

25 Conclusions Which supercomputer? > Leadership-class systems are important, of course > Distributed computing (e.g. BOINC) also! > But CAMPUS CONDOS fill an important and growing gap > And the networks we re building already ASSUME Campus Condos (or similar)!

26 Conclusions Don t assume your cyberinfrastructure! > Fill the gap with a Campus Condo Cluster > And Storage DTN, archives, and working disk > Partner with your biggest users it works > And provide assistance to the Long Tail it won t grow by itself

27 Assume a Supercomputer (and a bunch of other stuff) THANKS! Chance Reschke reschke@uw.edu