Overview of XSEDE for HPC Users Victor Hazlewood XSEDE Deputy Director of Operations

Transcription

1 October 29, 2014 Overview of XSEDE for HPC Users Victor Hazlewood XSEDE Deputy Director of Operations

2 XSEDE for HPC Users What is XSEDE? XSEDE mo/va/on and goals XSEDE Resources XSEDE for HPC Users: Before account XSEDE for HPC Users: ABer account

3 What is XSEDE? XSEDE aspires to be the place to go to access digital research services XSEDE a tool for accelera7ng scien7fic discovery Accelerate scien7fic discovery by enhancing the produc7vity of researchers, engineers, and scholars through the use of advanced digital services and infrastructure. 3

4 What is XSEDE? An ecosystem of advanced digital services accelera/ng scien/fic discovery support a growing porholio of resources and services advanced compu/ng, high- end visualiza/on, data analysis, and other resources and services interoperability with other infrastructures A virtual organiza/on providing dynamic distributed infrastructure support services, and technical exper/se to enable researchers engineers and scholars addressing the most important and challenging problems facing the na/on and world A project funded by the Na/onal Science Founda/on 4

5 Motivation for XSEDE: Scien/fic advancement across mul/ple disciplines requires a variety of resources and services XSEDE is about increased produc/vity of the community and providing expanded capabili/es leads to more science is some/mes the difference between a feasible project and an imprac/cal one lowers barriers to adop/on XSEDE provides a comprehensive escience infrastructure composed of expertly managed and evolving advanced heterogeneous digital resources and services integrated into a general- purpose infrastructure 5

6 XSEDE s Strategic Goals Deepen and extend the use of the XSEDE ecosystem deepen use of XSEDE by exis/ng researchers extend use of XSEDE to new communi/es prepare the current and next genera/on via educa/on, training, and outreach raise the general awareness of the value of advanced digital services Advance the XSEDE infrastructure create an open and evolving infrastructure enhance the array of technical exper/se and support services offered Sustain the XSEDE infrastructure sustain a reliable and secure infrastructure provide excellent user support services operate an effec/ve and innova/ve virtual organiza/on 6

7 What do you mean by Advanced Digital Services? OBen use the terms resources and services these should be interpreted very broadly most are likely not operated by XSEDE Examples of resources compute engines: HPC, HTC (high throughput compu/ng), campus, departmental, research group, project, data: simula/on output, input files, instrument data, repositories, public databases, private databases, instruments: telescopes, beam lines, sensor nets, shake tables, microscopes, infrastructure: local networks, wide- area networks, Examples of services collabora/on: wikis, forums, telepresence, data: data transport, data management, sharing, cura/on, provenance, access/used: authen/ca/on, authoriza/on, accoun/ng, coordina/on: meta- queuing, support: helpdesk, consul/ng, ECSS, training, And many more: educa/on, outreach, community building, 7

8 XSEDE offers access to a variety of resources Leading- edge distributed memory systems Very large shared memory systems High throughput systems, including Open Science Grid (OSG) Visualiza/on engines Accelerators like GPUs and Xeon PHIs Many scien7fic problems have components that call for use of more than one architecture. 8

9 Current XSEDE Compute Resources TACC SDSC (coming soon) 9.6 PFLOPS (PF) Dell Cluster w/ GPUs and Xeon PHIs 2 PFLOPS (PF) Dell Cluster LSU 1 PF Dell Cluster w/ GPUs and Xeon PHIs TACC (coming soon) GaTech Data analysis cluster 615 TF HP GPU cluster SDSC 341 TFFLOPS (TF) Appro Distributed SMP cluster Lonestar TACC 302 TF Dell Cluster NICS 248T F Cray XC30 SDSC 100 TF Appro Cluster PSC 37 TF SGI UV (2 x 16TB shared memory SMP) Mason 3.8 TF HP Cluster with large memory nodes (2TB/node) 9

10 Current XSEDE Visualization Resources, Data Resources and Services Storage TACC Visualiza/on TACC 59 TF HP/NVIDIA cluster NICS Services 59 TF SGI/NVIDIA cluster Globus Online Data transfer service IU VM farm for gateways and web hos/ng 61 PB tape NICS 17 PB tape TACC 10 PB tape Data PSC 4 PB tape Data SDSC 4 PB tape 10

11 XSEDEnet 11

12 XSEDE for HPC Users: Before Website hnp:// Resources overview online hnps:// SoBware Search hnps:// User Guides hnps://

13 XSEDE for HPC Users: After User Portal hnps://portal.xsede.org MyXSEDE hnps://portal.xsede.org/my- xsede Resources system monitor hnps://portal.xsede.org/resource- monitor Documenta/on hnps://portal.xsede.org/documenta/on- overview

14 Questions?