Eastern Regional Network (ERN) Barr von Oehsen Internet2 Tech Exchange 10/16/2018

Transcription

1 Eastern Regional Network (ERN) Barr von Oehsen Internet2 Tech Exchange 10/16/2018

2 Eastern Regional Network (ERN) Vision: To simplify multi-campus collaborations and partnerships that advance the frontiers of research and innovation. Mission: Through a partnership of educational institutions, research facilities, regional network providers, and Internet2, the ERN is committed to providing layered and transparent access to shared data and computing facilities for research projects located at partner sites to address the growing need for a regional research platform designed to support a diverse set of science drivers and education needs. The resulting layered approach offers the research community across the region access to a broad range of services and resources that are not available on any one campus alone.

3 Solving Challenges Related to: Supporting and enabling research collaborations that span multiple universities Sharing and accessing data Building, managing, supporting, and sharing distributed federated resources/infrastructure that spans multiple campuses and commercial cloud designed to enable research Creating performant, software-configurable, and intelligent networks to enable access to research resources Creating testbeds around new and emerging technologies, software stacks, etc., being asked for by the research community Having a safe space for Central IT to experiment with new and emerging technologies without the worry of breaking enterprise infrastructure Sharing expertise and building collaborations across both research and IT silos Workforce development, especially for schools that don t typically have access to campus cyberinfrastructure, research testbeds, new and emerging technologies, etc. Writing broader impact statements on grant proposals

4 What Are The Science Drivers? Genomics Climate research High Energy Physics Digital humanities Medical/clinical research Precision health Systems biology Computational social science Computer science (testbeds, IoT, Edge computing, etc) Network research Multi-scale modeling Chemistry Industry testbed

5 Origins and Evolution Germ of an idea: at 2017 National Research Platform meetings Can the regional research platform idea work in the Northeast? Rutgers, OSHEAN, Kinber Coalition of the Willing: January 2018 gathering at Rutgers Can we find something of common interest to work on? Kinber, Rutgers, OSHEAN, MGHPCC, Internet2, NYSERnet Resource Federation Proof of Concept: Can we work together to prototype a potentially beneficial resource federation idea? Rutgers, MGHPCC, Syracuse, NJ Edge, U Maine, Google, Internet2 Early if not elegant approach; emphasis on getting people to work together

6 Origins and Evolution Northeast perfsonar Mesh: Can we work together toward a regional science DMZ? Federation sites plus BU, Brown, Colby, CEN, Kinber, Network Maine, OSHEAN, UNH Less-specialized technology allows expanded participation Growing interest: Maybe we really can do this? [in progress] expanded steering committee; per-project working groups All of the above plus U Delaware, NJIT, U Buffalo, Bucknell, UMass Amherst, Yale, Princeton, U Iowa, Penn State, Purdue, U Kentucky

7 Resource Federation Proof of Concept Recipe for joining: Six sites, five states Ability to launch containerized (Singluarity) jobs as well as traditional HPC jobs, from any site to any other site including commercial cloud, via SLURM scheduler. Working with Google, Cisco, Internet2, SchedMD (SLURM), and OSG on enhancements InCommon authentication and authorization Policy based federation of computing resources Reserving slices of the network Cloud bursting OSG federation with containerized SLURM (slurmd) Testing different data sharing approaches as well as filesystems

8 ERN perfsonar Mesh 21 nodes, 14 sites, six states New sites welcome Still in teething phase Improves visibility on connectivity/bandwidth/delay Starting point for connectivity improvements (where they matter) Prerequisite for a regional data DMZ Site: Select Dashboards -> Northeast Mesh Recipe for joining:

9 Looking ahead Some Possibilities Regional technology testbeds Regional Science DMZ Common interface to resources, independent of provider Campus resources, national resources, commercial cloud Resource bartering system Advanced network technologies (experiment->pilot->production) Simplified engagement with national resources and initiatives National Research Platform (NRP) Open Storage Network (OSN) Big Data Hubs Open Science Grid National Resources (XSEDE, GENI, Cloudlab, Chameleon) Commercial cloud providers (Azure, AWS) Regional infrastructure proposals Improve competitiveness on larger solicitations Mosaic of smaller proposals that benefit the whole New security models Zero trust?