Discovery, Unconstrained by Geography

Transcription

1 Discovery, Unconstrained by Geography ACAT 2016 Valparaiso, Chile January 21, 2016 Gregory Bell, Ph.D. Director, Energy Sciences Network (ESnet) Director, ScienKfic Networking Division Lawrence Berkeley NaKonal Laboratory

2 2 1/20/16

3 NRENs: the world s science backbone. UK US CU MX GT HN SV NI CA CR PA VE CO EC PE BO PY BR CL UY AR 10 Mbps 34 Mbps 155 Mbps 600 Mbps 2 Gbps 2.5 Gbps 06 / Mbps 622 Mbps 5 Gbps 90 Mbps 1 Gbps 10 Gbps 3 1/20/16 Courtesy RedCLARA

4 DOE s Energy Sciences Network (ESnet):

5 80% of ESnet traffic originates or terminates NRENs share fate. No research network can outside the Department of Energy complex. succeed in isolagon. 80% of ESnet traffic originates or terminates outside the DOE complex.

6 NRENs Trends and Impacts

7 NRENs Trends and Impacts

8 Consider the recent evolugon of the LHC data model: In chronological order 1. Copy as much data as is feasible to analysis centers worldwide, with hierarchical distribukon scheme ( Monarc model, determiniskc flows). 2. Relax the hierarchy, and rely on opkmiskc caching. 3. Use federated data stores to fetch por$ons of relevant data sets from remote storage (anywhere), just before they re needed. 4. OpportunisKc use of cloud resources? ATLAS CMS@home? 1/20/16 8

9 Consider the recent evolugon of the LHC data model: In chronological order 1. Copy as much data as is feasible to analysis centers worldwide, with hierarchical distribukon scheme ( Monarc model, determiniskc flows). 2. Relax the hierarchy, and rely on opkmiskc caching. 3. Use federated data stores to fetch por$ons of relevant data sets from remote storage (anywhere), just before they re needed. 4. OpportunisKc use of cloud resources? ATLAS CMS@home? This evolukon implies two thing: 1) growing faith in research networks 2) decreasing relevance of geography 9 1/20/16

10 ESnet vision: ScienKfic progress will be completely unconstrained by the physical locakon of instruments, people, computakonal resources, or data. 10

11 The most important thing to know about NRENs: they are not ISPs.

12 They are instruments for discovery designed to overcome the constraints of geography. Offering unique capabilikes and opkmized for data acquisikon, data placement, data sharing, data mobility.

13

14 Elephant flows require almost lossless networks. Local (LAN) InternaKonal Metro Area Regional ConKnental Measured (TCP Reno) Measured (HTCP) Theoretical (TCP Reno) Measured (no loss) 14. See Eli Dart, Lauren Rotman, Brian Tierney, Mary Hester, and Jason Zurawski. The Science DMZ: A Network Design Pajern for Data- Intensive Science. In Proceedings of the IEEE/ACM Annual SuperCompu$ng Conference (SC13), Denver CO, 2013.

15 Bytes of Science Data Transferred Each Month by the Energy Sciences Network August 2015: PB Total Feb-94 Apr-98 Jun-02 Aug-06 Oct-10 Dec-14 Month

16 Bytes of Science Data Transferred Each Month by the Energy Sciences Network August 2015: PB Total Feb-94 Apr-98 Jun-02 Aug-06 Oct-10 Dec-14 Month

17 17

18

19 NRENs Trends and Impacts

20 In 1986, physics community made two modest requests : 1. What we can do on LANs today is indicakve of what we wish to be able to do on wide area networks. 2. Just as we expect a computer to perform as if we are the only user, we expect the network to give that same appearance.

21 In 1986, physics community made two modest requests : 1. What we can do on LANs today is indicakve of what we wish to be able to do on wide area networks. 2. Just as we expect a computer to perform as if we are the only user, we expect the network to give that same appearance.

22 Emerging global consensus around Science DMZ architecture. 1. FricKon-free network path 2. Dedicated data transfer nodes (DTNs) 3. Performance monitoring (perfsonar) >120 universikes in the US have deployed this ESnet architecture. NSF has invested >>$60M to accelerate adopkon. Australian, Canadian universikes following suit. hyp://fasterdata.es.net/science-dmz/

23 Coming next? EvoluGon of Science DMZ as a regional and na,onal pla^orm. Pacific Research Pla^orm inigagve, lead by Larry Smarr (Calit2/UCSD) first large-scale effort to coordinate and integrate Science DMZs parkcipakon by all major California R&E insgtugons, CENIC, ESnet 23 1/20/16

24

25 25 $$$ ètcp++

26 In 1986, physics community made two modest requests : 1. What we can do on LANs today is indicakve of what we wish to be able to do on wide area networks. 2. Just as we expect a computer to perform as if we are the only user, we expect the network to give that same appearance.

27

28

29 An architecture we foresee: ESnet as pla.orm for concurrent, domain-specific network apps. Requires network operakng system for science. early-stage project (LBNL LDRD) mulkple challenges in creakng flexible, stable app execukon environment We envision apps that will express high-level inten$ons: create and manage virtual networks enable programmakc resource allocakon opkmize link uklizakon Future apps could support: NDN for climate; data management for CMS, ATLAS, Belle-II; security overlay for KBase; replicakon for ESGF; detector / HPC coupling for light sources workflows we haven t imagined 29

30 Superfacility: our global science complex can become more than the sum of its parts. Real-Gme analysis of slot-die technique for pringng organic photovoltaics, using ALS + NERSC (SPOT Suite for reducgon, remeshing, analysis) + OLCF (HipGISAXS running on Titan w/ 8000 GPUs) hjp:// Results presented at March 2015 meekng of American Physical Society by Alex Hexemer. AddiKonal DOE contribukons: GLOBUS (ANL), CAMERA (Berkeley Lab)

31 In conclusion: Global science networks are not ISPs rather, extensions of your discovery instruments. HEP s modest requests from 1986 are in the process of being fulfilled. discovery unconstrained by geography is explicit vision of ESnet and virtualizakon is a global inikakve Design pajerns, architectures, workflows and challenges from HEP science are now crossing over to domains. 31

32 In conclusion: Global science networks are not ISPs rather, extensions of your discovery instruments. HEP s modest requests from 1986 are in the process of being fulfilled. discovery unconstrained by geography is explicit vision of ESnet and virtualizakon is a global inikakve Design pajerns, architectures, workflows and challenges from HEP science are now crossing over to domains. HEP has been pushing the boundaries of networking for three decades. please keep it up! It s Kme to make your next modest requests we are taking orders for

33 Thank you. 33