International Big Science Coming to Your Campus Soon (Sooner Than You Think ) Lauren Rotman ESnet Science Engagement Group Lead April 7, 2014
ESnet Supports DOE Office of Science Office of Science provides broad support for Labs, Facilities, people almost $5B/year in funding 45% of Federal support for physical sciences research key funding for basic research in biology, computing, energy, climate over 100 Nobel Prizes in past 60 years Supports > 27,000 PhDs, grad students, engineers at >300 institutions. Provides world's largest collection (32) of scientific user facilities: supercomputer centers, accelerators, light sources, neutron sources, electron microscopes, nano-scale centers, a sequencing center, fusion facilities. ESnet is classified as a DOE user facility 4/6/14 2
Traditional Big Science 4/6/14 3
Big Science Now Comes in Small Packages 4/6/14 4
Light Sources and sequencers are producing data faster than Moore s Law Synchrotrons Sequencers 60 Expected Data Rate Production Increase over 2010 10000000 Data Rate in Mbps 1000000 100000 10000 1000 100 10 1 ALS <2 years 2-5 years NSLS > 5 years SLAC 50 40 Sequencers Detectors Processors Memory 30 20 10 0 2010 2011 2012 2013 2014 2015-5-
One Beamline Data Flow Tripled Network Use for a DOE Supercomputing Center
Light Sources in Production or Under Construction 2015 low rep rate high rep rate 2009 LCLS-II 2018 2016 2011 2014 source: Paul Alivisatos 4/6/14 7
10 17 10 16 Science Data Transferred Each Month by the Energy Sciences Network 10 15 Bytes Transferred 10 14 10 13 10 12 10 11 10 10 Feb-94 Apr-98 Jun-02 Aug-06 Oct-10 Month
Universities funded by DOE & NSF BER (genomics, climate) BES (life & materials science) CC-NIE awardees (round 1) CC-NIE awardees (round 2) 4/6/14 9
Challenges to Network Adoption Causes of performance issues are complicated for users. Lack of communication and collaboration between the CIO s office and researchers on campus. Lack of IT expertise within a science collaboration or experimental facility User s performance expectations are low ( The network is too slow, I tried it and it didn t work ). Cultural change is hard ( we ve always shipped disks! ). Scientists want to do science not IT support The Capability Gap 10 ESnet Science Engagement (engage@es.net) - 4/6/14
Science Data Transport Tomorrow? 4/6/14 11
ESnet Engagement Team Vision Collaborations at every scale, in every domain, will have the information and tools they need to achieve maximum benefit from global networks. 12 ESnet Science Engagement (engage@es.net) - 4/6/14
ESnet Science Engagement Services Partnerships With facilities / research teams / providers, building foundation for lasting impact. Education & Consulting Webinars, workshops, 1:1 data mobility consultations with scientists, support teams. Resources & Knowledgebase Reference designs, case studies, papers, FAQs tailored for multiple audiences. 13 ESnet Science Engagement (engage@es.net) - 4/6/14
1 GE link ESnet Core Router Sacramento ESnet 10 GE link 10 GE virtual circuit Cenic UC Berkeley ESnet Site Router 100 GE link ALS Science DMZ Switch ESnet Core Router Sunnyvale Border Router Border Router Data Transfer Node Data Transfer Node Data Transfer Node LBL Edge Router 1 LBL Edge Router 2 LBL Edge Router 3 ALS Router JGI Router Data Transfer Node Slide courtesy of Rune Stromsness, LBL
1 a coordinated multiagency, international collaboration of institutions that continually develop, deploy, and maintain the software and infrastructure needed for climate science.... 1. Luca Cinquini, Daniel Crichton, Chris Mattmann, Gavin M. Bell, Bob Drach, Dean Williams, John Harney, Galen Shipman, Feiyi Wang, Philip Kershaw, Stephen Pascoe, Rachana Ananthakrishnan, Neill Miller, Estanislao Gonzalez, Sebastian Denvil, Mark Morgan, Sandro Fiore, Zed Pobre, Roland Schweitzer, The Earth System Grid Federation: An Open Infrastructure for Access to Distributed Geospatial Data, IEEE Future Generation Computer Systems, http://dx.doi.org/10.1016/j.future.2013.07.002, 17 September 2013. Slide courtesy of Dean Williams, Lawrence Livermore National Lab
ESGF is a major contributor to Intergovernmental Panel on Climate Change (IPCC) reports: CMIP data history Bytes 1E+20 1E+19 1E+18 1E+17 1E+16 1E+15 1E+14 1E+13 1E+12 1E+11 1E+10 1E+09 100000000 10000000 1000000 100000 10000 1000 100 10 1 The balance of evidence suggests a discernible human influence on global climate (1 GB of data) CMIP1: (1 GB of data) There is new and stronger evidence that most of the warming observed over the last 50 years is attributable to human activities (500 GB of data) CMIP 2: (500 GB of data) Most of the observed increase in globally averaged temperatures since the mid-20 th century is very likely* due to the observed increase in anthropogenic greenhouse gas concentrations (35 TB of data) CMIP3: (35 TB of data) This evidence for human influence has grown since AR4. It is extremely likely that human influence has been the dominant cause of the observed warming since the mid-20th century. (3.5 PB of data) CMIP5: (3.5 PB of data) CMIP6: (3 EB?) Slide courtesy of Dean Williams, Lawrence Livermore National Lab
Success stories: Education Focused Technical Workshops Brings together domain scientists with engineers for productive problem solving and dialogue, in partnership with Internet2 Operating Innovative Networks Workshops Hands-on training for network engineers interested in deploying and supporting Science DMZ, perfsonar and SDN In partnership with Internet2, and IU GRNOC Supercomputing Science DMZ paper nominated for Best Paper Tutorial with Globus on Science DMZ and Globus Toolkit Hands-on perfsonar Tutorial Webinar Series Host regular webinars on perfsonar, Science DMZ and other data transfer topics focused for particular science domains, in collaboration with Globus FasterData Robust and constantly updated knowledgebase 17 ESnet Science Engagement (engage@es.net) - 4/6/14
International Big Science Coming to Your Campus Soon (Sooner Than You Think ) Lauren Rotman ESnet Science Engagement Group Lead April 7, 2014