Scaling Across the NRP Ecosystem From Campus to Regional to National - What Support Is There? 2NRP Workshop Bozeman, Montana Tuesday, August 7, 2018

Transcription

1 Scaling Across the NRP Ecosystem From Campus to Regional to National - What Support Is There? 2NRP Workshop Bozeman, Montana Tuesday, August 7,

2 Panel Lars Fischer NORDUnet Kate Mace ESnet Marla Meehl UCAR/FRGP Inder Monga - ESnet Howard Pfeffer Internet2 Jen Schopf - IU [ 2 ]

3 NORDUnet

4 Second National Research Platform Workshop August 6-7, 2018 Montana State University Bozeman, Montana Panel Discussion: Scaling Across the NRP Ecosystem from Regional to National to International NORDUnet DTN initiaitive: Infrastructure (OXPs) Workshops Community building Campus Pilots Nordic and European Outreach Challenge or Approach: Distrance from research community; pilots with local groups with Nordic and global reach Lack of experience; Building up Nordic and European Technical Community Science Engagement; Support for emerging European science engagement activities Future: Deployment of Nordic DTN infrastructure Leveraging FileSender experience and user interface Deployment of DTNs at Open Exchanges; foundation for global infrastructure European-level effort through GÉANT and EOSC project(s) <insert graphic(s), diagram, or picture here> Scientific Impact or Broader Impact: Bringing the PRP experience to the Nordic community Creating infrastructure foundation for Nordic science engement Strengthening focus on science engagement in EU efforts (EOSC, GÉANT) Name and Lars Fischer,

5 Scaling to 1 Tb/s per experiment Sample Example - LCLS 2 ( ) 5 This assumes 10x data reduction is achieved

6 Superfacility Vision: A network of connected facilities, software and expertise to enable new modes of discovery Programmable network MS-DESI New Math Other dataproducing sources LHC Data mgmt. and sharing Extreme Data Science Facility (XDSF) ESnet Real-time analysis LCLS JGI Novel compute/da ta platforms APS High performance Software - 6 -

7 Second National Research Platform Workshop August 6-7, 2018 Montana State University Bozeman, Montana Panel Discussion: Scaling Across the NRP Ecosystem from Regional to National to International The Petascale DTN Project Performance engineering for HPC facility DTN clusters High performance with usable tools Production capability Minimum 1PB/week performance Available to all HPC facility users Approach: High level leadership commitment Integration and a platform for innovation Leverage previous advances perfsonar Science DMZ Future: Expanding to additional facilities Incorporating data portals Supports superfacility model Coupled HPC and Experiment Integrating multiple facilities using high performance networks Scientific Impact: Easy mobility of large-scale data Increased scientific user productivity Science networks are more valuable to HPC users Enables large-scale data analysis Integration of big data sets Machine Learning Sharing of results at scale Name and Inder Monga imonga@es.net

8 Second National Research Platform Workshop August 6-7, 2018 Montana State University Bozeman, Montana Panel Discussion: Scaling Across the NRP Ecosystem from Regional to National to International NRP Testbed: Pilot national science network applications, workflows, automation/api/orchestration, security & technology opportunities for NRP PRP, ONENet and Kinber participating, let us know of additional interest Future: Opportunities for application software testing/integration Opportunities to think about security, analytics and telemetry from science networks Challenge or Approach: Internet2 working with vendors to prototype automation/orchestration to enable science network applications in a lab (now). Opportunity to deploy a physical testbed with dedicated capacity later this year. Scientific Impact or Broader Impact: Speed time to science Provide best practice workflows for data intensive science Provide better telemetry and measurement to NSF projects

9 Second National Research Platform Workshop August 6-7, 2018 Montana State University Bozeman, Montana Panel Discussion: Scaling Across the NRP Ecosystem from Regional to National to International Open Science Grid StashCache Pilot: Added nodes to PRP/OSG for disk capacity in New York, Chicago and Kansas City with 100G to backbone Instrumenting to testing performance Future: Test cloud data movement opportunities with cache at cloud provider direct-connect sites Telemetry/analytics prototype for scaling infrastructure Challenge or Approach: Added disk capacity to existing PRP/Kubernetes clusters in New York and Chicago with 100G GPN Provided additional node in Kansas City near Nebraska OSG users Future: Investigate cloud data movement opportunities in Chicago Scientific Impact or Broader Impact: Speed time to science Test cloud data movement Provide better telemetry and measurement to NSF projects

10 From a user standpoint, users have their own trial and error way of locating the fastest service. It seems when the network is slow, we simply let the download continue and mind other things.

11 NCAR, UCAR, FRGP, BiSON, WRN, NWAVE, I2, Esnet Climate/weather Scientific Hierarchy & Partnership n/ Future: Faster, bigger computers BIG data Cloud computing and storage Data analytics and informatics Machine learning Server-side analysis Interdisciplinary collaboration Increasingly higher resolution, complex weather and climate models Multi-model datasets Climate and weather services Second National Research Platform Workshop August 6-7, 2018 Montana State University Bozeman, Montana Panel Discussion: Scaling Across the NRP Ecosystem from Regional to National to International Name and Marla Meehl Challenge and Approach: End-to-end performance: PerfSonar meshes; proactive information/detection (Netsage) Strategies for storing and serving big data (NCAR/UCAR/NOAA): CMIP analysis platform; caching; distributed storage; data mining; Data Analytics: how to cull knowledge from large, complex data Scientific Impact: Climate and Weather To understand the behavior of the atmosphere and related Earth and geospace systems; to support, enhance, and extend the capabilities of the university community and the broader scientific community, nationally and internationally; to foster the transfer of knowledge and technology for the betterment of life on Earth

12 Researcher/Science Engagement First National Research Platform Workshop: August 7, 2017 Session One - Scaling Science Communities: Lessons Learned and Future Plans Advanced Cyberinfrastructure Research and Educational Facilitation (ACI-REF): Campus-Based Computational Research Support Tom Cheatham, University of Utah If CaRC* Consortium could deliver one thing to you, "a must have," what would it be? (Something that you personally value or that is professionally useful to you. It would motivate you to want this to move forward.) What is the biggest barrier preventing or limiting your must have? * = Campus Research Computing Infrastructures

13 National Science Board report: Science and Engineering Indicators 2018 Global Science & Engineering Work Force Figure 3-38 National Science Board Science and Engineering Indicators 2018 Digest. NSB Alexandria, VA: National Science Foundation. Available at

14 Second National Research Platform Workshop August 6-7, 2018 Montana State University Bozeman, Montana Panel Discussion: Scaling Across the NRP Ecosystem from Regional to National to International Sustainable, dedicated Engagement professionals Community momentum Expansion of training Unique skill set Full time job Global need Approach: Engagement Professionals = critical part of the instrument Fundamental requirement, like electrical, network, plumbing Include full time Engagement in ongoing facility & instrument costs Future: More complete view of supporting research/science Big Ideas, other solicitation responses Leverage the investments from other agencies and industry National Science Board Science and Engineering Indicators 2018 Digest. NSB Alexandria, VA: National Science Foundation. Available at Scientific Impact or Broader Impact: Specialized Engagement professionals for each instrument, Center, facility, etc. Demonstrated demand for the profession Faster adoption of best practices Kate Petersen: kate@es.net

15 Scaling Science Engagement Dr. Jennifer M. Schopf Director, EPOC Director, International Networks Indiana University

16 Engagement and Performance Operations Center (EPOC) Joint project between Indiana University and ESnet co-pi Jent (GlobalNOC) and Zurawski (ESNet) Part of CC* program for domestic science support Award # , $3.5M over 3 years Partnerships with regional, infrastructure, and science communities INDIANA UNIVERSITY

17 Challenge: Understanding End-to-End Performance is hard Lots of pieces - Host system through networks to host system No one controls all the pieces Unknown expectations for what performance should be Soft failures are hard to find Many, many points of coordination INDIANA UNIVERSITY

18 EPOC Five Main Focus Areas 1. Roadside Assistance for Performance Problems 2. Application Deep Dives 3. Network Analysis (NetSage) 4. Services in a box (DMZ, testpoint in a box, etc) 5. Training INDIANA UNIVERSITY

19 EPOC Roadside Assistance This file transfer worked last week, but it doesn t anymore? Think of this like a flat tire, crash repair Collaboration of 3 teams already doing this Engagement team at ESnet IN@IU IRNC NOC Performance Engagement Team (PET) INDIANA UNIVERSITY

20 EPOC Deep Dives Based on ESNet Case Studies Walk through science workflow with the actual scientists Way to understand needs and planning Think of this as regular maintenance, oil change, or planning to buy a new car INDIANA UNIVERSITY

21 Scaling Engagement Operations Center Approach Central point of contact Operations Center Approach Ticketing Service center framework Dedicated team- NOT just volunteers Coordination Ties to the community Take advantage of the coalition of the willing INDIANA UNIVERSITY

22 Need for Measurements Performance and Measurements are 2 sides of a coin EPOC includes domestic deployments of the NetSage framework SNMP, perfsonar, Flow, Tstat Data Grafana-based dashboards to visualize performance Common basic measurement data is the first step to understanding performance issues See tomorrow s panel INDIANA UNIVERSITY

23 Takeaways EPOC is an NSF-funded operations center to help scale engagement Joint project between Indiana University and ESnet Roadside assistance and Deep dives Ask for help: More information: Jennifer Schopf, INDIANA UNIVERSITY