International Climate Network Working Group (ICNWG) Meeting

Size: px
Start display at page:

Download "International Climate Network Working Group (ICNWG) Meeting"

Transcription

1 International Climate Network Working Group (ICNWG) Meeting Eli Dart ESnet Science Engagement Lawrence Berkeley National Laboratory Workshop on Improving Data Mobility & Management for International Climate Science Boulder, CO July 14, 2014

2 Outline ICNWG purpose and goals EYR status Beyond EYR Methods of performance verification Network Data transfer Globus integration Status Architecture New member interest To-Do list 2

3 ICNWG purpose and goals International Climate Network Working Group ESGF working group Congruent with EYR-Global award Purpose: improve data transfer performance between major climate data facilities Current tools (http/wget) won t scale to CMIP6 data volumes Technologies exist to significantly improve performance Science DMZ Globus Near-term goals replication workflow using GridFTP 500MB/sec network performance by May MB/sec (4Gbps) disk to disk transfer by August 2014 Longer-term goals 1GB/sec (8Gbps) disk to disk by August GB/sec (16Gbps) disk to disk by June 2016 (stretch goal) 3

4 International collaboration between NRENs to support researchers in using networks ESnet (US), Funet (FI), Internet2 (US), Janet (UK), SURFnet (NL) 2013 program awards included Engineering support and expertise for 4 proposals (2 in climate science) 10G link upgrade for KNMI Program motivations All research is global especially science Data requirements are increasing Networks can make an impact to help research progress If we ran a 2015 program, what other resources would scientists find beneficial from networks? 4

5 Beyond EYR-Global Expanding ICNWG CMIP6 what is needed? Almost certain to be more than what today s data nodes can handle Many more climate sites than the 5 EYR participants Data replication workflow from EYR is key first task In addition, performance increases at other sites would benefit the ESGF Similar goals for other sites Progressive performance increase over time 500MB/sec, 1GB/sec, 2GB/sec Is this enough? Maybe yes, maybe no.. 5

6 Methods of performance verification Start with perfsonar If the network can t do it, the storage systems certainly can t Well-deployed global test and measurement infrastructure Reference data sets for disk-to-disk transfers Not currently automated Could be semi-automated with some scripting Two goals Ensure things are functioning well If not, understand why it is broken what, why, when? 6

7 Globus integration Globus is being integrated into ESGF Globus software pieces for ESGF are done What remains is to integrate into deployed ESGF data nodes Architectural changes being explored Science DMZ model Globus I/O nodes attach directly to filesystem, serve data directly 7

8 New Member Interest Interest in joining ICNWG from additional sites NOAA NCAR In addition, suggestion to pursue ACME sites Primarily DOE labs Eli to reach out 8

9 Thanks! Eli Dart ESnet Science Engagement Lawrence Berkeley National Laboratory

10 A small amount of packet loss makes a huge difference in TCP performance Local (LAN) With loss, high performance beyond metro distances is essentially impossible International Metro Area Regional Continental Measured (TCP Reno) Measured (HTCP) Theoretical (TCP Reno) Measured (no loss)

Production Petascale Climate Data Replication at NCI Lustre and our engagement with the Earth Systems Grid Federation (ESGF)

Production Petascale Climate Data Replication at NCI Lustre and our engagement with the Earth Systems Grid Federation (ESGF) Joseph Antony, Andrew Howard, Jason Andrade, Ben Evans, Claire Trenham, Jingbo Wang Production Petascale Climate Data Replication at NCI Lustre and our engagement with the Earth Systems Grid Federation

More information

Engagement With Scientific Facilities

Engagement With Scientific Facilities Engagement With Scientific Facilities Eli Dart, Network Engineer ESnet Science Engagement Lawrence Berkeley National Laboratory Global Science Engagement Panel Internet2 Technology Exchange San Francisco,

More information

Enhancing Infrastructure: Success Stories

Enhancing Infrastructure: Success Stories Enhancing Infrastructure: Success Stories Eli Dart, Network Engineer ESnet Network Engineering Group Joint Techs, Winter 2012 Baton Rouge, LA January 24, 2012 Outline Motivation for strategic investments

More information

Network and Host Design to Facilitate High Performance Data Transfer

Network and Host Design to Facilitate High Performance Data Transfer Network and Host Design to Facilitate High Performance Data Transfer Jason Zurawski - ESnet Engineering & Outreach engage@es.net globusworld 2014 April 15 th 2014 With contributions from S. Balasubramanian,

More information

Discovery, Unconstrained by Geography

Discovery, Unconstrained by Geography Discovery, Unconstrained by Geography ACAT 2016 Valparaiso, Chile January 21, 2016 Gregory Bell, Ph.D. Director, Energy Sciences Network (ESnet) Director, ScienKfic Networking Division Lawrence Berkeley

More information

Achieving the Science DMZ

Achieving the Science DMZ Achieving the Science DMZ Eli Dart, Network Engineer ESnet Network Engineering Group Joint Techs, Winter 2012 Baton Rouge, LA January 22, 2012 Outline of the Day Motivation Services Overview Science DMZ

More information

Data Intensive Science Impact on Networks

Data Intensive Science Impact on Networks Data Intensive Science Impact on Networks Eli Dart, Network Engineer ESnet Network Engineering g Group IEEE Bandwidth Assessment Ad Hoc December 13, 2011 Outline Data intensive science examples Collaboration

More information

How Five International Networks are Enabling International Data-Intensive Research. Internet2 Global Summit 2014

How Five International Networks are Enabling International Data-Intensive Research. Internet2 Global Summit 2014 How Five International Networks are Enabling International Data-Intensive Research Internet2 Global Summit 2014 CONTENTS Brief introduction to EYR and EYR-Global Introduction to 2 selected projects Large

More information

A Brief Overview of the Science DMZ

A Brief Overview of the Science DMZ With contributions from S. Balasubramanian, G. Bell, E. Dart, M. Hester, B. Johnston, A. Lake, E. Pouyoul, L. Rotman, B. Tierney and others @ ESnet A Brief Overview of the Science DMZ Jason Zurawski -

More information

The perfsonar Project at 10 Years: Status and Trajectory

The perfsonar Project at 10 Years: Status and Trajectory With contributions from S. Balasubramanian, G. Bell, E. Dart, M. Hester, B. Johnston, A. Lake, E. Pouyoul, L. Rotman, B. Tierney and others @ ESnet The perfsonar Project at 10 Years: Status and Trajectory

More information

International Big Science Coming to Your Campus Soon (Sooner Than You Think )

International Big Science Coming to Your Campus Soon (Sooner Than You Think ) International Big Science Coming to Your Campus Soon (Sooner Than You Think ) Lauren Rotman ESnet Science Engagement Group Lead April 7, 2014 ESnet Supports DOE Office of Science Office of Science provides

More information

perfsonar Going Forward Eric Boyd, Internet2 Internet2 Technology Exchange September 27 th 2016

perfsonar Going Forward Eric Boyd, Internet2   Internet2 Technology Exchange September 27 th 2016 perfsonar Going Forward Eric Boyd, Internet2 http://www.perfsonar.net Internet2 Technology Exchange September 27 th 2016 Problem Statement The global Research & Education network ecosystem is comprised

More information

Research Cyberinfrastructure Upgrade Proposal - CITI

Research Cyberinfrastructure Upgrade Proposal - CITI 10/02/2015 Research Cyberinfrastructure Upgrade Proposal - CITI Bill Labate, Director Research Technology Group RCI Upgrade Executive Summary REQUEST Support for the funding request for upgrades to UCLA

More information

Network Support for Data Intensive Science

Network Support for Data Intensive Science Network Support for Data Intensive Science Eli Dart, Network Engineer ESnet Network Engineering Group ARN2 Workshop Washington, DC April 18, 2013 Overview Drivers Sociology Path Forward 4/19/13 2 Exponential

More information

Enabling Science Through Cyber Security At 100G

Enabling Science Through Cyber Security At 100G Enabling Science Through Cyber Security At 100G Submitted by: Rosio Alvarez, Ph.D. Chief Information Officer, Berkeley Lab RAlvarez@lbl.gov Project team: IT Division, Cyber Security Team Aashish Sharma

More information

HIDDEN SLIDE Summary These slides are meant to be used as is to give an upper level view of perfsonar for an audience that is not familiar with the

HIDDEN SLIDE Summary These slides are meant to be used as is to give an upper level view of perfsonar for an audience that is not familiar with the HIDDEN SLIDE Summary These slides are meant to be used as is to give an upper level view of perfsonar for an audience that is not familiar with the concept. You *ARE* allowed to delete things you don t

More information

SLIDE 1 - COPYRIGHT 2015 ELEPHANT FLOWS IN THE ROOM: SCIENCEDMZ NATIONALLY DISTRIBUTED

SLIDE 1 - COPYRIGHT 2015 ELEPHANT FLOWS IN THE ROOM: SCIENCEDMZ NATIONALLY DISTRIBUTED SLIDE 1 - COPYRIGHT 2015 ELEPHANT FLOWS IN THE ROOM: SCIENCEDMZ NATIONALLY DISTRIBUTED SLIDE 2 - COPYRIGHT 2015 Do you know what your campus network is actually capable of? (i.e. have you addressed your

More information

The Best Defense is a Good Offense Creating Networks That Work (the first time)

The Best Defense is a Good Offense Creating Networks That Work (the first time) The Best Defense is a Good Offense Creating Networks That Work (the first time) Lauren Rotman, ESnet Jennifer Schopf, Indiana University April 24, 2017 Internet2 Global Summit 2017 Presentation Overview

More information

Climate Data Management using Globus

Climate Data Management using Globus Climate Data Management using Globus Computation Institute Rachana Ananthakrishnan (ranantha@uchicago.edu) Data Management Challenges Transfers often take longer than expected based on available network

More information

Developing Networking and Human Expertise in Support of International Science

Developing Networking and Human Expertise in Support of International Science INTERNATIONAL NETWORKS Developing Networking and Human Expertise in Support of International Science Edward Moynihan, November 3, 2017 Indiana? INTERNATIONAL NETWORKS INTERNATIONAL NETWORKS The NEAAR Collaboration

More information

DICE Diagnostic Service

DICE Diagnostic Service DICE Diagnostic Service Joe Metzger metzger@es.net Joint Techs Measurement Working Group January 27 2011 Background Each of the DICE collaborators are defining and delivering services to their users. A

More information

GÉANT Services Supporting International Networking and Collaboration

GÉANT Services Supporting International Networking and Collaboration GÉANT Services Supporting International Networking and Collaboration Karl Meyer December 2017 GÉANT Who we are and what we do To support collaboration and development amongst researchers, the dissemination

More information

ALICE Grid Activities in US

ALICE Grid Activities in US ALICE Grid Activities in US 1 ALICE-USA Computing Project ALICE-USA Collaboration formed to focus on the ALICE EMCal project Construction, installation, testing and integration participating institutions

More information

The Science DMZ Design Pattern

The Science DMZ Design Pattern The Science DMZ Design Pattern Eli Dart Network Engineer ESnet Science Engagement Lawrence Berkeley National Laboratory NASA Mountain View, CA October 1, 2016 Overview Science DMZ Motivation and Introduction

More information

The new perfsonar: a global tool for global network monitoring

The new perfsonar: a global tool for global network monitoring The new perfsonar: a global tool for global network monitoring Domenico Vicinanza (on behalf of the perfsonar Project) http://www.perfsonar.net GÉANT Product Management Team GÉANT Global Connec/vity -

More information

IS-ENES2 1 st General Assembly th June 2014 UPC Campus, Barcelona, Spain. ESGF Use, CORDEX, ongoing developments

IS-ENES2 1 st General Assembly th June 2014 UPC Campus, Barcelona, Spain. ESGF Use, CORDEX, ongoing developments IS-ENES2 1 st General Assembly 11-13 th June 2014 UPC Campus, Barcelona, Spain ESGF Use, CORDEX, ongoing developments! 1 ESGF: Status IS- ENES ESGF Portals BADC DKRZ IPSL SMHI CMCC DMI IS- ENES coordina4on:

More information

IRNC:RXP SDN / SDX Update

IRNC:RXP SDN / SDX Update 30 September 2016 IRNC:RXP SDN / SDX Update John Hess Darrell Newcomb GLIF16, Miami Pacific Wave: Overview Joint project of CENIC (California regional research and

More information

Zhengyang Liu University of Virginia. Oct 29, 2012

Zhengyang Liu University of Virginia. Oct 29, 2012 SDCI Net: Collaborative Research: An integrated study of datacenter networking and 100 GigE wide-area networking in support of distributed scientific computing Zhengyang Liu University of Virginia Oct

More information

The Science DMZ: Evolution

The Science DMZ: Evolution The Science DMZ: Evolution Eli Dart, ESnet CC-NIE PI Meeting Washington, DC May 1, 2014 Why Are We Doing This? It s good to build high-quality infrastructure As network engineers, we like building networks

More information

Improving Network Infrastructure to Enable Large Scale Scientific Data Flows and Collaboration (Award # ) Klara Jelinkova Joseph Ghobrial

Improving Network Infrastructure to Enable Large Scale Scientific Data Flows and Collaboration (Award # ) Klara Jelinkova Joseph Ghobrial Improving Network Infrastructure to Enable Large Scale Scientific Data Flows and Collaboration (Award # 1659348) Klara Jelinkova Joseph Ghobrial NSF Campus Cyberinfrastructure PI and Cybersecurity Innovation

More information

NERSC Site Update. National Energy Research Scientific Computing Center Lawrence Berkeley National Laboratory. Richard Gerber

NERSC Site Update. National Energy Research Scientific Computing Center Lawrence Berkeley National Laboratory. Richard Gerber NERSC Site Update National Energy Research Scientific Computing Center Lawrence Berkeley National Laboratory Richard Gerber NERSC Senior Science Advisor High Performance Computing Department Head Cori

More information

The Pacific Research Platform (PRP)

The Pacific Research Platform (PRP) The Pacific Research Platform (PRP) John Silvester CENIC International Relations University of Southern California Professor of Electrical Engineering Many slides courtesy of Professor Larry Smarr., CALIT2,

More information

Science DMZ Architecture

Science DMZ Architecture Science DMZ Architecture Jason Zurawski - zurawski@es.net Kate Petersen Mace kate@es.net ESnet Science Engagement engage@es.net http://fasterdata.es.net Science DMZ Overview The Science DMZ in 1 Slide

More information

Data Management Components for a Research Data Archive

Data Management Components for a Research Data Archive Data Management Components for a Research Data Archive Steven Worley and Bob Dattore Scientific Computing Division Computational and Information Systems Laboratory National Center for Atmospheric Research

More information

Introduction to. Network Startup Resource Center. Partially adopted from materials by

Introduction to. Network Startup Resource Center. Partially adopted from materials by Introduction to Network Startup Resource Center Partially adopted from materials by These materials are licensed under the Creative Commons Attribution-NonCommercial 4.0 International license (http://creativecommons.org/licenses/by-nc/4.0/)

More information

Scientific data processing at global scale The LHC Computing Grid. fabio hernandez

Scientific data processing at global scale The LHC Computing Grid. fabio hernandez Scientific data processing at global scale The LHC Computing Grid Chengdu (China), July 5th 2011 Who I am 2 Computing science background Working in the field of computing for high-energy physics since

More information

Virtual Circuits Landscape

Virtual Circuits Landscape Virtual Circuits Landscape Summer 2010 ESCC Meeting Columbus, OH Evangelos Chaniotakis, ESnet Network Engineer Lawrence Berkeley National Lab Context and Goals Guaranteed bandwidth services are maturing.

More information

GÉANT Open Service Description. High Performance Interconnectivity to Support Advanced Research

GÉANT Open Service Description. High Performance Interconnectivity to Support Advanced Research GÉANT Open Service Description High Performance Interconnectivity to Support Advanced Research Issue Date: 20 July 2015 GÉANT Open Exchange Overview Facilitating collaboration has always been the cornerstone

More information

Scaling Across the NRP Ecosystem From Campus to Regional to National - What Support Is There? 2NRP Workshop Bozeman, Montana Tuesday, August 7, 2018

Scaling Across the NRP Ecosystem From Campus to Regional to National - What Support Is There? 2NRP Workshop Bozeman, Montana Tuesday, August 7, 2018 Scaling Across the NRP Ecosystem From Campus to Regional to National - What Support Is There? 2NRP Workshop Bozeman, Montana Tuesday, August 7, 2018 1 Panel Lars Fischer NORDUnet Kate Mace ESnet Marla

More information

Standardization Trend for Super 3G (LTE)

Standardization Trend for Super 3G (LTE) : NGN Mobile Communication Technologies for Standardization Trend for Super (LTE) Sadayuki Abeta and Minami Ishii Abstract Super (also known as Long Term Evolution (LTE)) expands upon the HSDPA/HSUPA (high-speed

More information

Surveying the Industry For a Higher Speed Ethernet

Surveying the Industry For a Higher Speed Ethernet Surveying the Industry For a Higher Speed Ethernet Presented by Mike Bennett, LBNL 802.3 Working Group Interim Knoxville, TN September 20, 2006 High Speed Study Group 1 Background CFI marketing team prepared

More information

Building high-performing infrastructures for research Workshop

Building high-performing infrastructures for research Workshop Building high-performing infrastructures for research Workshop NETWORK INFRASTRUCTURE AND ARCHITECTURES Pieter de Boer SURFnet Network Engineer ASTRON workshop 24 September 2018 Agenda Motivation - Overview

More information

Data Issues for next generation HPC

Data Issues for next generation HPC Data Issues for next generation HPC Bryan Lawrence National Centre for Atmospheric Science National Centre for Earth Observation Rutherford Appleton Laboratory Caveats: Due to time, discussion is limited

More information

Data near processing support for climate data analysis. Stephan Kindermann, Carsten Ehbrecht Deutsches Klimarechenzentrum (DKRZ)

Data near processing support for climate data analysis. Stephan Kindermann, Carsten Ehbrecht Deutsches Klimarechenzentrum (DKRZ) Data near processing support for climate data analysis Stephan Kindermann, Carsten Ehbrecht Deutsches Klimarechenzentrum (DKRZ) Overview Background / Motivation Climate community data infrastructure Data

More information

400G: Deployment at a National Lab

400G: Deployment at a National Lab 400G: Deployment at a National Lab Chris Tracy (Esnet) *Jason R. Lee (NERSC) June 30, 2016-1 - Concept - 2 - Concept: Use case This work originally began as a white paper in December 2013, in which Esnet

More information

Introduction to PRECIS

Introduction to PRECIS Introduction to PRECIS Joseph D. Intsiful CGE Hands-on training Workshop on V & A, Asuncion, Paraguay, 14 th 18 th August 2006 Crown copyright Page 1 Contents What, why, who The components of PRECIS Hardware

More information

An NDN Testbed for Large-scale Scientific Data

An NDN Testbed for Large-scale Scientific Data An NDN Testbed for Large-scale Scientific Data Huhnkuk Lim Korea Institute of Science & Technology Information (KISTI) NDNComm 2015 Sep. 28, 2015 Motivations on NDN for Large-scale Scientific Application

More information

GÉANT: Supporting R&E Collaboration

GÉANT: Supporting R&E Collaboration GÉANT: Supporting R&E Collaboration Thomas Fryer, Senior International Relations Officer, GÉANT Association NKN Annual Workshop Guwahati, Assam, India Monday, 15 th December 2014 TERENA and DANTE have

More information

Globus Research Data Management: Campus Deployment and Configuration. Steve Tuecke Vas Vasiliadis

Globus Research Data Management: Campus Deployment and Configuration. Steve Tuecke Vas Vasiliadis Globus Research Data Management: Campus Deployment and Configuration Steve Tuecke Vas Vasiliadis Presentations and other useful information available at globus.org/events/xsede15/tutorial 2 Agenda Globus

More information

AWS Pilot Report M. O Connor, Y. Hines July 2016 Version 1.3

AWS Pilot Report M. O Connor, Y. Hines July 2016 Version 1.3 AWS Pilot Report M. O Connor, Y. Hines July 2016 Version 1.3 Ernest Orlando Lawrence Berkeley National Laboratory 1 Cyclotron Road, Berkeley, CA 94720 8148 This work was supported by the Director, Office

More information

Pilot Project Outline - Interoperability between Microsoft Lync /Skype for Business and Standards based Videoconferencing Gateway

Pilot Project Outline - Interoperability between Microsoft Lync /Skype for Business and Standards based Videoconferencing Gateway Pilot Project Outline - Interoperability between Microsoft Lync /Skype for Business and Standards based Swansea University, May 2015 Address: Swansea University, Singleton Campus, Swansea SA2 8PP Email:

More information

An Assessment of Data Transfer Performance for Large- Scale Climate Data Analysis and Recommendations for the Data Infrastructure for CMIP6

An Assessment of Data Transfer Performance for Large- Scale Climate Data Analysis and Recommendations for the Data Infrastructure for CMIP6 An Assessment of Data Transfer Performance for Large- Scale Climate Data Analysis and Recommendations for the Data Infrastructure for CMIP6 Eli Dart, Michael F. Wehner, Prabhat Lawrence Berkeley National

More information

GRIDS INTRODUCTION TO GRID INFRASTRUCTURES. Fabrizio Gagliardi

GRIDS INTRODUCTION TO GRID INFRASTRUCTURES. Fabrizio Gagliardi GRIDS INTRODUCTION TO GRID INFRASTRUCTURES Fabrizio Gagliardi Dr. Fabrizio Gagliardi is the leader of the EU DataGrid project and designated director of the proposed EGEE (Enabling Grids for E-science

More information

The Bro Cluster The Bro Cluster

The Bro Cluster The Bro Cluster The Bro Cluster The Bro Cluster Intrusion Detection at 10 Gig and A High-Performance beyond using the NIDS Bro Architecture IDS for the Lawrence Berkeley National Lab Robin International Computer Science

More information

The Abilene Observatory and Measurement Opportunities

The Abilene Observatory and Measurement Opportunities The Abilene Observatory and Measurement Opportunities Rick Summerhill, Director Network Research, Architecture, and Technology, Internet2 CONMI Workshop / PAM 2005 Boston, MA March 30, 05 Outline History

More information

High performance, feature-rich CMS.

High performance, feature-rich CMS. High performance, feature-rich CMS. CONTENTS. Introduction Experience Level Uses Key Features Additional Features How It Works System Requirements Users of Acquire 4 5 5 6 7 8 9 9 INTRODUCTION. Acquire

More information

Experiences with 40G/100G Applications

Experiences with 40G/100G Applications Experiences with 40G/100G Applications Brian L Tierney ESnet, Internet2 Global Summit, April 2014 Outline Review of packet loss Overview SC13 high-bandwidth demos ESnet s 100G testbed Sample of results

More information

GÉANT Open Service Description. High Performance Interconnectivity to Support Advanced Research

GÉANT Open Service Description. High Performance Interconnectivity to Support Advanced Research GÉANT Open Service Description High Performance Interconnectivity to Support Advanced Research Issue Date: 1 November 2017 GÉANT Open Exchange Overview Facilitating collaboration has always been the cornerstone

More information

ACME Exploratory Analysis and Classic Diagnostics Viewer

ACME Exploratory Analysis and Classic Diagnostics Viewer ACME Exploratory Analysis and Classic Diagnostics Viewer Raymond Borges Marcia Branstetter Katherine Evans John Harney Brian Jewell Benjamin Mayer Jeff Painter Galen Shipman Brian Smith Chad Steed Dean

More information

Programmable Information Highway (with no Traffic Jams)

Programmable Information Highway (with no Traffic Jams) Programmable Information Highway (with no Traffic Jams) Inder Monga Energy Sciences Network Scientific Networking Division Lawrence Berkeley National Lab Exponential Growth ESnet Accepted Traffic: Jan

More information

Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory

Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory Title Scaling the Earth System Grid to 100Gbps Networks Permalink https://escholarship.org/uc/item/80n7w3tw Author Balman, Mehmet

More information

Analytics of Wide-Area Lustre Throughput Using LNet Routers

Analytics of Wide-Area Lustre Throughput Using LNet Routers Analytics of Wide-Area Throughput Using LNet Routers Nagi Rao, Neena Imam, Jesse Hanley, Sarp Oral Oak Ridge National Laboratory User Group Conference LUG 2018 April 24-26, 2018 Argonne National Laboratory

More information

The Software Journey: from networks to visualization

The Software Journey: from networks to visualization Discovery, unconstrained by geography. The Software Journey: from networks to visualization Inder Monga Executive Director, ESnet Division Director, Scientific Networking Lawrence Berkeley National Laboratory

More information

THE GLOBUS PROJECT. White Paper. GridFTP. Universal Data Transfer for the Grid

THE GLOBUS PROJECT. White Paper. GridFTP. Universal Data Transfer for the Grid THE GLOBUS PROJECT White Paper GridFTP Universal Data Transfer for the Grid WHITE PAPER GridFTP Universal Data Transfer for the Grid September 5, 2000 Copyright 2000, The University of Chicago and The

More information

Connecting the e-infrastructure chain

Connecting the e-infrastructure chain Connecting the e-infrastructure chain Internet2 Spring Meeting, Arlington, April 23 rd, 2012 Peter Hinrich & Migiel de Vos Topics - About SURFnet - Motivation: Big data & collaboration - Collaboration

More information

Diagnostics and Exploratory Analysis Infrastructure for ACME Workflow

Diagnostics and Exploratory Analysis Infrastructure for ACME Workflow Diagnostics and Exploratory Analysis Infrastructure for ACME Workflow ORNL: Brian Smith, John Harney, Brian Jewell LLNL: Jeffrey Painter, James McEnerney, ORNL is managed by UT-Battelle for the US Department

More information

Implementation of the Pacific Research Platform over Pacific Wave

Implementation of the Pacific Research Platform over Pacific Wave Implementation of the Pacific Research Platform over Pacific Wave 21 September 2015 CANS, Chengdu, China Dave Reese (dave@cenic.org) www.pnw-gigapop.net A Brief History of Pacific Wave n Late 1990 s: Exchange

More information

SLA Module Implementation in AMPS

SLA Module Implementation in AMPS SLA Module Implementation in AMPS GEANT2 Workshop June 2007 Cambridge UK Mary Grammatikou GRNET The establishment of end-to-end SLAs for each PIP service instance from one edge of the extended PIP domain

More information

NSF Campus Cyberinfrastructure and Cybersecurity for Cyberinfrastructure PI Workshop

NSF Campus Cyberinfrastructure and Cybersecurity for Cyberinfrastructure PI Workshop NSF Campus Cyberinfrastructure and Cybersecurity for Cyberinfrastructure PI Workshop Recently the National Science Foundation (NSF) held it s NSF Campus Cyberinfrastructure and Cybersecurity for Cyberinfrastructure

More information

Scheduling Computational and Storage Resources on the NRP

Scheduling Computational and Storage Resources on the NRP Scheduling Computational and Storage Resources on the NRP Rob Gardner Dima Mishin University of Chicago UCSD Second NRP Workshop Montana State University August 6-7, 2018 slides: http://bit.ly/nrp-scheduling

More information

The CISM Education Plan (updated August 2006)

The CISM Education Plan (updated August 2006) The CISM Education Mission The CISM Education Plan (updated August 2006) The CISM Education Mission is to recruit and train the next generation of space physicists and imbue them with an understanding

More information

Challenges of Big Data Movement in support of the ESA Copernicus program and global research collaborations

Challenges of Big Data Movement in support of the ESA Copernicus program and global research collaborations APAN Cloud WG Challenges of Big Data Movement in support of the ESA Copernicus program and global research collaborations Lift off NCI and Copernicus The National Computational Infrastructure (NCI) in

More information

Distributed Cooperative Security Monitoring

Distributed Cooperative Security Monitoring Distributed Cooperative Security Monitoring Robin Sommer Lawrence Berkeley National Laboratory rsommer@lbl.gov http://www.icir.org/robin Cooperative Security Monitoring Internet sites monitor their network

More information

Eastern Regional Network (ERN) Barr von Oehsen Internet2 Tech Exchange 10/16/2018

Eastern Regional Network (ERN) Barr von Oehsen Internet2 Tech Exchange 10/16/2018 Eastern Regional Network (ERN) Barr von Oehsen Internet2 Tech Exchange 10/16/2018 Eastern Regional Network (ERN) Vision: To simplify multi-campus collaborations and partnerships that advance the frontiers

More information

Networking updates: CHECO CIO meet ing

Networking updates: CHECO CIO meet ing Networking updates: CHECO CIO meet ing Jeff Custard Network Engineering Manager UCAR/NCAR 2013-03-05 1 Acronym soup University Corporation for Atmospheric Research (UCAR; http:/ / www.ucar.edu) National

More information

IPv6 Neighbor Discovery (ND) Problems with Layer-2 Multicast State

IPv6 Neighbor Discovery (ND) Problems with Layer-2 Multicast State DRAFT IPv6 Neighbor Discovery (ND) Problems with Layer-2 Multicast State Jeff Wheeler jsw@inconcepts.biz The Problem MLD-snooping is much like IGMP-snooping but for IPv6 It keeps unnecessary multicast

More information

Optimizing NetApp SnapMirror Data Replication with F5 BIG-IP WAN Optimization Manager

Optimizing NetApp SnapMirror Data Replication with F5 BIG-IP WAN Optimization Manager PARTNER USE CASE Optimizing NetApp SnapMirror Data Replication with F5 BIG-IP WAN Optimization Manager F5 BIG-IP WAN Optimization Manager (WOM) helps organizations optimize data replication with NetApp

More information

Science DMZ Security Architecture

Science DMZ Security Architecture Science DMZ Security Architecture Michael Sinatra (presenting) Eli Dart (data portal content) Nick Buraglio (Bro content) Network, Outreach and, Security Engineers Energy Sciences Network Lawrence Berkeley

More information

Deploying Standards-based, Multi-domain, Bandwidth-on-Demand

Deploying Standards-based, Multi-domain, Bandwidth-on-Demand Nordic Infrastructure for Research & Education Deploying Standards-based, Multi-domain, Bandwidth-on-Demand Lars Fischer 28 th NORDUnet Conference Uppsala, 23 September 2014 The State of BoD Hybrid networking

More information

Environmental Sustainability

Environmental Sustainability Environmental Sustainability Smart Applications to support future growth and care for the environment Michalis Grigoratos, EMEA Delivery Lead Energy and Sustainability Management, Hewlett-Packard Company

More information

Data Staging: Moving large amounts of data around, and moving it close to compute resources

Data Staging: Moving large amounts of data around, and moving it close to compute resources Data Staging: Moving large amounts of data around, and moving it close to compute resources Digital Preserva-on Advanced Prac--oner Course Glasgow, July 19 th 2013 c.cacciari@cineca.it Definition Starting

More information

Table 9. ASCI Data Storage Requirements

Table 9. ASCI Data Storage Requirements Table 9. ASCI Data Storage Requirements 1998 1999 2000 2001 2002 2003 2004 ASCI memory (TB) Storage Growth / Year (PB) Total Storage Capacity (PB) Single File Xfr Rate (GB/sec).44 4 1.5 4.5 8.9 15. 8 28

More information

Securing Grid Data Transfer Services with Active Network Portals

Securing Grid Data Transfer Services with Active Network Portals Securing with Active Network Portals Onur Demir 1 2 Kanad Ghose 3 Madhusudhan Govindaraju 4 Department of Computer Science Binghamton University (SUNY) {onur 1, mike 2, ghose 3, mgovinda 4 }@cs.binghamton.edu

More information

UNIVERSITY OF CALIFORNIA

UNIVERSITY OF CALIFORNIA UNIVERSITY OF CALIFORNIA Evaluating switch buffers for high BDP flows (10G x 50ms) Michael Smitasin Network Engineer LBLnet Services Group Lawrence Berkeley National Laboratory Brian Tierney Staff Scientist

More information

perfsonar: A Look Ahead Andrew Lake, ESnet Mark Feit, Internet2 October 16, 2017

perfsonar: A Look Ahead Andrew Lake, ESnet Mark Feit, Internet2   October 16, 2017 perfsonar: A Look Ahead Andrew Lake, ESnet Mark Feit, Internet2 http://www.perfsonar.net October 16, 2017 Overview Introduction perfsonar 4.0 Recap perfsonar 4.0.2 (November 2017) perfsonar 4.1 (Early

More information

Infrastructure Underpinnings of the GFDL Workflow

Infrastructure Underpinnings of the GFDL Workflow Infrastructure Underpinnings of the GFDL Workflow A Trio Of Lightning Talks For ISENES2 Chandin Wilson, Engility Amy Langenhorst, NOAA Karen Paffendorf, Princeton University Erik Mason, Engility Jeffrey

More information

Strategies for Sound Internet Measurement

Strategies for Sound Internet Measurement Strategies for Sound Internet Measurement Vern Paxson Presented by Hossein Falaki Vern Paxson M.S. and Ph.D. degrees Berkeley Staff scientist at the Lawrence Berkeley National Laboratory Founder of the

More information

Kepler and Grid Systems -- Early Efforts --

Kepler and Grid Systems -- Early Efforts -- Distributed Computing in Kepler Lead, Scientific Workflow Automation Technologies Laboratory San Diego Supercomputer Center, (Joint work with Matthew Jones) 6th Biennial Ptolemy Miniconference Berkeley,

More information

ACCELERATING RESEARCH AND EDUCATION NETWORKS WITH INFINERA CLOUD XPRESS

ACCELERATING RESEARCH AND EDUCATION NETWORKS WITH INFINERA CLOUD XPRESS CASE STUDY ACCELERATING RESEARCH AND EDUCATION NETWORKS WITH INFINERA CLOUD XPRESS CUSTOMER Research and education networks connect across nations and around the world to enable collaborative research

More information

BSc (Honours) Computer Science Curriculum Outline

BSc (Honours) Computer Science Curriculum Outline BSc (Honours) Computer Science Curriculum Outline 1. Introduction: The economic and strategic importance provided by Computer Science and Information Technology is increasing daily. This importance is

More information

BUCKNELL S SCIENCE DMZ

BUCKNELL S SCIENCE DMZ BUCKNELL S SCIENCE #Bisonet Param Bedi VP for Library and Information Technology Principal Investigator Initial Science Design Process Involving Bucknell faculty researchers Library and Information Technology

More information

Design patterns for data-driven research acceleration

Design patterns for data-driven research acceleration Design patterns for data-driven research acceleration Rachana Ananthakrishnan, Kyle Chard, and Ian Foster The University of Chicago and Argonne National Laboratory Contact: rachana@globus.org Introduction

More information

Zhengyang Liu! Oct 25, Supported by NSF Grant OCI

Zhengyang Liu! Oct 25, Supported by NSF Grant OCI SDCI Net: Collaborative Research: An integrated study of datacenter networking and 100 GigE wide-area networking in support of distributed scientific computing Zhengyang Liu! Oct 25, 2013 Supported by

More information

Networking updates: Westnet

Networking updates: Westnet Networking updates: Westnet Marla Meehl UCAR/FRGP/UPoP/BiSON Manager UCAR/NCAR 2014-01-08 1 Acronym soup University Corporation for Atmospheric Research (UCAR; http://www.ucar.edu) National Center for

More information

EUMEDCONNECT3 and European R&E Developments

EUMEDCONNECT3 and European R&E Developments EUMEDCONNECT3 and European R&E Developments David West DANTE 17 September 2012 INTERNET2 Middle SIG, Abu Dhabi The Research and Education Network for the Mediterranean Covering GEANT Other regional network

More information

NCP Computing Infrastructure & T2-PK-NCP Site Update. Saqib Haleem National Centre for Physics (NCP), Pakistan

NCP Computing Infrastructure & T2-PK-NCP Site Update. Saqib Haleem National Centre for Physics (NCP), Pakistan NCP Computing Infrastructure & T2-PK-NCP Site Update Saqib Haleem National Centre for Physics (NCP), Pakistan Outline NCP Overview Computing Infrastructure at NCP WLCG T2 Site status Network status and

More information

Building 10-Gbps Networks: A few observations on the national and regional scales in the U.S.

Building 10-Gbps Networks: A few observations on the national and regional scales in the U.S. Building 10-Gbps Networks: A few observations on the national and regional scales in the U.S. Steve Corbató corbato@internet2.edu Director, Network Initiatives, Internet2 & Visiting Fellow, Center for

More information

TransPAC3- Asia US High Performance International Networking (Award # ) Quarterly Report 1-March-2014 through 31-May-2014

TransPAC3- Asia US High Performance International Networking (Award # ) Quarterly Report 1-March-2014 through 31-May-2014 Summary TransPAC3- Asia US High Performance International Networking (Award #0962968) Quarterly Report 1-March-2014 through 31-May-2014 Jennifer Schopf Principal Investigator (Prepared by Alice Jackson,

More information

The Science DMZ as a Security Architecture

The Science DMZ as a Security Architecture The Science DMZ as a Security Architecture Michael Sinatra Network, Systems, Security Engineer Energy Sciences Network Lawrence Berkeley National Laboratory Internet2 Joint Techs 28 September 2016 Firewalls:

More information

File Access Optimization with the Lustre Filesystem at Florida CMS T2

File Access Optimization with the Lustre Filesystem at Florida CMS T2 Journal of Physics: Conference Series PAPER OPEN ACCESS File Access Optimization with the Lustre Filesystem at Florida CMS T2 To cite this article: P. Avery et al 215 J. Phys.: Conf. Ser. 664 4228 View

More information