SubOptic 2007 May 15, 2007 Baltimore, MD

Transcription

1 High Performance Hybrid Optical-Packet Networks: Developments and Potential Impacts SubOptic 2007 May 15, 2007 Baltimore, MD Dr. Don Riley, Professor, University of Maryland SURA IT Fellow; Chair, IEEAF Jerry Sobieski, Director of Network Research Mid-Atlantic Crossroads (MAX)

2 Overview of Global R&E Networking Direction The international research and education community has mounted significant efforts to develop a new generation of networking capabilities that have at the core infrastructure owned/controlled, provisioned and managed by the R&E community: all-optical with multiple point-to-point wavelengths, currently at the 10Ge level. Services provisioned across these backbones are multi-layer, multi-service in nature, including Layer 1, 2 and 3 services. Efforts include control plane issues of how you manage and monitor provision of hybrid services across multiple service layers, across multiple network domains, often on an international basis. 2

3 Needs of Global R&E Collaborations are Driving the Networking Development The need for such new services is driven by the applications community - the research community that is typically a globally-distributed collaboration. U.S. CyberInfrastructure one such effort focused on the infrastructural needs, and is now a new program office of the National Science Foundation. New research collaborations include the need to move massive amounts of data in real time, control expensive and unique equipment, etc. Example projects include: the high energy physics community s Large Halon Collider (LHC) project coming on line next year at CERN in Geneva, the extended very long baseline interferometry (evlbi) radio astronomy project with antenna arrays located around the world. The evlbi (very long base-line interferrometry) international collaboration in radio astronomony 3

4 Overview of Global R&E Networking Direction This tutorial will provide some insight into these developments and the driving motivations and potential future developments and possible implications for the submarine cable industry. The presentation will include overviews of GLIF and DRAGON objectives and technology developments, and other similar, related projects and initiatives. One goal of this tutorial is to stimulate discussion of areas of needed development/collaboration regarding submarine systems technology - so that these important links between global R&E communities do not become the disconnect. 4

5 Internet2 Today Current Abilene Backbone Topology Abilene Weather Map Jan 23, 2007 Abilene Logical Map January 2007 Internet2 HOPI Testbed Topology using DRAGON Technology ~ 2006, showing overlay with NLR Backbone

6 Internet2 Tomorrow - NewNet to replace Abilene summer 2007

7 Internet2 Tomorrow - NewNet Internet2 DWDM Layer1 - Optical Circuit Services Internet2 Optical Circuit Services Internet2 IP Services Internet2 HOPI Testbed Topology using DRAGON Technology

8 NLR Today NLR Topology, showing also POP-territories (gray areas unserved) & key Federal lab sites

9 NLR Today NLR Layer-3 Network Status Jan 23, 2007 NLR Layer-2 Network Status Monday, Jan 23, 2007 NLR Layer-1 Wave Availability Jan 23,

10 Connecting DOE Labs to the World s R&E and Commercial Nets: ESnet s Domestic, Commercial, and International Connectivity (Spring 2006) Japan (SINet) Australia (AARNet) Canada (CA*net4 Taiwan (TANet2) Singaren SEA Australia PNWGPoP/ PacificWave CA*net4 France GLORIAD (Russia, China) Korea (Kreonet2) MREN Netherlands StarTap Taiwan (TANet2) UltraLight Starlight CHI-SL SINet (Japan) Russia (BINP) CERN (USLHCnet CERN+DOE funded) GÉANT - France, Germany, Italy, UK, etc NYC MAN LAN Abilene USN Equinix SNV SNV Abilene NGIX-W PAIX-PA Equinix MAE-West PacificWave USN CHI Abilene NGIX-E DC MAE-E Equinix MAXGPoP Australia SDSC AMPATH S. America ALB UNM ESnet provides: High-speed peerings with Abilene, CERN, and US and international R&E networks Management of the full complement of global Internet routes (about 180,000 unique IPv4 routes) in order to provide DOE scientists rich connectivity to all Internet sites Abilene Abilene ATL IP SDN SoXGPoP High Speed International Connection Commercial and R&E peering points ESnet core hubs AMPATH (S. America) High-speed peering points with Abilene

11 ESnet Target Architecture: IP Core+Science Data Network Core+Metro Area Rings Asia-Pacific Aus. Australia Seattle Sunnyvale LA San Diego Canada (CANARIE) Metropolitan Area Rings Denver Albuquerque Canada (CANARIE) SDN Core IP Core Loop off Backbone Europe (GEANT) Chicago Atlanta CERN CERN Europe (GEANT) New York Washington, DC South America (AMPATH) IP core hubs SDN hubs South America (AMPATH) Primary DOE Labs possible hubs Gb/s circuits Production IP core Science Data Network core Metropolitan Area Networks International connections

12 Asia-Pacific ESnet3: A National IP Network Built on Various Circuit Infrastructure Canada 2700 miles / 4300 km Russia and China Canada CERN CERN Europe 1200 miles / 1900 km Aus. Australia Seattle Sunnyvale R&E NLR supplied 10Gbps circuits R&E San Diego Qwest supplied 10Gbps backbone Albuquerque R&E Chicago Atlanta R&E R&E R&E New York Washington, DC AMPATH (S. America) R&E AMPATH Backbone hubs Primary DOE Labs Major research and education (R&E) network peering points 10 Gbps circuits Production IP core NLR core Metro Area Networks Lab supplied International connections ESnet network architecture consists of 1) Circuits 2) Circuits interconnects hubs with routers and switches 3) Connected sites 4) Connections to other networks US R&E, international, and commercial

13 ESnet3 Layer 2 Architecture Provides Global High-Speed Internet Connectivity for DOE Facilities and Collaborators (spring, 2006) ESnet Science Data Network (SDN) core Japan (SINet) Australia (AARNet) Canada (CA*net4 Taiwan (TANet2) Singaren SNV SDN AU 42 end user sites LIGO PNNL TWC LLNL SNLL YUCCA MT GA INEEL BECHTEL-NV Office Of Science Sponsored (22) NNSA Sponsored (12) Joint Sponsored (3) LANL Other Sponsored (NSF LIGO, NOAA) Laboratory Sponsored (6) commercial and R&E peering points ESnet core hubs IP AU JGI LBNL NERSC SLAC Abilene SEA SDSC Abilene NASA Ames SNV PNWGPoP/ PAcificWave SNV PAIX-PA Equinix, etc. ALB CA*net4 MREN France Netherlands GLORIAD StarTap (Russia, China) Taiwan (TANet2, Korea (Kreonet2 ASCC) ESnet IP core NREL SNLA Allied Signal DOE-ALB ELP PANTEX high-speed peering points with Internet2/Abilene AMES ARM Starlight Chi NAP KCP SINet (Japan) Russia (BINP) FNAL ANL OSTI NOAA Abilene ESnet IP core: Packet over SONET Optical Ring and Hubs CHI-SL CHI CERN (USLHCnet CERN+DOE funded) ORNL Lab DC Offices OSC GTN NNSA ORAU ATL DC SRS NYC MAE-E JLAB PPPL International (high speed) 10 Gb/s SDN core 10G/s IP core 2.5 Gb/s IP core MAN rings ( 10 G/s) Lab supplied links OC12 ATM (622 Mb/s) OC12 / GigEthernet OC3 (155 Mb/s) 45 Mb/s and less GÉANT - France, Germany, Italy, UK, etc MAN LAN Abilene MAXGPoP Equinix MIT BNL

14 LHC Tier 0, 1, and 2 Connectivity Requirements Summary TRIUMF (Atlas T1, Canada) ESnet SDN Sunnyvale LA San Diego Seattle Vancouver Boise ESnet IP Core Abilene / Gigapop Footprint Denver Albuq. Dallas CANARIE Virtual Circuits KC Chicago FNAL (CMS T1) Toronto Atlanta USLHCNet BNL (Atlas T1) Wash DC GÉANT CERN-3 New York CERN-1 CERN-2 GÉANT-1 GÉANT-2 Jacksonville USLHC nodes Abilene/GigaPoP nodes ESnet IP core hubs ESnet SDN/NLR hubs Cross connects with Internet2/Abilene Tier 1 Centers Tier 2 Sites Direct connectivity T0-T1-T2 USLHCNet to ESnet to Abilene Backup connectivity SDN, GLIF, VCs

15 Esnet4 Plan for 2012 Build-out 15

16 Quilt Fiber-based RON Map 16

17 NSF Funding for International Research Network Connections (IRNC) NSF funding new links from U.S. to International R&E Networks (2.5 to 10 Gbps lambdas ) To Europe To Asia-Pacific To South America To China and Russia Nothing to African yet Purpose is to support US researchers - in their research and their international collaborations

18 One view of NSF IRNC GLORIAD: Global Ring to China, Korea and Russia To Japan, HongKong, Singapore To Hawaii, Australia To Australia P-Wave To Europe To Latin America

19 GEANT2 & dark fiber 19

20 European Dark Fiber Efforts 20

21 CESNET (CZ) Dark Fiber Efforts 21

22 Dark Fiber in European NRENs 22

23 GEANT2 & Global Research Networking 23

24 International GLIF Initiative: Global Lambda Integrated Facility A globally integrated set of light path facilities: optical waves (lambdas - typically 10G), open exchange points, international peerings Visualization courtesy of Bob Patterson, NCSA.

25 GLIF Lightpaths and GOLEs

26 International: Atlantic Wave

27 The DRAGON Testbed

28 DRAGON/HOPI Control Plane Provisioning Environment GMPLS Multi-layer, Multi-Domain Ethernet Service Provisioning Dynamic dedicated VLAN based connections IGP-TE UNI SEA CHI LA Ethernet Layer HOU NY GMPLS Provisioned LSP Dedicated Ethernet VLAN Circuit DC MCLN GWU IGP-TE ARLG CLPK DCNE UNI Ethernet Layer Static Optical Layer Switched WDM Optical Layer HOPI Dynamic Ethernet Network ENNI DRAGON Multi-Layer GMPLS Network Domain Boundary 28

29 Heterogeneous Network Technologies Complex End to End Paths horizontal multi-layer adaptations for multi-domain AS 1 IP Control Plane AS 2 IP Control Plane AS 3 IP Control Plane VLSR VLSR End System Ethernet Segment VLSR Established VLAN Ethernet over WDM Ethernet over SONET Ethernet Lambda Switch SONET Switch Router Router MPLS LSP End System Ethernet Segment VLSR Established VLAN 29

30 DRAGON-HOPI SC05 Demo: Intercontinental evlbi Collaboration 30

31 DRAGON Application Specific Topologies Identify endpoints, control plane sets up topologies Set up global multi-link topologies ~30 seconds 31

32 Grids as the escience Enabler Standards & Specifications High Performance Computing Connectivity Last Mile Regional Grid Infrastructure Program Network Research SCOOP Tele-Medicine Bio-Informatics New Simulation And Modeling Applications (energy,weather Population,etc)

33 What s next? What can we do together? How can we help? Followup Contact or Questions: Don Riley <drriley@umd.edu> Jerry Sobieski <jerrys@maxgigapop.net> 33