Pacific Wave: Building an SDN Exchange

Transcription

1 Pacific Wave: Building an SDN Exchange Will Black, CENIC - Pacific Wave Internet2 TechExchange San Francisco, CA

2 Pacific Wave: Overview Joint project between CENIC and PNWGP Open Exchange supporting both commercial and R&E peers NSF partially-supported Serves 29 countries across Pacific First Trans-Pacific 100GE link between Tokyo / Seattle 2

3 Pacific Wave: Overview 3

4

5 Pacific Wave: SDX Control Plane Testbed Resources / Other Uses (DTNs) Science Group Applications / Uses Network Testbeds Circuit Building (NSI/OpenNSA) SDX middleware OpenFlow Controllers (ONOS) OpenFlow Switches On-ramp Locations (Ethernet / virtual circuits) 5

6 Pacific Wave: NSF IRNC:RXP Award Pacific Wave Expansion Supporting SDX & Experimentation (ACI , September 2015) 100GE enhancements Parallel SDN/SDX deployment Improved instrumentation IRNC Collaboration 6

7 Pacific Wave: IRNC Activities Project Year 1 Activities: Traditional Switching from Tokyo through West Coast and east through Starlight SDX nodes in Los Angeles and Seattle 100G connected to common exchange Control nodes in Los Angeles and Seattle AutoGOLE / NSI + MEICAN pilot Project Year 2 Activities: 100G SDX node in Sunnyvale Interdomain collaboration Project Year 3 Activities: Control node in Sunnyvale Expanding depth and range of collaboration efforts Additional DTN deployments, Tstat instrumentation,... 7

8 8

9 Automated GOLE Dynamic network services between GOLEs and networks GOLE - GLIF Open Lightpath Exchange NSI Connection Service v2.0 Open Grid Forum (OGF) Hub and Spoke architecture - 29 Network Service Agents 6 Aggregators 23 leaf upa (ultimate provider agent) Advertising 30 networks Document Distribution Service (DDS) Tools MEICAN, DDS Portal, etc Advanced capabilities Path finding and signaling algorithms Additional Network modeling for optimizations 9

10 Automated GOLE fabric 10

11 Pacific Wave Dynamic Circuit Services: AutoGOLE / NSI Pilot Dynamic circuit services available in Seattle, Sunnyvale, and Los Angeles Initially, each Pacific Wave GOLE will operate its own NSI domain e.g. Los Angeles as lsanca.pacificwave.net:2016 NSA Deployment in Pacific Wave OpenNSA software Developed by NorduNet Separate OpenNSA instances for each GOLE Each instance managing a single device Each instances configured for c-plane & d-plane peering with adjacent Pacific Wave GOLE 11

12 Pacific Wave Dynamic Circuit Services: AutoGOLE / NSI Pilot Control-plane peering (with NSI Aggregators) ESnet NetherLight StarLight Data-plane peering ESnet StarLight SINET (JGN-X, Caltech pending) Provisioning -- RNP s MEICAN webui Contributions 12

13 Pacific Wave Dynamic Circuit Services: Resources 100G-connected (IRNC) DTNs pending in Seattle, Sunnyvale, and Los Angeles Dual-socket (2) E5-2667v4 3.2GHz w/256gb DRAM 6.4TB raw on NVMe -- (2) Kingston (Liqid) 3.2TB NVMe PCIe 3.0 x8 80TB raw on SAS3 (8) 10TB HGST off of an LSI i HBA Mellanox ConnectX-5 interconnect using QSFP28 passive copper DACs in Sunnyvale and Los Angeles, and QSFP28 LR4-lite (2km) optic in Seattle 100G-connected (CC-DNI DIBBs) PRP-contributed 1st-Gen FIONA operating as a DTN in Los Angeles Single-socket (1) E v3 2.40GHz w/32gb DRAM 90TB raw storage on SAS2 QLogic NIC interconnect using LR4 optics CentOS7 with minimal install of perfsonar-tools, for ad hoc tests (~50Gbps single stream) GridFTP disk-to-disk throughput testpoint on PRP MaDDash (~14Gbps multi-stream) 10G-connected ps nodes deployed in Seattle, Sunnyvale, and Los Angeles 100G-connected ps nodes at Seattle and Los Angeles; with Sunnyvale pending 13

14 14

15 Pacific Wave Dynamic Circuit Services: AutoGOLE / NSI Pilot Near-term and ongoing efforts Extend pilot SDN/SDX testbed integration Collaborations with AutoGOLE / GLIF community OpenNSA DevOps contributions Network Resource Manager - Single OpenNSA instance NSI knobs MEICAN advocation Measurement and visualization integration 15

16 Pacific Wave Dynamic Circuit Services: MEICAN // Dashboard 16

17 Pacific Wave Dynamic Circuit Services: MEICAN // Topology 17

18 Pacific Wave Dynamic Circuit Services: MEICAN // Circuit Reservation 18

19 Pacific Wave Dynamic Circuit Services: MEICAN // Circuit Reservation / Detail 19

20 Pacific Wave Dynamic Circuit Services: MEICAN // Circuit Reservation / Path Info 20

21 Pacific Wave / AARNet / Starlight Joint Demo: SDN-controlled interdomain DTN transfers Interdomain interoperability using dynamically controlled transport infrastructure (NSI / AutoGOLE and SDN / Openflow) International collaboration very important Demonstrate real-world usefulness High-speed data transfers using 100GE DTN nodes 21

22 Pacific Wave / AARNet / Starlight Joint Demo: SDN-controlled interdomain DTN transfers 22

23 Pacific Wave / AARNet / Starlight Joint Demo: SDN-controlled interdomain DTN transfers Demo Details Intradomain control-plane: BGP session between DTN and FRRouting (Born from Quagga) SDN-controlled exchange switches using ONOS instance as controller ONOS speaking Openflow 1.3 to SDX switches Interdomain control-plane: BGP session between FRRouting route-servers in different ASNs BGP sessions using shared exchange VLAN / broadcast domain Mixture of manually provisioned and AutoGOLE / NSI-controlled VLAN s Data-plane: Mostly follows same path as control-plane DTN nodes use routes to other DTNs learned from Quagga instance running on same hardware 23

24 Pacific Wave / AARNet / Starlight Joint Demo: SDN-controlled interdomain DTN transfers Demo Details Castor Project born out of University of New South Wales, Australia Provides glue between BGP sessions and SDN/SDX switches Using BGP peering details, provisions ONOS Openflow intents / flows onto Openflow switches that provides both control-plane and data-plane connectivity 24

25 Pacific Wave / AARNet / Starlight Joint Demo: SDN-controlled interdomain DTN transfers 25

26 Pacific Wave / AARNet / Starlight Joint Demo: SDN-controlled interdomain DTN transfers 26

27 Pacific Wave: SDX in the future Ongoing Efforts Remove need for FRRouting / Quagga on DTN nodes Add redundancy Investigate other interdomain options SDN-IP Faucet Custom / in-house development Further collaboration with other research entities 27

28 Questions? 28

29 Contact Information Will Black - wblack@cenic.org 29

30 Thank You! 30