ESnet s (100G) SDN Testbed

Transcription

1 ESnet s (100G) SDN Testbed Inder Monga and ESnet SDN team Interna:onal SDN Testbed, March 2015

2 Outline Testbeds in ESnet Mo:va:on: Building a Scalable SDN WAN testbed Hardware and Deployment Status First Experiments 2 02/04/15

3 Testbeds in ESnet Opera:ng 100G Testbed and mul:- layer testbed since 2011 Testbed Model = 2-3 page applica:on to use, calendar based access, yearly renewal Lots of published research, work on TCP, flow classifica:on, 100G IDS etc. 100G now common service to many campuses, and in many networks Migra:on to 100G SDN Testbed! 3 02/04/15

4 Building a Scalable SDN WAN Testbed 1. Prototype for a poten:al ESnet6 design 2. Mul:- domain federa:on for the science complex 3. Interna;onal SDN collabora;on Many concepts work well in lab, but require significant modifica;on to scale 4 02/04/15

5 Building a Scalable SDN WAN Testbed Assump:on: Greenfield SDN testbeds need to interoperate with other non- SDN networks or may need to federate over exis:ng non- SDN networks Isola:on is NOT a feature we want on this testbed Requirements L2 / L3 transport with QoS, MPLS Support for federa:on Internet- scale rou:ng and forwarding tables OpenFlow 1.3 support Diagnos:c and troubleshoo:ng capabili:es 5 02/04/15

6 Testbed Hardware: Corsa Technology DP6440" 4 x 100G CFP2 Ports" 24x 10G SFP+ Ports " DP6430" 2 x 100G CFP2 Ports" 24x 10G SFP+ Ports " 100G 10G DP6420" 48 x 10G SFP+ Ports" 4 x 40G QSFP+ Ports " Open vswitch + " DP6410" 24 x 10G SFP+ Ports" OpenFlow 1.3 / 1.4 / 1.5+" Fully programmable OpenFlow data plane with mul:ple pipelines Embedded OVS based OpenFlow 1.3+ / ovsdb SDN controller interface Ultra fast flow setup and control plane interfaces Full line rate, OpenFlow ports with mul:ple flow tables on all ports..

7 Notable Features of Corsa Switches 1. Mul:ple flow tables 2. Millions of flow entries 3. Large scale packet buffers (20GB) and 100- Gbps ports at line rate 5. Extremely fast flow modifica:ons: 10K 1M entries per second ( as opposed to 100 flow mods / sec ) 6. OpenFlow 1.3+ protocol support.

8 ESnet PE Router (2+)x10GE ESnet SDN Testbed (n)x10ge Testbed Host Planned SDN Testbed node locations Planned SDN Testbed connectivity overlay (using OSCARS circuits) PNWG PNNL BOIS ANL FNAL STAR BOST AMST SACR DENV DENV KANS STAR CHIC AOFA BNL AMST LBL AOFA NEWY LOND LBL LLNL WASH CERN NERSC SUNN ALBQ NASH ORNL WASH CERN LANL SLAC ATLA SAND ELPA HOUS ATLA

9 ESnet SDN Testbed Node Physical View ESnet SDN Testbed Node Logical View ESnet PE Router ESnet PE Router (2+)x10GE (2+)x10GE (n)x10ge (n)x10ge Testbed Host Services VM

10 Sogware switch and Services VM paired with every hardware switch. Most flows only pass through hardware switch Flows requiring special handling go through sogware switch, possibly to Services VM. Hardware switch provides performance, stability Sogware switch provides flexibility, without compromising stability of network

11 ESnet SDX: Mul;- con;nent SDN BGP peering VANDERVECKEN (VM): SDN Router BGP peering BGP peering Pica8, NoviFlow Corsa Pica8 Data Plane With help from /04/15 NORDUnet Conf. 2014

12 AARNet/ESnet TreeHouse Setup [Jan, 2015] AARNet (AS 7575) PacWave ESnet (AS 293) AARNetFLA (AS 65001) UTS/AARNet Sydney VL GE 9/1/4:1066 (VL 1066) sunn- cr5.es.net VANDERVECKEN ONOS xge-2 (VL 462) [ /30] (Peers w/ AARnet) 10GE xge-3 (VL 463) corsa-1 (Corsa) xge-1 (VL 461) [ /30] (Peers w/ ESnet FLA) TOR switch VL 461 2x 10GE (Data-plane) cardigan-vvk.es.net VANDERVECKEN (VM) cardigan-onos.es.net ONOS (VM) CARDIGAN (Corsa?) xe-8/2/ (VL 1069) (To AARnet) xe-8/1/0.0 (VLAN 1023) [ /30] (Peers w/ ESnet FLA) eth /24 eth /24 lbl-mr2.es.net ge- 9/0/0.959 (VLAN 959) (Mgmt- plane) 1Gbps OSCARS circuit (es.net-5464) for connection to AARNet ESnet FLA (AS 3434) eth /24 eth /24 fla-otb-rt1 (Corsa) fla-vvk.es.net VANDERVECKEN (VM) 2275lan- sts1:39 fla-onos.es.net ONOS (VM) Port? eth /24 eth /24 (VL 462) [ /30] (Peers w/ AARnet FLA) 10GE Port? Port? Port? 2x 10GE (Data-plane) Port 1 (VL 1023) [ /30] (Peers w/ ESnet) Port 2 (VL 1069) [ /30] (Peers w/ AARnet FLA) AARNet (AS 64684)

13 Network Policies and Framework to support mul;- tenant science applica;ons Distributed Applica:ons / Intents Rendering / Network Policies Northbound API Monitoring SDN Controller Provisioning State DB Southbound API Network

14 ENOS: ESnet Network Opera;ng System Goal: Provide an environment for network policies to run Allows applica:ons / users to: Provision endpoints Specify dynamic QoS Allows ESnet to easily do: Automa:on Analysis / verifica:on Provides a "network shell" interface to advanced network services such as: Show the path op:ons between two sites and their performance characteris:cs Send traffic to or from some subnet to a IDS for analysis Crea:ng a mul:- point VPN between sites 14 02/04/15

15 ESnet SDN Testbed: Current Status SDN Testbed Testbed hardware deployment recently started Plan for everything to be deployed by the end of May SDX Ini:al demonstra:on in ONS 2013 Latest topology demonstrated and announced in November 2014 Currently peering with AARnet ENOS Code being developed Mul:point VPN being tested on Mininet 15 02/04/15

16 Ques:ons? imonga, chin, lomax, bmah, bl:erney at es dot net Thank you! 16 02/04/15