Network Experimentation with GpENI Outline

Transcription

1 KU EECS 780 Communication Networks Laboratory Programmable Networking with Communication Networks Laboratory The University of Kansas EECS 780 Programmable Networking with Egemen K. Çetinkaya and James P.G. Sterbenz Department of Electrical Engineering & Computer Science Information Technology & Telecommunications Research Center The University of Kansas May 2011 rev James P.G. Sterbenz Network Experimentation with Outline L5.1 Motivation and overview L5.2 Participants and infrastructure L5.3 Node cluster and programmability L5.4 Network monitoring 04 May 2011 KU EECS 780 Comm Nets NET-L4-2 1

2 KU EECS 780 Communication Networks Laboratory Programmable Networking with Network Experimentation with Motivation and Overview L5.1 Motivation and overview L5.2 Participants and infrastructure L5.3 Node cluster and programmability L5.4 Network monitoring 04 May 2011 KU EECS 780 Comm Nets NET-L4-3 Large-Scale Testbeds Motivation Progression of research deployment analysis simulation emulation lab prototyping large-scale field prototyping field deployment Testbeds needed to understand realistic behaviour but realistic scale needed essential for experiments in Future Internet architecture 04 May 2011 KU EECS 780 Comm Nets NET-L4-4 2

3 KU EECS 780 Communication Networks Laboratory Programmable Networking with Large-Scale Testbeds History CNRI Gigabit testbeds Aurora, Blanca, Casa, Nectar, Vistanet, MAGIC supported high-speed networking research technology specific; not programmable e.g. ATM, HIPPI Active network testbeds DARPA ABone, EU FP5 FAIN, EPSRC LARA++ dynamically programmable networks (signalling or capsules) supported research in service and protocol deployment logical predecessor to GENI 04 May 2011 KU EECS 780 Comm Nets NET-L4-5 Large-Scale Testbeds Current Testbeds PlanetLab international testbed to conduct Internet research L4 7 programmable: applications and transport VINI extends to control Internet topology experiments use a slice of PlanetLab basis for GENI cluster B Emulab: clusters of computing nodes arbitrary system software programmable interconnection basis for GENI cluster C (ProtoGENI) 04 May 2011 KU EECS 780 Comm Nets NET-L4-6 3

4 KU EECS 780 Communication Networks Laboratory Programmable Networking with GENI and FIRE Overview GENI: Global Environments for Network Innovation funded by the US NSF and participant institutions managed by the GPO (GENI Project Office BBN) goal: new experimental network infrastructure FIRE: Future Internet Research and Experimentation funded by the EU under FP7 research component (similar to FIND) experimental component (similar to GENI) 04 May 2011 KU EECS 780 Comm Nets NET-L4-7 Overview Canada Asia GPN KanREN UNL KSU KU UMKC MOREnet Europe [dʒɛ pi ni] Great Plains Environment for Network Innovation exploiting new fiber infrastructure in KS, MO, and NE significant international footprint under deployment 04 May 2011 KU EECS 780 Comm Nets NET-L4-8 4

5 KU EECS 780 Communication Networks Laboratory Programmable Networking with Project Goals Programmable research infrastructure centered on optical infrastructure in Great Plains undergoing international expansion Infrastructure to support future Internet research NSF FIND PoMo EU FIRE ResumeNet is part of GENI and affiliated with FIRE GENI cluster B: PlanetLab control framework testbed for EU FP7 FIRE ResumeNet project Open environment for network research community clearinghouse for sharing experiments 04 May 2011 KU EECS 780 Comm Nets NET-L4-9 Network Experimentation with Participants and Infrastructure L5.1 Motivation and overview L5.2 Participants and infrastructure L5.3 Node cluster and programmability L5.4 Network monitoring 04 May 2011 KU EECS 780 Comm Nets NET-L4-10 5

6 KU EECS 780 Communication Networks Laboratory Programmable Networking with Principal Participants: Universities 1 KU: The University of Kansas James P.G. Sterbenz (lead PI), Joseph B Evans (co-i), Rick McMullen (co-i), Ronqing Hui, Gary Minden KSU: Kansas State University Caterina Scoglio (PI), Don Gruenbacher (co-pi), Tricha Anjali UMKC: University of Missouri Kansas City Deep Medhi (PI), Baek-Young Choi (co-i) Cory Beard, Khosrow Sohraby, Jim Schonemann UNL: University of Nebraska Lincoln Byrav Ramamurthy (PI) 04 May 2011 KU EECS 780 Comm Nets NET-L4-11 Principal Participants: Universities 2 IIT: Illinois Institute of Technology Tricha Anjali Lancaster University (UK) David Hutchison, Andrew Scott (co-is), ETH Zürich (Switzerland) Bernhard Plattner (co-i) 04 May 2011 KU EECS 780 Comm Nets NET-L4-12 6

7 KU EECS 780 Communication Networks Laboratory Programmable Networking with Participants: Research Networks GPN: Great Plains Network (consortium) Greg Monaco (PI) KanREN: Kansas Research and Education Network Cort Buffington (PI) MOREnet: Missouri Research and Education Network Hank Niederhelm JANET SWITCH GÉANT2 / DANTE NORDUnet 04 May 2011 KU EECS 780 Comm Nets NET-L4-13 Participants: Industry Ciena Jeff Verrant (PI), Jim Archuleta (co-i) Qwest 04 May 2011 KU EECS 780 Comm Nets NET-L4-14 7

8 KU EECS 780 Communication Networks Laboratory Programmable Networking with Participants: L2 Tunnel Fanout UK, Ireland, and Iberia Lancaster Switzerland, Germany, Austria, Poland, Turkey ETH Zürich Bern (Torsten Braun) Kaiserslautern / G-Lab (Paul Müller) Scandinavia and Russia Simula Labs Oslo Asia? 04 May 2011 KU EECS 780 Comm Nets NET-L4-15 Network Experimentation with Node Cluster and Programmability L5.1 Motivation and overview L5.2 Participants and infrastructure L5.3 Node cluster and programmability L5.4 Network monitoring 04 May 2011 KU EECS 780 Comm Nets NET-L4-16 8

9 KU EECS 780 Communication Networks Laboratory Programmable Networking with Node Cluster Types Midwest optical backbone KU, KSU, UNL, UMKC Optically connected islands Lancaster, Cambridge ETH Zürich, Bern, Uni Zürich L2TPv3 concentration/fanout nodes Lancaster, Zürich, Bern, Kaiserslautern L2TPv3 terminal nodes IU GMOC, ETH Zürich, Tampere, Simula, KIT, Passau, IP tunneled nodes Public Internet connected nodes? 04 May 2011 KU EECS 780 Comm Nets NET-L4-17 Node Cluster Architecture: Midwest Optical Node cluster 5 10 PCs mgt. L4: PlanetLab L3: prog. routers GbE switch prog. routers VINI, Quagga, XORP, click, arbitrary site interconnection L2: /GENI VLAN SNMP cluster monitoring Ciena optical switch PlanetLab GENIwrap prog. nodes GbEnet Ciena optical ctl. frwk. aggr. mgr. PLC VINI DCN GENI VLANs management & control site specific KUAR, sensor, optical backbone to Internet2 and KC SPP L1 interconnection ProtoGENI to MAX 04 May 2011 KU EECS 780 Comm Nets NET-L4-18 9

10 KU EECS 780 Communication Networks Laboratory Programmable Networking with Node Cluster Architecture: Island Optical Node cluster 5 10 PCs mgt. L4: PlanetLab L3: prog. routers GbE switch prog. routers VINI, Quagga, XORP, click, PlanetLab GENIwrap prog. nodes arbitrary site interconnection L2: /GENI VLAN SNMP cluster monitoring L2 optical interconnection among island tunneled to L2TPv3 GbEnet island specific aggregate manager GENI VLANs management & control site specific KUAR, sensor, 04 May 2011 KU EECS 780 Comm Nets NET-L4-19 Node Cluster Architecture: Tunneled Node Cluster cluster 5 10 PCs mgt. L4: PlanetLab L3: prog. routers GbE switch prog. routers VINI, Quagga, XORP, click, arbitrary site interconnection L2: /GENI VLAN SNMP cluster monitoring Router terminating tunnels L2TPv3 recommended PlanetLab GENIwrap prog. nodes GbEnet L2TPv3 ctl. frwk. aggr. mgr. PLC VINI DCN GENI VLANs management & control site specific KUAR, sensor, L2TPv3 or IP tunnels multiple for fanout nodes 04 May 2011 KU EECS 780 Comm Nets NET-L

11 KU EECS 780 Communication Networks Laboratory Programmable Networking with Node Cluster Management and Control Management and control processor in each cluster control 1. institution.gpeni.net General purpose Linux box runs any software needed by or local sites e.g. PlanetLab control framework demo at KSU Security services firewall and NAT for cluster private subnet Monitoring services Cacti port monitoring of GbE switch Nagios to monitor individual nodes 04 May 2011 KU EECS 780 Comm Nets NET-L4-21 Programmability All Layers Layer experiment application end-to-end router topology VLAN lightpath RF, photonics Programmability Gush, Raven PlanetLab Quagga, XORP, Click, site VINI DCN site-specific 04 May 2011 KU EECS 780 Comm Nets NET-L

12 KU EECS 780 Communication Networks Laboratory Programmable Networking with Programmability Experiment Software to assist researcher run experiments Gush: GENI user shell [Albrecht] helps reserve resources using GENI clearinghouse Raven provisioning service [Hartman] code and configuration deployment clearinghouse experiment application end-to-end router topology VLAN lightpath RF,photonics Programmability Gush, Raven PlanetLab Quagga, XORP, Click VINI 04 May 2011 KU EECS 780 Comm Nets NET-L Layer DCN site-specific Programmability Application and End-to-End Transport PlanetLab sub-aggregate: upper layer programmability application and E2E transport Shares resources using slice paradigm experiment application end-to-end router topology VLAN lightpath photonics GENIwrapper version of PlanetLab SFA (slice facility architecture) exports GENI interfaces PLC located at KSU: geni myplc.ksu.gpeni.net Programmable nodes at each institution geni planetlab n. institution.gpeni.net Layer Programmability Gush, Raven PlanetLab Quagga, XORP, Click VINI DCN site-specific 04 May 2011 KU EECS 780 Comm Nets NET-L

13 KU EECS 780 Communication Networks Laboratory Programmable Networking with Programmability Network Routers and Switches Programmable routers under control of VINI sub-aggregate standard software Quagga XORP currently being integrated OpenFlow under investigation Click possible Site-specific routers experiment application end-to-end router topology VLAN lightpath photonics Programmability Gush, Raven PlanetLab Quagga, XORP, Click VINI Each cluster has at least 2 programmable routers geni router n. institution.gpeni.net 04 May 2011 KU EECS 780 Comm Nets NET-L Layer DCN site-specific Programmability Network Topology VINI sub-aggregate: middle layer programmability topology and router control PlanetLab with Trellis extensions control of topology slices eventual merge with PL experiment application end-to-end router topology VLAN lightpath photonics Control located at UMKC: geni myvini.umkc.gpeni.net Unification of PlanetLab and VINI underway by Princeton PlanetLab group now has integrated portal Layer Programmability Gush, Raven PlanetLab Quagga, XORP, Click VINI DCN site-specific 04 May 2011 KU EECS 780 Comm Nets NET-L

14 KU EECS 780 Communication Networks Laboratory Programmable Networking with Programmability VLAN and Lightpath Connectivity DCN sub-aggregate: lower layer programmability DCN: dynamic circuit network developed by DRAGON dynamic creation of VLANs and lightpaths port to Netgear GbE switch experiment application end-to-end router topology VLAN lightpath photonics Programmability Gush, Raven PlanetLab Quagga, XORP, Click VINI DCN site-specific MAX port to Ciena CoreDirector optical switch MAX + ISI working on DCN GENIwrapper will enable unification of PlanetLab and DCN sub-aggregates Layer 04 May 2011 KU EECS 780 Comm Nets NET-L4-27 Programmability Photonic and RF Site-specific layer-1 programmability Edge testbed attached to GbE switch Core requires optical interconnection virtual connectivity hoped in future Layer experiment application end-to-end router topology VLAN lightpath photonics Programmability Gush, Raven PlanetLab Quagga, XORP, Click VINI DCN site-specific 04 May 2011 KU EECS 780 Comm Nets NET-L

15 KU EECS 780 Communication Networks Laboratory Programmable Networking with Physical Topology and Network Infrastructure Midwest backbone (phase 3) multiwavelength optical backbone current or imminent deployment 4 universities in 3 states 1 switch/year with current funding to Smith Ctr. KS (eventual link to CO) new nodes CCD Ciena CoreDirector C42 Ciena CN4200 Gp ENI node cluster WTC patch fiber C Power Plant C-band n λs CCD Gp ENI Rathbone Hall KSU KS KU/Qwest fiber SFBB fiber Ellsworth C Hall C-band n λs CCD Nichols Hall splice Gp ENI KU KS KU/Qwest fiber Qwest POP KC MO UNL NE Gp ENI Avery Hall Scott Center KU/Qwest fiber dark fiber CCD Internet2 POP KC MO 2 λs UNL (L3) fiber MOREnet fiber 4 λs CCD Gp ENI Newcomb Hall Ethernet Flarsheim Hall UMKC MO 04 May 2011 KU EECS 780 Comm Nets NET-L4-29 Layer 2 Connectivity (mid phase 1) rapidly evolving 04 May 2011 KU EECS 780 Comm Nets NET-L

16 KU EECS 780 Communication Networks Laboratory Programmable Networking with Midwest Expansion Regional partners: 11 Principal partners KU, KSU, UMKC, UNL, IIT South Dakota: 3 universities DSU, SDSMT, USD Missouri: UMC Asia GMOC at Indiana University Canada Waterloo SDSMT DSU USD UNL KSU UMC KU UMKC IIT Waterloo Europe IU IU GMOC 04 May 2011 KU EECS 780 Comm Nets NET-L4-31 European Expansion European partners 13 nations 24 research institutions Asia SDSMT ~120 nodes more under discussion DSU USD UNL UMC KSU KU UMKC IIT Internet2 IU GMOC ISCTE Lisboa HEAnet UC Dublin JANET Lancaster Warszawa Cambridge GÉANT2 G-Lab Kaiserslautern Karlsruhe Passau Konstanz U-Zürich Wien Bern München DANTE ETH SWITCH UPC Barcelona Tampere UT Simula Uppsala SICS Skt. Peterburg IIRAS TKK Helsinki KTH Stockholm Moscow Karlstads to NORDUnet Beijing Bucharest Bilkent 04 May 2011 KU EECS 780 Comm Nets NET-L

17 KU EECS 780 Communication Networks Laboratory Programmable Networking with Asian Expansion IIT Guwahati Europe CUC Beijing POSTECH Asian partners 3 nations 5 research institutions 25 nodes more under discussion ERNET IIT Mumbai IISc Bangalore APAN Internet2 Asia SDSMT DSU USD UNL UMC KSU KU UMKC IIT IU GMOC 04 May 2011 KU EECS 780 Comm Nets NET-L4-33 Node Cluster Status 1 Midwest backbone nodes PlanetLab and VINI operational UNL switch installed; KU switch this year GENI interconnection physical connection to ProtoGENI in KC I2 POP connection to MAX L2TPv3 tunnel to GMOC: gmoc.gpeni.net 04 May 2011 KU EECS 780 Comm Nets NET-L

18 KU EECS 780 Communication Networks Laboratory Programmable Networking with Node Cluster Status 2 British Iles and Iberia L2TPv3 tunnel to Lancaster to JANET wavelength to Cambridge (first European node up) L2TPv3 tunnel to UPC Barcelona (up); ISCTE Lisboa (soon) Switzerland, Germany, and Austria L2TPv3 tunnel to Bern to ETH Zürich (may provide additional fan-out) L2TPv3 tunnel to Kaiserslautern / GLab to OpenVPN (experimental) to TUMünchen L2TPv3 tunnel to Karlsruhe (temporary) 04 May 2011 KU EECS 780 Comm Nets NET-L4-35 Node Cluster Status 3 Nordic and Russia L2TPv3 tunnel to Simula Norway to Tampere (up) Karlstad (up) European meeting this year need UK Germany/Switzerland/Austria Nordic backbone Asia IIT Guwahati (soon) 04 May 2011 KU EECS 780 Comm Nets NET-L

19 KU EECS 780 Communication Networks Laboratory Programmable Networking with Aggregate Status: PlanetLab PlanetLab sub-aggregate (KSU) MyPLC 4.3 GENIwrapper 8.5 SFA federated with Princeton PLC OpenFlow integration under investigation Loop demo publicly available (but still fragile) PlanetLab / VINI sub-aggregate integration integrated portal available waiting for Princeton PL/VINI integration 04 May 2011 KU EECS 780 Comm Nets NET-L4-37 Aggregate Status: Programmable Router Programmable router sub-aggregate (UMKC) VINI installed UMKC will be beta site for 5.0 to unify with PlanetLab Quagga running, tested with OSPF and Zebra currently working on sliceability XORP integration underway Integrating topology creation in map demo 04 May 2011 KU EECS 780 Comm Nets NET-L

20 KU EECS 780 Communication Networks Laboratory Programmable Networking with Aggregate Status: DCN Optical Control Plane Optical switch sub-aggregate (UNL) UNL switch installed; KU next DCN running on Ciena CoreDirector and Netgear switch Connection established to MAX through ProtoGENI interdomain DCN 04 May 2011 KU EECS 780 Comm Nets NET-L4-39 Status: Overall Management Overall management, monitoring, administration (KU) L2TPv3 tunnels coming up complex planning given meager funding working with European partners to provide fanout UK, Switzerland, Austria/Germany, Nordic/Russia, Asia International optical discussions soon Nagios management interface begin developed GMOC node cluster installed should provide integration with overall GENI monitoring TRIDENTCOM 2010 paper 04 May 2011 KU EECS 780 Comm Nets NET-L

21 KU EECS 780 Communication Networks Laboratory Programmable Networking with Status: Application and User Community Tools experiment control: Gush running now code deployment: Raven running now suggestions for other tools welcome User access Limited access to wider community; Web-based request form Seattle running community will likely be the first real users FIND PoMo, EU FIRE ResumeNet, project clearinghouse soon but others welcome (build it and they will come?) the road to hell is paved with unused testbeds 04 May 2011 KU EECS 780 Comm Nets NET-L4-41 Status: Experiments ResiliNets / ResumeNet experiments planned soon NSF GEW Eager Resilience and survivability at scale WAN + ProtoGENI access networks European experiment planning soon 04 May 2011 KU EECS 780 Comm Nets NET-L

22 KU EECS 780 Communication Networks Laboratory Programmable Networking with Node Cluster Systems Software Status PlanetLab sub-aggregate (KSU) MyPLC 4.3 with GENIwrapper SFA federated with PlanetLab Programmable router sub-aggregate (UMKC) VINI installed; will be beta for 5.0 to unify with PlanetLab Quagga running, XORP integration in progress Optical switch sub-aggregate (UNL) UNL switch installed; KU in summer 2010 DCN running on Ciena CoreDirector and Netgear Enet coördinating with MAX for interdomain DCN Overall management, monitoring, administration (KU) 04 May 2011 KU EECS 780 Comm Nets NET-L4-43 User and Application Status Experiment control: Gush running now Code deployment: Raven running now User access: external access requests considered Demo publicly available: control 1.ksu.gpeni.net/demo 04 May 2011 KU EECS 780 Comm Nets NET-L

23 KU EECS 780 Communication Networks Laboratory Programmable Networking with Experiment Plans PoMo: NSF FIND PostModern Internet Architecture exploring resilient transport over heterogeneous realms ResumeNet: EU FIRE Resilinece and Survivability for Future Networking is one of the testbeds provide ability to experiment with new protocols while investigating topologies and injecting failures Other activities participating in NSF GENI experimenter s workshop clearinghouse for international collaborations 04 May 2011 KU EECS 780 Comm Nets NET-L4-45 Experiment Example Resilience of network when challenged cross-verification with KU-LoCGen/TacGen 04 May 2011 KU EECS 780 Comm Nets NET-L

24 KU EECS 780 Communication Networks Laboratory Programmable Networking with Network Experimentation with Network Monitoring L5.1 Motivation and overview L5.2 Participants and infrastructure L5.3 Node cluster and programmability L5.4 Network monitoring 04 May 2011 KU EECS 780 Comm Nets NET-L4-47 Monitoring via Nagios 1 Nagios provides instantaneous view of the net. 04 May 2011 KU EECS 780 Comm Nets NET-L

25 KU EECS 780 Communication Networks Laboratory Programmable Networking with Monitoring via Nagios ku.gpeni.net/nagios 04 May 2011 KU EECS 780 Comm Nets NET-L4-49 Network Resource Monitoring via Cacti 1.ku.gpeni.net/cacti 04 May 2011 KU EECS 780 Comm Nets NET-L

26 KU EECS 780 Communication Networks Laboratory Programmable Networking with Network Experimentation with References James P.G. Sterbenz et. al. The Great Plains Environment for Network Innovation (): A Programmable Testbed for Future Internet Architecture Research, Proc. of TridentCom, Berlin, May 2010, pp R. Cherukuri, X. Liu, A. Bavier, J.P.G. Sterbenz, D. Medhi, Network Virtualization in : Framework, Implementation & Integration Experience, Proc. of IEEE ManFI, Dublin, May May 2011 KU EECS 780 Comm Nets NET-L4-51 Network Experimentation with Acknowledgements Justin P. for Nagios, Cacti, and PlanetLab support Xuan UMKC for MyVINI support 04 May 2011 KU EECS 780 Comm Nets NET-L