SURFnet5, ins and outs SNB Master @ SURFnet May 14 th, 2004 Dennis Paus, Network Services
SURFnet5, ins and outs - contents Design and architecture Components Key technologies External connectivity Future developments
SURFnet5, ins and outs - contents Design and architecture Components Key technologies External connectivity Future developments
SURFnet5 design rules Robust: No Single Point of Failure Fast: Connectivity up to 10 Gbit/s Simple: IP over lambda Advanced: IPv4 *and* IPv6, plus IPv4 multicast 15 concentrator locations (PoPs)
SURFnet5 topology
SURFnet5 design (1) Core network in Amsterdam, two locations Plenty bandwidth in core, virtually one location 10 Gbit/s between each PoP and both core locations Unprotected 10G lambdas, so
SURFnet5 design (2) resilience on IP level! Initial design: IS-IS as Interior Gateway Protocol (IGP) MPLS Traffic Engineering Fast ReRoute -> 50 msec Soon after implementation: Only IS-IS, with tuned parameters -> ~100 a 200 msec Future: New developments in IS-IS within IETF and Cisco, -> 50 msec
SURFnet5, ins and outs - contents Design and architecture Components Key technologies External connectivity Future developments
SURFnet5 components (1) All optical add-drop mux 32 lambdas @ 10 Gbit/s Ownership BT Ignite Operations BT Ignite Marconi SmartPhotonix PMA32
SURFnet5 components (2) 16 Slot router 10G full duplex per slot 320 Gbit/s switch fabric 4 PSUs Line cards: 1x 10G PoS (#=75) 1x 10GE (#=5) 4x GE (#=26) 1x 2.5G (#10) Ownership SURFnet Operations SURFnet/ SARA Cisco 12416
SURFnet5 components (2) 16 Slot router 10G full duplex per slot 320 Gbit/s switch fabric Line cards: 1x 10G PoS (#=75) 1x 10GE (#=5) 4x GE (#=26) 1x 2.5G (#10) Ownership SURFnet Operations SURFnet/ SARA Cisco 12416
SURFnet5 components (3) Cisco Catalyst 4912G 12 port GE switch, non blocking, GBIC-based Over 100 installed Ownership SURFnet Operations SURFnet/ SARA
GigaMAN topology Deventer GE Arnhem
SURFnet5, ins and outs - contents Design and architecture Components Key elements External connectivity Future developments
SURFnet5 key elements (1) Full production since October 2001 IP-over-Lambda using POS framing Dual stack IPv4 and IPv6 Fast restoration by using tuned IS-IS IPv4 multicast (PIM-SM, MBGP and MSDP) Data volume: 1.300 Tbyte/month end of 2003 Availability >99.9%
SURFnet5 key elements (2) 122 customer connections at Gbit/s level (67%) SX, LX/LH, ZX optics, attenuators Ring: Spanning Tree Protocol P-to-P: primary and backup ebgp peering Wirespeed for IPv6 since early 2004 Installation 26x 4-port GE Engine3 linecard Introduction of MPLS in the core (again...) IPv6 wirespeed over 6PE MPLS paths, terminated at the edges of the network
SURFnet5 key elements (3) Within the SURFnet core: ibgp All Cisco 12416 routers receive Full Routing table Core routers are route reflectors (scalability) Traffic follows most optimal path out of AS1103 (SURFnet)
SURFnet5 topology Border Border
SURFnet5, ins and outs - contents Design and architecture Components Key technologies External connectivity Future developments
External connectivity (1) Multiple connections: AMS-IX (2x 1 GE) GÉANT (DANTE) (10G, 2.5G backup) Global IP connectivity (2x 2 GE) Key elements external connectiviteit: No SPoF Congestion free IPv4 unicast and multicast IPv6 unicast
External connectivity (2) Private peerings over GE Peering based on ebgp4, SURFnet BCP: Full mesh of peerings for resiliency (if possible) IPv4 and IPv6 AS-path filtering (soon: max prefix limit) MD5 passwords (trigger: TCP vulnerability) Peer groups to reduce processor load
SURFnet5, ins and outs - contents Design and architecture Components Key technologies External connectivity Future developments
Future developments (1) IPv6 multicast (also wirespeed) IPv4 multicast SSM en Bidir-PIM Continued and increased security awareness Improve convergence customer connections Ring: Rapid Spanning Tree Protocol P-to-P: Tuning BGP4 timers
Future developments (2) Upgrade AMS-IX connections 1 2 Gbit/s by using link bundling 1 10 Gbit/s by using 10GE connection on the new AMS-IX platform Extend number of private peerings Upgrade global IP connectivity Interconnection to SURFnet6...
Thank you for your attention Dennis Paus dennis.paus@surfnet.nl www.surfnet.nl