100 Gbit/s challenges for an operator as TDC

Transcription

1 100 Gbit/s challenges for an operator as TDC Martin Skafte Michael Lyngbøl Bjarke Skjoldstrup 13. september 2012 Network Engineering Department (TDC Operations, Technology & Planning)

2 Outline 100 Gigabit Transport Networks (Bjarke Skjoldstrup) o Impact of 100 Gbit/s on TDCs core transport network architecture o Drivers for the introduction of 100 Gbit/s in TDCs network o Handling of client trunks with 100 Gbit/s traffic Why 100G link quality matters (Martin Skafte) 14. september

3 TDCs core transport network architecture - topology Access to km fibre cables in the Nordics 88 channel DWDM per fibre, potentially 40 Gbit/s capacity per channel Large rings connecting the main TDC locations in Northern Europe Partially meshed network connecting the main TDC IPpops in DK 14. september

4 Impact of 100 Gbit/s on TDCs core transport network architecture present situation Wavelength routing of traffic using transponders and Reconfigurable Optical Add/Drop Multiplexers (ROADMs) All circuits are terminating at the same sites as the wavelengths Optical Transport Network (OTN) overhead is merely used as a wrapper around the client signal for support of wavelength transport and management Grooming of traffic requires that circuits are terminated Upgrading to 100 Gbit/s rates on the wavelengths will (just) make the big pipes bigger A B C D A x10 B C D 2x september

5 Impact of 100 Gbit/s on TDCs core transport network architecture future situation Optal Data Unit (ODU) routing of traffic using OTN switching Circuits do not need to terminate at the same sites as the wavelengths OTN is used as network technology Simple routing Fast protection Automatic restoration Grooming of traffic can be done without terminating circuits Upgrading to 100 Gbit/s on the wavelengths will increase the grooming potentials and may improve the use of the network ressources A B C D A x10 B C D 2x september

6 Drivers for the introduction of 100 Gbit/s in TDCs network Cost per bit transported a given distance o 100 Gbit/s transponders must as a minimum be cheaper than 2.5 times the cost of 40 Gbit/s transponders provided that a) there is no associated requirement for upgrading the DWDM infrastructure b) the reach is unaffected by the change from 40 Gbit/s to 100 Gbit/s c) customers will stop asking for lower prices of the services o Savings must be applicable to the present architecture Customer demands for 100 Gbit/s services o No serious requests untill now o Very few customers with 100 Gbit/s service demands are expected in the near future (at least until end of 2013) Internal TDC demands for handling 100 Gbit/s trunks between IP routers 14. september

7 Handling of client trunks with 100 Gbit/s traffic Client interface must fit into or be adapted to - the OTN architecture and equipment o 100 Gbit/s OTN electrical format (OTU4/ODU4/OPU4) is tailored to transport 100 GbE o The physical interface on the 100 GbE client ports is still uncertain: four lanes of 25 Gbit/s as defined by IEEE or ten lanes of 10 Gbit/s as defined by Multi Source Agreement (MSI) C form factor pluggable (CFP) or...? 100 GbE seems to be straight forward to transport and manage when it is embedded in OTN as it will be in TDCs backbone network. However the capabilities of 100 GbE interface itself suffers from some deficiencies enherited from 10 GbE LAN PHY september

8 Why 100G link quality matters Martin Skafte Network Engineering Department

9 TV transport in the core network Video streaming server TV multicast traffic Core Network TV stream End customer Video Assisting Server 10th September

10 Bit-error on a single DSL line Video streaming server TV multicast traffic Core Network TV stream End customer 3 2 Video Assisting Server 10th September

11 Bit-error in the core network Video streaming server TV multicast traffic Core Network TV stream End customer Video Assisting Server th September

12 N x 10G backbone link 4 x 10G WAN-PHY DWDM transport Core router Core router 10G WAN-PHY frame WAN-PHY overhead WAN-PHY overhead Ethernet 1 Ethernet 2 Ethernet 3 Ethernet 4 10th September

13 First generation 100G LAN-PHY interface 100G LAN-PHY DWDM transport Core router Core router 100G LAN-PHY frames Ethernet 1 Ethernet 2 Ethernet 3 Ethernet 4 Ethernet 5 Ethernet 6 10G WAN-PHY frame WAN-PHY overhead WAN-PHY overhead Ethernet 1 Ethernet 2 Ethernet 3 Ethernet 4 10th September

14 Tools that can do (some) error detection 100G LAN-PHY DWDM transport Core router Core router Metods for error detection: Not accurate: BFD Ethernet OAM Router Control plane Routing engine (RE) Data plane Somewhat accurate: BFD Ethernet OAM PFE Switch fabric PFE Not usuable: LAN-PHY overhead Interface/ framer Interface/ framer 10th September

15 Second generation 100G OTN interface 100G OTN DWDM transport Core router Core router 100G OTN frame OTN overhead OTN overhead Ethernet 1 Ethernet 2 Ethernet 3 Ethernet 4 Metods for error detection: Router Data plane Somewhat accurate: BFD Ethernet OAM PFE Switch fabric PFE Very accurate: OTN overhead Interface/ framer Interface/ framer 10th September

16 Conclusion Important to be able to shut down a link that experiences even a small amount of continuously bit-errors. o Researching how to handle bursts of errors. N x 10G WAN-PHY links is an inefficient way of scaling the network. First generation 100G LAN-PHY interfaces for core routers (operated by TDC) does probably not support the necessary mechanisms for detection of bit-errors. Second generation 100G OTN interfaces will be deployed once they are available. This is expected to be second half of Research is ongoing on how to implement intelligent communication between IP/MPLSrouters and the DWDM-management system. Dialog with vendors on how to do fine-grained tuning of thresholds and signaling on 100G OTN-interfaces. o Encourage vendors to use intelligent and adjustable framers. o Encourage vendors to go beyond values specified in standards. Looking for test solution that combines OTN and IP/MPLS. 10th September

17 Questions? 10th September