T-VT2/ L2. Jaromír Pilař, Consulting Systems Engineer, CCIE 2910

Size: px

Start display at page:

Download "T-VT2/ L2. Jaromír Pilař, Consulting Systems Engineer, CCIE 2910"

Louise Goodman
6 years ago
Views:

1 Praha, hotel Clarion dubna 2013 Využití WDM technologie pro propojování datových center T-VT2/ L2 Jaromír Pilař, Consulting Systems Engineer, CCIE Cisco and/or its affiliates. All rights reserved. Cisco Connect 1

Basic optical transmission principles 2013 Cisco

3 Single Mode Fiber Prerequisite for long distance optical transmission Both the core and the cladding are made primarily of silica (SiO 2 ) Several types defined by ITU-T standards (most common is G.652) Typically one pair needed (single fiber systems possible as well) Refractive Index (n) - n = c/v, n ~ 1.46 (SiO 2 ), n (core) > n (cladding), difference < 1% - Propagation delay in fiber: 5 µsec/km (given by speed of light) Core 10µm 125µm 250µm Cladding Buffer/Coating 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 3

4 Single lambda vs. multiple lambdas How to transport more than one channel Single lambda: - One signal only (e.g. 1000BaseZX, 10GBaseZR etc.) - More signals using TDM (SDH, EoSDH, FCoSDH) or statistical multiplexing (e.g. MPLS-TP) Multiple lambdas: (grids defined by ITU standard) - CWDM 20 nm grid (usually 8 or 16 channels) - DWDM 200 GHz, 100 GHz or 50 Ghz grid - WWDM Combination: - DWDM (or CWDM) used to scale overall bandwidth - TDM used for subset of wavelength to efficiently use available bandwidth by slow channels TDM: WDM: 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 4

5 Welcome to the analog world Optical Impairments (1/2) Attenuation Loss of signal strength (absorption a scattering) Limits transmission distance Optical amplifiers can compensate Optical Signal to Noise Ratio (OSNR) Noise introduced by optical amplifiers Function of symbol rate - rule of thumb, 2X data symbol => 3 db higher OSNR needed Limits number of amps hence distance Solution provided by FEC/EFEC or regeneration Chromatic Dispersion (CD) Speed of light is different for different wavelength Limits transmission distance (pulses are distorted) Inverse to the square of the data rates Dispersion compensator compensates for effects Advanced modulations provides higher tolerance Loss (db/km) Wavelength (nm) Time Slot 2.5Gb/s Fiber 10Gb/s Fiber S-band: nm C-band: nm L-band: nm 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 5

Welcome to the analog world Optical Impairments (2/2) Polarization Mode Dispersion (PMD) Caused by non-linearity of fiber geometry Very disruptive at higher bit rates (>

rates CD, unequal channel spacing, larger spacings Power (dbm) -5-10 -15-20 -25-30 -35-40 1542 1543 1544 1545 1546 1547 1548 Wavelength (nm) Self/Cross Phase Modulation

6 Welcome to the analog world Optical Impairments (2/2) Polarization Mode Dispersion (PMD) Caused by non-linearity of fiber geometry Very disruptive at higher bit rates (> =10G) MLSE and advanced modulations to increase tolerance, PDMC or regeneration to compensate Four Wave Mixing (FWM) Effects in multichannel systems Effects for higher bit rates CD, unequal channel spacing, larger spacings Power (dbm) Wavelength (nm) Self/Cross Phase Modulation (SPM, XPM) Effected by high channel power Effected by neighbor channels CD, reduce launch power, larger spacings 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 6

WDM system anatomy Transponder based system GE OEO Optically Amplified

ITU-T Grid for DWDM Wavelength Multiplexed Signals Optical Amplifier 2012

Cisco Connect 8 OEO = transponder Primary functions: - wavelength conversion -

8 WDM system anatomy Transponder based system GE OEO Optically Amplified Wavelengths SDH OEO WDM Mux (Filter) OA OA FC 'Grey' MM/SM 850/1310/1550nm OEO ITU-T Grid for DWDM Wavelength Multiplexed Signals Optical Amplifier 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 8 OEO = transponder Primary functions: - wavelength conversion - G.709 encapsulation - FEC/EFEC - protocol monitoring - service demarcation point - can provide TDM multiplexing - OFC

9 WDM system anatomy System with colored clients GE SFP(+)/XENPAK/X2/XFP Optically Amplified Wavelengths SDH Colored optics WDM Mux (Filter) OA OA FC SFP/X2 Wavelength Multiplexed Signals Optical Amplifier equipment ITU-T Grid for DWDM 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 9

11 Bandwidth / Fiber Multiplication Transport of bandwidths beyond available interface rates (10G, 40G, 100G) requires multiple channels. With standard interfaces, multiple channels requires multiple fiber pairs. Fiber is a scarce resource, and can be costly. DWDM allows multiple channels over a single fiber pair, and is often more cost effective than using multiple fiber pairs. Without DWDM N fiber pairs With DWDM One fiber pair N wavelengths 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 11

12 Distance With standard interfaces, distance is limited to the reach of the specified interface (e.g. LX, EX, ZX 10 km, 40 km, 80 km). Exceeding these distances requires regeneration of each channel (typically with router/switch interfaces). With DWDM, single span distances can reach 250 km. Amplified, multiple span DWDM distances can reach 1000 s of km, with no electrical regeneration. Without DWDM Up to 80km With DWDM 1000 s of km Optical Amplifier 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 12

13 Topology Flexibility With standard interfaces, the physical (layer 1) network topology is restricted to the fiber topology. Fiber is expensive, and availability is limited. Metro / regional fiber is most cost effectively deployed to multiple sites in a ring. DWDM, specifically ROADM, allows any L1 topology (hub and spoke, mesh) over any fiber topology typically a ring. Dark Fiber Dark Fiber DWDM Wavelengths Physical Ring Channel Topology must be a Ring Physical Ring Channel Hub & Spoke Physical Ring Channel Mesh Physical Mesh Channel Mesh 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 13

Service Protection Without DWDM (or TDM), service protection must be

14 Service Protection Without DWDM (or TDM), service protection must be provided by an upper layer protocol. This can be complicated and slow. DWDM provides the ability to protect individual channels at layer 1, with sub 50ms switching times. Bandwidth is reserved, with no oversubscription or contention in a failure scenario. Multiple levels of resiliency are available, at varying cost points. Line Card Protection Interface Protection Optical Layer Protection Fiber Protection 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 14

16 Cisco optical products portfolio Optical products are handled by to different groups Transciever Module Group (TMG) High End Routing and Optical Group (HERO) TMG portfolio Grey, CWDM and DWDM optical pluggable modules (GBIC, SFP, XENPAK, X2, XFP, SFP+, QSFP+, CFP, CXP, CPAK*) Supported in Catalyst and Nexus families of switches and routers ** Simple passive filters (CWDM, EWDM) HERO portfolio (optical part) Passive filters (ONS family, DWDM and CWDM) SDH/SONET products (ONS 15300, ONS MSPP and ONS family Carrier Ethernet solution (CPT family MPLS TP based) DWDM system (ONS MSTP) IPoDWDM (modules for CRS, GSR, ASR 9K and 7600) * - roadmap, ** - check datasheets for details

Cisco ONS 15454 MSTP Fully reconfigurable, intelligent DWDM platform Carrier Class DWDM Transport Combines TDM, Ethernet, SAN and video services Originally introduced in 2003 as advanced metropolitan

applications (3000 km with 70 channels @ 100 Gbps tested in public) Flexible optical networking platform Cost effective Reconfigurable Optical Add/Drop Multiplexers (ROADM) with support for optical

17 Cisco ONS MSTP Fully reconfigurable, intelligent DWDM platform Carrier Class DWDM Transport Combines TDM, Ethernet, SAN and video services Originally introduced in 2003 as advanced metropolitan DWDM platform (broad services range, 800 km reach) Through multiple releases evolves into platform covering all requirements for enterprise BC/DR solutions, metropolitan DWDM networks, LH and ULH applications (3000 km with Gbps tested in public) Flexible optical networking platform Cost effective Reconfigurable Optical Add/Drop Multiplexers (ROADM) with support for optical mesh Full band tunable lasers, modular client interfaces Tight integration with IP core routers (IPoDWDM strategy) and carrier ethernet solutions (Xponders, MPLS-TP) Future proof extensible platform Up to 80/96 wavelengths in C-band, 32 in L-band Support for 40 and 100 Gbps transport Further developed to extend the reach and functionality High level of investment protection 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 17

19 Cisco ONS MSTP supported clients Wide range of telco and enterprise client interfaces TDM STM-1 STM-4 STM-16 STM-64 STM-256 OTU-2 OTU-2e OTU-3 OTU-3e OTU-4 E1 E3 Data E FE GE 10 GE LAN PHY 10 GE WAN PHY 40 GE 100 GE Storage 1G FC/FICON 2G FC/FICON 4G FC/FICON 8G FC/FICON 10G FC/FICON ESCON ISC 1 ISC 3 Sysplex CLO Sysplex ETR STP 5G Infiniband Video DV-6000 HDTV SDI D1 video DVB ASI 2R Any rate from 100 Mbps to 2.5 Gbps BENEFIT: High flexibility in system deployment, most of applications covered BENEFIT: Broad range of potential service offerings BENEFIT: 40/100 Gbps support allows for further bandwidth scaling 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 19

10G OTU2 Xponder 10G OTN Xponder is a single slot board equipped with 4 10G pluggable interfaces (XFP based) supports fixed and full C-band tuneable XFP Each of the 4 interfaces supports multiple

709 overclocked to transport 10GE as defined by ITU-T G. Sup43 Clause 7.1 (11.0957 Gbps) G.709 overclocked to transport 10GE as defined by ITU-T G. Sup43 Clause 7.2 (11.0491 Gbps) G.

21 10G OTU2 Xponder 10G OTN Xponder is a single slot board equipped with 4 10G pluggable interfaces (XFP based) supports fixed and full C-band tuneable XFP Each of the 4 interfaces supports multiple services: OC-192 / STM-64 ( Gbps) 10GE WAN PHY ( Gbps) 10GE LAN PHY ( Gbps) 10G FC ( Gbps) OTU-2 Standard G.709 ( Gbps) G.709 overclocked to transport 10GE as defined by ITU-T G. Sup43 Clause 7.1 ( Gbps) G.709 overclocked to transport 10GE as defined by ITU-T G. Sup43 Clause 7.2 ( Gbps) G.709 proprietary overclocking mode to transport 10G FC ( Gbps) Port specification All the 4 ports support NO-FEC and FEC mode (Standard Reed-Solomon FEC defined by ITU-T G.975) 2 ports (Port 3 and Port 4) also supports E-FEC correction algorithm (Standard Orthogonal BCH defined by ITU-T G Clause I.7) 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 21

10G DWDM 10G DWDM 10G DWDM 10G DWDM 10G DWDM 10G DWDM 10G DWDM 10G DWDM 1x 10G Multi-rate Transponder with

22 10G OTU2 Xponder: Card Configurations 2x 10G Multi-rate Transponder 2x 10G FEC/E-FEC Regen 1x 10G E-FEC/E-FEC Regen Mixed MR TXP and Regen FEC/EFEC 10G (Grey/DWDM) 10G (Grey/DWDM) 10G DWDM 10G DWDM 10G DWDM 10G (Grey/DWDM) 10G DWDM 10G DWDM 10G DWDM 10G DWDM 10G DWDM 10G DWDM 10G DWDM 10G DWDM 1x 10G Multi-rate Transponder with protected trunk 10G (Grey/DWDM) 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 22 10G DWDM 10G DWDM 10G DWDM

23 Any-Rate Xponder Card Ultimate Flexibility for DWDM Aggregation and Transport 8 x SFP, 2 x XFP ports Unprotected / Protected Ethernet: FastE, GigE SAN: 1G, 2G, 4G, 8G SDI Video: SD, HD, 3G 2.5G OTU-2 10G OTU-3 Transparent TDM: OC-3/12/48, OTN Transponder / Muxponder Pay-As-You-Grow

Any-Rate Xponder Card Ultimate Flexibility for DWDM Aggregation and Transport 2.5G Transponder 2.5G Protected Transponder 2.5G Data Muxponder 2.5G Protected Data Muxponder 4 x 2.

24 Any-Rate Xponder Card Ultimate Flexibility for DWDM Aggregation and Transport 2.5G Transponder 2.5G Protected Transponder 2.5G Data Muxponder 2.5G Protected Data Muxponder 4 x 2.5G 10G Muxponder 8-Port 10G DataMuxponder Replaces the functionality of all these cards... Video aggregation OC-3/12/48 aggregation Fast Ethernet aggregation 8G Fibre Channel Transponder Protected 10G Muxponder EFEC I.7 Transponder/Regen...and adds these new features.

25 Any-Rate Xponder Card Sample operating mode (1/2) TSP #1 TSP #2 DWDM Trunk DWDM Trunk Protected TSP #1 DWDM Trunk Working DWDM Trunk Protect 10G DWDM Trunk 10G DWDM Trunk TSP #3 TSP #4 DWDM Trunk DWDM Trunk Protected TSP #2 DWDM Trunk Working DWDM Trunk Protect 4 x SFP Transponder Unprotected 1G, 2G or 4G 2 x SFP Transponder Protected 1G, 2G or 4G 2 x 4:1 10G Muxponder Unprotected 1G, 2G or 4G 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 25

26 Any-Rate Xponder Card Sample operating mode (2/2) DWDM Trunk Working DWDM Trunk Protect 10G DWDM Trunk Working 8G FC 10G DWDM Trunk Protect DWDM Trunk DWDM Trunk Working DWDM Trunk Protect 8:1 10G Muxponder Protected Multi-Rate 8G FC Transponder Unprotected 2 x 2:1 2.5G Muxponder Protected Multi-Rate 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 26

27 Cisco ONS MSTP 100Gbps Implementation M2 with 2x 100G DWDM Trunk 100G DWDM Trunk Line Card 10x 10G Multi-Rate Line Card M6 with 6x 100G DWDM Trunk 2x CFP Line Card Outcome of internal development and CoreOptics acquisition 400Gbps and 1Tbps technology PONC in Monza 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 27

28 Latency sources Where the latency comes from? Fiber - speed of light is not infinite Speed in vacuum c = 3 x 10 8 m/s 3.3µs/km Speed through fiber ⅔ c 5µs/km Transponder/muxponder OEO, monitoring, muxponding, etc. FEC/EFEC DCU Calculation Spool of special fiber Typical length for Cisco DCUs is from 0.6km (100 ps/nm) to 12km (1950 ps/nm) Can add 10% of latency in average on G Cisco and/or its affiliates. All rights reserved. Cisco Connect 28

29 Fibre Bragg Grating DCU s Dispersion Compensation for Low Latency Optical Networking Same range of compensation values as DCF DCU s Uniform, low loss (3dB) Near Zero Latency (< 25ns) Compatible with 100GHz systems Passive Inventory

30 Ultra Low Latency Transponder Mode Software Mode of same 10x10G card Sub 4ns latency! No FEC or G.709 Five 10G transponders per slot Fixed or Tuneable DWDM Trunk Optics 10GE / 10G FC only Normal Mode TX/RX TX/RX Trunk ULL Mode TX RX Trunk TX Trunk RX 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 30

31 10G TXP/MXP Latency Details (End-to-End) 10G MR EFEC Transponder: G.709 Off: 1µs G.709 On No FEC / Standard FEC: 5µs G.709 On Enhanced FEC: 150µs 10G Data Muxponder (DE disable): G.709 Off 1G FC: 58µs G.709 Off 2G FC: 30µs G.709 Off 4G FC: 59µs G.709 On No FEC / Standard FEC 1G FC: 66µs G.709 On No FEC / Standard FEC 2G FC: 36µs G.709 On No FEC / Standard FEC 4G FC: 66µs G.709 On Enhanced FEC 1G FC: 204µs G.709 On Enhanced FEC 2G FC: 174µs G.709 On Enhanced FEC 4G FC: 204µs 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 31

32 40G TXP and 100G modules Latency Details (End-to-End) 40G Data Muxponder: G.709 On No FEC / Standard FEC : 5µs G.709 On Enhanced FEC : 50µs 10x10G Linecard: G.709 Off No FEC : 4µs G.709 On No FEC : 7µs G.709 On Standard FEC : 11µs G.709 On Enhanced FEC : 146µs 100G Trunk module: G.709 On Standard FEC : 4µs G.709 On HG-FEC 7% : 20µs G.709 On UFEC 20% : 39µs 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 32

33 What is "skew" Source - t=0 Skew = differential delay Destination - t>0 Can be introduced by: - Different path lengths - Muxponding Negative impact on some load balancing schemes (namely Brocade ISL trunking) Negative impact on protocols with embedded timing information Must be carefully evaluated 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 33

34 DWDM Encryption Architecture Key exchange over OTU2 GCC Ethernet Ethernet Fibre Channel Fibre Channel OTN OTN OTU2 Payload Encrypted with 256 bit AES 256 bit AES DWDM Wavelength(s)

10G Multi-Rate Encryption Transponder One slot, Ten SFP+ pluggable ports Powerful Layer 1 Encryption for 10G signals Supports 10GE, 10G FC, 8G FC, OC-192 and OTU-2 Five independent encrypted streams

35 10G Multi-Rate Encryption Transponder One slot, Ten SFP+ pluggable ports Powerful Layer 1 Encryption for 10G signals Supports 10GE, 10G FC, 8G FC, OC-192 and OTU-2 Five independent encrypted streams per card 256 bit XTS-AES encryption & GMAC Authentication Robust key exchange mechanism over G.709 GCC Integrated transponder functionality Trunk SFP s can be gray (SR, LR, ER) or DWDM DWDM trunks include FEC for long reach Trunks can interface with 40G or 100G muxponders for wavelength aggregation

10G Multi-Rate Encryption Transponder Per Port

Encrypted, Gray output to 40G or 100G Muxponder

36 10G Multi-Rate Encryption Transponder Per Port Flexibility Unencrypted, Gray Encrypted, DWDM Trunk OTU2 output from AnyRate Xponder Encrypted, DWDM Trunk Unencrypted, Gray Encrypted, Gray output to 40G or 100G Muxponder Unencrypted, Gray Unencrypted, DWDM Trunk Low Latency Transponder

37 Cisco ONS MSTP ROADM Implementation Basic implementation - 2 ROADM - Multidegree ROADM (optical mesh) Enhanced functionality - Omnidirectional - Colourless - DWDM aware control plane Integration and space/power efficiency - Single module ROADM - Attractive PAYG bundles EDFA ROADM OSA 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 37

Cisco ONS 15454 MSTP Comprehensive design

Network Design Entry Traffic requirements:

selection optical budget and OSNR CD, PMD,

Diagrams Step-by-Step Interconnect BENEFIT:

38 Cisco ONS MSTP Comprehensive design tool - Cisco Transport Planner GUI-based Network Design Entry Traffic requirements: Any-to-Any Demand provided by ROADM Point-to-point demands Comprehensive Analysis checks for: wavelength routing and selection optical budget and OSNR CD, PMD, amplifier tilt etc. Smooth Transition from Design to Implementation Bill of Materials Rack Diagrams Step-by-Step Interconnect BENEFIT: Fast and comprehensive network design 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 38

Cisco ONS 15454 MSTP Management Applications Options Cisco Transport

capability Cisco Prime Optical (formerly CTM) EMS/NMS layer

available for OOS integration Cisco Transport Planner Network design

straight to installation Live network import OSMINE completed TIRKS,

39 Cisco ONS MSTP Management Applications Options Cisco Transport Controller (CTC) Installation and setup Full node/ring management capability Cisco Prime Optical (formerly CTM) EMS/NMS layer applications for advanced optical management CORBA/TL1 and SNMP NBI available for OOS integration Cisco Transport Planner Network design Network modelling Computer-aided installation: from network design straight to installation Live network import OSMINE completed TIRKS, NMA and TEMS 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 39

41 Project information Two systems redundant point-to-point between Ljubljana and Maribor (replacement of existing ONS 15530) and ring in Ljubljana Distance Ljubljana Maribor is almost 170 km, solution without in-line amplification required (RAMAN amplification used) Distances for ring are between 10 km and 15 km Traffic for point-to-point system: 1x10GE, 1x8G FC, 1x 4G FC, 8xGE (all channels 1+1 protected) up to Gbps validated Traffic for ring system: 1x10GE, 2x8G FC, 2x2G FC, 8xGE (all channels splitter protected) up any-to-any traffic combination validated to full capacity of 40 wavelengths and 100 Gbps per wavelength interfaces 850 nm MMF (easily changeable) Redundant AC power supplies and chassis controllers Multishelf graphical management and OSC channel Prerequisite for DC and switching evolution which will introduce Catalyst upgrade, Nexus 7000 and MDS Cisco and/or its affiliates. All rights reserved. Cisco Connect 41

44 Project information Two systems per site (independent, primary and secondary) combined with platform redundancy (AC PS, shelf controllers) Primary system traffic requirements: 31x 10GE, 16x GE, 22x8G FC, 17x8G FICON, 12x10G FC, 4x 5G IB Secondary system traffic requirements: 25x 10GE, 14x GE, 22x8G FC, 17x8G FICON, 12x10G FC, 4x 5G IB Each system equipped to support for Gbps High wavelength utilization achieved by use of 10x10->100G multiplexing, only 16 wavelengths used in primary system and 14 in secondary. Additional 24 still available for use in primary system and 26 in secondary system All nodes are multidegree ROADMs to allow future topology expansion Traffic protection will be managed at end-device level by taking diverse paths via primary and secondary systems Graphical management with multishelf capabilities, OSC 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 44

Rack Layout Primary system power consumption: Maximum 4580 W Typical 3700 W Secondary system power consumption: Maximum 4500 W Typical 3633 W 8/10G

45 Rack Layout Primary system power consumption: Maximum 4580 W Typical 3700 W Secondary system power consumption: Maximum 4500 W Typical 3633 W 8/10G channel latency: Fiber: 110 µs (22x5) System: 11 µs (7+4) Primary system Secondary system 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 45

47 4-channel bidirectional terminal based on FLD 2.5dB 2.5dB Ch1-RX Ch2-RX Ch3-RX Ch4-RX FLD COM-TX OPT-AMP-17 COM-RX FLD Ch1-TX Ch1-RX Ch2-TX Ch2-RX Ch3-TX Ch3-RX Ch4-TX Ch4-RX Single FLD EXP-RX FLD COM-TX 1.5dB Single FLD COM-RX Ch1-TX Ch2-TX Ch3-TX Ch4-TX FLD COM-RX OPT-PRE COM-TX FLD Ch1-RX Ch1-TX Ch2-RX Ch2-TX Ch3-RX Ch3-TX Ch4-RX Ch4-TX FLD dB 2.5dB 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect 47

Creating and Analyzing Networks

Creating and Analyzing Networks 2 CHAPTER A project consists of a single network or multiple networks that you analyze and compare. In a project, you can have multiple copies of a single network with the same customer input data, but