10 Gigabit Ethernet and Future Cabling for Offices + Data Centres

Transcription

1 10 Gigabit Ethernet and Future Cabling for Offices + Data Centres Presentation at Nexans Seminar Scandinavia, May 2006 Dr Alan Flatman Principal Consultant LAN Technologies

2 Topics Gig over optical fibre Gig over twisted pairs 3. Future office cabling 4. Data centre cabling 5. What does the future hold?

3 1. 10 Gigabit over Optical Fibre

4 10 Gigabit Fibre Ethernet Standards industry standards projects within IEEE 802: IEEE 802.3ae standard approved & published in versions using 3 different wavelengths uses multimode & singlemode fibre types used for local, metro, wide-area networks IEEE 802.3aq standard approval planned for Jun 2006 extended reach over installed multimode 10GBASE-LRM = Long Reach Multimode

5 10 Gigabit Ethernet Fibre Lengths fibre type maximum operating range (m) 10GBASE-SR 10GBASE-LR 10GBASE-ER 10GBASE-LRM FDDI-grade 26 not used not used 220 OM1 33 not used not used 220 OM2 82 not used not used 220 OM3 300 not used not used 220 OS1 not used 10,000 30,000 not used

6 In-Premises Fibre Shipment Forecast for 2007 (by volume) Europe 37% USA 36% Other 10% Asia Pacific 17% Source: BSRIA (Feb 2004)

7 Annual Fibre Shipments: Worldwide fibre core metres (millions) MMF 160/500 FDDI 62MMF 200/500 OM1 50MMF 400/400 50MMF 500/500 OM2 50MMF 1500/500 OM3 SMF Base Data Sources: Flatman (1999) BSRIA (Feb 2004)

8 IEEE 802.3aq: Approach & Implications uses digital signal processing & low-cost lasers» DSP compensates for low bandwidth multimode fibre uses multimode fibres in 2 nd window» where bandwidth is 500 MHz.km for all fibres! extends reach from 26m to 220m for installed fibre could have a significant impact on OM3 market

9 IEEE 802.3aq Development Plan IEEE 802.3aq sanctioned TG WG Sponsor CFI PAR Review Ballot Ballot Standard S O N D 2003 J F M A M J J A S O N D 2004 J F M A M J J A S O N D 2005 J F M A M J J 2006 CFI = Call for Interest PAR = Project Approval Request TG = 802.3aq Task Group WG = Working Group D1.0 D2.0 Baseline Last Proposal Feature D3.0 Last Technical Change

10 10 Gigabit Fibre Ethernet Market Evaluation Fair Source: RHK Inc (October 2004) Excellent SR LR LR LRM industry support LX4 LRM SR LX4 Poor Good module performance

11 2. 10 Gigabit over Twisted Pairs

12 10 Gigabit Ethernet over Copper Projects 2 projects established within IEEE 802: 10GBASE-CX4 quick & cheap 15m link for rack-to-rack uses Infiniband screened cable assembly IEEE 802.3ak standard published in GBASE-T 100m for data centres & future desktops initially targeted at Category 5e cabling IEEE 802.3an approval planned June 2006

13 10GBASE-CX4 Cable & Connector

14 10GBASE-CX4 Issues the channel is severely length-limited (15m) cable and connectors are space-consuming labour-intensive, expensive implementation cannot plug + play with copper Ethernet via auto-negotiation

15 Ethernet Port Shipments Annual Shipments (1000s ports) Source: Dell Oro, Smith Barney 10M total 10M copper 100M total 100M copper 1G total 1G copper M 1G M BASE-T dominant

16 10GBASE-fibre vs 10GBASE-T Cost 1.2 Source: Cahners In-Stat, CFI Group (2004) Relative Cost GBASE-F 10GBASE-T 10GBASE-SR NIC+switch port average cost $5k (Yankee Group) 10GBASE-LX4 NIC+switch port average cost $6k (Yankee Group) 10GBASE-T NIC+switch port cost expected to be in range $1k - $2k (Yankee Group)

17 Future Server Requirements 10GBE used mostly for GBE switch uplinks, in high-end user server farms, data centres 10GBASE-fibre product deployment issues:» doesn t follow 10x speed / 3x cost model» currently too expensive for data centres» prices falling but hard to predict how fast server networks must be supremely robust» design margin to reduce errors and failures cabling cost pressure not as acute as office data centre geography not as great as office

18 High-speed Copper Trends strong increase in 1000BASE-T shipments PCs packaged with cheap 1000BASE-T NIC deployment not driven by need for speed copper 40% cost of 10G fibre solution (2007) 10GBASE-T excellent fit for Data Centres 10GBASE-T a future prospect for desktops now! within the life of cabling being installed today?

19 10GBASE-T Transmission nearby UTP cable Switch 10GBASE-T signal spectrum over 400 MHz Alien Crosstalk (AXT) NIC 2.5 Gbit/s 10 Gbit/s Digital Signal Processor (DSP) 2.5 Gbit/s 2.5 Gbit/s Digital Signal Processor (DSP) 10 Gbit/s 2.5 Gbit/s NEXT FEXT Return Loss

20 10GBASE-T Cabling must be specified to an upper frequency of 500MHz UTP is significantly challenged by alien crosstalk EMC compliance may also be a challenge with UTP alien crosstalk may be mitigated but it is complex field measurement of alien crosstalk not practical initial target of Cat 5e has been virtually rejected Cat 6 UTP struggles to achieve respectable length

21 Estimated World-wide Installed Cabling Base: December 2005 old Class D 15% new Class D 50% FTTD 0.6% Class E 34% Class F 0.4% Source: LAN Technologies

22 10GBASE-T Cabling Choices Cabling Supported Link Distances Class E / Cat 6 unscreened up to 55m Class E / Cat 6 screened Class F / Cat 7 (screened) new Class E / Cat 6A (unscreened) 100m 100m 100m new type of UTP with improved alien crosstalk performance

23 10GBASE-T PSD Mask potential interference from 1000BASE-T to 10GBASE-T potential interference from 10GBASE-T to 1000BASE-T BASE-T PSD PSD (dbm/hz) GBASE-T PSD Mask Frequency (MHz)

24 The Twilight* Zone * state of imperfect understanding (OED) good bad BER = BASE-T compliance limit failure limit zero throughput BER = BASE-TX zero throughput BER = BASE-T zero throughput BER = GBASE-T zero throughput

25 10GBASE-T 30m Channel Option preferred switch module (X2) limits power to 4w at least 2 generations of silicon predicted to achieve target levels, which could take 3-4 yrs 30m Cat 6A or Cat 7 option loosely defined to enable low power/low latency implementations

26 IEEE 802.3an Development Plan CFI PAR IEEE 802.3an sanctioned TG Review WG Ballot Sponsor Ballot Standard O N D 2002 J F M A M J J A S O N D 2003 J F M A M J J A S O N D 2004 J F M A M J J A S O N D 2005 J F M A M J J 2006 CFI = Call for Interest PAR = Project Approval Request TG = 802.3an Task Group WG = Working Group D1.0 Baseline Proposal D2.0 Last Feature D3.0 Last Technical Change

27 10 Gigabit Copper Ethernet Market Evaluation Fair Source: RHK Inc (October 2004) T Excellent industry support CX4 CX4 Poor T Good module performance

28 3. Future Office Cabling

29 ISO/IEC Cabling Projects Number Title Status ISO/IEC Ed.2 Customer Premises Cabling published 2002 ISO/IEC Ed.2.1 Customer Premises Cabling: in development including new Class E, new Class F ISO/IEC TR GBASE-T over installed Class E+F in development ISO/IEC Cabling Administration published 2002 ISO/IEC Cabling Planning & Installation in development ISO/IEC Testing of Optical Fibre Cabling under revision ISO/IEC Residential Cabling published 2003 ISO/IEC Pathways & Spaces under revision ISO/IEC Industrial Premises Cabling near final draft ISO/IEC Cabling for Wireless Access Points published 2003 ISO/IEC Data Centre Cabling working draft

30 ISO/IEC TR Installed Class E/F to Support 10GBASE-T Technical Reports created as industry guides compliance accomplished on a channel basis also permanent link spec for confidence testing contains AXT mitigation methods for UTP only planned to be approved as a TR during 4Q06 mirrors technical requirements of 10GBASE-T technically compatible with TIA/EIA TSB-155

31 PSANEXT Mitigation Procedures for Installed Class E UTP Cabling 1. Select 6 channels in TR. Measure PSANEXT between each channel and others in same rack, and in rack panels above/below. 2. Calculate PSNEXT for each channel. 3. Measure IL for all channels. 4. Mitigation is needed if channels do not meet PSANEXT requirement. 5. If PSANEXT negative margin >6dB between MHz, mitigation is not feasible. Replace these channels with cabling having better PSANEXT, such as Cat 6A or Cat Replace patch, equipment & work area cords with Cat 6A cords, keeping them unbundled and randomly organised. 7. Use interconnects rather than crossconnects. 8. Unbundle & randomise horizontal cabling in the TR up to its point of exit. 9. Select non-adjacent channels for 10GBASE-T (skip patch panel jacks). 10. Replace inter/crossconnect with Cat 6A inter/crossconnect. 11. Replace CP with Cat 6A connectors. 12. Repeat steps 1-5 above to verify that mitigation has been successful, selecting a different 6 channels on which to measure PSANEXT. 13. Once channels have been qualified for PSANEXT, each channel must be further qualified for internal transmission up to 500MHz. If any channel does not meet internal requirements, the mitigation steps above concerning component replacement should be followed.

32 ISO/IEC Edition 2.1 New Class E & Class F Cabling will specify channel, links, cords & components introduces new Class E + new Class F cabling intent to meet AXT requirements by design, but this could be for screened cabling only Class E A & F A compliance accomplished by meeting channel and TO interface requirements existing Class A-F compliance via usual routes 1. Channel, TO interface & connector performance, or 2. Permanent Link, TO interface, connector performance & compliant cords, or 3. Reference implementation captures technical requirements of 10GBASE-T technically different to TIA Cat 6 Augmented

33 ISO/IEC Edition 2.1 New Class E & Class F Cabling Names Existing channels unchanged as Class E, Class F Existing components unchanged as Cat 6, Cat 7 New channels to be Class E A, Class F A New components to be Cat 6 A, Cat 7 A

34 Channel PSANEXT Performance 100 from ISO/IEC Ed2.1 FPDAM 90 PSANEXT (db) GBASE-T limit for Class F and Class E A Class F A STP Class E A UTP measurement cap of 67dB applied Frequency (MHz)

35 Channel PSAELFEXT Performance 90 from ISO/IEC Ed2.1 FPDAM 80 PSAELFEXT (db) GBASE-T limit for Class F and Class E A Class F A STP Class E A UTP measurement cap of 67dB applied Frequency (MHz)

36 Comparison of Cabling Types Cable Type Cat 6 Cat 6 A Cat 6 Cat 6 Cat 7/7 A optical Parameter UTP UTP FTP STP STP fibre Cable dia (mm) 6.2 < Min bend radius 49.6 < when pulling (mm) Min bend radius 24.8 < installed (mm) cost per cable metre 1.0x 1.8x 1.45x 1.5x 1.6x 2.5x (factor x Cat 6 UTP) component costs 1.0x 1.8x 1.25x 1.4x 1.5x 3.0x 50m channel (fxc6u)

37 Screen Management huge amount of screened cabling deployed in Europe Germany 98.4%, France 89.3%, Austria 87.3% (BSRIA 2004) at least 30 years experience in screen management has been put in public domain practices & guides CENELEC EN Cabling Planning & Installation CENELEC EN Equipotential Bonding for IT Equipment TIA/EIA 607 Grounding & Bonding for Telecoms Equipment contribution to installation process is estimated to be small (additional 10-20% labour time/cost)

38 ISO/IEC vs CENELEC vs TIA vs IEEE 802.3an Channel NEXT values ISO/IEC TR CENELEC EN TIA TSB-155 IEEE 802.3an TIA Cat 6 Augmented ISO/IEC Class E A NEXT (db) Class E 250MHz 330MHz Frequency (MHz)

39 TIA-568-B.2 Ad.11 (Max Cable Dia) diameter of a 4-pair UTP or ScTP cable been increased from 6.35mm max to 9.00mm max to accommodate Cat 6A cable construction this is equivalent to Cat 7 cable diameter this doubles the cable cross sectional area TIA specification approved in October 2005

40 Remaining Challenges lab alien crosstalk testing (drum vs. 6 around 1) practicality of in-field alien crosstalk measurement in-field measurement accuracy at high frequencies coexistence of Cat 6A UTP with other UTP types Cat 6A modular connector interoperability Cat 6A modular connector backwards-compatibility Electromagnetic Compatibility (EMC)

41 4. Data Centre Cabling

42 Typical Data Centre IT Model SAN SAN NAS NAS Directory SAN = Storage Area Network NAS = Network Attached Storage Internet Tier-3: Backend Tier-2: Application Tier-1: Web Tier-0: Network large databases data warehousing networked databases , file, print web services network services

43 Data Centre Cabling Standards TIA-942: Data Centre Cabling» captures IT, power, resilience, HVAC, security» published in 2005 CENELEC EN : Data Centre Cabling» scope is IT cabling only» approval anticipated late 2006 ISO/IEC 24764: Data Centre Cabling» based on CENELEC EN » approval anticipated in 2007

44 Data Centre vs Office Cabling Data Centre Cabling very different to Office cabling: 1. it has more external (WAN) connections than an office 2. infrastructure to be more robust/resilient than office 3. attached equipment is more static than in the office 4. it needs to support more growth/less churn than office 5. cabling to be Cat 6 minimum/office Cat 5e minimum

45 EN : Data Centre Cabling Structure ENI MD ZD LDP (optional) EO Equipment ENI network access cabling subsystem main distribution cabling subsystem zone distribution cabling subsystem equipment cabling ENI = Equipment Network Interface MD = Main Distributor ZD = Zone Distributor LDP = Local Distribution Point EO = Equipment Outlet

46 EN : Data Centre Cabling Overview Class E A min performance balanced copper channel OM2, OM3 adopted for fibre channel (OM3 recommended) duplex LC SFF connector specified for use at the ENI» telecom services require >55dB return loss for SMF duplex LC SFF connector adopted for use at the EO RJ-45 Cat 6 connector adopted for use at EO with 4 pairs RJ-45 or other Cat 7 connector for use at EO with 4 pairs

47 10GBASE-SR Channel Budget 8 7 Attenuation (db) OM1 OM2 OM3 Connector Loss 1 3.5dB/km Length (m)

48 TIA Data Centre Cabling Connectivity need to support 1/10GBE plus 1-10GB FC with 2-8 connectors non-linear power penalties & 0.75dB connector loss assumed» TIA and ISO/IEC specify 0.75dB connector loss for 100%matings» CENELEC specifies only 0.50dB connector loss for 95%matings max supportable channel length (metres) number of connectors in a channel Application Fibre Type OM BASE-SX OM OM OM GBASE-SR OM OM

49 EN : Data Centre Cabling Optical Connector Loss Budget Application Total Connector Loss Supportable (db) vs Cable Length Fibre Type 25m 50m 75m 100m 250m 500m 750m 1000BASE-SX OM OM OM BASE-LX OM OM OM GBASE-SR OM OM OM GBASE-LX4 OM OM OM

50 5. What does the future hold?

51 Desktops the next 10 years 1000BASE-T will become commonplace at the desktop cheap, low-latency switches will ease QoS requirements increased penetration of IP-based services (voice/video) increased deployment of Power over Ethernet (POE) to support VoIP, wireless, inventory management, security copper cabling will continue to dominate the horizontal supports legacy copper NICs supports POE applications lower cost than optical fibre Cat 6A vs Cat 6 screened vs Cat 6 UTP some local deployment of 54/100Meg WiFi & Zigbee PANs

52 Backbones the next 10 years increased penetration of 10Gig over fibre in corporates increased deployment of highly resilient configurations emergence of 100Gig over fibre for some applications delayed investment in fibre infrastructure due to legacy fibre applications such as 10GBASE-LRM increased deployment of singlemode fibre for future use

53 Systems the next 10 years 10GBASE-T will become commonplace in the data centre 100G Ethernet over fibre will also be used in data centres 10Gig Ethernet backplanes, then later 100Gig backplanes robustness of data centre cabling infrastructure will be a critical factor