Data Center Optical Connectivity with Bend-Optimized OM3/OM4 Multimode Optical Fiber Doug Coleman Corning Cable Systems Manager, Technology & Standards
Data Center Environment
Data Center Environment Higher speeds Higher density Higher reliability Lower capex Lower opex
Data Center Environment
10G Optical Connectivity CIR 2009 Market Report Forecast Relatively few 10GBASE-T connections will be deployed in the next five years compared with what was originally expected Emergence of a sub-1w low-cost 10G SFP+ optical transceiver will enable large volume data center optical storage and data networks. Ability of the SFP+ form factor to support short reach twinaxial copper connections will dampen the need for a 10GBASE-T solution
Data Center Environment Expect lower-cost solutions in data center networks will remain at 850 nm 850 nm 10G VCSELs entering high-volume manufacturing cycle Low-cost solution for 10G Relative Cost 3.5 3.0 2.5 2.0 1.5 1.0 0.5 10G Transceivers 850 nm optics 1300 nm optics Vertical Cavity Surface Emitting Laser 0.0 2004 2005 2006 2007 2008 2009 SFP+ OM3 100m $400 SFP+ OM3 300m $500 SFP+ SMF 10km $1000
Data Center Environment 80% 70% 60% 50% 40% 30% 20% OM3 OM2 OM1 SMF 10% 0% 2004 2005 2006 2007 2008 Source: CCS
Data Center Environment Laser-optimized 50 Micron Fiber (OM3) Core Size: 50 Micron Attenuation: 3.0/1.5 db/km @ 850/1300 nm Bandwidth: OFL: 1500/500 MHz km @ 850/1300 nm EMB: 2000 MHz km @ 850 nm
Data Center Environment TIA OM4 Standard Approved August 2009. Laser-optimized 50 Micron Fiber (OM4) Core Size: 50 Micron Attenuation: 3.0/1.5 db/km @ 850/1300 nm Bandwidth: OFL: 3500/500 MHz km @ 850/1300 nm EMB: 4700 MHz km @ 850 nm No transmission protocol utilizes the 3500 MHz-km OFL BW OFL BW utilized by fiber manufacturers who rely on DMD masks to validate the 4700 MHz-km EMB
Standard Specified Distances 850 nm Ethernet Distance (m) 1G 10G 40G 100G OM3 1000 300 100 100 OM4 1000 550 125 125 850 nm Fibre Channel Distance (m) 4G 8G 16G OM3 380 150 100 OM4 480 190 125
Bend-Optimized OM3/OM4 Multimode Fiber
Macrobending in Multimode Fibers Multimode optical fiber has many modes of light traveling through the fiber As each of these modes moves closer to the edge of the core, it is more likely to escape, especially if the fiber is bent As the bend radius is decreased, the amount of light that leaks out of the core increases Core Dissipation of energy Cladding
Bend-Optimized OM3/OM4 Multimode Fiber Technology Bend-optimized multimode fiber, which is capable of confining almost all the energy of the different modes, even in the most challenging bending scenarios Fiber utilizes a specially engineered optical trench to trap the energy in the many modes which propagate within the fiber core The energy is confined inside the fiber
Bend Performance Comparison Study compared bend performance of conventional OM3/OM4 fibers with BOMMF OM3/OM4 In all tests, BOMMF fiber performs significantly better than conventional OM3 fiber with existing macrobending specifications BOMMF OM3/OM4 is specified for use in tighter bends than all other conventional multimode fiber types Average Bend Loss [db] 2.0 1.5 1.0 0.5 0.0 Bending Performance 20x 90 Turns < 10 mm Bend Radius Typical bend performance of conventional OM3/OM4 fiber (OVD, MVCD and PVCD) Supplier A New bend performance Benchmark Supplier Supplier Supplier BOMMF B C D OM3/OM4 Tested OM3/OM4 fibre types Source: Corning study, test according to draft IEC60793-1-47
Bend-optimized OM3/OM4 fiber bend performance is a key enabler for high-density and operational margin 10 Macrobend loss 850 nm, 2 turns (db) 1 0.1 Desire d Bend Radii ClearCurve Delivers up to 10x improvement 0.01 5 7 9 11 13 15 17 19 21 23 25 Bend Radius (mm) Multimode Std IEC 60793-2-10 Multimode Std ITU G.651.1 New Level of Bend Performance Bend Radius 37.5 mm 15 mm 7.5 mm Number of Turns 100 2 2 Max Induced Attn @ 850 nm 0.5 db 1 db BOMMF Spec @ 850 nm 0.05 db 0.1 db 0.2 db
BOMMF Standards-Compliant Standards Compliance BOMMF OM4 BOMMF OM3 BOMMF OM2 ISO/IEC 11801 IEC 60793-2-10 TIA/EIA Type OM4 Fiber* Type A1a.3 Fiber* 492AAAD Type OM3 Fiber Type A1a.2 Fiber 492AAAC-A Type OM2 Fiber Type A1a.1 Fiber 492AAAB * Assumes IEC Draft Standard is harmonized with 492AAAD, which was approved by TIA.
BOMMF reduces system problems in a high-density patching area Patch cord with sharp bend or pinched in door with standard OM3: Bit Error Rate = 10-6 Link Failure with BOMMF OM3: Bit Error Rate > 10-12 Link Unaffected Tight loop in tie wraps with standard OM3: with BOMMF OM3: Bending loss > 5 db Link Failure Bending loss < 0.5 db Link Unaffected
BOMMF Optical Connectivity High Density and Fewer Raw Materials BOMMF OM3/OM4 Smaller Diameter Cables Cable with Tighter Bend Radius Reduction in Packaging Material Greater Density 4000+ Fibers Reduced Size of Components
10G Ethernet
10G Optical Connectivity Lower the Total Cost of Network Ownership Fiber optic cabling is less expensive to operate Less power consumption Decreased cooling requirements Smaller transceiver size Higher electronic port densities Fiber ~1-4 W $ 10 Gb/s Operating Cost Fiber vs. Copper Power Consumption Cooling Requirements Transceiver Size Data Center Area Copper ~6-8W $$$$
10G Optical Connectivity: Higher-Density Electronics 10G transceiver trends Move signal processing from module to the line card Reduce module size Reduce power Reduce price Source: CMP Media XFP XENPAK X2 SFP+ Source: Intel Duplex LC Connector
10G Optical Connectivity : Copper 10GBASE-T Power Issues Significant switch power requirements 10G copper 6 to 8 watts per port Major silicon chip development required to reduce power Expect 3 to 4 watts to be lowest achievable power level per port independent of distance 10G optical switches 1 to 4 watts per port Typical SFP+ 0.5 watts 1000BASE-T PHY
Yearly Energy Cost 10GBASE-S Optical Connectivity Compared to Copper 10GBASE-T Power Requirements $80,000 $70,000 $60,000 $50,000 $40,000 $30,000 $20,000 $10,000 76% Total Electronics and Cooling Energy Cost and Savings Comparison for 10GBASE-SR and 10GBASE-T 82% 84% 84% 85% 86% 87% 85% 83% 81% 79% 77% 75% 73% 71% Energy Savings Copper Switch Fiber Switch % Energy Reduction $0 69% 48 96 144 192 240 288 Port Count OPTICAL CONNECTIVITY Enables The Green Data Center!
Legacy Data Center Architecture: EDGE Switch Consolidation into MDA
Emerging Data Center Architecture Top of Rack EDGE Switch
Fibre Channel and FCoE
Fibre Channel Speed Roadmap Base 2 Product Naming Throughout (MBps) Line Rate (Gbaud) T11 Spec Technology Completed (Year) Market Availability (Year) 1GFC 200 1.0625 1996 1997 2GFC 400 2.125 2000 2001 4GFC 800 4.25 2003 2005 8GFC 1600 8.5 2006 2008 Parallel Optics 16FC 3200 14.025 2009 2011 32GFC 6400 28.5 2012 64GFC 12800 57 2016 128GFC 25600 114 2020 Market Demand Market Demand Market Demand
FCoE Converging Protocols in the Data Center What s Changing? Industry looking to move to a single, unified fabric Ethernet offers low cost and is the decided approach, which means encapsulating Fibre Channel into an Ethernet frame (FCoE)
FCoE Physical Layer Recommendations 2009 2010 10GbE Physical Protocol Ethernet Logical Protocol Optical connectivity: IEEE 802.3 10gb/s serial (<=100m MM OM3 recommended to new installs for compatibility with 40/100gE and 16/32GFC) Copper connectivity: SFP+ copper definition for external copper connection (10GBase10-KX4/KR internal backplanes and blades) Connector for optics and copper: SFP+ 802.3X Link Level Flow Control and Baby Jumbo Frames DCB (Data Center Bridging): IEEE 802.1Qaz Enhanced Transmission Selection (aka Priority Groups) IEEE 802.1Qbb Priority-based Flow Control DCBX (DCB Capability Discovery and Exchange Protocol) Source: FCIA FC INCITS T11.3 BB-5 Logical FCoE Frame Format Protocol 10GBASE-T FCoE not Initialization included Protocol due (FIP) to power and latency issues Server PCIe 2.0
FCoE Converged Network Converged network adapter (CNA) Lossless Ethernet Reduced I/0 cabling Reduced power/cooling power Reduced CO 2 More efficient cooling
Typical Data Center Architecture Today
FCoE Data Center Architecture - Available Now 1,000 Server Environment Eliminates 6,000 ft and 276 lbs Copper Cable
Fibre Channel Speed Roadmap Product Naming Throughout (MBps) Equivalent Line Rate (Gbaud) T11 Spec Technology Completed (Year) Market Availability (Year) FCoE 10GFCoE 2400 10.3125 2008 2009 40GFCoE 9600 41.225 TBD 100GFCoE 24000 103.125 TBD Market Demand Market Demand
40/100G Ethernet
What s Next? Ethernet IEEE 802.3 approved motions 40 and 100 Gbps At least 100 m on OM3 multimode fiber At least 125 m on OM4 multimode fiber At least 10 km on single-mode fiber At least 40 km on single-mode fiber (100G only) At least 7 m on copper cable assembly Key project dates Study group formed in July 2006 Project authorization in December 2007 Task force formed in January 2008 40/100G standard complete mid-2010
40G Ethernet Parallel Optics: OM3/OM4 12F MTP Interface
40G Optical Transceiver: OM3/OM4 QSFP Transceiver technology Standard 12F MTP Connector =< 3 watts per port Now used for 40G InfiniBand Source: Zarlink
40G Optical Connectivity: OM3/OM4 8 cards per chassis 16 ports per card 192 fibers per card 1536 fibers per chassis 8 cards per chassis 32 ports per card 384 fibers per card 3072 fibers per chassis QSFP Transceiver 12F MTP Pinless Connector Key-up interface
100G Ethernet Parallel Optics: OM3/OM4 24F MTP Interface Source: USConec
100G Optical Transceiver: OM3/OM4 CXP Transceiver technology Standard 24F MTP Connector =< 3 watts per port Development in process IBTA 120G Source: Molex 24F MTP Pinless Connector
100G Optical Connectivity: OM3/OM4 8 cards per chassis 16 ports per card 384 fibers per card 3072 fibers per chassis CXP Transceiver 24F MTP Pinless Connector Key-Up interface
40/100G Data Center Architecture Top of Rack EDGE Switch 40G: 48F OM3/OM4 Uplink 100G: 96F OM3/OM4 Uplink
40/100G Optical Transceiver: SMF CFP Transceiver technology Standard duplex LC Connectors =< 20 watts per port 3-4 ports per card Large Footprint Equivalent to two 10G XENPAKs Development in process CFP MSA Duplex LC Connector Source: CFP MSA
40G Electronics/Physical Layer Economics: 32 Ports 40G SMF Price Relative to OM3 8.00 6.00 4.00 2.00 40G Initial 40G Mature 0.00 50 60 70 80 90 100 Distance (m)
100G Electronics/Physical Layer Economics: 32 Ports 100G SMF Price Relative to OM3 20.00 15.00 10.00 5.00 100G Initial 100G Mature 0.00 50 60 70 80 90 100 Distance (m)
Data Center Cabling and Hardware with Bend-Optimized OM3/OM4 Fiber
BOMMF Optical Connectivity High Density and Less Raw Materials BOMMF OM3/OM4 Smaller Diameter Cables Cable with Tighter Bend Radius Reduction in Packaging Material Greater Density 4000+ Fibers Reduced Size of Components
TIA-942 Data Center Physical Topology Storage Equipment SAN Directors Servers Core Routers / Switches
MTP Trunk Cable Compact, high fiber count: 12 to 144 fibers (4.4 mm 11.5 mm O.D.) minimizing space in cable tray Flexible, easy to handle - tight bend radius 5x O.D. Plenum-rated for air-handling spaces Factory terminated and tested with 12-fiber MTP low-loss connectors for rapid installation and high performance 96-fiber trunk 12-fiber MTP Connector
Density: Smaller trunk diameter allows greater cable tray fill Need Trunks Key Value Areas Smaller cable size 16%-32% cable diameter reduction 12 x 6 Cable Tray Traditional New 50% space savings $15k-$20k saved for every 1000 ft of cable tray installed
Today 10GE Electronics' Fiber Density Significantly Increasing 40/100G Scaling Impact Fiber Count and Connector 21 RU 256 x 10GE ports 2-fiber LC connector 512 to 1,024 fibers per chassis 40GE 128 x 40GE ports 12-fiber MTP connector 1,536 to 3,072 fibers per chassis 100GE 128 x 100GE ports 24-fiber MTP connector 3,072 fibers per chassis
Scalability and Interchangeability Migration from 10G serial to 40G and 100G Parallel Optics Fiber Type No. fibers Max. link length, m Max. Channel insertion loss, db Connector type Skew, ns 10 GbE OM3 2 300 2.6 LC 40 GbE OM3 8 100 1.9 12f MTP 79 100 GbE OM3 OM4 20 100 125 1.9 24f MTP 79 Patch cord MTP pair Trunk Patch cord Trunk MTP pair MTP pair MTP pair Patch cord Tx/R x Tx/R x 0.35 db Fiber loss 0.35 db Fiber loss 0.35 db 0.35 db Maximum link length: 100m OM3; 125m OM4 Low-Loss MTP connectors allow for one cross-connect with 40/100G systems, e.g. EDA to MDA to EDA
Scalability and Interchangeability Interchangeable termination housing components 12-fiber module: 12-fiber MTP to 6 Duplex LCs... 10G ports MTP adapter panel: 12-fiber MTP to 12-fiber MTP... 40G ports 12F MTP 12F MTP 40G Port 12F MTP 40G Port 12F MTP
Scalability and Interchangeability Interchangeable termination housing components 12-fiber module: 12-fiber MTP to 6 Duplex LCs 10G ports MTP adapter panel: 2 x 12-fiber MTP to 24-fiber MTP... 100G ports using Y-cable 12F MTP 12F MTP 100G Port 24F MTP
Scalability and Interchangeability Interchangeable termination housing components 12-fiber module: 12-fiber MTP to 6 Duplex LCs... 10G ports MTP adapter panel: 24-fiber MTP to 24-fiber MTP... 100G ports 24F MTP 24F MTP 100G Port 24F MTP 100G Port 24F MTP
Scalability and Interchangeability: 10G LC modules independently changed out for 40G and/or 100G MTP panels Duplex LC 10G ports 12f Duplex MTP LC 40G 10G ports and/or + 12f 24f MTP MTP 40G 100G ports ports
Density: 4U termination housings designed for high capacity, easy access and management Designed for high density connectivity HDA and MDA 48 easy-access module/panel slots Patchcord management Integrated trunk cable strain relief Deeper housing for high trunk capacity 4U housing 10G ports 2-fiber Duplex LC 40G ports 12-fiber MTP 100G ports 2 x 12-fiber MTPs 100G ports 24-fiber MTP Circuit capacity 288 192 96 192 Fiber capacity 576 2,304 2,304 4,608
Density: 1U termination housings designed for topof-rack deployment Designed for high-density connectivity server/storage access 8 easy-access module/panel slots Patch cord management Integrated trunk cable strain relief Slide out, 30 tilting tray 1U housing 10G ports 2-fiber Duplex LC 40G ports 12-fiber MTP 100G ports 2 x 12-fiber MTPs 100G ports 24-fiber MTP Circuit capacity 48 32 16 32 Fiber capacity 96 384 384 768
Density: Uniboot patch cords reduce cable bulk in patching areas by half BOMMF are contained in one 2 mm cable Doubled 4U housing port density with no increase in cable bulk Round cable is easier to manage than zipcord
Equipment Harnesses 256 x 10G ports 512 Fibers 12-fiber MTP to 6 duplex LCs Staggered LC legs tailored for equipment ports Reduces patch cord bulk and congestion Improves access to switch ports and blades Improves airflow Easier, quicker hook-up
Equipment Harnesses with harnesses with duplex patch cords
Equipment Harnesses Dense Connectivity Requirements 384 ports 768 fibers
Reduction in Cabling Bulk Cabling comparsion for one half of a Cisco Nexus 7010 (4 x 32-port blades) 128 duplex patch cords 256 connectors to plug in 24 harnesses 152 connectors to plug in
Contact Info Doug Coleman E-mail: doug.coleman@corning.com Phone: 828-901-5580 Fax: 828-901-5488 Address: 800 17th Street NW Hickory, NC 28601