How to Decide on Optical Fibre Termination Options Thomas Ko, RCDD Product Manager Tyco Electronics / AMP NetConnect
Termination Choices Optical Fiber Cabling in Data Center Options available Traditional Field Termination Factory Pre-terminated Trunk Cables Simplex or Duplex Connectors MPO Array Connectors
Common Fiber Connectors ST-Style Connector Simplex connector, push-and-twist SC Duplex Connector Duplex connector, push-pull LC Connector Simplex/Duplex, RJ-style latch MPO Array Connector, push-pull Up to 72 fiber cores
TIA-568-C.3 Connector Standards Connector choice Customer preference 2 Conditions Must meet FOCIS (Fiber Connector Intermateability Standard) Connector dimensions and tolerances Must comply with TIA-568-C.3 Annex A - Optical Fiber Connector Performance Specifications Insertion loss, return loss, mechanical performance and environmental performance ISO/IEC-11801 SC Duplex at the Telecommunications Outlets
FOCIS Reference Connector Type FOCIS Document ST-Style TIA/EIA-604-2A (FOCIS 2) SC and SC Duplex TIA/EIA-604-3 (FOCIS 3) MPO/MTP TIA/EIA-604-5 (FOCIS 5) LC and LC Duplex TIA/EIA-604-10 (FOCIS 10) MT-RJ TIA/EIA-604-12 (FOCIS 12)
Field Termination Termination Types Connectorise distribution cables ST, SC, LC Factory Termination Mass production in controlled environment Patch cords, pre-terminated trunk cables ST, SC, LC and MPO Combination Splice factory terminated pigtails on site
Field Termination Comparison No-epoxy/ No-polish No Epoxy/ Polish Epoxy/ Polish Setup & Takedown time (each location) ~10 minutes ~20 Minutes ~24 Minutes Installation Time ~5 minutes ~10 minutes ~9 minutes (Quick Cure) ~13 minutes (Heat Cure) Connector Cost (relative) High Moderate Low Installation Labour Cost (relative) Low Moderate High Tool Kit Cost (relative) Low Moderate High Skill Level (relative) Low Moderate High Training (relative) Short Moderate High
Trends in Data Center Non-stop Operation Speed is everything 10G now 40G/100GbE by 2010 Scalability Virtualisation Consolidation Green
Cabling For Data Center DC Cabling Standards TIA 942 Telecommunications Infrastructure Standard, April 2005 Substantial, available, American EN 50173-5 Information technology Data Centers Smaller scope, European perspective ISO/IEC Draft 24764 Information technology Global Generic Cabling for Data Centers
Hierarchical Structure of Data Center Office, NOC, Support Center Access Providers Entrance Room Access Providers Telecom Room Main Distribution Area Red lines represent backbone cabling Horizontal Distribution Area Horizontal Distribution Area Horizontal Distribution Area Blue lines represent horizontal cabling Zone Dist Area Equip Dist Area Equip Dist Area Equip Dist Area Data Center - - -
Cabling infrastructure - Fiber Use in DC In Traditional DC solution, Fiber being used in Backbone Copper to connect the server New trend is to take fiber near to the end devices like servers due to Multimode supporting up to 10Gbps Future 40Gbps/100Gbps are Multimode Fiber over copper is no longer a cost consideration due to error free transmission, headroom and performance criteria.
Ethernet Evolution 1990 2000 2006 2012 100 Mbps 1.000 Mbps 10.000 Mbps 100.000 Mbps 10 Mbps 100 Mbps 1.000 Mbps 10.000 Mbps
2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 millions server units x86 Servers by Connection Speed 30 Source: Intel & Broadcom (April 2007) 25 20 15 10 5 0 100M 1G 10G 40G 100G 10 year transition for 1G Ethernet 6 years for 10GBE 5 years for 40GBE
2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 millions server units What it Means for Data Center? 10G Backbone fiber is prevalent now Two-core system 40G/100G on Multimode fiber is next Parallel Transmission 8-Cores for 40G 20-Cores for 100G Much higher Fiber Utilisation 30 25 20 15 10 5 0 100M 1G 10G 40G 100G
Fiber Cabling in Data Center Backbone cabling Horizontal Cabling over 100m SAN
Fiber Cabling in Data Center
Question 1: How many fiber cores? Question 2: What are the Options? Question 3: How long would it take to install?
Rack Servers 35 Servers with: 2X10GBE Ethernet 2X10G Fibre Channel 2 Ethernet switch with 3 X 40G Uplinks 2 Fibre Channel Switch with 3 X 40G Uplinks Total I/O: 6 X 40G Primary 6 X 40G Redundant
Blade Servers 5 Blade Server cabinets with: 2X100GBE Ethernet Total I/O: 5 X 100G Primary 5 X 100G Redundant
Fiber Cores for Each Server Rack Rack Server No of Cores/ Channel Total Cores/ Rack 6 X 40G Primary 8 48 6 X 40G Redundant 8 48 Total Cores 96 Blade Server No of Cores/ Channel Total Cores/ Rack 5 x 100G Primary 20 100 5 x 100G Redundant 20 100 Total Cores 200
Termination Options -1 Field Install Deliver materials to site bulk cable, connectors, curing oven, tools, consumables Pull optical fiber cable on-site Apply Simplex/Duplex connectors Strip, Crimp, Cleave, Polish Manage cable Clean, Inspect and Test Labelling and Admin
Advantages Termination Option - 1 Trunk cables exact lengths Lower connector cost Disadvantages Mess in data center Long termination time Inconsistent performance More time spent on-site
Termination Option 2 (simplex/duplex connectors) Off-Site Fabrication Cable Assembly Measure cable lengths from plan Setup trunk cable production in Installer s workshop Make cable assemblies by hand polish Clean, Inspect and Test Cable Labelling Pack and deliver to site Unpack and Install on-site Clean, Inspect and Test Labelling and Admin
Advantages Termination Option - 2 Less time on-site Less mess on-site Disadvantages Not exact lengths of trunk cables Protect multiple connectors during delivery/installation Inconsistent performance
Termination Options 3 (simplex/duplex connectors) Factory Pre-Terminated Cable Assembly Measure cable lengths from plan Issue cable assembly order to Vendor Wait for delivery from Vendor Unpack and Install on-site Clean, Inspect and Test Labelling and Admin
Termination Option - 3 Advantages Out-source assembly labour component Test reports from Vendor Factory Terminated / machine polish - Consistent performance Less time on-site Less labour on-site Factory Tested Disadvantages Waiting Not exact lengths of trunk cables
Termination Options 4 (MPO connector) Factory Pre-Terminate MPO Cable Assembly Measure cable lengths from plan Issue cable assembly order to Vendor Wait for delivery from Vendor Unpack and Install on-site Clean, Inspect and Test Labelling and Admin
Termination Options - 4 Advantages Out-source assembly labour component 1-click installation High density Test reports from Vendor Less time on-site Less labour on-site Factory Tested Disadvantages Waiting Not exact lengths of trunk cables
One Click MPO Installation
Pre-terminated, Modular Assemblies Patch Cords Cassette 12 / 24-fiber Truck Cable Cassette Patch Cords PLACE and PLUG trunk cable no field termination!
MPO System Primarily used in backbone and trunk applications Place & Plug System 12-144 fiber assemblies: 50/125µm, LOF 50/125µm (OM3), 62.5/125µm, Singlemode 10 Gbps+ Performance Pre-Terminated and factory tested 96 fibers achievable on 1U
MPO Plug&Go Fiber Optic System Standard Patchcord MPO cassette Multi-Fiber trunk MPO cassette Standard Patchcord ST SC MT-RJ LC
Recap No-epoxy/ No-polish No Epoxy/ Polish Epoxy/ Polish Setup & Takedown time (each location) ~10 minutes ~20 Minutes ~24 Minutes Installation Time ~5 minutes ~10 minutes ~9 minutes (Quick Cure) ~13 minutes (Heat Cure) Connector Cost (relative) High Moderate Low Installation Labour Cost (relative) Low Moderate High Tool Kit Cost (relative) Low Moderate High Skill Level (relative) Low Moderate High Training (relative) Short Moderate High
Cabling in Data Centers Installation time based on 1 Rack No-Epoxy/No Polish Connector 200 terminations = 17 Hours (@ 5 minutes each) Pre-terminated Cable Assembly 200 insertions = 1.5 hours (@ 30 sec/insertion) Pre-Terminated MPO System 20 connections = 10 minutes (@30 sec/insertion)
Main factors Labour Installed Costs Training / Experience hours On-the-job hours Material Costs Connectors Tools Consumables
Choice? Depends on the following Type of job Locations Number of terminations Skill level Tools available Schedule
Comparison Field Install Labour Intensive Wastes in Data Center Time - long Inconsistent performance Factory Terminated Fast installation Consistent Performance
Next Generation Ethernet IEEE 802.3ba High Speed Ethernet To be completed by June 2010
IEEE 802.3ba 40G/100G Provide Physical Layer specifications which support 40 Gb/s over: at least 10km on SMF at least 100m on OM3 MMF at least 7m over a copper cable assembly at least 1m over a backplane Provide Physical Layer specifications which support 100 Gb/s over: at least 40km on SMF at least 10km on SMF (note: will be CWDM) at least 100m on OM3 MMF at least 7m over a copper cable assembly Timeline shows publication in June 2010
IEEE 802.3ba Multimode solutions will be parallel 4 TX and 4 RX for 40G 10 TX and 10 RX for 100G 1 Options for 40 Gb/s 1 MPO NOTE: all views are looking into transceiver
IEEE 802.3ba Multimode solutions will be parallel 4 TX and 4 RX for 40G 10 TX and 10 RX for 100G Rx Tx 3 Options for 100G 1 MPO (preferred) 2 MPO top and bottom 2 MPO side by side All use the 10 center fibers Tx Rx Tx Rx NOTE: all views are looking into transceiver
MPO channel can be future-proof SFP SFP From server switch to QSF P QSF P
Cost Comparison Based on Fall 2006 BICSI Conference Disclaimer The material referenced on the following slides is for comparison purposes only and not for budgetary purposes. Actual costs may differ and may depend on project size, location or purchasing practice as well as other variables.
Fiber Data Center Input (Constant) Number of Ports 480 (960 fibers) Number of Locations (ends) 5 Average Length Bulk fiber cable, adapter plates, and assembly prices Installer Experience 60 meters Market for XG Intermediate Number of Technicians 2 Number of Tool Kits and Test Kits 1 tool kit, 2 test kits
Fiber Data Center - Relative Total Cost 180% 160% 140% 120% 100% 80% 60% 40% 20% 0% Pre-t erminat ed SC E/ P LC QC E/ P MT-RJ NE/ NP Source: Is Pre-terminated Prudent for Your Project?, Herb Congdon (BISCI Conference, Fall 2006)
Additional Man-days Fiber Data Center - Baseline Time Differential 14.0 12.0 10.0 8.0 6.0 4.0 2.0 0.0 Pre-t erminat ed SC E/ P LC QC E/ P MT-RJ NE/ NP Source: Is Pre-terminated Prudent for Your Project?, Herb Congdon (BISCI Conference, Fall 2006)
Fiber Data Center Scenario - Summary Pre-terminated solutions Reduced installed cost by ~10% compared to epoxy/polish ~15% cost premium over no-epoxy/no-polish Reduced installation time by ~10 days compared to epoxy/polish Reduced installation time by ~2 days compared to noepoxy/no-polish Source: Is Pre-terminated Prudent for Your Project?, Herb Congdon (BISCI Conference, Fall 2006)
Cable Mangement Implication Cables should be placed in pathways adhering to recommended fill rates BICSI recommends 60% maximum fill for cable tray Cable trays should be sized to accommodate growth or change if necessary Separation should be in place to accommodate media or change. Many data centers used tiered cable trays: Top tray - Most accessed cables Lower tray (s) Fixed / Permanent cabling Plan pathways to accommodate media OD and weight for structure
Thank You