BICSI Breakfast Club Emerging Technologies in Data Centers and Outside Plant Applications Warren Hicks Mgr, Marketing Strategy and Development July 24, 2007
Presentation Format Part I Data Center Part II Outside Plant 2
Data Centers Technology Roadmap
Data Center Topics Ethernet and Fiber Channel Roadmap Optical fiber trends 10 Gigabit Speeds in the Data Center Nomenclature 10G copper and fiber; Just the Facts Emerging Technologies Parallel Optics Infiniband 4
Standards have evolved to meet increasing bandwidth requirements with cost effective solutions Data rate (Gb/s) 100000 10000 1000 100 10 1 Below 10 Gb/s, application standards used then-current multimode fibers to design network solutions 10M Ethernet Token Ring FDDI 1985 Standards Roadmap 100M Fast Ethernet ATM 1995 1999 2002 10Gb/s required new fiber specifications and measurement methods LEDs 1G GbE Fibre Channel Lasers 2G FC 10G 10 GbE Sonet/SDH InfiniBand 4G FC 8G FC We expect next step in data rates to primarily use current fiber specifications 2005 2010 100G IEEE 5
Optical Trends in Premises Networks Data Center Fiber Trends 70% 60% 50% 40% 30% 20% 10% OM3 OM2 OM1 SMF LO 50um Std 50um 62.5um 0% 2004 2005 2006 6
Optical Trends in Premises Networks We expect lower-cost solutions in premises networks will remain at 850 nm 850 nm VCSELs have won the 1G premises market 3.5 10G Transceivers 850 nm VCSELs just entering high-volume manufacturing cycle Will continue to be lowcost solution for 10G 1300 nm solutions will capture some market share in premises with legacy systems and EDC technology (10GBASE-LRM) Relative Cost 3.0 2.5 2.0 1.5 1.0 0.5 0.0 850 nm optics 1300 nm optics 2004 2005 2006 2007 2008 2009 7
Optical Trends in Premises Networks Demand for higher bandwidth at lower cost is driving increase in 50 micron demand, particularly OM3 65% 65% 60% 60% Multimode Fiber Market Demand 55% 50% 45% 40% 35% 50 62.5 50micron Market Demand 55% 50% 45% 40% 35% OM3 OM2 30% Jan-05 Jul-05 Jan-06 Jul-06 Jan-07 Jul-07 Jan-08 Time 30% Jan-05Jul-05 Jan-06Jul-06Jan-07Jul-07Jan-08 Time Source: Burroughs report 8
Pretium 300 Solutions Laser-Optimized 50 µm Fiber (OM3) Core Size: 50 µm Attenuation: Bandwidth: 3.0/1.5 db/km @ 850/1300 nm OFL 1500/500 MHz km @ 850/1300 nm EMBc 2000 MHz km @ 850 nm Distance: Gigabit Ethernet 1000/600 meters @ 850/1300 nm Serial 10 Gigabit Ethernet: 300 meters @ 850 nm CWDM 10 Gigabit Ethernet: 300 meters @ 1300 nm 9
Pretium 550 Solutions Laser-Optimized 50 µm Fiber Core Size: Attenuation: 50 µm (OM3+) 3.0/1.5 db/km @ 850/1300 nm Bandwidth: EMBc 4700 MHz km @ 850 nm Distance: Gigabit Ethernet 1000/600 meters @ 850/1300 nm Serial 10 Gigabit Ethernet: 550 meters @ 850 nm 10
10 Gigabit Ethernet Nomenclature and Definitions 10GBASE-S - Multimode fiber, serial transmission at 850 nm - Lowest cost for new installs (=<300/550 m) - Data centers and building/campus backbones 10GBASE-LX4 - Multimode or single-mode fiber, WWDM transmission in the 1300 nm region - MMF solution intended for legacy systems 10GBASE-L - Single-mode fiber, serial transmission at 1300 nm - Campus backbones 10GBASE-E - Single-mode fiber, serial transmission at 1550 nm - Metro area networks 11
10 Gigabit Ethernet Nomenclature and Definitions 10GBASE-CX4 Twinaxial Coax cable (15m) 10GBASE-LRM Completed - Multimode fiber, EDC, FDDI fiber, 1300 nm, 220 m (legacy fiber) - 220 m distance does not address 30% intrabuilding installations 12
10G Copper vs Fiber: Just the Facts 13
10GBASE-T Standard (10G on Twisted Pair Copper) IEEE 802.3an 10GBASE-T 10G Standard 100m CAT6A UTP 100m CAT7 STP 55m or 37m CAT6 UTP 2.5 Gb/s per twisted pair across 500 MHz frequency range Cable is not 100% tested when manufactured (sampling used) Augmented Category 6 (to be 568-B.2 Add10) TIA Cable Standard Optimistically looking at late 2007 for publication Commercial offering now considered proprietary solutions Not TIA-568 and TIA-942 compliant 14
FACT: No Transmission Equipment is Available 10GBASE-T capable switches are not commercially available Optimistically, 10GBASE-T capable equipment won t be available from Cisco until sometime in the second half of 2008 The only copper based equipment available today for copper is 10GBASE-CX4 Twin axial Coax cable. Distance limitation is 15 meters 15
FACT:10GBASE-T Presents Density and Heat Issues Significant switch and server adapter card power requirements 10G copper requires 10-15 watts per port 60W allocated per card Reduced switch port density Projected 4-8 ports per 10G copper card Max.100m distance 10G optical switch X2 transceiver: Max 4 watts per port (or 16 ports per card) XFP transceiver: Max 2.5 watts per port (or 36 ports per card) SFP+ transceiver: Max 1.0 watt per port (or 48 ports per card) 10G copper 25-30 watts per server adapter card 30m service distance 10G optical <9 watts per server adapter card 300m service distance Heat dissipation 16
FACT: 10GBASE-T Presents Transmission Issues Transmission Issues Complex digital signal processing (DSP) required for internal noise cancellation Latency Issue 10G optical typical PHY latency in the nanosecond range (10-9 sec.) where 10G copper has PHY latency in milliseconds (10-3 sec.) A one-millisecond advantage in trading applications can be worth $100 million a year to a major brokerage firm, Information Week, April 2007 Sun Microsystems states PHY latency should next exceed 1 microsecond. May start effecting Ethernet over TCP/IP application performance in the foreseeable future Susceptible to external noise such as alien cross-talk and EMI Cannot be corrected with electronics due to random nature No 100G Migration Path Over Required Distances OM3 included in IEEE 100G PAR Minimum 100m distance 17
FACT: 10GBASE-T Presents Pathway & Space Issues Larger Cable OD and heavier 108 circuits at 200ft CAT6A, 108 cables, 1000lbs, typical effective diameter 5.0 216F optical cable, 40 lbs, effective diameter 0.76 48 Cables vs (1) 96-fiber cable 18
FACT: 10GBASE-T Presents Pathway & Space Issues Cannot bundle with lower Category copper cables Alien Cross-Talk Reduced Patch Panel Density Typical 50% reduction Inhibits raised floor cooling efficiency Air flow obstruction Interferes with ventilation system to remove dust and dirt 19
FACT: 10GBASE-T Presents Install & Testing Issues 10-20% Contractor Labor Premium Larger, heavier cable 25lb tensile rating, No tight bends Difficult to Terminate, Jacket Removal, Pair Untwisting Larger plugs and jacks Testing More Complex and Time Consuming 500 MHz (expensive new equipment) Alien Cross Talk» 17 minutes to perform a single alien crosstalk measurement. Fiber tests only one parameter - Attenuation 20
Emerging Technologies 100G Ethernet IEEE 802.3 HSSG Approved Motions (November 2006) 100 Gbps At least 100 m on OM3 MMF At least 10 km on SMF Key project dates Study group formed in July 2006 Project authorization anticipated in September 2007 Task force formed in November 2007 100G standard complete in November 2009 21
Emerging Technologies 100G Ethernet Several possible solutions are all currently being discussed in IEEE Parallel Ribbon Cable CWDM DSP Hybrid 22
100G Circuit Price Comparison Between OM3 and SMF Relative 100G Circuit Price 2.50 2.00 1.50 1.00 0.50 0.00 100G Circuit Relative Price (point to point architecture) OM3 144F, SDM 10x10 OM3 144F, SDM,cWDM 2x5x10 OS2 12F, cwdm 10x10 OS2 24F, cwdm, 10x10 10 30 50 70 90 110 130 150 Distance (m) 23
Emerging Technologies Data Center Predominant Protocols used in Data Center Ethernet used for LAN connectivity FC used to manage applications and data on SANs 24
Emerging Technologies InfiniBand Architecture: Server Area Network (HPC) 25
Emerging Technologies Why InfiniBand in the Data Center? Application Designed to simplify and speed server-to-server connections and links to other server-related systems, such as remote storage and networking devices Server clusters Facilitate use of low-cost servers Potential single fabric protocol Reliable transmission Virtualization Media types Optical fiber Twinaxial copper cable Consolidate many wires to a single connection 26
Emerging Technologies InfiniBand Parallel Optics Source: IB Standard 4X-SDR,DDR or QDR 27
Emerging Technologies InfiniBand Parallel Optics 8X-SDR, DDR or QDR Source: IB Standard 28
Emerging Technologies InfiniBand Parallel Optics 12X-SDR, DDR or QDR Source: IB Standard 29
Data Center - Key Take-Aways The time for fiber is now The value proposition for fiber between the distribution switch and the server is compelling Transmission equipment doesn t exist for 10GBASE-T When it arrives, port density much lower than fiber 4 8 ports per blade compared to 24 48 ports per blade Signal quality susceptible to cross talk System latency is higher than fiber High power requirements results in higher generated heat, contributing to higher cooling needs Installation and testing is more complex and time consuming than fiber installation and testing. Contractors charge a premium for ANEXT testing No migration path to speeds beyond 10G 30
Data Center - Key Take-Aways Parallel optics is required for Infiniband, 100Gbe and FC above 16G 12-Fiber array connectivity will future proof your data center for the future Kevin Kettler, Dell Chief Technology Officer, stated in Electronic Engineering Times, June 26, 2006: instead of a wholesale transition to 10G over copper, the networking Industry may well segue into optical fibre. The next speed is 100GigE and copper will not work over required distances at those data rates." 31
Outside Plant Emerging Technologies
Outside Plant Topics Typical Installation Methods Verizon FTTx project New technologies driven by necessity Value propositions 33
Cable Installation Techniques Outside plant (Interbuilding) Duct Aerial Direct buried 34
Cable Selection Considerations Duct All Dielectric, Dry waterblocked, Gel-Free Loose Tube Cable Aerial All Dielectric, Dry waterblocked, Gel-Free Loose Tube Cable Self-Supporting Figure-8, Dry water-blocked, Gel- Free Loose Tube Cable ADSS (All Dielectric Self- Supporting) Dry waterblocked, Gel-Free Loose Tube Cable 35
Cable Selection Considerations Direct-Buried Corrugated steel or aluminum armored, Dry water-blocked, Gel- Free Loose Tube Cable Interlocking armored, Dry water-blocked, Gel- Free Loose Tube Cable 36
Four General Placement Considerations Monitor Tension Maintain Minimum Bend Radius Protect Exposed Cable Ensure Sufficient Slack 37
Monitor Tension Corning 38
Four General Placement Considerations Monitor Tension Maintain Minimum Bend Radius Protect Exposed Cable Ensure Sufficient Slack 39
Maintain Minimum Bend Radius Corning 40
Pulling Cable Photos courtesy of Condux, Inc. Underground Fiber Optic Cable Sheave Horizontal Sheave Mounting Stand Vertical Sheave Mounting Stand 45º Angle Sheave Mounting Stand 41
Four General Placement Considerations Monitor Tension Maintain Minimum Bend Radius Protect Exposed Cable Ensure Sufficient Slack 42
Protect Exposed Cable Corning 43
Four General Placement Considerations Monitor Tension Maintain Minimum Bend Radius Protect Exposed Cable Ensure Sufficient Slack 44
General Placement Considerations Slack Splicing and Termination Termination Relocation Mistakes Cable Damage 45
Duct Splice Points Corning 46
Aerial Splice Points (While Splicing) Corning 47
Direct Buried Splice Point Corning 48
Verizon FTTx Verizon and other companies are competing to provide Triple Play services to homeowners Data Voice Video Verizon has invested in installing a fiber optic infrastructure to support the bandwidth requirements of Triple Play In order to be competitive, they had to find ways to reduce the cost, improve speed of deployment, and make connecting homes quick and easy Private enterprises have similar needs and issues when deploying campus networks The solution?...pre-terminated Outside Plant Systems 49
What does a pre-terminated outside plant system look like? System Component Terminology 2 3 1 4 4 OSP Components: 1. 1 Distribution Trunk Cable 2. 2 Tether Attachment Point (TAP) 3. 3 Tether Assembly 4. 4 Harness Assembly (plus Multiport Option) 5. 5 Hardware 5 50
System Components Trunk Cable 1 Distribution Trunk Cable SM Dielectric LT Cable SM Figure-8 LT Cable 51
System Components TAP 2 Tether Attachment Point (TAP) SM single-tether TAP SM dual-tether TAP 52
System Components Tether Assembly 3 Tether Assembly Pinless Hardened MT SM 5 tether 53
System Components Harness Assembly 4 Harness Assembly SM Hardened-MT to MTP, LC, SC, or ST Pinned Hardened MT 54
PnP OSP Components Hardware 5 55
Pre-terminated Outside Plant Applications Aerial Duct Direct Buried 56
Pre-terminated Outside Plant Applications Campus Networks Campus Networks: Any OSP network where there are numerous (more than two) splice points. Designed like standard OSP network. 57
Pre-terminated Outside Plant Applications Local Area Networks (LANs) PnP OSP Access Point Harness Assembly 58
Pre-terminated Outside Plant Applications Security Networks MC building Security Networks: Any OSP network where there are numerous (more than two) splice points. Designed like standard OSP network. 59
Pre-terminated Outside Plant Applications ITS Networks TCC Traffic Control Cabinet PnP OSP Access Point Harness Assembly 60
What is the value of Pre-terminated OSP? Risk Avoidance Built in controlled environment of ISO/TL9000 certified factory Reduction in field reworks due to broken fibers or bad splices Reduction of long term failure rate Deployment Velocity Complete installations in half the time of traditional installations Can connect buildings at a rate 3 to 4 times faster than traditional field practices Capital Avoidance Reduction in capital equipment required Splice trucks Tool Kits Fusion Splice Machines Workforce Efficiency Deploy skilled labor more efficiently Deploy more drop points with the same labor force 61
What is the value of PnP OSP vs. Standard Cabling? Standard Distribution Installation X X X 1. Install Cable = 2 hours (4 man-hours) 2. Access & Splice = 3 hours per handhole (9 man-hours) 3. Connecting = 1 hour per handhole (3 man-hours) Total Standard Installation Time = 14 hours Pre-term OSP Installation 1. Install Cable = 2 hours (4 man-hours) 2. Connecting = 15 minutes per handhole (0.75 man-hours) Total Installation Time = 2:45 hours 62
Outside Plant Key Take-Aways OSP installation deployments Aerial Duct Direct Buried Installation Considerations Proper cable selection Monitor tension, bend radius, protect cable, provide slack Pre-terminated Outside Plant Distribution Cable Increases end user control over key value measurements: Workforce Efficiency Deployment Velocity Risk Reduction Capital Avoidance Improves the OSP business case due to more efficient deployment in the Campus network 63