Fiber Optic Cabling Systems for High Performance Applications BICSI Conference Bangkok, Thailand 17-18 November 2016 Nicholas Yeo, RCDD/NTS/DCDC
Data Center Trends Computing evolution Cloud computing Servers evolution Server virtualization, Blade severs Networking evolution Leaf and Spine fabric Hi-speed Ethernet 40G, 100G, 200G, 400G.. FCoE (Convergence) Fiber Channel 32GFC, 128GFC, 256GFC.. Storage evolution Mega, Tera, Petra Bytes Tapes, Disk, Solid state
Speed Migration on Servers Total Market
Multimode Fiber Cable Multimode fiber designations
Singlemode Fiber Cable OS1 (Tight-buffered) Max. cabled attenuation 1.0dB/km (1310nm) 1.0dB/km (1550nm) OS1a (Tight-buffered) Max. cabled attenuation 1.0dB/km (1310nm) 1.0dB/km (1383nm) 1.0dB/km (1550nm) OS2 (Loose-tube) Max. cabled attenuation 0.4dB/km (1310nm) 0.4dB/km (1383nm) 0.4dB/km (1550nm) SM fiber specifications IEC 60793-2-50, type B1.1 ITU-T G.652.A or IEC 60793-2-50, type B1.3 ITU-T G.652.D SM fiber specifications IEC 60793-2-50, type B1.3 ITU-T G.652.D IEC 60793-2-50, type B6_a ITU-T G.657.A SM fiber specifications IEC 60793-2-50, type B1.3 ITU-T G.652.D IEC 60793-2-50, type B6_a ITU-T G.657.A
What is a Transceiver? Transmitter + Receiver = Transceiver! Optical Transceivers are pluggable, compact media connector use to connect a network device to a wide variety of fiber cable types and distances.
40 and 100 Gb/s over Multimode Servers bandwidth >1 Gb/s prompting customer planning for 40/100G $(Multimode total system cost) lower than $(Single-mode total system cost) Lower transceiver cost (Capex), lower power consumption (Opex) WBMMF fully backward compatible with OM4, with 4 x greater capacity IEEE Standards in bold letters *maximum supported length under consideration
40 and 100 Gb/s over Singlemode Single-mode deployed to support longer 10G/40G/100G distances $(Single-mode total system) cost higher than $(Multimode total system) IEEE Standards in bold letters *maximum supported length under consideration
What are the Ethernet Speed today?
High Speed Fiber Optic Connections Today Application 10GBASE-SR 25GBASE-SR 40GBASE-SR4 100GBASE-SR10 100GBASE-SR4 Data Rate 10G Bps 25G Bps 40G Bps 100G Bps 100G Bps IEEE Std. 802.3ae 802.3by 802.3ba 802.3ba 802.3bm Form Factor SFP+ SFP28 QSFP+ CFP, CXP QSFP28, CFP4 Fiber Type OM3/OM4 OM3/OM4 OM3/OM4 OM3/OM4 OM3/OM4 Reach 300m/400m 70m/100m 100m/150m 100m/150m 70m/100m # of Fibers 2 2 12 (8 used) 24 (20 used) 12 (8 used) Connector Duplex LC Duplex LC MPO-12 MPO-24 MPO-12 Schematic
Data Center Connections are Changing Many center networks are architected on a traditional 3-tier topology Cloud data center networks are migrating from the 3-tier to flattened 2-tier topology Hyperscale Data Centers becoming larger, more modular, more homogenous Workloads spread across 10s, 100s, sometimes 1000s of VMs and hosts Higher degree of east-west traffic across network (server to server)
Data Center Connections are Changing Data Center connections are moving from 10G/40G, to 25G/100G Within the Data Center Rack 10GE being deployed now 25GE to be deployed soon 50GE to the server will follow Between Data Center Racks 40GE being deployed now 100GE to be deployed soon What follows? 200GE or 400GE? Long Spans/Inter-Data Centers & WAN 100GE being deployed until now 400GE being standardized now What follows? 800GE, 1TE or 1.6TE?
Alternative to Duplex MMF for Higher Data Rates Duplex Single Mode Fiber (SMF) Fiber is less expensive than MMF, but SMF modules are more expensive than MMF Requires more precise alignment and cannot use low-cost VCSELs MMF is used up to 400m today, and SMF is used for longer reaches WDM over Duplex Single Mode Fiber Multiplex multiple wavelengths onto one pair of fibers More expensive module than duplex SMF, but fewer fibers Most cost effective for the longest reaches Parallel MMF Combine multiple MMF signals on separate fiber pairs Uses quality high-density MPO connectors (12 or 24 fibers) because fiber arrays must be simultaneously aligned. Achieves fiber economies of scale and still leverages low-cost VCSEL technology, but reach may be limited
200GE and 400GE Standardization The 400GE Standard is already being defined in IEEE P802.3bs Standard is expected to be ratified in December 2017 Link objectives: 400GBASE-SR16 100m on parallel MMF 400GBASE-DR4 500m on parallel SMF 400GBASE-FR8 2km on duplex SMF 400GBASE-LR8 10km on duplex SMF Electrical I/O: CDAUI-8 8x50G PAM-4 CDAUI-16 16x25G NRZ Optical I/O: SR16 will be based on 16x25G NRZ DR4 will be based on 4x100G PSM PAM-4 LR8 & FR8 will be based on 8x50G LAN-WDM PAM-4 50G and 200G Ethernet standardization is now being studied by IEEE Optics suppliers are working on components to support these new rates Based on VCSELs, DFB laser and SiP technologies ICs and test platforms that support PAM-4 encoding
Space Division Multiplexing (Parallel Optics) Data rates above 28Gb/s employ parallel fibers 40GBASE-SR4 100GBASE-SR10 100GBASE-SR4 128GFC (will be like 100G SR4) 400GBASE-SR16 ANSI/TIA-604-18 (FOCIS 18) Transmission via parallel fibers has pragmatic limits 100GBASE-SR4 more practical than 100GBASE-SR10 Diminished appeal above SR16 A better approach is needed to keep MMF solutions optimized Enter SWDM
Introducing Shortwave WDM It is now possible to put WDM capabilities in VCSELs VCSELs are laser technology of choice for MMF VCSELs operate best in the 850 nm region ( shortwave ) SWDM modules include the multiplexing and de-multiplexing all within the module Example: 40G QSFP+ SWDM4 λ 1 λ 2 λ 3 MUX DEMUX λ 1 λ 2 λ 3 λ WBMMF 4 λ 4 850 / 880 / 910 / 940 nm
WBMMF (OM5) Wide Band (OM5) extends the capability of OM4 across a wider spectrum to support at least four low-cost wavelengths Effective modal bandwidth: 4700 MHz.km at 850nm to 2470 MHz.km at 953nm Applications provide opportunities to seed Ethernet and Fibre Channel technologies Four wavelengths illustrated λ 1 λ 1 λ 2 λ 2 λ 3 λ 4 WBMMF λ 3 λ 4 MUX DEMUX 850 / 880 / 910 / 940 nm
WBMMF (OM5) Standardization ANSI/TIA-492AAAE (16 July 2016) 50/125-micron laser-optimized fiber optimized for enhanced performance for singlewavelength or multi-wavelength transmission systems Operating band: 850 to 953nm Effective modal bandwidth: 4700 MHz.km at 850nm to 2470 MHz.km at 953nm Nomenclature used for WBMMF will be OM5 (October 2016) Draft ISO/IEC 11801-1 Ed.3.0 ISO/IEC JTC 1/SC 25/WG3 (Interconnection of Information Technology Equipment) IEC 60793-2-10 Ed.6 includes WBMMF as Fiber Type A1a.4 (advance stage ballot) WBMMF (TIA-492AAAE) was accepted as a supported fibre type for IEEE 802.3bs 400GBASE-SR16 (September 2016) this was to accommodate future deployment of SWDM
Application Evolution Map - Ethernet Data Rate 10G NRZ Parallel TX RX 25G NRZ Parallel TX RX 50G PAM4 Parallel TX RX 10, 25, 50G WDM & Parallel TX RX 40G N/A N/A 100G 200G 400G *Parallel fibers remain essential to support break-out functionality
Application Evolution Map Fibre Channel FC Rate 32GFC Parallel TX RX 64GFC Parallel TX RX 32G, 64G WDM TX RX 128GFC N/A 256GFC N/A *Parallel fibers remain essential to support break-out functionality
Benefits of SWDM & WBMMF Wavelengths used to reduce number of fibers Good trend for improving MMF utility SWDM utility is limited on existing OM3 or OM4 at high lane rates OM5 delivers sufficient bandwidth over wavelength spectrum to support > 100G / fiber to at least 100 m Goals and benefits: retain legacy application support of OM4 increase capacity to > 100G per fiber reduce parallel fiber count by factor of 4 boost array cabling capacity for parallel apps enable Ethernet: 40G-SR, 100G-SR, 200G-SR, 400G-SR4 enable Fibre Channel: 128GFC-SWDM, 256GFC-SWDM extend MMF utility as universal medium
Ethernet Roadmap Ethernet today Existing: 10M, 100M, 1G, 10G, 40G, 100G, 2.5G, 5G, 25G Continues to evolve Developing: 400G, 50G, 200G, On and over the horizon 800G, 1.6T and >6.4T And thrive Due to unrelenting demand for faster speed
Data Center Fibre Cabling Trends MPO is a critical component for data center efficiency Installed in data centers with proven track record High-density fiber management interface Provides time and space efficiency on site Significant Industry improvements in MPO end-face performance Availability of Industry standard MPO options same ferrule body: MPO-8 MPO-12 MPO-24
Data Center Fibre Cabling Trends Migration from Duplex to Parallel lanes to Duplex Migration from 10G/lane building blocks to 25G, 50G, 100G for higher speed applications 10G @ 10G = 2f 100G @ 10Gb/s = 20f (100G SR10) 100G @ 25Gb/s = 8f (100G SR4) Extended Value of Multimode for short reach via SWDM and OM5 WBMMF technologies Parallel lanes over each fiber 100G @ 25Gb/s = 2f (100G QSFP28 SWDM4) Currently industry available Ultra Low Loss Adapter/Module losses: For MPO-8, MPO12, and MPO-24 MPO-LC module: 0.35dB max IL MPO-MPO module: 0.5dB max IL MPO-MPO direct: 0.25dB max IL
Optical Standards Proliferation Duplex and parallel optics products continue to proliferate This results in a proliferation of standards, de facto standards, MSAs, and proprietary codes, each optimized for a particular use case
MPO-12 Global Industry Standard interface for both Multimode and Singlemode In data centers: Initially used for modular fiber optic cabling Rapid pluggable deployment for duplex applications Converged adaptation to fully utilize fibers for parallel applications Fully Utilized trunk 66% Utilized trunk Fully Utilized trunk
MPO-8 Utilizes 8 of 12 fiber positions of Industry Standard MPO- 12 interface Initially used for equipment patch cords to QSFP transceivers As infrastructure cabling, MPO-8 can be used for either parallel or duplex Optimized for parallel applications Fully Utilized trunk Fully Utilized trunk 29 Fully Utilized trunk
MPO-24 Architecture for a Higher-speed future Lowest first cost duplex design (1/3 the MPO connections vs MPO-8) Most flexible trunk interface for duplex/parallel/future duplex migration Transition to parallel and recover/re-use fiber as lane rates increase Fully Utilized trunk Fully Utilized trunk 30 Fully Utilized trunk
Key Takeaways The industry is moving to utilize SWDM Transceivers, fibers, cabling OM5 WBMMF will optimize the reach of SWDM solutions While retaining support for 850 nm legacy applications at OM4 reaches Applications provide opportunities to seed these technologies Ethernet and Fibre Channel SWDM & WB technologies extend the utility of MMF Continuing legacy of delivering lowest-cost optical solutions over the universal data-comm transmission medium that is MMF MPO-24 provides the platform for seamless transition from Duplex to Parallel optic to future Duplex connectivity
Fiber Optic Cabling Systems for High Performance Applications Questions? BICSI Conference Bangkok, Thailand 17-18 November 2016