Don t Get Left Behind: Cabling Designs You Can Trust to Support Speeds of 32G to 400G

Transcription

1 Don t Get Left Behind: Cabling Designs You Can Trust to Support Speeds of G to 00G Dave Fredricks Data Center Infrastructure Architect #DATACENTERWORLD #CPEXPO CHANNELPARTNERSCONFERENCE.COM DATACENTERWORLD.COM

2 Agenda TIA Standards for data center cabling designs IEEE 0.ba/bm/bs Ethernet Standards for optics Structured cabling designs for 0G to 00G Ethernet Fibre Channel Gen and Gen optics Structured cabling designs for G to G Fibre Channel Final Considerations

3 Telecommunications Industry Association (TIA) TIA--B: released July 0 named; Telecommunications Infrastructure Standard for Data Centers TIA-.-D: released May 0 named; Optical Fiber Cabling and Components Standard TIA-0-C: released July 0 named; Telecommunications Infrastructure and Equipment Administration Standard *TIA Standards can be purchased at

4 TIA--B

5 TIA-.-D Three types of MPO/MTP polarity methods defined as Method A, B & C Type-B MPO/MTP cable will connect together two parallel optics typically 0G or 0G QSFP type Using flipped (Type-B) fiber optic trunks help support parallel and duplex optics

6 TIA-0-C Port location in cabinet by rack unit (RU) number Cabinet location on data center floor Port location in rack unit, patch panel or enclosure "X" COORDINATE AA AB AC AD AE AF AG AH AI AJ HOT AISLE (CABINET REAR) AD0 AD0 AD0 AD0 AD0 AD0 AD0 AD COLD AISLE (CABINET FRONTS) AG0 AG0 AG0 AG0 AG0 AG0 AG AG HOT AISLE (CABINET REAR) "Y" COORDINATE AD AG = cabinet corner used for grid location ID (right front facing the cabinet)

7 TIA Considerations Understand the TIA--B standard to use breaks in the connectivity links with patch panels, enclosures and port replication hardware. Patch panels give the ability to support different optics (next generation) while using existing horizontal or backbone cabling infrastructure Understand the different MPO/MTP polarity options in TIA-.-D to best plan for current and next generation optics Plan specific labeling schemes as shown by TIA-0-C to easily identify port locations throughout the data center space

8 IEEE 0.ba/bm/bs IEEE 0.ba released June 0 introducing 0G Ethernet over multimode fibers and 0G Ethernet over 0 multimode fibers IEEE 0.bm released April 0 updated several subset standards in 0.ba to include 0G Ethernet over multimode fibers as was 0G in previous standard new IEEE 0.bs released December 0 jumped the speed from 0G to 00G and 00G Ethernet. Introduced new fiber MPO/MTP connector for multimode and fiber on singlemode glass *IEEE Standards can be purchased at

9 0G & 0G Distance Limitations IEEE 0.ba June 0 IEEE 0.bm April 0

10 00G & 00G Distance Limitations IEEE 0.bs Multimode Glass New fiber MPO/MTP IEEE 0.bs Singlemode Glass Standard / fiber MPO/MTP

11 00G Multimode Optics The introduction of the new multimode MTP- connector will create challenges to support the signal within existing MPO/MTP and fiber cabling systems Many believe that the MTP- will not replace the MPO/MTP or connector as the fiber connector of choice moving forward. The consensus looks to be that it will be used at the Spine or Leaf switch and then break out to run on existing and standard and fiber cabling infrastructures Reduce cost of 0G ports as breakout x 0G = 00G

12 MTP- to x MTP- or MTP- Y Cable On the left side of the drawing would be an MTP- connector plugging into a 00G SR optic. xxxxxxxxxxxxx Then the Y cable would break the signal out into two fiber links to work with and fiber cabling plants. No need to rip and replace existing horizontal or backbone cabling

13 Multimode verse Singlemode The cost of singlemode optics have decreased steadily over the past several years Singlemode fiber is typically less expensive than OM or OM multimode fiber The newer singlemode 0G PSM optic reduces the maximum distance link from kilometers to 00 meters The singlemode PSM optic is closely priced now to multimode SR optics and should be considered on new structured cabling applications as it will work seamlessly for proposed 00G optics

14 IEEE 0. Considerations Plan to have a patch panel or break in the fiber link near the Core or Spine Switches. This allows easy migration to 0G, 0G, 00G, 00G or next generation 00G optics Calculate maximum db link loss below -. db including interconnects to use existing cabling for next generation optics Compare cost of multimode verse singlemode optics and cabling on new Spine and Leaf deployments. Consider new fiber links to support 0G Ethernet at a minimum

15 or Port Line Card Replication

16 Cabling Designs to Support 0G to 00G

17 Cabling Designs to Support 0G to 00G

18 Cabling Designs to Support 0G to 00G

19 Fibre Channel Generation Gen was released November 0 and introduced speeds of G fibre channel over fibers and GFCp fibre channel over fibers Introduced the MPO/MTP parallel optic (GFCp) to fibre channel connectivity Gen hardware began to enter the data center space in large numbers in 0 Supports st generation of FC-NVMe *

20 Fibre Channel Generation Released November 0 Introduced GFC and GFCp GFC to run on duplex or LC connections GFCp to run on parallel or MPO/MTP connections Fiber polarity same as Gen with distance limitation on OM multimode glass at 0 meters Supports nd generation FC-NVMe *

21 Fibre Channel Gen GFC & GFCp OM and OM multimode glass rated at same distance of 0 meters for Gen *

22 Fibre Channel Considerations Plan to have a patch panel or break in the fiber link near the Director or Core Switches. This allows easy migration to any current Gen or Gen optic as a two fiber duplex LC or fiber parallel MPO/MTP connector Calculate maximum db link loss below -. db including interconnects to use existing cabling for next generation optics Understand that the higher speeds from Gen and Gen along with a proper structured cabling system help reduce latency working with flash storage and NVMe

23 or Port Blade Replication u port replication enclosure H Series u replication enclosure with () port MTP-LC cassettes u enclosure with () port MPO/MTP coupler panels to replicate or port blades using LC or MPO/MTP harnesses

24 H Series H Series H Series H Series R H Series A B C D E F G H J K L M Cabling Designs to Support GFC to GFCp, or fiber MTP to MTP OM trunk Fabric B, or fiber MTP to MTP OM trunk Fabric A SAN Cabinet # MoR Patch Cabinet / fiber MTP to MTP OM trunk 0 0 Core # Core # u enclosure has () port MTP coupler panels to connect () FC- blades 0 0 Middle of Row (MoR) u patch enclosure can support up to LC ports with () port MTP-LC 0 cassettes 0 ports for Fabric A and ports for Fabric B 0 0 SAN X Core A SAN X Core B SAN Fabric A SAN Fabric B Maximum Link db loss:. +. = -0. db Typical Link db loss:. +. = -0. db

25 R H Series A B C D E F G H J K L M 0 R H Series A B C D E F G H J K L M R H Series A B C D E F G H J K L M 0 R H Series A B C D E F G H J K L M R H Series A B C D E F G H J K L M Cabling Designs to Support GFC to GFCp or fiber MTP to MTP OM trunk Fabric A SAN Cabinet # Patch Cabinet Fabric A Patch Cabinet Fabric B SAN Cabinet # or fiber MTP to MTP OM trunk Fabric B MoR Patch Cabinet () u enclosure has () port LC / fiber Cross-connect cassettes to replicate MTP to MTP LC to LC ports from () OM trunk OM jumper fully populated Brocade X directors with FC- blades Core # Core # H Series H Series 0 0 Middle of Row (MoR) u patch enclosure can support up to LC ports with () port MTP-LC 0 cassettes 0 ports for Fabric A and ports for Fabric B 0 0 SAN X Core A SAN X Core B SAN Fabric A SAN Fabric B Maximum Link db loss: = -.0 db Typical Link db loss: = -0. db

26 Final Considerations Understand published standards that apply to structured cabling from TIA, IEEE 0. and Fibre Channel.org Install a patch panel over Core, Spine or Directors to allow ability to connect optics that require an LC (duplex), MPO/MTP- or multimode fiber (parallel) or MPO/MTP- multimode fiber (parallel) connector Calculate link loss with decibels (db) as maximum below -. db for inter-connects or connectors, total db loss below -. db Plan to use cabling hardware that best replicates the switches, servers and compute equipment in the application as to Consider singlemode fiber cabling infrastructure verse multimode