Enhancing intra and inter datacenter synchronization using White Rabbit

Transcription

1 When every nanosecond counts Enhancing intra and inter datacenter synchronization using White Rabbit Pablo Marín Jiménez

2 Summary Visibility network White Rabbit technology. Production network Intra-datacenter time transfer and synchronization. Network backup Intra-datacenter time transfer and synchronization.

3 Visibility network Visibility network Monitorize your network status. Evaluate the network performance. Performance log. Improve the network design. Deutsche Börse use case: better analyzing their trading activity, latencies and algorithms performance. Important because of transparency purposes and enhanced infrastructure.

4 White Rabbit technology White Rabbit technology White Rabbit (WR) is a technology born at CERN which achieves sub-nanosecond accuracy in Ethernet based networks. It allows easy deployments of scalable and reliable networks with high accuracy synchronization requirements.

5 White Rabbit technology 10 years of expertise synchronizing large scientific facilities with WR: CERN, GSI, Fermilab, Validated by National Metrology Institutes: NIST, NPL, PTB, OP, VSL, ROA, VTT, RISE, New PTP High Accuracy profile to be released early 2019 will be intensively based on the pre-standard approach White Rabbit. More than 7 years of expertise on the White Rabbit technology. Main White Rabbit technology developers. Original WRS hardware designers.

6 White Rabbit technology Based on optical Gigabit Ethernet networks Network syntonization Synchronous Ethernet

7 White Rabbit technology Based on optical Gigabit Ethernet networks Network synchronization Precision Time Protocol (IEEE 1588v2)

8 White Rabbit technology Based on optical Gigabit Ethernet networks Additional mechanisms Digital Dual-Mixer Time Difference Hardware timestamps Dynamic link assymetry compensation Pre-calibration

9 Visibility network Deutsche Börse has studied and integrated WR technology using Seven Solutions products GPS 10 MHz 1 PPS GM WR-Switch WR WR-ZEN TP-32BNC to synchronize their packet 1PPS capture and timestamping devices across the entire datacenter with unprecedented Level 4 Timestamper precision. Tap every link Level 3 Timestamper Timestamp every packet A detailed live map of the Level 2 Timestamper network can be obtained for analysis Validated in the finance sector Level 1 Timestamper by the German stock exchange (Deutsche Börse).

10 Visibility network Multi-cabinet time transfer expander Deliver accurate and precise PPS to every capturing device All capturing devices synchronized Cabinet 1 Time Reference WR-SWITCH Cabinet 2 Cabinet 3 10 MHz & PPS WR PPS WR-ZEN TP-32BNC WR-ZEN TP-32BNC WR-ZEN TP-32BNC Capturing device Capturing device Capturing device Capturing device Capturing device Capturing device Capturing device Capturing device Capturing device

11 Visibility network MetaMako test (PPS connection) 10 MHz Reference Fiber PPS PPS WR-LEN WR-ZEN TP-32BNC Metamux ns

12 Visibility network Find the full press release on our website:

13 Production network Production network Distributed scenarios. Scalable deployments. High reliability and availability. Low latency.

14 Intra-datacenter time transfer and synchronization Sub-nanosecond distribution to each cabinet Expend < 1ns of time error budget to each cabinet Choice of interoperability for last hop: 1 last PTP hop (±50 ns from the reference) 2 last PTP hops (±100 ns from the reference) 1 PPS hop (sync accuracy depending on clock performance of the slave) WR until the end node (< 1ns from the reference)

15 Intra-datacenter time transfer and synchronization Time Reference WR-SWITCH 10 MHz & PPS WR WR-ZEN TP WR-ZEN TP WR-ZEN TP-32BNC WR-SWITCH PTP PTP Switch PTP PPS WR ± 50 ns from ref. X ns from ref. WR-SLAVES < 1 ns from ref. PTP Slave PTP ± 100 ns from ref. PPS Slaves PTP Slaves

16 Intra-datacenter time transfer and synchronization Intra-datacenter time distribution PTP interoperability using WR-ZEN TP devices. Setup 1: Direct connection to PTP Slave (± 50 ns accuracy). Setup 2: Multiple PTP slave connection using a PTP switch (± 100 ns accuracy). Tested devices: Solarflare, Metamako, Oregano, Endace, Napatech.

17 Offset (ns) Intra-datacenter time transfer and synchronization SolarFlare tests (PTP protocol) PPS Offset between SolarFlare devices NOT STAC BENCHMARK Samples

18 Intra-datacenter time transfer and synchronization Intra-datacenter time distribution WR-PTP time distribution Setup 4: Up to 16 WR compliant slaves connection. Sub-nanosecond accuracy over tens of daisy-chained slaves. Mandatory WR compliant slave devices.

19 Intra-datacenter time transfer and synchronization White Rabbit switch tests 200 ps

20 Network backup Network backup Preserve the network time reference. Dependable GNSS time reference backup. Protection against spoofing and jamming. Time reference monitorization.

21 Inter-datacenter time transfer and synchronization >100 Km time Transfer using GNSS receivers as primary time reference (APTS: network as backup) Time Transfer using optical network (<100 Km) >100 Km time Transfer using fiber as primary time reference (GNSS for asymmetry calibration and backup) Timing master datacenter

22 Inter-datacenter time transfer and synchronization Sub-nanosecond synchronization using bidirectional optical fiber links. Distances up to 100 Km. Dedicated or DWDM optical networks channels without amplification. Dedicated or data-shared timing channels.

23 Inter-datacenter time transfer and synchronization < 120 Km Datacenter A < 120 Km Datacenter B Datacenter A Datacenter B Time Reference Time Reference 10 MHz and/or PPS 10 MHz & PPS Time distrib. to the cabinets WR-SWITCH WR-SWITCH Time distrib. to the cabinets WR WR WR WR-ZEN TP WR-ZEN TP

24 Timing master device Inter-datacenter time transfer and synchronization Support for unidirectional WDM networks. Asymmetry calibration is provided based on GNSS receivers Timing master device

25 Inter-datacenter time transfer and synchronization WR-ZEN TP WR (20 Km) WR-ZEN TP PPS Keysight Frequency Counter/Timer 350 MHz 20 ps resolution PPS Lab test 24 hours measure Sub-nanosecond accuracy and precision

26 Inter-datacenter time transfer and synchronization

27