The Breakthrough LISTEN Search for Intelligent Life: A Wideband Data Recorder for the Robert C. Byrd Green Bank Telescope

Transcription

1 The Breakthrough LISTEN Search for Intelligent Life: A Wideband Data Recorder for the Robert C. Byrd Green Bank Telescope Dave MacMahon University of California at Berkeley

2 Breakthrough LISTEN SETI Project Breakthrough Initiative: $100M over 10 years Starting with Green Bank and Parkes Radio Telescopes, as well as Lick Observatory APF (optical SETI) 1,000,000 stars; 1,000 galaxies; galactic plane; all sky New instrumentation: 10 GHz bandwidth (~10 billion channels) analyzes parts of the data Open source everything: data, hardware, software, gpuware, gateware

3 Robert C. Byrd Green Bank Telescope Located in Green Bank, West Virginia within the National Radio Quiet Zone 100 meter unblocked aperture Frequency coverage from 100 MHz to 115+ GHz BL using L, S, C bands (1 to 8 GHz) so far Active surface comprised of >2000 panels World s largest fully steerable radio telescope Second largest moveable land object(?)

4

5

6

7 REUSE AT GBT ASTRID Runs on GBT host scan_coordinator GBT status Runs on GBT or BL host guppi_redis_monitor Runs on BL head node auto_dealer dealer_server redis_server Runs on BL compute node player player player player guppi_reds_gateway guppi_reds_gateway guppi_reds_gateway guppi_redis_gateway guppi_gbtstatus_loop guppi_gbtstatus_loop guppi_gbtstatus_loop guppi_gbtstatus_loop katcp_server DIBAS BOF status buffer status buffer status buffer status buffer Runs on ROACH2 guppi_daq_server guppi_daq_server guppi_daq_server guppi_daq_server Disk Disk Disk disk Existing Antenna Existing Digitizers Existing Gateware Existing Software

8 GBT to VEGAS GBT Downconvert ROACH2s (x8) 10 GbE Switch VEGAS

9 Add BL Hardware GBT Downconvert ROACH2s (x8) Breakthrough Listen 10 GbE Switch VEGAS

10 GBT to BL GBT Downconvert ROACH2s (x8) Breakthrough Listen 10 GbE Switch VEGAS

11 GBT Multicast Future? GBT Downconvert ROACH2s (x8) Breakthrough Listen 10 GbE Switch VEGAS

12 ROACH2 VEGAS Pulsar Mode 8 ports x 6 Gbps/port 48 Gbps 64 channels each 1.5 GHz x 2 Pols 10 GbE ADC ADC PFB 512 chan PFB 512 chan Requant 8+8 bits Requant 8+8 bits P a c k e t i z e r 10 GbE 10 GbE 10 GbE 10 GbE 10 GbE 10 GbE 10 GbE 3 Gsps x 2 Pols x 8 bits 48 Gbps 1.5 Gsps x 2 Pols x (8+8) bits 48 Gbps

13 Breakthrough Listen Node Types Head Node (x1) 1U Box - Dual Xeon - 64 GB DDR4 DRAM GB SSD DHCP/DNS/TFTP/NFS/NetBoot server Public face of BL cluster Compute Node (x spare) 4U Box - Dual Xeon - 64 GB DDR4 DRAM - Netboot Mellanox 10 GbE dual-port NIC 1 NVIDIA GPU (TITAN X or GTX 1080) 24 x 5 TB Hard Drives 2 x 11 disk RAID6 + 2 hot swap spares Each RAID volume hosts a 46 TB XFS files system Storage Node (x4) 4U Box - Dual Xeon - 64 GB DDR4 DRAM - Netboot Mellanox 40 GbE NIC 36 x 6 TB Hard Drives 3 x 11 disk RAID6 + 3 hot swap spares Each RAID volume hosts a 50 TB XFS file system

14 GBT BLOCK DIAGRAM 1GbE to gb.nrao.edu network 16 IF s from GBT GHz ADC 3Gbps VEGAS ROACH2 FPGA ROACH 0 Arista 64 QSFP GbE switch DCS QX - 64 Switch Breakthrough Listen Head Node Storage Node 0 Storage Node N Compute Node 0 Compute Node M VEGAS Compute Node 0 1 Storage Node 16 Compute Nodes 1/10 GbE switch 10Gbe 1Gbe 1Gbe 1Gbe 1Gbe Netgear prosafe S x switch ROACH 7 to VEGAS Infiniband switch VEGAS Compute Node 8 Breakthrough Listen at Green Bank Telescope management port 1GbE to gb.nrao.edu network rev 1 [17 August 2016] Dan Werthimer, Dave MacMahon, Zuhra Abdurashidova

15 BL Compute Node (1 of 8N) Record RAW voltages to disk during observations 10 GbE HASHPIPE Raw Voltages RAID GPU 6 Gbps x 6 Hours/Day 16 TB/Day (really ~12 TB/Day)

16 BL Compute Node (1 of 8N) ~12 TB/Day RAW Voltages (mostly discarded) 10 GbE HASHPIPE Raw Voltages RAID Power Spectra GPU Reduce data between observations ~330 GB/Day Filterbank Spectra (retained)

17 BL Compute Node (1 of 8N) 10 GbE Raw Voltages GPU HASHPIPE Power Spectra Power Spectra (+Raw Voltages) RAID Real-time future

18 Data Products Raw voltage data in GUPPI RAW format (limited retention, 8+8 bit complex) Integrated power spectra in Filterbank format (everything, 32 bits floating point) Description Spectral Resolution Integration Time SETI ~3 Hz ~18 seconds Astrophysical ~3 khz ~1 second Fast Transient ~360 khz ~350 microseconds

19 BL GBT Cluster

20 BL GBT Cluster

21 BL GBT Cluster

22 Water Cooling OEM GPU Water Block Passive CPU Water Blocks

23 Water Cooling Check Valve

24 System Monitoring with Nagios

25 First Light

26 Jupyter Notebook for Voyager1

27 Jupyter Notebook for Voyager

28 Jupyter Notebook for Voyager

29 Jupyter Notebook for Voyager

30 arxiv: v2

31 Thank You!