Data Handling and Transfer for German LOFAR Stations
|
|
- Cleopatra Turner
- 5 years ago
- Views:
Transcription
1 Data Handling and Transfer for German LOFAR Stations On behalf of LOFAR and GLOW (slides stolen from many other LOFAR presentations by other people) 1/24
2 Some Initial Comments LOFAR network details still under development Continue to evolve for international partners as single-station (and stand-alone operation) needs are developed and implemented GLOW meeting in Garching next week Now mostly frozen within the Netherlands Will discuss many issues of single-station operation (and subarray interferometry) and network issues for achieving that within GLOW GLOW partners will discuss observing options, plus use of other stations (Uw, Ju) Many other network experts within GLOW who know more about the network details than I do I know more about the station and data issues than I do the network configuration Many network experts at the various stations 2/24
3 View of a LOFAR Station No complete German stations yet... Each dipole/tile polarization transmitted along a cable back to the station cabinet Each signal digitized by 12 bit A/D converter at 160 or 200 MHz rate 3/24
4 Inside a Station 4/24
5 Control Overview 5/24
6 Types of Data Flow for LOFAR Stations In: Station control commands Out: Beamformed data Main LOFAR observational data product Summation of antenna signals for specific direction(s) on sky (beams) 248 subbands maximum (subbands reused for 8 and 4 bit modes) Up to 3.1 Gb/s Out: TBB data Typically a small load, < 1 Gb/s May be up to 5 Gb/s for certain single-station applications Out: Monitor information A/D time series for each antenna/polarization, or polyphase filter values as function of time for each antenna/polarization Receiver temperatures, coarse station spectra, GPS information, etc. Out: Station visibilities 1 subband per second, for all receiver units 6/24
7 Keeping Things Organized: VLANs In ASTRON's LOFAR plan, all LOFAR data travels down a single 1x10 GE fiber connection Each data type separated by different VLAN IDs About 11 standard LOFAR VLAN IDs in use Many different types of monitoring data in previous slide are separated 7/24
8 QinQ 12 bit VLAN ID IDs for the entire world VLAN IDs chosen by ASTRON for LOFAR are often standard IDs used for various applications 1 through 100 filled with other uses VLAN IDs must be unique for security reasons LOFAR VLAN IDs cannot make it through the various German stations and Juelich Solution is to use QinQ Bundle all LOFAR VLAN traffic inside of another layer, with a different VLAN ID GLOW allocated range 2000 through 2100 for itself, to be kept free by all GLOW stations and Juelich 8/24
9 10 GE Network Following the upgrade of the LOFAR correlator (Blue Gene supercomputer) from the L to P class, ASTRON decided to switch to using 10 GE technology for LOFAR Blue Gene/P only has 10 GE connections 10 GE bid cheaper than 3x1 GE bid Extra bandwidth allows more things to be done International partners told to use 10 GE if at all possible Currently only a (money) problem for Tb and Uw Note that the fiber connection provides 10 Gb/s each in both directions Can also shove 10 Gb/s to a station 9/24
10 Dutch Core Solution Fibers from nearly all Dutch stations are first sent to a central collector buiding near the Exloo core Data then sent along a LOFAR fiber path to Groningen 10/24
11 International Network German stations send all LOFAR data through Juelich supercomputing center Data from different stations bundled onto common fibers Allows German stations to efficiently operate a German subarray Cb, On, and Nc will have LOFAR data go through Amsterdam 11/24
12 German Network Continued 12/24
13 German Network and Juelich 13/24
14 Juelich Research Center near Dutch boarder GLOW member, participating in networking/ storage/computation work in LOFAR Will also host the German university station Providing 1 PB of archive storage for early LOFAR work Can potentially house computational and extra storage for LOFAR/GLOW 14/24
15 Groningen Overview Main processing center for LOFAR (correlation and initial calibration and imaging pipelines) Blue Gene used as correlator and data formatter Calibration, RFI flagging, imaging, and so on happens in the off-line cluster for now 15/24
16 16/24
17 Basic Network Topology for GLOW 17/24
18 Notes on GLOW Topology Nearly every (TBD) GLOW station will have local data storage capability, with 10s of TB each Many stations will have local processing capability for singlestation operation Processing power needs (# CPUs) to be worked out in the future as we figure out how much we need Also have the ability to gather station data in Juelich Tap off data-stream to Groningen for monitoring Recording and/or processing at Juelich planned for the future Multiple single-station or subarray uses Can redirect data from other stations In principle possible to do at both Juelich and Groningen, but Groningen will likely have ability first Can directly pass other International or Dutch station data to Juelich or to a German station 18/24
19 Station Data: Individual Antenna Spectra Station hardware records average spectra over ~1 min intervals for individual antennas Example LBA spectra shown here Relatively low data rate, but also poor frequency and time resolution 19/24
20 LBA Example Dynamic Spectrum Made from a time series from an antenna on the previous plot Can see Milky Way rise and fall over several days Low frequency RFI also shows diurnal patern 20/24
21 Station Data: Visibilities Example Tb LBA image shown Can get visibilities for 1 subband (~ 200 khz) once per second All-sky imaging for LBA Can image full tile beam for HBA If certain antennas within tiles are shut off, can also make allsky images for HBA, but at reduced sensitivity Limited ability to remove RFI, low data rate 21/24
22 Station Data: Beamformed Data Station electronics coherently sums antenna signals together for specific sky direction Summation done in ~200 khz polyphase filter subbands Up to 248 subbands can be sent out from the station, with subband samples every ~5 μs Can process outside of station to get higher frequency resolution, with corresponding time resolution loss 22/24
23 Beamformed Data Data comes out of station in a raw format Software currently running on Blue Gene to convert the raw format to HDF5 files for further processing Documentation on current raw beamformed data format made available during Technical Status Meeting in May GLOW effort to port software to run on standard Linux computer needs to be finished Many single-station and interferometer subarray applications will probably want to read the raw beamformed data coming off the network to process in realtime Lots of development work ahead 23/24
24 The End 24/24
Netherlands Institute for Radio Astronomy. May 18th, 2009 Hanno Holties
Netherlands Institute for Radio Astronomy Update LOFAR Long Term Archive May 18th, 2009 Hanno Holties LOFAR Long Term Archive (LTA) Update Status Architecture Data Management Integration LOFAR, Target,
More informationLOFAR-WAN ADD D.H.P. Maat, R.B. Gloudemans
LOFAR-WAN ADD D.H.P. Maat, R.B. Gloudemans -1- Verified: Name Signature Date Rev.nr. Accepted: Work Package Manager System Engineering Manager Program Manager D.H.P. Maat. date: A. Gunst. date: J.M. Reitsma.
More informationTutorial can be downloaded here: https://dl.dropboxusercontent.com/u/ /data_school_tutorial1_final.pdf
Quick summary of tutorial data set * Seven sub-array pointings, frequency range 120.1 125.8 MHz * Hexagonal pattern centred at RA 21:00:00.00, Dec. +52:54:00.0 (Galactic Plane field) * Same fields as from
More informationPre-Processing and Calibration for Million Source Shallow Survey
Pre-Processing and Calibration for Million Source Shallow Survey V.N. Pandey(Kapteyn Institute/ASTRON) for LOFAR Offline Processing Team April 1 st, 2009 CALIM 09, Socorro Outline 1 2 3 4 MSSS (MS 3 )
More informationEuropean VLBI Network
European VLBI Network Cormac Reynolds, JIVE European Radio Interferometry School, Bonn 12 Sept. 2007 EVN Array 15 dissimilar telescopes Observes 3 times a year (approx 60 days per year) Includes some
More informationSKA Low Correlator & Beamformer - Towards Construction
SKA Low Correlator & Beamformer - Towards Construction Dr. Grant Hampson 15 th February 2018 ASTRONOMY AND SPACE SCIENCE Presentation Outline Context + Specifications Development team CDR Status + timeline
More informationStation Data Cookbook
Station Data Cookbook Verified: Name Signature Date Rev.nr. Menno Norden...... 1.2 Accepted: Work Package Manager System Engineering Manager Program Manager Menno Norden Andre Gunst Rene Vermeulen.........
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886-1299 LOFAR MEMO #002 September 3, 2001 Phone: (978) 692-4764 Fax : (781) 981-0590 To: From: Subject: LOFAR Group
More informationPARALLEL PROGRAMMING MANY-CORE COMPUTING: THE LOFAR SOFTWARE TELESCOPE (5/5)
PARALLEL PROGRAMMING MANY-CORE COMPUTING: THE LOFAR SOFTWARE TELESCOPE (5/5) Rob van Nieuwpoort Vrije Universiteit Amsterdam & Astron, the Netherlands Institute for Radio Astronomy Why Radio? Credit: NASA/IPAC
More informationMeerKAT Data Architecture. Simon Ratcliffe
MeerKAT Data Architecture Simon Ratcliffe MeerKAT Signal Path MeerKAT Data Rates Online System The online system receives raw visibilities from the correlator at a sufficiently high dump rate to facilitate
More informationJohn W. Romein. Netherlands Institute for Radio Astronomy (ASTRON) Dwingeloo, the Netherlands
Signal Processing on GPUs for Radio Telescopes John W. Romein Netherlands Institute for Radio Astronomy (ASTRON) Dwingeloo, the Netherlands 1 Overview radio telescopes six radio telescope algorithms on
More informationPARALLEL PROGRAMMING MANY-CORE COMPUTING FOR THE LOFAR TELESCOPE ROB VAN NIEUWPOORT. Rob van Nieuwpoort
PARALLEL PROGRAMMING MANY-CORE COMPUTING FOR THE LOFAR TELESCOPE ROB VAN NIEUWPOORT Rob van Nieuwpoort rob@cs.vu.nl Who am I 10 years of Grid / Cloud computing 6 years of many-core computing, radio astronomy
More informationPoS(10th EVN Symposium)098
1 Joint Institute for VLBI in Europe P.O. Box 2, 7990 AA Dwingeloo, The Netherlands E-mail: szomoru@jive.nl The, a Joint Research Activity in the RadioNet FP7 2 programme, has as its aim the creation of
More informationEVLA Monitor & Control Software PDR. Status
Status Requirements, Schedule Requirements (High Level, Raw): target completed Antenna Monitor & Control (AMCS) 03/22/02 04/04/02 Operational Interface 03/22/02 04/04/02 Correlator Backend 3/18/02 03/05/02
More informationAdaptive selfcalibration for Allen Telescope Array imaging
Adaptive selfcalibration for Allen Telescope Array imaging Garrett Keating, William C. Barott & Melvyn Wright Radio Astronomy laboratory, University of California, Berkeley, CA, 94720 ABSTRACT Planned
More informationStager. A Web Based Application for Presenting Network Statistics. Arne Øslebø
Stager A Web Based Application for Presenting Network Statistics Arne Øslebø Keywords: Network monitoring, web application, NetFlow, network statistics Abstract Stager is a web based
More informationSignal processing with heterogeneous digital filterbanks: lessons from the MWA and EDA
Signal processing with heterogeneous digital filterbanks: lessons from the MWA and EDA Randall Wayth ICRAR/Curtin University with Marcin Sokolowski, Cathryn Trott Outline "Holy grail of CASPER system is
More informationA.J. Faulkner K. Zarb-Adami
AJ Faulkner K Zarb-Adami March 2015 LFAA LMC - Trieste Andrew Faulkner Kris Zarb-Adami SKA1-low requirements (after RBS) Frequency: 50MHz 350MHz Scan angle: >45 Bandwidth: 300MHz # of beams: >5 Sensitivity
More informationMWA Correlator Status. Cambridge MWA Meeting Roger Cappallo
MWA Correlator Status Cambridge MWA Meeting Roger Cappallo 2007.6.25 Correlator Requirements Complex cross-multiply and accumulate data from 524800 signal pairs Each pair comprises 3072 channels with 10
More informationData Compression for HERA
Data Compression for HERA Paul La Plante, James Aguirre, Bryna Hazelton, Miguel Morales 1. INTRODUCTION The size of the dataset for HERA will soon become intractable for either storage or computing if
More informationSKA Monitoring & Control Realisation Technologies Hardware aspects. R.Balasubramaniam GMRT
SKA Monitoring & Control Realisation Technologies Hardware aspects R.Balasubramaniam GMRT Basic entities of M&C Sensors and Actuators Data acquisition boards Field buses Local M&C nodes Regional M&C nodes
More informationLecture 2 Parallel Programming Platforms
Lecture 2 Parallel Programming Platforms Flynn s Taxonomy In 1966, Michael Flynn classified systems according to numbers of instruction streams and the number of data stream. Data stream Single Multiple
More informationASKAP Data Flow ASKAP & MWA Archives Meeting
ASKAP Data Flow ASKAP & MWA Archives Meeting Ben Humphreys ASKAP Software and Computing Project Engineer 25 th March 2013 ASTRONOMY AND SPACE SCIENCE ASKAP @ Murchison Radioastronomy Observatory Australian
More informationOSKAR-2: Simulating data from the SKA
OSKAR-2: Simulating data from the SKA AACal 2012, Amsterdam, 13 th July 2012 Fred Dulwich, Ben Mort, Stef Salvini 1 Overview OSKAR-2: Interferometer and beamforming simulator package. Intended for simulations
More informationOSKAR: Simulating data from the SKA
OSKAR: Simulating data from the SKA Oxford e-research Centre, 4 June 2014 Fred Dulwich, Ben Mort, Stef Salvini 1 Overview Simulating interferometer data for SKA: Radio interferometry basics. Measurement
More informationHSC Data Processing Environment ~Upgrading plan of open-use computing facility for HSC data
HSC Data Processing Environment ~Upgrading plan of open-use computing facility for HSC data Hisanori Furusawa (NAOJ) 2018.1.17 Subaru Users Meeting 1 Missions of HSC Data Processing in NAOJ Support General
More informationHigh dynamic range imaging, computing & I/O load
High dynamic range imaging, computing & I/O load RMS ~15µJy/beam RMS ~1µJy/beam S. Bhatnagar NRAO, Socorro Parameterized Measurement Equation Generalized Measurement Equation Obs [ S M V ij = J ij, t W
More informationThe UniBoard. a RadioNet FP7 Joint Research Activity. Arpad Szomoru, JIVE
The UniBoard a RadioNet FP7 Joint Research Activity Arpad Szomoru, JIVE Overview Background, project setup Current state UniBoard as SKA phase 1 correlator/beam former Future: UniBoard 2 The aim Creation
More informationNo More Waiting Around
White Paper 10 GbE NETWORK UPGRADE FOR SMB FOR IT ADMINISTRATORS, DECISION-MAKERS, AND OWNERS OF SMALL TO MEDIUM-SIZED BUSINESSES No More Waiting Around How 10 Gb/s Will Change Your Company Network Introduction
More informationASKAP Pipeline processing and simulations. Dr Matthew Whiting ASKAP Computing, CSIRO May 5th, 2010
ASKAP Pipeline processing and simulations Dr Matthew Whiting ASKAP Computing, CSIRO May 5th, 2010 ASKAP Computing Team Members Team members Marsfield: Tim Cornwell, Ben Humphreys, Juan Carlos Guzman, Malte
More informationAdvanced Photon Source Data Management. S. Veseli, N. Schwarz, C. Schmitz (SDM/XSD) R. Sersted, D. Wallis (IT/AES)
Advanced Photon Source Data Management S. Veseli, N. Schwarz, C. Schmitz (SDM/XSD) R. Sersted, D. Wallis (IT/AES) APS Data Management - Globus World 2018 Growing Beamline Data Needs X-ray detector capabilities
More informationFIBER OPTIC NETWORK TECHNOLOGY FOR DISTRIBUTED LONG BASELINE RADIO TELESCOPES
Experimental Astronomy (2004) 17: 213 220 C Springer 2005 FIBER OPTIC NETWORK TECHNOLOGY FOR DISTRIBUTED LONG BASELINE RADIO TELESCOPES D.H.P. MAAT and G.W. KANT ASTRON, P.O. Box 2, 7990 AA Dwingeloo,
More informationShared Risk Observing
Shared Risk Observing EVLA Advisory Committee Meeting, March 19-20, 2009 Claire Chandler Deputy AD for Science, NM Ops Motivation Early science: Want to get EVLA science capabilities i into the hands of
More informationThree Generations of Linux Dr. Alexander Dunaevskiy
Three Generations of Linux Server Systems as TSM-Platform at 17.08.2007 Dr. Alexander Dunaevskiy dunaevskiy@lrz.de d LRZ in Words LRZ is the biggest supercomputing centre in Germany LRZ provides a wide
More informationRoHS COMPLIANT 2002/95/EC
Document ID: SL.QC... May Revision: ATTENTION ELECTROSTATIC SENSITIVE DEVICES RoHS COMPLIANT /95/EC Page of 9 Contents Product Description / Applications / Features... Mechanical specification... Electrical
More informationCoarse and Dense Wavelength Division Multiplexing
Coarse and Dense Wavelength Division Multiplexing There are two main types of technology for wavelength division multiplexing (WDM): coarse (CWDM) and dense (DWDM). They both use multiple wavelengths of
More informationKVN. Duk-Gyoo Roh, and staffs of KASI & NAOJ + Kagoshima Univ. 8 th VERA User s Meeting, Mitaka NAOJ
KVN Duk-Gyoo Roh, and staffs of KASI & NAOJ + Kagoshima Univ. 8 th VERA User s Meeting, 2010. 09. 16-17. Mitaka NAOJ Contents EAVN & KJJVC project KJJVC framework and status Playback Systems RVDB System
More informationClick to edit Master title style
Click to edit Master title style SCALING NETWORK MONITORING IN A LARGE ENTERPRISE BroCon 2016 Austin, TX Click to edit Master Who title am style I? I work for Amazon s Worldwide Consumer Information Security
More informationThe Virtual Observatory in Australia Connecting to International Initiatives. Peter Lamb. CSIRO Mathematical & Information Sciences
The Virtual Observatory in Australia Connecting to International Initiatives Peter Lamb CSIRO Mathematical & Information Sciences The Grid & escience Convergence of high-performance computing, huge data
More informationAA CORRELATOR SYSTEM CONCEPT DESCRIPTION
AA CORRELATOR SYSTEM CONCEPT DESCRIPTION Document number WP2 040.040.010 TD 001 Revision 1 Author. Andrew Faulkner Date.. 2011 03 29 Status.. Approved for release Name Designation Affiliation Date Signature
More informationResource allocation and utilization in the Blue Gene/L supercomputer
Resource allocation and utilization in the Blue Gene/L supercomputer Tamar Domany, Y Aridor, O Goldshmidt, Y Kliteynik, EShmueli, U Silbershtein IBM Labs in Haifa Agenda Blue Gene/L Background Blue Gene/L
More informationASKAP Central Processor: Design and Implementa8on
ASKAP Central Processor: Design and Implementa8on Calibra8on and Imaging Workshop 2014 Ben Humphreys ASKAP So(ware and Compu3ng Project Engineer 3rd - 7th March 2014 ASTRONOMY AND SPACE SCIENCE Australian
More informationBlueGene/L (No. 4 in the Latest Top500 List)
BlueGene/L (No. 4 in the Latest Top500 List) first supercomputer in the Blue Gene project architecture. Individual PowerPC 440 processors at 700Mhz Two processors reside in a single chip. Two chips reside
More informationData storage services at KEK/CRC -- status and plan
Data storage services at KEK/CRC -- status and plan KEK/CRC Hiroyuki Matsunaga Most of the slides are prepared by Koichi Murakami and Go Iwai KEKCC System Overview KEKCC (Central Computing System) The
More informationSurFS Product Description
SurFS Product Description 1. ABSTRACT SurFS An innovative technology is evolving the distributed storage ecosystem. SurFS is designed for cloud storage with extreme performance at a price that is significantly
More informationarxiv: v3 [astro-ph.im] 30 Apr 2018
Cobalt: A GPU-based correlator and beamformer for OFAR P. Chris Broekema 1, J. Jan David Mol 1, Ronald Nijboer 1, Alexander S. van Amesfoort 1, Michiel A. Brentjens 1, G. Marcel oose 1, Wouter F. A. Klijn
More informationReal Parallel Computers
Real Parallel Computers Modular data centers Background Information Recent trends in the marketplace of high performance computing Strohmaier, Dongarra, Meuer, Simon Parallel Computing 2005 Short history
More informationPotential Alignment of and TSN for Industrial
Potential Alignment of 1722.1 and TSN for Industrial Eric Gardiner (eric.gardiner@) Key Ideas Many industrial applications need capabilities defined in the 802.1 TSN Task Group Examples: ASrev, Qbv, Qbu,
More informationControlling Field-of-View of Radio Arrays using Weighting Functions
Controlling Field-of-View of Radio Arrays using Weighting Functions MIT Haystack FOV Group: Lynn D. Matthews,Colin Lonsdale, Roger Cappallo, Sheperd Doeleman, Divya Oberoi, Vincent Fish Fulfilling scientific
More informationVideo Surveillance EMC Storage with LENSEC Perspective VMS
Video Surveillance EMC Storage with LENSEC Perspective VMS Sizing Guide H14768 01 Copyright 2016 EMC Corporation. All rights reserved. Published in the USA. Published March, 2016 EMC believes the information
More informationScience Data Model v2
Science Data Model v2 François Viallefond Observatoire de Paris - LERMA Steve Torchinsky Observatoire de Paris - USN François Viallefond Science Data Model v2 CALIM2010, Dwingeloo, 24 Aug 2010 1 Science
More informationRadio astronomy data reduction at the Institute of Radio Astronomy
Mem. S.A.It. Suppl. Vol. 13, 79 c SAIt 2009 Memorie della Supplementi Radio astronomy data reduction at the Institute of Radio Astronomy J.S. Morgan INAF Istituto di Radioastronomia, Via P. Gobetti, 101
More informationOptimizing Parallel Access to the BaBar Database System Using CORBA Servers
SLAC-PUB-9176 September 2001 Optimizing Parallel Access to the BaBar Database System Using CORBA Servers Jacek Becla 1, Igor Gaponenko 2 1 Stanford Linear Accelerator Center Stanford University, Stanford,
More informationComputational issues for HI
Computational issues for HI Tim Cornwell, Square Kilometre Array How SKA processes data Science Data Processing system is part of the telescope Only one system per telescope Data flow so large that dedicated
More informationObjectives. 1. Introduction:
University of Jordan Faculty of Engineering & Technology Computer Engineering Department Advance Networks Laboratory 0907529 Exp.5 Spanning-Tree Protocol (STP) Objectives 1. Explain the role of redundancy
More informationSurveillance Dell EMC Storage with Cisco Video Surveillance Manager
Surveillance Dell EMC Storage with Cisco Video Surveillance Manager Configuration Guide H14001 REV 1.1 Copyright 2015-2017 Dell Inc. or its subsidiaries. All rights reserved. Published May 2015 Dell believes
More informationLecture 17 Reprise: dirty beam, dirty image. Sensitivity Wide-band imaging Weighting
Lecture 17 Reprise: dirty beam, dirty image. Sensitivity Wide-band imaging Weighting Uniform vs Natural Tapering De Villiers weighting Briggs-like schemes Reprise: dirty beam, dirty image. Fourier inversion
More informationCisco Tetration Analytics Platform: A Dive into Blazing Fast Deep Storage
White Paper Cisco Tetration Analytics Platform: A Dive into Blazing Fast Deep Storage What You Will Learn A Cisco Tetration Analytics appliance bundles computing, networking, and storage resources in one
More informationCoflow. Recent Advances and What s Next? Mosharaf Chowdhury. University of Michigan
Coflow Recent Advances and What s Next? Mosharaf Chowdhury University of Michigan Rack-Scale Computing Datacenter-Scale Computing Geo-Distributed Computing Coflow Networking Open Source Apache Spark Open
More informationShared Memory to FITS Formatter Data Structure MAY 19, 2015
Shared Memory to FITS Formatter Data Structure RICHARD BLACK MAY 19, 215 VERSION.3 1 Overview CPU/GPU Threads (BYU) FITS Formatters (WVU) RT Beamformer Thread PSRFITS Formatter Thread 5 Coarse or 16 Fine
More informationAutomated Control for Elastic Storage
Automated Control for Elastic Storage Summarized by Matthew Jablonski George Mason University mjablons@gmu.edu October 26, 2015 Lim, H. C. and Babu, S. and Chase, J. S. (2010) Automated Control for Elastic
More informationS.A. Torchinsky, A. van Ardenne, T. van den Brink-Havinga, A.J.J. van Es, A.J. Faulkner (eds.) 4-6 November 2009, Château de Limelette, Belgium
WIDEFIELD SCIENCE AND TECHNOLOGY FOR THE SKA SKADS CONFERENCE 2009 S.A. Torchinsky, A. van Ardenne, T. van den Brink-Havinga, A.J.J. van Es, A.J. Faulkner (eds.) 4-6 November 2009, Château de Limelette,
More informationPowering Real-time Radio Astronomy Signal Processing with latest GPU architectures
Powering Real-time Radio Astronomy Signal Processing with latest GPU architectures Harshavardhan Reddy Suda NCRA, India Vinay Deshpande NVIDIA, India Bharat Kumar NVIDIA, India What signals we are processing?
More informationRadio Interferometry Bill Cotton, NRAO. Basic radio interferometry Emphasis on VLBI Imaging application
Radio Interferometry Bill Cotton, NRAO Basic radio interferometry Emphasis on VLBI Imaging application 2 Simplest Radio Interferometer Monochromatic, point source 3 Interferometer response Adding quarter
More informationINTRODUCTION DATA COMMUNICATION TELECOMMUNICATIONS SYSTEM COMPONENTS 1/28/2015. Satish Chandra satish0402.weebly.com
INTRODUCTION DATA COMMUNICATION Satish Chandra satish0402.weebly.com The term telecommunication means communication at a distance. The word data refers to information presented in whatever form is agreed
More informationPORTAL. A Case Study. Dr. Kristin Tufte Mark Wong September 23, Linux Plumbers Conference 2009
PORTAL A Case Study Dr. Kristin Tufte (tufte@cecs.pdx.edu) Mark Wong (markwkm@postgresql.org) Linux Plumbers Conference 2009 September 23, 2009 Overview What is PORTAL? How PORTAL works Improving PORTAL
More informationBuffer Management for XFS in Linux. William J. Earl SGI
Buffer Management for XFS in Linux William J. Earl SGI XFS Requirements for a Buffer Cache Delayed allocation of disk space for cached writes supports high write performance Delayed allocation main memory
More informationMinutes of Meeting LOFAR Software
Minutes of Meeting LOFAR Software Date: 2010-07-21 Next meeting: 2010-07-29 9:30-10:30 Multimedia room Present: Andre Gunst Ronald Nijboer Ruud Overeem John Romein No Michael Wise No Harm Munk Hanno Holties
More informationSharkFest'17 US. Validating Your Packet Capture: How to be sure you ve captured correct & complete data for analysis
SharkFest'17 US Validating Your Packet Capture: How to be sure you ve captured correct & complete data for analysis Dupes, Drops, and Misses, Oh My! *New title; same product J. Scott Haugdahl and Mike
More informationFCNP: Fast I/O on the Blue Gene/P
FCNP: Fast I/O on the Blue Gene/P John W. Romein romein@astron.nl Stichting ASTRON (Netherlands Institute for Radio Astronomy), Dwingeloo, The Netherlands Abstract This paper describes the Fast Collective-Network
More informationAgilent Technologies EZJIT and EZJIT Plus Jitter Analysis Software for Infiniium Series Oscilloscopes
Agilent Technologies EZJIT and EZJIT Plus Jitter Analysis Software for Infiniium Series Oscilloscopes Data Sheet Features of the EZJIT Plus software that optimize jitter analysis include: Easy-to-use jitter
More informationCS 425 / ECE 428 Distributed Systems Fall 2015
CS 425 / ECE 428 Distributed Systems Fall 2015 Indranil Gupta (Indy) Measurement Studies Lecture 23 Nov 10, 2015 Reading: See links on website All Slides IG 1 Motivation We design algorithms, implement
More information15-441: Computer Networking. Lecture 24: Ad-Hoc Wireless Networks
15-441: Computer Networking Lecture 24: Ad-Hoc Wireless Networks Scenarios and Roadmap Point to point wireless networks (last lecture) Example: your laptop to CMU wireless Challenges: Poor and variable
More informationSmart Card Data in Public Transport
Department of Technology & Operations Management Smart Card Data in Public Transport Paul Bouman Also based on work of: Evelien van der Hurk, Timo Polman, Leo Kroon, Peter Vervest and Gábor Maróti Complexity
More informationEVLA Software High-Level Design Presentation Notes
Expanded Very Large Array EVLA-SW-??? Revision:1.0 2004-Feb-25 Presentation Notes B.Waters EVLA Software High-Level Design Presentation Notes EVLA Software Design Group: T. Morgan, K. Ryan, K. Sowinski,
More informationCorrelator Field-of-View Shaping
Correlator Field-of-View Shaping Colin Lonsdale Shep Doeleman Vincent Fish Divya Oberoi Lynn Matthews Roger Cappallo Dillon Foight MIT Haystack Observatory Context SKA specifications extremely challenging
More informationDistributed ASCI Supercomputer DAS-1 DAS-2 DAS-3 DAS-4 DAS-5
Distributed ASCI Supercomputer DAS-1 DAS-2 DAS-3 DAS-4 DAS-5 Paper IEEE Computer (May 2016) What is DAS? Distributed common infrastructure for Dutch Computer Science Distributed: multiple (4-6) clusters
More informationALCF Argonne Leadership Computing Facility
ALCF Argonne Leadership Computing Facility ALCF Data Analytics and Visualization Resources William (Bill) Allcock Leadership Computing Facility Argonne Leadership Computing Facility Established 2006. Dedicated
More informationAssignment 1 due Mon (Feb 4pm
Announcements Assignment 1 due Mon (Feb 19) @ 4pm Next week: no classes Inf3 Computer Architecture - 2017-2018 1 The Memory Gap 1.2x-1.5x 1.07x H&P 5/e, Fig. 2.2 Memory subsystem design increasingly important!
More informationComparison of Alternatives for Calibration of the High-Band Receiver 2015 at 25 o C
Comparison of Alternatives for Calibration of the High-Band Receiver 2015 at 25 o C Raul Monsalve SESE, Arizona State University June 4, 2015 2 This document presents a comparison of results when using
More informationRemoving Radio Frequency Interference in the LOFAR using GPUs
Vrije Universiteit Amsterdam Master Thesis Removing Radio Frequency Interference in the LOFAR using GPUs Author: Linus Schoemaker Supervisors: Dr. Rob. V. van Nieuwpoort Alessio Sclocco A thesis submitted
More informationUsing the NMIA GPS Common View Time Transfer Calibration System
Using the NMIA GPS Common View Time Transfer Calibration System Version 1.1 Last modified 2016-09-25 Getting started This calibrated, dual-frequency GPS common-view system does the following: a) It collects
More informationVM Aware Fibre Channel
White Paper White Paper VM-ID VM Aware Fibre Channel Virtual Machine Traffic Visibility for SANs StorFusion VM-ID feature on QLogic Gen6 (32G) and Enhanced Gen5 (16G) Fibre Channel KEY BENEFITS Increases
More informationMinutes of Meeting LOFAR Software
Minutes of Meeting LOFAR Software Date: 2007-11-28 Next meeting: 2007-12-05 9:15-10:15 Minnaert room Present: Andre Gunst No Ronald Nijboer Ruud Overeem John Romein Michael Wise cc: Arthur Coolen, Jurjen
More informationComputer Systems. Communication (networks, radio links) Meatware (people, users don t forget them)
Computers are useful machines, but they are generally useless by themselves. Computers are usually part of a system a computer system includes: Hardware (machines) Software (programs, applications) Communication
More informationDell EMC Storage with the Avigilon Control Center System
Dell EMC Storage with the Avigilon Control Center System Surveillance July 2018 H15398.4 Sizing Guide Abstract This guide helps you understand the benefits of using a Dell EMC storage solution with Avigilon
More informationMIMO OTA Environment Builder. User Manual
MIMO OTA Environment Builder User Manual Spirent 541 Industrial Way West Eatontown, NJ 07724 USA Email: sales@spirent.com Web: http://www.spirent.com AMERICAS 1-800-SPIRENT +1-818-676-2683 sales@spirent.com
More informationQuick Start Guide. System Release 1.0. Upgrade Notice Install Connectorized Radio Install Integrated Radio Power On Configure Units for Radio Link
Quick Start Guide System Release 1.0 Upgrade Notice Install Connectorized Radio Install Integrated Radio Power On Configure Units for Radio Link SPECIAL SOFTWARE UPGRADE NOTICE Important! All users of
More informationRonald van der Pol
Ronald van der Pol Contributors! " Ronald van der Pol! " Freek Dijkstra! " Pieter de Boer! " Igor Idziejczak! " Mark Meijerink! " Hanno Pet! " Peter Tavenier Outline! " Network bandwidth
More informationSpectraTec X. Multi- λ Laser Light Source BLUE SKY RESEARCH WAVELENGTHS
Multi- λ Laser Light Source BLUE SKY RESEARCH Up to four individual laser wavelengths One single mode PM fiber output Ultra-stable power output Compact : 165mm x 125mm x 34mm Integrated control and drive
More informationLOFAR Data Storage and Handling. Ger van Diepen ASTRON. On behalf of Imaging Pipeline Team
LOFAR Data Storage and Handling Ger van Diepen ASTRON On behalf of Imaging Pipeline Team -1- Outline LOFAR Imaging Pipeline data flow and data format Data Handling Tools -2- Imaging Pipeline data flow
More informationAdvanced Multi-Beam Spect rom et er for t he GBT
Advanced Multi-Beam Spect rom et er for t he Conceptual Software Design Amy Shelton, Patrick Brandt, Bob Garwood, Joe Masters, Mark Whitehead NRAO and U.C. Berkeley Joint Conceptual Design Review January
More informationTop500 Supercomputer list
Top500 Supercomputer list Tends to represent parallel computers, so distributed systems such as SETI@Home are neglected. Does not consider storage or I/O issues Both custom designed machines and commodity
More informationWavelength-Switched to Flex-Grid Optical Networks
Book Chapter Review-Evolution from Wavelength-Switched to Flex-Grid Optical Networks Tanjila Ahmed Agenda ØObjective ØIdentifying the Problem ØSolution: Flex-Grid Network ØFixed-grid DWDM Architecture
More informationInformation systems playground the target infrastructure
Exp Astron (2013) 35:367 389 DOI 10.1007/s10686-011-9262-1 ORIGINAL ARTICLE Information systems playground the target infrastructure Scaling Astro-WISE into the petabyte range Andrey N. Belikov Fokke Dijkstra
More informationDTC (Dynspec Toolkit Content)
Netherlands Institute for Radio Astronomy DTC (Dynspec Toolkit Content) Nicolas Vilchez Lofar Status Meeting, ASTRON, 29 th October 2014 ASTRON is part of the Netherlands Organisation for Scientific Research
More informationCLOUD-BASED DDOS PROTECTION FOR HOSTING PROVIDERS
CLOUD-BASED DDOS PROTECTION FOR HOSTING PROVIDERS A STRONG PARTNER OUR PORTFOLIO COMPANY Expand your own portfolio with an IT security expert that has redefined DDoS protection from the cloud. Link11 is
More informationTest-Traffic Project Status and Plans
Test-Traffic Project Status and Plans Henk Uijterwaal, Fotis Georgatos, Johann Gutauer, Daniel Karrenberg, René Wilhelm RIPE-NCC New Projects Group RIPE-36, Budapest, May 2000 1 Overview Manpower, Email
More informationComet Virtualization Code & Design Sprint
Comet Virtualization Code & Design Sprint SDSC September 23-24 Rick Wagner San Diego Supercomputer Center Meeting Goals Build personal connections between the IU and SDSC members of the Comet team working
More informationOptical Networking Activities in NetherLight
Optical Networking Activities in NetherLight TERENA Networking Conference 2003 Zagreb, May 19-22, 2003 Erik Radius Manager Network Services, SURFnet Outline NetherLight What is it Why: the rationale From
More information