IVTW - Auckland
|
|
|
- Albert Griffin Malone
- 5 years ago
- Views:
Transcription
1
2 formatter recorder
3 MarkIV VLBA RS422 Mark5A
4 DBBC VSI/H FiLa10G ethernet Mark5C Mark6 FlexBuff
5 RS422 MarkIV VLBA Analog VSI/H DBBC[2] R1002 CDAS ADS[123]000 Digital Ethernet DBBC[2]+FiLa10G R[2]DBE CDAS2 BRAS Digital
6
7 RS422 MarkIV VLBA 512 Mbps VSI/H DBBC[2] R1002 CDAS ADS[123] Mbps Ethernet DBBC[2]+FiLa10G R[2]DBE CDAS2 BRAS 8192 Mbps
8 RS422 MarkIV VLBA Mark5A VSI/H DBBC[2] R1002 CDAS ADS[123]000 Mark5B(+) Ethernet DBBC[2]+FiLa10G R[2]DBE CDAS2 BRAS Mark5C Mark6 FlexBuff
9 How to get all those bytes to disk?
10 and Marking your 6 s Harro Verkouter
11 In the beginning... mem PCI bus bank a bank b CPU, Memory Mark5 system StreamstorCard I/O board telescope/ formatter
12 In the beginning... mem PCI bus bank a bank b CPU, Memory Mark5 system StreamstorCard I/O board telescope/ formatter
13 In the beginning... (5A) disk disk.... disk disk PATA RAID Controller PCI FPDP I/O board RS422
14 In the beginning... (5B) disk disk.... disk disk PATA RAID Controller FPDP I/O board VSI/H
15 These days Mbps 512Mbps
16 These days
17
18
19 10Gbps 10Gbps CPU0... CPUn lots of memory
20 What are the differences? Mark6 FlexBuff 4 removable disk packs fixed disks
21 MIT Haystack EVN Mark5A Mark5B Mark5C Mark6 Mark5A DIMino drs cplane/dplane jive5ab jive5ab jive5ab jive5ab FlexBuff - jive5ab
22 What are the differences? Mark6 /mnt/disks/... striped in single file/disk extra headers in stream FlexBuff /mnt/disk... striped in file per block just the facts, ma m!
23 Mountpoints Mark6 /mnt/disks/1/0... /1... / /7 /mnt/disks/2/0... /1... / /7 /mnt/disks/3/ FlexBuff /mnt/disk0 /mnt/disk1 /mnt/disk2 /mnt/disk3... /mnt/disk31
24 Mark6+d-plane /mnt/disks/1/0/data/eg053.m6 10Gbps /mnt/disks/1/1/data/eg053.m6 /mnt/disks/1/2/data/eg053.m6 /mnt/disks/1/3/data/eg053.m6
25 Mark6+d-plane /mnt/disks/1/0/data/eg053.m6 0 DATA 10Gbps 10 MB /mnt/disks/1/1/data/eg053.m6 /mnt/disks/1/2/data/eg053.m6 /mnt/disks/1/3/data/eg053.m6 recording application header VLBI data
26 Mark6+d-plane /mnt/disks/1/0/data/eg053.m6 0 DATA 10Gbps 10 MB /mnt/disks/1/1/data/eg053.m6 1 DATA /mnt/disks/1/2/data/eg053.m6 /mnt/disks/1/3/data/eg053.m6 recording application header VLBI data
27 Mark6+d-plane /mnt/disks/1/0/data/eg053.m6 0 DATA 6 DATA 10Gbps /mnt/disks/1/1/data/eg053.m6 1 DATA 7 DATA /mnt/disks/1/2/data/eg053.m6 2 DATA 5 DATA /mnt/disks/1/3/data/eg053.m6 recording application header VLBI data 3 DATA 4 DATA
28 FlexBuff+jive5ab /mnt/disk0/eg053/ 10Gbps /mnt/disk1/eg053/ /mnt/disk2/eg053/ /mnt/disk3/eg053/
29 FlexBuff+jive5ab /mnt/disk0/eg053/ eg Gbps 256 MB /mnt/disk1/eg053/ /mnt/disk2/eg053/ /mnt/disk3/eg053/ recording application header VLBI data
30 FlexBuff+jive5ab /mnt/disk0/eg053/ eg Gbps 256 MB /mnt/disk1/eg053/ eg /mnt/disk2/eg053/ /mnt/disk3/eg053/ recording application header VLBI data
31 FlexBuff+jive5ab /mnt/disk0/eg053/ eg Gbps eg /mnt/disk1/eg053/ eg eg /mnt/disk2/eg053/ eg eg /mnt/disk3/eg053/ recording application header VLBI data eg eg
32 Still very similar! capture block assign sequence number write to next available disk
33 Still very similar! where to stripe data? in which format?
34 jive5ab commands for FlexBuff/Mark6 Where to stripe data? set_disks = /path/to/disk* [ : more ] set_disks = [1234]+ emsn [ : more ] Mark6 disk module number(s) or emsn(s) set_disks = ^(foo bar)[^0-9]$ [ : more ] full regular expression support Set recording format record = mk6 : 0 (FlexBuff vbs format) record = mk6 : 1 (d-plane v2 format)
35 How is data captured? d-plane tcpdump ni ethx udp only, extract bytes from pkt jive5ab (IPv4:)PORT sockets all supported protocols: udp, vtp, tcp, udt
36 Supported data formats d-plane Assumes VDIF/Mark5B packet =...(*) jive5ab Record explicit format: all supported data formats mode=vdif_ mode=mark5b mode=mkiv1_ (*) see Mark5C packet= command
37 Multiple streams d-plane jive5ab 1 recording 1 streams 1 recording = 1 stream subgroups to split 1 parallel recording, streams to different each indepently modules configurable (set_disks=)
38 Disk management c-plane disk management: mount/unmount format jive5ab no disk management: better done with shell commands/scripts(*) (*) c-plane is Python which generates and executes shell commands for you: for dsk,mp in [( /dev/sdb1, /mnt/.. ),...]: subprocess.call([ mount, -t, xfs, dsk, mp])
39 Slamming the bytes on disk is only half the story!
40 post-recording check recorder state play back at correlator e-transfer/conversion disk-shippingless operations...
41 Useful Mark5 commands on FlexBuff/ 6 # disk space on selected disks rtime? # uses recording data rate from mode= dir_info? # recorded space and total free space # post recording scan_set =... # see Mark5 manual scan_check? # will recognize VDIF (heuristically) # extract data range selected via scan_set = disk2file = /path/to/file disk2net = connect : host.ip.com
42 Advantages FlexBuff recording format each file is a (small) time slice: only VLBI payload individually correlatable by DiFX and SFXC individually inspectable (e.g. file_check?) transferable (256MB is a manageable size) can use UNIX utilities + scripts to locate/manipulate data
43 EVN goes disk shipping less operations
44 Internet
45 FlexBuff advantages Independent of FlexBuff layout at station/jive vbs vbs transfers are a sync operation only missing bits are transferred
46 Station JIVE /mnt/disk0/eg053/ eg eg /mnt/disk1/eg053/ eg eg /mnt/disk2/eg053/ eg eg /mnt/disk3/eg053/ eg eg Internet /mnt/disk0/eg053/ eg eg eg eg /mnt/disk2/eg053/ eg eg eg eg
47 Sidekicks c-plane/d-plane gather/vdifuse jive5a vbs_fs m5copy gather/vdifuse/vbs_fs: present scattered recording as one file gather copies vdifuse/vbs_fs are FUSE virtual file systems m5copy: copy VLBI data from somewhere to elsewhere $> m5copy mk6://host:port/<recording>... $> m5copy vbs://host:port/<recording>...
48 SRC Mark5 File FlexBuff Mark6 Note: rem source and rem destination are different DST Mark5 File FlexBuff Mark6 lcl rem lcl rem lcl rem lcl rem lcl rem lcl rem lcl rem lcl rem
49 jive5ab new command line arguments $> jive5ab [-6] [-f <format>] -6 look for Mark6 mountpoints (use set_disks= to -f <format> set default recording format: mk6 record in native Mark6 mode flexbuff record in FlexBuff mode (use record=mk6:[01] to
50 Summarizing FlexBuff/Mark6 jive5ab 2.7.* can record in either format on either system read either format on either system Differences wrt MIT Haystack c-plane/d-plane software: only record known data format (not arbitrary packet dump) but easy to specify the data format (libmk5access-like) VDIF_ / MARK5B c-plane: >1 network card 1 recording jive5ab: >1 network card >1 recording per stream control where it s recorded starting a recording scripted anyway
51 Record recipe for FlexBuff/Mark6 # configure network net_protocol = udp pudp tcp udt # which protocol mtu = 9000 # UDP based protocols need this net_port = # port number to listen on for data # where to stripe data [optional: in which format?] set_disks =... # default: flexbuff disks record = mk6 : 0 1 # default: vbs format # what is the format of the data being recorded? mode = VDIF_ # and record it record = on : <scanlabel>
52 Thank you for your attention
53 Availability jive5ab.deb installation, source code Flexbuff scripts and documentation direct download link, always latest version changelogs of m5copy and jive5ab for inspection
54 Summarizing Mark6/FlexBuff jive5ab will NOT: read FlexBuff format read Mark6 format use FUSE(*) virtual file system for reading as single file vbs_fs (for FlexBuff format) distributed by JIVE./vbs_fs [options] /path/to/dir for Mark6 format either: MIT Haystack (Geoff Crew?) Jan Wagner s fusemk6 (*)
55 Remember scan_set=?
56 Remember scan_set=? # In order to fully support: scan_set = n15x1_o6_no0003 : 10m30s : +2s disk2file = /path/to/file
57 Remember scan_set=? # In order to fully support: scan_set = n15x1_o6_no0003 : 10m30s : +2s disk2file = /path/to/file jive5ab must be able to read back the recording!
58 Remember scan_set=? # In order to fully support: scan_set = n15x1_o6_no0003 : 10m30s : +2s disk2file = /path/to/file jive5ab must be able to read back the recording! disk2net = connect : host.ip.com
59 Upcoming m5copy capabilities Copy FlexBuff or Mark6 recordings anywhere: To local or remote file: $> m5copy vbs://.../ file://[host.ip]/path/ $> m5copy mk6://.../ file://[host.ip]/path/ To remote Mark5: $> m5copy vbs://.../ mk5://host.ip/path/ $> m5copy mk6://.../ mk5://host.ip/path/... etc...
60 Upcoming m5copy capabilities Resume an interrupted transfer! $> m5copy --resume [...] SRC DST Only works on limited set of transfers: DST must be file://.../ other endpoints do not support appending SRC can be mk5, file, vbs or mk6 But works on local + remote transfers!
61 vbs_fs FUSE file system novelties Use to present FlexBuff style recordings as single files $> vbs_fs [-6] [...] /path/to/dir Acquired command line option -6 look in Mark6 mountpoints for recordings Increased performance by scheduling reads by disk Increased stability by disabling background indexing
62 Summarizing FlexBuff/Mark6 jive5ab can record in either format on either system read either format on either system Differences wrt Haystack c-plane/d-plane software: only record known data format (not arbitrary packet dump) but easy to specify the data format (libmk5access-like) VDIF_ / MARK5B cplane: >1 network card 1 recording jive5ab: >1 network card >1 recording per stream control where it s recorded starting a recording scripted anyway
63 Thank you for your attention
64 Availability jive5ab.deb installation, source code Flexbuff scripts and documentation direct download links, always latest version changelogs of m5copy and jive5ab for inspection
VLBI Recording et al.
acquisition, formats and transfer Harro Verkouter ? VLBI Recording et al. verkouter@jive.eu Analog Digital FM radio, TV visible gamma VLBI Recording et al. verkouter@jive.eu radio astronomy VLBI Recording
jive5ab The Swiss Army knife of (e-)vlbi Harro Verkouter
jive5ab The Swiss Army knife of (e-)vlbi Harro Verkouter Archaelogy $> cd ~/src/jive5ab $> grep 'int main(' *cc test.cc:int main(int argc, char** argv) { Archaelogy aug 2007 256Mbps e-vlbi w/ China demo
JOINT INSTITUTE FOR VLBI IN EUROPE OUDE HOOGEVEENSEDIJK 4, DWINGELOO!
JOINT INSTITUTE FOR VLBI IN EUROPE OUDE HOOGEVEENSEDIJK 4, DWINGELOO! Telephone: +31 (0) 592 596500 Fax: +31 (0) 592 596539 27 August 2015 TO: Distribution FROM: Harro Verkouter SUBJECT: jive5ab command
JOINT INSTITUTE FOR VLBI IN EUROPE OUDE HOOGEVEENSEDIJK 4, DWINGELOO!
JOINT INSTITUTE FOR VLBI IN EUROPE OUDE HOOGEVEENSEDIJK 4, DWINGELOO Telephone: +31 (0) 592 596500 Fax: +31 (0) 592 596539 13 March 2018 TO: Distribution FROM: Harro Verkouter SUBJECT: jive5ab command
Real-Time E-VLBI with the SFXC Software Correlator. Mark Kettenis Aard Keimpema JIVE
Real-Time E-VLBI with the SFXC Software Correlator Mark Kettenis kettenis@jive.nl Aard Keimpema keimpema@jive.nl JIVE SFXC SFXC = S? FX Correlator Where S? used to mean Super Uses MPI to distribute/parallelize
Mark6 Operations. Chester Chet Ruszczyk
Mark6 Operations Chester Chet Ruszczyk chester@haystack.mit.edu Objective Mark6 General Information Mark6 Applications Disk Modules Recording Play Back 2 Mark6 General Information Setup Cabling for SAS
WP7. Mark Kettenis April 18, Joint Institute for VLBI in Europe
WP7 Mark Kettenis kettenis@jive.nl Joint Institute for VLBI in Europe April 18, 2011 Mark Kettenis kettenis@jive.nl (JIVE) NEXPReS WP7 April 18, 2011 1 / 16 Goals Create an automated, distributed correlator
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS October 2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886 16 October 2013 Telephone: 781-981-5400 Fax: 781-981-0590 TO: Distribution FROM: Alan R. Whitney, Dan L. Smythe,
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS November 2002
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886 18 November 2002 Telephone: 978-692-4764 Fax: 781-981-0590 TO: Distribution FROM: A. R. Whitney and J. A. Ball SUBJECT:
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS May 2011
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886 27 May 2011 Telephone: 781-981-5400 Fax: 781-981-0590 TO: VLBI2010/mm-VLBI development group FROM: Alan R. Whitney,
Guifré Molera, J. Ritakari & J. Wagner Metsähovi Radio Observatory, TKK - Finland
European 4-Gbps VLBI and evlbi Click to edit Master subtitle style Guifré Molera, J. Ritakari & J. Wagner Observatory, TKK - Finland 1 Outline Introduction Goals for 4 Gbps Testing Results Product Conclusions
TimeServerVlbi - A VLBI data stream real-time monitor
TimeServerVlbi - A VLBI data stream real-time monitor Matteo Stagni March 25, 2015 IRA 485/15 Abstract A couple of Python scripts that serve the purpose of monitoring VLBI data streams and check their
Mark 6 Next-Generation VLBI Data System
Mark 6 Next-Generation VLBI Data System, IVS 2012 General Meeting Proceedings, p.86 90 http://ivscc.gsfc.nasa.gov/publications/gm2012/whitney.pdf Mark 6 Next-Generation VLBI Data System Alan Whitney, David
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS March 2003
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886 19 March 2003 Telephone: 978-692-4764 Fax: 781-981-0590 TO: Distribution FROM: A. R. Whitney and J. A. Ball SUBJECT:
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS December 2002
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886 24 December 2002 Telephone: 978-692-4764 Fax: 781-981-0590 TO: Distribution FROM: A. R. Whitney and J. A. Ball SUBJECT:
Anthony Rushton. University of Manchester
Application of VSI-E Anthony Rushton University of Manchester VSI-E Transfer Protocol (VTP) This work attemps to comply with the draft VSI-E standard Rev. 2.7 VSI-E Tranfer protocol (VTP - version 1.0.P)
Mark 6: design and status update
VLBI Technical Meeting MIT Haystack Observatory 2012.10.23 Roger Cappallo Alan Whitney Chet Ruszczyk Mark 6: design and status update Why Mark6? drivers for everincreasing datarates Sensitivity! VLBI2010
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS October 10, 2014
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886 October 10, 2014 Telephone: 781-981-5400 Fax: 781-981-0590 TO: Distribution FROM: Alan Whitney, Chester Ruszczyk
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS September 2003
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886 4 September 2003 Telephone: 978-692-4764 Fax: 781-981-0590 TO: Distribution FROM: A. R. Whitney and J. A. Ball SUBJECT:
PoS(EXPReS09)036. e-vlbi Networking Tricks. Paul Boven, for the EXPReS team Joint Institute for VLBI in Europe (JIVE)
, for the EXPReS team Joint Institute for VLBI in Europe (JIVE) E-mail: boven@jive.nl Real-time e-vlbi is made possible by having access to long-distance, high-performance networks - straight from the
Mark 6 Utility Programs and Commands
Mark 6 Utility Programs and Commands Roger Cappallo Last update: 2015-10- 09 Introduction There are a number of utility programs which facilitate use of the mk6, making it more straightforward and robust.
Mark 5C VLBI Data System
Mark 5C VLBI Data System Alan Whitney Chet Ruszczyk Kevin Dudevoir MIT Haystack Observatory Walter Brisken Jon Romney National Radio Astronomy Observatory 17 September 2007 e-vlbi Workshop MPI Bonn, Germany
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS December 2009
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY MARK 5 MEMO #081 WESTFORD, MASSACHUSETTS 01886 10 December 2009 Telephone: 978-692-4764 Fax: 781-981-0590 TO: FROM: SUBJECT: General Mark 5 group
PoS(11th EVN Symposium)112
Arpad Szomoru 1 Joint Institute for VLBI in Europe P.O. Box 2, 7990 AA Dwingeloo, the Netherlands E-mail: szomoru@jive.nl Paul Boven Joint Institute for VLBI in Europe P.O. Box 2, 7990 AA Dwingeloo, the
The Mark 5B VLBI Data System
The Mark 5B VLBI Data System Alan Whitney MIT Haystack Observatory 25 Oct 2006 NRAO-Haystack meeting Haystack Observatory Mark 5B Data System Features Full VSI-H compatibility Same chassis as Mark 5A;
D Demonstration of integrated BoD testing and validation
D6.06 - Demonstration of integrated BoD testing and validation Deliverable Number 06 WP # 6 Date 2012-12-30 Authors Jimmy Cullen, The University of Manchester Fedde Bloemhof, JIVE Paul Boven, JIVE Ralph
Mark 6 16Gbps VLBI Data System
Mark 6 16Gbps VLBI Data System Alan Whitney & David Lapsley for the Mark 6 development team MIT Haystack Observatory 5 December 2011 DiFX workshop MIT Haystack Observatory 1 Mark 6 project 16 Gbps COTS-based
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS November 2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886 14 November 2013 Telephone: 781-981-5400 Fax: 781-981-0590 TO: Distribution FROM: Alan Whitney, Chester Ruszczyk
Notes about visual Mark5 (vmk5) interface v. 2
Notes about visual Mark5 (vmk5) interface v. 2 Upgrades from previous 1 version Disks size: thanks to new rtime 1 command it is now possible to recover the proper bank size even if the Mark5 is busy. The
Test report of transparent local/remote application programming interface for storage elements
NEXPReS is an Integrated Infrastructure Initiative (I3), funded under the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n RI-261525. Test report of transparent
Status of the Bonn Correlator MPIfR BKG correlator. Walter Alef Helge Rottmann
Status of the Bonn Correlator MPIfR BKG correlator Walter Alef Helge Rottmann Bonn correlator centre MK IV hardware correlator (XF) 15 Mark 5s: 8 x 5A, 4 x 5B, (1 x 5B+, 2 x 5C) Up to 1 Gbit/s data rate
Grid Integration of Future Arrays of Broadband Radio Telescopes moving towards e-vlbi
Grid Integration of Future Arrays of Broadband Radio Telescopes moving towards e-vlbi Marcin Okoń Poznań Supercomputing and Networking Center, Supercomputing Department INGRID 2007 S. Margherita Ligure,
Performance comparison of filesystems on RAID for e-vlbi data
Performance comparison of filesystems on RAID for e-vlbi data Matteo Stagni - Francesco Bedosti - Mauro Nanni April 23, 213 IRA 47/13 Abstract A thorough description of several tests conducted on a single
EXPReS SA1: at the half-way mark. Arpad Szomoru JIVE
EXPReS SA1: at the half-way mark Arpad Szomoru JIVE Outline Progress in 2007 Going intercontinental The next 18 months Slide #2 e-vlbi science/test runs 17 e-vlbi science projects accepted since 2006:
Oscillation of RED with 2way TCP bulk data traffic
First Author: Oscillation of RED with way TCP bulk data traffic Thomas Ziegler, Salzburg Polytechnic University; Thomas.Ziegler@fh-sbg.ac.at Second Author: Bernhard Hechenleitner, Salzburg Polytechnic
DiFX-Mark6 integration
DiFX-Mark6 integration correlator operations & tools Helge Rottmann Max-Planck-Institut für Radioastronomie 9 th DiFX Users and Developer Meeting Hobart, Tasmania Mark6 Overview Mark6 has 4 banks Modules
THE VLBA SENSITIVITY UPGRADE
THE VLBA SENSITIVITY UPGRADE Craig Walker, NRAO Eleventh Synthesis Imaging Workshop Socorro, June 10-17, 2008 CONTEXT 2 The VLBA is based on 20 year old technology Only limited new capabilities have been
Gigabit Ethernet Packet Capture. User s Guide
Gigabit Ethernet Packet Capture User s Guide Copyrights Copyright 2009 CACE Technologies, Inc. All rights reserved. This document may not, in whole or part, be: copied; photocopied; reproduced; translated;
LBA evlbi Developments. Chris Phillips evlbi Project Scientist 14 September 2007
LBA evlbi Developments Chris Phillips evlbi Project Scientist 14 September 2007 Summary First science paper Offering via normal call for proposals Partner in EXPReS Fringes to Sh as part of APAN Also Da,
Mark 5 Status and Developments
Mark 5 Status and Developments Alan Whitney MIT Haystack Observatory 14 May 2007 U.S. VLBI Technical Coordination Meeting NRAO Socorro, NM Mark 5 team Will Aldrich John Ball Peter Bolis Roger Cappallo
Mark 6 16Gbps VLBI Data System
Mark 6 16Gbps VLBI Data System Alan Whitney & David Lapsley for the Mark 6 development team MIT Haystack Observatory 14-15 November 2011 International e-vlbi workshop Broederstroom, S. Africa 1 Mark 6
b. Suppose the two packets are to be forwarded to two different output ports. Is it
Problem-1:[15] Suppose two packets arrive to two different input ports of a router at exactly the same time. Also suppose there are no other packets anywhere in the router. a. Suppose the two packets are
Lecture 2: Internet Structure
Lecture 2: Internet Structure COMP 332, Spring 2018 Victoria Manfredi Acknowledgements: materials adapted from Computer Networking: A Top Down Approach 7 th edition: 1996-2016, J.F Kurose and K.W. Ross,
Intro to LAN/WAN. Transport Layer
Intro to LAN/WAN Transport Layer Transport Layer Topics Introduction (6.1) Elements of Transport Protocols (6.2) Internet Transport Protocols: TDP (6.5) Internet Transport Protocols: UDP (6.4) socket interface
Computer Networks A Simple Network Analyzer Decoding Ethernet and IP headers
Computer Networks A Simple Network Analyzer Decoding Ethernet and IP headers Objectives The main objective of this assignment is to gain an understanding of network activities and network packet formats
COMS Introduction to Computers. Networking
COMS 1001 Introduction to Computers Networking What's Ahead Networking layers Network Speeds Protocols, sockets, client/server Routing, DNS, Ethernet, LANs, wireless What is a Network? Loose definition:
EVN/JIVE Technical developments. Arpad Szomoru, JIVE
EVN/JIVE Technical developments Arpad Szomoru, JIVE Correlator upgrades New(ish) data output platform Solaris AMD server with large raid array Fully interchangeable with control computers Re-circulation
Lecture 20: Link Layer
Lecture 20: Link Layer COMP 332, Spring 2018 Victoria Manfredi Acknowledgements: materials adapted from Computer Networking: A Top Down Approach 7 th edition: 1996-2016, J.F Kurose and K.W. Ross, All Rights
K2289: Using advanced tcpdump filters
K2289: Using advanced tcpdump filters Non-Diagnostic Original Publication Date: May 17, 2007 Update Date: Sep 21, 2017 Topic Introduction Filtering for packets using specific TCP flags headers Filtering
Performance Characteristics on Fast Ethernet and Gigabit networks
Version 2.5 Traffic Generator and Measurement Tool for IP Networks (IPv4 & IPv6) FTTx, LAN, MAN, WAN, WLAN, WWAN, Mobile, Satellite, PLC, etc Performance Characteristics on Fast Ethernet and Gigabit networks
Storage Systems. Storage Systems
Storage Systems Storage Systems We already know about four levels of storage: Registers Cache Memory Disk But we've been a little vague on how these devices are interconnected In this unit, we study Input/output
Mark 5A System User s Manual
Mark 5A System User s Manual MIT Haystack Observatory 14 January 2004 1. Introduction 2. Brief Theory of Operation 2.1 Operating modes 2.2 Data Modes 2.3 Input Section 2.3.1 Functional Summary 2.3.2 Brief
Introduction to Computer Systems. Networks 2. c Theodore Norvell. The Sockets API
The Sockets API [Wait! If you are not familiar with file descriptors and the UNIX read and write system calls, read chapter 10 of Bryant and O Hallaron and/or my summary before going on.] In this section
CS 326: Operating Systems. Networking. Lecture 17
CS 326: Operating Systems Networking Lecture 17 Today s Schedule Project 3 Overview, Q&A Networking Basics Messaging 4/23/18 CS 326: Operating Systems 2 Today s Schedule Project 3 Overview, Q&A Networking
Lecture 16: Network Layer Overview, Internet Protocol
Lecture 16: Network Layer Overview, Internet Protocol COMP 332, Spring 2018 Victoria Manfredi Acknowledgements: materials adapted from Computer Networking: A Top Down Approach 7 th edition: 1996-2016,
Cisco Nexus 7000 Series Architecture: Built-in Wireshark Capability for Network Visibility and Control
White Paper Cisco Nexus 7000 Series Architecture: Built-in Wireshark Capability for Network Visibility and Control What You Will Learn The Cisco Nexus 7000 Series Switches combine the highest levels of
Operating Systems. 17. Sockets. Paul Krzyzanowski. Rutgers University. Spring /6/ Paul Krzyzanowski
Operating Systems 17. Sockets Paul Krzyzanowski Rutgers University Spring 2015 1 Sockets Dominant API for transport layer connectivity Created at UC Berkeley for 4.2BSD Unix (1983) Design goals Communication
PoS(10th EVN Symposium)098
1 Joint Institute for VLBI in Europe P.O. Box 2, 7990 AA Dwingeloo, The Netherlands E-mail: szomoru@jive.nl The, a Joint Research Activity in the RadioNet FP7 2 programme, has as its aim the creation of
IBM POWER8 100 GigE Adapter Best Practices
Introduction IBM POWER8 100 GigE Adapter Best Practices With higher network speeds in new network adapters, achieving peak performance requires careful tuning of the adapters and workloads using them.
IP Network Troubleshooting Part 3. Wayne M. Pecena, CPBE, CBNE Texas A&M University Educational Broadcast Services - KAMU
IP Network Troubleshooting Part 3 Wayne M. Pecena, CPBE, CBNE Texas A&M University Educational Broadcast Services - KAMU February 2016 Today s Outline: Focused Upon Protocol Analysis with Wireshark Review
libcap_utils Documentation
libcap_utils Documentation Release 0.7 DPMI January 28, 2017 Contents: 1 Overview 3 2 Install instructions 5 3 Consumers 9 4 API 11 5 Tool overview 13 6 capshow 15 7 Use-cases 17 8 Indices and tables
Lecture 2-ter. 2. A communication example Managing a HTTP v1.0 connection. Managing a HTTP request. transport session. Step 1 - opening transport
Lecture 2-ter. 2 A communication example Managing a HTTP v1.0 connection Managing a HTTP request User digits URL and press return (or clicks ). What happens (HTTP 1.0): 1. opens a TCP transport session
Performance Characteristics on Fast Ethernet, Gigabit and 10 Gigabits networks
Versions 2.6 Traffic Generator for IP Networks (IPv4 & IPv6) FTTx, LAN, MAN, WAN, WLAN, WWAN, Mobile, Satellite, PLC, etc. Performance Characteristics on Fast Ethernet, Gigabit and 10 Gigabits networks
QUIZ: Longest Matching Prefix
QUIZ: Longest Matching Prefix A router has the following routing table: 10.50.42.0 /24 Send out on interface Z 10.50.20.0 /24 Send out on interface A 10.50.24.0 /22 Send out on interface B 10.50.20.0 /22
Chapter 4: network layer. Network service model. Two key network-layer functions. Network layer. Input port functions. Router architecture overview
Chapter 4: chapter goals: understand principles behind services service models forwarding versus routing how a router works generalized forwarding instantiation, implementation in the Internet 4- Network
VLBI progress Down-under. Tasso Tzioumis Australia Telescope National Facility (ATNF) 25 September 2008
VLBI progress Down-under Tasso Tzioumis Australia Telescope National Facility (ATNF) 25 September 2008 Outline Down-under == Southern hemisphere VLBI in Australia (LBA) Progress in the last few years Disks
The Yebes PC-EVN: Configuration and usage. P. de Vicente Informe Técnico IT-OAN
The Yebes PC-EVN: Configuration and usage P. de Vicente Informe Técnico IT-OAN 2010-8 1 Revision history Version Date Author Updates 1.0 18-05-2010 P. de Vicente First version CONTENTS 2 Contents 1 Introduction
RDBE Host Software. Doc No: X3C 2009_07_21_1 TODO: Add appropriate document number. XCube Communication 1(13)
RDBE Host Software Doc No: X3C 2009_07_21_1 TODO: Add appropriate document number XCube Communication 1(13) Document history Change date Changed by Version Notes 09-07-21 09:12 Mikael Taveniku PA1 New
CS 716: Introduction to communication networks th class; 7 th Oct Instructor: Sridhar Iyer IIT Bombay
CS 716: Introduction to communication networks - 18 th class; 7 th Oct 2011 Instructor: Sridhar Iyer IIT Bombay Reliable Transport We have already designed a reliable communication protocol for an analogy
OPERATING SYSTEMS & Network OVERVIEW. 1: OS & Network Overview
OPERATING SYSTEMS & Network OVERVIEW 1: OS & Network Overview 1 OPERATING SYSTEM OVERVIEW WHAT IS AN OPERATING SYSTEM? An interface between users and hardware - an environment "architecture Allows convenient
PCIe Dual Port Gigabit Server. Adapter
PCIe Dual Port Gigabit Server Adapter User Manual Ver. 2.01 All brand names and trademarks are properties of their respective owners. Contents: Chapter 1: Introduction... 3 1.1 Product Introduction...
ANIC Host CPU Offload Features Overview An Overview of Features and Functions Available with ANIC Adapters
ANIC Host CPU Offload Features Overview An Overview of Features and Functions Available with ANIC Adapters ANIC Adapters Accolade s ANIC line of FPGA-based adapters/nics help accelerate security and networking
System Programming. Introduction to computer networks
Content : by Dr. B. Boufama School of Computer Science University of Windsor Instructor: Dr. A. Habed adlane@cs.uwindsor.ca http://cs.uwindsor.ca/ adlane/60-256 Content Content 1 Introduction to Computer
precise rules that govern communication between two parties TCP/IP: the basic Internet protocols IP: Internet protocol (bottom level)
Protocols precise rules that govern communication between two parties TCP/IP: the basic Internet protocols IP: Internet protocol (bottom level) all packets shipped from network to network as IP packets
Xen Network I/O Performance Analysis and Opportunities for Improvement
Xen Network I/O Performance Analysis and Opportunities for Improvement J. Renato Santos G. (John) Janakiraman Yoshio Turner HP Labs Xen Summit April 17-18, 27 23 Hewlett-Packard Development Company, L.P.
UDP: Datagram Transport Service
UDP: Datagram Transport Service 1 Topics Covered Introduction Transport Protocols and End-to-End Communication The User Datagram Protocol The Connectionless Paradigm Message-Oriented Interface UDP Communication
Elements of Transport Protocols
CEN445 Network Protocols and Algorithms Chapter 6 Transport Layer 6.2 Elements of Transport Protocols Dr. Mostafa Hassan Dahshan Department of Computer Engineering College of Computer and Information Sciences
Performance Characteristics on Gigabit networks
Version 4.7 Impairment Emulator Software for IP Networks (IPv4 & IPv6) Performance Characteristics on Gigabit networks ZTI Communications / 1 rue Ampère / 22300 LANNION / France Phone: +33 2 9613 4003
Raw Data Formatting: The RDR Formatter and NetFlow Exporting
CHAPTER 9 Raw Data Formatting: The RDR Formatter and NetFlow Exporting Revised: September 27, 2012, Introduction Cisco Service Control is able to deliver gathered reporting data to an external application
Defining a Rockwell Logix unsolicited message using RSLogix 5000
Defining a Rockwell Logix unsolicited message using RSLogix 5000 The following section shows an example in the Rockwell Software RSLogix 5000 of how to add a rung of a ladder and configure a message instruction
Input/Output. Today. Next. Principles of I/O hardware & software I/O software layers Disks. Protection & Security
Input/Output Today Principles of I/O hardware & software I/O software layers Disks Next Protection & Security Operating Systems and I/O Two key operating system goals Control I/O devices Provide a simple,
7 March, Distribution Chester Ruszczyk Conduant Amazon Controller Card SDK 9.2 Upgrade (Mark5B+) with Debian Etch
Mark 5 Memo #098 MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 01886 Telephone: 781-981-5951 Fax: 781-981-0590 7 March, 2014 TO: FROM: SUBJECT: Distribution Chester
ECE 4450:427/527 - Computer Networks Spring 2017
ECE 4450:427/527 - Computer Networks Spring 2017 Dr. Nghi Tran Department of Electrical & Computer Engineering Lecture 6.2: IP Dr. Nghi Tran (ECE-University of Akron) ECE 4450:427/527 Computer Networks
NEXPReS WP8 Progress Meeting
NEXPReS WP8 Progress Meeting Preparations for Multi Site Testing Ari Mujunen Aalto University Metsähovi Radio Observatory VLBI2SKA Workshop in Aveiro, Portugal, 24-26.5.2011 Research leading to these results
Midterm II December 4 th, 2006 CS162: Operating Systems and Systems Programming
Fall 2006 University of California, Berkeley College of Engineering Computer Science Division EECS John Kubiatowicz Midterm II December 4 th, 2006 CS162: Operating Systems and Systems Programming Your
GUARANTEED END-TO-END LATENCY THROUGH ETHERNET
GUARANTEED END-TO-END LATENCY THROUGH ETHERNET Øyvind Holmeide, OnTime Networks AS, Oslo, Norway oeyvind@ontimenet.com Markus Schmitz, OnTime Networks LLC, Texas, USA markus@ontimenet.com Abstract: Latency
Request for Comments: 913 September 1984
Network Working Group Request for Comments: 913 Mark K. Lottor MIT September 1984 STATUS OF THIS MEMO This RFC suggests a proposed protocol for the ARPA-Internet community, and requests discussion and
Jason Manley. Internal presentation: Operation overview and drill-down October 2007
Jason Manley Internal presentation: Operation overview and drill-down October 2007 System overview Achievements to date ibob F Engine in detail BEE2 X Engine in detail Backend System in detail Future developments
6.033 Computer System Engineering
MIT OpenCourseWare http://ocw.mit.edu 6.033 Computer System Engineering Spring 2009 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 6.033 Lecture 10:
DevoFlow: Scaling Flow Management for High Performance Networks
DevoFlow: Scaling Flow Management for High Performance Networks SDN Seminar David Sidler 08.04.2016 1 Smart, handles everything Controller Control plane Data plane Dump, forward based on rules Existing
Long Baseline Array Status
Long Baseline Array Status Cormac Reynolds, Chris Phillips + LBA Team 19 November 2015 CSIRO ASTRONOMY & SPACE SCIENCE LBA LBA VLBI array operated by CSIRO University of Tasmania, Auckland University of
NAT Router Performance Evaluation
University of Aizu, Graduation Thesis. Mar, 22 17173 1 NAT Performance Evaluation HAYASHI yu-ichi 17173 Supervised by Atsushi Kara Abstract This thesis describes a quantitative analysis of NAT routers
FreeBSD Network Performance Tuning
Sucon 2004 Zurich, Switzerland Hendrik Scholz hscholz@raisdorf.net http://www.wormulon.net/ Agenda Motivation Overview Optimization approaches sysctl() tuning Measurement NIC comparision Conclusion Motivation
IT 341: Introduction to System
IT 341: Introduction to System Administration Private IP Addresses and the Internet Using IP Addresses to Communicate Over the Internet Network Address Translation Private IP Addresses and the Internet
Mark 5A Disk-Module Assembly, Test and Conditioning
Mark 5A Disk-Module Assembly, Test and Conditioning Alan R. Whitney MIT Haystack Observatory 11 Nov 2005 Attached to this memo are instructions from Conduant on how to assemble 8-pack disk modules. Please
Network Test and Monitoring Tools
ajgillette.com Technical Note Network Test and Monitoring Tools Author: A.J.Gillette Date: December 6, 2012 Revision: 1.3 Table of Contents Network Test and Monitoring Tools...1 Introduction...3 Link Characterization...4
UNIVERSITY OF TORONTO ELECTRICAL AND COMPUTER ENGINEERING ECE 361 Test February 2, 2012
Student Number: UNIVERSITY OF TORONTO ELECTRICAL AND COMPUTER ENGINEERING ECE 361 Test February 2, 2012 ECE 361 Computer Networks This test is Closed Book 75 Minutes Examiner: A. Leon-Garcia Question Mark
Configuring IP Services
This module describes how to configure optional IP services. For a complete description of the IP services commands in this chapter, refer to the Cisco IOS IP Application Services Command Reference. To
TRANSMISSION CONTROL PROTOCOL. ETI 2506 TELECOMMUNICATION SYSTEMS Monday, 7 November 2016
TRANSMISSION CONTROL PROTOCOL ETI 2506 TELECOMMUNICATION SYSTEMS Monday, 7 November 2016 ETI 2506 - TELECOMMUNICATION SYLLABUS Principles of Telecom (IP Telephony and IP TV) - Key Issues to remember 1.
A Client-Server Exchange
Socket programming A Client-Server Exchange A server process and one or more client processes Server manages some resource. Server provides service by manipulating resource for clients. 1. Client sends