Description of the international LOFAR station datatransport system

Transcription

1 Descriptin f the internatinal LOFAR statin datatransprt system Auteur(s) / Authr(s): Organisatie / Organizatin Datum / Date D.H.P. Maat Cntrle / Checked: Gedkeuring / Apprval: A. Gunst Autrisatie / Authrisatin: Handtekening / Signature J. Reitsma -FO All rights are reserved. Reprductin in whle r in part is prhibited withut written cnsent f the cpyright wner. Class.: Restricted 1 / 9

2 Distributin list: Grup: Others: Dcument histry: Revisin Date Chapter / Page Mdificatin / Change - Creatin 2 / 9

3 Table f cntents: 1 Intrductin Dcument scpe and purpse Applicable dcuments (AD) Reference dcuments (RD) Abbreviatins Statin netwrk design Requirements fr the fiber link between statin and partner building E-LOFAR statin netwrk cmpnents Requirements fr the link between the partner site and the central prcessr Requirements fr the partner systems / 9

4 1 Intrductin 1.1 Dcument scpe and purpse In this dcument the design f the E-LOFAR statin datatransprt system is given. In additin the peratinal and technical requirements fr this system are described. E-LOFAR statin is used thrughut the rest f the dcument as synnym fr an internatinal LOFAR statin. 1.2 Applicable dcuments (AD) Ref.nr. Dcument number Title 1.3 Reference dcuments (RD) Ref.nr. Dcument number Title 1.4 Abbreviatins 4 / 9

5 2 Statin netwrk design The data netwrk f an E-LOFAR statin cntains tw switches. Switch1, a Fundry FastIrn LS 648, is lcated inside the E-LOFAR cabinet. Switch2 is lcated at the E-LOFAR Partner institute. Switch1 is used as the cmmunicatin nde f the E-LOFAR statin. It handles all internal traffic and aggregates all in and utging traffic f the statin int a single 10GbE link. Via this link a cnnectin is realized t Switch2, a Fundry FastIrn LS 624. With the use f Switch2 the tw peratin mdes f the E-LOFAR statin are realised: in peratinal mde 1 all the RSP-bard bservatin data that is prduced by the E-LOFAR statin is sent t the central prcessr at Grningen. In peratinal mde 2 this bservatin data is made available t the E-LOFAR partner by cnnecting the RSP-bard VLAN t the E-LOFAR partner prts f Switch2. In this latter mde the E-LOFAR statin acts as a stand alne statin, whse data is available fr the lcal E-LOFAR partner, via fur GbE links., These fur 1GbE links are accessible via fur 1000BASE-T prts. In additin t the data cnnectin, the E-LOFAR partner can als cnnect t the Lcal Cntrl Unit (LCU) at the E-LOFAR statin via its E-LOFAR partner prts. Fr this LCU link a lcal LCU VLAN is available. T be capable f sending the data t the central prcessr, a 10GbE prt f Switch2 must be cnnected t a 10GbE prt f a dedicated link which cnnects a Switch2 10GbE prt directly t CEP at Grningen. The dedicated link, which must have a bandwidth f at least 3 Gb/s, needs t be installed and maintained by the E- LOFAR partner. The ptical 10GbE prt f Switch2, with which the cnnectin t the link t Grningen is realized, will be equipped with a 10GBASE-LX XFP. Since the entire LOFAR data transprt netwrk is based n 10Gb/s technlgy, the use f 10Gb/s lightpath technlgy fr the link t Grningen is preferred. In additin t the 10GbE data link between the tw switches, a secnd link is present. This link cnnects a cnsle switch at the E-LOFAR statin t Switch2 via a media cnverter and a 100BASE-FX link. This netwrk management link will be aggregated int the 10GbE link by Switch2, such that a cnnectin t the netwrk management system at Grningen is realized. Switch2 will be managed via a cnsle switch at the partner building. Fr realizing a cnnectin between this switch and CEP at Grningen a <1Mb/s Internet cnnectin needs t be available. At the cnsle switch a RJ-45 10/100Base-T prt is available fr realising this cnnectin. The cmmunicatin equipment that will be delivered as part f the E-LOFAR statin is summarized in Sectin 2.2. These items will be cnfigured, cntrlled and maintained by -LOFAR, with supprt f the E-LOFAR partner. The fiber-ptic cable (and its terminatins) between the E-LOFAR cabinet and the E- LOFAR partner building, that is used fr cnnecting bth E-LOFAR switches, must be designed, deplyed and maintained by the E-LOFAR partner. This will be dne in such a way that the mentined 10GBASE-LX and 100BASE-FX based links will functin accrding t their specificatins. 5 / 9

6 2.1 Requirements fr the fiber link between statin and partner building In this subsectin the requirements fr the tw fiber pairs between the E-LOFAR cabinet and the patch panel at the Switch 2 lcatin is given. The detail level in this specificatin is such that it can be used in the negtiatins with the cmpany that will deply the cable. The given specificatin hlds fr a distance f less than 10km. In case a larger distance needs t be bridged, an adjusted specificatin and cmpnent list is needed, which als will be prvided by -LOFAR. Requirements fr the fiber cable - The fibers in the cable must be f type G652-C r G652-D (IEC B 1.3). - The ptical prperties f the fibers must be accrding t the current cmmn quality levels, bth per kilmeter as ver its entire length. - The ptical lss f every fiber between the E-LOFAR statin and the patchpanel at Switch2 must be belw 4 db in the wavelength windw between 1310 nm and 1625 nm. This lss is measured between the adapters n the patchpanel at the E-LOFAR statin and the patchpanel at the Switch2 lcatin. - The abslute chrmatic dispersin in the O-band (1260 nm 1360 nm) is less than 3,5 ps/nm.km. - The chrmatic dispersin in the C-band (1530 nm 1565 nm) is less than 18 ps/nm.km. - Lw PMD levels (less than 0,5 ps/ km) are preferred. Requirements fr the patchpanel adapters and cnnectrs - The fibers between the E-LFOAR cabinet and the Switch2 lcatin will be terminated n patchpanels with SC/PC adapters. - The adapters and cnnectrs in the link between the E-LOFAR cabinet and the Switch2 lcatin must have a reflectin level belw -30 db and must be specified fr a ptical lss f less than 0.5 db. Requirements fr the splices - Only fusin splices must be used. Glued r mechanical splices are nt allwed. - The maximum allwed ptical lss ver a single splice is 0.5 db - The average lss per splice must be less than 0.10 db. 6 / 9

7 2.2 E-LOFAR statin netwrk cmpnents The fllwing items are part f the E-LOFAR statin hardware: 1 x Fundry FastIrn LS x Fundry FastIrn LS x 10GBASE-LX XFPs 1 x 100BASE-FX SFP 2 x MRV Cnsle Server 1 x MRV 10/100BaseTX t 100BASE-FX cnverter (SM, 1310nm, 0-35km, DSC) 2.3 Requirements fr the link between the partner site and the central prcessr Fr cnnecting the E-LOFAR statin t the Central Prcessr (CEP) at Grningen, the E-LOFAR partner needs t prvide a cmmunicatin link with a 10GbE interface at bth sides. This link has t transfer the data traffic t and frm Switch2 with a bandwidth (per directin) f at least 3 Gb/s. This cmmunicatin link will hld a number f data streams which are virtually separated with the use f VLANs. The E-LOFAR cnnectin link must be a layer 2 link that supprts: At least 3 Gb/s f bandwidth 10GbE interfaces at bth sides VLAN tagging and QinQ in case f a VLAN cnflict The transfer f VLANs whse numbering will be determined by / LOFAR IPv4 and IPv6 9kB Jumbframes Packet ruting based n MAC addresses TCP/IP The E-LOFAR cnnectin t CEP must be a dedicated link which transfers its data separated frm the Internet. The mst suitable technlgy fr this is 10Gb/s lightpath technlgy that is a.. supplied by many ISPs. The link has t cmply with a number f availability, maintenance and security requirements which are described in Chapter 3. 7 / 9

8 3 Requirements fr the partner systems In additin t the E-LOFAR cmmunicatin hardware mentined in Sectin 2.2, the fllwing items are needed fr the E-LOFAR cmmunicatin link: a fiber-ptic cable between the E-LOFAR cabinet and the Switch2 lcatin a cmmunicatin link with a minimum bandwidth f 3 Gb/s, which cnnects a 10GBASE- LX prt n the E-LOFAR ruting switch t a 10GBASE- LX prt n the lightpath switch at the central prcessr site at Grningen. a <1Mb/s Internet cnnectin All three items need t be prvided by the E-LOFAR partner. Belw, a number f requirements fr the cnstructin, availability, maintenance and security f this cable / link are given which have t be fllwed up by the E-LOFAR partner fr a flawless peratin. 1. The fiber-ptic cable between Switch1 and Switch2 must be terminated at bth sides n a patch panel with SC/PC patch psitins. 2. This fiber-ptic cable and its terminatins are cnfigured, cnstructed and maintained in such a way that the Switch1 and Switch2 can realize a 10GbE cnnectin via that cable. 3. The data cnnectin between Switch2 and the lightpath/cep switch shuld be transparent regarding transprt f data t the CEP. In additin, the sequence f the data as prduced by the statin shall nt be altered, first data bit prduced by the statin arrives first at CEP. 4. The data cnnectin between Switch2 and the lightpath/cep switch may nt alter the data packets as they are sent ut by the E-LOFAR ruting switch 5. Small amunts f packet lss (<10 packets/s per statin) in the data cnnectin between Switch1 and the lightpath/cep switch is nly acceptable after cnsultatin with / LOFAR 6. A high level f packet lss (>10 packets/s per statin) in the data cnnectin between Switch2 and the lightpath/cep switch is nt acceptable 7. The data link between Switch2 and the lightpath/cep switch may nt have a delay larger than 100 ms. 8. The 10GbE stream frm a E-LOFAR statin cntains the fllwing sub-streams: a. Observatin with required bandwidth: 2.2 Gb/s b. Mnitring and Cntrl with required bandwidth f 100 Mb/s c. Netwrk cntrl with required bandwidth f 10 Mb/s d. Transient Mde with a varying required bandwidth which is in the rder f several Gb/s Each stream will require its wn VLAN. All mentined streams will be needed in the final situatin. Befre upgrading at least item a, b and c need t be supprted. An upgrade plan fr the required bandwidth needs t be negtiated with each E-LOFAR partner. 9. Any maintenance t the fiber-ptic cable between the Switch1 and Switch2 must be reprted at least 1 week in advance. In case the annunced maintenance des nt cncur with LOFAR scheduling the partner and LOFAR/ shuld agree a mre suitable timeframe. 10. Any maintenance t the data link between Switch2 and the lightpath/cep switch at Grningen must be reprted at least 1 week in advance. In case the annunced maintenance des nt cncur with LOFAR scheduling the partner and LOFAR/ shuld agree a mre suitable timeframe. 11. In case f failure in the fibre-ptic infrastructure between Switch1 and Switch2, a reprt must be created by the E-LOFAR partner. This reprt cntains an incident and 8 / 9

9 a repair plan which will be prvided t /LOFAR preferably within 3 hurs after the failure has been detected. The repair plan infrms / LOFAR abut the nature f the failure and the schedule fr the repair. In case the prblem exists fr several days, /LOFAR will be infrmed daily n the status f the repair. 12. The hard- and sftware f Switch1 and Switch2 will be cnfigured and maintained by / LOFAR. The lcal E-LOFAR partner rganizatin supplies assistance in this cnfiguratin and maintenance task. 13. In case f failure f the active equipment and / r failure in the fiber-ptic infrastructure in the link between Switch2 and the lightpath/cep switch, an incident and repair plan must be made. This incident and a repair plan shuld be prvided t /LOFAR preferably within 3 hurs after the failure has been detected. The repair plan infrms / LOFAR abut the nature f the failure and the schedule fr the repair. In case the prblem exists fr several days, /LOFAR will be infrmed daily n the status f the repair. Security and availability related items The E-LOFAR partner has the respnsibility t cnnect his equipment t the data transfer system in such a way that the LOFAR data link and cnnectin t Central Prcessr at Grningen will nt be endangered in any way. In case LOFAR/ ntices any prblems that riginate frm the partner s data link, it will be discnnected frm the LOFAR systems. In rder t prevent such a situatin the fllwing preventive measures are strngly recmmended t be taken by the partner: 1. In case an intrusin is detected in the active equipment that is placed in the link between Switch2 and the lightpath/cep interface switch, this shuld be directly (within 1 hur) reprted t / LOFAR (LOFAR cntrl rm) 2. In case a cnnectin between an E-LOFAR statin and the lightpath/cep switch at Grningen is suspected t be intruded/crrupted and/r is causing prblems in the LOFAR Central Prcessr system at Grningen, / LOFAR will discnnect this cnnectin immediately. After the E-LOFAR partner has shwn that the mentined issues are remved / nt present the link will be restred. 3. An E-LOFAR partner has the respnsibility t prvide a secure link. N.B.: The security f the link will be assessed based n infrmatin prvided by the E- LOFAR partner regarding the link between the E-LOFAR statin and the lightpath/cep switch at Grningen. 4. An E-LOFAR partner has the respnsibility t prvide a qualitative gd link with prper availability. 5. Befre the link between an E-LOFAR statin and the lightpath/cep switch at Grningen is cnnected t the LOFAR systems at Grningen, the invlved E-LOFAR partner has t supply a reprt in which the cnstructin and cnfiguratin f the link between Switch2 and Grningen is described. / LOFAR will assess with the E-LOFAR partner the quality f the link. 6. In case an E-LOFAR partner wants t cnnect his lcal data prcessr systems t the Internet and /r ther, nn-lofar netwrks, the partner has t install a prper firewall and intrusin detectin system between the lcal data prcessr system and the Internet /nn-lofar netwrks. 9 / 9