ESnet Netwrk Measurements ESCC Feb 15 2007 Je Metzger metzger@es.net 1
Measurement Mtivatins 2 Users dependence n the netwrk is increasing Distributed Applicatins Mving Larger Data Sets The netwrk is becming a critical part f large science experiments The netwrk is grwing mre cmplex 6 cre devices in 05, 25+ in 08 6 cre links in 05, 40+ in 08, 80+ by 2010? Users cntinue t reprt perfrmance prblems wizards gap issues The cmmunity needs t better understand the netwrk We need t be able t demnstrate that the netwrk is gd. We need t be able t detect and fix subtle netwrk prblems.
perfsonar 3 perfsonar is a glbal cllabratin t design, implement and deply a netwrk measurement framewrk. Web Services based Framewrk - Measurement Archives (MA) - Measurement Pints (MP) - Lkup Service (LS) - Tplgy Service (TS) - Authenticatin Service (AS) Sme f the currently Deplyed Services - Utilizatin MA - Circuit Status MA & MP - Latency MA & MP - Bandwidth MA & MP - Lking Glass MP - Tplgy MA This is an Active Cllabratin - The basic framewrk is cmplete - Prtcls are being dcumented - New Services are being develped and deplyed.
perfsonar Cllabratrs 4 ARNES Belnet CARnet CESnet Dante University f Delaware DFN ESnet FCCN FNAL GARR GEANT2 Gerga Tech GRNET Internet2 IST POZNAN Supercmputing Center Red IRIS Renater RNP SLAC SURFnet SWITCH Uninett * Plus thers wh are cntributing, but haven t added their names t the list n the WIKI.
perfsonar Deplyments 5 16+ different netwrks have deplyed at least 1 perfsonar service (Jan 2007)
ESnet perfsonar Prgress 6 ESnet Deplyed Services Link Utilizatin Measurement Archive Virtual Circuit Status In Develpment Active Latency and Bandwidth Tests Tplgy Service Additinal Visualizatin capabilities perfsonar visualizatin tls shwing ESnet data Link Utilizatin - perfsonarui http://perfsnar.acad.bg/ - VisualPerfSONAR https://nc-mn.srce.hr/visual_perf - Tracerute Visualizer https://perfrmance.es.net/cgi-bin/level0/perfsnar-trace.cgi Virtual Circuit Status - E2EMn (fr LHCOPN Circuits) http://cnmdev.lrz-muenchen.de/e2e/lhc/g2_e2e_index.html
LHCOPN Mnitring 7 LHCOPN An Optical Private Netwrk cnnecting LHC Teir1 centers arund the wrld t CERN. The circuits t tw f the largest Tier1 centers, FERMI & BNL crss ESnet E2Emn An applicatin develped by DFN fr mnitring circuits using perfsonar prtcls E2ECU End t End Crdinatin Unit that uses E2Emn t mnitr LHCOPN Circuits Run by the GEANT2 NOC
E2Emn Cmpnents 8 Central Mnitring Sftware Uses perfsonar prtcls t retrieve current circuit status every minute r s frm MAs and MPs in all the different dmains supprting the circuits. Prvides a web site shwing current end-t-end circuit status Generates SNMP traps that can be sent t ther management systems when circuits g dwn MA & MP Sftware Manages the perfsonar cmmunicatins with the central mnitring sftware Requires an XML file describing current circuit status as input. Dmain Specific Cmpnent Generates the XML input file fr the MA r MP Multiple develpment effrts in prgress, but n universal slutins - CERN develped ne that interfaces t their abstractin f the Spectrum NMS DB - DANTE develped ne that interfaces with the Acatel NMS - ESnet develped ne that uses SNMP t directly pll ruter interfaces - FERMI develped ne that uses SNMP t directly pll ruter interfaces - Others under develpment
E2Emn Central Mnitring Sftware 9 http://cnmdev.lrz-muenchen.de/e2e/lhc/g2_e2e_index.html
ESnet4 Hub Measurement Hardware 10 Latency 1U Server with ne f: - EndRun Praecis CT CDMA Clck - Meinberg TCR167PCI IRIG Clck - Symmetricm bc637pci-u IRIG Clck Bandwidth 4U dual Optern server with ne f: - Myricm 10GE NIC - 9.9 Gbps UDP streams - ~6 Gbps TCP streams - Cnsumes 100% f 1 CPU - Chelsi S320 10GE NIC Shuld d 10G TCP & UDP with lw CPU Utilizatin Has interesting shaping pssibilities Still under testing
Netwrk Measurements ESnet is Cllecting 11 SNMP Interface Utilizatin Cllected every minute - Fr MRTG & Mnthly Reprting Circuit Availability Currently based n SNMP Interface up/dwn status Limited t LHCOPN and Service Trial circuits fr nw NetFlw Data Sampled n ur bundaries Latency OWAMP
ESnet Perfrmance Center 12 Web Interface t run Netwrk Measurements Available t ESnet sites Supprted Tests Ping Tracerute IPERF Pathlad, Pathrate, Pipechar - (Only n GE systems) Test Hardware GE testers in Qwest hubs - TCP iperf tests max at ~600 Mbps. 10GE testers are being deplyed in ESnet4 hubs - Deplyed in lcatins where we have Cisc 6509 10GE Interfaces - Available via Perfrmance Center when nt being used fr ther tests - TCP iperf tests max at 6 Gbps.
ESnet Measurement Summary 13 Standards / Cllabratins PerfSONAR LHCOPN Circuit Status Mnitring Mnitring Hardware in ESnet 4 Hubs Bandwidth Latency Measurements SNMP Interface Cunters Circuit Availability Flw Data One Way Delay Achievable Bandwidth Visualizatins PerfSONARUI VisualPerfSONAR NetInf