perfsonar Update Jason Zurawski Internet2 March 5, 2009 The 27th APAN Meeting, Kaohsiung, Taiwan

perfsonar Update Jason Zurawski Internet2 March 5, 2009 The 27th APAN Meeting, Kaohsiung, Taiwan

perfsonar Update Introduction & Overview Development Status Authentication & Authorization GUI Status Deployment Status Development Roadmap Call for Participation

Introduction & Overview Most organizations perform monitoring and diagnostics of their own network Networking is increasingly a crossdomain effort Monitoring and diagnostics must also become a cross-domain effort

What is perfsonar A collaboration Production network operators focused on designing and building tools that they will deploy and use on their networks to provide monitoring and diagnostic capabilities to themselves and their user communities. An architecture & a set of protocols Web Services Architecture Protocols based on the Open Grid Forum Network Measurement Working Group Schemata Several interoperable software implementations Java, Perl, Python A Deployed Measurement infrastructure

perfsonar Architecture Interoperable network measurement middleware (SOA): Modular Web services-based Decentralized Locally controlled Integrates: Network measurement tools and archives Data manipulation Information Services Discovery Topology Authentication and authorization Based on: Open Grid Forum Network Measurement Working Group schema Currently attempting to formalize specification of perfsonar protocols in a new OGF WG (NMC)

perfsonar Architecture Data Services Measurement Points Measurement Archives Transformations Analysis/Visualization User GUIs Web Pages NOC Alarms Infrastructure ( Auth(n/z Services Information Services Service Lookup Topology Service Configuration

Decouple 3 phases of a Measurement Infrastructure Analysis & Visualization Analysis & Visualization API Measurement Infrastructure Measurement Infrastructure API Data Collection Performance Tools

perfsonar works E2E when All Networks Participate Many collaborations are inherently multi-domain, so for an end-to-end monitoring tool to work everyone must participate in the monitoring infrastructure performance GUI user measurement archive measurement archive Analysis tool measurement archive m1 m3 m4 measurement archive m1 m3 m4 measurement archive m1 m3 m4 FNAL (AS3152) [US] m1 m4 GEANT (AS20965) [Europe] m1 m3 m4 DESY (AS1754) [Germany] m3 ESnet (AS293) [US] DFN (AS680) [Germany] 8

perfsonar Development Partners perfsonar-mdm Originally funded through Geant2 (and eventually Geant3) Project Java Platform perfsonar-ps Joint effort between US Higher Education partners and National Laboratories Perl Platform

perfsonar Collaboraters ARNES BELNET CARNET CESNET CYNET DANTE DFN ESnet FCCN FERMI GARR GEANT Georgia Institute of Technology GRNET HEAnet Internet2 ISTF POZNAN UNINETT University of Delaware Indiana University Renater RedIRIS RNP SLAC SWITCH SURFnet

Development Status perfsonar-mdm Current Release: v3.1 (Jan 2009) http://wiki.perfsonar.net/jra1-wiki/index.php/perfsonar_v3.1 Services: RRD Measurement Archive SQL Measurement Archive SSH Telnet Measurement Point Lookup Service Authentication Service BWCTL Measurement Point Command Line Measurement Point

Development Status perfsonar-ps Scheduled Release (v3.1) for Late March http://www.internet2.edu/performance/ps-ps/ Services & Tools SNMP Measurement Archive Status Measurement Archive PingER Measurement Archive/Measurement Point perfsonar-buoy Measurement Archive Global & Local Lookup Service Topology Service perfsonar GUIs

Development Status Performance Node Live CD (v2.1) to be released Early April http://www.internet2.edu/performance/node/index.html Services & Tools perfsonar-ps Tools OWAMP BWCTL NDT NPAD Reverse Traceroute Server

Authentication and Authorization perfsonar-mdm Using edugain Federation Support exists in most services (see documentation for details) perfsonar-ps Currently designing support for edugain and other federations (Shibboleth) Awaiting recommendations of DICE group http://wiki.perfsonar.net/jra1-wiki/index.php/authentication_service_resources

GUI Status GUI development *must* shift Move away from what developers can easily do Move towards what users/operators want Several GUIs exist currently Future Plans Dashboard applications to see many types of data at one time Layered GUIs to drill down Web and Application Based

SNMP MA In Action - perfometer

Gmaps (SNMP) http://packrat.internet2.edu:8008/

Gmaps (pinger) http://packrat.internet2.edu:8008/

Gmaps (bwctl) http://packrat.internet2.edu:8008/

pinger Analysis http://lhcopnmon1-mgm.fnal.gov:9090/pinger/gui

pinger Analysis http://lhcopnmon1-mgm.fnal.gov:9090/pinger/gui

perfsonar-buoy (bwctl) http://ndb1.internet2.edu/cgi-bin/bwctl.cgi?name=officemeshbwtcp4

perfsonar-buoy (bwctl)

Traceroute Visualizer Forward direction bandwidth utilization on application path from LBNL to INFN-Frascati (Italy) traffic shown as bars on those network device interfaces that have an associated MP services (the first 4 graphs are normalized to 2000 Mb/s, the last to 500 Mb/s) 1 ir1000gw (131.243.2.1) 2 er1kgw 3 lbl2-ge-lbnl.es.net link capacity is also provided 10 esnet.rt1.nyc.us.geant2.net (NO DATA) 11 so-7-0-0.rt1.ams.nl.geant2.net (NO DATA) 12 so-6-2-0.rt1.fra.de.geant2.net (NO DATA) 13 so-6-2-0.rt1.gen.ch.geant2.net (NO DATA) 14 so-2-0-0.rt1.mil.it.geant2.net (NO DATA) 15 garr-gw.rt1.mil.it.geant2.net (NO DATA) 16 rt1-mi1-rt-mi2.mi2.garr.net 4 slacmr1-sdn-lblmr1.es.net (GRAPH OMITTED) 5 snv2mr1-slacmr1.es.net (GRAPH OMITTED) 6 snv2sdn1-snv2mr1.es.net 17 rt-mi2-rt-rm2.rm2.garr.net (GRAPH OMITTED) 18 rt-rm2-rc-fra.fra.garr.net (GRAPH OMITTED) 19 rc-fra-ru-lnf.fra.garr.net (GRAPH OMITTED) 7 chislsdn1-oc192-snv2sdn1.es.net (GRAPH OMITTED) 8 chiccr1-chislsdn1.es.net 20 21 www6.lnf.infn.it (193.206.84.223) 189.908 ms 189.596 ms 189.684 ms 9 aofacr1-chicsdn1.es.net (GRAPH OMITTED)

E2Emon - Monitoring Circuits

E2Emon: Status of E2E link CERN-LHCOPN-FNAL-001 E2Emon generated view of the data for one OPN link [E2EMON]

perfsonar GUI List http://www.perfsonar.net/activeservices Listing of many types of active services Graphs Live Tests Points http://psvis0.internet2.edu:8008/ Gmaps interface http://perfsonar.acad.bg/ Java based visualization tool http://cnmdev.lrz-muenchen.de/e2e/lhc/mon/ G2_E2E_index_ALL.html E2emon link monitoring https://performance.es.net/cgi-bin/level0/ perfsonar-trace.cgi Traceroute visualization 27

Deployment Status Backbone Networks APAN SNMP perfsonar-buoy (Trial) ESnet SNMP PingER Planed BWCTL/OWAMP data through perfsonar-buoy Geant Components from perfsonar-mdm v3.1 Internet2 SNMP perfsonar-buoy RNP Command Line Measurement Points

Deployment Status Regional Networks MAX MCNC SOX TransPac2 Regional Networks (Trials) CENIC GPN JGN2 LONI MERIT NOX NYSERNET UEN

Deployment Status User Communities LHC (Tier1 Sites) perfsonar-mdm v3.0/3.1 Support provided by Dante USATLAS (Tier2/Tier3 Sites in the United States) Performance Node: Live CD deployments (currently v2.0) Support provided by perfsonar-ps developers and user community USCMS (Tier2/Tier3 Sites in the United States) Evaluating Performance Node GLIF Trial of perfsonar tools to monitor circuits

Development Roadmap perfsonar-mdm Geant3 will place perfsonar into a Service Activity Deployment focused Harden existing software Continued support of International development efforts Information Services Protocol Development

Development Roadmap perfsonar-ps Information Services Enhancements Topology and Lookup Service combination Service Monitoring Nagios Plugins for perfsonar Tools Dynamic Circuit Support Detection and monitoring of circuits Diagnostic tools

Development Roadmap Performance Node Adoption of Fedora based framework Live CD and Instant-NOC RPM based deployment will allow for kickstarting deployment without using Live CD Improved GUIs Administration of tools as well as data visualization Additional Services Circuit and Link status Topology

Call For Participation Deploy the the services: http://www.perfsonar.net/download.html Join the mailing lists: https://mail.internet2.edu/wws/subrequest/perfsonar-user https://mail.internet2.edu/wws/subrequest/performancenode-users

Call For Participation Always looking to see more involvement New Service Ideas GUI Development All forms of data visualization Almost any language as a platform Beta Testers Mailing List: https://mail.internet2.edu/wws/subrequest/ perfsonar-dev

perfsonar-update Questions?