The new perfsonar: a global tool for global network monitoring

Transcription

1 The new perfsonar: a global tool for global network monitoring Domenico Vicinanza (on behalf of the perfsonar Project) GÉANT Product Management Team

2 GÉANT Global Connec/vity - at the heart of global research networking GÉANT connects 65 countries outside of Europe, reaching all con/nents through interna/onal partners

3 Problem Statement Research and educa,on is increasingly global With an ecosystem of hundreds of local, regional, na,onal and interna,onal networks 3

4 Problem Statement These networks all interconnect J Each network is owned and operated by separate organisa,ons (called domains ) with different Policies Customers Funding models Hardware Bandwidth Configura,ons. 4

5 Problem Statement Complex, heterogeneous set of networks Must operate seamlessly from end to end to support science and research collabora,ons that are distributed globally. We need network monitoring and troubleshoo,ng! 5

6 Problem Statement: Hard vs. SoF Failures Hard failures are the kind of problems every organiza,on understands Fiber cut Power failure takes down routers Hardware ceases to func,on Classic monitoring systems are good at aler,ng hard failures NOC sees something turn red on their screen Engineers alerted by monitoring systems SoT failures are different and oten go undetected Basic connec,vity (ping, traceroute, web pages, ) works Performance is just poor How much should we care about sot failures? 6

7 SoF Failures Cause Packet Loss and Degraded TCP Performance Local (LAN) Metro Area With loss, high performance beyond metro distances is essentially impossible Regional Con,nental Interna,onal Measured (TCP Reno) Measured (HTCP) Theoretical (TCP Reno) Measured (no loss) 7

8 Finding the needle in the haystack perfsonar is designed to pinpoint and iden,fy sot failures to accelerate resolu,on. Example: Find and replace failing op,cs normal performance Gb/s degrading performance repair one month 8

9 Finding the needle in the haystack perfsonar is designed to pinpoint and iden,fy sot failures to accelerate resolu,on. Example: Host Tuning 9

10 Poorly performing firewalls Inside the firewall One direc,on severely impacted by firewall Not useful for science data Outside the firewall Good performance in both direc,ons 10

11 The solu/on: perfsonar An open- source, community- developed sotware suite which: Provides a consistent set of proven tools to pinpoint and resolve network performance issues Allows you to set network performance expecta/ons and make informed decisions on future network investments. Creates a standard way to visualize, publish, and archive network metrics and data for future analysis, and aids other networks in debugging issues. 11

12 How does perfsonar work? Web UI perfsonar MP Available Bandwidth One Way Delay Jifer IP Route Tracing perfsonar MP

13 The new perfsonar (version 3.4) Since Dec 2013, GEANT, Internet2, ESNet, Indiana University worked together to create a new perfsonar Prototype created in 2014 and tested in an opera,onal environment It included four measurement points two in the US: Washington and New York two in Europe: Frankfurt and Amsterdam. Measurement points located at the ends of the transatlan,c links interconnec,ng Europe and North America New version then released to the public on October 2014

14 Visibility perfsonar Dashboard Status at- a- glance Packet loss Throughput Correctness Example available to browse: hfp://ps- dashboard.es.net/ hfp://pas.net.internet2.edu/ Drill- down capabili,es: Test history between hosts Ability to correlate with other events Very valuable for fault localiza,on and isola,on 14

15 Visibility perfsonar Dashboard Throughput measurements Periodic verifica,on More concrete than packet loss Easier to show to users Example available to browse: hfp://ps- dashboard.es.net/ hfp://pas.net.internet2.edu/ Sekng expecta,ons is key If the tester can t get good performance, forget big data If the tester works and the DTNs do not, you ve learned something 15

16 perfsonar web user interface

17 perfsonar UI and edugain (next release) 17

18 On- demand transatlan/c tests available from web interface Source Des,na,on

19 Washington- New York

20 On- demand OWAMP example Amsterdam- Washington

21 Who is running perfsonar? Currently close to 1200 deployments world- wide, and around 400 have already upgraded to version 3.4 h^p://stats.es.net/servicesdirectory/ 21 ESnet Advanced Network Technologies - 15/01/2015

22 Steady increase perfsonar has seen a steady increase in deployments with each release. 22

23 Give it a try! Long story made short, you can t fix what you can t find you can t find what you can t see perfsonar lets you see perfsonar is a sotware tool that is: flexible provides ac,ve and passive network metrics inexpensive, low risk to deploy open- source community- developed, community curated 23

24 Conclusions Research & Educa,on networking is increasingly global SoT issues management can have a crucial impact Test data and metrics verifies performance of current investments Can you get full use out of the carrier circuit you re paying for? If performance suddenly changes, what caused it? Data informs future investments Put resources in places with demonstrated need Example: if your firewall is limi,ng performance, buying more bandwidth won t solve the problem Give it a try! J Be part of a growing community! 24

25 Resources perfsonar website hfp:// hfp://perfsonar.geant.net/ perfsonar mailing lists hfp:// about/gekng- help/ perfsonar directory of users hfp://stats.es.net/ ServicesDirectory/ edupert Knowledge base: hfp://kb.pert.geant.net/ ESnet FasterData Knowledgebase hfp://fasterdata.es.net 25

26 Connect Communicate Collaborate