HIDDEN SLIDE Summary These slides are meant to be used as is to give an upper level view of perfsonar for an audience that is not familiar with the

HIDDEN SLIDE Summary These slides are meant to be used as is to give an upper level view of perfsonar for an audience that is not familiar with the concept. You *ARE* allowed to delete things you don t understand,or modify the message to fit a specific group You *ARE* allowed to add more if the audience is more technical These slides should take about 30 minutes to present.

perfsonar Overview Presented by the perfsonar Project hop://www.perfsonar.net January 6 th 2016 This document is a result of work by the perfsonar Project (hop://www.perfsonar.net) and is licensed under CC BY- SA 4.0 (hops://crea\vecommons.org/licenses/by- sa/4.0/).

Outline Problem statement Mul\- domain, complex environment Hard vs. so_ failures The solu\on: perfsonar Primary Benefits of perfsonar Resources Collaborators January 6, 2016 3

HIDDEN SLIDE Slides 4 to 10 These slides have a lot of text this is provided as an ar\fact a_er the fact. People will want to read things you should not read all text on a slide (e.g. prac\ce before you give them) Purpose: these mo\vate the reason why we need a perfsonar. Lots of complexity, no way to see what is going on

Problem Statement The global Research & Educa\on network ecosystem is comprised of hundreds of interna\onal, na\onal, regional and local- scale networks. 2016, hop://www.perfsonar.net January 6, 2016 5

Problem S tatement While these networks all interconnect, each network is owned and operated by separate organiza\ons (called domains ) with diﬀerent policies, customers, funding models, hardware, bandwidth and conﬁgura\ons. 2016, hop://www.perfsonar.net January 6, 2016 6

Problem Statement This complex, heterogeneous set of networks must operate seamlessly from end to end to support science and research collabora\ons that are distributed globally. January 6, 2016 7

Problem Statement In prac\ce, performance issues are prevalent and distributed. When a network is underperforming or errors occur, it is difficult to iden\fy the source, as problems can happen anywhere, in any domain. Local- area network tes\ng is not sufficient, as errors can occur between networks. January 6, 2016 8

Problem Statement: Hard vs. So_ Failures Hard failures are the kind of problems every organiza\on understands Fiber cut Power failure takes down routers Hardware ceases to func\on Classic monitoring systems are good at aler\ng hard failures i.e., NOC sees something turn red on their screen Engineers paged by monitoring systems January 6, 2016 9

Problem Statement: Hard vs. So_ Failures So_ failures are different and o_en go undetected Basic connec\vity (ping, traceroute, web pages, email) works Performance is just poor How much should we care about so_ failures? January 6, 2016 10

January 6, 2016 11

Elephant Flows Place Great Demands on Networks essen\ally fixed determined by speed of light è è Physical pipe that leaks water at rate of.0046% by volume. Network pipe that drops packets at rate of.0046%. è è Result 99.9954% of water transferred, at line rate. Result 100% of data transferred, slowly, at <<5% op\mal speed. Through careful engineering, we can minimize packet loss. January 6, 2016 12

So_ Failures Cause Packet Loss and Degraded TCP Performance Local (LAN) Metro Area Regional With loss, high performance beyond metro distances is essentially impossible Con\nental Interna\onal Measured (TCP Reno) Measured (HTCP) Theoretical (TCP Reno) Measured (no loss) January 6, 2016 13

HIDDEN SLIDE Slides 12 to 16 These slides have a lot of text this is provided as an ar\fact a_er the fact. People will want to read things you should not read all text on a slide (e.g. prac\ce before you give them) Purpose: show that perfsonar is the only way to solve an end to end problem. Show that end to end problems can occur anywhere on a path, and that its easy to miss them if you don t think about the behavior of a protocol.

The solu\on: perfsonar A widely- deployed test and measurement infrastructure used by local, regional and na\onal research networks as well as science facili\es to ac\vely track and troubleshoot network performance issues. An open- source, community- developed so_ware suite which: Provides a consistent set of proven tools to pinpoint and resolve network performance issues including so_ failures across complex, mul\- domain data paths. Allows you to set network performance expecta\ons with your stakeholders and make informed decisions on future network investments. Creates a standard way to visualize, publish, and archive network metrics and data for future analysis, and aids other networks in debugging issues. perfsonar is designed to pinpoint and iden\fy so_ failures to accelerate resolu\on. January 6, 2016 15

Benefits: Finding the needle in the haystack Above all, perfsonar allows you to maintain a healthy, high- performing network because it helps iden\fy the so_ failures in the network path. Classical monitoring systems have limita\ons Performance problems are o_en only visible at the ends Individual network components (e.g. routers) have no knowledge of end host state perfsonar tests the network in ways that classical monitoring systems do not More perfsonar distribu\ons equal beoer network visibility. January 6, 2016 16

Benefits: Finding the needle in the haystack Example: Find and replace failing op\cs normal performance Gb/s degrading performance repair one month January 6, 2016 17

Benefits: Finding the needle in the haystack Example: Host Tuning January 6, 2016 18

Benefits: Finding the needle in the haystack Inside the firewall One direc\on severely impacted by firewall Not useful for science data Outside the firewall Good performance in both direc\ons January 6, 2016 19

HIDDEN SLIDE Slides 18 to 23 These slides have a lot of text this is provided as an ar\fact a_er the fact. People will want to read things you should not read all text on a slide (e.g. prac\ce before you give them) Update Slide 19 and 20 with each use (to ensure more up to date pictures) Purpose: perfsonar works because of the community deploying nodes in places that we need visibility. There wouldn t be a perfsonar without the community.

Who is running perfsonar? More than 1500 deployments, world- wide h"p://stats.es.net/servicesdirectory/ January 6, 2016 21

Benefit: Mul\- domain insight perfsonar has seen a steady increase in deployments with each release. January 6, 2016 22

Benefit: Visibility perfsonar Dashboard Status at- a- glance Packet loss Throughput Correctness Example available to browse: hop://ps- dashboard.es.net/ hop://pas.net.internet2.edu/ Drill- down capabili\es: Test history between hosts Ability to correlate with other events Very valuable for fault localiza\on and isola\on January 6, 2016 23

Benefit: Investment Planning, Verifica\on Test data and metrics verifies performance of current investments Can you get full use out of the carrier circuit you re paying for? If performance suddenly changes, what caused it? Data informs future investments Put resources in places with demonstrated need Example: if your firewall is limi\ng performance, buying more bandwidth won t solve the problem Make the case for architectural improvements How might a Science DMZ or alternate architecture change performance? How to evaluate poten\al purchases? Put perfsonar hosts on them and run tests Prototype new model January 6, 2016 24

Benefit: Improved Responsiveness Test data allows for expecta\on management Communicate what is possible to stakeholders like users and senior management Efficient troubleshoo\ng If a customer is having problems, is it their machine or the network? Focus scarce human cycles on problems quickly Localize troubleshoo\ng Networking is global O_en the problem isn t local perfsonar helps determine area of responsibility Again, direc\ng human effort quickly and appropriately January 6, 2016 25

Benefit: Ac\ve and Growing Community Ac\ve email lists and forums provide: Instant access to advice and exper\se from the community. Ability to share metrics, experience and findings with others to help debug issues on a global scale. Joining the community automa\cally increases the reach and power of perfsonar The more endpoints means exponen\ally more ways to test and discover issues, compare metrics January 6, 2016 26

HIDDEN SLIDE Slides 25-26 Purpose: Sum up what you talked about. Encourage deployment.

In Closing Long story made short, you can t fix what you can t find you can t find what you can t see perfsonar lets you see perfsonar is a so_ware tool that is: flexible provides ac\ve and passive network metrics inexpensive, low risk to deploy open- source community- developed, community curated January 6, 2016 28

Resources perfsonar website hop://www.perfsonar.net/ perfsonar mailing lists hop://www.perfsonar.net/ about/gewng- help/ perfsonar directory of users hop://stats.es.net/ ServicesDirectory/ ESnet FasterData Knowledgebase hop://fasterdata.es.net January 6, 2016 29