Peer-to-Peer Networks 15 Self-Organization. Christian Schindelhauer Technical Faculty Computer-Networks and Telematics University of Freiburg

Similar documents
Peer-to-peer networks: pioneers, self-organisation, small-world-phenomenons

Overlay (and P2P) Networks

The Structure of Information Networks. Jon Kleinberg. Cornell University

How Do Real Networks Look? Networked Life NETS 112 Fall 2014 Prof. Michael Kearns

Networks and stability

Resilient Networking. Thorsten Strufe. Module 3: Graph Analysis. Disclaimer. Dresden, SS 15

M.E.J. Newman: Models of the Small World

Basic Graph Properties

Scalable P2P architectures

Peer-to-Peer Data Management

Social, Information, and Routing Networks: Models, Algorithms, and Strategic Behavior

6. Overview. L3S Research Center, University of Hannover. 6.1 Section Motivation. Investigation of structural aspects of peer-to-peer networks

ECS 253 / MAE 253, Lecture 8 April 21, Web search and decentralized search on small-world networks

Distributed Data Management

Graph Model Selection using Maximum Likelihood


Distributed Data Management. Christoph Lofi Institut für Informationssysteme Technische Universität Braunschweig

Local Search in Unstructured Networks

MAE 298, Lecture 9 April 30, Web search and decentralized search on small-worlds

ECE 158A - Data Networks

CSCI5070 Advanced Topics in Social Computing

ECS 289 / MAE 298, Lecture 9 April 29, Web search and decentralized search on small-worlds

Network Thinking. Complexity: A Guided Tour, Chapters 15-16

SI Networks: Theory and Application, Fall 2008

(Social) Networks Analysis III. Prof. Dr. Daning Hu Department of Informatics University of Zurich

Social and Technological Network Data Analytics. Lecture 5: Structure of the Web, Search and Power Laws. Prof Cecilia Mascolo

CAIM: Cerca i Anàlisi d Informació Massiva

Nick Hamilton Institute for Molecular Bioscience. Essential Graph Theory for Biologists. Image: Matt Moores, The Visible Cell

Distributed Data Management. Christoph Lofi Institut für Informationssysteme Technische Universität Braunschweig

Modelling data networks research summary and modelling tools

arxiv:cond-mat/ v1 [cond-mat.dis-nn] 7 Jun 2004

CS224W: Social and Information Network Analysis Jure Leskovec, Stanford University

CS-E5740. Complex Networks. Scale-free networks

Behavioral Data Mining. Lecture 9 Modeling People

arxiv:cond-mat/ v1 21 Oct 1999

Models of Network Formation. Networked Life NETS 112 Fall 2017 Prof. Michael Kearns

TELCOM2125: Network Science and Analysis

A Multi-Layer Model for the Web Graph

arxiv:cs/ v1 [cs.ir] 26 Apr 2002

CS249: SPECIAL TOPICS MINING INFORMATION/SOCIAL NETWORKS

Rumour spreading in the spatial preferential attachment model

The Shape of the Internet. Slides assembled by Jeff Chase Duke University (thanks to Vishal Misra and C. Faloutsos)

MODELS FOR EVOLUTION AND JOINING OF SMALL WORLD NETWORKS

Introduction to network metrics

Randomized Rumor Spreading in Social Networks

Complex Networks. Structure and Dynamics

Wednesday, March 8, Complex Networks. Presenter: Jirakhom Ruttanavakul. CS 790R, University of Nevada, Reno

Analysis and Comparison of Internet Topology Generators

Lesson 4. Random graphs. Sergio Barbarossa. UPC - Barcelona - July 2008

Math 443/543 Graph Theory Notes 10: Small world phenomenon and decentralized search

Small Worlds in Security Systems: an Analysis of the PGP Certificate Graph

Internet as a Complex Network. Guanrong Chen City University of Hong Kong

On the Origin of Power Laws in Internet Topologies Λ

An introduction to the physics of complex networks

Information Security in Scale Free Networks

Erdős-Rényi Model for network formation

Drawing power law graphs

Machine Learning and Modeling for Social Networks

An Exploratory Journey Into Network Analysis A Gentle Introduction to Network Science and Graph Visualization

Lesson 18. Laura Ricci 08/05/2017

1 Comparing networks, and why social networks are different

Random Graphs CS224W

Network Mathematics - Why is it a Small World? Oskar Sandberg

Graph structure in the web

Distributed Network Routing Algorithms Table for Small World Networks

Distribution-Free Models of Social and Information Networks

Modeling and Analysis of Random Walk Search Algorithms in P2P Networks

- relationships (edges) among entities (nodes) - technology: Internet, World Wide Web - biology: genomics, gene expression, proteinprotein

CSE 190 Lecture 16. Data Mining and Predictive Analytics. Small-world phenomena

arxiv: v1 [cs.ds] 7 Apr 2008

Small-World Models and Network Growth Models. Anastassia Semjonova Roman Tekhov

Networks and Discrete Mathematics

Graph Theory and Network Measurment

Impact of Topology on the Performance of Communication Networks

Network Analysis by Using Various Models of the Online Social Media Networks

On Complex Dynamical Networks. G. Ron Chen Centre for Chaos Control and Synchronization City University of Hong Kong

Chapter 1. Social Media and Social Computing. October 2012 Youn-Hee Han

Signal Processing for Big Data

CS 124/LINGUIST 180 From Languages to Information. Social Networks: Small Worlds, Weak Ties, and Power Laws. Dan Jurafsky Stanford University

CSE 158 Lecture 11. Web Mining and Recommender Systems. Triadic closure; strong & weak ties

TELCOM2125: Network Science and Analysis

The Small World Phenomenon in Hybrid Power Law Graphs

Structure of Social Networks

Link Lifetimes and Randomized Neighbor Selection in DHTs

γ : constant Goett 2 P(k) = k γ k : degree

SLANG Session 4. Jason Quinley Roland Mühlenbernd Seminar für Sprachwissenschaft University of Tübingen

Graph Theory. Graph Theory. COURSE: Introduction to Biological Networks. Euler s Solution LECTURE 1: INTRODUCTION TO NETWORKS.

ECS 253 / MAE 253, Lecture 10 May 3, Web search and decentralized search on small-world networks

CSE 255 Lecture 13. Data Mining and Predictive Analytics. Triadic closure; strong & weak ties

arxiv: v3 [cs.ni] 3 May 2017

Outline. Last 3 Weeks. Today. General background. web characterization ( web archaeology ) size and shape of the web

WLU Mathematics Department Seminar March 12, The Web Graph. Anthony Bonato. Wilfrid Laurier University. Waterloo, Canada

Compressibility of Behavioral Graphs

CSE 158 Lecture 13. Web Mining and Recommender Systems. Triadic closure; strong & weak ties

Examples of Complex Networks

Maximal Independent Set

Web 2.0 Social Data Analysis

Navigation in Networks. Networked Life NETS 112 Fall 2017 Prof. Michael Kearns

Advanced Distributed Systems. Peer to peer systems. Reference. Reference. What is P2P? Unstructured P2P Systems Structured P2P Systems

Distributed Data Management Part 3 - Peer-2-Peer Systems (cont)

Transcription:

Peer-to-Peer Networks 15 Self-Organization Christian Schindelhauer Technical Faculty Computer-Networks and Telematics University of Freiburg

Gnutella Connecting Protokoll - Ping Ping participants query for neighbors are forwarded according for TTL steps (time to live) Ping Ping Ping Ping Pong Pong - Pong answers Ping is forwarded backward on the query path reports IP and port adress (socket pair) Ping Ping Pong Pong Pong Pong Pong number and size of available files 2

Degree Distribution in Gnutella Modeling Large-scale Peer-to-Peer Networks and a Case Study of Gnutella - Mihajlo A. Jovanovic, Master Thesis, 2001 The number of neighbors is distributed according a power law (Pareto) distribution - log(#peers with degree d) = c - k log d - #peers with degree d = C/d k 3

Pareto-Distribution Examples Pareto 1897: Distribution of wealth in the population Yule 1944: frequency of words in texts Zipf 1949: size of towns length of molecule chains file length of Unix-system files. 4

Pareto Verteilung Discreet Pareto-Distribution for x {1,2,3, } - with constant factor - (also known as Riemann s Zeta-function) Heavy tail property - not all moments E[X k ] exist - the expectation exists if and only if (iff) α>2 - variance and E[X 2 ] exist iff α>3 - E[X k ] exists iff α>k+1 Density function of the continuous function for x>x0 5

Indegree and Outdegree of Web-Pages are described by a power law (Pareto) distribution Experiments of - Kumar et al 97: 40 millions Webpages - Barabasi et al 99: Domain *.nd.edu + Web-pages in distance 3 - Broder et al 00: 204 millions web pages (Scan Mai und Okt. 1999) 6

Connectivity of Pareto Graphs William Aiello, Fan Chung, Linyuan Lu, A Random Graph Model for Massive Graphs, STOC 2000 Undirected graph with n nodes where - the probability of k neighbors for a node is pk - where pk = c k -τ for some normalizing factor c Theorem - For sufficient large n such Pareto-Graphs with exponent τ we observe for τ < 1 the graph is connected with probability 1-o(1) for τ > 1 the graph is nont connected with probability 1-o(1) for 1< τ <2 there is a connected component of size Θ(n) for 2< τ < 3.4785 there is only one connected component of size Θ(n) and all others have size O(log n) for τ >3.4785: there is no large connected component of size Θ(n) with probability 1-o(1) For τ >4: no large connected components which size can be described by a power law (Pareto) distribution 7

Zipf Distribution as a Variant of Power Laws George Kinsley Zipf claimed - that the frequency of the n most frequent word f(n) - satisfies the equation n f(n) = c. Zipf probability distribution for x {1,2,3, } - with constant factor c only defined for connstant sized sets, since - is unbounded Zipf distribution relate to the rank - The Zipf exponent α may be larger than 1, i.e. f(n) = c/n α Pareto distribution realte the absolute size, e.g. the number of inhabitants 8

Size of towns Scaling Laws and Urban Distributions, Denise Pumain, 2003 Zipf distribution 9

Zipf s Law and the Internet Lada A. Adamic, Bernardo A. Huberman, 2002 Pareto Distribution!! 10

Heavy-Tailed Probability Distributions in the World Wide Web Mark Crovella, Murad, Taqqu, Azer Bestavros, 1996 11

Small World Phenomenon Milgram s experiment 1967-60 random chosen participants in Wichita, Kansas had to send a packet to an unknown address - They were only allowed to send the packet to friends likewise the friends The majority of packtes arrived within six hops Small-World-Networks - are networks with Pareto distributed node degree - with small diameter (i.e. O(log c n)) - and relatively many cliques Small-World-Networks - Internet, World-Wide-Web, nervous systems, social networks 12

How do Small World Networks Come into Existence? Emergence of scaling in random networks, Albert-Laszlo Barabasi, Reka Albert, 1999 Preferential Attachment-Modell (Barabasi-Albert): - Starting from a small starting graph successively nodes are inserte with m edges each (m is a parameter) - The probability to choose an existing node as a neighbor is proportional to the current degree of a node This leads to a Pareto network with exponent 2,9 ± 0,1 - however cliques are very seldom Watts-Strogatz (1998) - Start with a ring and connections to the m nearest neighbors - With probability p every edge is replaced with a random edge - Allows continuous transition from an ordered graph to chaos Extended by Kleinberg (1999) for the theoretical verification of Milgram s experiment 13

Analyzing Gnutella Modeling Large-scale Peer-to-Peer Networks and a Case Study of Gnutella - Mihajlo A. Jovanovic, 2001 14

Analyzing Gnutella Modeling Large-scale Peer-to-Peer Networks and a Case Study of Gnutella - Mihajlo A. Jovanovic, 2001 Comparison of the characteristic path length - mean distance between two nodes 15

Peer-to-Peer Networks 15 Self-Organization Christian Schindelhauer Technical Faculty Computer-Networks and Telematics University of Freiburg