Basic Network Concepts

Size: px
Start display at page:

Download "Basic Network Concepts"

Transcription

1 Basic Network Concepts

2 Basic Vocabulary Alice Graph Network Edges Links Nodes Vertices Chuck Bob

3 Edges Alice Chuck Bob

4 Edge Weights Alice Chuck Bob

5 Apollo 13 Movie Network Main Actors in Apollo 13 the Movie: Tom Hanks Kevin Bacon Gary Sinise Bill Paxton Ed Harris Actors are nodes. Edges connect actors who were in a movie together. Since all were in Apollo 13, this is not interesting. Let s make a new network that connects them if they were in an additional movie together.

6 Apollo 13 Movie Network Bill Paxton Magnificent Desolation: Walking on the Moon Magnificent Desolation: Walking on the Moon Tom Hanks The Green Mile Beyond All Boundaries Kevin Bacon Gary Sinise The Human Stain Ed Harris

7 Directed or Undirected? Tom Hanks Bill Paxton Kevin Bacon Gary Sinise Ed Harris

8 Adjacency List Tom Hanks TH,BP Bill Paxton TH,GS Kevin Bacon BP,GS GS,KB Gary Sinise Ed Harris GS,EH

9 Adjacency Matrix Bill Paxton Tom Hanks Kevin Bacon TH BP GS EH KB TH 1 2 BP 1 1 GS EH 1 KB 1 Gary Sinise Ed Harris

10 Shortest Path Length and Cliques A C D E F G H B

11 Cliques Tom Hanks Bill Paxton Kevin Bacon Gary Sinise Ed Harris

12 Connectedness Two nodes are connected if there is a path between them. A graph is connected if there is a path between every pair of nodes. In a directed graph, it is strongly connected if there is a directed path between each pair. It is weakly connected if there is a path between every pair if direction is ignored.

13 Hubs and Bridges J I K G H L M N R F P O Q D A E C B

14 Clusters A cluster is a group of nodes that are tightly connected tightly varies, but usually means they are more tightly connected than the network as a whole Does not need to be a clique Group in the lower left of previous graph is a cluster

15 Subnetworks Q A P O D E C B

16 Egocentric Networks Q A D E C B

17 Egocentric Networks Q A D E C B

18 Network Structure

19 Degree Distribution Tom Hanks Degrees Bill Paxton Gary Sinise Ed Harris Kevin Bacon Degree Distribution Tom Hanks Bill Paxton Gary Sinise Kevin Bacon Ed Harris Degree

20 Degree Distribution Degree Distribution Degree

21 Density Edges: 5 Total Possible Edges: 10 Density: 5/10 = 0.5 Tom Hanks Bill Paxton Kevin Bacon Gary Sinise Ed Harris

22 Density Nodes: 8 Edges: 12 Total Possible Edges:?? # Nodes * (# Nodes -1) 2 (8*7)/2 = 56/2 = 28 Density: 12/28 = 0.43

23 Clustering Coefficient Density of a node s 1.5 degree egocentric network (with the node itself excluded) is called its clustering coefficient. An important measure we will see later on.

24 Which Node is Most Important? B A K J I H C Q L R G D P M O N F E

25 Which Node is Most Important? J I K G H L M N R F P O Q D A E C B

26 Closeness Centrality J G I H P 1 O 1 Q 2 R F P O C Q D C 2 D 3 R 1 G 2 J 2 I 2 H 2 =18/10=1.8

27 Closeness Centrality J G I H P 2 O 2 Q 3 R F P O C Q D C 3 D 4 F 1 G 1 J 1 I 1 H 1 =19/10 =1.9

28 Closeness Centrality J I F 1 O 1 G R H Q 1 C 2 D 2 Q R 2 F P O C D G 3 J 3 I 3 H 3 =21/10 =2.1

29 Closeness Centrality J I F 1 O 1 G R H Q 1 C 2 D 2 Q R 2 F P O C D G 3 J 3 I 3 H 3 =21/10 =2.1

30 Degree Centrality K J G I H R=9 F=3 L N M R F P O Q D A E D=5 B=4 C B

31 Betweenness Centrality Measure of a node s influence Percentage of shortest paths that include a given node

32 Betweenness Centrality A B C E D F H G

33 Eigenvector Centrality Measure of a node s importance Iterative matrix computation that gives more weight to nodes if they are connected to influential nodes. The backbone to techniques like Google s PageRank which ranks web pages.

34 Connectivity and Cohesion Minimum number of nodes to remove before the network becomes disconnected. A B C D H E G F G F E D C A B Cohesion=1 Cohesion=2

35 Network

36 Exercise Open an assigned network in a network analysis tool like Gephi or NodeXL. Run statistics to compute centrality. Compare different centrality measures.

37 Visual Analysis of Networks

38 What is interesting about this network?

39 What makes a good visualization? Every node is visible For every node you can count its degree For every link you can follow it from source to destination Clusters and outliers are identifiable (Dunne and Shneiderman, 2009) We can t always do all of this, but it s a start

40 Is this a good visualization?

41 What about this one?

42 And this one?

43 And finally, this one?

44 Node Size and Color

45 Node Size and Color

46 Edge Weight

47 Visualization Issues Scale Too many nodes (~10,000 or more) or edges are almost impossible to visualize Dense networks may not reveal patterns

48 Example: Senate Voting Records

49 Filtering

50 Visualization Tools Gephi All platforms Stand alone program NodeXL Windows only Plugin for Microsoft Excel

51 In Class Exercise Load an assigned dataset into NodeXL or Gephi Create a visualization, using color, size, layout, and other features to tell a story or provide an insight into the data. Post your final visualization in a shared space

52 Tie Strength

53 Strong vs. Weak Ties Strong ties Trusted Close friends and family Weak ties Often part of other social circles Acquaintances, co-workers We talk about strong or weak ties, but in reality, there is a continuous spectrum

54 Mark Granovetter Foundational work in 1973, The Strength of Weak Ties Strong ties had been considered most important His work showed weak ties mattered

55 Getting a Job Carl Y. was doing commission sales for an encyclopedia firm, but was not doing well. He decided he would have to find a different job; meanwhile, he started driving a cab to bring in extra money. One passenger asked to be taken to the train station where he had to meet a friend. This friend turned out to be an old friend of Carl Y.'s, and asked him "what're you doing driving a cab?" When Mr. Y. explained, the friend offered him the job he now holds labor relations manager for a small company, owned by his friend. (Granovetter, 1974, p34) Granovetter, M Getting a Job: A Study of Contacts an

56 Getting a Job George C. was working as a technician for an electrical firm, with a salary of about $8000, and little apparent chance for advancement. While courting his future wife, he met her downstairs neighbor, the manager of a candy shop, a concession leased from a national chain. After they were married, Mr. C. continued to see him when visiting his mother-in-law. The neighbor finally talked him into entering a trainee program for the chain, and arranged an interview for him. Within three years, Mr. C. was earning nearly $30,000 in this business. (Granovetter, 1974, p. 49). Granovetter, M Getting a Job: A Study of Contacts an

57 Getting a Job Edward A., during high school, went to a party given by a girl he knew. There, he met her older sister's boyfriend, who was ten years older than himself. Three years later, when he had just gotten out of the service, he ran into him in a local hangout. In conversation, the boyfriend mentioned to Mr. A. that his company had an opening for a draftsman. Mr. A. applied for this job and was hired. (Granovetter, 1974, p. 76) Granovetter, M Getting a Job: A Study of Contacts an

58 Replicating Milgram s Six Degrees Send booklets from original participants to a target, unknown person (Lin, et al) show that successful chains made heavy use of weak ties

59 Weak Ties in Use Racial integration in schools Job satisfaction in psych hospital

60 The benefits of weak ties Connect people to different social circles, exposing them to more information Many more of them in a person s life than strong ties

61 The network of strong ties

62 Measuring Tie Strength Time Emotional Intensity Intimacy Reciprocal Services

63 Measuring Tie Strength Additional Features Social Distance Structural Emotional Support

64 Quantifying Measurements Time Emotional Intensity Intimacy Reciprocal Services Social Distance Structural Emotional Support

65 Measurement Overlaps

66 Network Structure Forbidden Triad

67 Network Structure - Bridges

68 Tie Strength and Propagation Strong ties more trusted Weak ties wider spread

THE KNOWLEDGE MANAGEMENT STRATEGY IN ORGANIZATIONS. Summer semester, 2016/2017

THE KNOWLEDGE MANAGEMENT STRATEGY IN ORGANIZATIONS. Summer semester, 2016/2017 THE KNOWLEDGE MANAGEMENT STRATEGY IN ORGANIZATIONS Summer semester, 2016/2017 SOCIAL NETWORK ANALYSIS: THEORY AND APPLICATIONS 1. A FEW THINGS ABOUT NETWORKS NETWORKS IN THE REAL WORLD There are four categories

More information

Mathematical Foundations

Mathematical Foundations Mathematical Foundations Steve Borgatti Revised 7/04 in Colchester, U.K. Graphs Networks represented mathematically as graphs A graph G(V,E) consists of Set of nodes vertices V representing actors Set

More information

Tie strength, social capital, betweenness and homophily. Rik Sarkar

Tie strength, social capital, betweenness and homophily. Rik Sarkar Tie strength, social capital, betweenness and homophily Rik Sarkar Networks Position of a node in a network determines its role/importance Structure of a network determines its properties 2 Today Notion

More information

Alessandro Del Ponte, Weijia Ran PAD 637 Week 3 Summary January 31, Wasserman and Faust, Chapter 3: Notation for Social Network Data

Alessandro Del Ponte, Weijia Ran PAD 637 Week 3 Summary January 31, Wasserman and Faust, Chapter 3: Notation for Social Network Data Wasserman and Faust, Chapter 3: Notation for Social Network Data Three different network notational schemes Graph theoretic: the most useful for centrality and prestige methods, cohesive subgroup ideas,

More information

Economics of Information Networks

Economics of Information Networks Economics of Information Networks Stephen Turnbull Division of Policy and Planning Sciences Lecture 4: December 7, 2017 Abstract We continue discussion of the modern economics of networks, which considers

More information

Structure of Social Networks

Structure of Social Networks Structure of Social Networks Outline Structure of social networks Applications of structural analysis Social *networks* Twitter Facebook Linked-in IMs Email Real life Address books... Who Twitter #numbers

More information

Detecting and Analyzing Communities in Social Network Graphs for Targeted Marketing

Detecting and Analyzing Communities in Social Network Graphs for Targeted Marketing Detecting and Analyzing Communities in Social Network Graphs for Targeted Marketing Gautam Bhat, Rajeev Kumar Singh Department of Computer Science and Engineering Shiv Nadar University Gautam Buddh Nagar,

More information

CS224W: Analysis of Networks Jure Leskovec, Stanford University

CS224W: Analysis of Networks Jure Leskovec, Stanford University CS224W: Analysis of Networks Jure Leskovec, Stanford University http://cs224w.stanford.edu 11/13/17 Jure Leskovec, Stanford CS224W: Analysis of Networks, http://cs224w.stanford.edu 2 Observations Models

More information

Mathematics of Networks II

Mathematics of Networks II Mathematics of Networks II 26.10.2016 1 / 30 Definition of a network Our definition (Newman): A network (graph) is a collection of vertices (nodes) joined by edges (links). More precise definition (Bollobàs):

More information

Extracting Information from Complex Networks

Extracting Information from Complex Networks Extracting Information from Complex Networks 1 Complex Networks Networks that arise from modeling complex systems: relationships Social networks Biological networks Distinguish from random networks uniform

More information

CSE 255 Lecture 13. Data Mining and Predictive Analytics. Triadic closure; strong & weak ties

CSE 255 Lecture 13. Data Mining and Predictive Analytics. Triadic closure; strong & weak ties CSE 255 Lecture 13 Data Mining and Predictive Analytics Triadic closure; strong & weak ties Monday Random models of networks: Erdos Renyi random graphs (picture from Wikipedia http://en.wikipedia.org/wiki/erd%c5%91s%e2%80%93r%c3%a9nyi_model)

More information

CSE 158 Lecture 13. Web Mining and Recommender Systems. Triadic closure; strong & weak ties

CSE 158 Lecture 13. Web Mining and Recommender Systems. Triadic closure; strong & weak ties CSE 158 Lecture 13 Web Mining and Recommender Systems Triadic closure; strong & weak ties Monday Random models of networks: Erdos Renyi random graphs (picture from Wikipedia http://en.wikipedia.org/wiki/erd%c5%91s%e2%80%93r%c3%a9nyi_model)

More information

Using! to Teach Graph Theory

Using! to Teach Graph Theory !! Using! to Teach Graph Theory Todd Abel Mary Elizabeth Searcy Appalachian State University Why Graph Theory? Mathematical Thinking (Habits of Mind, Mathematical Practices) Accessible to students at a

More information

CSE 158 Lecture 11. Web Mining and Recommender Systems. Triadic closure; strong & weak ties

CSE 158 Lecture 11. Web Mining and Recommender Systems. Triadic closure; strong & weak ties CSE 158 Lecture 11 Web Mining and Recommender Systems Triadic closure; strong & weak ties Triangles So far we ve seen (a little about) how networks can be characterized by their connectivity patterns What

More information

Web 2.0 Social Data Analysis

Web 2.0 Social Data Analysis Web 2.0 Social Data Analysis Ing. Jaroslav Kuchař jaroslav.kuchar@fit.cvut.cz Structure(1) Czech Technical University in Prague, Faculty of Information Technologies Software and Web Engineering 2 Contents

More information

CSE 190 Lecture 16. Data Mining and Predictive Analytics. Small-world phenomena

CSE 190 Lecture 16. Data Mining and Predictive Analytics. Small-world phenomena CSE 190 Lecture 16 Data Mining and Predictive Analytics Small-world phenomena Another famous study Stanley Milgram wanted to test the (already popular) hypothesis that people in social networks are separated

More information

An Exploratory Journey Into Network Analysis A Gentle Introduction to Network Science and Graph Visualization

An Exploratory Journey Into Network Analysis A Gentle Introduction to Network Science and Graph Visualization An Exploratory Journey Into Network Analysis A Gentle Introduction to Network Science and Graph Visualization Pedro Ribeiro (DCC/FCUP & CRACS/INESC-TEC) Part 1 Motivation and emergence of Network Science

More information

L Modelling and Simulating Social Systems with MATLAB

L Modelling and Simulating Social Systems with MATLAB 851-0585-04L Modelling and Simulating Social Systems with MATLAB Lesson 6 Graphs (Networks) Anders Johansson and Wenjian Yu (with S. Lozano and S. Wehrli) ETH Zürich 2010-03-29 Lesson 6 Contents History:

More information

Degree Distribution: The case of Citation Networks

Degree Distribution: The case of Citation Networks Network Analysis Degree Distribution: The case of Citation Networks Papers (in almost all fields) refer to works done earlier on same/related topics Citations A network can be defined as Each node is a

More information

Introduction To Graphs and Networks. Fall 2013 Carola Wenk

Introduction To Graphs and Networks. Fall 2013 Carola Wenk Introduction To Graphs and Networks Fall 203 Carola Wenk On the Internet, links are essentially weighted by factors such as transit time, or cost. The goal is to find the shortest path from one node to

More information

Social Network Analysis

Social Network Analysis Social Network Analysis Mathematics of Networks Manar Mohaisen Department of EEC Engineering Adjacency matrix Network types Edge list Adjacency list Graph representation 2 Adjacency matrix Adjacency matrix

More information

Social Networks. Slides by : I. Koutsopoulos (AUEB), Source:L. Adamic, SN Analysis, Coursera course

Social Networks. Slides by : I. Koutsopoulos (AUEB), Source:L. Adamic, SN Analysis, Coursera course Social Networks Slides by : I. Koutsopoulos (AUEB), Source:L. Adamic, SN Analysis, Coursera course Introduction Political blogs Organizations Facebook networks Ingredient networks SN representation Networks

More information

Introduction Types of Social Network Analysis Social Networks in the Online Age Data Mining for Social Network Analysis Applications Conclusion

Introduction Types of Social Network Analysis Social Networks in the Online Age Data Mining for Social Network Analysis Applications Conclusion Introduction Types of Social Network Analysis Social Networks in the Online Age Data Mining for Social Network Analysis Applications Conclusion References Social Network Social Network Analysis Sociocentric

More information

Math 215 Project (25 pts) : Using Linear Algebra to solve Graph Problems

Math 215 Project (25 pts) : Using Linear Algebra to solve Graph Problems Due: Fri. Mar. 30 NAME(S): Math 215 Project (25 pts) : Using Linear Algebra to solve Graph Problems 1 Introduction First let us define what we mean by a graph. A graph is a set of points (called vertices,

More information

Graph Theory. Network Science: Graph theory. Graph theory Terminology and notation. Graph theory Graph visualization

Graph Theory. Network Science: Graph theory. Graph theory Terminology and notation. Graph theory Graph visualization Network Science: Graph Theory Ozalp abaoglu ipartimento di Informatica Scienza e Ingegneria Università di ologna www.cs.unibo.it/babaoglu/ ranch of mathematics for the study of structures called graphs

More information

Week 5 Video 5. Relationship Mining Network Analysis

Week 5 Video 5. Relationship Mining Network Analysis Week 5 Video 5 Relationship Mining Network Analysis Today s Class Network Analysis Network Analysis Analysis of anything that can be seen as connections between nodes Most common social networks Connections

More information

NodeXL for Network analysis. Hands-on at NICAR 2014, Baltimore, Feb 28. Peter

NodeXL for Network analysis. Hands-on at NICAR 2014, Baltimore, Feb 28. Peter NodeXL for Network analysis Hands-on at NICAR 2014, Baltimore, Feb 28 Peter Aldhous peter@peteraldhous.com @paldhous NodeXL is a template for Microsoft Excel 2007 and later, which allows you to run network

More information

Navigation in Networks. Networked Life NETS 112 Fall 2017 Prof. Michael Kearns

Navigation in Networks. Networked Life NETS 112 Fall 2017 Prof. Michael Kearns Navigation in Networks Networked Life NETS 112 Fall 2017 Prof. Michael Kearns The Navigation Problem You are an individual (vertex) in a very large social network You want to find a (short) chain of friendships

More information

Social Networks, Social Interaction, and Outcomes

Social Networks, Social Interaction, and Outcomes Social Networks, Social Interaction, and Outcomes Social Networks and Social Interaction Not all links are created equal: Some links are stronger than others Some links are more useful than others Links

More information

Social Network Analysis With igraph & R. Ofrit Lesser December 11 th, 2014

Social Network Analysis With igraph & R. Ofrit Lesser December 11 th, 2014 Social Network Analysis With igraph & R Ofrit Lesser ofrit.lesser@gmail.com December 11 th, 2014 Outline The igraph R package Basic graph concepts What can you do with igraph? Construction Attributes Centrality

More information

Behavioral Data Mining. Lecture 9 Modeling People

Behavioral Data Mining. Lecture 9 Modeling People Behavioral Data Mining Lecture 9 Modeling People Outline Power Laws Big-5 Personality Factors Social Network Structure Power Laws Y-axis = frequency of word, X-axis = rank in decreasing order Power Laws

More information

Network Analysis. Dr. Scott A. Hale Oxford Internet Institute 16 March 2016

Network Analysis. Dr. Scott A. Hale Oxford Internet Institute   16 March 2016 Network Analysis Dr. Scott A. Hale Oxford Internet Institute http://www.scotthale.net/ 16 March 2016 Outline for today 1 Basic network concepts 2 Network data 3 Software for networks 4 Layout algorithms

More information

Algorithmic and Economic Aspects of Networks. Nicole Immorlica

Algorithmic and Economic Aspects of Networks. Nicole Immorlica Algorithmic and Economic Aspects of Networks Nicole Immorlica Syllabus 1. Jan. 8 th (today): Graph theory, network structure 2. Jan. 15 th : Random graphs, probabilistic network formation 3. Jan. 20 th

More information

Centralities (4) By: Ralucca Gera, NPS. Excellence Through Knowledge

Centralities (4) By: Ralucca Gera, NPS. Excellence Through Knowledge Centralities (4) By: Ralucca Gera, NPS Excellence Through Knowledge Some slide from last week that we didn t talk about in class: 2 PageRank algorithm Eigenvector centrality: i s Rank score is the sum

More information

Topic II: Graph Mining

Topic II: Graph Mining Topic II: Graph Mining Discrete Topics in Data Mining Universität des Saarlandes, Saarbrücken Winter Semester 2012/13 T II.Intro-1 Topic II Intro: Graph Mining 1. Why Graphs? 2. What is Graph Mining 3.

More information

Nick Hamilton Institute for Molecular Bioscience. Essential Graph Theory for Biologists. Image: Matt Moores, The Visible Cell

Nick Hamilton Institute for Molecular Bioscience. Essential Graph Theory for Biologists. Image: Matt Moores, The Visible Cell Nick Hamilton Institute for Molecular Bioscience Essential Graph Theory for Biologists Image: Matt Moores, The Visible Cell Outline Core definitions Which are the most important bits? What happens when

More information

Modeling and Simulating Social Systems with MATLAB

Modeling and Simulating Social Systems with MATLAB Modeling and Simulating Social Systems with MATLAB Lecture 8 Introduction to Graphs/Networks Olivia Woolley, Stefano Balietti, Lloyd Sanders, Dirk Helbing Chair of Sociology, in particular of Modeling

More information

Graph Structure Over Time

Graph Structure Over Time Graph Structure Over Time Observing how time alters the structure of the IEEE data set Priti Kumar Computer Science Rensselaer Polytechnic Institute Troy, NY Kumarp3@rpi.edu Abstract This paper examines

More information

The Basics of Network Structure

The Basics of Network Structure The Basics of Network Structure James M. Cook University of Maine at Augusta james.m.cook@maine.edu Keywords Betweenness; Centrality; Closeness; Degree; Density; Diameter; Distance; Clique; Connected Component;

More information

The application of Randomized HITS algorithm in the fund trading network

The application of Randomized HITS algorithm in the fund trading network The application of Randomized HITS algorithm in the fund trading network Xingyu Xu 1, Zhen Wang 1,Chunhe Tao 1,Haifeng He 1 1 The Third Research Institute of Ministry of Public Security,China Abstract.

More information

Complex-Network Modelling and Inference

Complex-Network Modelling and Inference Complex-Network Modelling and Inference Lecture 8: Graph features (2) Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/notes/ Network_Modelling/ School

More information

Web Structure Mining Community Detection and Evaluation

Web Structure Mining Community Detection and Evaluation Web Structure Mining Community Detection and Evaluation 1 Community Community. It is formed by individuals such that those within a group interact with each other more frequently than with those outside

More information

Recap! CMSC 498J: Social Media Computing. Department of Computer Science University of Maryland Spring Hadi Amiri

Recap! CMSC 498J: Social Media Computing. Department of Computer Science University of Maryland Spring Hadi Amiri Recap! CMSC 498J: Social Media Computing Department of Computer Science University of Maryland Spring 2015 Hadi Amiri hadi@umd.edu Announcement CourseEvalUM https://www.courseevalum.umd.edu/ 2 Announcement

More information

Cascades. Rik Sarkar. Social and Technological Networks. University of Edinburgh, 2018.

Cascades. Rik Sarkar. Social and Technological Networks. University of Edinburgh, 2018. Cascades Social and Technological Networks Rik Sarkar University of Edinburgh, 2018. Course Solutions to Ex0 are up Make sure you are comfortable with this material Notes 1 with exercise questions are

More information

CIP- OSN Online Social Networks as Graphs. Dr. Thanassis Tiropanis -

CIP- OSN Online Social Networks as Graphs. Dr. Thanassis Tiropanis - CIP- OSN Online Social Networks as Graphs Dr. Thanassis Tiropanis - tt2@ecs http://vimeo.com/58729247 http://socialnetworks.soton.ac.uk The narra9ve Web Evolu9on and Online Social Networks Web Evolu9on

More information

Web 2.0 Social Data Analysis

Web 2.0 Social Data Analysis Web 2.0 Social Data Analysis Ing. Jaroslav Kuchař jaroslav.kuchar@fit.cvut.cz Structure (2) Czech Technical University in Prague, Faculty of Information Technologies Software and Web Engineering 2 Contents

More information

Non Overlapping Communities

Non Overlapping Communities Non Overlapping Communities Davide Mottin, Konstantina Lazaridou HassoPlattner Institute Graph Mining course Winter Semester 2016 Acknowledgements Most of this lecture is taken from: http://web.stanford.edu/class/cs224w/slides

More information

Graph and Link Mining

Graph and Link Mining Graph and Link Mining Graphs - Basics A graph is a powerful abstraction for modeling entities and their pairwise relationships. G = (V,E) Set of nodes V = v,, v 5 Set of edges E = { v, v 2, v 4, v 5 }

More information

CS246: Mining Massive Datasets Jure Leskovec, Stanford University

CS246: Mining Massive Datasets Jure Leskovec, Stanford University CS246: Mining Massive Datasets Jure Leskovec, Stanford University http://cs246.stanford.edu HITS (Hypertext Induced Topic Selection) Is a measure of importance of pages or documents, similar to PageRank

More information

Graph Theory and Network Measurment

Graph Theory and Network Measurment Graph Theory and Network Measurment Social and Economic Networks MohammadAmin Fazli Social and Economic Networks 1 ToC Network Representation Basic Graph Theory Definitions (SE) Network Statistics and

More information

Social Network Analysis (SNA) including a tutorial on concepts and methods

Social Network Analysis (SNA) including a tutorial on concepts and methods Social Network Analysis (SNA) including a tutorial on concepts and methods Social Media Dr. Giorgos Cheliotis (gcheliotis@nus.edu.sg) Communications and New Media, National University of Singapore Source

More information

CS 124/LINGUIST 180 From Languages to Information. Social Networks: Small Worlds, Weak Ties, and Power Laws. Dan Jurafsky Stanford University

CS 124/LINGUIST 180 From Languages to Information. Social Networks: Small Worlds, Weak Ties, and Power Laws. Dan Jurafsky Stanford University CS 124/LINGUIST 180 From Languages to Information Dan Jurafsky Stanford University Social Networks: Small Worlds, Weak Ties, and Power Laws Slides from Jure Leskovec, Lada Adamic, James Moody, Bing Liu,

More information

CS249: SPECIAL TOPICS MINING INFORMATION/SOCIAL NETWORKS

CS249: SPECIAL TOPICS MINING INFORMATION/SOCIAL NETWORKS CS249: SPECIAL TOPICS MINING INFORMATION/SOCIAL NETWORKS Overview of Networks Instructor: Yizhou Sun yzsun@cs.ucla.edu January 10, 2017 Overview of Information Network Analysis Network Representation Network

More information

GEPHI Introduction to network analysis and visualization

GEPHI Introduction to network analysis and visualization GEPHI Introduction to network analysis and visualization GRANDJEAN, Martin (2015) «GEPHI Introduction to network analysis and visualization», http://www.martingrandjean.ch/gephi-introduction 15 minutes

More information

The Picture of Dorian Gray

The Picture of Dorian Gray Comprehension Test for ISBN 978-0-19-479126-7 The Picture of Dorian Gray Oscar Wilde 1 Are these sentences true (T) or false (F)? a Dorian Gray was twenty years old at the beginning of the story. b He

More information

CSE 258 Lecture 12. Web Mining and Recommender Systems. Social networks

CSE 258 Lecture 12. Web Mining and Recommender Systems. Social networks CSE 258 Lecture 12 Web Mining and Recommender Systems Social networks Social networks We ve already seen networks (a little bit) in week 3 i.e., we ve studied inference problems defined on graphs, and

More information

RANDOM-REAL NETWORKS

RANDOM-REAL NETWORKS RANDOM-REAL NETWORKS 1 Random networks: model A random graph is a graph of N nodes where each pair of nodes is connected by probability p: G(N,p) Random networks: model p=1/6 N=12 L=8 L=10 L=7 The number

More information

Link Analysis from Bing Liu. Web Data Mining: Exploring Hyperlinks, Contents, and Usage Data, Springer and other material.

Link Analysis from Bing Liu. Web Data Mining: Exploring Hyperlinks, Contents, and Usage Data, Springer and other material. Link Analysis from Bing Liu. Web Data Mining: Exploring Hyperlinks, Contents, and Usage Data, Springer and other material. 1 Contents Introduction Network properties Social network analysis Co-citation

More information

CS246: Mining Massive Datasets Jure Leskovec, Stanford University

CS246: Mining Massive Datasets Jure Leskovec, Stanford University CS246: Mining Massive Datasets Jure Leskovec, Stanford University http://cs246.stanford.edu SPAM FARMING 2/11/2013 Jure Leskovec, Stanford C246: Mining Massive Datasets 2 2/11/2013 Jure Leskovec, Stanford

More information

CENTRALITIES. Carlo PICCARDI. DEIB - Department of Electronics, Information and Bioengineering Politecnico di Milano, Italy

CENTRALITIES. Carlo PICCARDI. DEIB - Department of Electronics, Information and Bioengineering Politecnico di Milano, Italy CENTRALITIES Carlo PICCARDI DEIB - Department of Electronics, Information and Bioengineering Politecnico di Milano, Italy email carlo.piccardi@polimi.it http://home.deib.polimi.it/piccardi Carlo Piccardi

More information

CSE 158 Lecture 11. Web Mining and Recommender Systems. Social networks

CSE 158 Lecture 11. Web Mining and Recommender Systems. Social networks CSE 158 Lecture 11 Web Mining and Recommender Systems Social networks Assignment 1 Due 5pm next Monday! (Kaggle shows UTC time, but the due date is 5pm, Monday, PST) Assignment 1 Assignment 1 Social networks

More information

Graphs. Data Structures and Algorithms CSE 373 SU 18 BEN JONES 1

Graphs. Data Structures and Algorithms CSE 373 SU 18 BEN JONES 1 Graphs Data Structures and Algorithms CSE 373 SU 18 BEN JONES 1 Warmup Discuss with your neighbors: Come up with as many kinds of relational data as you can (data that can be represented with a graph).

More information

Algorithms and Applications in Social Networks. 2017/2018, Semester B Slava Novgorodov

Algorithms and Applications in Social Networks. 2017/2018, Semester B Slava Novgorodov Algorithms and Applications in Social Networks 2017/2018, Semester B Slava Novgorodov 1 Lesson #1 Administrative questions Course overview Introduction to Social Networks Basic definitions Network properties

More information

Link Analysis and Web Search

Link Analysis and Web Search Link Analysis and Web Search Moreno Marzolla Dip. di Informatica Scienza e Ingegneria (DISI) Università di Bologna http://www.moreno.marzolla.name/ based on material by prof. Bing Liu http://www.cs.uic.edu/~liub/webminingbook.html

More information

Information Networks and Semantics. Srinath Srinivasa IIIT Bangalore

Information Networks and Semantics. Srinath Srinivasa IIIT Bangalore Information Networks and Semantics Srinath Srinivasa IIIT Bangalore sri@iiitb.ac.in Outline Information versus Material Networks Semantics in Information Networks Knowledge Networks Triadic Closure Entrenchment

More information

L Modeling and Simulating Social Systems with MATLAB

L Modeling and Simulating Social Systems with MATLAB 851-0585-04L Modeling and Simulating Social Systems with MATLAB Lecture 6 Introduction to Graphs/Networks Karsten Donnay and Stefano Balietti Chair of Sociology, in particular of Modeling and Simulation

More information

STRUCTURES OF STORY PROBLEMS SEPARATE

STRUCTURES OF STORY PROBLEMS SEPARATE STRUCTURES OF PROBLEMS SAMPLE RESULT STRUCTURES OF STORY PROBLEMS Separate story problems have an action that causes a decrease. These problems have the same three quantities as join problems: the result

More information

Network Thinking. Complexity: A Guided Tour, Chapters 15-16

Network Thinking. Complexity: A Guided Tour, Chapters 15-16 Network Thinking Complexity: A Guided Tour, Chapters 15-16 Neural Network (C. Elegans) http://gephi.org/wp-content/uploads/2008/12/screenshot-celegans.png Food Web http://1.bp.blogspot.com/_vifbm3t8bou/sbhzqbchiei/aaaaaaaaaxk/rsc-pj45avc/

More information

Analysis of Tweets: Donald Trump and sexual harassment allegations

Analysis of Tweets: Donald Trump and sexual harassment allegations Analysis of Tweets: Donald Trump and sexual harassment allegations MAIN CONCEPT Twitter historical database was used to search for suitable tweets. Search term of Trump and harassment was consequently

More information

Networks in economics and finance. Lecture 1 - Measuring networks

Networks in economics and finance. Lecture 1 - Measuring networks Networks in economics and finance Lecture 1 - Measuring networks What are networks and why study them? A network is a set of items (nodes) connected by edges or links. Units (nodes) Individuals Firms Banks

More information

1. a graph G = (V (G), E(G)) consists of a set V (G) of vertices, and a set E(G) of edges (edges are pairs of elements of V (G))

1. a graph G = (V (G), E(G)) consists of a set V (G) of vertices, and a set E(G) of edges (edges are pairs of elements of V (G)) 10 Graphs 10.1 Graphs and Graph Models 1. a graph G = (V (G), E(G)) consists of a set V (G) of vertices, and a set E(G) of edges (edges are pairs of elements of V (G)) 2. an edge is present, say e = {u,

More information

Beyond the Euler Trail. Mathematics is often thought of as formulas, ratios, and the number Pi. The history of

Beyond the Euler Trail. Mathematics is often thought of as formulas, ratios, and the number Pi. The history of Patino 1 Prof. Petersen Sierra Patino Math 101 Section 4939 6 April 2016 Beyond the Euler Trail Mathematics is often thought of as formulas, ratios, and the number Pi. The history of math and its roots

More information

TELCOM2125: Network Science and Analysis

TELCOM2125: Network Science and Analysis School of Information Sciences University of Pittsburgh TELCOM2125: Network Science and Analysis Konstantinos Pelechrinis Spring 2015 Figures are taken from: M.E.J. Newman, Networks: An Introduction 2

More information

Graphs / Networks. CSE 6242/ CX 4242 Feb 18, Centrality measures, algorithms, interactive applications. Duen Horng (Polo) Chau Georgia Tech

Graphs / Networks. CSE 6242/ CX 4242 Feb 18, Centrality measures, algorithms, interactive applications. Duen Horng (Polo) Chau Georgia Tech CSE 6242/ CX 4242 Feb 18, 2014 Graphs / Networks Centrality measures, algorithms, interactive applications Duen Horng (Polo) Chau Georgia Tech Partly based on materials by Professors Guy Lebanon, Jeffrey

More information

CMSC 132: Project #8

CMSC 132: Project #8 CMSC 132: Project #8 Due on Friday, August 5, 2016 11:59pm Anwar Mamat 1 Anwar Mamat CMSC 132 (Anwar 11:59pm): Project #8 Problem 1 Six Degrees of Kevin Bacon In this project, you write a program that

More information

The Network Analysis Five-Number Summary

The Network Analysis Five-Number Summary Chapter 2 The Network Analysis Five-Number Summary There is nothing like looking, if you want to find something. You certainly usually find something, if you look, but it is not always quite the something

More information

Lecture 11: Graph algorithms! Claudia Hauff (Web Information Systems)!

Lecture 11: Graph algorithms! Claudia Hauff (Web Information Systems)! Lecture 11: Graph algorithms!! Claudia Hauff (Web Information Systems)! ti2736b-ewi@tudelft.nl 1 Course content Introduction Data streams 1 & 2 The MapReduce paradigm Looking behind the scenes of MapReduce:

More information

Analysis and visualization with v isone

Analysis and visualization with v isone Analysis and visualization with v isone Jürgen Lerner University of Konstanz Egoredes Summerschool Barcelona, 21. 25. June, 2010 About v isone. Visone is the Italian word for mink. In Spanish visón. visone

More information

Econ 430 Lecture 3: Significance and Structural Properties of N

Econ 430 Lecture 3: Significance and Structural Properties of N Econ 430 Lecture 3: Significance and Structural Properties of Networks Alper Duman Izmir University Economics, March 8, 2013 Prevalence of Networks Networks are everywhere! Even in this class. We can classify

More information

Math 443/543 Graph Theory Notes 10: Small world phenomenon and decentralized search

Math 443/543 Graph Theory Notes 10: Small world phenomenon and decentralized search Math 443/543 Graph Theory Notes 0: Small world phenomenon and decentralized search David Glickenstein November 0, 008 Small world phenomenon The small world phenomenon is the principle that all people

More information

SOFIA: Social Filtering for Niche Markets

SOFIA: Social Filtering for Niche Markets Social Filtering for Niche Markets Matteo Dell'Amico Licia Capra University College London UCL MobiSys Seminar 9 October 2007 : Social Filtering for Niche Markets Outline 1 Social Filtering Competence:

More information

1 Starting around 1996, researchers began to work on. 2 In Feb, 1997, Yanhong Li (Scotch Plains, NJ) filed a

1 Starting around 1996, researchers began to work on. 2 In Feb, 1997, Yanhong Li (Scotch Plains, NJ) filed a !"#$ %#& ' Introduction ' Social network analysis ' Co-citation and bibliographic coupling ' PageRank ' HIS ' Summary ()*+,-/*,) Early search engines mainly compare content similarity of the query and

More information

David Easley and Jon Kleinberg January 24, 2007

David Easley and Jon Kleinberg January 24, 2007 Networks: Spring 2007 Graph Theory David Easley and Jon Kleinberg January 24, 2007 A graph is simply a way of encoding the pairwise relationships among a set of objects: we will refer to the objects as

More information

University of Maryland. Tuesday, March 2, 2010

University of Maryland. Tuesday, March 2, 2010 Data-Intensive Information Processing Applications Session #5 Graph Algorithms Jimmy Lin University of Maryland Tuesday, March 2, 2010 This work is licensed under a Creative Commons Attribution-Noncommercial-Share

More information

Key words: Wikipedia - a non-profit encyclopedia project available online and written collaboratively by volunteers from around the world

Key words: Wikipedia - a non-profit encyclopedia project available online and written collaboratively by volunteers from around the world Jacob Wenger Programming Paradigms Thursday, May 12, 2011 Six Degrees of Wikipedia Abstract: I created an application which allows you to find the shortest paths between any two Wikipedia articles. Paths,

More information

Basics of Network Analysis

Basics of Network Analysis Basics of Network Analysis Hiroki Sayama sayama@binghamton.edu Graph = Network G(V, E): graph (network) V: vertices (nodes), E: edges (links) 1 Nodes = 1, 2, 3, 4, 5 2 3 Links = 12, 13, 15, 23,

More information

Analysis of Biological Networks. 1. Clustering 2. Random Walks 3. Finding paths

Analysis of Biological Networks. 1. Clustering 2. Random Walks 3. Finding paths Analysis of Biological Networks 1. Clustering 2. Random Walks 3. Finding paths Problem 1: Graph Clustering Finding dense subgraphs Applications Identification of novel pathways, complexes, other modules?

More information

Ian Clarke Oskar Sandberg

Ian Clarke Oskar Sandberg Ian Clarke is the architect and coordinator of The Freenet Project, and the Chief Executive Officer of Cematics Ltd, a company he founded to realise commercial applications for the Freenet technology.

More information

Distribution-Free Models of Social and Information Networks

Distribution-Free Models of Social and Information Networks Distribution-Free Models of Social and Information Networks Tim Roughgarden (Stanford CS) joint work with Jacob Fox (Stanford Math), Rishi Gupta (Stanford CS), C. Seshadhri (UC Santa Cruz), Fan Wei (Stanford

More information

A Short Introduction To Social Network Analysis Dr. Mishari Alnahedh Kuwait University College of Business Administration

A Short Introduction To Social Network Analysis Dr. Mishari Alnahedh Kuwait University College of Business Administration A Short Introduction To Social Network Analysis Dr. Kuwait University College of Business Administration Introduction A network is a collection of points linked through some type of association. These

More information

Centrality Book. cohesion.

Centrality Book. cohesion. Cohesion The graph-theoretic terms discussed in the previous chapter have very specific and concrete meanings which are highly shared across the field of graph theory and other fields like social network

More information

1 Homophily and assortative mixing

1 Homophily and assortative mixing 1 Homophily and assortative mixing Networks, and particularly social networks, often exhibit a property called homophily or assortative mixing, which simply means that the attributes of vertices correlate

More information

MEMOR.IO ONSCREEN SHORT MOVIE BY VADIM GORDT

MEMOR.IO ONSCREEN SHORT MOVIE BY VADIM GORDT MEMOR.IO ONSCREEN SHORT MOVIE BY VADIM GORDT Synopsis A girl is waiting for a skype call from her father at her 14 th birthday. When she was 10 he left home for a military operation and since that she

More information

How to explore big networks? Question: Perform a random walk on G. What is the average node degree among visited nodes, if avg degree in G is 200?

How to explore big networks? Question: Perform a random walk on G. What is the average node degree among visited nodes, if avg degree in G is 200? How to explore big networks? Question: Perform a random walk on G. What is the average node degree among visited nodes, if avg degree in G is 200? Questions from last time Avg. FB degree is 200 (suppose).

More information

Type of Project: This is an empirical analysis project. We incorporated graph algorithms and social network algorithms.

Type of Project: This is an empirical analysis project. We incorporated graph algorithms and social network algorithms. Congressional Influence on Student Debt Katherine Dix, Juan Padilla, William Archer Introduction For our final project, we decided to analyze the relationships between people in Congress in order to find

More information

Data-Intensive Computing with MapReduce

Data-Intensive Computing with MapReduce Data-Intensive Computing with MapReduce Session 5: Graph Processing Jimmy Lin University of Maryland Thursday, February 21, 2013 This work is licensed under a Creative Commons Attribution-Noncommercial-Share

More information

1 Jane s dress is... yours. A the same than B the same to C similar than D similar to

1 Jane s dress is... yours. A the same than B the same to C similar than D similar to Test 5A 1 Jane s dress is... yours. A the same than B the same to C similar than D similar to 2 We ve proved that he was guilty but he... doesn t admit it. A yet B already C still D no longer 3 If I...

More information

Mining and Analyzing Online Social Networks

Mining and Analyzing Online Social Networks The 5th EuroSys Doctoral Workshop (EuroDW 2011) Salzburg, Austria, Sunday 10 April 2011 Mining and Analyzing Online Social Networks Emilio Ferrara eferrara@unime.it Advisor: Prof. Giacomo Fiumara PhD School

More information

Small-World Models and Network Growth Models. Anastassia Semjonova Roman Tekhov

Small-World Models and Network Growth Models. Anastassia Semjonova Roman Tekhov Small-World Models and Network Growth Models Anastassia Semjonova Roman Tekhov Small world 6 billion small world? 1960s Stanley Milgram Six degree of separation Small world effect Motivation Not only friends:

More information

Objective and Subjective Specifications

Objective and Subjective Specifications 2017-7-10 0 Objective and Subjective Specifications Eric C.R. Hehner Department of Computer Science, University of Toronto hehner@cs.utoronto.ca Abstract: We examine specifications for dependence on the

More information