Systems, ESD.00. Networks II. Lecture 8. Lecturers: Professor Joseph Sussman Dr. Afreen Siddiqi TA: Regina Clewlow

Similar documents
Introduction to Engineering Systems, ESD.00. Networks. Lecturers: Professor Joseph Sussman Dr. Afreen Siddiqi TA: Regina Clewlow

Networks in economics and finance. Lecture 1 - Measuring networks

Wednesday, March 8, Complex Networks. Presenter: Jirakhom Ruttanavakul. CS 790R, University of Nevada, Reno

An Exploratory Journey Into Network Analysis A Gentle Introduction to Network Science and Graph Visualization

Network Thinking. Complexity: A Guided Tour, Chapters 15-16

CAIM: Cerca i Anàlisi d Informació Massiva

Complex Networks. Structure and Dynamics

RANDOM-REAL NETWORKS

Constructing a G(N, p) Network

TELCOM2125: Network Science and Analysis

Tie strength, social capital, betweenness and homophily. Rik Sarkar

Plan of the lecture I. INTRODUCTION II. DYNAMICAL PROCESSES. I. Networks: definitions, statistical characterization, examples II. Modeling frameworks

Failure in Complex Social Networks

Theory and Applications of Complex Networks

Introduction to Networks and Business Intelligence

TELCOM2125: Network Science and Analysis

Constructing a G(N, p) Network

Modeling and Simulating Social Systems with MATLAB

What is a Network? Theory and Applications of Complex Networks. Network Example 1: High School Friendships

How Do Real Networks Look? Networked Life NETS 112 Fall 2014 Prof. Michael Kearns

Impact of Clustering on Epidemics in Random Networks

Introduction to network metrics

Critical Phenomena in Complex Networks

GTA West Corridor Review

(Social) Networks Analysis III. Prof. Dr. Daning Hu Department of Informatics University of Zurich

Supply chains involve complex webs of interactions among suppliers, manufacturers,

A Generating Function Approach to Analyze Random Graphs

Economics of Information Networks

Algorithms and Applications in Social Networks. 2017/2018, Semester B Slava Novgorodov

CS-E5740. Complex Networks. Scale-free networks

1 Degree Distributions

Structural Analysis of Paper Citation and Co-Authorship Networks using Network Analysis Techniques

M.E.J. Newman: Models of the Small World

CS224W: Analysis of Networks Jure Leskovec, Stanford University

Disclaimer. Lect 2: empirical analyses of graphs

Doug Couto Texas A&M Transportation Technology Conference 2017 College Station, Texas May 4, 2017

ECS 253 / MAE 253, Lecture 8 April 21, Web search and decentralized search on small-world networks

Social, Information, and Routing Networks: Models, Algorithms, and Strategic Behavior

Network Theory: Social, Mythological and Fictional Networks. Math 485, Spring 2018 (Midterm Report) Christina West, Taylor Martins, Yihe Hao

Resilience at JRC. Naouma Kourti. Dep. Head of Unit. Technology Innovation in security Security, Space and Migration Directorate

The missing links in the BGP-based AS connectivity maps

Universal Properties of Mythological Networks Midterm report: Math 485

Smallest small-world network

Overlay (and P2P) Networks

Supplementary material to Epidemic spreading on complex networks with community structures

Network Environments in AnyLogic. Nathaniel Osgood Agent-Based Modeling Bootcamp for Health Researchers

Social and Technological Network Analysis. Lecture 6: Network Robustness and Applica=ons. Dr. Cecilia Mascolo

Critical Infrastructure Protection (CIP) as example of a multi-stakeholder approach.

National Centre for Energy Systems Integration Introduction to the Centre November 2016

Graph Theory. Graph Theory. COURSE: Introduction to Biological Networks. Euler s Solution LECTURE 1: INTRODUCTION TO NETWORKS.

Example for calculation of clustering coefficient Node N 1 has 8 neighbors (red arrows) There are 12 connectivities among neighbors (blue arrows)

Navigation in Networks. Networked Life NETS 112 Fall 2017 Prof. Michael Kearns

Methods of Technical Risk Assessment in a Regional Context

Marine Transportation System Resilience: A Federal Agency Perspective

HOW WE EXPRESS OURSELVES

Evaluating and Improving Cybersecurity Capabilities of the Electricity Critical Infrastructure

SPACE for SDGs a Global Partnership

NDIA 19th Annual System Engineering Conference, Springfield, Virginia October 24-27, 2016

Topology Enhancement in Wireless Multihop Networks: A Top-down Approach

beyond social networks

David Easley and Jon Kleinberg January 24, 2007

SI Networks: Theory and Application, Fall 2008

Andrea Bondavalli. The maturity of Italian Critical Infrastructures

Attack Vulnerability of Network with Duplication-Divergence Mechanism

Transportation & ITS in Ethiopia Challenges & Opportunities

CSE 190 Lecture 16. Data Mining and Predictive Analytics. Small-world phenomena

ALTERNATIVES TO BETWEENNESS CENTRALITY: A MEASURE OF CORRELATION COEFFICIENT

Properties of Biological Networks

On Complex Dynamical Networks. G. Ron Chen Centre for Chaos Control and Synchronization City University of Hong Kong

modern database systems lecture 10 : large-scale graph processing

Copyright Wyyzzk, Inc Version 5.0. Introduction to Software Architecture

Basics of Network Analysis

The Complex Network Phenomena. and Their Origin

Data Governance for Smart City Management

Examples of Complex Networks

Graph-theoretic Properties of Networks

Social and Technological Network Data Analytics. Lecture 5: Structure of the Web, Search and Power Laws. Prof Cecilia Mascolo

1 Comparing networks, and why social networks are different

Large Scale Graph Algorithms

The Reliability, Efficiency and Treatment Quality of Centralized versus Decentralized Water Infrastructure 1

Social Network Analysis of the Planetary Data System

Transportation Security Planning in British Columbia David Morhart, Deputy Solicitor General

ITS (Intelligent Transportation Systems) Solutions

Lecture 2 Generalized Representation of a Transportation Network

Only the original curriculum in Danish language has legal validity in matters of discrepancy

Introduction to the Internet

6.207/14.15: Networks Lecture 5: Generalized Random Graphs and Small-World Model

Applying Social Network Analysis to the Information in CVS Repositories

Section 7.13: Homophily (or Assortativity) By: Ralucca Gera, NPS

Quadratic Functions Dr. Laura J. Pyzdrowski

Empirical analysis of online social networks in the age of Web 2.0

Long-Term Power Outage Response and Recovery Tabletop Exercise

Collaboration networks and innovation in Canada s ICT Hardware Cluster. Catherine Beaudry and Melik Bouhadra Polytechnique Montréal

Interactive Analysis of Large Distributed Systems with Scalable Topology-based Visualization

The Third Party Administrator Model: Right for Puerto Rico?

Complex networks: A mixture of power-law and Weibull distributions

Machine Learning and Modeling for Social Networks

Complex Networks: Ubiquity, Importance and Implications. Alessandro Vespignani

Structure of biological networks. Presentation by Atanas Kamburov

Small-World Models and Network Growth Models. Anastassia Semjonova Roman Tekhov

Transcription:

Introduction to Engineering Systems, ESD.00 Networks II Lecture 8 Lecturers: Professor Joseph Sussman Dr. Afreen Siddiqi TA: Regina Clewlow

Outline Introduction to networks Infrastructure networks Institutional networks Th ili k The military and networks MIT as a network ESD 00 as a network ESD.00 as a network Bay Area transportation Freight railroad networks Random and non-random networks

Networks, Systems and Complexity Systems Networks Complexity It is very difficult (for me) to separate these ideas

Networks - Introductory Concepts The idea of networks is intuitive - we sketch our nodes and links connecting them. But you need to think about What do the nodes represent? What do the links represent What does connectivity imply? Complexity often arises in systems that have a network structure Network behavior is an emergent property of network structure and link and node characteristics

Network Types Physical Transportation Energy Water Organizational US Government US Military MIT Social networks-- Facebook, for example Conceptual Systems Dynamics Other?

Networks - Some Basic Questions What flows on the links? In physical network In organization network In conceptual network How do you characterize a link? What processes are performed at the nodes? How do you characterize the node? Level of network detail? Dynamic Vs. Static Network Structure

An Interesting Research Area: How do we analyze/design/understand systems composed of networks of different types - physical, organizational, conceptual?

Infrastructure Systems Infrastructure systems often have a network structure Infrastructure networks are often critical to the functioning of society Infrastructure networks are not simply physical; they are also organizational

Critical Infrastructure What makes an infrastructure Critical -- YOUR IDEAS, PLEASE

Critical Infrastructure What makes an infrastructure Critical A matter of taste -- a failure leads to.. Life safety issues? HILP (High impact, low probability) events? Large economic disruption? Large societal disruption? You bet your company? You bet your job?

Identify Different Classes of Infrastructure and Think About Their Interactions Transportation Communication Water Supply Energy Materials All are Network-based--development of common methodologies across classes is the goal

Institutional Issues I And we should NOT lose sight of the Institutional Issues we face in CI Organizational structure and institutional interactions (there are organizational cultures which are slow to change) Need for huge resources and the notion of public/private partnerships to give access to new sources of capital and expertise Legacy issues: we usually have an infrastructure in place - rarely a greenfield development

Institutional Issues II Multiple stakeholders with different perspectives, about which they often feel strongly-- evaluative complexity Interaction of the institutional issues with the technological questions-- nested complexity Working across classes of infrastructure presents additional institutional issues (and it was hard enough already!)

Questions Networks interact with each other - how to deal with cascading failures? Intra-infrastructural if - on highways, h a crash at important node causes congestion throughout - or intermodally, the interplay between passenger air transportation and HSR for trips of less than 500 miles Inter-infrastructural - the interaction between communications and transportation networks (ITS, eg) Interaction of the technologies with organizations - local deployment and communications issues - can the firefighters communicate with the police? What does failure mean? Spatially? Temporally?

Military Exam ple: It takes a network; the new frontline of modern warfare By Stanley A McChrystal

Governing by Network The New Shape of the Public Sector Stephen Goldsmith and William D. Eggers

From business to warfare, networked organizational forms are supplanting hierarchies. Now, Goldsmith and Eggers, two of America s most innovative policy thinkers, show how the networking trend is transforming government. This book is a must read for anyone concerned with how to make government better and more cost effective. -Mitt Romney, Governor of Massachusetts

Mre MIT and ESD.00 as networks Bay Area ground transportation Freight railroads

Random and non-random networks Mre

Network Properties: Clustering Coefficient It is a measure of clustering of a graph s vertices. In a friendship network it gives a measure of the extent to which friends of v are also friends of each other it measures the cliquishness of a friendship circle. If a vertex i has k i neighbors, then at most 2 {e jk } k i (k i 1)/2 edges can exist between them C i = k (k 1) v,v N j v k i,ee jk E (when every neighbor of i is connected to i i every other neighbor of i). C i is the fraction of edges es that atactually exist. C i is also called the local clustering coefficient i In the diagram shown, vertex I has four neighbors. ki = 4. Then 4(4 1)/2 = 6. There is only one edge that exists between the neighbors. So, Ci = 1/6.

Network Properties: Betweenness Betweenness of a node v, C B (), v), is the number of paths from all nodes (except v) to all other nodes that must pass through node v. Betweenness measures the power of an intermediary. It is useful in applications related to network navigation, transmission of information etc. C B (v) v = σ st (v) s, v,t V s v t σ st σ st : # of paths between vertices s and t σ st (v): # of paths between vertices s and t passing through v If G is a connected graph, its complement is a disconnected graph. If it is a complete graph, its complement is a null graph.

Network Properties: Degree Distribution Degree Distribution A histogram of the degrees of vertices is the degree distribution of the network. The degree distribution, P(k), is the fraction of vertices with degree k in the network with a total of n vertices: P(1) = fraction of vertices with degree ee 1 = n 1 /n : 1 P(2) = fraction of vertices with degree 2 = n 2 /n P(k max )= fraction of vertices with largest degree k max = n kmax /n (k) 0.15 0.10 0.05 0.00 5 10 15 20 k Image by MIT OpenCourseWare. In a random graph, each edge is present or absent with equal probability, and the degree distribution is binomial: ( )= n 1 p k (1 p) n 1 k P k k

Scale Free ee Networks A scale free network is a type of graph that has a degree distribution described d( (at least asymptotically) )b by a power law: P(k ) ~ ck γ, γ > 1 A number of natural and man made systems have been found to be scalefree networks such as the world wide web, the internet, metabolic networks, citations between scientific papers etc. Scale free networks contain some large hubs, but most vertices are connected to a few edges (have low degree). Very many nodes with only a few links Number of links (k) A few hubs with large number of links Scale-free networks are fault tolerant failure (or removal) of a node at random does not significantly affect network connectivity. A power law is a mathematical relationship in which one quantity varies as the power of another quantity: f(x) = ax^k +o(x^k) where a and k are constants. k is referred to as the scaling exponent. If we scale the variable x as cx, then: f(cx) = a(cx)^k = ac^k x^k = c^k f(x). So scaling by a constant simply multiplies the original power law with a constant. Number of nodes with k links Image by MIT OpenCourseWare.

Additional Network Properties Network resilience is often a property of interest. how well can the network maintain its connectivity when vertices are removed (due to failures, disruptions etc.) what happens to the average path lengths etc. Degree correlations do high degree vertices connect mostly to other vertices of high degrees or mostly to vertices with low degrees? Others Mean vertex-vertex distance 15 10 5 Vertices are removed in random order 0 0.00 0.01 0.02 Fraction of vertices removed Ref [1] Vertices removed in order of their degrees, starting with the highest degree Image by MIT OpenCourseWare. The picture shows the results of vertex removal in a graph of the internet.

References [1]M.E.J. Newman, The structure and function of complex networks, SIAM review, 2003 [2] Duncan J. Watts & Steven H. Strogatz, Collective dynamics of small world networks, Nature, Vol. 393, 4 June 1998 [3] Introduction to Graph Theory, Koh Khee Meng et. al [4] Graph Theory: Modeling, Applications, and Algorithms, Geir Agnarsson, Raymond Greenlaw

Any comments or questions?

MIT OpenCourseWare http://ocw.mit.edu ESD.00 Introduction to Engineering Systems Spring 2011 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.