DynaTraffic Models and mathematical prognosis. Simulation of the distribution of traffic with the help of Markov chains

Size: px
Start display at page:

Download "DynaTraffic Models and mathematical prognosis. Simulation of the distribution of traffic with the help of Markov chains"

Transcription

1 DynaTraffic Models and mathematical prognosis Simulation of the distribution of traffic with the help of Markov chains

2 What is this about? Models of traffic situations Graphs: Edges, Vertices Matrix representation Vector representation Markov chains States, transition probabilities Special states: periodic, absorbing, or transient Steady-state distribution Matrix vector multiplication DynaTraffic help to understand and learn these concepts 2

3 The goal: analysis of a traffic system We are interested in this question: How many cars are there at a certain time on a lane? In order to be able to make statements about the development of a system, we need a model. I.e., first we build a model and then we control and observe this model. 3

4 Mathematical prognosis step 1 Build a model of an everyday situation

5 Photo from a side perspective 5

6 Photo of the layout Google Imagery

7 Model of the layout, with cars 7

8 Elements for the model without cars Nodes Arrows What does your model look like? 8

9 Model of the layout, without cars Stop points nodes Lanes edges

10 Representation in DynaTraffic Characters to label lanes - Colored arrows and slightly different arrangement 10

11 Models Why does one build models? To better understand systems Models are a useful tool to examine systems Definition of a model: A simplified representation used to explain the workings of a real world system or event. (Source: Mathematical Models try to capture the relevant parameters of natural phenomena and to use these parameters for predictions in the observed system. 11

12 Mathematical prognosis step 2 Transformation of the model

13 Why a transformation method? We are concerned with traffic on single lanes and analyze the traffic with the help of a Markov model. For that lanes must be vertices Transformation of the situation graph! 13

14 Transformation recipe Transformation of situation graph to line graph: Each edge become a vertex. There is an edge between two vertices, if one can change from one lane to the other in the traffic situation. Each vertex has an edge to itself. 14

15 Transformation step a) Each edge becomes a vertex. 15

16 Transformation step b) There is an edge between two vertices, if one can change from one lane to the other in the traffic situation. 16

17 Transformation step c) Each vertex has an edge to itself. I.e.: a car can remain on a lane! 17

18 The good news concerning this transformation We do not need to do this transformation, it is already done in DynaTraffic. But we should understand it Situation graph Line graph to the situation graph 18

19 Mathematical prognosis step 3 Define assumptions

20 Define the process Every 10 seconds, each car takes a decision with a certain probability (so-called transition probability): I change to another lane I remain on this lane The realization of decisions is called a transition: cars change their state, if necessary. 20

21 The transition graph The transition probabilities are entered in the line graph Transition graph (= Markov chain) 21

22 Our Markov chain The vertices represent possible states, i.e., lanes on which a car can be. The edges show to which other lanes a car can change from each lane. 22

23 Meaning of the transition probability? If there is a car on lane A now, it will in the next transition change to lane B with a probability of 83%. 23

24 Alternative representation of the transition graph Transition graph Transition matrix 24

25 How to read the transition matrix From To 25

26 Empty entries in the transition matrix? If an edge does not exist, there is a 0 in the transition matrix at the corresponding entry. 26

27 Summary: our traffic model Photo Model with cars Model without cars Transition matrix Transition graph 27

28 Summary: our traffic model Step 1: build a model of an everyday situation Model with cars Photo Step 3: define assumptions Transition matrix Model without cars Transition graph Step 2: transformation of the model 28

29 Demo DynaTraffic 29

30 Our Markov chain again The vertices represent possible states, i.e., lanes on which a car be. The edges show on which other vertices a car can change from one vertex, and with which probability this happens per transition. 30

31 Do a transition? To calculate how many cars there are going to be on a certain lane, one needs: The number of cars on the individual lanes. The probabilities leading to the certain lane. 31

32 How many cars are on lane A after the next transition? Cars on individual lanes: A: 3 cars B: 4 cars C: 7 cars Probabilities leading to lane A: A A : 0.17 C A : 0.83 Calculation: 3 * * 0.83 = 6.32 cars 32

33 Probabilities for transitions The required probabilities can directly be read from the transition matrix! 3 * * 0.83 = 6.32 cars 33

34 State vector The number of cars per lane in the state vector notation 34

35 Calculate transitions As seen: Multiplication of the first row of the transition matrix with the current number of cars on the first lane (= second entry of the state vector) gives the new number of cars on the first lane. 35

36 Calculate transitions compactly With a matrix vector multiplication a transition can be calculated at once for all lanes! 36

37 Matrix vector multiplication = 37

38 Properties of transition graphs Based on the transition probabilities, certain states of a transition graph can be classified. States can be absorbing, periodic, or transient. There are further steady-state distributions and irreducible transition graphs. 38

39 Absorbing state A state which has no out-going transition with positive probability Over time all cars conglomerate there! Where does this happen with real traffic? -Junkyard - dead-end one-way street ;-) 39

40 Periodic states States take periodically the same values Traffic oscillates between certain states. Where are such streets in everyday life? - e.g. between work and home 40

41 Transient state A state to which a care can never return. 41

42 Irreducible transition graph Each state is reachable from every other state. 42

43 Is the following graph irreducible? No! (State D is not reachable from every other state!) Which transition probabilites could be changed in order to make this graph ireducible? 43

44 Properties of the transition matrix Column sum = 1: stochastic matrix Column sum 1: Column sum < 1: total number of cars goes toward 0 Column sum > 1: total number of cars grow infinetly 44

45 Steady-state distribution If a transition graph is irreducible and does not have periodic states, then the system swings into a steadystate distribution, independently of the initial state. 45

46 Notation of transition probabilities The probability to change from vertex A to vertex B is 10% P(A, B) =

47 Summary Properties of states: Periodic: Cars move to and fro. Absorbing: All cars are finally there. Transient: A car never returns there. Transitions graphs can be irreducible: Cars can change from every state to every other state. Distributions can be steady-state: the system has swung into. 47

48 Models and their limitations Lanes can hold a infinitely large number of cars in our model. This is not realistic! Therefore: Simulation stops, of > 2000 cars on a lane. In the upper-limit mode a individual upper limit (< 2000) can be defined per lane. 48

49 The upper-limit mode Possible application: Different parking areas. Cars should fill the parking areas C, D, and E in this order. 49

50 Layout of parking areas in DynaTraffic Upper limits of lanes are displayed 50

51 Process upper-limit: lane C reached its capacity Set all edges incident to C to 0. No more cars should arrive. This is not a stochastic matrix any more! Columns must be normalized. 51

52 Process upper-limit: lane C is unlocked again Original row of the lane is reestablished Only outgoing edges are reestablished: This is ok for all vertices. Normalize column sum. 52

53 What is this about? Models of traffic situations Graphs: Edges, Vertices Matrix representation Vector representation Markov chains States, transition probabilities Special states: periodic, absorbing, or transient Steady-state distribution Matrix vector multiplication DynaTraffic help to understand and learn these concepts 53

54 Summary We model and analyze a traffic system with the help of Markov chains. How does the traffic distribution evolve? Does the system swing into? Like this we can make predictions about the system based on our Markov model! 54

55 DynaTraffic Situation graph Transition graph Control of transitions State statistics Transition matrix & state vector 55

56 Demo DynaTraffic 56

Outline. Application examples

Outline. Application examples Outline Application examples Google page rank algorithm Aloha protocol Virtual circuit with window flow control Store-and-Forward packet-switched network Interactive system with infinite servers 1 Example1:

More information

Directed Graphical Models (Bayes Nets) (9/4/13)

Directed Graphical Models (Bayes Nets) (9/4/13) STA561: Probabilistic machine learning Directed Graphical Models (Bayes Nets) (9/4/13) Lecturer: Barbara Engelhardt Scribes: Richard (Fangjian) Guo, Yan Chen, Siyang Wang, Huayang Cui 1 Introduction For

More information

A Modified Algorithm to Handle Dangling Pages using Hypothetical Node

A Modified Algorithm to Handle Dangling Pages using Hypothetical Node A Modified Algorithm to Handle Dangling Pages using Hypothetical Node Shipra Srivastava Student Department of Computer Science & Engineering Thapar University, Patiala, 147001 (India) Rinkle Rani Aggrawal

More information

1 Random Walks on Graphs

1 Random Walks on Graphs Lecture 7 Com S 633: Randomness in Computation Scribe: Ankit Agrawal In the last lecture, we looked at random walks on line and used them to devise randomized algorithms for 2-SAT and 3-SAT For 2-SAT we

More information

Queuing Systems. 1 Lecturer: Hawraa Sh. Modeling & Simulation- Lecture -4-21/10/2012

Queuing Systems. 1 Lecturer: Hawraa Sh. Modeling & Simulation- Lecture -4-21/10/2012 Queuing Systems Queuing theory establishes a powerful tool in modeling and performance analysis of many complex systems, such as computer networks, telecommunication systems, call centers, manufacturing

More information

Link Analysis and Web Search

Link Analysis and Web Search Link Analysis and Web Search Moreno Marzolla Dip. di Informatica Scienza e Ingegneria (DISI) Università di Bologna http://www.moreno.marzolla.name/ based on material by prof. Bing Liu http://www.cs.uic.edu/~liub/webminingbook.html

More information

Lecture 8: Linkage algorithms and web search

Lecture 8: Linkage algorithms and web search Lecture 8: Linkage algorithms and web search Information Retrieval Computer Science Tripos Part II Ronan Cummins 1 Natural Language and Information Processing (NLIP) Group ronan.cummins@cl.cam.ac.uk 2017

More information

CS6200 Information Retreival. The WebGraph. July 13, 2015

CS6200 Information Retreival. The WebGraph. July 13, 2015 CS6200 Information Retreival The WebGraph The WebGraph July 13, 2015 1 Web Graph: pages and links The WebGraph describes the directed links between pages of the World Wide Web. A directed edge connects

More information

Lecture 22 Tuesday, April 10

Lecture 22 Tuesday, April 10 CIS 160 - Spring 2018 (instructor Val Tannen) Lecture 22 Tuesday, April 10 GRAPH THEORY Directed Graphs Directed graphs (a.k.a. digraphs) are an important mathematical modeling tool in Computer Science,

More information

2. CONNECTIVITY Connectivity

2. CONNECTIVITY Connectivity 2. CONNECTIVITY 70 2. Connectivity 2.1. Connectivity. Definition 2.1.1. (1) A path in a graph G = (V, E) is a sequence of vertices v 0, v 1, v 2,..., v n such that {v i 1, v i } is an edge of G for i =

More information

Link Structure Analysis

Link Structure Analysis Link Structure Analysis Kira Radinsky All of the following slides are courtesy of Ronny Lempel (Yahoo!) Link Analysis In the Lecture HITS: topic-specific algorithm Assigns each page two scores a hub score

More information

TA: Jade Cheng ICS 241 Recitation Lecture Note #9 October 23, 2009

TA: Jade Cheng ICS 241 Recitation Lecture Note #9 October 23, 2009 TA: Jade Cheng ICS 241 Recitation Lecture Note #9 October 23, 2009 Recitation #9 Question: For each of these problems about a subway system, describe a weighted graph model that can be used to solve the

More information

BUFFER STOCKS IN KANBAN CONTROLLED (TRADITIONAL) UNSATURATED MULTI-STAGE PRODUCTION SYSTEM

BUFFER STOCKS IN KANBAN CONTROLLED (TRADITIONAL) UNSATURATED MULTI-STAGE PRODUCTION SYSTEM VOL. 3, NO., FEBRUARY 008 ISSN 89-6608 006-008 Asian Research Publishing Network (ARPN). All rights reserved. BUFFER STOCKS IN KANBAN CONTROLLED (TRADITIONAL) UNSATURATED MULTI-STAGE PRODUCTION SYSTEM

More information

Page rank computation HPC course project a.y Compute efficient and scalable Pagerank

Page rank computation HPC course project a.y Compute efficient and scalable Pagerank Page rank computation HPC course project a.y. 2012-13 Compute efficient and scalable Pagerank 1 PageRank PageRank is a link analysis algorithm, named after Brin & Page [1], and used by the Google Internet

More information

Analysis of Biological Networks. 1. Clustering 2. Random Walks 3. Finding paths

Analysis of Biological Networks. 1. Clustering 2. Random Walks 3. Finding paths Analysis of Biological Networks 1. Clustering 2. Random Walks 3. Finding paths Problem 1: Graph Clustering Finding dense subgraphs Applications Identification of novel pathways, complexes, other modules?

More information

The Simplex Algorithm for LP, and an Open Problem

The Simplex Algorithm for LP, and an Open Problem The Simplex Algorithm for LP, and an Open Problem Linear Programming: General Formulation Inputs: real-valued m x n matrix A, and vectors c in R n and b in R m Output: n-dimensional vector x There is one

More information

Lecture 5: Performance Analysis I

Lecture 5: Performance Analysis I CS 6323 : Modeling and Inference Lecture 5: Performance Analysis I Prof. Gregory Provan Department of Computer Science University College Cork Slides: Based on M. Yin (Performability Analysis) Overview

More information

Pagerank Scoring. Imagine a browser doing a random walk on web pages:

Pagerank Scoring. Imagine a browser doing a random walk on web pages: Ranking Sec. 21.2 Pagerank Scoring Imagine a browser doing a random walk on web pages: Start at a random page At each step, go out of the current page along one of the links on that page, equiprobably

More information

Transportation Network Development and Algorithm

Transportation Network Development and Algorithm Chapter 5 Transportation Network Development and Algorithm Key words: network development, network properties, shortest path algorithms. 5.1 Transportation Networks In order to predict how the demand for

More information

Modeling web-crawlers on the Internet with random walksdecember on graphs11, / 15

Modeling web-crawlers on the Internet with random walksdecember on graphs11, / 15 Modeling web-crawlers on the Internet with random walks on graphs December 11, 2014 Modeling web-crawlers on the Internet with random walksdecember on graphs11, 2014 1 / 15 Motivation The state of the

More information

Approximate Linear Programming for Average-Cost Dynamic Programming

Approximate Linear Programming for Average-Cost Dynamic Programming Approximate Linear Programming for Average-Cost Dynamic Programming Daniela Pucci de Farias IBM Almaden Research Center 65 Harry Road, San Jose, CA 51 pucci@mitedu Benjamin Van Roy Department of Management

More information

The Randomized Shortest Path model in a nutshell

The Randomized Shortest Path model in a nutshell Panzacchi M, Van Moorter B, Strand O, Saerens M, Kivimäki I, Cassady St.Clair C., Herfindal I, Boitani L. (2015) Predicting the continuum between corridors and barriers to animal movements using Step Selection

More information

ETSN01 Exam Solutions

ETSN01 Exam Solutions ETSN01 Exam Solutions March 014 Question 1 (a) See p17 of the cellular systems slides for a diagram and the full procedure. The main points here were that the HLR needs to be queried to determine the location

More information

Einführung in Web und Data Science Community Analysis. Prof. Dr. Ralf Möller Universität zu Lübeck Institut für Informationssysteme

Einführung in Web und Data Science Community Analysis. Prof. Dr. Ralf Möller Universität zu Lübeck Institut für Informationssysteme Einführung in Web und Data Science Community Analysis Prof. Dr. Ralf Möller Universität zu Lübeck Institut für Informationssysteme Today s lecture Anchor text Link analysis for ranking Pagerank and variants

More information

Estimating Parking Spot Occupancy

Estimating Parking Spot Occupancy 1 Estimating Parking Spot Occupancy David M.W. Landry and Matthew R. Morin Abstract Whether or not a car occupies a given parking spot at a given time can be modeled as a random variable. By looking at

More information

1 Euler Circuits. Many of the things we do in daily life involve networks, like the one shown below [Houston Street Map]. Figure 1: Houston City Map

1 Euler Circuits. Many of the things we do in daily life involve networks, like the one shown below [Houston Street Map]. Figure 1: Houston City Map 1 Euler Circuits Many of the things we do in daily life involve networks, like the one shown below [Houston Street Map]. Figure 1: Houston City Map Suppose you needed to vist a number of locations in the

More information

Mining Web Data. Lijun Zhang

Mining Web Data. Lijun Zhang Mining Web Data Lijun Zhang zlj@nju.edu.cn http://cs.nju.edu.cn/zlj Outline Introduction Web Crawling and Resource Discovery Search Engine Indexing and Query Processing Ranking Algorithms Recommender Systems

More information

Week 10: DTMC Applications Randomized Routing. Network Performance 10-1

Week 10: DTMC Applications Randomized Routing. Network Performance 10-1 Week 10: DTMC Applications Randomized Routing Network Performance 10-1 Random Walk: Probabilistic Routing Random neighbor selection e.g. in ad-hoc/sensor network due to: Scalability: no routing table (e.g.

More information

Method for Automatic Construction of Queuing System Models

Method for Automatic Construction of Queuing System Models International Conference on Modelling, Simulation and Applied Mathematics (MSAM 215) Method for Automatic Construction of Queuing System Models Eimutis Valakevicius * Department of Mathematical Modeling

More information

MODERN automated manufacturing systems require. An Extended Event Graph With Negative Places and Tokens for Time Window Constraints

MODERN automated manufacturing systems require. An Extended Event Graph With Negative Places and Tokens for Time Window Constraints IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, VOL. 2, NO. 4, OCTOBER 2005 319 An Extended Event Graph With Negative Places and Tokens for Time Window Constraints Tae-Eog Lee and Seong-Ho Park

More information

County of Sacramento Instructions for filling out an online Tree Permit

County of Sacramento Instructions for filling out an online Tree Permit To start your permit 1. Create an account or log in if you already have an account. https://actonline.saccounty.net 2. Click on Apply for a Tree Permit Or in you already have a tree permit you can search

More information

The PEPA Eclipse Plug-in

The PEPA Eclipse Plug-in The PEPA Eclipse Plug-in A modelling, analysis and verification platform for PEPA Adam Duguid, Stephen Gilmore, Michael Smith and Mirco Tribastone Wednesday 01 December 2010 Abstract: This user manual

More information

Automated Markov-chain based Analysis for Large State Spaces

Automated Markov-chain based Analysis for Large State Spaces Automated Markov-chain based Analysis for Large State Spaces Kaitlin N. Smith, Michael A.Taylor, Anna A. Carroll, Theodore W. Manikas, Mitchell A. Thornton Darwin Deason Institute for Cyber Security Southern

More information

Introduction to Information Retrieval

Introduction to Information Retrieval Introduction to Information Retrieval http://informationretrieval.org IIR 21: Link Analysis Hinrich Schütze Center for Information and Language Processing, University of Munich 2014-06-18 1/80 Overview

More information

Forces acting at a point

Forces acting at a point Forces acting at a point Introduction This software has been designed to provide visual representations of the addition of vectors and can be used to show the concept of a polygon of forces. It allows

More information

Copyright 2000, Kevin Wayne 1

Copyright 2000, Kevin Wayne 1 Chapter 3 - Graphs Undirected Graphs Undirected graph. G = (V, E) V = nodes. E = edges between pairs of nodes. Captures pairwise relationship between objects. Graph size parameters: n = V, m = E. Directed

More information

MS in Applied Statistics: Study Guide for the Data Science concentration Comprehensive Examination. 1. MAT 456 Applied Regression Analysis

MS in Applied Statistics: Study Guide for the Data Science concentration Comprehensive Examination. 1. MAT 456 Applied Regression Analysis MS in Applied Statistics: Study Guide for the Data Science concentration Comprehensive Examination. The Part II comprehensive examination is a three-hour closed-book exam that is offered on the second

More information

New Jersey Center for Teaching and Learning. Progressive Mathematics Initiative

New Jersey Center for Teaching and Learning. Progressive Mathematics Initiative Slide 1 / 192 New Jersey Center for Teaching and Learning Progressive Mathematics Initiative This material is made freely available at www.njctl.org and is intended for the non-commercial use of students

More information

Advanced Computer Architecture: A Google Search Engine

Advanced Computer Architecture: A Google Search Engine Advanced Computer Architecture: A Google Search Engine Jeremy Bradley Room 372. Office hour - Thursdays at 3pm. Email: jb@doc.ic.ac.uk Course notes: http://www.doc.ic.ac.uk/ jb/ Department of Computing,

More information

Bipartite Perfect Matching in O(n log n) Randomized Time. Nikhil Bhargava and Elliot Marx

Bipartite Perfect Matching in O(n log n) Randomized Time. Nikhil Bhargava and Elliot Marx Bipartite Perfect Matching in O(n log n) Randomized Time Nikhil Bhargava and Elliot Marx Background Matching in bipartite graphs is a problem that has many distinct applications. Many problems can be reduced

More information

Medium Access Control Protocols With Memory Jaeok Park, Member, IEEE, and Mihaela van der Schaar, Fellow, IEEE

Medium Access Control Protocols With Memory Jaeok Park, Member, IEEE, and Mihaela van der Schaar, Fellow, IEEE IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 18, NO. 6, DECEMBER 2010 1921 Medium Access Control Protocols With Memory Jaeok Park, Member, IEEE, and Mihaela van der Schaar, Fellow, IEEE Abstract Many existing

More information

Connection-Level Scheduling in Wireless Networks Using Only MAC-Layer Information

Connection-Level Scheduling in Wireless Networks Using Only MAC-Layer Information Connection-Level Scheduling in Wireless Networks Using Only MAC-Layer Information Javad Ghaderi, Tianxiong Ji and R. Srikant Coordinated Science Laboratory and Department of Electrical and Computer Engineering

More information

The A* traffic process in a queue with feedback

The A* traffic process in a queue with feedback The A traffic process in a queue with feedback Elizabeth Varki Abstract This paper establishes the A traffic process in queueing networks. The A traffic process links open and closed networks, and explains

More information

16.410/413 Principles of Autonomy and Decision Making

16.410/413 Principles of Autonomy and Decision Making 16.410/413 Principles of Autonomy and Decision Making Lecture 16: Mathematical Programming I Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology November 8, 2010 E. Frazzoli

More information

An Empirical Study of an Anonymity Metric for Data Networks. Abinash Vasudevan Bachelor of Engineering Saveetha Engineering College, 2009

An Empirical Study of an Anonymity Metric for Data Networks. Abinash Vasudevan Bachelor of Engineering Saveetha Engineering College, 2009 An Empirical Study of an Anonymity Metric for Data Networks A thesis submitted in partial fulfillment of the requirements for the degree of Master of Science at George Mason University By Abinash Vasudevan

More information

Agenda. Math Google PageRank algorithm. 2 Developing a formula for ranking web pages. 3 Interpretation. 4 Computing the score of each page

Agenda. Math Google PageRank algorithm. 2 Developing a formula for ranking web pages. 3 Interpretation. 4 Computing the score of each page Agenda Math 104 1 Google PageRank algorithm 2 Developing a formula for ranking web pages 3 Interpretation 4 Computing the score of each page Google: background Mid nineties: many search engines often times

More information

Graphs. The ultimate data structure. graphs 1

Graphs. The ultimate data structure. graphs 1 Graphs The ultimate data structure graphs 1 Definition of graph Non-linear data structure consisting of nodes & links between them (like trees in this sense) Unlike trees, graph nodes may be completely

More information

Discrete Time Batch Arrival Queue with Multiple Vacations

Discrete Time Batch Arrival Queue with Multiple Vacations International Journal of Engineering Research Development e-issn: 2278-067X, p-issn: 2278-800X, www.ijerd.com Volume 13, Issue 7 (July 2017), PP.49-55 Discrete Time Batch Arrival Queue with Multiple Vacations

More information

Brief (non-technical) history

Brief (non-technical) history Web Data Management Part 2 Advanced Topics in Database Management (INFSCI 2711) Textbooks: Database System Concepts - 2010 Introduction to Information Retrieval - 2008 Vladimir Zadorozhny, DINS, SCI, University

More information

Safety and Reliability of Embedded Systems. (Sicherheit und Zuverlässigkeit eingebetteter Systeme) Safety and Reliability Analysis Models: Overview

Safety and Reliability of Embedded Systems. (Sicherheit und Zuverlässigkeit eingebetteter Systeme) Safety and Reliability Analysis Models: Overview (Sicherheit und Zuverlässigkeit eingebetteter Systeme) Safety and Reliability Analysis Models: Overview Content Classification Hazard and Operability Study (HAZOP) Preliminary Hazard Analysis (PHA) Event

More information

Modeling Malware Spreading Dynamics

Modeling Malware Spreading Dynamics Modeling Malware Spreading Dynamics Michele Garetto Dipartimento di Elettronica Politecnico di Torino Torino, Italy 1129 Email: garetto@polito.it Weibo Gong Department of Electrical and Computer Engineering

More information

REINFORCEMENT LEARNING: MDP APPLIED TO AUTONOMOUS NAVIGATION

REINFORCEMENT LEARNING: MDP APPLIED TO AUTONOMOUS NAVIGATION REINFORCEMENT LEARNING: MDP APPLIED TO AUTONOMOUS NAVIGATION ABSTRACT Mark A. Mueller Georgia Institute of Technology, Computer Science, Atlanta, GA USA The problem of autonomous vehicle navigation between

More information

Centralities (4) By: Ralucca Gera, NPS. Excellence Through Knowledge

Centralities (4) By: Ralucca Gera, NPS. Excellence Through Knowledge Centralities (4) By: Ralucca Gera, NPS Excellence Through Knowledge Some slide from last week that we didn t talk about in class: 2 PageRank algorithm Eigenvector centrality: i s Rank score is the sum

More information

Car Industry A3.1. Which of the graphs in Figure 2 fit the diagram above? Copy all graphs that fit and add names of manufacturers to the vertices.

Car Industry A3.1. Which of the graphs in Figure 2 fit the diagram above? Copy all graphs that fit and add names of manufacturers to the vertices. Mathematics: Modeling Our World Unit 3: HIDDEN CONNECTIONS A S S E S S M E N T PROBLEM A3.1 Car Industry A3.1 Because competition is heavy, car manufacturers are cooperating with each other more and more.

More information

Traffic Modeling of Communication Networks

Traffic Modeling of Communication Networks EÖTVÖS LORÁND UNIVERSITY, BUDAPEST Traffic Modeling of Communication Networks PÉTER VADERNA THESES OF PHD DISSERTATION Doctoral School: Physics Director: Prof. Zalán Horváth Doctoral Program: Statistical

More information

COMP Page Rank

COMP Page Rank COMP 4601 Page Rank 1 Motivation Remember, we were interested in giving back the most relevant documents to a user. Importance is measured by reference as well as content. Think of this like academic paper

More information

Linear Programming Terminology

Linear Programming Terminology Linear Programming Terminology The carpenter problem is an example of a linear program. T and B (the number of tables and bookcases to produce weekly) are decision variables. The profit function is an

More information

Web consists of web pages and hyperlinks between pages. A page receiving many links from other pages may be a hint of the authority of the page

Web consists of web pages and hyperlinks between pages. A page receiving many links from other pages may be a hint of the authority of the page Link Analysis Links Web consists of web pages and hyperlinks between pages A page receiving many links from other pages may be a hint of the authority of the page Links are also popular in some other information

More information

Creating a Presentation

Creating a Presentation Creating a Presentation You will need to create a basic presentation before you can work with the advanced features of PowerPoint. 1 Exercise #1 Creating the Basic Presentation (1) Open Microsoft PowerPoint

More information

Calculating Call Blocking and Utilization for Communication Satellites that Use Dynamic Resource Allocation

Calculating Call Blocking and Utilization for Communication Satellites that Use Dynamic Resource Allocation Calculating Call Blocking and Utilization for Communication Satellites that Use Dynamic Resource Allocation Leah Rosenbaum Mohit Agrawal Leah Birch Yacoub Kureh Nam Lee UCLA Institute for Pure and Applied

More information

Constructing Communication Subgraphs and Deriving an Optimal Synchronization Interval for Distributed Virtual Environment Systems

Constructing Communication Subgraphs and Deriving an Optimal Synchronization Interval for Distributed Virtual Environment Systems Constructing Communication Subgraphs and Deriving an Optimal Synchronization Interval for Distributed Virtual Environment Systems John CS Lui Department of Computer Science & Engineering The Chinese University

More information

Algorithms: Lecture 10. Chalmers University of Technology

Algorithms: Lecture 10. Chalmers University of Technology Algorithms: Lecture 10 Chalmers University of Technology Today s Topics Basic Definitions Path, Cycle, Tree, Connectivity, etc. Graph Traversal Depth First Search Breadth First Search Testing Bipartatiness

More information

Graphs. The ultimate data structure. graphs 1

Graphs. The ultimate data structure. graphs 1 Graphs The ultimate data structure graphs 1 Definition of graph Non-linear data structure consisting of nodes & links between them (like trees in this sense) Unlike trees, graph nodes may be completely

More information

Introduction to Mathematical Programming IE406. Lecture 16. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 16. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 16 Dr. Ted Ralphs IE406 Lecture 16 1 Reading for This Lecture Bertsimas 7.1-7.3 IE406 Lecture 16 2 Network Flow Problems Networks are used to model

More information

Stochastic Processing Networks: What, Why and How? Ruth J. Williams University of California, San Diego

Stochastic Processing Networks: What, Why and How? Ruth J. Williams University of California, San Diego Stochastic Processing Networks: What, Why and How? Ruth J. Williams University of California, San Diego http://www.math.ucsd.edu/~williams 1 OUTLINE! What is a Stochastic Processing Network?! Applications!

More information

Strongly connected: A directed graph is strongly connected if every pair of vertices are reachable from each other.

Strongly connected: A directed graph is strongly connected if every pair of vertices are reachable from each other. Directed Graph In a directed graph, each edge (u, v) has a direction u v. Thus (u, v) (v, u). Directed graph is useful to model many practical problems (such as one-way road in traffic network, and asymmetric

More information

A SOCIAL NETWORK ANALYSIS APPROACH TO ANALYZE ROAD NETWORKS INTRODUCTION

A SOCIAL NETWORK ANALYSIS APPROACH TO ANALYZE ROAD NETWORKS INTRODUCTION A SOCIAL NETWORK ANALYSIS APPROACH TO ANALYZE ROAD NETWORKS Kyoungjin Park Alper Yilmaz Photogrammetric and Computer Vision Lab Ohio State University park.764@osu.edu yilmaz.15@osu.edu ABSTRACT Depending

More information

Perceptron: This is convolution!

Perceptron: This is convolution! Perceptron: This is convolution! v v v Shared weights v Filter = local perceptron. Also called kernel. By pooling responses at different locations, we gain robustness to the exact spatial location of image

More information

Using PageRank in Feature Selection

Using PageRank in Feature Selection Using PageRank in Feature Selection Dino Ienco, Rosa Meo, and Marco Botta Dipartimento di Informatica, Università di Torino, Italy fienco,meo,bottag@di.unito.it Abstract. Feature selection is an important

More information

Converting the Roads & Highways Advanced LRS to a Routable Network. Eric J. Rodenberg

Converting the Roads & Highways Advanced LRS to a Routable Network. Eric J. Rodenberg Converting the Roads & Highways Advanced LRS to a Routable Network Eric J. Rodenberg Agenda The ArcGIS Platform Roads and Highways Network Datasets Roads and Highways Events Converting the LRS to a Network

More information

Buffered Fixed Routing: A Routing Protocol for Real-Time Transport in Grid Networks

Buffered Fixed Routing: A Routing Protocol for Real-Time Transport in Grid Networks JOURNAL OF LIGHTWAVE TECHNOLOGY, VOL. 18, NO. 6, JUNE 2000 757 Buffered Fixed Routing: A Routing Protocol for Real-Time Transport in Grid Networks Jinhan Song and Saewoong Bahk Abstract In this paper we

More information

ParkIT Application User Manual Page 1/63

ParkIT Application User Manual Page 1/63 ParkIT Application User Manual Page 1/63 Version: v1.5 Document version: 2016.07.28 Table of Contents 1 Application overview... 5 1.1 Basic handling methods... 5 2 Main screen... 6 3 User authentication...

More information

spanning trees of tree graphs Philippe Biane, CNRS-IGM-Université Paris-Est Firenze, May

spanning trees of tree graphs Philippe Biane, CNRS-IGM-Université Paris-Est Firenze, May Spanning trees of tree graphs, CNRS-IGM-Université Paris-Est Firenze, May 18 2015 joint work with Guillaume Chapuy, CNRS-LIAFA-Université Paris 7 V, E=directed graph w x e v Q=Laplacian matrix, indexed

More information

Markov Model Based Congestion Control for TCP

Markov Model Based Congestion Control for TCP Markov Model Based Congestion Control for TCP Shan Suthaharan University of North Carolina at Greensboro, Greensboro, NC 27402, USA ssuthaharan@uncg.edu Abstract The Random Early Detection (RED) scheme

More information

Graphing on Excel. Open Excel (2013). The first screen you will see looks like this (it varies slightly, depending on the version):

Graphing on Excel. Open Excel (2013). The first screen you will see looks like this (it varies slightly, depending on the version): Graphing on Excel Open Excel (2013). The first screen you will see looks like this (it varies slightly, depending on the version): The first step is to organize your data in columns. Suppose you obtain

More information

From Routing to Traffic Engineering

From Routing to Traffic Engineering 1 From Routing to Traffic Engineering Robert Soulé Advanced Networking Fall 2016 2 In the beginning B Goal: pair-wise connectivity (get packets from A to B) Approach: configure static rules in routers

More information

Pre-Calculus. Slide 1 / 192. Slide 2 / 192. Slide 3 / 192. Matrices

Pre-Calculus. Slide 1 / 192. Slide 2 / 192. Slide 3 / 192. Matrices Slide 1 / 192 Pre-Calculus Slide 2 / 192 Matrices 2015-03-23 www.njctl.org Table of Content Introduction to Matrices Matrix Arithmetic Scalar Multiplication Addition Subtraction Multiplication Solving

More information

Pre-Calculus Matrices

Pre-Calculus Matrices Slide 1 / 192 Slide 2 / 192 Pre-Calculus Matrices 2015-03-23 www.njctl.org Slide 3 / 192 Table of Content Introduction to Matrices Matrix Arithmetic Scalar Multiplication Addition Subtraction Multiplication

More information

Hidden Markov Models in the context of genetic analysis

Hidden Markov Models in the context of genetic analysis Hidden Markov Models in the context of genetic analysis Vincent Plagnol UCL Genetics Institute November 22, 2012 Outline 1 Introduction 2 Two basic problems Forward/backward Baum-Welch algorithm Viterbi

More information

Configuring Gateway Device Reports

Configuring Gateway Device Reports CHAPTER 19 CAR provides reporting capabilities for three levels of users: administrators, managers, and individual users. Only administrators generate device reports. Device reports track the load and

More information

Modeling Plant Succession with Markov Matrices

Modeling Plant Succession with Markov Matrices Modeling Plant Succession with Markov Matrices 1 Modeling Plant Succession with Markov Matrices Concluding Paper Undergraduate Biology and Math Training Program New Jersey Institute of Technology Catherine

More information

Gateway device reports

Gateway device reports Gateway device reports CAR provides reporting capabilities for three levels of users: administrators, managers, and individual users. Only administrators generate device reports. Device reports track the

More information

Building the Software 2.0 Stack. Andrej Karpathy May 10, 2018

Building the Software 2.0 Stack. Andrej Karpathy May 10, 2018 Building the Software 2.0 Stack Andrej Karpathy May 10, 2018 1M years ago Engineering: approach by decomposition AWS stack 1. Identify a problem 2. Break down a big problem to smaller problems 3.

More information

Short-Cut MCMC: An Alternative to Adaptation

Short-Cut MCMC: An Alternative to Adaptation Short-Cut MCMC: An Alternative to Adaptation Radford M. Neal Dept. of Statistics and Dept. of Computer Science University of Toronto http://www.cs.utoronto.ca/ radford/ Third Workshop on Monte Carlo Methods,

More information

New Perspectives on PowerPoint Module 2: Adding Media and Special Effects

New Perspectives on PowerPoint Module 2: Adding Media and Special Effects New Perspectives on PowerPoint 2016 Module 2: Adding Media and Special Effects Objectives, Part 1 Apply a theme used in another presentation Insert shapes Format shapes and pictures Rotate and flip objects

More information

Pre-Calculus. Introduction to Matrices. Slide 1 / 192 Slide 2 / 192. Slide 3 / 192. Slide 4 / 192. Slide 6 / 192. Slide 5 / 192. Matrices

Pre-Calculus. Introduction to Matrices. Slide 1 / 192 Slide 2 / 192. Slide 3 / 192. Slide 4 / 192. Slide 6 / 192. Slide 5 / 192. Matrices Slide 1 / 192 Slide 2 / 192 Pre-Calculus Matrices 2015-03-23 www.njctl.org Slide 3 / 192 Content Introduction to Matrices Matrix Arithmetic Scalar Multiplication Addition Subtraction Multiplication Solving

More information

Inst: Chris Davison

Inst: Chris Davison ICS 153 Introduction to Computer Networks Inst: Chris Davison cbdaviso@uci.edu ICS 153 Data Link Layer Contents Simplex and Duplex Communication Frame Creation Flow Control Error Control Performance of

More information

Structured Learning. Jun Zhu

Structured Learning. Jun Zhu Structured Learning Jun Zhu Supervised learning Given a set of I.I.D. training samples Learn a prediction function b r a c e Supervised learning (cont d) Many different choices Logistic Regression Maximum

More information

Database Management System Prof. D. Janakiram Department of Computer Science & Engineering Indian Institute of Technology, Madras Lecture No.

Database Management System Prof. D. Janakiram Department of Computer Science & Engineering Indian Institute of Technology, Madras Lecture No. Database Management System Prof. D. Janakiram Department of Computer Science & Engineering Indian Institute of Technology, Madras Lecture No. # 20 Concurrency Control Part -1 Foundations for concurrency

More information

MEI Further Mathematics Support Programme

MEI Further Mathematics Support Programme Further Mathematics Support Programme the Further Mathematics Support Programme www.furthermaths.org.uk Modelling and problem solving with Networks Sharon Tripconey Let Maths take you Further Nov 2009

More information

SHARPE Interface User's Manual Version 1.01

SHARPE Interface User's Manual Version 1.01 SHARPE Interface User's Manual Version 1.01 Contact information: Professor Kishor S. Trivedi Center for Advanced Computing and Communication (CACC) Department of Electrical and Computer Engineering Duke

More information

Queueing Networks analysis with GNU Octave. Moreno Marzolla Università di Bologna

Queueing Networks analysis with GNU Octave. Moreno Marzolla  Università di Bologna The queueing Package Queueing Networks analysis with GNU Octave Moreno Marzolla marzolla@cs.unibo.it http://www.moreno.marzolla.name/ Università di Bologna december 4, 2012 Moreno Marzolla (Università

More information

Mining Web Data. Lijun Zhang

Mining Web Data. Lijun Zhang Mining Web Data Lijun Zhang zlj@nju.edu.cn http://cs.nju.edu.cn/zlj Outline Introduction Web Crawling and Resource Discovery Search Engine Indexing and Query Processing Ranking Algorithms Recommender Systems

More information

Graph Search Methods. Graph Search Methods

Graph Search Methods. Graph Search Methods Graph Search Methods A vertex u is reachable from vertex v iff there is a path from v to u. 0 Graph Search Methods A search method starts at a given vertex v and visits/labels/marks every vertex that is

More information

Numerical approach estimate

Numerical approach estimate Simulation Nature of simulation Numericalapproachfor investigating models of systems. Data are gathered to estimatethe true characteristics of the model. Garbage in garbage out! One of the techniques of

More information

What is Network Analyst?

What is Network Analyst? What is Network Analyst? Extension for analyzing transportation networks Four network solvers Route Closest Facility Service Area Uses Network Datasets Origin-Destination (OD) Cost Matrix Specialized layers

More information

On Finding Power Method in Spreading Activation Search

On Finding Power Method in Spreading Activation Search On Finding Power Method in Spreading Activation Search Ján Suchal Slovak University of Technology Faculty of Informatics and Information Technologies Institute of Informatics and Software Engineering Ilkovičova

More information

Read Chapter 4 of Kurose-Ross

Read Chapter 4 of Kurose-Ross CSE 422 Notes, Set 4 These slides contain materials provided with the text: Computer Networking: A Top Down Approach,5th edition, by Jim Kurose and Keith Ross, Addison-Wesley, April 2009. Additional figures

More information

Graph Search Methods. Graph Search Methods

Graph Search Methods. Graph Search Methods Graph Search Methods A vertex u is reachable from vertex v iff there is a path from v to u. 0 Graph Search Methods A search method starts at a given vertex v and visits/labels/marks every vertex that is

More information

Elementary Graph Algorithms. Ref: Chapter 22 of the text by Cormen et al. Representing a graph:

Elementary Graph Algorithms. Ref: Chapter 22 of the text by Cormen et al. Representing a graph: Elementary Graph Algorithms Ref: Chapter 22 of the text by Cormen et al. Representing a graph: Graph G(V, E): V set of nodes (vertices); E set of edges. Notation: n = V and m = E. (Vertices are numbered

More information