Latent Space Model for Road Networks to Predict Time-Varying Traffic. Presented by: Rob Fitzgerald Spring 2017

Similar documents
Latent Space Model for Road Networks to Predict Time-Varying Traffic

Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting

Database and Knowledge-Base Systems: Data Mining. Martin Ester

Social Network Analysis

TriRank: Review-aware Explainable Recommendation by Modeling Aspects

Community Detection. Community

Document Information

Community Preserving Network Embedding

Analysis and Mapping of Sparse Matrix Computations

Harp-DAAL for High Performance Big Data Computing

Computational Design. Stelian Coros

Meta-path based Multi-Network Collective Link Prediction

08 An Introduction to Dense Continuous Robotic Mapping

Context-Aware Vehicular Cyber-Physical Systems with Cloud Support: Architecture, Challenges, and Solutions

Sampling Large Graphs for Anticipatory Analysis

STREAMING RANKING BASED RECOMMENDER SYSTEMS

Challenges in large-scale graph processing on HPC platforms and the Graph500 benchmark. by Nkemdirim Dockery

Temporal Graphs KRISHNAN PANAMALAI MURALI

Network visualization techniques and evaluation

Extracting Information from Complex Networks

Distributed Agent-Based Intrusion Detection for the Smart Grid

Scalable Object Classification using Range Images

Clusters and Communities

Nonparametric Importance Sampling for Big Data

CSCI5070 Advanced Topics in Social Computing

Bruno Martins. 1 st Semester 2012/2013

Automatic Scaling Iterative Computations. Aug. 7 th, 2012

Recommender Systems New Approaches with Netflix Dataset

Citizen Sensing: Opportunities and Challenges in Mining Social Signals and Perceptions

Reddit Recommendation System Daniel Poon, Yu Wu, David (Qifan) Zhang CS229, Stanford University December 11 th, 2011

Problem Definition. Clustering nonlinearly separable data:

Latent Variable Models for Structured Prediction and Content-Based Retrieval

CS249: ADVANCED DATA MINING

Distributed Consensus in Multivehicle Cooperative Control: Theory and Applications

TrajStore: an Adaptive Storage System for Very Large Trajectory Data Sets

Inf 496/596 Topics in Informatics: Analysis of Social Network Data

Graphs. Tessema M. Mengistu Department of Computer Science Southern Illinois University Carbondale Room - Faner 3131

Parallel Greedy Matching Algorithms

Applying Supervised Learning

Telling Experts from Spammers Expertise Ranking in Folksonomies

g2o: A General Framework for Graph Optimization Rainer Kümmerle Giorgio Grisetti Hauke Strasdat Kurt Konolige Wolfram Burgard

ICRA 2016 Tutorial on SLAM. Graph-Based SLAM and Sparsity. Cyrill Stachniss

Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Randomized Algorithms

Graph Exploitation Testbed

A POWER CHARACTERIZATION AND MANAGEMENT OF GPU GRAPH TRAVERSAL

CSCI5070 Advanced Topics in Social Computing

FROM SPACE TO PLACE: PREDICTING USERS INTENTIONS TO RETURN TO VIRTUAL WORLDS 1

Statistical Physics of Community Detection

Content-based Dimensionality Reduction for Recommender Systems

Introduction to Data Science Lecture 8 Unsupervised Learning. CS 194 Fall 2015 John Canny

TCP Spatial-Temporal Measurement and Analysis

MINI-PAPER A Gentle Introduction to the Analysis of Sequential Data

Minghai Liu, Rui Cai, Ming Zhang, and Lei Zhang. Microsoft Research, Asia School of EECS, Peking University

Local Community Detection in Dynamic Graphs Using Personalized Centrality

Mining Web Data. Lijun Zhang

Online Bad Data Detection for Synchrophasor Systems via Spatio-temporal Correlations

Real-Time Model-Free Detection of Low-Quality Synchrophasor Data

Least Squares and SLAM Pose-SLAM

DeepWalk: Online Learning of Social Representations

PULP: Fast and Simple Complex Network Partitioning

Centralities (4) By: Ralucca Gera, NPS. Excellence Through Knowledge

Graph Algorithms. Parallel and Distributed Computing. Department of Computer Science and Engineering (DEI) Instituto Superior Técnico.

Hitachi Visualization Predictive Crime Analytics

Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering

Behavioral Data Mining. Lecture 18 Clustering

Network Lasso: Clustering and Optimization in Large Graphs

Evaluation of Seed Selection Strategies for Vehicle to Vehicle Epidemic Information Dissemination

Streaming iphone sensor data to SAS Event Stream Processing

OPEN-CSAM INFORMATION AGGREGATOR AND REPORTING TOOL USING AI AND NATURAL LANGUAGE PROCESSING

Structured prediction using the network perceptron

The Un-normalized Graph p-laplacian based Semi-supervised Learning Method and Speech Recognition Problem

Final report - CS224W: Using Wikipedia pages traffic data to infer pertinence of links

Challenges in Geographic Routing: Sparse Networks, Obstacles, and Traffic Provisioning

MIDTERM EXAMINATION Networked Life (NETS 112) November 21, 2013 Prof. Michael Kearns

Image Interpolation Using Multiscale Geometric Representations

Weighted Alternating Least Squares (WALS) for Movie Recommendations) Drew Hodun SCPD. Abstract

Empirical Complexity of Laplacian Linear Solvers: Discussion

Anomaly Detection in Very Large Graphs Modeling and Computational Considerations

K-Means and Gaussian Mixture Models

DS595/CS525: Urban Network Analysis --Urban Mobility Prof. Yanhua Li

PARALLEL AND DISTRIBUTED PLATFORM FOR PLUG-AND-PLAY AGENT-BASED SIMULATIONS. Wentong CAI

G(B)enchmark GraphBench: Towards a Universal Graph Benchmark. Khaled Ammar M. Tamer Özsu

Principles of Wireless Sensor Networks. Fast-Lipschitz Optimization

New Trends in Database Systems

Mining Web Data. Lijun Zhang

volley: automated data placement for geo-distributed cloud services

Spatial Interpolation & Geostatistics

Femto-Matching: Efficient Traffic Offloading in Heterogeneous Cellular Networks

A Fault-Tolerant P2P-based Protocol for Logical Networks Interconnection

CS 5220: Parallel Graph Algorithms. David Bindel

Parallel Gibbs Sampling From Colored Fields to Thin Junction Trees

Object Geolocation from Crowdsourced Street Level Imagery

High-Throughput Real-Time Network Flow Visualization

A Work-Efficient GPU Algorithm for Level Set Segmentation. Mike Roberts Jeff Packer Mario Costa Sousa Joseph Ross Mitchell

Cluster Analysis (b) Lijun Zhang

Spatial Interpolation - Geostatistics 4/3/2018

Scalable Clustering of Signed Networks Using Balance Normalized Cut

Link Prediction for Social Network

Modeling Dynamic Behavior in Large Evolving Graphs

Transcription:

Latent Space Model for Road Networks to Predict Time-Varying Traffic Presented by: Rob Fitzgerald Spring 2017

Definition of Latent https://en.oxforddictionaries.com/definition/latent

Latent Space Model? Is this what they were referring to?

Introduction The traffic prediction problem aims to find the future link flows based on historical flow data and some observations of the current network state Applications include traffic warning systems, route guidance systems, emergency planning systems, and network design Online applications require fast and correct solutions

Introduction Traffic prediction solutions require many iterations over massive networks Flows are not independent Driver behavior is very difficult to model

Introduction 1. Can we take a predictive technique which has been successfully applied to social media, and apply it to the traffic prediction problem? 2. Can we produce a solution to traffic prediction which is less computationally demanding than leading techniques such as HMM and SGD?

Latent Space Model Latent Models find emergent topics that associate observations Social networks Find consumer trends Track disease transmission Sentiment analysis

Latent Space Model Paper proposes Latent Space Modeling for Road Networks (LSM-RN) Group vertices of a road network graph Match pairs of vertices which are similar Traffic behavior Road network topology Embed matched pair in a latent space Use these latent spaces to make traffic prediction

Latent Space Model Differences between social networks and road networks Spatial and temporal correlations between neighbors on road networks are not present in social networks Road networks are fast to evolve as traffic conditions vary on a short time scale; people in social networks tend to evolve smoothly Road networks require dynamic updates to the network links, whereas social network links are relatively static We have relatively instantaneous validation of our prediction in road networks - short time between prediction and the ground truth

Latent Space Model LSM-RN avoids pure global learning Iterative multiplicative methods for model convergence Not practical for real-time traffic prediction LSM-RN has incremental online learning approach Feedback-based Instead of a single vertex update per round, multiple vertices can be predicted and leverages both global and incremental Balance between accuracy and efficiency Long-term global learning batches Short-term incremental learning

Latent Space Model Road Networks have Sparse data Strongly correlated vertices - temporal and spatial The need to model time variance LSM-RN uses Non-negative Matrix Factorization (NMF) for latent space learning Traditional global multiplicative algorithm Topology-aware incremental algorithm Updates vertices with topology constraints Based on adjacency matrix graph representation

Latent Space Model

Latent Space Model Loss function only defined on edges with observed readings Sparse network data results in missing values LSM-RN applies a graph Laplacian constraint for smoothing Defined as L = D - W where W is a graph proximity matrix D is a diagonal matrix Traffic model with Laplacian constraint:

Latent Space Model

Latent Space Model

Latent Space Model

Latent Space Model

Latent Space Model

Experimental Results

Experimental Results Experiments on loop sensor network (15,000 sensors, 3420 miles) From March and April 2014-60 million records LARGE and SMALL subgraphs of Los Angeles SMALL LARGE Vertices 5984 8242 Edges 12538 19986 Sensors 1642 4048

Experimental Results

Experimental Results

Experimental Results

Experimental Results Scalability

Experimental Results Additional Experiments Effect of varying algorithm parameters and discussion Convergence rate