Deep Learning on Graphs
|
|
- Roxanne Carter
- 5 years ago
- Views:
Transcription
1 Deep Learning on Graphs with Graph Convolutional Networks Hidden layer Hidden layer Input Output ReLU ReLU, 6 April 2017 joint work with Max Welling (University of Amsterdam)
2 The success story of deep learning Speech data Natural language processing (NLP) 2
3 The success story of deep learning Speech data Natural language processing (NLP) Deep neural nets that exploit: - translation invariance (weight sharing) - hierarchical compositionality 2
4 Recap: Deep learning on Euclidean data Euclidean data: grids, sequences 2D grid 3
5 Recap: Deep learning on Euclidean data Euclidean data: grids, sequences 2D grid 1D grid 3
6 Recap: Deep learning on Euclidean data Convolutional neural networks (CNNs) (Animation by Vincent Dumoulin) (Source: Wikipedia) 4
7 Recap: Deep learning on Euclidean data Convolutional neural networks (CNNs) (Animation by Vincent Dumoulin) (Source: Wikipedia) 4
8 Recap: Deep learning on Euclidean data Convolutional neural networks (CNNs) (Animation by Vincent Dumoulin) (Source: Wikipedia) Recurrent neural networks (RNNs) (Source: Christopher Olah s blog) 4
9 Traditional vs. deep learning Traditional approach Hand-designed feature extractor Classifier on top Output 5
10 Traditional vs. deep learning Traditional approach Hand-designed feature extractor Classifier on top Output End-to-end learning Deep neural network Output 5
11 CNNs: Message passing on a grid-graph Single CNN layer with 3x3 filter: (Animation by Vincent Dumoulin) 6
12 CNNs: Message passing on a grid-graph Single CNN layer with 3x3 filter: (Animation by Vincent Dumoulin) 6
13 CNNs: Message passing on a grid-graph Single CNN layer with 3x3 filter: (Animation by Vincent Dumoulin) 6
14 CNNs: Message passing on a grid-graph Single CNN layer with 3x3 filter: (Animation by Vincent Dumoulin) Update for a single pixel: Transform messages individually Add everything up 6
15 CNNs: Message passing on a grid-graph Single CNN layer with 3x3 filter: (Animation by Vincent Dumoulin) Update for a single pixel: Transform messages individually Add everything up Full update: 6
16 Graph-structured data What if our data looks like this? 7
17 Graph-structured data What if our data looks like this? or this: 7
18 Graph-structured data What if our data looks like this? or this: Real-world examples: Social networks World-wide-web Protein-interaction networks Telecommunication networks Knowledge graphs 7
19 Graph-structured data Graph: Adjacency matrix: A A B C D E A B E A B C C D D E
20 Graph-structured data Graph: Adjacency matrix: A A B C D E A B E A B C C D D E Model wish list: Trainable in time Applicable even if the input graph changes 8
21 A naïve approach Take adjacency matrix Concatenate them and feature matrix [A, X] Feed them into deep (fully connected) neural net Done? A B C D E Feat A C B D E A B C D ? E
22 A naïve approach Take adjacency matrix Concatenate them and feature matrix [A, X] Feed them into deep (fully connected) neural net Done? A B C D E Feat A C B D E A B C D ? E Problems: Huge number of parameters Re-train if graph changes 9
23 A naïve approach Take adjacency matrix Concatenate them and feature matrix [A, X] Feed them into deep (fully connected) neural net Done? A B C D E Feat A C B D E A B C D ? E Problems: Huge number of parameters Re-train if graph changes 9
24 A naïve approach Take adjacency matrix Concatenate them and feature matrix [A, X] Feed them into deep (fully connected) neural net Done? A B E C D A B C D E A B C D E Feat We need weight sharing! CNNs on graphs or Graph Convolutional Networks (GCNs)? Problems: Huge number of parameters Re-train if graph changes 9
25 GCNs with 1st-order message passing (related idea was first proposed in Scarselli et al. 2009) Consider this undirected graph: 10
26 GCNs with 1st-order message passing (related idea was first proposed in Scarselli et al. 2009) Consider this undirected graph: Calculate update for node in red: 10
27 GCNs with 1st-order message passing (related idea was first proposed in Scarselli et al. 2009) Consider this undirected graph: Calculate update for node in red: 10
28 GCNs with 1st-order message passing (related idea was first proposed in Scarselli et al. 2009) Consider this undirected graph: Calculate update for node in red: Update rule: : neighbor indices : norm. constant (per edge) Note: We could also choose simpler or more general functions over the neighborhood 10
29 GCN model architecture Input: Feature matrix, preprocessed adjacency matrix Hidden layer Hidden layer Input Output ReLU ReLU [Kipf & Welling, ICLR 2017] 11
30 What does it do? An example. Forward pass through untrained 3-layer GCN model Parameters initialized randomly 2-dim output per node f( ) = [Karate Club Network] 12
31 Relation to Weisfeiler-Lehman algorithm A classical approach for node feature assignment 13
32 Relation to Weisfeiler-Lehman algorithm A classical approach for node feature assignment 13
33 Relation to Weisfeiler-Lehman algorithm A classical approach for node feature assignment Useful as graph isomorphism check for most graphs (exception: highly regular graphs) 13
34 Relation to Weisfeiler-Lehman algorithm A classical approach for node feature assignment Useful as graph isomorphism check for most graphs (exception: highly regular graphs) 13
35 Relation to Weisfeiler-Lehman algorithm A classical approach for node feature assignment GCN: Useful as graph isomorphism check for most graphs (exception: highly regular graphs) 13
36 Semi-supervised classification on graphs Setting: Some nodes are labeled (black circle) All other nodes are unlabeled Task: Predict node label of unlabeled nodes 14
37 Semi-supervised classification on graphs Setting: Some nodes are labeled (black circle) All other nodes are unlabeled Task: Predict node label of unlabeled nodes Standard approach: graph-based regularization [Zhu et al., 2003] with assumes: connected nodes likely to share same label 14
38 Semi-supervised classification on graphs Embedding-based approaches Two-step pipeline: 1) Get embedding for every node 2) Train classifier on node embedding Examples: DeepWalk [Perozzi et al., 2014], node2vec [Grover & Leskovec, 2016] 15
39 Semi-supervised classification on graphs Embedding-based approaches Two-step pipeline: 1) Get embedding for every node 2) Train classifier on node embedding Examples: DeepWalk [Perozzi et al., 2014], node2vec [Grover & Leskovec, 2016] Problem: Embeddings are not optimized for classification! 15
40 Semi-supervised classification on graphs Embedding-based approaches Two-step pipeline: 1) Get embedding for every node 2) Train classifier on node embedding Examples: DeepWalk [Perozzi et al., 2014], node2vec [Grover & Leskovec, 2016] Problem: Embeddings are not optimized for classification! Idea: Train graph-based classifier end-to-end using GCN Evaluate loss on labeled nodes only: set of labeled node indices label matrix GCN output (after softmax) 15
41 Toy example (semi-supervised learning) Video also available here: 16
42 Toy example (semi-supervised learning) Video also available here: 16
43 Application: Classification on citation networks Input: Citation networks (nodes are papers, edges are citation links, optionally bag-of-words features on nodes) Target: Paper category (e.g. stat.ml, cs.lg, ) (Figure from: Bronstein, Bruna, LeCun, Szlam, Vandergheynst, 2016) 17
44 Experiments and results Model: 2-layer GCN Dataset statistics (Kipf & Welling, Semi-Supervised Classification with Graph Convolutional Networks, ICLR 2017) 18
45 Experiments and results Model: 2-layer GCN Dataset statistics Classification results (accuracy) no input features (Kipf & Welling, Semi-Supervised Classification with Graph Convolutional Networks, ICLR 2017) 18
46 Experiments and results Model: 2-layer GCN Dataset statistics no input features Classification results (accuracy) Learned representations (t-sne embedding of hidden layer activations) (Kipf & Welling, Semi-Supervised Classification with Graph Convolutional Networks, ICLR 2017) 18
47 Other recent applications Molecules Shapes [Duvenaud et al., NIPS 2015] [Monti et al., 2016] Knowledge Graphs [Schlichtkrull et al., 2017] 19
48 Link prediction with Graph Auto-Encoders Kipf & Welling, NIPS Bayesian Deep Learning Workshop, 2016 X A Encoder Hidden layer Hidden layer q( Z A, X ) Input Output Z ReLU ReLU p( A Z ) Â GAE Decoder 20
49 Further reading Blog post Graph Convolutional Networks: Code on Github: Kipf & Welling, Semi-Supervised Classification with Graph Convolutional Networks, ICLR 2017: Kipf & Welling, Variational Graph Auto-Encoders, NIPS BDL Workshop, 2016: You can get in touch with me via: Web: Project funded by SAP 21
Deep Learning on Graphs
Deep Learning on Graphs with Graph Convolutional Networks Hidden layer Hidden layer Input Output ReLU ReLU, 22 March 2017 joint work with Max Welling (University of Amsterdam) BDL Workshop @ NIPS 2016
More informationSemi-supervised Methods for Graph Representation
Semi-supervised Methods for Graph Representation Modeling Data With Networks + Network Embedding: Problems, Methodologies and Frontiers Ivan Brugere (University of Illinois at Chicago) Peng Cui (Tsinghua
More informationGraphite: Iterative Generative Modeling of Graphs
Graphite: Iterative Generative Modeling of Graphs Aditya Grover* adityag@cs.stanford.edu Aaron Zweig* azweig@cs.stanford.edu Stefano Ermon ermon@cs.stanford.edu Abstract Graphs are a fundamental abstraction
More informationThis Talk. 1) Node embeddings. Map nodes to low-dimensional embeddings. 2) Graph neural networks. Deep learning architectures for graphstructured
Representation Learning on Networks, snap.stanford.edu/proj/embeddings-www, WWW 2018 1 This Talk 1) Node embeddings Map nodes to low-dimensional embeddings. 2) Graph neural networks Deep learning architectures
More informationarxiv: v1 [cs.lg] 20 Apr 2017
Dynamic Graph Convolutional Networks Franco Manessi 1, Alessandro Rozza 1, and Mario Manzo 2 arxiv:1704.06199v1 [cs.lg] 20 Apr 2017 1 Research Team - Waynaut {name.surname}@waynaut.com 2 Servizi IT - Università
More informationMachine Learning 13. week
Machine Learning 13. week Deep Learning Convolutional Neural Network Recurrent Neural Network 1 Why Deep Learning is so Popular? 1. Increase in the amount of data Thanks to the Internet, huge amount of
More informationGraphNet: Recommendation system based on language and network structure
GraphNet: Recommendation system based on language and network structure Rex Ying Stanford University rexying@stanford.edu Yuanfang Li Stanford University yli03@stanford.edu Xin Li Stanford University xinli16@stanford.edu
More informationarxiv: v4 [cs.lg] 22 Feb 2017
SEMI-SUPERVISED CLASSIFICATION WITH GRAPH CONVOLUTIONAL NETWORKS Thomas N. Kipf University of Amsterdam T.N.Kipf@uva.nl Max Welling University of Amsterdam Canadian Institute for Advanced Research (CIFAR)
More informationA Higher-Order Graph Convolutional Layer
A Higher-Order Graph Convolutional Layer Sami Abu-El-Haija 1, Nazanin Alipourfard 1, Hrayr Harutyunyan 1, Amol Kapoor 2, Bryan Perozzi 2 1 Information Sciences Institute University of Southern California
More informationDeep Graph Infomax. Petar Velic kovic 1,2, William Fedus2,3,5, William L. Hamilton2,4, Pietro Lio 1, Yoshua Bengio2,3 and R Devon Hjelm6,2,3
Deep Graph Infomax Petar Velic kovic 1,2, William Fedus2,3,5, William L. Hamilton2,4, Pietro Lio 1, Yoshua Bengio2,3 and R Devon Hjelm6,2,3 1 University 4 McGill of Cambridge 2 Mila University 5 Google
More informationObject Detection Lecture Introduction to deep learning (CNN) Idar Dyrdal
Object Detection Lecture 10.3 - Introduction to deep learning (CNN) Idar Dyrdal Deep Learning Labels Computational models composed of multiple processing layers (non-linear transformations) Used to learn
More informationFeaStNet: Feature-Steered Graph Convolutions for 3D Shape Analysis Supplementary Material
FeaStNet: Feature-Steered Graph Convolutions for 3D Shape Analysis Supplementary Material Nitika Verma Edmond Boyer Jakob Verbeek Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK, 38000 Grenoble, France
More informationDiffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting
Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting Yaguang Li Joint work with Rose Yu, Cyrus Shahabi, Yan Liu Page 1 Introduction Traffic congesting is wasteful of time,
More informationNetwork embedding. Cheng Zheng
Network embedding Cheng Zheng Outline Problem definition Factorization based algorithms --- Laplacian Eigenmaps(NIPS, 2001) Random walk based algorithms ---DeepWalk(KDD, 2014), node2vec(kdd, 2016) Deep
More informationDeepWalk: Online Learning of Social Representations
DeepWalk: Online Learning of Social Representations ACM SIG-KDD August 26, 2014, Rami Al-Rfou, Steven Skiena Stony Brook University Outline Introduction: Graphs as Features Language Modeling DeepWalk Evaluation:
More informationThis Talk. Map nodes to low-dimensional embeddings. 2) Graph neural networks. Deep learning architectures for graphstructured
Representation Learning on Networks, snap.stanford.edu/proj/embeddings-www, WWW 2018 1 This Talk 1) Node embeddings Map nodes to low-dimensional embeddings. 2) Graph neural networks Deep learning architectures
More informationDeep Learning. Deep Learning provided breakthrough results in speech recognition and image classification. Why?
Data Mining Deep Learning Deep Learning provided breakthrough results in speech recognition and image classification. Why? Because Speech recognition and image classification are two basic examples of
More informationDEEP LEARNING REVIEW. Yann LeCun, Yoshua Bengio & Geoffrey Hinton Nature Presented by Divya Chitimalla
DEEP LEARNING REVIEW Yann LeCun, Yoshua Bengio & Geoffrey Hinton Nature 2015 -Presented by Divya Chitimalla What is deep learning Deep learning allows computational models that are composed of multiple
More informationCOMP 551 Applied Machine Learning Lecture 16: Deep Learning
COMP 551 Applied Machine Learning Lecture 16: Deep Learning Instructor: Ryan Lowe (ryan.lowe@cs.mcgill.ca) Slides mostly by: Class web page: www.cs.mcgill.ca/~hvanho2/comp551 Unless otherwise noted, all
More informationCS224W: Analysis of Networks Jure Leskovec, Stanford University
CS224W: Analysis of Networks Jure Leskovec, Stanford University http://cs224w.stanford.edu Jure Leskovec, Stanford CS224W: Analysis of Networks, http://cs224w.stanford.edu 2????? Machine Learning Node
More informationarxiv: v1 [stat.ml] 10 Mar 2018
Attention-based Graph Neural Network for Semi-supervised Learning Kiran K. Thekumparampil, Chong Wang, Sewoong Oh, and Li-Jia Li, March 13, 2018 arxiv:1803.03735v1 [stat.ml] 10 Mar 2018 Abstract Recently
More informationAdversarial Network Embedding
Adversarial Network Embedding Quanyu Dai 1, Qiang Li 1,2, Jian Tang 3,4, Dan Wang 1 1 Department of Computing, The Hong Kong Polytechnic University, Hong Kong 2 School of Software, FEIT, The University
More informationDeep Learning for Computer Vision II
IIIT Hyderabad Deep Learning for Computer Vision II C. V. Jawahar Paradigm Shift Feature Extraction (SIFT, HoG, ) Part Models / Encoding Classifier Sparrow Feature Learning Classifier Sparrow L 1 L 2 L
More informationFrom processing to learning on graphs
From processing to learning on graphs Patrick Pérez Maths and Images in Paris IHP, 2 March 2017 Signals on graphs Natural graph: mesh, network, etc., related to a real structure, various signals can live
More informationDeeper Insights into Graph Convolutional Networks for Semi-Supervised Learning
Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning Qimai Li, Zhichao Han 2, Xiao-Ming Wu The Hong Kong Polytechnic University 2 ETH Zurich csqmli@comp.polyu.edu.hk, zhhan@student.ethz.ch,
More informationNext Steps in Data Mining. Sistemas de Apoio à Decisão Cláudia Antunes
Next Steps in Data Mining Sistemas de Apoio à Decisão Cláudia Antunes Temporal Data Mining Cláudia Antunes Data Mining Knowledge Discovery is the nontrivial extraction of implicit, previously unknown,
More informationAdversarial Network Embedding
Adversarial Network Embedding Quanyu Dai 1, Qiang Li 1,2, Jian Tang 3,4, Dan Wang 1 1 Department of Computing, The Hong Kong Polytechnic University, Hong Kong 2 School of Software, FEIT, The University
More informationDeeper Insights into Graph Convolutional Networks for Semi-Supervised Learning
The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18) Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning Qimai Li, 1 Zhichao Han, 1,2 Xiao-Ming Wu 1 1 The Hong
More informationMachine Learning. Deep Learning. Eric Xing (and Pengtao Xie) , Fall Lecture 8, October 6, Eric CMU,
Machine Learning 10-701, Fall 2015 Deep Learning Eric Xing (and Pengtao Xie) Lecture 8, October 6, 2015 Eric Xing @ CMU, 2015 1 A perennial challenge in computer vision: feature engineering SIFT Spin image
More informationDeep Learning Applications
October 20, 2017 Overview Supervised Learning Feedforward neural network Convolution neural network Recurrent neural network Recursive neural network (Recursive neural tensor network) Unsupervised Learning
More informationConvolutional Networks for Text
CS11-747 Neural Networks for NLP Convolutional Networks for Text Graham Neubig Site https://phontron.com/class/nn4nlp2017/ An Example Prediction Problem: Sentence Classification I hate this movie very
More informationFacial Expression Classification with Random Filters Feature Extraction
Facial Expression Classification with Random Filters Feature Extraction Mengye Ren Facial Monkey mren@cs.toronto.edu Zhi Hao Luo It s Me lzh@cs.toronto.edu I. ABSTRACT In our work, we attempted to tackle
More informationRepresentation Learning on Graphs: Methods and Applications
Representation Learning on Graphs: Methods and Applications William L. Hamilton wleif@stanford.edu Rex Ying rexying@stanford.edu Department of Computer Science Stanford University Stanford, CA, 94305 Jure
More informationRecurrent Convolutional Neural Networks for Scene Labeling
Recurrent Convolutional Neural Networks for Scene Labeling Pedro O. Pinheiro, Ronan Collobert Reviewed by Yizhe Zhang August 14, 2015 Scene labeling task Scene labeling: assign a class label to each pixel
More informationarxiv: v1 [cs.si] 14 Mar 2017
SNE: Signed Network Embedding Shuhan Yuan 1, Xintao Wu 2, and Yang Xiang 1 1 Tongji University, Shanghai, China, Email:{4e66,shxiangyang}@tongji.edu.cn 2 University of Arkansas, Fayetteville, AR, USA,
More informationDeep Learning in Visual Recognition. Thanks Da Zhang for the slides
Deep Learning in Visual Recognition Thanks Da Zhang for the slides Deep Learning is Everywhere 2 Roadmap Introduction Convolutional Neural Network Application Image Classification Object Detection Object
More informationUnsupervised Learning of Spatiotemporally Coherent Metrics
Unsupervised Learning of Spatiotemporally Coherent Metrics Ross Goroshin, Joan Bruna, Jonathan Tompson, David Eigen, Yann LeCun arxiv 2015. Presented by Jackie Chu Contributions Insight between slow feature
More informationPTE : Predictive Text Embedding through Large-scale Heterogeneous Text Networks
PTE : Predictive Text Embedding through Large-scale Heterogeneous Text Networks Pramod Srinivasan CS591txt - Text Mining Seminar University of Illinois, Urbana-Champaign April 8, 2016 Pramod Srinivasan
More informationGraph neural networks February Visin Francesco
Graph neural networks February 2018 Visin Francesco Who I am Outline Motivation and examples Graph nets (Semi)-formal definition Interaction network Relation network Gated graph sequence neural network
More informationParticle Track Reconstruction with Deep Learning
Particle Track Reconstruction with Deep Learning Steven Farrell, Paolo Calafiura, Mayur Mudigonda, Prabhat Lawrence Berkeley National Laboratory {SFarrell,PCalafiura,Mudigonda,Prabhat}@lbl.gov Dustin Anderson,
More informationLecture 10 CNNs on Graphs
Lecture 10 CNNs on Graphs CMSC 35246: Deep Learning Shubhendu Trivedi & Risi Kondor University of Chicago April 26, 2017 Two Scenarios For CNNs on graphs, we have two distinct scenarios: Scenario 1: Each
More informationKeras: Handwritten Digit Recognition using MNIST Dataset
Keras: Handwritten Digit Recognition using MNIST Dataset IIT PATNA January 31, 2018 1 / 30 OUTLINE 1 Keras: Introduction 2 Installing Keras 3 Keras: Building, Testing, Improving A Simple Network 2 / 30
More informationLecture 13 Segmentation and Scene Understanding Chris Choy, Ph.D. candidate Stanford Vision and Learning Lab (SVL)
Lecture 13 Segmentation and Scene Understanding Chris Choy, Ph.D. candidate Stanford Vision and Learning Lab (SVL) http://chrischoy.org Stanford CS231A 1 Understanding a Scene Objects Chairs, Cups, Tables,
More informationDAGCN: Dual Attention Graph Convolutional Networks
DAGCN: Dual Attention Graph Convolutional Networks Fengwen Chen, Shirui Pan, Jing Jiang, Huan Huo Guodong Long Centre for Artificial Intelligence, FEIT, University of Technology Sydney, Australia Faculty
More informationDeep Learning. Deep Learning. Practical Application Automatically Adding Sounds To Silent Movies
http://blog.csdn.net/zouxy09/article/details/8775360 Automatic Colorization of Black and White Images Automatically Adding Sounds To Silent Movies Traditionally this was done by hand with human effort
More informationTutorial on Machine Learning Tools
Tutorial on Machine Learning Tools Yanbing Xue Milos Hauskrecht Why do we need these tools? Widely deployed classical models No need to code from scratch Easy-to-use GUI Outline Matlab Apps Weka 3 UI TensorFlow
More informationGraph Convolutional Networks: Algorithms, Applications and Open Challenges
Graph Convolutional Networks: Algorithms, Applications and Open Challenges Si Zhang, Hanghang Tong, Jiejun Xu, and Ross Maciejewski Arizona State University, {szhan172, hanghang.tong, rmacieje}@asu.edu;
More informationA Deep Learning primer
A Deep Learning primer Riccardo Zanella r.zanella@cineca.it SuperComputing Applications and Innovation Department 1/21 Table of Contents Deep Learning: a review Representation Learning methods DL Applications
More informationarxiv: v1 [cs.lg] 11 Nov 2018
Graph Convolutional Neural Networks via Motif-based Attention Hao Peng Jianxin Li Qiran Gong Yuanxin Ning Lihong Wang Department of Computer Science & Engineering, Beihang University, Beijing, China National
More informationarxiv: v1 [cs.lg] 10 Dec 2017
DGCNN: Disordered Graph Convolutional Neural Network Based on the Gaussian Mixture Model arxiv:1712.03563v1 [cs.lg] 10 Dec 2017 Bo Wu, Yang Liu, Bo Lang, Lei Huang State Key Laboratory of Software Development
More informationarxiv: v4 [cs.si] 26 Apr 2018
Semi-supervised Embedding in Attributed Networks with Outliers Jiongqian Liang Peter Jacobs Jiankai Sun Srinivasan Parthasarathy arxiv:1703.08100v4 [cs.si] 26 Apr 2018 Abstract In this paper, we propose
More informationA Hybrid Neural Model for Type Classification of Entity Mentions
A Hybrid Neural Model for Type Classification of Entity Mentions Motivation Types group entities to categories Entity types are important for various NLP tasks Our task: predict an entity mention s type
More informationDeep Learning For Video Classification. Presented by Natalie Carlebach & Gil Sharon
Deep Learning For Video Classification Presented by Natalie Carlebach & Gil Sharon Overview Of Presentation Motivation Challenges of video classification Common datasets 4 different methods presented in
More informationCode Mania Artificial Intelligence: a. Module - 1: Introduction to Artificial intelligence and Python:
Code Mania 2019 Artificial Intelligence: a. Module - 1: Introduction to Artificial intelligence and Python: 1. Introduction to Artificial Intelligence 2. Introduction to python programming and Environment
More informationDeep Tracking: Biologically Inspired Tracking with Deep Convolutional Networks
Deep Tracking: Biologically Inspired Tracking with Deep Convolutional Networks Si Chen The George Washington University sichen@gwmail.gwu.edu Meera Hahn Emory University mhahn7@emory.edu Mentor: Afshin
More informationMulti-Task Self-Supervised Visual Learning
Multi-Task Self-Supervised Visual Learning Sikai Zhong March 4, 2018 COMPUTER SCIENCE Table of contents 1. Introduction 2. Self-supervised Tasks 3. Architectures 4. Experiments 1 Introduction Self-supervised
More informationInductive Representation Learning on Large Graphs
Inductive Representation Learning on Large Graphs William L. Hamilton wleif@stanford.edu Rex Ying rexying@stanford.edu Jure Leskovec jure@cs.stanford.edu Department of Computer Science Stanford University
More informationCS 1674: Intro to Computer Vision. Neural Networks. Prof. Adriana Kovashka University of Pittsburgh November 16, 2016
CS 1674: Intro to Computer Vision Neural Networks Prof. Adriana Kovashka University of Pittsburgh November 16, 2016 Announcements Please watch the videos I sent you, if you haven t yet (that s your reading)
More informationCS 2750: Machine Learning. Neural Networks. Prof. Adriana Kovashka University of Pittsburgh April 13, 2016
CS 2750: Machine Learning Neural Networks Prof. Adriana Kovashka University of Pittsburgh April 13, 2016 Plan for today Neural network definition and examples Training neural networks (backprop) Convolutional
More informationUnsupervised Learning
Deep Learning for Graphics Unsupervised Learning Niloy Mitra Iasonas Kokkinos Paul Guerrero Vladimir Kim Kostas Rematas Tobias Ritschel UCL UCL/Facebook UCL Adobe Research U Washington UCL Timetable Niloy
More informationConvolutional-Recursive Deep Learning for 3D Object Classification
Convolutional-Recursive Deep Learning for 3D Object Classification Richard Socher, Brody Huval, Bharath Bhat, Christopher D. Manning, Andrew Y. Ng NIPS 2012 Iro Armeni, Manik Dhar Motivation Hand-designed
More informationATTENTION-BASED GRAPH NEURAL NETWORK FOR SEMI-SUPERVISED LEARNING
ATTENTION-BASED GRAPH NEURAL NETWORK FOR SEMI-SUPERVISED LEARNING Anonymous authors Paper under double-blind review ABSTRACT Recently popularized graph neural networks achieve the state-of-the-art accuracy
More informationCIS680: Vision & Learning Assignment 2.b: RPN, Faster R-CNN and Mask R-CNN Due: Nov. 21, 2018 at 11:59 pm
CIS680: Vision & Learning Assignment 2.b: RPN, Faster R-CNN and Mask R-CNN Due: Nov. 21, 2018 at 11:59 pm Instructions This is an individual assignment. Individual means each student must hand in their
More informationDeep Attributed Network Embedding
Deep Attributed Network Embedding Hongchang Gao, Heng Huang Department of Electrical and Computer Engineering University of Pittsburgh, USA hongchanggao@gmail.com, heng.huang@pitt.edu Abstract Network
More informationCMU Lecture 18: Deep learning and Vision: Convolutional neural networks. Teacher: Gianni A. Di Caro
CMU 15-781 Lecture 18: Deep learning and Vision: Convolutional neural networks Teacher: Gianni A. Di Caro DEEP, SHALLOW, CONNECTED, SPARSE? Fully connected multi-layer feed-forward perceptrons: More powerful
More informationEnd-To-End Spam Classification With Neural Networks
End-To-End Spam Classification With Neural Networks Christopher Lennan, Bastian Naber, Jan Reher, Leon Weber 1 Introduction A few years ago, the majority of the internet s network traffic was due to spam
More informationUnrolling Inference: The Recurrent Inference Machine
Unrolling Inference: The Recurrent Inference Machine Max Welling University of Amsterdam / Qualcomm Canadian Institute for Advanced Research ML @ UvA (2 fte) (12fte) Machine Learning in Amsterdam (3fte)
More informationJOINT INTENT DETECTION AND SLOT FILLING USING CONVOLUTIONAL NEURAL NETWORKS. Puyang Xu, Ruhi Sarikaya. Microsoft Corporation
JOINT INTENT DETECTION AND SLOT FILLING USING CONVOLUTIONAL NEURAL NETWORKS Puyang Xu, Ruhi Sarikaya Microsoft Corporation ABSTRACT We describe a joint model for intent detection and slot filling based
More informationCS468: 3D Deep Learning on Point Cloud Data. class label part label. Hao Su. image. May 10, 2017
CS468: 3D Deep Learning on Point Cloud Data class label part label Hao Su image. May 10, 2017 Agenda Point cloud generation Point cloud analysis CVPR 17, Point Set Generation Pipeline render CVPR 17, Point
More informationDeep Learning Explained Module 4: Convolution Neural Networks (CNN or Conv Nets)
Deep Learning Explained Module 4: Convolution Neural Networks (CNN or Conv Nets) Sayan D. Pathak, Ph.D., Principal ML Scientist, Microsoft Roland Fernandez, Senior Researcher, Microsoft Module Outline
More informationCapsule Networks. Eric Mintun
Capsule Networks Eric Mintun Motivation An improvement* to regular Convolutional Neural Networks. Two goals: Replace max-pooling operation with something more intuitive. Keep more info about an activated
More informationDeep Learning Cook Book
Deep Learning Cook Book Robert Haschke (CITEC) Overview Input Representation Output Layer + Cost Function Hidden Layer Units Initialization Regularization Input representation Choose an input representation
More informationarxiv: v1 [cs.si] 7 Sep 2018
dyngraph2vec: Capturing Network Dynamics using Dynamic Graph Representation Learning Palash Goyal USC Information Sciences Institute palashgo@usc.edu Sujit Rokka Chhetri * University of California-Irvine
More informationLearning Graph-Level Representations with Recurrent Neural Networks
Learning Graph-Level Representations with Recurrent Neural Networks arxiv:1805.07683v4 [cs.lg] 11 Sep 2018 Yu Jin, Joseph F. JaJa Department of Electrical and Computer Engineering Institute for Advanced
More informationLecture 20: Neural Networks for NLP. Zubin Pahuja
Lecture 20: Neural Networks for NLP Zubin Pahuja zpahuja2@illinois.edu courses.engr.illinois.edu/cs447 CS447: Natural Language Processing 1 Today s Lecture Feed-forward neural networks as classifiers simple
More informationAlternatives to Direct Supervision
CreativeAI: Deep Learning for Graphics Alternatives to Direct Supervision Niloy Mitra Iasonas Kokkinos Paul Guerrero Nils Thuerey Tobias Ritschel UCL UCL UCL TUM UCL Timetable Theory and Basics State of
More informationDynamic Routing Between Capsules
Report Explainable Machine Learning Dynamic Routing Between Capsules Author: Michael Dorkenwald Supervisor: Dr. Ullrich Köthe 28. Juni 2018 Inhaltsverzeichnis 1 Introduction 2 2 Motivation 2 3 CapusleNet
More informationA Deep Learning Approach to Vehicle Speed Estimation
A Deep Learning Approach to Vehicle Speed Estimation Benjamin Penchas bpenchas@stanford.edu Tobin Bell tbell@stanford.edu Marco Monteiro marcorm@stanford.edu ABSTRACT Given car dashboard video footage,
More informationABC-CNN: Attention Based CNN for Visual Question Answering
ABC-CNN: Attention Based CNN for Visual Question Answering CIS 601 PRESENTED BY: MAYUR RUMALWALA GUIDED BY: DR. SUNNIE CHUNG AGENDA Ø Introduction Ø Understanding CNN Ø Framework of ABC-CNN Ø Datasets
More informationConvolutional Neural Networks. Computer Vision Jia-Bin Huang, Virginia Tech
Convolutional Neural Networks Computer Vision Jia-Bin Huang, Virginia Tech Today s class Overview Convolutional Neural Network (CNN) Training CNN Understanding and Visualizing CNN Image Categorization:
More informationCENTER FOR EMBEDDED & CYBER-PHYSICAL SYSTEMS. System Level CPS design using Non-Euclidean Training method. Jiang Wan.
CECS CENTER FOR EMBEDDED & CYBER-PHYSICAL SYSTEMS System Level CPS design using Non-Euclidean Training method Jiang Wan Arquimedes Canedo Mohammad Abdullah Al Faruque Center for Embedded and Cyber-Physical
More informationDeep neural networks II
Deep neural networks II May 31 st, 2018 Yong Jae Lee UC Davis Many slides from Rob Fergus, Svetlana Lazebnik, Jia-Bin Huang, Derek Hoiem, Adriana Kovashka, Why (convolutional) neural networks? State of
More informationFace Recognition A Deep Learning Approach
Face Recognition A Deep Learning Approach Lihi Shiloh Tal Perl Deep Learning Seminar 2 Outline What about Cat recognition? Classical face recognition Modern face recognition DeepFace FaceNet Comparison
More informationarxiv: v1 [cs.lg] 16 Mar 2018
Graph Partition Neural Networks for Semi-Supervised Classification arxiv:1803.06272v1 [cs.lg] 16 Mar 2018 Renjie Liao University of Toronto Uber ATG Toronto Vector Institute rjliao@cs.toronto.edu Alexander
More informationnode2vec: Scalable Feature Learning for Networks
node2vec: Scalable Feature Learning for Networks A paper by Aditya Grover and Jure Leskovec, presented at Knowledge Discovery and Data Mining 16. 11/27/2018 Presented by: Dharvi Verma CS 848: Graph Database
More informationKnow your data - many types of networks
Architectures Know your data - many types of networks Fixed length representation Variable length representation Online video sequences, or samples of different sizes Images Specific architectures for
More informationComputer Vision Lecture 16
Computer Vision Lecture 16 Deep Learning Applications 11.01.2017 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar registration period starts
More informationRyerson University CP8208. Soft Computing and Machine Intelligence. Naive Road-Detection using CNNS. Authors: Sarah Asiri - Domenic Curro
Ryerson University CP8208 Soft Computing and Machine Intelligence Naive Road-Detection using CNNS Authors: Sarah Asiri - Domenic Curro April 24 2016 Contents 1 Abstract 2 2 Introduction 2 3 Motivation
More informationKeras: Handwritten Digit Recognition using MNIST Dataset
Keras: Handwritten Digit Recognition using MNIST Dataset IIT PATNA February 9, 2017 1 / 24 OUTLINE 1 Introduction Keras: Deep Learning library for Theano and TensorFlow 2 Installing Keras Installation
More informationComputer Vision Lecture 16
Announcements Computer Vision Lecture 16 Deep Learning Applications 11.01.2017 Seminar registration period starts on Friday We will offer a lab course in the summer semester Deep Robot Learning Topic:
More informationRecurrent Neural Nets II
Recurrent Neural Nets II Steven Spielberg Pon Kumar, Tingke (Kevin) Shen Machine Learning Reading Group, Fall 2016 9 November, 2016 Outline 1 Introduction 2 Problem Formulations with RNNs 3 LSTM for Optimization
More informationarxiv: v1 [cs.si] 20 Nov 2018
Temporal Graph Offset Reconstruction: Towards Temporally Robust Graph Representation Learning arxiv:1811.08366v1 [cs.si] 20 Nov 2018 Stephen Bonner, John Brennan, Ibad Kureshi, Georgios Theodoropoulos,
More informationConvolutionalNN's... ConvNet's... deep learnig
Deep Learning ConvolutionalNN's... ConvNet's... deep learnig Markus Thaler, TG208 tham@zhaw.ch www.zhaw.ch/~tham Martin Weisenhorn, TB427 weie@zhaw.ch 20.08.2018 1 Neural Networks Classification: up to
More informationAutoencoders. Stephen Scott. Introduction. Basic Idea. Stacked AE. Denoising AE. Sparse AE. Contractive AE. Variational AE GAN.
Stacked Denoising Sparse Variational (Adapted from Paul Quint and Ian Goodfellow) Stacked Denoising Sparse Variational Autoencoding is training a network to replicate its input to its output Applications:
More informationDeep Learning in Image Processing
Deep Learning in Image Processing Roland Memisevic University of Montreal & TwentyBN ICISP 2016 Roland Memisevic Deep Learning in Image Processing ICISP 2016 f 2? cathedral high-rise f 1 It s the features,
More informationAsynchronous Parallel Learning for Neural Networks and Structured Models with Dense Features
Asynchronous Parallel Learning for Neural Networks and Structured Models with Dense Features Xu SUN ( 孙栩 ) Peking University xusun@pku.edu.cn Motivation Neural networks -> Good Performance CNN, RNN, LSTM
More informationIntroduction to Deep Learning for Facial Understanding Part III: Regional CNNs
Introduction to Deep Learning for Facial Understanding Part III: Regional CNNs Raymond Ptucha, Rochester Institute of Technology, USA Tutorial-9 May 19, 218 www.nvidia.com/dli R. Ptucha 18 1 Fair Use Agreement
More informationA Sparse and Locally Shift Invariant Feature Extractor Applied to Document Images
A Sparse and Locally Shift Invariant Feature Extractor Applied to Document Images Marc Aurelio Ranzato Yann LeCun Courant Institute of Mathematical Sciences New York University - New York, NY 10003 Abstract
More informationRecurrent Neural Networks and Transfer Learning for Action Recognition
Recurrent Neural Networks and Transfer Learning for Action Recognition Andrew Giel Stanford University agiel@stanford.edu Ryan Diaz Stanford University ryandiaz@stanford.edu Abstract We have taken on the
More informationarxiv: v2 [cs.lg] 12 Sep 2018
Watch Your Step: Learning Node Embeddings via Graph Attention arxiv:1710.09599v2 [cs.lg] 12 Sep 2018 Sami Abu-El-Haija Information Sciences Institute, University of Southern alifornia haija@isi.edu Rami
More information