Towards Weakly- and Semi- Supervised Object Localization and Semantic Segmentation
|
|
|
- Joshua Gallagher
- 5 years ago
- Views:
Transcription
1 Towards Weakly- and Semi- Supervised Object Localization and Semantic Segmentation Lecturer: Yunchao Wei Image Formation and Processing (IFP) Group University of Illinois at Urbanahttps://weiyc.githu Champaign b.io 1
2 Fully Supervised Semantic Segmentation Hard to Collect Masks 2
3 3
4 100/C 5min/I 4
5 Weakly Supervised Annotations bounding boxes horse scribbles points image-level labels horse person person The simplest and the most efficient one 5
6 Our Targets images Object Localization Maps Loc annotations person horse table Seg 6
7 Achievements PR 2016 PAMI 2017 CVPR 2017 Proposal-based Localization Simple to Complex Adversarial Erasing CVPR 2018 CVPR 2018 AAAI 2018 Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network 7
8 Achievements PR 2016 PAMI 2017 CVPR 2017 Proposal-based Localization Simple to Complex Adversarial Erasing CVPR 2018 CVPR 2018 AAAI 2018 Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network 8
9 Proposal-based Localization Learning to Segment with Image-level Annotations. PR
10 Proposal-based Localization Pascal VOC 43.2% Hypotheses-CNN-Pooling Localization Map Generation Weakness o o Exhaustedly examine each proposal to generate localization Introducing false negative pixels(background) Learning to Segment with Image-level Annotations. PR
11 Achievements PR 2016 PAMI 2017 CVPR 2017 Proposal-based Localization Simple to Complex Adversarial Erasing CVPR 2018 CVPR 2018 AAAI 2018 Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network 11
12 Simple to Complex Simple Images Complex Images STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI
13 Simple to Complex Simple images with the corresponding saliency maps STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI
14 Simple to Complex o Initial-DCNN o Enhanced-DCNN o Powerful-DCNN STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI
15 Simple to Complex Flickr-Clean (40K) STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI
16 Ablation Analysis on Pascal VOC12 val Simple to Complex Pascal VOC 43.2% 51.2% Networks Training Set miou I-DCNN Flickr-Clean 44.1 E-DCNN Flickr-Clean 46.8 P-DCNN Flickr-Clean+VOC 49.8 Weakness o o Collecting a large number of simple images Time consuming for training STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation. PAMI
17 Achievements PR 2016 PAMI 2017 CVPR 2017 Proposal-based Localization Simple to Complex Adversarial Erasing CVPR 2018 CVPR 2018 AAAI 2018 Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network 17
18 Adversarial Erasing dog bird cow Previous works Our target Small and sparse object localization maps Dense and integral object localization maps Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral) 18
19 Adversarial Erasing Motivation head conf: 1.0 conf: 0.8 conf: 0.5 body foot Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral) 19
20 Adversarial Erasing Our Solution Visualizations Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral) 20
21 Adversarial Erasing The pipeline of weakly semantic segmentation based on AE Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral) 21
22 Weakness of Adversarial Erasing Pascal VOC 43.2% 51.2% o o Time consuming to learn several classification networks. Hard to determine how many AE steps should be conducted. 55.7% AE-step4 AE-step3 AE-step2 AE-step Loss Epoch Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach. CVPR 2017 (oral) 22
23 Achievements PR 2016 PAMI 2017 CVPR 2017 Proposal-based Localization Simple to Complex Adversarial Erasing CVPR 2018 CVPR 2018 AAAI 2018 Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network 23
24 Ours Ours CAM CAM Images Adversarial Complementary Learning Revisiting CAM Classification GAP FC Conv 1x1 GAP Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR
25 Adversarial Complementary Learning Detailed Framework Erasing Thresholding Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR
26 Adversarial Complementary Learning Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR
27 Adversarial Complementary Learning Localization Comparison Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR
28 Adversarial Complementary Learning Localization error on ILSVRC validation set Methods Top-1 err. Top-5 err. Backprop on GoogleLeNet GoogLeNet-GAP (CVPR 2016) GoogLeNet-HaS-32 (ICCV 2017) GoogLeNet-ACoL(Ours) GoogLeNet-ACoL*(Ours) Backprop on VGGnet VGG-GAP (CVPR 2016) VGGnet-ACoL(Ours) VGGnet-ACoL*(Ours) Pascal VOC 43.2% 51.2% 55.7% 58.8% Adversarial Complementary Learning for Weakly Supervised Object Localization. CVPR
29 Achievements PR 2016 PAMI 2017 CVPR 2017 Proposal-based Localization Simple to Complex Adversarial Erasing CVPR 2018 CVPR 2018 AAAI 2018 Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network 29
30 Multi-dilated Convolution Motivation In kernel 3x3 Out Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight) 30
31 Multi-dilated Convolution o Multi-dilated Convolutional Network for Object Localization Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight) 31
32 Multi-dilated Convolution Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight) 32
33 Multi-dilated Convolution o Weakly- and Semi- Supervised Semantic Segmentation Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight) 33
34 Multi-dilated Convolution Pascal VOC 43.2% 51.2% 55.7% 58.8% 60.8% 68.5% Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation. CVPR 2018 (spotlight) 34
35 Achievements PR 2016 PAMI 2017 CVPR 2017 Proposal-based Localization Simple to Complex Adversarial Erasing CVPR 2018 CVPR 2018 AAAI 2018 Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network 35
36 Transferable Semi-supervised Network In-category Semi-supervised Semantic Segmentation (I3S) Transferable Semi-supervised Semantic Segmentation. AAAI
37 100/C 5min/I 37
38 Transferable Semi-supervised Network In-category Semi-supervised Semantic Segmentation (I3S) Cross-category Semi-supervised Semantic Segmentation (C3S) Transferable Semi-supervised Semantic Segmentation. AAAI
39 Transferable Semi-supervised Network Label Transfer Network (L-Net) Prediction Transfer Network (P-Net) Transferable Semi-supervised Semantic Segmentation. AAAI
40 Transferable Semi-supervised Network denotes the standard element-wise binary cross-entropy loss Transferable Semi-supervised Semantic Segmentation. AAAI
41 Transferable Semi-supervised Network Classification Activation Map Transferable Semi-supervised Semantic Segmentation. AAAI
42 Transferable Semi-supervised Network Random Walk based self-diffusion algorithm Transferable Semi-supervised Semantic Segmentation. AAAI
43 Transferable Semi-supervised Network Transferable Semi-supervised Semantic Segmentation. AAAI
44 Transferable Semi-supervised Network Transferable Semi-supervised Semantic Segmentation. AAAI
45 Transferable Semi-supervised Network Pascal VOC 43.2% 51.2% 55.7% 58.8% 60.8% 68.5% 64.6% 45
46 Transferable Semi-supervised Semantic Segmentation. AAAI
47 Summary PR 2016 PAMI 2017 CVPR 2017 images Object Localization Maps Loc Proposal-based Localization Simple to Complex Adversarial Erasing annotations CVPR 2018 CVPR 2018 AAAI 2018 Seg person horse table Adversarial Complementary Learning Multi-dilated Convolution Transferable Semi-supervised Network 47
48 Thanks 48
Lecture 7: Semantic Segmentation
Semantic Segmentation CSED703R: Deep Learning for Visual Recognition (207F) Segmenting images based on its semantic notion Lecture 7: Semantic Segmentation Bohyung Han Computer Vision Lab. bhhanpostech.ac.kr
arxiv: v1 [cs.cv] 12 Jun 2018
![arxiv: v1 [cs.cv] 12 Jun 2018](/thumbs/92/110223238.jpg "arxiv: v1 [cs.cv] 12 Jun 2018")
Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features Xiang Wang 1 Shaodi You 2,3 Xi Li 1 Huimin Ma 1 1 Department of Electronic Engineering, Tsinghua University 2 DATA61-CSIRO
SSD: Single Shot MultiBox Detector. Author: Wei Liu et al. Presenter: Siyu Jiang
SSD: Single Shot MultiBox Detector Author: Wei Liu et al. Presenter: Siyu Jiang Outline 1. Motivations 2. Contributions 3. Methodology 4. Experiments 5. Conclusions 6. Extensions Motivation Motivation
Yiqi Yan. May 10, 2017
Yiqi Yan May 10, 2017 P a r t I F u n d a m e n t a l B a c k g r o u n d s Convolution Single Filter Multiple Filters 3 Convolution: case study, 2 filters 4 Convolution: receptive field receptive field
Fully Convolutional Networks for Semantic Segmentation
Fully Convolutional Networks for Semantic Segmentation Jonathan Long* Evan Shelhamer* Trevor Darrell UC Berkeley Chaim Ginzburg for Deep Learning seminar 1 Semantic Segmentation Define a pixel-wise labeling
Spatial Localization and Detection. Lecture 8-1
Lecture 8: Spatial Localization and Detection Lecture 8-1 Administrative - Project Proposals were due on Saturday Homework 2 due Friday 2/5 Homework 1 grades out this week Midterm will be in-class on Wednesday
Rich feature hierarchies for accurate object detection and semantic segmentation
Rich feature hierarchies for accurate object detection and semantic segmentation BY; ROSS GIRSHICK, JEFF DONAHUE, TREVOR DARRELL AND JITENDRA MALIK PRESENTER; MUHAMMAD OSAMA Object detection vs. classification
Weakly Supervised Object Recognition with Convolutional Neural Networks
GDR-ISIS, Paris March 20, 2015 Weakly Supervised Object Recognition with Convolutional Neural Networks Ivan Laptev ivan.laptev@inria.fr WILLOW, INRIA/ENS/CNRS, Paris Joint work with: Maxime Oquab Leon
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution and Fully Connected CRFs
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution and Fully Connected CRFs Zhipeng Yan, Moyuan Huang, Hao Jiang 5/1/2017 1 Outline Background semantic segmentation Objective,
Hide-and-Seek: Forcing a network to be Meticulous for Weakly-supervised Object and Action Localization
Hide-and-Seek: Forcing a network to be Meticulous for Weakly-supervised Object and Action Localization Krishna Kumar Singh and Yong Jae Lee University of California, Davis ---- Paper Presentation Yixian
AttentionNet for Accurate Localization and Detection of Objects. (To appear in ICCV 2015)
AttentionNet for Accurate Localization and Detection of Objects. (To appear in ICCV 2015) Donggeun Yoo, Sunggyun Park, Joon-Young Lee, Anthony Paek, In So Kweon. State-of-the-art frameworks for object
YOLO9000: Better, Faster, Stronger
YOLO9000: Better, Faster, Stronger Date: January 24, 2018 Prepared by Haris Khan (University of Toronto) Haris Khan CSC2548: Machine Learning in Computer Vision 1 Overview 1. Motivation for one-shot object
Object Detection Based on Deep Learning
Object Detection Based on Deep Learning Yurii Pashchenko AI Ukraine 2016, Kharkiv, 2016 Image classification (mostly what you ve seen) http://tutorial.caffe.berkeleyvision.org/caffe-cvpr15-detection.pdf
Constrained Convolutional Neural Networks for Weakly Supervised Segmentation. Deepak Pathak, Philipp Krähenbühl and Trevor Darrell
Constrained Convolutional Neural Networks for Weakly Supervised Segmentation Deepak Pathak, Philipp Krähenbühl and Trevor Darrell 1 Multi-class Image Segmentation Assign a class label to each pixel in
Structured Prediction using Convolutional Neural Networks
Overview Structured Prediction using Convolutional Neural Networks Bohyung Han bhhan@postech.ac.kr Computer Vision Lab. Convolutional Neural Networks (CNNs) Structured predictions for low level computer
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun Presented by Tushar Bansal Objective 1. Get bounding box for all objects
Adversarial Complementary Learning for Weakly Supervised Object Localization
Adversarial Complementary Learning for Weakly Supervised Object Localization Xiaolin Zhang 1 Yunchao Wei 2 Jiashi Feng 3 Yi Yang 1 Thomas Huang 2 1 CAI, University of Technology Sydney 2 University of
Gradient of the lower bound
Weakly Supervised with Latent PhD advisor: Dr. Ambedkar Dukkipati Department of Computer Science and Automation gaurav.pandey@csa.iisc.ernet.in Objective Given a training set that comprises image and image-level
Speaker: Ming-Ming Cheng Nankai University 15-Sep-17 Towards Weakly Supervised Image Understanding
Towards Weakly Supervised Image Understanding (WSIU) Speaker: Ming-Ming Cheng Nankai University http://mmcheng.net/ 1/50 Understanding Visual Information Image by kirkh.deviantart.com 2/50 Dataset Annotation
CS 1674: Intro to Computer Vision. Object Recognition. Prof. Adriana Kovashka University of Pittsburgh April 3, 5, 2018
CS 1674: Intro to Computer Vision Object Recognition Prof. Adriana Kovashka University of Pittsburgh April 3, 5, 2018 Different Flavors of Object Recognition Semantic Segmentation Classification + Localization
EE-559 Deep learning Networks for semantic segmentation
EE-559 Deep learning 7.4. Networks for semantic segmentation François Fleuret https://fleuret.org/ee559/ Mon Feb 8 3:35:5 UTC 209 ÉCOLE POLYTECHNIQUE FÉDÉRALE DE LAUSANNE The historical approach to image
Cascade Region Regression for Robust Object Detection
Large Scale Visual Recognition Challenge 2015 (ILSVRC2015) Cascade Region Regression for Robust Object Detection Jiankang Deng, Shaoli Huang, Jing Yang, Hui Shuai, Zhengbo Yu, Zongguang Lu, Qiang Ma, Yali
R-FCN: Object Detection with Really - Friggin Convolutional Networks
R-FCN: Object Detection with Really - Friggin Convolutional Networks Jifeng Dai Microsoft Research Li Yi Tsinghua Univ. Kaiming He FAIR Jian Sun Microsoft Research NIPS, 2016 Or Region-based Fully Convolutional
Rich feature hierarchies for accurate object detection and semant
Rich feature hierarchies for accurate object detection and semantic segmentation Speaker: Yucong Shen 4/5/2018 Develop of Object Detection 1 DPM (Deformable parts models) 2 R-CNN 3 Fast R-CNN 4 Faster
Rich feature hierarchies for accurate object detection and semantic segmentation
Rich feature hierarchies for accurate object detection and semantic segmentation Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik Presented by Pandian Raju and Jialin Wu Last class SGD for Document
CS6501: Deep Learning for Visual Recognition. Object Detection I: RCNN, Fast-RCNN, Faster-RCNN
CS6501: Deep Learning for Visual Recognition Object Detection I: RCNN, Fast-RCNN, Faster-RCNN Today s Class Object Detection The RCNN Object Detector (2014) The Fast RCNN Object Detector (2015) The Faster
Optimizing Object Detection:
Lecture 10: Optimizing Object Detection: A Case Study of R-CNN, Fast R-CNN, and Faster R-CNN Visual Computing Systems Today s task: object detection Image classification: what is the object in this image?
Flow-Based Video Recognition
Flow-Based Video Recognition Jifeng Dai Visual Computing Group, Microsoft Research Asia Joint work with Xizhou Zhu*, Yuwen Xiong*, Yujie Wang*, Lu Yuan and Yichen Wei (* interns) Talk pipeline Introduction
Advanced Video Analysis & Imaging
Advanced Video Analysis & Imaging (5LSH0), Module 09B Machine Learning with Convolutional Neural Networks (CNNs) - Workout Farhad G. Zanjani, Clint Sebastian, Egor Bondarev, Peter H.N. de With ( p.h.n.de.with@tue.nl
YOLO 9000 TAEWAN KIM
YOLO 9000 TAEWAN KIM DNN-based Object Detection R-CNN MultiBox SPP-Net DeepID-Net NoC Fast R-CNN DeepBox MR-CNN 2013.11 Faster R-CNN YOLO AttentionNet DenseBox SSD Inside-OutsideNet(ION) G-CNN NIPS 15
Mind the regularized GAP, for human action classification and semi-supervised localization based on visual saliency.
Mind the regularized GAP, for human action classification and semi-supervised localization based on visual saliency. Marc Moreaux123, Natalia Lyubova1, Isabelle Ferrane 2 and Frederic Lerasle3 1 Softbank
Fine-tuning Pre-trained Large Scaled ImageNet model on smaller dataset for Detection task
Fine-tuning Pre-trained Large Scaled ImageNet model on smaller dataset for Detection task Kyunghee Kim Stanford University 353 Serra Mall Stanford, CA 94305 kyunghee.kim@stanford.edu Abstract We use a
Webly Supervised Semantic Segmentation
Webly Supervised Semantic Segmentation Bin Jin IC, EPFL bin.jin@epfl.ch Maria V. Ortiz Segovia Océ Print Logic Technologies Maria.Ortiz@oce.com Sabine Süsstrunk IC, EPFL sabine.susstrunk@epfl.ch Abstract
PASCAL VOC Classification: Local Features vs. Deep Features. Shuicheng YAN, NUS
PASCAL VOC Classification: Local Features vs. Deep Features Shuicheng YAN, NUS PASCAL VOC Why valuable? Multi-label, Real Scenarios! Visual Object Recognition Object Classification Object Detection Object
TS 2 C: Tight Box Mining with Surrounding Segmentation Context for Weakly Supervised Object Detection
TS 2 C: Tight Box Mining with Surrounding Segmentation Context for Weakly Supervised Object Detection Yunchao Wei 1, Zhiqiang Shen 1,2, Bowen Cheng 1, Honghui Shi 3, Jinjun Xiong 3, Jiashi Feng 4, and
Learning Deep Structured Models for Semantic Segmentation. Guosheng Lin
Learning Deep Structured Models for Semantic Segmentation Guosheng Lin Semantic Segmentation Outline Exploring Context with Deep Structured Models Guosheng Lin, Chunhua Shen, Ian Reid, Anton van dan Hengel;
3 Object Detection. BVM 2018 Tutorial: Advanced Deep Learning Methods. Paul F. Jaeger, Division of Medical Image Computing
3 Object Detection BVM 2018 Tutorial: Advanced Deep Learning Methods Paul F. Jaeger, of Medical Image Computing What is object detection? classification segmentation obj. detection (1 label per pixel)
arxiv: v1 [cs.cv] 13 Jul 2018
![arxiv: v1 [cs.cv] 13 Jul 2018](/thumbs/93/114369399.jpg "arxiv: v1 [cs.cv] 13 Jul 2018")
arxiv:1807.04897v1 [cs.cv] 13 Jul 2018 TS 2 C: Tight Box Mining with Surrounding Segmentation Context for Weakly Supervised Object Detection Yunchao Wei 1, Zhiqiang Shen 1,2, Bowen Cheng 1, Honghui Shi
Regionlet Object Detector with Hand-crafted and CNN Feature
Regionlet Object Detector with Hand-crafted and CNN Feature Xiaoyu Wang Research Xiaoyu Wang Research Ming Yang Horizon Robotics Shenghuo Zhu Alibaba Group Yuanqing Lin Baidu Overview of this section Regionlet
Human Pose Estimation with Deep Learning. Wei Yang
Human Pose Estimation with Deep Learning Wei Yang Applications Understand Activities Family Robots American Heist (2014) - The Bank Robbery Scene 2 What do we need to know to recognize a crime scene? 3
SEMANTIC SEGMENTATION AVIRAM BAR HAIM & IRIS TAL
SEMANTIC SEGMENTATION AVIRAM BAR HAIM & IRIS TAL IMAGE DESCRIPTIONS IN THE WILD (IDW-CNN) LARGE KERNEL MATTERS (GCN) DEEP LEARNING SEMINAR, TAU NOVEMBER 2017 TOPICS IDW-CNN: Improving Semantic Segmentation
Deep learning for dense per-pixel prediction. Chunhua Shen The University of Adelaide, Australia
Deep learning for dense per-pixel prediction Chunhua Shen The University of Adelaide, Australia Image understanding Classification error Convolution Neural Networks 0.3 0.2 0.1 Image Classification [Krizhevsky
Encoder-Decoder Networks for Semantic Segmentation. Sachin Mehta
Encoder-Decoder Networks for Semantic Segmentation Sachin Mehta Outline > Overview of Semantic Segmentation > Encoder-Decoder Networks > Results What is Semantic Segmentation? Input: RGB Image Output:
Unsupervised Deep Learning. James Hays slides from Carl Doersch and Richard Zhang
Unsupervised Deep Learning James Hays slides from Carl Doersch and Richard Zhang Recap from Previous Lecture We saw two strategies to get structured output while using deep learning With object detection,
arxiv: v2 [cs.cv] 8 Apr 2018
![arxiv: v2 [cs.cv] 8 Apr 2018](/thumbs/86/94330536.jpg "arxiv: v2 [cs.cv] 8 Apr 2018")
Single-Shot Object Detection with Enriched Semantics Zhishuai Zhang 1 Siyuan Qiao 1 Cihang Xie 1 Wei Shen 1,2 Bo Wang 3 Alan L. Yuille 1 Johns Hopkins University 1 Shanghai University 2 Hikvision Research
CNN for Low Level Image Processing. Huanjing Yue
CNN for Low Level Image Processing Huanjing Yue 2017.11 1 Deep Learning for Image Restoration General formulation: min Θ L( x, x) s. t. x = F(y; Θ) Loss function Parameters to be learned Key issues The
Extend the shallow part of Single Shot MultiBox Detector via Convolutional Neural Network
Extend the shallow part of Single Shot MultiBox Detector via Convolutional Neural Network Liwen Zheng, Canmiao Fu, Yong Zhao * School of Electronic and Computer Engineering, Shenzhen Graduate School of
Semantic Segmentation
Semantic Segmentation UCLA:https://goo.gl/images/I0VTi2 OUTLINE Semantic Segmentation Why? Paper to talk about: Fully Convolutional Networks for Semantic Segmentation. J. Long, E. Shelhamer, and T. Darrell,
Binary Convolutional Neural Network on RRAM
Binary Convolutional Neural Network on RRAM Tianqi Tang, Lixue Xia, Boxun Li, Yu Wang, Huazhong Yang Dept. of E.E, Tsinghua National Laboratory for Information Science and Technology (TNList) Tsinghua
Category-level localization
Category-level localization Cordelia Schmid Recognition Classification Object present/absent in an image Often presence of a significant amount of background clutter Localization / Detection Localize object
Convolutional Neural Networks + Neural Style Transfer. Justin Johnson 2/1/2017
Convolutional Neural Networks + Neural Style Transfer Justin Johnson 2/1/2017 Outline Convolutional Neural Networks Convolution Pooling Feature Visualization Neural Style Transfer Feature Inversion Texture
Pixel Offset Regression (POR) for Single-shot Instance Segmentation
Pixel Offset Regression (POR) for Single-shot Instance Segmentation Yuezun Li 1, Xiao Bian 2, Ming-ching Chang 1, Longyin Wen 2 and Siwei Lyu 1 1 University at Albany, State University of New York, NY,
REGION AVERAGE POOLING FOR CONTEXT-AWARE OBJECT DETECTION
REGION AVERAGE POOLING FOR CONTEXT-AWARE OBJECT DETECTION Kingsley Kuan 1, Gaurav Manek 1, Jie Lin 1, Yuan Fang 1, Vijay Chandrasekhar 1,2 Institute for Infocomm Research, A*STAR, Singapore 1 Nanyang Technological
JOINT DETECTION AND SEGMENTATION WITH DEEP HIERARCHICAL NETWORKS. Zhao Chen Machine Learning Intern, NVIDIA
JOINT DETECTION AND SEGMENTATION WITH DEEP HIERARCHICAL NETWORKS Zhao Chen Machine Learning Intern, NVIDIA ABOUT ME 5th year PhD student in physics @ Stanford by day, deep learning computer vision scientist
arxiv: v1 [cs.cv] 6 Sep 2017
![arxiv: v1 [cs.cv] 6 Sep 2017](/thumbs/77/76246458.jpg "arxiv: v1 [cs.cv] 6 Sep 2017")
Soft Proposal Networks for Weakly Supervised Object Localization Yi Zhu 1, Yanzhao Zhou 1, Qixiang Ye 1, Qiang Qiu 2 and Jianbin Jiao 1 1 University of Chinese Academy of Sciences 2 Duke University {zhuyi215,
Segmentation and Shape Extraction from Convolutional Neural Networks
Segmentation and Shape Extraction from Convolutional Neural Networks Mai Lan Ha, Gianni Franchi, Michael Möller, Andreas Kolb, Volker Blanz University of Siegen, Germany {hamailan, blanz}@informatik.uni-siegen.de
Deep learning for object detection. Slides from Svetlana Lazebnik and many others
Deep learning for object detection Slides from Svetlana Lazebnik and many others Recent developments in object detection 80% PASCAL VOC mean0average0precision0(map) 70% 60% 50% 40% 30% 20% 10% Before deep
Exploiting noisy web data for largescale visual recognition
Exploiting noisy web data for largescale visual recognition Lamberto Ballan University of Padova, Italy CVPRW WebVision - Jul 26, 2017 Datasets drive computer vision progress ImageNet Slide credit: O.
RSRN: Rich Side-output Residual Network for Medial Axis Detection
RSRN: Rich Side-output Residual Network for Medial Axis Detection Chang Liu, Wei Ke, Jianbin Jiao, and Qixiang Ye University of Chinese Academy of Sciences, Beijing, China {liuchang615, kewei11}@mails.ucas.ac.cn,
Deep Learning For Video Classification. Presented by Natalie Carlebach & Gil Sharon
Deep Learning For Video Classification Presented by Natalie Carlebach & Gil Sharon Overview Of Presentation Motivation Challenges of video classification Common datasets 4 different methods presented in
WITH the recent advance [1] of deep convolutional neural
![WITH the recent advance [1] of deep convolutional neural](/thumbs/91/106774335.jpg "WITH the recent advance [1] of deep convolutional neural")
1 Action-Driven Object Detection with Top-Down Visual Attentions Donggeun Yoo, Student Member, IEEE, Sunggyun Park, Student Member, IEEE, Kyunghyun Paeng, Student Member, IEEE, Joon-Young Lee, Member,
Autoencoders. Stephen Scott. Introduction. Basic Idea. Stacked AE. Denoising AE. Sparse AE. Contractive AE. Variational AE GAN.
Stacked Denoising Sparse Variational (Adapted from Paul Quint and Ian Goodfellow) Stacked Denoising Sparse Variational Autoencoding is training a network to replicate its input to its output Applications:
RON: Reverse Connection with Objectness Prior Networks for Object Detection
RON: Reverse Connection with Objectness Prior Networks for Object Detection Tao Kong 1, Fuchun Sun 1, Anbang Yao 2, Huaping Liu 1, Ming Lu 3, Yurong Chen 2 1 Department of CST, Tsinghua University, 2 Intel
Computer Vision Lecture 16
Computer Vision Lecture 16 Deep Learning Applications 11.01.2017 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar registration period starts
Feature-Fused SSD: Fast Detection for Small Objects
Feature-Fused SSD: Fast Detection for Small Objects Guimei Cao, Xuemei Xie, Wenzhe Yang, Quan Liao, Guangming Shi, Jinjian Wu School of Electronic Engineering, Xidian University, China xmxie@mail.xidian.edu.cn
Single-Shot Refinement Neural Network for Object Detection -Supplementary Material-
Single-Shot Refinement Neural Network for Object Detection -Supplementary Material- Shifeng Zhang 1,2, Longyin Wen 3, Xiao Bian 3, Zhen Lei 1,2, Stan Z. Li 4,1,2 1 CBSR & NLPR, Institute of Automation,
Person Part Segmentation based on Weak Supervision
JIANG, CHI: PERSON PART SEGMENTATION BASED ON WEAK SUPERVISION 1 Person Part Segmentation based on Weak Supervision Yalong Jiang 1 yalong.jiang@connect.polyu.hk Zheru Chi 1 chi.zheru@polyu.edu.hk 1 Department
Semantic segmentation is a popular visual recognition task
Deep Learning for Visual Understanding Seunghoon Hong, Suha Kwak, and Bohyung Han Weakly Supervised Learning with Deep Convolutional Neural Networks for Semantic Segmentation Understanding semantic layout
Efficient Segmentation-Aided Text Detection For Intelligent Robots
Efficient Segmentation-Aided Text Detection For Intelligent Robots Junting Zhang, Yuewei Na, Siyang Li, C.-C. Jay Kuo University of Southern California Outline Problem Definition and Motivation Related
CNN Visualizations. Seoul AI Meetup Martin Kersner, 2018/01/06
CNN Visualizations Seoul AI Meetup Martin Kersner, 2018/01/06 Content 1. Visualization of convolutional weights from the first layer 2. Visualization of patterns learned by higher layers 3. Weakly Supervised
HIERARCHICAL JOINT-GUIDED NETWORKS FOR SEMANTIC IMAGE SEGMENTATION
HIERARCHICAL JOINT-GUIDED NETWORKS FOR SEMANTIC IMAGE SEGMENTATION Chien-Yao Wang, Jyun-Hong Li, Seksan Mathulaprangsan, Chin-Chin Chiang, and Jia-Ching Wang Department of Computer Science and Information
arxiv: v2 [cs.cv] 9 Apr 2018
![arxiv: v2 [cs.cv] 9 Apr 2018](/thumbs/86/94484701.jpg "arxiv: v2 [cs.cv] 9 Apr 2018")
Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation Jiwoon Ahn DGIST, Korea jyun@dgist.ac.kr Suha Kwak POSTECH, Korea suha.kwak@postech.ac.kr
Constrained-CNN losses for weakly supervised segmentation
Constrained-CNN losses for weakly supervised segmentation MIDL 2018, Amsterdam Hoel Kervadec*, Jose Dolz*, Meng Tang**, Éric Granger*, Yuri Boykov**, Ismail Ben Ayed* *ÉTS Montréal, **Univertisy of Waterloo
Proposal-free Network for Instance-level Object Segmentation
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. XX, NO. X, X 20XX 1 Proposal-free Network for Instance-level Object Segmentation Xiaodan Liang, Yunchao Wei, Xiaohui Shen, Jianchao
Object Detection on Self-Driving Cars in China. Lingyun Li
Object Detection on Self-Driving Cars in China Lingyun Li Introduction Motivation: Perception is the key of self-driving cars Data set: 10000 images with annotation 2000 images without annotation (not
Yield Estimation using faster R-CNN
Yield Estimation using faster R-CNN 1 Vidhya Sagar, 2 Sailesh J.Jain and 2 Arjun P. 1 Assistant Professor, 2 UG Scholar, Department of Computer Engineering and Science SRM Institute of Science and Technology,Chennai,
Xiaowei Hu* Lei Zhu* Chi-Wing Fu Jing Qin Pheng-Ann Heng
Direction-aware Spatial Context Features for Shadow Detection Xiaowei Hu* Lei Zhu* Chi-Wing Fu Jing Qin Pheng-Ann Heng The Chinese University of Hong Kong The Hong Kong Polytechnic University Shenzhen
Computer Vision Lecture 16
Announcements Computer Vision Lecture 16 Deep Learning Applications 11.01.2017 Seminar registration period starts on Friday We will offer a lab course in the summer semester Deep Robot Learning Topic:
Analysis: TextonBoost and Semantic Texton Forests. Daniel Munoz Februrary 9, 2009
Analysis: TextonBoost and Semantic Texton Forests Daniel Munoz 16-721 Februrary 9, 2009 Papers [shotton-eccv-06] J. Shotton, J. Winn, C. Rother, A. Criminisi, TextonBoost: Joint Appearance, Shape and Context
Computer Vision Lecture 16
Computer Vision Lecture 16 Deep Learning for Object Categorization 14.01.2016 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar registration period
Discovering Class-Specific Pixels for Weakly-Supervised Semantic Segmentation
CHAUDHRY ET AL.: DCSP 1 Discovering Class-Specific Pixels for Weakly-Supervised Semantic Segmentation Arslan Chaudhry arslan.chaudhry@eng.ox.ac.uk Puneet K. Dokania puneet@robots.ox.ac.uk Philip H.S. Torr
Predicting ground-level scene Layout from Aerial imagery. Muhammad Hasan Maqbool
Predicting ground-level scene Layout from Aerial imagery Muhammad Hasan Maqbool Objective Given the overhead image predict its ground level semantic segmentation Predicted ground level labeling Overhead/Aerial
Inception and Residual Networks. Hantao Zhang. Deep Learning with Python.
Inception and Residual Networks Hantao Zhang Deep Learning with Python https://en.wikipedia.org/wiki/residual_neural_network Deep Neural Network Progress from Large Scale Visual Recognition Challenge (ILSVRC)
Content-Based Image Recovery
Content-Based Image Recovery Hong-Yu Zhou and Jianxin Wu National Key Laboratory for Novel Software Technology Nanjing University, China zhouhy@lamda.nju.edu.cn wujx2001@nju.edu.cn Abstract. We propose
Deep Learning for Embedded Security Evaluation
Deep Learning for Embedded Security Evaluation Emmanuel Prouff 1 1 Laboratoire de Sécurité des Composants, ANSSI, France April 2018, CISCO April 2018, CISCO E. Prouff 1/22 Contents 1. Context and Motivation
arxiv: v1 [cs.cv] 24 May 2016
![arxiv: v1 [cs.cv] 24 May 2016](/thumbs/80/80473828.jpg "arxiv: v1 [cs.cv] 24 May 2016")
Dense CNN Learning with Equivalent Mappings arxiv:1605.07251v1 [cs.cv] 24 May 2016 Jianxin Wu Chen-Wei Xie Jian-Hao Luo National Key Laboratory for Novel Software Technology, Nanjing University 163 Xianlin
arxiv: v1 [cs.cv] 20 Dec 2016
![arxiv: v1 [cs.cv] 20 Dec 2016](/thumbs/73/68905842.jpg "arxiv: v1 [cs.cv] 20 Dec 2016")
End-to-End Pedestrian Collision Warning System based on a Convolutional Neural Network with Semantic Segmentation arxiv:1612.06558v1 [cs.cv] 20 Dec 2016 Heechul Jung heechul@dgist.ac.kr Min-Kook Choi mkchoi@dgist.ac.kr
Deep Residual Learning
Deep Residual Learning MSRA @ ILSVRC & COCO 2015 competitions Kaiming He with Xiangyu Zhang, Shaoqing Ren, Jifeng Dai, & Jian Sun Microsoft Research Asia (MSRA) MSRA @ ILSVRC & COCO 2015 Competitions 1st
Lecture 5: Object Detection
Object Detection CSED703R: Deep Learning for Visual Recognition (2017F) Lecture 5: Object Detection Bohyung Han Computer Vision Lab. bhhan@postech.ac.kr 2 Traditional Object Detection Algorithms Region-based
Multiple Instance Detection Network with Online Instance Classifier Refinement
1 Multiple Instance Detection Network with Online Instance Classifier Refinement Peng Tang pengtang@hust.edu.cn Weakly-supervised visual learning (WSVL) 2 Weakly-supervised visual learning is a new trend
Object detection using Region Proposals (RCNN) Ernest Cheung COMP Presentation
Object detection using Region Proposals (RCNN) Ernest Cheung COMP790-125 Presentation 1 2 Problem to solve Object detection Input: Image Output: Bounding box of the object 3 Object detection using CNN
Deep Learning for Object detection & localization
Deep Learning for Object detection & localization RCNN, Fast RCNN, Faster RCNN, YOLO, GAP, CAM, MSROI Aaditya Prakash Sep 25, 2018 Image classification Image classification Whole of image is classified
Deconvolutions in Convolutional Neural Networks
Overview Deconvolutions in Convolutional Neural Networks Bohyung Han bhhan@postech.ac.kr Computer Vision Lab. Convolutional Neural Networks (CNNs) Deconvolutions in CNNs Applications Network visualization
THE superior performance of convolutional neural networks
A Taught-Obesrve-Ask (TOA) Method for Object Detection with Critical Supervision Chi-Hao Wu, Qin Huang, Siyang Li, and C.-C. Jay Kuo, Fellow, IEEE 1 arxiv:1711.01043v1 [cs.cv] 3 Nov 2017 Abstract Being
Segmentation as Selective Search for Object Recognition in ILSVRC2011
Segmentation as Selective Search for Object Recognition in ILSVRC2011 Koen van de Sande Jasper Uijlings Arnold Smeulders Theo Gevers Nicu Sebe Cees Snoek University of Amsterdam, University of Trento ILSVRC2011
Progress in Computer Vision in the Last Decade & Open Problems: People Detection & Human Pose Estimation
Progress in Computer Vision in the Last Decade & Open Problems: People Detection & Human Pose Estimation Bernt Schiele Max Planck Institute for Informatics & Saarland University, Saarland Informatics Campus
arxiv: v3 [cs.cv] 13 Apr 2016 Abstract
![arxiv: v3 [cs.cv] 13 Apr 2016 Abstract](/thumbs/94/121926594.jpg "arxiv: v3 [cs.cv] 13 Apr 2016 Abstract")
ProNet: Learning to Propose Object-specific Boxes for Cascaded Neural Networks Chen Sun 1,2 Manohar Paluri 2 Ronan Collobert 2 Ram Nevatia 1 Lubomir Bourdev 3 1 USC 2 Facebook AI Research 3 UC Berkeley
PARTIAL STYLE TRANSFER USING WEAKLY SUPERVISED SEMANTIC SEGMENTATION. Shin Matsuo Wataru Shimoda Keiji Yanai
PARTIAL STYLE TRANSFER USING WEAKLY SUPERVISED SEMANTIC SEGMENTATION Shin Matsuo Wataru Shimoda Keiji Yanai Department of Informatics, The University of Electro-Communications, Tokyo 1-5-1 Chofugaoka,
Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture David Eigen, Rob Fergus
Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture David Eigen, Rob Fergus Presented by: Rex Ying and Charles Qi Input: A Single RGB Image Estimate
Instance-aware Semantic Segmentation via Multi-task Network Cascades
Instance-aware Semantic Segmentation via Multi-task Network Cascades Jifeng Dai, Kaiming He, Jian Sun Microsoft research 2016 Yotam Gil Amit Nativ Agenda Introduction Highlights Implementation Further