NeoNet: Object centric training for image recognition
|
|
- Berenice Baker
- 6 years ago
- Views:
Transcription
1 Daniel Fontijne, Koen E. A. van de Sande, Eren Gölge, R. Blythe Towal, Anthony Sarah, Cees G. M. Snoek Qualcomm Technologies, Inc., December 17, 2015 NeoNet: Object centric training for image recognition Presented by: Daniel Fontijne Senior Staff Engineer 1
2 Summary Score Ranking Classification Localization Detection Places Key component: object centric training 2
3 Foundation Classification Localization Detection Places 2 Agenda 3
4 Ioffe & Szegedy ICML 2015 Foundation: Batch-normalized inception The base network for all our submissions is the inception network as introduced in the batch normalization paper by Ioffe & Szegedy. 4
5 Lin et al. ICLR 2014 Network in an inception module Note: the 5x5 path is not used. 5
6 Foundation Classification Localization Detection Places 2 Agenda 6
7 Classification overview Ensemble of 12 networks Train really long, 350 epochs. Randomized RELU. Test at 14 scales, 10 crops. Object preserving crops. Xu et al. ICML workshop
8 Quiz: What is this? 8
9 Answer: Flower 9
10 Quiz: In case you got that right, what is this? 10
11 Answer: Butterfly 11
12 Object preserving crops Random crop selection might miss the object of interest. Network tries to remember butterfly when presented with leaves. Solution: use provided boxes to assure crop contains the object. For images without box annotation, use best box predicted by localization system. X 12
13 Component breakdown Epochs Single view Multi-view First attempt at inception + batch norm % 6.58% Train ~325 epochs % 6.34% 32 images / mini-batch % 6.68% Object preserving, 32 images/mini-batch % 6.51% Object preserving with generated boxes % 6.46% Ensemble of % 13
14 Final classification results Top-5 classification error on test set MSRA ReCeption Trimps-Soushen NeoNet Ioffe & Szegedy, ICML '15 GoogLeNet ('14) Clarifai ('13) SuperVision ('12) NeoNet is competitive on object classification 14
15 Foundation Classification Localization Detection Places 2 Agenda 15
16 Localization overview Foundations. Generate box proposals using fast selective search. Train box-classification networks on crops. Uijlings et al. IJCV 2013 Girshik et al. PAMI 2016 Object centric training. Object pre-training network. Object localization network. Object alignment network. 16
17 Object centric pre-training Use the bounding box annotations for pre-training. Increase the number of classes from N to 2*N+1: N classes for the object, well-framed. N classes for partially framed objects. 1 class for background, i.e., object not visible. 1% 1.5% improvement compared to standard pre-training. 17
18 Object centric pre-training Dual-head network to account for missing bounding boxes. One with 1000 outputs. One with 2001 outputs. No error gradient when box annotation is missing. 18
19 Object localization network Fully connected layer on top of Inception 4e and 5b. Re-train Inception 5b and new head. Then fine-tune entire network. 19
20 Quiz: Is this an entire skyscraper? 20
21 Bordering the object A 40% border worked best. Such that in 7x7 resolution of Inception 5b there is a 1 pixel border. 21
22 Object alignment network Extra head for object box alignment. Classification head is also used, but with cross entropy cost. 22
23 Object alignment border Object box alignment moves corners up to 50% of the width and height. 100% border allows network to see full range of possible alignments. ~2% gain. 23
24 Component breakdown Top-5 localization error First attempt 24.0% 40% border, FC on top of inception 5b 22.5% FC on top of inception 5b+4e 21.8% Object centric pre-training 20.3% Ensemble of % Object alignment 15.5% Final result with ILSVRC blacklist applied 14.5% 24
25 Final localization results Top-5 localization error on test set MSRA 9.0 Trimps-Soushen NeoNet VGG ('14) 25.3 OverFeat ('13) 30.0 SuperVision ('12) 34.2 UvA ('11) NeoNet is competitive on object localization 25
26 Foundation Classification Localization Detection Places 2 Agenda 26
27 Improved selective search Fast Improved Color spaces 2 3 Segmentations 2 4 Similarity functions 2 4 Average boxes 1,600 5,000 MABO Time (s) map
28 Object detection network Five inception-style networks for feature extraction Two trained on 1,000 object classes, no input border, fine-tuning on detection boxes Three trained on 1,000 object windows with input border, no fine tuning 28
29 Component breakdown map on validation set Best object class network 44.6 Best object centric network 47.7 Ensemble of
30 Component breakdown map on validation set Best object class network 44.6 Best object centric network 47.7 Ensemble of context 53.2 Four classification networks fine tuned with 200 detection class labels 30
31 Component breakdown map on validation set Best object class network 44.6 Best object centric network 47.7 Ensemble of context object alignment
32 Final detection results Mean average precision on test set MSRA 62.1 NeoNet Deep-ID Net GoogLeNet ('14) 43.9 UvA/Euvision ('13) NeoNet is competitive on object detection 32
33 Foundation Classification Localization Detection Places 2 Agenda 33
34 Places 2 overview Our best submission: an ensemble of two inception nets. Reduce fully connected layer from 1,000 to 401 outputs. Use pre-trained weights from ImageNet 1,000 (~325 epochs). Train Inception 5b and fully connected layer for two epochs. Fine-tune entire network for eight epochs. Adding other networks reduced the accuracy 34
35 Component breakdown (top-5 error) Single view Multi view ~325 epochs pre-training 17.9% 16.8% First attempt. 112 epochs pre-training. 19.1% 17.9% 512 channel 5b, Alex-style FC head 20.0% 18.4% 32 images / batch 18.7% 17.6% Randomized RELU 18.2% 17.5% Ensemble of % Ensemble of % 35
36 Final places 2 results Top-5 classification error on test set WM SIAT_MMLAB NeoNet Trimps-Soushen ntu_rose MERL HiVision NeoNet is competitive on scene classification 36
37 On device recognition at 18 ms 37
38 Summary Score Ranking Classification Localization Detection Places Key component: object centric training 38
39 Thank you Follow us on: For more information on Qualcomm, visit us at: & Nothing in these materials is an offer to sell any of the components or devices referenced herein Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved. Qualcomm and Snapdragon are trademarks of Qualcomm Incorporated, registered in the United States and other countries. Zeroth is a trademark of Qualcomm Incorporated. Other products and brand names may be trademarks or registered trademarks of their respective owners. References in this presentation to Qualcomm may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm s engineering, research and development functions, and substantially all of its product and services businesses, including its semiconductor business, QCT. 39
Snapdragon NPE Overview
March 2018 Linaro Connect Hong Kong Snapdragon NPE Overview Mark Charlebois Director, Engineering Qualcomm Technologies, Inc. Caffe2 Snapdragon Neural Processing Engine Efficient execution on Snapdragon
More information802.11ax: Meeting the demands of modern networks. Gopi Sirineni, Vice President Qualcomm Technologies, Inc. April 19,
802.11ax: Meeting the demands of modern networks Gopi Sirineni, Vice President Qualcomm Technologies, Inc. April 19, 2017 @qualcomm The Wi-Fi landscape has changed More devices & data Diverse apps & services
More informationInception and Residual Networks. Hantao Zhang. Deep Learning with Python.
Inception and Residual Networks Hantao Zhang Deep Learning with Python https://en.wikipedia.org/wiki/residual_neural_network Deep Neural Network Progress from Large Scale Visual Recognition Challenge (ILSVRC)
More informationConvolutional Neural Networks
NPFL114, Lecture 4 Convolutional Neural Networks Milan Straka March 25, 2019 Charles University in Prague Faculty of Mathematics and Physics Institute of Formal and Applied Linguistics unless otherwise
More informationDate: 13 June Location: Sophia Antipolis. Integrating the SIM. Dr. Adrian Escott. Qualcomm Technologies, Inc.
Date: 13 June 2018 @qualcomm Location: Sophia Antipolis Integrating the SIM Dr. Adrian Escott Qualcomm Technologies, Inc. Agenda 1 2 3 4 5 6 Path to isim isim Size benefit Hardware Architecture Certification
More informationA New Foundation for the Connected Home. Qualcomm Technologies, Inc. June
A New Foundation for the Connected Home Qualcomm Technologies, Inc. June 2017 @qualcomm The connected home is evolving at a breakneck pace Number of connected devices per home (family of four) 50 24 8
More informationMaking always-on vision a reality. Dr. Evgeni Gousev Sr. Director, Engineering Qualcomm Technologies, Inc. September 22,
Making always-on vision a reality Dr. Evgeni Gousev Sr. Director, Engineering Qualcomm Technologies, Inc. September 22, 2017 @qualcomm Outline 1. Problem statement Challenges to develop always-on vision
More informationThe Future of Mobility. Keith Kressin Senior Vice President, Product Management Qualcomm Technologies,
The Future of Mobility Keith Kressin Senior Vice President, Product Management Qualcomm Technologies, Inc. @qualcomm The future of mobility Path to 5G extended Reality Artificial Intelligence Trends Evolution
More informationLeading the world to 5G
June 28, 2018 @5GwirelessEDGE Shanghai, China Leading the world to 5G Serge Willenegger SVP & GM, 5G & Industrial IoT Qualcomm Wireless GmbH A unifying connectivity platform to drive growth and innovation
More informationPreparing for Mass Market Virtual Reality: A Mobile Perspective. Qualcomm Technologies, Inc. September 16, 2017
Preparing for Mass Market Virtual Reality: A Mobile Perspective Qualcomm Technologies, Inc. September 16, 2017 Immersive Always-connected VR is meant to be Mobile 2 Automotive video streaming Crowded event
More informationMobile: the foundation of the digital economy
Mobile: the foundation of the digital economy Cristiano Amon Executive Vice President, Qualcomm Technologies, Inc. and President, Qualcomm CDMA Technologies @cristianoamon 1 Mobile technology is powering
More informationMaking XR a reality for everyone
May 29, 2018 @qualcomm Augmented World Expo Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management Qualcomm Technologies,
More informationITU Workshop Combating grey devices. Audrey Scozzaro Ferrazzini Standardisation and Industrial Policy Lead, EMENA Government Affairs 28 June 2016
ITU Workshop Combating grey devices Audrey Scozzaro Ferrazzini Standardisation and Industrial Policy Lead, EMENA Government Affairs 28 June 2016 Security solutions Qualcomm s vision Theft Deterrence Enterprise
More informationPerform. Travis Lanier Sr. Director, Product Management Qualcomm Technologies,
Perform Travis Lanier Sr. Director, Product Management Qualcomm Technologies, Inc. @qualcomm More powerful and longer lasting mobile experiences Because nobody wants to be this person U.K. U.S. Germany
More informationRISC-V: Opportunities and Challenges in SoCs
December 5, 2018 @qualcomm Santa Clara, CA RISC-V: Opportunities and Challenges in SoCs Greg Wright Sr Director, Engineering Qualcomm Technologies, Inc. Introductions Who am I? Why am I here? 2 Quick tour
More information2016 Seoul DevU Pipeline Cache Object. Bill Licea-Kane Engineer, Senior Staff Qualcomm Technologies, Inc
2016 Seoul DevU Pipeline Cache Object Bill Licea-Kane Engineer, Senior Staff Qualcomm Technologies, Inc. 2016-10-21 Our application requires many many many Pipeline State Objects. Creation time is a huge
More informationGlobal 5G spectrum update
Global 5G spectrum update Luigi Ardito Director, Government Affairs Qualcomm Incorporated European Commission driving a Gigabit Society 1 Deploying 5G across Europe by 2020 with pre-commercial trials starting
More informationIoT with 5G Technology
July 25 th, 2018 Innofest ID 2018 Jakarta, Indonesia IoT with 5G Technology Transformation for Industrial 4.0 Shannedy Ong Country Director Indonesia Leading mobile innovation for over 30 years Digitized
More informationImmersion. Tim Leland Vice President, Product Management Qualcomm Technologies,
Immersion Tim Leland Vice President, Product Management Qualcomm Technologies, Inc. @qualcomm Capturing life experiences and extending Realities Capture Color is a power which directly influences the soul
More informationInnovative Wireless Technologies for Mobile Broadband
Innovative Wireless Technologies for Mobile Broadband RRS-17-Africa Forum - WRC 19 Agenda : Challenges and Opportunities for Africa Emerging Innovative Technologies Dakar, Senegal, 31 March, 2017 Qualcomm
More informationBringing link-time optimization to the embedded world: (Thin)LTO with Linker Scripts
Bringing link-time optimization to the embedded world: (Thin)LTO with Linker Scripts Tobias Edler von Koch, Sergei Larin, Shankar Easwaran, Hemant Kulkarni Qualcomm Innovation Center, Inc. What is a linker
More informationMachine Learning for Selected SI & PI Problems. Timothy Michalka Sr. Director, Engineering Qualcomm Technologies, Inc. 18-Oct-2017
Machine Learning for Selected SI & PI Problems Timothy Michalka Sr. Director, Engineering Qualcomm Technologies, Inc. 18-Oct-2017 1 Outline ML @ Qualcomm Technologies, Inc. SI & PI project interests 2
More informationUltra-low Power Always-On Computer Vision
March 20, 2019 @qualcomm_tech Sunnyvale, California Ultra-low Power Always-On Computer Vision Edwin Park Principal Engineer Qualcomm Artificial Intelligence (AI) Research Qualcomm Technologies, Inc. Qualcomm
More informationMaking 5G NR a reality
Making 5G NR a reality Silicon Valley 5G Summit Mountain View, CA October 19 th, 2017 Tingfang Ji Senior Director, Engineering Qualcomm Technologies, Inc. @qualcomm_tech NR Designing a unified, more capable
More informationHow Qualcomm Wireless Reach M&E Catalyzes SGBs. Lauren H Reed Staff Analyst Government Affairs 1
How Qualcomm Wireless Reach M&E Catalyzes SGBs Lauren H Reed Staff Analyst Government Affairs 1 30 #1 years of driving the evolution of wireless fabless semiconductor company #1 #1 in 3G/4G LTE modem in
More information5 GHz for consumers. Guillaume Lebrun Director 7 th June 2016
5 GHz for consumers Guillaume Lebrun Director 7 th June 2016 More data to more devices in more places ~75% 25-50B Mobile traffic that will be rich content & video 1 by 2020 Connected devices 2 and IoT
More information5G Spectrum Access. Wassim Chourbaji. Vice President, Government Affairs and Public Policy EMEA Qualcomm Technologies Inc.
5G Spectrum Access Wassim Chourbaji Vice President, Government Affairs and Public Policy EMEA Qualcomm Technologies Inc. @WassimChourbaji Pioneering 5G bands for Europe A unifying connectivity fabric Always-available,
More informationOpen Source and Standards: A Proposal for Collaboration
ETSI Workshop on Open Source and ization: Legal Interactions September 16, 2016 Sophia Antipolis Open Source and s: A Proposal for Collaboration David Marr VP & Legal Counsel Open Source Group Qualcomm
More informationImpact of the current LLVM inlining strategy on complex embedded application memory utilization and performance
Impact of the current LLVM inlining strategy on complex embedded application memory utilization and performance Sergei Larin Senior Staff Engineer, Harsha Jagasia Staff Engineer, Tobias Edler von Koch
More informationCSR102x Starter Development Kit
CSR102x Starter Development Kit Bluetooth Low Energy Single Mode SoC CSR102x is a product of Qualcomm Technologies International, Ltd. Qualcomm Bluetooth Low Energy Terminology clarification In this document
More informationQualcomm Snapdragon Technologies
March 2018 Game Developer Conference (GDC) Qualcomm Snapdragon Technologies Hiren Bhinde, Director, XR Product Management Qualcomm Technologies, Inc. Qualcomm Technologies announcements & updates Snapdragon
More informationITU-R Handbook on Global Trends in IMT
1 Dr. Bienvenu AGBOKPONTO SOGLO Gov t Affairs Director, West and Central Africa ITU-R Handbook on Global Trends in IMT ATU Workshop on Implementation of WRC-15 Outcomes and Capacity Building on Development
More informationEnabling and Optimizing MariaDB on Qualcomm Centriq 2400 Arm-based Servers
Enabling and Optimizing MariaDB on Qualcomm Centriq 2400 Arm-based Servers World s First 10nm Server Processor Sandeep Sethia Staff Engineer Qualcomm Datacenter Technologies, Inc. February 25, 2018 MariaDB
More informationQualcomm Snapdragon 450 Mobile Platform
Qualcomm Snapdragon 450 Mobile Platform Kedar Kondap Vice President, Product Management Qualcomm Technologies, Inc. Snapdragon 400 Tier @qualcomm Qualcomm Snapdragon is a product of Qualcomm Technologies,
More informationConvolutional Neural Networks. Computer Vision Jia-Bin Huang, Virginia Tech
Convolutional Neural Networks Computer Vision Jia-Bin Huang, Virginia Tech Today s class Overview Convolutional Neural Network (CNN) Training CNN Understanding and Visualizing CNN Image Categorization:
More informationMobile technology: A catalyst for change. Kedar Kondap Vice President, Product Management Qualcomm Technologies, Inc.
Mobile technology: A catalyst for change Kedar Kondap Vice President, Product Management Qualcomm Technologies, Inc. Evolution of Wireless 384 kbps 21 Mbps 150 Mbps 2G Digital voice D-AMPS, GSM, IS-95
More informationUvA-DARE (Digital Academic Repository)
UvA-DARE (Digital Academic Repository) Qualcomm Research and University of Amsterdam at TRECVID 215: Recognizing Concepts, s, and Events in Video Snoek, C.G.M.; Cappallo, S.H.; Fontijne, D.H.F.; Julian,
More informationWelcome to the 5G age
Welcome to the 5G age Cristiano Amon Executive Vice President, Qualcomm Technologies, Inc. and President, Qualcomm CDMA Technologies October 2017 @cristianoamon Mobile technology is powering the global
More informationStructured Prediction using Convolutional Neural Networks
Overview Structured Prediction using Convolutional Neural Networks Bohyung Han bhhan@postech.ac.kr Computer Vision Lab. Convolutional Neural Networks (CNNs) Structured predictions for low level computer
More information5G Design and Technology. Durga Malladi SVP Engineering Qualcomm Technologies, Inc. October 19 th, 2016
5G Design and Technology Durga Malladi SVP Engineering Qualcomm Technologies, Inc. October 19 th, 2016 Mobile fueled the last 30 years interconnecting people 1980s Analog voice 1990s Digital voice 2000s
More informationMaking 5G NR a commercial reality
Making 5G NR a commercial reality Ultra-high fidelity media anywhere Immersive entertainment Safer, more autonomous transportation Connectivity is the new Electricity Reliable access to remote healthcare
More informationTowards 5G NR Commercialization
Towards 5G NR Commercialization Accelerating 5G NR for Enhanced Mobile Broadband May 25 2017 5G NR will deliver new levels of capability and efficiency For enhanced mobile broadband and beyond Multi-Gigabit
More informationMaking Mobile 5G a Commercial Reality. Peter Carson Senior Director Product Marketing Qualcomm Technologies, Inc.
Making Mobile 5G a Commercial Reality Peter Carson Senior Director Product Marketing Qualcomm Technologies, Inc. Insatiable global data demand First phase of 5G NR will focus on enhanced MBB Enhanced mobile
More informationSpatial Localization and Detection. Lecture 8-1
Lecture 8: Spatial Localization and Detection Lecture 8-1 Administrative - Project Proposals were due on Saturday Homework 2 due Friday 2/5 Homework 1 grades out this week Midterm will be in-class on Wednesday
More informationLeading the World to 5G NR
Leading the World to 5G NR Luigi Ardito Director Government Affairs, 5G Policy Lead Qualcomm Europe Inc. September 2017 Global snapshot of 5G spectrum Around the world, these bands have been allocated
More informationMachine Learning. Deep Learning. Eric Xing (and Pengtao Xie) , Fall Lecture 8, October 6, Eric CMU,
Machine Learning 10-701, Fall 2015 Deep Learning Eric Xing (and Pengtao Xie) Lecture 8, October 6, 2015 Eric Xing @ CMU, 2015 1 A perennial challenge in computer vision: feature engineering SIFT Spin image
More informationHeterogeneous Computing Made Easy:
Heterogeneous Computing Made Easy: Qualcomm Symphony System Manager SDK Wenjia Ruan Sr. Engineer, Advanced Content Group Qualcomm Technologies, Inc. May 2017 Qualcomm Symphony System Manager SDK is a product
More information5G and Automotive Cellular Vehicle-to-Everything (C-V2X) March 2017
5G and Automotive Cellular Vehicle-to-Everything (C-V2X) March 2017 Our vision for the autonomous vehicle of the future Intelligently connected Efficiently shared Increasingly electric Increasingly autonomous
More informationJapan. December 13, C-V2X Trial in Japan. Qualcomm Technologies Inc.
December 13, 2018 Japan C-V2X Trial in Japan Qualcomm Technologies Inc. Continental, Ericsson, Nissan, NTT DOCOMO, OKI, Qualcomm Technologies 2 Trial objectives The objective is to validate and demonstrate
More informationSpectrum for 4G and 5G. Qualcomm Technologies, Inc. October, 2016
Spectrum for 4G and 5G Qualcomm Technologies, Inc. October, 2016 New spectrum sharing paradigms opportunity to innovate Using all spectrum: low-band, mid-band, & high-band for mobile broadband Licensed
More informationFuture Networked Car Geneva Auto Show 2018
March 8, 2018 Geneva, Switzerland Future Networked Car Symposium @ Geneva Auto Show 2018 Accelerating 5G for autonomous driving Jason Ellis Qualcomm - Automotive Director, Business Development for Connected
More informationDeconvolutions in Convolutional Neural Networks
Overview Deconvolutions in Convolutional Neural Networks Bohyung Han bhhan@postech.ac.kr Computer Vision Lab. Convolutional Neural Networks (CNNs) Deconvolutions in CNNs Applications Network visualization
More informationEmerging Vision Technologies: Enabling a New Era of Intelligent Devices
Emerging Vision Technologies: Enabling a New Era of Intelligent Devices Computer vision overview Computer vision is being integrated in our daily lives Acquiring, processing, and understanding visual data
More informationNovember, Qualcomm s 5G vision Qualcomm Technologies, Inc. and/or its affiliates.
November, 2014 Qualcomm s 5G vision 1 Mobile is the largest technology platform in history ~7 billion connections, almost as many as people on earth 1 Evolving into Internet of Everything: cars, meters,
More informationSanjeev Athalye, Sr. Director, Product Management Qualcomm Technologies, Inc.
Sanjeev Athalye, Sr. Director, Product Management Qualcomm Technologies, Inc. This presentation addresses potential use cases and views on characteristics of 5G technology and is not intended to reflect
More informationQualcomm WiPower Flexible Wireless Charging
Geoff Gordon Staff Manager, Marketing Qualcomm Incorporated Qualcomm WiPower Flexible Wireless Charging Qualcomm WiPower wireless charging technology is licensed by Qualcomm Incorporated. Qualcomm WiPower
More informationCNNS FROM THE BASICS TO RECENT ADVANCES. Dmytro Mishkin Center for Machine Perception Czech Technical University in Prague
CNNS FROM THE BASICS TO RECENT ADVANCES Dmytro Mishkin Center for Machine Perception Czech Technical University in Prague ducha.aiki@gmail.com OUTLINE Short review of the CNN design Architecture progress
More information11. Neural Network Regularization
11. Neural Network Regularization CS 519 Deep Learning, Winter 2016 Fuxin Li With materials from Andrej Karpathy, Zsolt Kira Preventing overfitting Approach 1: Get more data! Always best if possible! If
More informationFine-tuning Pre-trained Large Scaled ImageNet model on smaller dataset for Detection task
Fine-tuning Pre-trained Large Scaled ImageNet model on smaller dataset for Detection task Kyunghee Kim Stanford University 353 Serra Mall Stanford, CA 94305 kyunghee.kim@stanford.edu Abstract We use a
More informationMaking 5G NR a reality
Making 5G NR a reality Laurent Fournier Sr. Director Technology Development Europe Qualcomm Technologies, Inc. November 17, 2016 DigiWorld Congress Scalability to address diverse service and devices Ultra-low
More informationYiqi Yan. May 10, 2017
Yiqi Yan May 10, 2017 P a r t I F u n d a m e n t a l B a c k g r o u n d s Convolution Single Filter Multiple Filters 3 Convolution: case study, 2 filters 4 Convolution: receptive field receptive field
More informationKnow your data - many types of networks
Architectures Know your data - many types of networks Fixed length representation Variable length representation Online video sequences, or samples of different sizes Images Specific architectures for
More informationDeep Learning Explained Module 4: Convolution Neural Networks (CNN or Conv Nets)
Deep Learning Explained Module 4: Convolution Neural Networks (CNN or Conv Nets) Sayan D. Pathak, Ph.D., Principal ML Scientist, Microsoft Roland Fernandez, Senior Researcher, Microsoft Module Outline
More informationThe Mobile Future of extended Reality (XR) Hugo Swart Senior Director, Product Management Qualcomm Technologies, Inc.
The Mobile Future of extended Reality (XR) Hugo Swart Senior Director, Product Management Qualcomm Technologies, Inc. June 29, 2017 XR is the future Industrial & manufacturing Engineering Healthcare M
More informationThe promise of higher spectrum bands for 5G. Rasmus Hellberg PhD Senior Director, Technical Marketing Qualcomm Technologies, Inc.
The promise of higher spectrum bands for 5G Rasmus Hellberg PhD Senior Director, Technical Marketing Qualcomm Technologies, Inc. June 30, 2016 Our 5G vision: a unifying connectivity fabric Enhanced mobile
More informationParag Kar Vice President, Government Affairs, Qualcomm India & South Asia 15 th June, Spectrum Sharing : Opportunities & Challenges
Parag Kar Vice President, Government Affairs, Qualcomm India & South Asia 15 th June, 2015 Spectrum Sharing : Opportunities & Challenges 1 1 2 3 4 Introduction Spectrum : Status Context Types Encash Opportunities
More informationLecture 7: Semantic Segmentation
Semantic Segmentation CSED703R: Deep Learning for Visual Recognition (207F) Segmenting images based on its semantic notion Lecture 7: Semantic Segmentation Bohyung Han Computer Vision Lab. bhhanpostech.ac.kr
More informationRich feature hierarchies for accurate object detection and semantic segmentation
Rich feature hierarchies for accurate object detection and semantic segmentation BY; ROSS GIRSHICK, JEFF DONAHUE, TREVOR DARRELL AND JITENDRA MALIK PRESENTER; MUHAMMAD OSAMA Object detection vs. classification
More informationCOMP 551 Applied Machine Learning Lecture 16: Deep Learning
COMP 551 Applied Machine Learning Lecture 16: Deep Learning Instructor: Ryan Lowe (ryan.lowe@cs.mcgill.ca) Slides mostly by: Class web page: www.cs.mcgill.ca/~hvanho2/comp551 Unless otherwise noted, all
More informationComparison of Fine-tuning and Extension Strategies for Deep Convolutional Neural Networks
Comparison of Fine-tuning and Extension Strategies for Deep Convolutional Neural Networks Nikiforos Pittaras 1, Foteini Markatopoulou 1,2, Vasileios Mezaris 1, and Ioannis Patras 2 1 Information Technologies
More informationInnovation and EU s cultural policy. Guillaume Lebrun Director Qualcomm 12 th May 2016
Innovation and EU s cultural policy Guillaume Lebrun Director Qualcomm 12 th May 2016 Looking at the world through the eye of a needle Mobile Network Operators I cannot get access to content I cannot monetize
More informationMaking an on-device personal assistant a reality
June 2018 @qualcomm_tech Making an on-device personal assistant a reality Qualcomm Technologies, Inc. AI brings human-like understanding and behaviors to the machines Perception Hear, see, and observe
More informationQualcomm AllPlay Smart Media Platform
Presenter Name Presenter Title Qualcomm Connected Experiences, Inc. Qualcomm AllPlay Smart Media Platform Qualcomm AllPlay smart media platform 2014 ACE Award winner Internet of Things Technology, Service
More information5G NR to high capacity and
July 11, 2018 @qualcomm Webinar How can CoMP extend 5G NR to high capacity and ultra-reliable communications? Dr. Durga Malladi SVP, Engineering & GM, 4G/5G Qualcomm Technologies, Inc. Enabler to the factory
More informationFuzzy Set Theory in Computer Vision: Example 3
Fuzzy Set Theory in Computer Vision: Example 3 Derek T. Anderson and James M. Keller FUZZ-IEEE, July 2017 Overview Purpose of these slides are to make you aware of a few of the different CNN architectures
More informationObject detection with CNNs
Object detection with CNNs 80% PASCAL VOC mean0average0precision0(map) 70% 60% 50% 40% 30% 20% 10% Before CNNs After CNNs 0% 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 year Region proposals
More informationVulkan API 杨瑜, 资深工程师
Vulkan API 杨瑜, 资深工程师 Vulkan Overview (1/3) Some History ~2011 became apparent that the API is getting in the way - Console Developers programmed GPUs To-the-Metal 2012 Khronos started work on GLCommon
More informationSmartphone-powered future
Matt Grob EVP & Chief Technology Officer, Qualcomm Technologies, Inc. Smartphone-powered future @GrobMatt 1 Energy Enough to lift an adult several stories high Utility Replaces 6+ devices Power More computing
More informationComputer Vision Lecture 16
Computer Vision Lecture 16 Deep Learning for Object Categorization 14.01.2016 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar registration period
More informationLearning Deep Features for Visual Recognition
7x7 conv, 64, /2, pool/2 1x1 conv, 64 3x3 conv, 64 1x1 conv, 64 3x3 conv, 64 1x1 conv, 64 3x3 conv, 64 1x1 conv, 128, /2 3x3 conv, 128 1x1 conv, 512 1x1 conv, 128 3x3 conv, 128 1x1 conv, 512 1x1 conv,
More informationConvolutional Neural Networks: Applications and a short timeline. 7th Deep Learning Meetup Kornel Kis Vienna,
Convolutional Neural Networks: Applications and a short timeline 7th Deep Learning Meetup Kornel Kis Vienna, 1.12.2016. Introduction Currently a master student Master thesis at BME SmartLab Started deep
More informationCS 1674: Intro to Computer Vision. Object Recognition. Prof. Adriana Kovashka University of Pittsburgh April 3, 5, 2018
CS 1674: Intro to Computer Vision Object Recognition Prof. Adriana Kovashka University of Pittsburgh April 3, 5, 2018 Different Flavors of Object Recognition Semantic Segmentation Classification + Localization
More informationDeep learning for object detection. Slides from Svetlana Lazebnik and many others
Deep learning for object detection Slides from Svetlana Lazebnik and many others Recent developments in object detection 80% PASCAL VOC mean0average0precision0(map) 70% 60% 50% 40% 30% 20% 10% Before deep
More informationYOLO9000: Better, Faster, Stronger
YOLO9000: Better, Faster, Stronger Date: January 24, 2018 Prepared by Haris Khan (University of Toronto) Haris Khan CSC2548: Machine Learning in Computer Vision 1 Overview 1. Motivation for one-shot object
More informationNew Technologies for UAV/UGV
Qualcomm Research New Technologies for UAV/UGV Charles Bergan VP, Engineering Qualcomm Research Qualcomm Technologies, Inc. 2013-2016 QUALCOMM Incorporated and/or its subsidiaries. All rights reserved
More informationLearning Deep Representations for Visual Recognition
Learning Deep Representations for Visual Recognition CVPR 2018 Tutorial Kaiming He Facebook AI Research (FAIR) Deep Learning is Representation Learning Representation Learning: worth a conference name
More informationTowards Weakly- and Semi- Supervised Object Localization and Semantic Segmentation
Towards Weakly- and Semi- Supervised Object Localization and Semantic Segmentation Lecturer: Yunchao Wei Image Formation and Processing (IFP) Group University of Illinois at Urbanahttps://weiyc.githu Champaign
More informationProceedings of the International MultiConference of Engineers and Computer Scientists 2018 Vol I IMECS 2018, March 14-16, 2018, Hong Kong
, March 14-16, 2018, Hong Kong , March 14-16, 2018, Hong Kong , March 14-16, 2018, Hong Kong , March 14-16, 2018, Hong Kong TABLE I CLASSIFICATION ACCURACY OF DIFFERENT PRE-TRAINED MODELS ON THE TEST DATA
More informationFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun Presented by Tushar Bansal Objective 1. Get bounding box for all objects
More informationRegionlet Object Detector with Hand-crafted and CNN Feature
Regionlet Object Detector with Hand-crafted and CNN Feature Xiaoyu Wang Research Xiaoyu Wang Research Ming Yang Horizon Robotics Shenghuo Zhu Alibaba Group Yuanqing Lin Baidu Overview of this section Regionlet
More informationSpectrum for 4G and 5G. Qualcomm Technologies, Inc. July, 2017
Spectrum for 4G and 5G Qualcomm Technologies, Inc. July, 2017 Using all available spectrum types and spectrum bands Licensed spectrum Exclusive use Over 40 bands globally for LTE Shared spectrum New shared
More informationDeep Learning for Computer Vision II
IIIT Hyderabad Deep Learning for Computer Vision II C. V. Jawahar Paradigm Shift Feature Extraction (SIFT, HoG, ) Part Models / Encoding Classifier Sparrow Feature Learning Classifier Sparrow L 1 L 2 L
More informationAdvanced Video Analysis & Imaging
Advanced Video Analysis & Imaging (5LSH0), Module 09B Machine Learning with Convolutional Neural Networks (CNNs) - Workout Farhad G. Zanjani, Clint Sebastian, Egor Bondarev, Peter H.N. de With ( p.h.n.de.with@tue.nl
More informationFei-Fei Li & Justin Johnson & Serena Yeung
Lecture 9-1 Administrative A2 due Wed May 2 Midterm: In-class Tue May 8. Covers material through Lecture 10 (Thu May 3). Sample midterm released on piazza. Midterm review session: Fri May 4 discussion
More informationFashion Style in 128 Floats: Joint Ranking and Classification using Weak Data for Feature Extraction SUPPLEMENTAL MATERIAL
Fashion Style in 128 Floats: Joint Ranking and Classification using Weak Data for Feature Extraction SUPPLEMENTAL MATERIAL Edgar Simo-Serra Waseda University esimo@aoni.waseda.jp Hiroshi Ishikawa Waseda
More informationExploiting noisy web data for largescale visual recognition
Exploiting noisy web data for largescale visual recognition Lamberto Ballan University of Padova, Italy CVPRW WebVision - Jul 26, 2017 Datasets drive computer vision progress ImageNet Slide credit: O.
More informationNeville Meijers VP, Business Development Qualcomm Technologies, Inc. Extending the Benefits of LTE to Unlicensed Spectrum
Neville Meijers VP, Business Development Qualcomm Technologies, Inc. Extending the Benefits of LTE to Unlicensed Spectrum 1 Making the best use of licensed and unlicensed spectrum More spectrum More licensed
More informationYelp Restaurant Photo Classification
Yelp Restaurant Photo Classification Rajarshi Roy Stanford University rroy@stanford.edu Abstract The Yelp Restaurant Photo Classification challenge is a Kaggle challenge that focuses on the problem predicting
More informationAll You Want To Know About CNNs. Yukun Zhu
All You Want To Know About CNNs Yukun Zhu Deep Learning Deep Learning Image from http://imgur.com/ Deep Learning Image from http://imgur.com/ Deep Learning Image from http://imgur.com/ Deep Learning Image
More informationCOMP9444 Neural Networks and Deep Learning 7. Image Processing. COMP9444 c Alan Blair, 2017
COMP9444 Neural Networks and Deep Learning 7. Image Processing COMP9444 17s2 Image Processing 1 Outline Image Datasets and Tasks Convolution in Detail AlexNet Weight Initialization Batch Normalization
More information