Introduction to Computer Vision MARCH 2018
|
|
- Christine Byrd
- 5 years ago
- Views:
Transcription
1 Introduction to Computer Vision RODNEY DOCKTER, PH.D. MARCH
2 Rodney Dockter (me) Ph.D. in Mechanical Engineering from the University of Minnesota Worked in Dr. Tim Kowalewski s lab Medical robotics and machine learning Now working at Danfoss Power Solutions developing autonomous systems in agriculture and heavy machinery 2
3 Contact Information Office: ME Office Hours: W, F 1:15pm 2:00 pm 3
4 Book References (optional) David A. Forsyth and Jean Ponce: Computer vision: a modern approach. Prentice Hall, Peter Corke: Robotics, Vision and Control: Fundamental Algorithms In MATLAB. Springer, 2017 R.C. Gonzalez and R.E. Woods: Digital Image Processing, Prentice-Hall, 2002 Richard Hartley and Andrew Zisserman: Multiple View Geometry in Computer Vision. Cambridge 2004 Christopher M. Bishop: Pattern Recognition and Machine Learning. Springer,
5 Class Organization All computer vision from here on out! ~10 lectures, 3 assignments, 30% of total grade Prerequisites : Linear algebra Statistics Vector Calculus Coding! Course does not presume prior computer vision experience Emphasis on coding! Matlab will be required for all homework assignments 5
6 Class Organization Cont. Collaboration Policy: - You are encouraged to discuss assignments with your peers. However, all written work and coding must be done individually. Individuals found submitting duplicate or substantially similar materials due to inappropriate collaboration may get an F in this class and may receive other serious consequences. - In the real world no one will write your code for you! Libraries and Code Found Online: - None of the Matlab libraries for computer vision may be used in assignments. You will writing your own computer vision code from the ground up. - Students found plagiarizing code found on the internet will fail the course (we know how to use google too) 6
7 Course Syllabus (Vision Portion) March 30 F 1 - Introduction to computer vision and image processing April 04 W 2 - Image Formation Camera Fundamentals April 06 F 3 - Digital Image Representation (Quiz #2 review) April 11 W 4 - Spatial Domain + Computer Vision in Matlab April 13 F QUIZ #2 No Lecture April 18 W 5 - Image Histograms April 20 F 6 - Edge Detection April 25 W 7 - Edge Detection Cont. Canny and Sobel April 27 F 8 - Interest Point Detection May 02 W 9 - Line Detection. Hough Transform. May 04 F 10 - The future. Deep Learning. 7
8 Outline What is computer vision? What is image processing? Basics of Computer Vision Processing Interesting examples of computer vision in the wild? Brief introduction to Matlab for computer vision use. 8
9 Part 1 - What is computer vision? Allowing robots and machines to see the world around them. 9
10 What is computer vision? Once robots can see the world, they can interact with it. 10
11 What is computer vision? Machines can learn to perform tasks just like humans. 11
12 What is computer vision? Deals with the formation, analyses and interpretation of images Integral to robotics and Artificial Intelligence (AI) Interdisciplinary subject area: Robotics Autonomous Vehicles Medical Applications Security Practical and Useful Challenging and continuously evolving 12
13 Difficulties in Computer Vision Images are ambiguous: dependent on perspective Images are affected by many factors: Sensor model Illumination (lighting) Shape of object(s) Color of object (s) Texture of object (s) No universal solution to vision and sensing Many theories and potential algorithms Gold standard: Human Vision! 13
14 Human Vision: 14
15 Difficulties in Computer Vision It is a many-to-mapping: Different objects with different material and geometric properties, possibly under different lighting conditions could lead to identical images. The same object, viewed from different perspectives or with different lighting can result in vastly different images (under constrained mapping) Information is lost in the transformation from the 3D world to a 2D image. 15
16 Difficulties in Computer Vision It is computationally intensive. Usually requires high end processors or graphics cards to achieve real time performance. We still do not fully understand the recognition problem. 16
17 Nomenclature Many names for mostly similar things: Computer Vision General All encompassing term Computational Vision Modeling of biological vision Image Processing Generally refers to static images (frame to frame). Building block for computer vision. Machine Vision Industrial or factory applications for inspection and measurement. 17
18 Related Fields Pattern Recognition Machine Learning Robotics (obviously) Medical Imaging Computer Graphics Human Robot Interaction 18
19 Why study computer vision Images and videos are everywhere Mobile phones, cheap cameras, real time streaming New applications all the time Face recognition 3D representations from pictures Automatic surveillance Driverless vehicles Shipping and warehouse management Various deep scientific mysteries Human vision system etc 19
20 Brief History of Computer Vision B.C. (Before Computers) Philosophy Optics Physics Neurophysiology Early Cameras (Late 1800s) Earliest way to represent the real world in a consistent manner Precursor to video and digital representations of the world around us 20
21 Brief History of Computer Vision Early Computer Vision Systems (1960 s) Minsky at MIT Attempted to solve vision in a summer (lol) Empirical approaches Ad hoc, bag of tricks Image processing plus+ Solutions tailored to each problem. Simplified worlds Blocks worlds then generalize Known perspectives, known illumination 21
22 Brief History of Computer Vision 1980 s improved computational power + robotics innovations 1990 s personal computing brings computer vision possibilities to researchers everywhere s OpenCV, ROS, and Matlab provide generalized computer vision computing abilities to researchers 2010 s Computer vision comes to the masses: Microsoft Kinect Leap Motion Google Tango Augmented Reality iphone Face ID 22
23 Progress in Computer Vision First Generation: Military/ Early Research Few systems, custom built. Cost: $1 Million+ Users have PhDs Slow (1 hour per frame) Second Generation: Industrial / Medical Numerous systems (1000+). Cost: $10,000+ Users have bachelor degrees Specialized hardware Third Generation: Consumer systems worldwide. Cost: $100 Users have little or no training Raspberry + webcam = $50 = limitless potential 23
24 The Future Software: 1 solution for all vision problems Provide unexperienced users with an easy way to detect/track objects. Does it exist? Convolutional Neural Networks? Tensorflow? Hardware: Cheap cameras (cell phone) Depth cameras (Kinect, stereo cameras) Cheap, powerful, mobile processing (getting there) 24
25 Part 2 Computer Vision Processing Processing Levels: Low Level Mid Level High Level Image Formulation 25
26 Three Processing Levels Low Level Low Level Processing: Standard procedures to improve image quality and format No intelligence 26
27 Three Processing Levels - Mid Level Intermediate Processing: Extract features and characterize components Some intelligence 27
28 Three Processing Levels - Mid Level Representing small patches in an image Want to establish correspondence between points or regions in different images, so we need to mathematically describe the neighborhood around a point Sharp changes are important features! (Known as edges ) Representing texture by giving some statistics of the different types of patches present in a region i.e. Tigers have lots of stripes, few spots Leapords have lots of spots, no stripes How can we mathematically describe this? 28
29 Three Processing Levels - Mid Level Filter Outputs Filters form a dot-product between a pattern and an image, while shifting the pattern across the image Strong Response -> image region matches a pattern e.g. derivatives measured by filtering with a kernel that looks like a big derivative (bright line next to a dark line would yield a large derivative) 29
30 Three Processing Levels - Mid Level Many objects are distinguished by their texture Tigers, cheetahs, grass, trees We represent texture with statistics from filter outputs For tigers, a stripes filter at a coarse scale responds strongly For cheetahs, a spot filter with a coarse scale responds strongly For grass, long narrow lines For the leaves of a trees, extended spots Objects with different textures can be segmented The variation in textures in a cue to a shape 30
31 Three Processing Levels - Mid Level Geometry of multiple views (images) Where might an object appear in camera #2 (or #3, ) given its position in camera 1 Stereopsis What we know about the world from having 2 eyes (cameras) Depth and 3D information Structure from motion What we know about the world from having many eyes (a single eye, moving quickly) 31
32 Three Processing Levels - Mid Level Finding coherent structures in an image to break it into smaller units Segmentation: Breaking images and videos into useful pieces e.g. finding image components that are coherent in appearance e.g. separating image foreground from background Tracking: Keeping track of a moving object through a sequence of views 32
33 Three Processing Levels High Level High-Level Processing: Recognizing patterns, comparing to known models High intelligence (ie machine learning) 33
34 Three Processing Levels - High Level Relationship between object geometry and image geometry Model Based Vision Find the position and orientation of known objects (e.g. squares, circles) Smooth surfaces and outlines How the outline of a curved object is formed and what it looks like (contours) Aspect graphs: How the outline of a curved object changes as you view it from different directions Range data 34
35 Three Processing Levels - High Level Using classifiers and probability to match and recognize objects Templates and classifiers How to find objects that look the same from view to view with a classifier Relations Break up objects into big, simple parts, find the parts with a classifier, then identify relationships between parts to find the object Geometric templates from spatial relations Extend this trick so that templates are formed from relations between smaller parts Bordering on machine learning 35
36 Image Formulation 36
37 Image Formulation 37
38 Simplistic View 38
39 The Physics of Imaging How images are formed: Cameras How a camera creates an image How to tell where the camera was Light How to measure light What light does at surfaces How the brightness values we see in cameras are determined Color The underlying mechanisms of color How to describe and measure color 39
40 The Physics of Imaging 40
41 The Physics of Imaging More on this later 41
42 Part 4 Computer Vision in the wild There are countless products that have an element of computer vision, and the number increases daily. Consumer, defense, and research. 42
43 Computer Vision in the wild NASA Rover PAR systems: Vision Guided Robots 43
44 Computer Vision in the wild Face Recognition For Security, User Interface Apple Face ID 44
45 Computer Vision in the wild Challenges in Face Recognition: -Illumination -Pose Variations -Facial Expressions -Facial Similarity 45
46 Computer Vision in the wild 3D Sensors, Microsoft, Intel, etc Time of Flight Depth Gesture Recognition Leap Motion, Realsense 46
47 Computer Vision in the wild Optical Character Recognition (Hand Written Digits) MNIST Data Set 47
48 Computer Vision in the wild Traffic Monitoring Augmented Driver Assist Systems 48
49 Computer Vision in the wild Autonomous Vehicles 49
50 Computer Vision in the wild Robotics Navigation 50
51 Computer Vision in the wild Brain Imaging MRI Vital Images Inc. 51
52 Computer Vision in the wild Types of images: Infra-red Ultra-violet Radio-waves Visible-light Radar Tomography Sonar Microscopy Magnetic Resonance 52
53 Computer Vision in the wild Thermal Imaging: Applications in defense, agriculture Local company: Fluke Thermography 53
54 Computer Vision in the wild Human Activity Recognition 54
55 Computer Vision in the wild Video Surveillance and Tracking 55
56 Can computers match human perception? Not yet Computer vision is still no match for human perception But computers are catching up in certain areas Classifying the ImageNet Database: 1.2 million images, 1000 categories Human: ~5.1% Error Rate Inception-v3 Convolutional Neural Network: 3.46% Error Rate 56
57 Conclusion Computer Vision is a challenging and exciting field Applied to many real world situations Tremendous progress in the last two decades There is still work to be done 57
Why study Computer Vision?
Why study Computer Vision? Images and movies are everywhere Fast-growing collection of useful applications building representations of the 3D world from pictures automated surveillance (who s doing what)
More informationWhy study Computer Vision?
Computer Vision Why study Computer Vision? Images and movies are everywhere Fast-growing collection of useful applications building representations of the 3D world from pictures automated surveillance
More informationWhat is Computer Vision? Introduction. We all make mistakes. Why is this hard? What was happening. What do you see? Intro Computer Vision
What is Computer Vision? Trucco and Verri (Text): Computing properties of the 3-D world from one or more digital images Introduction Introduction to Computer Vision CSE 152 Lecture 1 Sockman and Shapiro:
More informationOverview of Computer Vision. CS308 Data Structures
Overview of Computer Vision CS308 Data Structures What is Computer Vision? Deals with the development of the theoretical and algorithmic basis by which useful information about the 3D world can be automatically
More informationEECS 442 Computer Vision fall 2011
EECS 442 Computer Vision fall 2011 Instructor Silvio Savarese silvio@eecs.umich.edu Office: ECE Building, room: 4435 Office hour: Tues 4:30-5:30pm or under appoint. (after conversation hour) GSIs: Mohit
More informationComputer Vision. Introduction
Computer Vision Introduction Filippo Bergamasco (filippo.bergamasco@unive.it) http://www.dais.unive.it/~bergamasco DAIS, Ca Foscari University of Venice Academic year 2016/2017 About this course Official
More informationIntroduction. Prof. Kyoung Mu Lee SoEECS, Seoul National University
Introduction 1 Introduction to Computer Vision Introduction Prof. Kyoung Mu Lee SoEECS, Seoul National University Goal and Objectives Introduction 2 To introduce the fundamental problems of computer vision.
More informationIntroduction to Computer Vision
Introduction to Computer Vision Dr. Gerhard Roth COMP 4102A Winter 2015 Version 2 General Information Instructor: Adjunct Prof. Dr. Gerhard Roth gerhardroth@rogers.com read hourly gerhardroth@cmail.carleton.ca
More informationAnnouncements. Introduction. Why is this hard? What is Computer Vision? We all make mistakes. What do you see? Class Web Page is up:
Announcements Introduction Computer Vision I CSE 252A Lecture 1 Class Web Page is up: http://www.cs.ucsd.edu/classes/wi05/cse252a/ Assignment 0: Getting Started with Matlab is posted to web page, due 1/13/04
More informationCSE 527: Intro. to Computer
CSE 527: Intro. to Computer Vision CSE 527: Intro. to Computer Vision www.cs.sunysb.edu/~cse527 Instructor: Prof. M. Alex O. Vasilescu Email: maov@cs.sunysb.edu Phone: 631 632-8457 Office: 1421 Prerequisites:
More informationCOMPUTER VISION. Dr. Sukhendu Das Deptt. of Computer Science and Engg., IIT Madras, Chennai
COMPUTER VISION Dr. Sukhendu Das Deptt. of Computer Science and Engg., IIT Madras, Chennai 600036. Email: sdas@iitm.ac.in URL: //www.cs.iitm.ernet.in/~sdas 1 INTRODUCTION 2 Human Vision System (HVS) Vs.
More informationImage Registration Lecture 1: Introduction
Image Registration Lecture 1: Introduction Prof. Charlene Tsai Outline Syllabus Registration problem Applications of registration Components of a solution Thematic questions underlying registration Software
More informationCP467 Image Processing and Pattern Recognition
CP467 Image Processing and Pattern Recognition Instructor: Hongbing Fan Introduction About DIP & PR About this course Lecture 1: an overview of DIP DIP&PR show What is Digital Image? We use digital image
More informationComputer and Machine Vision
Computer and Machine Vision Lecture Week 4 Part-2 February 5, 2014 Sam Siewert Outline of Week 4 Practical Methods for Dealing with Camera Streams, Frame by Frame and De-coding/Re-encoding for Analysis
More informationImage segmentation. Václav Hlaváč. Czech Technical University in Prague
Image segmentation Václav Hlaváč Czech Technical University in Prague Center for Machine Perception (bridging groups of the) Czech Institute of Informatics, Robotics and Cybernetics and Faculty of Electrical
More informationComputer Vision Lecture 17
Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics 13.01.2015 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar in the summer semester
More informationComputer Vision Lecture 17
Announcements Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics Seminar in the summer semester Current Topics in Computer Vision and Machine Learning Block seminar, presentations in 1 st week
More informationComputer Vision. Alexandra Branzan Albu Spring 2010
Computer Vision Alexandra Branzan Albu Spring 2010 Staff Instructor: Alexandra Branzan Albu www.ece.uvic.ca/~aalbu email: aalbu@ece.uvic.ca Office hours (EOW 631): by appointment CENG 421/ ELEC 536 : Computer
More informationCSc I6716 Spring D Computer Vision. Introduction. Instructor: Zhigang Zhu City College of New York
Introduction CSc I6716 Spring 2012 Introduction Instructor: Zhigang Zhu City College of New York zzhu@ccny.cuny.edu Course Information Basic Information: Course participation p Books, notes, etc. Web page
More informationComputer Vision EE837, CS867, CE803
Computer Vision EE837, CS867, CE803 Introduction Lecture 01 Computer Vision Prerequisites Basic linear Algebra, probability, calculus - Required Basic data structures/programming knowledge - Required Working
More informationEECS 442 Computer Vision fall 2012
EECS 442 Computer Vision fall 2012 Instructor Silvio Savarese silvio@eecs.umich.edu Office: ECE Building, room: 4435 Office hour: Tues 4:30-5:30pm or under appoint. GSI: Johnny Chao (ywchao125@gmail.com)
More informationCS 534: Computer Vision Segmentation and Perceptual Grouping
CS 534: Computer Vision Segmentation and Perceptual Grouping Spring 2005 Ahmed Elgammal Dept of Computer Science CS 534 Segmentation - 1 Where are we? Image Formation Human vision Cameras Geometric Camera
More informationFinal Exam Study Guide
Final Exam Study Guide Exam Window: 28th April, 12:00am EST to 30th April, 11:59pm EST Description As indicated in class the goal of the exam is to encourage you to review the material from the course.
More informationComputer Vision. I-Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University
Computer Vision I-Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University About the course Course title: Computer Vision Lectures: EC016, 10:10~12:00(Tues.); 15:30~16:20(Thurs.) Pre-requisites:
More informationAn Introduc+on to Mathema+cal Image Processing IAS, Park City Mathema2cs Ins2tute, Utah Undergraduate Summer School 2010
An Introduc+on to Mathema+cal Image Processing IAS, Park City Mathema2cs Ins2tute, Utah Undergraduate Summer School 2010 Luminita Vese Todd WiCman Department of Mathema2cs, UCLA lvese@math.ucla.edu wicman@math.ucla.edu
More informationCSE 4392/5369. Dr. Gian Luca Mariottini, Ph.D.
University of Texas at Arlington CSE 4392/5369 Introduction to Vision Sensing Dr. Gian Luca Mariottini, Ph.D. Department of Computer Science and Engineering University of Texas at Arlington WEB : http://ranger.uta.edu/~gianluca
More informationMachine Learning (CSMML16) (Autumn term, ) Xia Hong
Machine Learning (CSMML16) (Autumn term, 28-29) Xia Hong 1 Useful books: 1. C. M. Bishop: Pattern Recognition and Machine Learning (2007) Springer. 2. S. Haykin: Neural Networks (1999) Prentice Hall. 3.
More informationWhat is computer vision?
What is computer vision? Computer vision (image understanding) is a discipline that studies how to reconstruct, interpret and understand a 3D scene from its 2D images in terms of the properties of the
More informationDepth. Common Classification Tasks. Example: AlexNet. Another Example: Inception. Another Example: Inception. Depth
Common Classification Tasks Recognition of individual objects/faces Analyze object-specific features (e.g., key points) Train with images from different viewing angles Recognition of object classes Analyze
More informationECG782: Multidimensional Digital Signal Processing
Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu ECG782: Multidimensional Digital Signal Processing Lecture 01 Introduction http://www.ee.unlv.edu/~b1morris/ecg782/ 2 Outline Computer Vision
More information3D Computer Vision Introduction. Guido Gerig CS 6320, Spring 2012
3D Computer Vision Introduction Guido Gerig CS 6320, Spring 2012 gerig@sci.utah.edu Administrivia Classes: M & W, 1.25-2:45 Room WEB L126 Instructor: Guido Gerig gerig@sci.utah.edu (801) 585 0327 Prerequisites:
More information3D Fusion of Infrared Images with Dense RGB Reconstruction from Multiple Views - with Application to Fire-fighting Robots
3D Fusion of Infrared Images with Dense RGB Reconstruction from Multiple Views - with Application to Fire-fighting Robots Yuncong Chen 1 and Will Warren 2 1 Department of Computer Science and Engineering,
More informationCSCD18: Computer Graphics. Instructor: Leonid Sigal
CSCD18: Computer Graphics Instructor: Leonid Sigal CSCD18: Computer Graphics Instructor: Leonid Sigal (call me Leon) lsigal@utsc.utoronto.ca www.cs.toronto.edu/~ls/ Office: SW626 Office Hour: M, 12-1pm?
More information3D Computer Vision. Introduction. Introduction. CSc I6716 Fall Instructor: Zhigang Zhu City College of New York
Introduction CSc I6716 Fall 2010 3D Computer Vision Introduction Instructor: Zhigang Zhu City College of New York zzhu@ccny.cuny.edu Course Information Basic Information: Course participation Books, notes,
More informationCS595:Introduction to Computer Vision
CS595:Introduction to Computer Vision Instructor: Qi Li Instructor Course syllabus E-mail: qi.li@cs.wku.edu Office: TCCW 135 Office hours MW: 9:00-10:00, 15:00-16:00 T: 9:00-12:00, 14:00-16:00 F: 9:00-10:00
More informationColorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.
Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Introduction to 2 What is? A process that produces from images of the external world a description
More informationLocal Image preprocessing (cont d)
Local Image preprocessing (cont d) 1 Outline - Edge detectors - Corner detectors - Reading: textbook 5.3.1-5.3.5 and 5.3.10 2 What are edges? Edges correspond to relevant features in the image. An edge
More informationCourse Name: Computer Vision Course Code: IT444
Course Name: Computer Vision Course Code: IT444 I. Basic Course Information Major or minor element of program: Major Department offering the course:information Technology Department Academic level:400
More informationA Survey of Light Source Detection Methods
A Survey of Light Source Detection Methods Nathan Funk University of Alberta Mini-Project for CMPUT 603 November 30, 2003 Abstract This paper provides an overview of the most prominent techniques for light
More informationAnnouncements. Hough Transform [ Patented 1962 ] Generalized Hough Transform, line fitting. Assignment 2: Due today Midterm: Thursday, May 5 in class
Announcements Generalized Hough Transform, line fitting Assignment 2: Due today Midterm: Thursday, May 5 in class Introduction to Computer Vision CSE 152 Lecture 11a What is region like if: 1. λ 1 = 0?
More informationIntroductions. Today. Computer Vision Jan 19, What is computer vision? 1. Vision for measurement. Computer Vision
Introductions Instructor: Prof. Kristen Grauman grauman@cs.utexas.edu Computer Vision Jan 19, 2011 TA: Shalini Sahoo shalini@cs.utexas.edu Today What is computer vision? Course overview Requirements, logistics
More informationImage Analysis. Lars Schmidt-Thieme
Image Analysis Image Analysis Lars Schmidt-Thieme Information Systems and Machine Learning Lab (ISMLL) Institute for Business Economics and Information Systems & Institute for Computer Science University
More informationComputer Vision Course Lecture 04. Template Matching Image Pyramids. Ceyhun Burak Akgül, PhD cba-research.com. Spring 2015 Last updated 11/03/2015
Computer Vision Course Lecture 04 Template Matching Image Pyramids Ceyhun Burak Akgül, PhD cba-research.com Spring 2015 Last updated 11/03/2015 Photo credit: Olivier Teboul vision.mas.ecp.fr/personnel/teboul
More informationChaplin, Modern Times, 1936
Chaplin, Modern Times, 1936 [A Bucket of Water and a Glass Matte: Special Effects in Modern Times; bonus feature on The Criterion Collection set] Multi-view geometry problems Structure: Given projections
More informationUnderstanding Tracking and StroMotion of Soccer Ball
Understanding Tracking and StroMotion of Soccer Ball Nhat H. Nguyen Master Student 205 Witherspoon Hall Charlotte, NC 28223 704 656 2021 rich.uncc@gmail.com ABSTRACT Soccer requires rapid ball movements.
More informationWeb site. Introduction to Computer Vision. Computer Vision. Text Book. Computer Vision. Relation to other fields
Introduction to Computer Vision CS / ECE 181B Tuesday, March 30, 2004 Web site http://www.ece.ucsb.edu/~manj/ece181b http://www.ece.ucsb.edu/~manj/cs181b Prof. B. S. Manjunath ECE/CS Department Last Year
More informationStereo: Disparity and Matching
CS 4495 Computer Vision Aaron Bobick School of Interactive Computing Administrivia PS2 is out. But I was late. So we pushed the due date to Wed Sept 24 th, 11:55pm. There is still *no* grace period. To
More informationAll human beings desire to know. [...] sight, more than any other senses, gives us knowledge of things and clarifies many differences among them.
All human beings desire to know. [...] sight, more than any other senses, gives us knowledge of things and clarifies many differences among them. - Aristotle University of Texas at Arlington Introduction
More information12/3/2009. What is Computer Vision? Applications. Application: Assisted driving Pedestrian and car detection. Application: Improving online search
Introduction to Artificial Intelligence V22.0472-001 Fall 2009 Lecture 26: Computer Vision Rob Fergus Dept of Computer Science, Courant Institute, NYU Slides from Andrew Zisserman What is Computer Vision?
More informationSchedule for Rest of Semester
Schedule for Rest of Semester Date Lecture Topic 11/20 24 Texture 11/27 25 Review of Statistics & Linear Algebra, Eigenvectors 11/29 26 Eigenvector expansions, Pattern Recognition 12/4 27 Cameras & calibration
More informationRange Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation
Obviously, this is a very slow process and not suitable for dynamic scenes. To speed things up, we can use a laser that projects a vertical line of light onto the scene. This laser rotates around its vertical
More informationFinal Exam Schedule. Final exam has been scheduled. 12:30 pm 3:00 pm, May 7. Location: INNOVA It will cover all the topics discussed in class
Final Exam Schedule Final exam has been scheduled 12:30 pm 3:00 pm, May 7 Location: INNOVA 1400 It will cover all the topics discussed in class One page double-sided cheat sheet is allowed A calculator
More informationCS334: Digital Imaging and Multimedia Edges and Contours. Ahmed Elgammal Dept. of Computer Science Rutgers University
CS334: Digital Imaging and Multimedia Edges and Contours Ahmed Elgammal Dept. of Computer Science Rutgers University Outlines What makes an edge? Gradient-based edge detection Edge Operators From Edges
More informationOn-line and Off-line 3D Reconstruction for Crisis Management Applications
On-line and Off-line 3D Reconstruction for Crisis Management Applications Geert De Cubber Royal Military Academy, Department of Mechanical Engineering (MSTA) Av. de la Renaissance 30, 1000 Brussels geert.de.cubber@rma.ac.be
More informationSmall-scale objects extraction in digital images
102 Int'l Conf. IP, Comp. Vision, and Pattern Recognition IPCV'15 Small-scale objects extraction in digital images V. Volkov 1,2 S. Bobylev 1 1 Radioengineering Dept., The Bonch-Bruevich State Telecommunications
More information(Sample) Final Exam with brief answers
Name: Perm #: (Sample) Final Exam with brief answers CS/ECE 181B Intro to Computer Vision March 24, 2017 noon 3:00 pm This is a closed-book test. There are also a few pages of equations, etc. included
More informationEdge Detection Lecture 03 Computer Vision
Edge Detection Lecture 3 Computer Vision Suggested readings Chapter 5 Linda G. Shapiro and George Stockman, Computer Vision, Upper Saddle River, NJ, Prentice Hall,. Chapter David A. Forsyth and Jean Ponce,
More informationCONCENTRATIONS: HIGH-PERFORMANCE COMPUTING & BIOINFORMATICS CYBER-SECURITY & NETWORKING
MAJOR: DEGREE: COMPUTER SCIENCE MASTER OF SCIENCE (M.S.) CONCENTRATIONS: HIGH-PERFORMANCE COMPUTING & BIOINFORMATICS CYBER-SECURITY & NETWORKING The Department of Computer Science offers a Master of Science
More informationBinghamton University. EngiNet. Thomas J. Watson. School of Engineering and Applied Science. State University of New York. EngiNet WARNING CS 560
Binghamton University EngiNet State University of New York EngiNet Thomas J. Watson School of Engineering and Applied Science WARNING All rights reserved. No Part of this video lecture series may be reproduced
More informationComplex Sensors: Cameras, Visual Sensing. The Robotics Primer (Ch. 9) ECE 497: Introduction to Mobile Robotics -Visual Sensors
Complex Sensors: Cameras, Visual Sensing The Robotics Primer (Ch. 9) Bring your laptop and robot everyday DO NOT unplug the network cables from the desktop computers or the walls Tuesday s Quiz is on Visual
More informationPractice Exam Sample Solutions
CS 675 Computer Vision Instructor: Marc Pomplun Practice Exam Sample Solutions Note that in the actual exam, no calculators, no books, and no notes allowed. Question 1: out of points Question 2: out of
More information3D Computer Vision Introduction. Guido Gerig CS 6320, Spring 2012
3D Computer Vision Introduction Guido Gerig CS 6320, Spring 2012 gerig@sci.utah.edu Administrivia Classes: M & W, 1.25-2:45 Room WEB L126 Instructor: Guido Gerig gerig@sci.utah.edu (801) 585 0327 Prerequisites:
More informationImage processing and features
Image processing and features Gabriele Bleser gabriele.bleser@dfki.de Thanks to Harald Wuest, Folker Wientapper and Marc Pollefeys Introduction Previous lectures: geometry Pose estimation Epipolar geometry
More informationCS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching
Stereo Matching Fundamental matrix Let p be a point in left image, p in right image l l Epipolar relation p maps to epipolar line l p maps to epipolar line l p p Epipolar mapping described by a 3x3 matrix
More informationStereo. Outline. Multiple views 3/29/2017. Thurs Mar 30 Kristen Grauman UT Austin. Multi-view geometry, matching, invariant features, stereo vision
Stereo Thurs Mar 30 Kristen Grauman UT Austin Outline Last time: Human stereopsis Epipolar geometry and the epipolar constraint Case example with parallel optical axes General case with calibrated cameras
More informationCHAPTER 1 Introduction 1. CHAPTER 2 Images, Sampling and Frequency Domain Processing 37
Extended Contents List Preface... xi About the authors... xvii CHAPTER 1 Introduction 1 1.1 Overview... 1 1.2 Human and Computer Vision... 2 1.3 The Human Vision System... 4 1.3.1 The Eye... 5 1.3.2 The
More informationCS 534: Computer Vision Texture
CS 534: Computer Vision Texture Ahmed Elgammal Dept of Computer Science CS 534 Texture - 1 Outlines Finding templates by convolution What is Texture Co-occurrence matrices for texture Spatial Filtering
More informationCAP 5415 Computer Vision. Fall 2011
CAP 5415 Computer Vision Fall 2011 General Instructor: Dr. Mubarak Shah Email: shah@eecs.ucf.edu Office: 247-F HEC Course Class Time Tuesdays, Thursdays 12 Noon to 1:15PM 383 ENGR Office hours Tuesdays
More informationMiniature faking. In close-up photo, the depth of field is limited.
Miniature faking In close-up photo, the depth of field is limited. http://en.wikipedia.org/wiki/file:jodhpur_tilt_shift.jpg Miniature faking Miniature faking http://en.wikipedia.org/wiki/file:oregon_state_beavers_tilt-shift_miniature_greg_keene.jpg
More informationComputer Vision. Alexandra Branzan Albu Spring 2009
Computer Vision Alexandra Branzan Albu Spring 2009 Staff Instructor: Alexandra Branzan Albu www.ece.uvic.ca/~aalbu email: aalbu@ece.uvic.ca Office hours (EOW 315): by appointment CENG 421/ ELEC 536 : Computer
More informationComputer Vision and Virtual Reality. Introduction
Computer Vision and Virtual Reality Introduction Tomáš Svoboda, svoboda@cmp.felk.cvut.cz Czech Technical University in Prague, Center for Machine Perception http://cmp.felk.cvut.cz Last update: October
More informationTRANSPARENT OBJECT DETECTION USING REGIONS WITH CONVOLUTIONAL NEURAL NETWORK
TRANSPARENT OBJECT DETECTION USING REGIONS WITH CONVOLUTIONAL NEURAL NETWORK 1 Po-Jen Lai ( 賴柏任 ), 2 Chiou-Shann Fuh ( 傅楸善 ) 1 Dept. of Electrical Engineering, National Taiwan University, Taiwan 2 Dept.
More informationME/CS 132: Introduction to Vision-based Robot Navigation! Low-level Image Processing" Larry Matthies"
ME/CS 132: Introduction to Vision-based Robot Navigation! Low-level Image Processing" Larry Matthies" lhm@jpl.nasa.gov, 818-354-3722" Announcements" First homework grading is done! Second homework is due
More informationAnnouncements. Recognition (Part 3) Model-Based Vision. A Rough Recognition Spectrum. Pose consistency. Recognition by Hypothesize and Test
Announcements (Part 3) CSE 152 Lecture 16 Homework 3 is due today, 11:59 PM Homework 4 will be assigned today Due Sat, Jun 4, 11:59 PM Reading: Chapter 15: Learning to Classify Chapter 16: Classifying
More informationDetection of a Single Hand Shape in the Foreground of Still Images
CS229 Project Final Report Detection of a Single Hand Shape in the Foreground of Still Images Toan Tran (dtoan@stanford.edu) 1. Introduction This paper is about an image detection system that can detect
More informationIntroduction to Digital Image Processing
Fall 2005 Image Enhancement in the Spatial Domain: Histograms, Arithmetic/Logic Operators, Basics of Spatial Filtering, Smoothing Spatial Filters Tuesday, February 7 2006, Overview (1): Before We Begin
More informationThink-Pair-Share. What visual or physiological cues help us to perceive 3D shape and depth?
Think-Pair-Share What visual or physiological cues help us to perceive 3D shape and depth? [Figure from Prados & Faugeras 2006] Shading Focus/defocus Images from same point of view, different camera parameters
More informationCarmen Alonso Montes 23rd-27th November 2015
Practical Computer Vision: Theory & Applications 23rd-27th November 2015 Wrap up Today, we are here 2 Learned concepts Hough Transform Distance mapping Watershed Active contours 3 Contents Wrap up Object
More informationCS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching
Stereo Matching Fundamental matrix Let p be a point in left image, p in right image l l Epipolar relation p maps to epipolar line l p maps to epipolar line l p p Epipolar mapping described by a 3x3 matrix
More informationM. Sc. (Artificial Intelligence and Machine Learning)
Course Name: Advanced Python Course Code: MSCAI 122 This course will introduce students to advanced python implementations and the latest Machine Learning and Deep learning libraries, Scikit-Learn and
More informationRecognition (Part 4) Introduction to Computer Vision CSE 152 Lecture 17
Recognition (Part 4) CSE 152 Lecture 17 Announcements Homework 5 is due June 9, 11:59 PM Reading: Chapter 15: Learning to Classify Chapter 16: Classifying Images Chapter 17: Detecting Objects in Images
More informationDigital Image Processing Lectures 1 & 2
Lectures 1 & 2, Professor Department of Electrical and Computer Engineering Colorado State University Spring 2013 Introduction to DIP The primary interest in transmitting and handling images in digital
More informationCS534: Introduction to Computer Vision Edges and Contours. Ahmed Elgammal Dept. of Computer Science Rutgers University
CS534: Introduction to Computer Vision Edges and Contours Ahmed Elgammal Dept. of Computer Science Rutgers University Outlines What makes an edge? Gradient-based edge detection Edge Operators Laplacian
More informationThanks to Chris Bregler. COS 429: Computer Vision
Thanks to Chris Bregler COS 429: Computer Vision COS 429: Computer Vision Instructor: Thomas Funkhouser funk@cs.princeton.edu Preceptors: Ohad Fried, Xinyi Fan {ohad,xinyi}@cs.princeton.edu Web page: http://www.cs.princeton.edu/courses/archive/fall13/cos429/
More informationIntroduction to Medical Imaging (5XSA0)
1 Introduction to Medical Imaging (5XSA0) Visual feature extraction Color and texture analysis Sveta Zinger ( s.zinger@tue.nl ) Introduction (1) Features What are features? Feature a piece of information
More informationCS 378: Autonomous Intelligent Robotics. Instructor: Jivko Sinapov
CS 378: Autonomous Intelligent Robotics Instructor: Jivko Sinapov http://www.cs.utexas.edu/~jsinapov/teaching/cs378/ Visual Registration and Recognition Announcements Homework 6 is out, due 4/5 4/7 Installing
More informationFeature Extraction and Image Processing, 2 nd Edition. Contents. Preface
, 2 nd Edition Preface ix 1 Introduction 1 1.1 Overview 1 1.2 Human and Computer Vision 1 1.3 The Human Vision System 3 1.3.1 The Eye 4 1.3.2 The Neural System 7 1.3.3 Processing 7 1.4 Computer Vision
More informationCS4442/9542b Artificial Intelligence II prof. Olga Veksler
CS4442/9542b Artificial Intelligence II prof. Olga Veksler Lecture 8 Computer Vision Introduction, Filtering Some slides from: D. Jacobs, D. Lowe, S. Seitz, A.Efros, X. Li, R. Fergus, J. Hayes, S. Lazebnik,
More informationCOMP 102: Computers and Computing
COMP 102: Computers and Computing Lecture 23: Computer Vision Instructor: Kaleem Siddiqi (siddiqi@cim.mcgill.ca) Class web page: www.cim.mcgill.ca/~siddiqi/102.html What is computer vision? Broadly speaking,
More informationActive Stereo Vision. COMP 4900D Winter 2012 Gerhard Roth
Active Stereo Vision COMP 4900D Winter 2012 Gerhard Roth Why active sensors? Project our own texture using light (usually laser) This simplifies correspondence problem (much easier) Pluses Can handle different
More informationCS 556: Computer Vision. Lecture 18
CS 556: Computer Vision Lecture 18 Prof. Sinisa Todorovic sinisa@eecs.oregonstate.edu 1 Color 2 Perception of Color The sensation of color is caused by the brain Strongly affected by: Other nearby colors
More informationGoals. Computer Graphics (Fall 2008) Course Outline. Course Outline. Course Outline. Demo: Surreal and Crazy World (HW 3)
Computer Graphics (Fall 2008) COMS 4160, Lecture 1: Overview and History Ravi Ramamoorthi http://www.cs.columbia.edu/~cs4160 Goals Systems: Be able to write complex 3D graphics programs (real-time in OpenGL,
More informationIntroducing Robotics Vision System to a Manufacturing Robotics Course
Paper ID #16241 Introducing Robotics Vision System to a Manufacturing Robotics Course Dr. Yuqiu You, Ohio University c American Society for Engineering Education, 2016 Introducing Robotics Vision System
More informationCS 534: Computer Vision Segmentation and Perceptual Grouping
CS 534: Computer Vision Segmentation and Perceptual Grouping Ahmed Elgammal Dept of Computer Science CS 534 Segmentation - 1 Outlines Mid-level vision What is segmentation Perceptual Grouping Segmentation
More informationCS 534: Computer Vision Texture
CS 534: Computer Vision Texture Spring 2004 Ahmed Elgammal Dept of Computer Science CS 534 Ahmed Elgammal Texture - 1 Outlines Finding templates by convolution What is Texture Co-occurrence matrecis for
More informationCS4495/6495 Introduction to Computer Vision
CS4495/6495 Introduction to Computer Vision 9C-L1 3D perception Some slides by Kelsey Hawkins Motivation Why do animals, people & robots need vision? To detect and recognize objects/landmarks Is that a
More informationRecall: Derivative of Gaussian Filter. Lecture 7: Correspondence Matching. Observe and Generalize. Observe and Generalize. Observe and Generalize
Recall: Derivative of Gaussian Filter G x I x =di(x,y)/dx Lecture 7: Correspondence Matching Reading: T&V Section 7.2 I(x,y) G y convolve convolve I y =di(x,y)/dy Observe and Generalize Derivative of Gaussian
More informationLast update: May 4, Vision. CMSC 421: Chapter 24. CMSC 421: Chapter 24 1
Last update: May 4, 200 Vision CMSC 42: Chapter 24 CMSC 42: Chapter 24 Outline Perception generally Image formation Early vision 2D D Object recognition CMSC 42: Chapter 24 2 Perception generally Stimulus
More informationThe NAO Robot, a case of study Robotics Franchi Alessio Mauro
The NAO Robot, a case of study Robotics 2013-2014 Franchi Alessio Mauro alessiomauro.franchi@polimi.it Who am I? Franchi Alessio Mauro Master Degree in Computer Science Engineer at Politecnico of Milan
More informationA Brief Introduction to Computer Vision
A Brief Introduction to Computer Vision Adrien Bartoli et al Endoscopy and Computer Vision group (EnCoV) Institut Pascal UMR6602, CNRS, Université Clermont Auvergne, SIGMA CHU de Clermont-Ferrand, Departments
More information