Tracking Under Low-light Conditions Using Background Subtraction

Size: px
Start display at page:

Download "Tracking Under Low-light Conditions Using Background Subtraction"

Transcription

1 Tracking Under Low-light Conditions Using Background Subtraction Matthew Bennink Clemson University Clemson, South Carolina Abstract A low-light tracking system was developed using background subtraction. Results are given for a full uniform light source, single light source and no light source. The results show that although the system performs well with full uniform light, it is easily confused by shadows given a single light source, and is almost useless with no light, even though low-light cameras are being used. The results will be discussed as well as the methods used to obtain the results. Some possible solutions will be presented in order to improve the tracking system for low-light conditions. 1 Introduction Tracking has a variety of applications. For example, a security team may want to track suspicious persons or a manufacturing plant may want to follow a product through the assembly process. One common method used with video tracking is background subtraction. Abbott and Williams used background subtraction with connected components analysis to segment video [1], Davis and Sharma used background subtraction with thermal cameras for tracking purposes [2], while Hoover used it with regular video feeds, also for tracking purposes [3]. In this paper, we will follow an algorithm very similar to Hoover s algorithm, but we will use low-light cameras in place of regular cameras. In doing so, we hope to track objects with little or no light present. These cameras contain a small amount of LEDs around the lens to provide ambient light without producing any light visible to the naked eye. 2 Methods Before any code is written, it is necessary to setup the tracking area and the cameras. In our case, we used masking tape to sketch out a rectangle approximately 4m long by 3m wide. The cameras were positioned above the tracking area and facing the center. Once the inital setup is complete, the cameras are calibrated. Using the calibration matrices and background subtraction, pixels are highlighted where the tracking system believes an object exists. We provide a discussion of camera calibration and background subtraction, then follow with the algorithm. 1

2 2.1 Camera Calibration Camera calibration is necessary to map image coordinates to real world coordinates. A brief overview of the calibration matrices will be presented and then a discussion of the image calibration tool we used will be given. Calibration requires two sets of information, the intrinsic values specific to the camera and the extrinsic values dependent on the world geometry. The intrinsic values include the focal length of the camera, the aspect ratio, the principal point, and skew. Rotation and translation make up the extrinsic values. The reduced equation mapping world coordinates to image coordinates is given below, where f is the focal length and (u 0,v 0 ) is the principal point. We assume that the skew is zero and the aspect ratio is 1:1. x y 1 = f 0 u 0 0 f v R 11 R 12 R 13 R 21 R 22 R 23 R 31 R 32 R 33 X Y Z + Camera calibration is not trivial, but several tools are available to calibrate cameras. We chose to use a 3rd party Matlab toolbox [4]. The toolbox, developed by Jean-Yves Bouguet, computes both the intrinsic values and extrinsic values of the camera. Calibration requires a calibration image, usually a black and white chessboard of sorts. We constructed a 3 x 3 chessboard using black foam board and white 11" x 8.5" printer paper. Images were captured with the board tilted at various angles. The calibration software uses these images to produce the intrinsic values. The board was then placed in the origin of our tracking area. The origin may be placed anywhere, but for ease of computation, we chose a corner, allowing for only positive world coordinates. A single image was captured, and this image was used to determine the extrinsic values, rotation and translation. Since rotation and translation are extrinsic, it is required to periodically update these matrices since they will change as the room is used. For example, the camera may be shifted slightly on accident. 2.2 Background Subtraction Background subtraction, on the other hand, is extremely trivial. With grey-level values, a difference map is produced by computing the absolute difference between each pixel in the image. This difference image is then thresholded to remove any difference values below some fixed threshold. Background subtraction is only effective when the foreground objects differ from the background. For example, black objects tracked on a black surface will not show up in a difference image because their grey level values are too similar. To produce good results, it is recommended that the images be pre-processed beforehand to remove noise and increase the breadth of the grey-level intensities. 2.3 Algorithm Now that we ve provided some background, here is the algorithm used. First, we calibrate the cameras. Second, we create a mapping of image coordinates to world coordinates. This speeds up the computation tremendously. Background images are stored, and mask images are produced in order to track only what is in the tracking area. Now, we loop over time. We set the occupancy map pixels to 1 indicating that none of the floor can be seen. Then, for each camera, a difference image is computed between the current image and the background image. If the difference is less T x T y T z 2

3 than some threshold, the floor can be seen in this area, and a 0 is placed in the occupancy map. After looping through all the cameras, the occupancy map is displayed. A value of 0 indicates at least one camera can see the floor. A value of 1 indicates that no camera can see the floor. Pseudocode Calibrate the cameras Create a lookup table of image coordinates to world coordinates Capture background images of empty tracking area Create mask image (1 is trackable, 0 is untrackable) Loop over time Set Occupancy Map to 1 for all pixels For each camera Compute difference of current image with background image If the difference is within desired threshold Set Occupancy Map to 0 at that location 3 Experimental Results The results varied over each of the test cases. With full uniform light, we acheived fairly good results. With a single light source, the results were not very good. The shadow of the object created just as much intensity change as the object itself. With no light, the noise from the cameras combined with a reduced overall intensity made it near impossible to track any object. It was impossible to distinguish between the system noise and an object within the tracking area. Images are given below to show how well an object was tracked. 3

4 3.1 Full Uniform Light Source Background Images Tracking Images Occupancy Map 4

5 3.2 Single Light Source Background Images Tracking Images Occupancy Map 5

6 3.3 No Light Source Background Images Tracking Images Occupancy Map 6

7 4 Conclusion As our results show, background subtraction is not a viable option for tracking under low-light conditions, even using low-light cameras. However, simply changing sensors could dramatically improve results. For example, using LADAR, one could use a very similar algorithm to track a person within the room. Also, infrared cameras produce a much better intensity histogram. It is also possible that some image processing could be done before the images are subtracted, such as smoothing and filtering. There are still many possibilities for tracking in the dark. However, we can now confidently say that background subtraction with low-light cameras is not the optimal solution. References [1] R. G. Abbott and L. R. Williams. Multiple target tracking with lazy background subtraction and connected components analysis. 3rd Computer Science Univ. New Mexico Student Conference [2] J. W. Davis and V. Sharma. Background-subtraction in thermal imagery using contour saliency. International Journal of Computer Vision, pages , [3] A. Hoover and B. D. Olsen. Real-time occupancy map from multiple video streams. Proc. IEEE Intl. Conf. Robotics and Automation, pages , [4] J. Bouget. Camera Calibration Toolbox for Matlab. bouguetj/calib_doc/, accessed 10 December

Ellipse Centroid Targeting in 3D Using Machine Vision Calibration and Triangulation (Inspired by NIST Pixel Probe)

Ellipse Centroid Targeting in 3D Using Machine Vision Calibration and Triangulation (Inspired by NIST Pixel Probe) Ellipse Centroid Targeting in 3D Using Machine Vision Calibration and Triangulation (Inspired by NIST Pixel Probe) Final Project EENG 510 December 7, 2015 Steven Borenstein 1 Background NIST Pixel Probe[1]

More information

Vision Review: Image Formation. Course web page:

Vision Review: Image Formation. Course web page: Vision Review: Image Formation Course web page: www.cis.udel.edu/~cer/arv September 10, 2002 Announcements Lecture on Thursday will be about Matlab; next Tuesday will be Image Processing The dates some

More information

CS4758: Rovio Augmented Vision Mapping Project

CS4758: Rovio Augmented Vision Mapping Project CS4758: Rovio Augmented Vision Mapping Project Sam Fladung, James Mwaura Abstract The goal of this project is to use the Rovio to create a 2D map of its environment using a camera and a fixed laser pointer

More information

Projector Calibration for Pattern Projection Systems

Projector Calibration for Pattern Projection Systems Projector Calibration for Pattern Projection Systems I. Din *1, H. Anwar 2, I. Syed 1, H. Zafar 3, L. Hasan 3 1 Department of Electronics Engineering, Incheon National University, Incheon, South Korea.

More information

Complex Sensors: Cameras, Visual Sensing. The Robotics Primer (Ch. 9) ECE 497: Introduction to Mobile Robotics -Visual Sensors

Complex Sensors: Cameras, Visual Sensing. The Robotics Primer (Ch. 9) ECE 497: Introduction to Mobile Robotics -Visual Sensors Complex Sensors: Cameras, Visual Sensing The Robotics Primer (Ch. 9) Bring your laptop and robot everyday DO NOT unplug the network cables from the desktop computers or the walls Tuesday s Quiz is on Visual

More information

Pin Hole Cameras & Warp Functions

Pin Hole Cameras & Warp Functions Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Motivation Taken from: http://img.gawkerassets.com/img/18w7i1umpzoa9jpg/original.jpg

More information

ENGN2911I: 3D Photography and Geometry Processing Assignment 1: 3D Photography using Planar Shadows

ENGN2911I: 3D Photography and Geometry Processing Assignment 1: 3D Photography using Planar Shadows ENGN2911I: 3D Photography and Geometry Processing Assignment 1: 3D Photography using Planar Shadows Instructor: Gabriel Taubin Assignment written by: Douglas Lanman 29 January 2009 Figure 1: 3D Photography

More information

Geometric camera models and calibration

Geometric camera models and calibration Geometric camera models and calibration http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 13 Course announcements Homework 3 is out. - Due October

More information

EECS 4330/7330 Introduction to Mechatronics and Robotic Vision, Fall Lab 1. Camera Calibration

EECS 4330/7330 Introduction to Mechatronics and Robotic Vision, Fall Lab 1. Camera Calibration 1 Lab 1 Camera Calibration Objective In this experiment, students will use stereo cameras, an image acquisition program and camera calibration algorithms to achieve the following goals: 1. Develop a procedure

More information

Camera Calibration. Schedule. Jesus J Caban. Note: You have until next Monday to let me know. ! Today:! Camera calibration

Camera Calibration. Schedule. Jesus J Caban. Note: You have until next Monday to let me know. ! Today:! Camera calibration Camera Calibration Jesus J Caban Schedule! Today:! Camera calibration! Wednesday:! Lecture: Motion & Optical Flow! Monday:! Lecture: Medical Imaging! Final presentations:! Nov 29 th : W. Griffin! Dec 1

More information

EXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,

EXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006, School of Computer Science and Communication, KTH Danica Kragic EXAM SOLUTIONS Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006, 14.00 19.00 Grade table 0-25 U 26-35 3 36-45

More information

The real voyage of discovery consists not in seeking new landscapes, but in having new eyes.

The real voyage of discovery consists not in seeking new landscapes, but in having new eyes. The real voyage of discovery consists not in seeking new landscapes, but in having new eyes. - Marcel Proust University of Texas at Arlington Camera Calibration (or Resectioning) CSE 4392-5369 Vision-based

More information

Camera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah

Camera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu Reference Most slides are adapted from the following notes: Some lecture notes on geometric

More information

Camera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah

Camera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu VisualFunHouse.com 3D Street Art Image courtesy: Julian Beaver (VisualFunHouse.com) 3D

More information

OBJECT SORTING IN MANUFACTURING INDUSTRIES USING IMAGE PROCESSING

OBJECT SORTING IN MANUFACTURING INDUSTRIES USING IMAGE PROCESSING OBJECT SORTING IN MANUFACTURING INDUSTRIES USING IMAGE PROCESSING Manoj Sabnis 1, Vinita Thakur 2, Rujuta Thorat 2, Gayatri Yeole 2, Chirag Tank 2 1 Assistant Professor, 2 Student, Department of Information

More information

Pin Hole Cameras & Warp Functions

Pin Hole Cameras & Warp Functions Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Example of SLAM for AR Taken from:

More information

Hand-Eye Calibration from Image Derivatives

Hand-Eye Calibration from Image Derivatives Hand-Eye Calibration from Image Derivatives Abstract In this paper it is shown how to perform hand-eye calibration using only the normal flow field and knowledge about the motion of the hand. The proposed

More information

3D graphics, raster and colors CS312 Fall 2010

3D graphics, raster and colors CS312 Fall 2010 Computer Graphics 3D graphics, raster and colors CS312 Fall 2010 Shift in CG Application Markets 1989-2000 2000 1989 3D Graphics Object description 3D graphics model Visualization 2D projection that simulates

More information

Camera Model and Calibration

Camera Model and Calibration Camera Model and Calibration Lecture-10 Camera Calibration Determine extrinsic and intrinsic parameters of camera Extrinsic 3D location and orientation of camera Intrinsic Focal length The size of the

More information

Calibration of a Different Field-of-view Stereo Camera System using an Embedded Checkerboard Pattern

Calibration of a Different Field-of-view Stereo Camera System using an Embedded Checkerboard Pattern Calibration of a Different Field-of-view Stereo Camera System using an Embedded Checkerboard Pattern Pathum Rathnayaka, Seung-Hae Baek and Soon-Yong Park School of Computer Science and Engineering, Kyungpook

More information

A COMPREHENSIVE SIMULATION SOFTWARE FOR TEACHING CAMERA CALIBRATION

A COMPREHENSIVE SIMULATION SOFTWARE FOR TEACHING CAMERA CALIBRATION XIX IMEKO World Congress Fundamental and Applied Metrology September 6 11, 2009, Lisbon, Portugal A COMPREHENSIVE SIMULATION SOFTWARE FOR TEACHING CAMERA CALIBRATION David Samper 1, Jorge Santolaria 1,

More information

CHAPTER 3 DISPARITY AND DEPTH MAP COMPUTATION

CHAPTER 3 DISPARITY AND DEPTH MAP COMPUTATION CHAPTER 3 DISPARITY AND DEPTH MAP COMPUTATION In this chapter we will discuss the process of disparity computation. It plays an important role in our caricature system because all 3D coordinates of nodes

More information

A Two-Stage Template Approach to Person Detection in Thermal Imagery

A Two-Stage Template Approach to Person Detection in Thermal Imagery A Two-Stage Template Approach to Person Detection in Thermal Imagery James W. Davis Mark A. Keck Ohio State University Columbus OH 432 USA {jwdavis,keck}@cse.ohio-state.edu Abstract We present a two-stage

More information

Image Transformations & Camera Calibration. Mašinska vizija, 2018.

Image Transformations & Camera Calibration. Mašinska vizija, 2018. Image Transformations & Camera Calibration Mašinska vizija, 2018. Image transformations What ve we learnt so far? Example 1 resize and rotate Open warp_affine_template.cpp Perform simple resize

More information

Miniaturized Camera Systems for Microfactories

Miniaturized Camera Systems for Microfactories Miniaturized Camera Systems for Microfactories Timo Prusi, Petri Rokka, and Reijo Tuokko Tampere University of Technology, Department of Production Engineering, Korkeakoulunkatu 6, 33720 Tampere, Finland

More information

ENG 7854 / 9804 Industrial Machine Vision. Midterm Exam March 1, 2010.

ENG 7854 / 9804 Industrial Machine Vision. Midterm Exam March 1, 2010. ENG 7854 / 9804 Industrial Machine Vision Midterm Exam March 1, 2010. Instructions: a) The duration of this exam is 50 minutes (10 minutes per question). b) Answer all five questions in the space provided.

More information

Fully Automatic Endoscope Calibration for Intraoperative Use

Fully Automatic Endoscope Calibration for Intraoperative Use Fully Automatic Endoscope Calibration for Intraoperative Use Christian Wengert, Mireille Reeff, Philippe C. Cattin, Gábor Székely Computer Vision Laboratory, ETH Zurich, 8092 Zurich, Switzerland {wengert,

More information

Project report Augmented reality with ARToolKit

Project report Augmented reality with ARToolKit Project report Augmented reality with ARToolKit FMA175 Image Analysis, Project Mathematical Sciences, Lund Institute of Technology Supervisor: Petter Strandmark Fredrik Larsson (dt07fl2@student.lth.se)

More information

Project Report for EE7700

Project Report for EE7700 Project Report for EE7700 Name: Jing Chen, Shaoming Chen Student ID: 89-507-3494, 89-295-9668 Face Tracking 1. Objective of the study Given a video, this semester project aims at implementing algorithms

More information

Real Time Motion Detection Using Background Subtraction Method and Frame Difference

Real Time Motion Detection Using Background Subtraction Method and Frame Difference Real Time Motion Detection Using Background Subtraction Method and Frame Difference Lavanya M P PG Scholar, Department of ECE, Channabasaveshwara Institute of Technology, Gubbi, Tumkur Abstract: In today

More information

LUMS Mine Detector Project

LUMS Mine Detector Project LUMS Mine Detector Project Using visual information to control a robot (Hutchinson et al. 1996). Vision may or may not be used in the feedback loop. Visual (image based) features such as points, lines

More information

Gabriel Taubin. Desktop 3D Photography

Gabriel Taubin. Desktop 3D Photography Sring 06 ENGN50 --- D Photograhy Lecture 7 Gabriel Taubin Brown University Deskto D Photograhy htt://www.vision.caltech.edu/bouguetj/iccv98/.index.html D triangulation: ray-lane Intersection lane ray intersection

More information

Vision Based Parking Space Classification

Vision Based Parking Space Classification 1 Vision Based Parking Space Classification Ananth Nallamuthu, Sandeep Lokala, Department of ECE, Clemson University. Abstract The problem of Vacant Parking space detection from static images using computer

More information

Range Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation

Range Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation Obviously, this is a very slow process and not suitable for dynamic scenes. To speed things up, we can use a laser that projects a vertical line of light onto the scene. This laser rotates around its vertical

More information

lecture 10 - depth from blur, binocular stereo

lecture 10 - depth from blur, binocular stereo This lecture carries forward some of the topics from early in the course, namely defocus blur and binocular disparity. The main emphasis here will be on the information these cues carry about depth, rather

More information

Draw Guide. Chapter 7 Working with 3D Objects

Draw Guide. Chapter 7 Working with 3D Objects Draw Guide Chapter 7 Working with 3D Objects Copyright This document is Copyright 2011 2014 by the LibreOffice Documentation Team. Contributors are listed below. You may distribute or modify it under the

More information

MERGING POINT CLOUDS FROM MULTIPLE KINECTS. Nishant Rai 13th July, 2016 CARIS Lab University of British Columbia

MERGING POINT CLOUDS FROM MULTIPLE KINECTS. Nishant Rai 13th July, 2016 CARIS Lab University of British Columbia MERGING POINT CLOUDS FROM MULTIPLE KINECTS Nishant Rai 13th July, 2016 CARIS Lab University of British Columbia Introduction What do we want to do? : Use information (point clouds) from multiple (2+) Kinects

More information

ENGN 2911 I: 3D Photography and Geometry Processing Assignment 2: Structured Light for 3D Scanning

ENGN 2911 I: 3D Photography and Geometry Processing Assignment 2: Structured Light for 3D Scanning ENGN 2911 I: 3D Photography and Geometry Processing Assignment 2: Structured Light for 3D Scanning Instructor: Gabriel Taubin Assignment written by: Douglas Lanman 26 February 2009 Figure 1: Structured

More information

Feature Detectors - Sobel Edge Detector

Feature Detectors - Sobel Edge Detector Page 1 of 5 Sobel Edge Detector Common Names: Sobel, also related is Prewitt Gradient Edge Detector Brief Description The Sobel operator performs a 2-D spatial gradient measurement on an image and so emphasizes

More information

Introducing Robotics Vision System to a Manufacturing Robotics Course

Introducing Robotics Vision System to a Manufacturing Robotics Course Paper ID #16241 Introducing Robotics Vision System to a Manufacturing Robotics Course Dr. Yuqiu You, Ohio University c American Society for Engineering Education, 2016 Introducing Robotics Vision System

More information

Perception. Autonomous Mobile Robots. Sensors Vision Uncertainties, Line extraction from laser scans. Autonomous Systems Lab. Zürich.

Perception. Autonomous Mobile Robots. Sensors Vision Uncertainties, Line extraction from laser scans. Autonomous Systems Lab. Zürich. Autonomous Mobile Robots Localization "Position" Global Map Cognition Environment Model Local Map Path Perception Real World Environment Motion Control Perception Sensors Vision Uncertainties, Line extraction

More information

A Practical Camera Calibration System on Mobile Phones

A Practical Camera Calibration System on Mobile Phones Advanced Science and echnolog Letters Vol.7 (Culture and Contents echnolog 0), pp.6-0 http://dx.doi.org/0.57/astl.0.7. A Practical Camera Calibration Sstem on Mobile Phones Lu Bo, aegkeun hangbo Department

More information

Detection of Moving Objects in Colour based and Graph s axis Change method

Detection of Moving Objects in Colour based and Graph s axis Change method Detection of Moving Objects in Colour based and Graph s axis Change method Gagandeep Kaur1 Student of Master of Technology, Department of Computer Engineering, YCOE, GuruKashi Campus, Punjabi university,

More information

Introduction to Homogeneous coordinates

Introduction to Homogeneous coordinates Last class we considered smooth translations and rotations of the camera coordinate system and the resulting motions of points in the image projection plane. These two transformations were expressed mathematically

More information

People detection and tracking using stereo vision and color

People detection and tracking using stereo vision and color People detection and tracking using stereo vision and color Rafael Munoz-Salinas, Eugenio Aguirre, Miguel Garcia-Silvente. In Image and Vision Computing Volume 25 Issue 6 (2007) 995-1007. Presented by

More information

Teleimmersion System. Contents. Dr. Gregorij Kurillo. n Introduction. n UCB. n Current problems. n Multi-stereo camera system

Teleimmersion System. Contents. Dr. Gregorij Kurillo. n Introduction. n UCB. n Current problems. n Multi-stereo camera system Teleimmersion System Dr. Gregorij Kurillo Contents n Introduction n Teleimmersion @ UCB n Current problems n Multi-stereo camera system n Networking n Rendering n Conclusion 1 3D scene 3D scene Internet

More information

Chapter 3 Image Registration. Chapter 3 Image Registration

Chapter 3 Image Registration. Chapter 3 Image Registration Chapter 3 Image Registration Distributed Algorithms for Introduction (1) Definition: Image Registration Input: 2 images of the same scene but taken from different perspectives Goal: Identify transformation

More information

Development of Vision System on Humanoid Robot HRP-2

Development of Vision System on Humanoid Robot HRP-2 Development of Vision System on Humanoid Robot HRP-2 Yutaro Fukase Institute of Technology, Shimizu Corporation, Japan fukase@shimz.co.jp Junichiro Maeda Institute of Technology, Shimizu Corporation, Japan

More information

A Vision System for Automatic State Determination of Grid Based Board Games

A Vision System for Automatic State Determination of Grid Based Board Games A Vision System for Automatic State Determination of Grid Based Board Games Michael Bryson Computer Science and Engineering, University of South Carolina, 29208 Abstract. Numerous programs have been written

More information

A Statistical Consistency Check for the Space Carving Algorithm.

A Statistical Consistency Check for the Space Carving Algorithm. A Statistical Consistency Check for the Space Carving Algorithm. A. Broadhurst and R. Cipolla Dept. of Engineering, Univ. of Cambridge, Cambridge, CB2 1PZ aeb29 cipolla @eng.cam.ac.uk Abstract This paper

More information

(Refer Slide Time 00:17) Welcome to the course on Digital Image Processing. (Refer Slide Time 00:22)

(Refer Slide Time 00:17) Welcome to the course on Digital Image Processing. (Refer Slide Time 00:22) Digital Image Processing Prof. P. K. Biswas Department of Electronics and Electrical Communications Engineering Indian Institute of Technology, Kharagpur Module Number 01 Lecture Number 02 Application

More information

Camera Self-calibration Based on the Vanishing Points*

Camera Self-calibration Based on the Vanishing Points* Camera Self-calibration Based on the Vanishing Points* Dongsheng Chang 1, Kuanquan Wang 2, and Lianqing Wang 1,2 1 School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001,

More information

EECS 487: Interactive Computer Graphics

EECS 487: Interactive Computer Graphics Ray Tracing EECS 487: Interactive Computer Graphics Lecture 29: Distributed Ray Tracing Introduction and context ray casting Recursive ray tracing shadows reflection refraction Ray tracing implementation

More information

Development of a Vision-Based Measurement System. for Relative Motion Compensation. Johan Lindal Haug. Supervisors Geir Hovland Morten Ottestad

Development of a Vision-Based Measurement System. for Relative Motion Compensation. Johan Lindal Haug. Supervisors Geir Hovland Morten Ottestad Development of a Vision-Based Measurement System for Relative Motion Compensation Johan Lindal Haug Supervisors Geir Hovland Morten Ottestad This master s thesis is carried out as a part of the education

More information

Face Tracking : An implementation of the Kanade-Lucas-Tomasi Tracking algorithm

Face Tracking : An implementation of the Kanade-Lucas-Tomasi Tracking algorithm Face Tracking : An implementation of the Kanade-Lucas-Tomasi Tracking algorithm Dirk W. Wagener, Ben Herbst Department of Applied Mathematics, University of Stellenbosch, Private Bag X1, Matieland 762,

More information

1 Projective Geometry

1 Projective Geometry CIS8, Machine Perception Review Problem - SPRING 26 Instructions. All coordinate systems are right handed. Projective Geometry Figure : Facade rectification. I took an image of a rectangular object, and

More information

Image-Based Reconstruction for View-Independent Human Motion Recognition

Image-Based Reconstruction for View-Independent Human Motion Recognition Image-Based Reconstruction for View-Independent Human Motion Recognition Robert Bodor Bennett Jackson Osama Masoud Nikolaos Papanikolopoulos {rbodor, jackson, masoud, npapas}@cs.umn.edu AIRVL, Dept. of

More information

Change detection using joint intensity histogram

Change detection using joint intensity histogram Change detection using joint intensity histogram Yasuyo Kita National Institute of Advanced Industrial Science and Technology (AIST) Information Technology Research Institute AIST Tsukuba Central 2, 1-1-1

More information

Kalman Filtered Robot Positioning System Using a Calibrated Camera

Kalman Filtered Robot Positioning System Using a Calibrated Camera Kalman Filtered Robot Positioning System Using a Calibrated Camera Group #1: Pat Hickey, Adam Stambler, & Ryan Whitson May 7, 2009 1 Abstract Our project goal is to estimate the position and orientation

More information

ECE 172A: Introduction to Intelligent Systems: Machine Vision, Fall Midterm Examination

ECE 172A: Introduction to Intelligent Systems: Machine Vision, Fall Midterm Examination ECE 172A: Introduction to Intelligent Systems: Machine Vision, Fall 2008 October 29, 2008 Notes: Midterm Examination This is a closed book and closed notes examination. Please be precise and to the point.

More information

Flat-Field Mega-Pixel Lens Series

Flat-Field Mega-Pixel Lens Series Flat-Field Mega-Pixel Lens Series Flat-Field Mega-Pixel Lens Flat-Field Mega-Pixel Lens 205.ver.0 E Specifications and Lineup Full Full Full Full 5MP MP MP MP Image Model Imager Size Mount Focal Length

More information

Effects Of Shadow On Canny Edge Detection through a camera

Effects Of Shadow On Canny Edge Detection through a camera 1523 Effects Of Shadow On Canny Edge Detection through a camera Srajit Mehrotra Shadow causes errors in computer vision as it is difficult to detect objects that are under the influence of shadows. Shadow

More information

Computer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG.

Computer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG. Computer Vision Coordinates Prof. Flávio Cardeal DECOM / CEFET- MG cardeal@decom.cefetmg.br Abstract This lecture discusses world coordinates and homogeneous coordinates, as well as provides an overview

More information

A Low Power, High Throughput, Fully Event-Based Stereo System: Supplementary Documentation

A Low Power, High Throughput, Fully Event-Based Stereo System: Supplementary Documentation A Low Power, High Throughput, Fully Event-Based Stereo System: Supplementary Documentation Alexander Andreopoulos, Hirak J. Kashyap, Tapan K. Nayak, Arnon Amir, Myron D. Flickner IBM Research March 25,

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Part 2: Image Enhancement in the Spatial Domain AASS Learning Systems Lab, Dep. Teknik Room T1209 (Fr, 11-12 o'clock) achim.lilienthal@oru.se Course Book Chapter 3 2011-04-06 Contents

More information

Computer and Machine Vision

Computer and Machine Vision Computer and Machine Vision Lecture Week 12 Part-2 Additional 3D Scene Considerations March 29, 2014 Sam Siewert Outline of Week 12 Computer Vision APIs and Languages Alternatives to C++ and OpenCV API

More information

Stereo Image Rectification for Simple Panoramic Image Generation

Stereo Image Rectification for Simple Panoramic Image Generation Stereo Image Rectification for Simple Panoramic Image Generation Yun-Suk Kang and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju 500-712 Korea Email:{yunsuk,

More information

Auto-focusing Technique in a Projector-Camera System

Auto-focusing Technique in a Projector-Camera System 2008 10th Intl. Conf. on Control, Automation, Robotics and Vision Hanoi, Vietnam, 17 20 December 2008 Auto-focusing Technique in a Projector-Camera System Lam Bui Quang, Daesik Kim and Sukhan Lee School

More information

CameramanVis: where the camera should look? CPSC 547 Project proposal

CameramanVis: where the camera should look? CPSC 547 Project proposal CameramanVis: where the camera should look? CPSC 547 Project proposal Jianhui Chen Computer Science Department University of British Columbia jhchen14@cs.ubc.ca 1. Domain, task and dataset reconstruction

More information

NAME :... Signature :... Desk no. :... Question Answer

NAME :... Signature :... Desk no. :... Question Answer Written test Tuesday 19th of December 2000. Aids allowed : All usual aids Weighting : All questions are equally weighted. NAME :................................................... Signature :...................................................

More information

Gate-to-gate automated video tracking and location

Gate-to-gate automated video tracking and location Gate-to-gate automated video tracing and location Sangyu Kang*, Jooni Pai**, Besma R. Abidi***, David Shelton, Mar Mitces, and Mongi A. Abidi IRIS Lab, Department of Electrical & Computer Engineering University

More information

Coarse-to-fine image registration

Coarse-to-fine image registration Today we will look at a few important topics in scale space in computer vision, in particular, coarseto-fine approaches, and the SIFT feature descriptor. I will present only the main ideas here to give

More information

Worksheet Answer Key: Scanning and Mapping Projects > Mine Mapping > Investigation 2

Worksheet Answer Key: Scanning and Mapping Projects > Mine Mapping > Investigation 2 Worksheet Answer Key: Scanning and Mapping Projects > Mine Mapping > Investigation 2 Ruler Graph: Analyze your graph 1. Examine the shape formed by the connected dots. i. Does the connected graph create

More information

Proc. Int. Symp. Robotics, Mechatronics and Manufacturing Systems 92 pp , Kobe, Japan, September 1992

Proc. Int. Symp. Robotics, Mechatronics and Manufacturing Systems 92 pp , Kobe, Japan, September 1992 Proc. Int. Symp. Robotics, Mechatronics and Manufacturing Systems 92 pp.957-962, Kobe, Japan, September 1992 Tracking a Moving Object by an Active Vision System: PANTHER-VZ Jun Miura, Hideharu Kawarabayashi,

More information

Camera Model and Calibration. Lecture-12

Camera Model and Calibration. Lecture-12 Camera Model and Calibration Lecture-12 Camera Calibration Determine extrinsic and intrinsic parameters of camera Extrinsic 3D location and orientation of camera Intrinsic Focal length The size of the

More information

Implemented by Valsamis Douskos Laboratoty of Photogrammetry, Dept. of Surveying, National Tehnical University of Athens

Implemented by Valsamis Douskos Laboratoty of Photogrammetry, Dept. of Surveying, National Tehnical University of Athens An open-source toolbox in Matlab for fully automatic calibration of close-range digital cameras based on images of chess-boards FAUCCAL (Fully Automatic Camera Calibration) Implemented by Valsamis Douskos

More information

Topics and things to know about them:

Topics and things to know about them: Practice Final CMSC 427 Distributed Tuesday, December 11, 2007 Review Session, Monday, December 17, 5:00pm, 4424 AV Williams Final: 10:30 AM Wednesday, December 19, 2007 General Guidelines: The final will

More information

Filtering Images. Contents

Filtering Images. Contents Image Processing and Data Visualization with MATLAB Filtering Images Hansrudi Noser June 8-9, 010 UZH, Multimedia and Robotics Summer School Noise Smoothing Filters Sigmoid Filters Gradient Filters Contents

More information

EDGE BASED REGION GROWING

EDGE BASED REGION GROWING EDGE BASED REGION GROWING Rupinder Singh, Jarnail Singh Preetkamal Sharma, Sudhir Sharma Abstract Image segmentation is a decomposition of scene into its components. It is a key step in image analysis.

More information

Stereo CSE 576. Ali Farhadi. Several slides from Larry Zitnick and Steve Seitz

Stereo CSE 576. Ali Farhadi. Several slides from Larry Zitnick and Steve Seitz Stereo CSE 576 Ali Farhadi Several slides from Larry Zitnick and Steve Seitz Why do we perceive depth? What do humans use as depth cues? Motion Convergence When watching an object close to us, our eyes

More information

Camera Parameters Estimation from Hand-labelled Sun Sositions in Image Sequences

Camera Parameters Estimation from Hand-labelled Sun Sositions in Image Sequences Camera Parameters Estimation from Hand-labelled Sun Sositions in Image Sequences Jean-François Lalonde, Srinivasa G. Narasimhan and Alexei A. Efros {jlalonde,srinivas,efros}@cs.cmu.edu CMU-RI-TR-8-32 July

More information

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science. Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Stereo Vision 2 Inferring 3D from 2D Model based pose estimation single (calibrated) camera Stereo

More information

Achim J. Lilienthal Mobile Robotics and Olfaction Lab, AASS, Örebro University

Achim J. Lilienthal Mobile Robotics and Olfaction Lab, AASS, Örebro University Achim J. Lilienthal Mobile Robotics and Olfaction Lab, Room T1227, Mo, 11-12 o'clock AASS, Örebro University (please drop me an email in advance) achim.lilienthal@oru.se 1 4. Admin Course Plan Rafael C.

More information

Performance Evaluation of Monitoring System Using IP Camera Networks

Performance Evaluation of Monitoring System Using IP Camera Networks 1077 Performance Evaluation of Monitoring System Using IP Camera Networks Maysoon Hashim Ismiaal Department of electronic and communications, faculty of engineering, university of kufa Abstract Today,

More information

Light: Geometric Optics

Light: Geometric Optics Light: Geometric Optics Regular and Diffuse Reflection Sections 23-1 to 23-2. How We See Weseebecauselightreachesoureyes. There are two ways, therefore, in which we see: (1) light from a luminous object

More information

3D Fusion of Infrared Images with Dense RGB Reconstruction from Multiple Views - with Application to Fire-fighting Robots

3D Fusion of Infrared Images with Dense RGB Reconstruction from Multiple Views - with Application to Fire-fighting Robots 3D Fusion of Infrared Images with Dense RGB Reconstruction from Multiple Views - with Application to Fire-fighting Robots Yuncong Chen 1 and Will Warren 2 1 Department of Computer Science and Engineering,

More information

Image-Based Reconstruction for View-Independent Human Motion Recognition. Technical Report

Image-Based Reconstruction for View-Independent Human Motion Recognition. Technical Report Image-Based Reconstruction for View-Independent Human Motion Recognition Technical Report Department of Computer Science and Engineering University of Minnesota 4-192 EECS Building 200 Union Street SE

More information

CS4733 Class Notes, Computer Vision

CS4733 Class Notes, Computer Vision CS4733 Class Notes, Computer Vision Sources for online computer vision tutorials and demos - http://www.dai.ed.ac.uk/hipr and Computer Vision resources online - http://www.dai.ed.ac.uk/cvonline Vision

More information

POME A mobile camera system for accurate indoor pose

POME A mobile camera system for accurate indoor pose POME A mobile camera system for accurate indoor pose Paul Montgomery & Andreas Winter November 2 2016 2010. All rights reserved. 1 ICT Intelligent Construction Tools A 50-50 joint venture between Trimble

More information

A Calibration-and-Error Correction Method for Improved Texel (Fused Ladar/Digital Camera) Images

A Calibration-and-Error Correction Method for Improved Texel (Fused Ladar/Digital Camera) Images Utah State University DigitalCommons@USU Electrical and Computer Engineering Faculty Publications Electrical and Computer Engineering 5-12-2014 A Calibration-and-Error Correction Method for Improved Texel

More information

Pattern Feature Detection for Camera Calibration Using Circular Sample

Pattern Feature Detection for Camera Calibration Using Circular Sample Pattern Feature Detection for Camera Calibration Using Circular Sample Dong-Won Shin and Yo-Sung Ho (&) Gwangju Institute of Science and Technology (GIST), 13 Cheomdan-gwagiro, Buk-gu, Gwangju 500-71,

More information

Estimating Speed, Velocity, Acceleration and Angle Using Image Addition Method

Estimating Speed, Velocity, Acceleration and Angle Using Image Addition Method Estimating Speed, Velocity, Acceleration and Angle Using Image Addition Method Sawan Singh Third Year Student, Dept. of ECE, UIET, CSJM University, Kanpur, India ABSTRACT: This paper leads us to a new

More information

Thermal / Visible Autonomous Stereo Visio System Calibration Methodology for Non-controlled Environments

Thermal / Visible Autonomous Stereo Visio System Calibration Methodology for Non-controlled Environments 11 th International Conference on Quantitative InfraRed Thermography Thermal / Visible Autonomous Stereo Visio System Calibration Methodology for Non-controlled Environments by W. Ursine*, F. Calado*,

More information

1 (5 max) 2 (10 max) 3 (20 max) 4 (30 max) 5 (10 max) 6 (15 extra max) total (75 max + 15 extra)

1 (5 max) 2 (10 max) 3 (20 max) 4 (30 max) 5 (10 max) 6 (15 extra max) total (75 max + 15 extra) Mierm Exam CS223b Stanford CS223b Computer Vision, Winter 2004 Feb. 18, 2004 Full Name: Email: This exam has 7 pages. Make sure your exam is not missing any sheets, and write your name on every page. The

More information

Sobel Edge Detection Algorithm

Sobel Edge Detection Algorithm Sobel Edge Detection Algorithm Samta Gupta 1, Susmita Ghosh Mazumdar 2 1 M. Tech Student, Department of Electronics & Telecom, RCET, CSVTU Bhilai, India 2 Reader, Department of Electronics & Telecom, RCET,

More information

Structured Light. Tobias Nöll Thanks to Marc Pollefeys, David Nister and David Lowe

Structured Light. Tobias Nöll Thanks to Marc Pollefeys, David Nister and David Lowe Structured Light Tobias Nöll tobias.noell@dfki.de Thanks to Marc Pollefeys, David Nister and David Lowe Introduction Previous lecture: Dense reconstruction Dense matching of non-feature pixels Patch-based

More information

High Altitude Balloon Localization from Photographs

High Altitude Balloon Localization from Photographs High Altitude Balloon Localization from Photographs Paul Norman and Daniel Bowman Bovine Aerospace August 27, 2013 Introduction On December 24, 2011, we launched a high altitude balloon equipped with a

More information

More Mosaic Madness. CS194: Image Manipulation & Computational Photography. Steve Seitz and Rick Szeliski. Jeffrey Martin (jeffrey-martin.

More Mosaic Madness. CS194: Image Manipulation & Computational Photography. Steve Seitz and Rick Szeliski. Jeffrey Martin (jeffrey-martin. More Mosaic Madness Jeffrey Martin (jeffrey-martin.com) CS194: Image Manipulation & Computational Photography with a lot of slides stolen from Alexei Efros, UC Berkeley, Fall 2018 Steve Seitz and Rick

More information

A High Speed Face Measurement System

A High Speed Face Measurement System A High Speed Face Measurement System Kazuhide HASEGAWA, Kazuyuki HATTORI and Yukio SATO Department of Electrical and Computer Engineering, Nagoya Institute of Technology Gokiso, Showa, Nagoya, Japan, 466-8555

More information

Robust and Accurate Detection of Object Orientation and ID without Color Segmentation

Robust and Accurate Detection of Object Orientation and ID without Color Segmentation 0 Robust and Accurate Detection of Object Orientation and ID without Color Segmentation Hironobu Fujiyoshi, Tomoyuki Nagahashi and Shoichi Shimizu Chubu University Japan Open Access Database www.i-techonline.com

More information