Vision-based Automated Vehicle Guidance: the experience of the ARGO vehicle
|
|
- Shon Lynch
- 5 years ago
- Views:
Transcription
1 Vision-based Automated Vehicle Guidance: the experience of the ARGO vehicle Massimo Bertozzi, Alberto Broggi, Gianni Conte, Alessandra Fascioli Dipartimento di Ingegneria dell Informazione Università di Parma, I Parma, ITALY Abstract This paper presents and discusses the results obtained by the GOLD (Generic Obstacle and Lane Detection) system as an automatic driver of ARGO. ARGO is a Lancia Thema passenger car equipped with a computer vision system that allows to extract road and environmental information from the acquired scene; it has been demonstrated to drive autonomously on a number of different road and environmental conditions. 1 The ARGO Autonomous Vehicle ARGO is the experimental autonomous vehicle developed at the Dipartimento di Ingegneria dell Informazione of the University of Parma, Italy. It integrates the main results of the research conducted over the last few years on the algorithms and the architectures for vision-based automatic road vehicles guidance. ARGO, a Lancia Thema 2000 passenger car (figure 1), is equipped with a vision system that allows to extract road and environmental information from the acquired scene and to drive autonomously under different road conditions. 1.1 Input devices Only passive, and therefore non-invasive, sensors (such as cameras) are used on ARGO to sense the surrounding environment. ARGO is equipped with a stereoscopic vision system consisting of two synchronized cameras able to acquire pairs of grey level images simultaneously. The installed devices are low cost cameras featuring a 6:0 mm focal length and a 360 lines resolution. The cameras lie inside the car at the top corners of the windscreen in order to maximize the longitudinal distance between the two cameras. A panel with user selectable functions is installed near the driver to change the functionalities of the system. An odometer is used to acquire the vehicle speed. 1.2 Output devices Four output devices are installed on ARGO (see figure 1): a led-based control panel, which indicates both the functionality selected by the user, and some data about the drive; a pair of stereo speakers, which give acoustic warnings to the driver; a monitor, which -for debugging purposes- displays the results of the processing; and an electric engine installed on the steering column, which allows the vehicle to steer autonomously. This work was partially supported by CNR under the frame of the Progetto Finalizzato Trasporti II.
2 Figure 1: the ARGO experimental vehicle: exterior and interior 1.3 The processing system Two different architectural solutions have been considered and evaluated: special-purpose [1] and standard processing system, but currently the system installed on ARGO is based on a standard Pentium processor with MMX technology, which allows to boost software performance by exploiting SIMD techniques. The new instructions supported by MMX technology accelerate the performance of applications based on computation intensive algorithms that perform localized recurring operations on small native data. 2 The Inverse Perspective Mapping (IPM) The perspective effect must be taken into account when processing images since it associates a different information content to each pixel of the image. A geometrical transform (Inverse Perspective Mapping [2], IPM) has been introduced which allows to remove the perspective effect from the acquired image, remapping it into a new 2-dimensional domain (the remapped domain) in which the information content is homogeneously distributed among all pixels, thus allowing the efficient implementation of the following processing steps with a SIMD paradigm. The application of the IPM transform requires the knowledge of the specific acquisition conditions (camera position, orientation, optics,...) and some assumptions on the scene represented in the image (here defined as a-priori knowledge). Assuming the road in front of the vision system as planar, the use of IPM allows to obtain a bird s eye view of the scene. 2.1 Extension of IPM to stereo vision As a consequence of the depth loss caused by the acquisition process, the use of a single two-dimensional image does not allow a three-dimensional reconstruction of the world without the use of any a-priori knowledge. In addition, when the target is the reconstruction of the 3D space, the solution gets more and more complex due to the larger amount of computation required by well-known approaches, such as the processing of stereo images. The traditional approach to stereo vision [3] can be divided into four steps: (i) calibration of the vision system; (ii) localization of a feature in an image; (iii) identification and localization of the same feature in the other image; (iv) 3D reconstruction of the scene. The problem of three dimensional reconstruction can be solved by the use of triangulations between points that correspond to the same feature (homologous points). Unfortunately, the determination of homologous points is a difficult task; however the introduction of some domain specific constraints (such as the assumption of a flat road in front of the cameras) can simplify it. In particular, when a complete 3D reconstruction
3 is not required and the verification of the match with a given surface model suffices, the application of IPM to stereo images plays a strategic role. More precisely, since IPM can be used to recover the texture of a specific surface (the road plane), when it is applied to both stereo images it provides two instances of the given surface, namely two partially overlapping patches. These two patches, thanks to the knowledge of the vision system setup, can be brought to correspondence, so that the homologous points share the same coordinates in the two remapped images [4]. 2.2 Extension of IPM to handle non-flat roads The formulas that define the IPM heavily rely on the knowledge of the geometry of the road surface, which is not always completely known. It can vary mainly for the following two different reasons: vehicle movements (pitch and roll), which change the reference system of the acquisition device with respect to the road; changes in the slope of the road. While it has been shown that small vehicle movements and small changes in the road slope can be neglected for sufficiently short fields of view (up to 50 m), sensible deviations from the flat road assumption may lead to unacceptable deformations in the resulting image. For this reason an extension of the IPM technique to handle also non-flat roads is currently under evaluation: thanks to the information obtained from pairs of stereo images, it is possible to derive the height of homologous points in the image using simple triangulations. The algorithm selects features of the image that belong to the road plane (in this implementation it selects road markings) and determines their height with respect to a flat road model. In this way it is possible to measure the road slope and recalibrate the IPM procedure according to the new road model. 3 GOLD, Generic Obstacle and Lane Detection on the ARGO Vehicle 3.1 Lane detection Lane detection functionality (LD) relies on the presence of painted lane markings. The advantage offered by the use of the IPM is that in the remapped image road markings are represented by quasi-vertical constantwidth lines, brighter than their surrounding region. This simplifies the following detection steps and allows its implementation with a traditional pattern matching technique on a SIMD system. The first step of road markings detection is a low-level processing aimed to detect the pixels that have a higher brightness value than their horizontal neighbors at a given distance thus obtaining a new image that encodes the horizontal brightness transitions and the presence of lane markings. Then, taking advantage of the lane markings vertical correlation, this image is enhanced through a few iterations of a geodesic morphological dilation. Different illumination conditions and the nonuniformity of painted road signs require the use of an adaptive threshold for the binarization of the image. The binary image scanned row by row in order to build chains of non-zero pixels (fig. 2.a). Each chain is then approximated with a polyline made of one or more segments, by means of an iterative process that brings the approximation under a specific threshold (fig. 2.b). To get rid of possible occlusions or errors caused by noise, two or more polylines are joined into longer ones if they satisfy some criteria such as small distance between the nearest extrema or similar orientation of the ending segments (fig. 2.c). When more solutions are possible in joining the polylines, initially all of them are considered; then a filter is applied to remove all the polylines that feature a too high or too variable curvature (fig. 2.d). A road model is used to select the polyline which most likely matches the road center line. Each computed polyline is matched against this model using several parameters such as distance, parallelism, orientation, and length. The polyline that fits better these parameters is selected. Finally a new road model is computed using the selected polyline, thus enabling the system to track the road centerline in image sequences.
4 (a) (b) (c) (d) (e) Figure 2: The different steps of Lane Detection: (a) concatenation of pixels; (b) segmentation and construction of polylines; (c) joined polylines; (d) filtered polylines; (e) superimposition of the detected center line onto a brighter version of the original image for displaying purposes only Since the model assumed for the external environment (flat road) allows to determine the spatial relationship between image pixels and the 3D world [2], from the previous result it is possible to derive both the road geometry and the vehicle position within the lane (fig. 2.e). 3.2 Obstacle detection Obstacle Detection (OD) shares the same underlying approach (IPM). This is of basic importance the IPM transform can be performed only once and its result can be shared by the two processes. The flat road model is checked through a pixel-wise difference between the two remapped images: in correspondence to anything rising up from the road surface in front of the vehicle (namely a generic obstacle), the difference image features sufficiently large clusters of non-zero pixels that have a specific shape [5]. Due to the different angles of view of the stereo cameras, an ideal homogeneous square obstacle produces two clusters of pixels with a triangular shape in the difference image, in correspondence to its vertical edges. Obviously triangles found in real cases are not so clearly defined and often not clearly disjoint because of the texture, irregular shape, and non-homogeneous color of real obstacles, but are anyway recognizable in the difference image (see figure 3.e). The obstacle detection process is thus based on the localization of these triangles. A polar histogram is used for the detection of triangles: it is obtained scanning the difference image with respect to a focus, considering every straight line originating from the focus itself and counting the number of overthreshold pixels lying on that line (figure 3.f). The values of the polar histogram are then normalized and a low-pass filter is applied in order to decrease the influence of noise (figure 3.g). The polar histogram presents an appreciable peak in correspondence of each triangle. The position of a peak within the histogram determines the angle of view under which the obstacle edge is seen. Peaks generated by the same obstacle, for example by its left and right edges, must be joined in order to consider the whole area between them as occluded. Starting from the analysis of a large number of different situations a criterion has been found, aimed to the grouping of peaks, that takes into account several characteristics such as the peaks amplitude and width, the area they subtend, as well as the interval between them. After the peaks joining phase, the angle of view under which the whole obstacle is seen is computed considering the peaks position, amplitude, and width. In addition, the obstacle distance can be estimated by a further analysis of the difference image along the directions pointed out by the maxima of the polar histogram, in order to detect the triangles corners. In fact they represent the contact points between obstacles and the road plane and thus hold the information about the obstacle distance. For each peak of the polar histogram a radial histogram is computed scanning a specific sector of the difference image whose width is determined as a function of the peak width [6]. The number of overthreshold pixels lying in the sector is computed for every distance from the focus and the result is normalized. A simple threshold applied to the radial histogram allows to detect the triangles corners position and thus the obstacle distance. The result is displayed with black markers superimposed on a brighter version of the left image; the markers position and size encode both the distance and width of obstacles (see figure 3.h).
5 (a) (b) (c) (d) (e) (f) (g) (h) Figure 3: Obstacle detection: (a) left and (b) right stereo images, (c) and (d) the remapped images, (e) the difference image, ( f ) the angles of view overlapped with the difference image, (g) the polar histogram, and (h) the result of obstacle detection using a black marker superimposed on the acquired left image; the thin black line highlights the road region visible from both cameras 3.3 System calibration Since the processing is based on stereo vision, camera calibration plays a basic role for the success of the approach. It is divided in two steps. Supervised calibration: the first part of the calibration process is an interactive step: a grid with known size has been painted onto the ground and two stereo images are captured and used for the calibration. Thanks to an X-Window based graphical interface a user selects the intersections of the grid lines using a mouse; these intersections represent a small set of homologous points whose world coordinates are known to the system; this mapping is used to compute the calibration parameters. This first step is intended to be performed only once when the orientation of the cameras or the vehicle trim have changed. Automatic parameters tuning: after the supervised phase, the computed calibration parameters have to be refined. Moreover small changes in the vision system setup or in the vehicle trim due to the vehicle movements require a periodic tuning of the calibration. The parameters tuning consists of an iterative procedure based on the application of the IPM transform to stereo images (see section 2.1). 3.4 A cooperative approach A new cooperative approach that allows to perform a deeper fusion of the results of the two modules (lane detection and obstacle detection) and takes into account also the high temporal correlation of image sequences is currently under evaluation. Once obstacles have been detected and localized, the knowledge of their position can be exploited by the lane detection module, since obstacles generally obstruct the visibility of road markings: the regions occluded by obstacles will not be considered in the search for road markings, thus decreasing noisy features that may disturb the retrieval of the road geometry. Similarly, supposing to know the road geometry (namely the position of road markings within the image), and the precise position of obstacles, a pair of stereo images can be analyzed to validate the assumption of planarity of the road surface: the stereo pair can be used to recalibrate the stereo system and adapt it to new road surfaces, such as hills, bridges, or non-planar highway ramps; the new model will replace the old one and will then be used by both OD and LD modules.
6 Static parameters Slowly changing dynamic parameters Rapidly changing dynamic parameters Rapidly changing dynamic parameters Camera Calibration START + Obstacle Detection Iterative process Lane Detection Road Model Update Obstacles Lane markings Road model Calibration Figure 4: Block diagram of the cooperative approach: the lower part depicts the data stream, while the upper part shows the control flow of the algorithm According to this cooperative approach, the OD and LD modules are triggered alternatively; each module exploits the results produced by the previous module and feeds the following one with its own results, thus keeping an updated data structure describing the three dynamic parameters sets: (1) obstacles position, (2) road geometry, and (3) road slope. This iterative process is initialized by hand when no obstacles are visible and the road in front of the vehicle is flat; the initialization phase is used to determine the calibration of the acquisition system, i.e. the static parameters. This integrated approach is depicted in figure 4. 4 Discussion In this paper the ARGO autonomous vehicle has been presented. It was demonstrated and tested on a number of different highways, freeways, and country roads in Italy. The main features of the automatic driving system are that it is based on the processing of information acquired by passive sensors only (cameras), and that the hardware system is based on low-cost off-the-shelf components only (such as video-phone cameras and a Pentium MMX processor). The whole processing takes less than 20 ms, and, since the acquisition of a single field takes 20 ms, the system reaches real-time performance. In this case, the bottleneck of the system is the acquisition time. During the tests, the system demonstrated to be robust and reliable: obstacles were always detected and only in few cases (i.e. on paved or -more generally- rough roads) vehicle movements became so considerable that the processing of noisy remapped images led to the erroneous detection of false small sized obstacles. On the other hand, thanks to the remapping process, lane markings were located even in presence of shadows or other artifacts on the road surface. Up-to-date information, as well images and video clips, can be found on ARGO s official web site: References [1] Alberto Broggi, Gianni Conte, Francesco Gregoretti, Claudio Sansoè, Roberto Passerone, and Leonardo M. Reyneri, Design and Implementation of the PAPRICA Parallel Architecture, The Journal of VLSI Signal Processing, 1997, In press. [2] H. A. Mallot, H. H. Bülthoff, J. J. Little, and S. Bohrer, Inverse perspective mapping simplifies optical flow computation and obstacle detection, Biological Cybernetics, vol. 64, pp , [3] Olivier Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint, The MIT Press, [4] Massimo Bertozzi, Alberto Broggi, and Alessandra Fascioli, Stereo Inverse Perspective Mapping: Theory and Applications, Image and Vision Computing Journal, 1998, in press. [5] Alessandra Fascioli, Localizzazione di ostacoli mediante elaborazione di immagini stereoscopiche, Master s thesis, Università degli Studi di Parma - Facoltà di Ingegneria, [6] Massimo Bertozzi and Alberto Broggi, GOLD: a Parallel Real-Time Stereo Vision System for Generic Obstacle and Lane Detection, IEEE Transactions on Image Processing, vol. 7, no. 1, pp , Jan
Real-Time Lane and Obstacle Detection on the
Real-Time Lane and Obstacle on the System Massimo Bertozzi and Alberto Broggi Dipartimento di Ingegneria dell Informazione Università di Parma, I-43100 Parma, Italy e-mail: fbertozzi,broggig@ce.unipr.it
More informationStereo Inverse Perspective Mapping: Theory and Applications
Stereo Inverse Perspective Mapping: Theory and Applications Massimo Bertozzi, Alberto Broggi, Alessandra Fascioli Dipartimento di Ingegneria dell Informazione Università di Parma, Italy e-mail: fbertozzi,broggi,fascalg@ce.unipr.it
More informationStereo inverse perspective mapping: theory and applications
Image and Vision Computing 16 (1998) 585 590 Short Communication Stereo inverse perspective mapping: theory and applications Massimo Bertozzi*, Alberto Broggi, Alessandra Fascioli Dipartimento di Ingegneria
More information(b) (a) (c) (d) (e) (f) Figure 1. (a) the ARGO experimental vehicle; (b) the cameras; (c) the electric engine installed on the steering column and the
The Experience of the ARGO Autonomous Vehicle Massimo Bertozzi, Alberto Broggi, Gianni Conte, and Alessandra Fascioli Dipartimento di Ingegneria dell'informazione Universita di Parma, I-43100 Parma, Italy
More informationSTEREO-VISION SYSTEM PERFORMANCE ANALYSIS
STEREO-VISION SYSTEM PERFORMANCE ANALYSIS M. Bertozzi, A. Broggi, G. Conte, and A. Fascioli Dipartimento di Ingegneria dell'informazione, Università di Parma Parco area delle Scienze, 181A I-43100, Parma,
More informationSelf-Calibration of a Stereo Vision System for Automotive Applications
Proceedings of the 2001 IEEE International Conference on Robotics & Automation Seoul, Korea - May 21-26, 2001 Self-Calibration of a Stereo Vision System for Automotive Applications Alberto Broggi, Massimo
More informationparco area delle Scienze, 181A via Ferrata, , Parma 27100, Pavia
Proceedings of the IEEE Intelligent Vehicles Symposium 2000 Dearbon (MI), USA October 3-5, 2000 Stereo Vision-based Vehicle Detection M. Bertozzi 1 A. Broggi 2 A. Fascioli 1 S. Nichele 2 1 Dipartimento
More informationAn Evolutionary Approach to Lane Markings Detection in Road Environments
An Evolutionary Approach to Lane Markings Detection in Road Environments M. Bertozzi, A. Broggi, A. Fascioli, A. Tibaldi Dipartimento di Ingegneria dell Informazione Università di Parma I-43100 Parma,
More informationA Cooperative Approach to Vision-based Vehicle Detection
2001 IEEE Intelligent Transportation Systems Conference Proceedings - Oakland (CA), USA - August 25-29, 2001 A Cooperative Approach to Vision-based Vehicle Detection A. Bensrhair, M. Bertozzi, A. Broggi,
More informationStereo Vision-based Feature Extraction for Vehicle Detection
Stereo Vision-based Feature Extraction for Vehicle Detection A. Bensrhair, M. Bertozzi, A. Broggi, A. Fascioli, S. Mousset, and G. Toulminet Abstract This paper presents a stereo vision system for vehicle
More informationIntelligent overhead sensor for sliding doors: a stereo based method for augmented efficiency
Intelligent overhead sensor for sliding doors: a stereo based method for augmented efficiency Luca Bombini, Alberto Broggi, Michele Buzzoni, and Paolo Medici VisLab Dipartimento di Ingegneria dell Informazione
More informationFree Space Detection on Highways using Time Correlation between Stabilized Sub-pixel precision IPM Images
Free Space Detection on Highways using Time Correlation between Stabilized Sub-pixel precision IPM Images Pietro Cerri and Paolo Grisleri Artificial Vision and Intelligent System Laboratory Dipartimento
More informationAn Efficient Obstacle Awareness Application for Android Mobile Devices
An Efficient Obstacle Awareness Application for Android Mobile Devices Razvan Itu, Radu Danescu Computer Science Department Technical University of Cluj-Napoca Cluj-Napoca, Romania itu.razvan@gmail.com,
More informationRange Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation
Obviously, this is a very slow process and not suitable for dynamic scenes. To speed things up, we can use a laser that projects a vertical line of light onto the scene. This laser rotates around its vertical
More informationIR Pedestrian Detection for Advanced Driver Assistance Systems
IR Pedestrian Detection for Advanced Driver Assistance Systems M. Bertozzi 1, A. Broggi 1, M. Carletti 1, A. Fascioli 1, T. Graf 2, P. Grisleri 1, and M. Meinecke 2 1 Dipartimento di Ingegneria dell Informazione
More informationOn Road Vehicle Detection using Shadows
On Road Vehicle Detection using Shadows Gilad Buchman Grasp Lab, Department of Computer and Information Science School of Engineering University of Pennsylvania, Philadelphia, PA buchmag@seas.upenn.edu
More informationLow-level Image Processing for Lane Detection and Tracking
Low-level Image Processing for Lane Detection and Tracking Ruyi Jiang 1, Mutsuhiro Terauchi 2, Reinhard Klette 3, Shigang Wang 1, and Tobi Vaudrey 3 1 Shanghai Jiao Tong University, Shanghai, China 2 Hiroshima
More informationLow-level Image Processing for Lane Detection and Tracking
Low-level Image Processing for Lane Detection and Tracking Ruyi Jiang 1, Reinhard Klette 2, Shigang Wang 1, and Tobi Vaudrey 2 1 Shanghai Jiao Tong University, Shanghai, China 2 The University of Auckland,
More informationDepth. Common Classification Tasks. Example: AlexNet. Another Example: Inception. Another Example: Inception. Depth
Common Classification Tasks Recognition of individual objects/faces Analyze object-specific features (e.g., key points) Train with images from different viewing angles Recognition of object classes Analyze
More informationInfrared Stereo Vision-based Pedestrian Detection
Infrared Stereo Vision-based Pedestrian Detection M. Bertozzi, A. Broggi, and A. Lasagni Dipartimento di Ingegneria dell Informazione Università di Parma Parma, I-43100, Italy {bertozzi,broggi,lasagni}@ce.unipr.it
More information3D Modeling of Objects Using Laser Scanning
1 3D Modeling of Objects Using Laser Scanning D. Jaya Deepu, LPU University, Punjab, India Email: Jaideepudadi@gmail.com Abstract: In the last few decades, constructing accurate three-dimensional models
More informationBowling for Calibration: An Undemanding Camera Calibration Procedure Using a Sphere
Bowling for Calibration: An Undemanding Camera Calibration Procedure Using a Sphere Pietro Cerri, Oscar Gerelli, and Dario Lodi Rizzini Dipartimento di Ingegneria dell Informazione Università degli Studi
More informationThe Evolution of a Massively Parallel Vision System for Real-Time Automotive Image Processing
The Evolution of a Massively Parallel Vision System for Real-Time Automotive Image Processing Alberto Broggi Dipartimento di Ingegneria dell Informazione UniversitàdiParma Parma, ITALY, I-43 Abstract This
More informationPaper title: A Multi-resolution Approach for Infrared Vision-based Pedestrian Detection
Paper title: A Multi-resolution Approach for Infrared Vision-based Pedestrian Detection Authors: A. Broggi, A. Fascioli, M. Carletti, T. Graf, and M. Meinecke Technical categories: Vehicle Environment
More informationMotion Analysis. Motion analysis. Now we will talk about. Differential Motion Analysis. Motion analysis. Difference Pictures
Now we will talk about Motion Analysis Motion analysis Motion analysis is dealing with three main groups of motionrelated problems: Motion detection Moving object detection and location. Derivation of
More informationCONTRIBUTION TO THE INVESTIGATION OF STOPPING SIGHT DISTANCE IN THREE-DIMENSIONAL SPACE
National Technical University of Athens School of Civil Engineering Department of Transportation Planning and Engineering Doctoral Dissertation CONTRIBUTION TO THE INVESTIGATION OF STOPPING SIGHT DISTANCE
More informationStereo Vision. MAN-522 Computer Vision
Stereo Vision MAN-522 Computer Vision What is the goal of stereo vision? The recovery of the 3D structure of a scene using two or more images of the 3D scene, each acquired from a different viewpoint in
More informationarxiv: v1 [cs.cv] 28 Sep 2018
Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,
More informationDense 3D Reconstruction. Christiano Gava
Dense 3D Reconstruction Christiano Gava christiano.gava@dfki.de Outline Previous lecture: structure and motion II Structure and motion loop Triangulation Today: dense 3D reconstruction The matching problem
More informationMulti-View Stereo for Static and Dynamic Scenes
Multi-View Stereo for Static and Dynamic Scenes Wolfgang Burgard Jan 6, 2010 Main references Yasutaka Furukawa and Jean Ponce, Accurate, Dense and Robust Multi-View Stereopsis, 2007 C.L. Zitnick, S.B.
More informationTxDOT Video Analytics System User Manual
TxDOT Video Analytics System User Manual Product 0-6432-P1 Published: August 2012 1 TxDOT VA System User Manual List of Figures... 3 1 System Overview... 4 1.1 System Structure Overview... 4 1.2 System
More informationFeature Transfer and Matching in Disparate Stereo Views through the use of Plane Homographies
Feature Transfer and Matching in Disparate Stereo Views through the use of Plane Homographies M. Lourakis, S. Tzurbakis, A. Argyros, S. Orphanoudakis Computer Vision and Robotics Lab (CVRL) Institute of
More informationComplex Sensors: Cameras, Visual Sensing. The Robotics Primer (Ch. 9) ECE 497: Introduction to Mobile Robotics -Visual Sensors
Complex Sensors: Cameras, Visual Sensing The Robotics Primer (Ch. 9) Bring your laptop and robot everyday DO NOT unplug the network cables from the desktop computers or the walls Tuesday s Quiz is on Visual
More informationTransactions on Information and Communications Technologies vol 16, 1996 WIT Press, ISSN
ransactions on Information and Communications echnologies vol 6, 996 WI Press, www.witpress.com, ISSN 743-357 Obstacle detection using stereo without correspondence L. X. Zhou & W. K. Gu Institute of Information
More informationCITS 4402 Computer Vision
CITS 4402 Computer Vision A/Prof Ajmal Mian Adj/A/Prof Mehdi Ravanbakhsh, CEO at Mapizy (www.mapizy.com) and InFarm (www.infarm.io) Lecture 02 Binary Image Analysis Objectives Revision of image formation
More informationStochastic Road Shape Estimation, B. Southall & C. Taylor. Review by: Christopher Rasmussen
Stochastic Road Shape Estimation, B. Southall & C. Taylor Review by: Christopher Rasmussen September 26, 2002 Announcements Readings for next Tuesday: Chapter 14-14.4, 22-22.5 in Forsyth & Ponce Main Contributions
More informationOvertaking Vehicle Detection Using Implicit Optical Flow
Overtaking Vehicle Detection Using Implicit Optical Flow Parag H. Batavia Dean A. Pomerleau Charles E. Thorpe Robotics Institute - Carnegie Mellon University Pittsburgh, PA, USA Keywords - Optical Flow,
More information3D-OBJECT DETECTION METHOD BASED ON THE STEREO IMAGE TRANSFORMATION TO THE COMMON OBSERVATION POINT
3D-OBJECT DETECTION METHOD BASED ON THE STEREO IMAGE TRANSFORMATION TO THE COMMON OBSERVATION POINT V. M. Lisitsyn *, S. V. Tikhonova ** State Research Institute of Aviation Systems, Moscow, Russia * lvm@gosniias.msk.ru
More informationStereo. 11/02/2012 CS129, Brown James Hays. Slides by Kristen Grauman
Stereo 11/02/2012 CS129, Brown James Hays Slides by Kristen Grauman Multiple views Multi-view geometry, matching, invariant features, stereo vision Lowe Hartley and Zisserman Why multiple views? Structure
More informationProcessing 3D Surface Data
Processing 3D Surface Data Computer Animation and Visualisation Lecture 17 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing
More informationOption Driver Assistance. Product Information
Product Information Table of Contents 1 Overview... 3 1.1 Introduction... 3 1.2 Features and Advantages... 3 1.3 Application Areas... 4 1.4 Further Information... 5 2 Functions... 5 3 Creating the Configuration
More informationResearch Article StereoBox: A Robust and Efficient Solution for Automotive Short-Range Obstacle Detection
Hindawi Publishing Corporation EURASIP Journal on Embedded Systems Volume 2007, Article ID 70256, 7 pages doi:10.1155/2007/70256 Research Article StereoBox: A Robust and Efficient Solution for Automotive
More informationStereo Vision Based Advanced Driver Assistance System
Stereo Vision Based Advanced Driver Assistance System Ho Gi Jung, Yun Hee Lee, Dong Suk Kim, Pal Joo Yoon MANDO Corp. 413-5,Gomae-Ri, Yongin-Si, Kyongi-Do, 449-901, Korea Phone: (82)31-0-5253 Fax: (82)31-0-5496
More informationDense 3D Reconstruction. Christiano Gava
Dense 3D Reconstruction Christiano Gava christiano.gava@dfki.de Outline Previous lecture: structure and motion II Structure and motion loop Triangulation Wide baseline matching (SIFT) Today: dense 3D reconstruction
More informationCorrespondence and Stereopsis. Original notes by W. Correa. Figures from [Forsyth & Ponce] and [Trucco & Verri]
Correspondence and Stereopsis Original notes by W. Correa. Figures from [Forsyth & Ponce] and [Trucco & Verri] Introduction Disparity: Informally: difference between two pictures Allows us to gain a strong
More informationPresented at the FIG Congress 2018, May 6-11, 2018 in Istanbul, Turkey
Presented at the FIG Congress 2018, May 6-11, 2018 in Istanbul, Turkey Evangelos MALTEZOS, Charalabos IOANNIDIS, Anastasios DOULAMIS and Nikolaos DOULAMIS Laboratory of Photogrammetry, School of Rural
More informationReal Time Obstacle Detection in Stereovision on Non Flat Road Geometry Through V-disparity Representation.
Real Time Obstacle Detection in Stereovision on Non Flat Road Geometry Through V-disparity Representation. Raphael Labayrade, Didier Aubert, Jean-Philippe Tarel Abstract Many roads are not totaly planar
More informationImage Formation. Antonino Furnari. Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania
Image Formation Antonino Furnari Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania furnari@dmi.unict.it 18/03/2014 Outline Introduction; Geometric Primitives
More informationEVALUATION OF SEQUENTIAL IMAGES FOR PHOTOGRAMMETRICALLY POINT DETERMINATION
Archives of Photogrammetry, Cartography and Remote Sensing, Vol. 22, 2011, pp. 285-296 ISSN 2083-2214 EVALUATION OF SEQUENTIAL IMAGES FOR PHOTOGRAMMETRICALLY POINT DETERMINATION Michał Kowalczyk 1 1 Department
More informationBall detection and predictive ball following based on a stereoscopic vision system
Research Collection Conference Paper Ball detection and predictive ball following based on a stereoscopic vision system Author(s): Scaramuzza, Davide; Pagnottelli, Stefano; Valigi, Paolo Publication Date:
More informationReal-time Stereo Vision for Urban Traffic Scene Understanding
Proceedings of the IEEE Intelligent Vehicles Symposium 2000 Dearborn (MI), USA October 3-5, 2000 Real-time Stereo Vision for Urban Traffic Scene Understanding U. Franke, A. Joos DaimlerChrylser AG D-70546
More informationChapter 3 Image Registration. Chapter 3 Image Registration
Chapter 3 Image Registration Distributed Algorithms for Introduction (1) Definition: Image Registration Input: 2 images of the same scene but taken from different perspectives Goal: Identify transformation
More informationMotion estimation of unmanned marine vehicles Massimo Caccia
Motion estimation of unmanned marine vehicles Massimo Caccia Consiglio Nazionale delle Ricerche Istituto di Studi sui Sistemi Intelligenti per l Automazione Via Amendola 122 D/O, 70126, Bari, Italy massimo.caccia@ge.issia.cnr.it
More informationMULTI-PEAK RANGE IMAGING FOR ACCURATE 3D RECONSTRUCTION OF SPECULAR OBJECTS. John Park and Avinash C. Kak
MULTI-PEAK RANGE IMAGING FOR ACCURATE 3D RECONSTRUCTION OF SPECULAR OBJECTS John Park and Avinash C. Kak Robot Vision Laboratory, Purdue University 185 EE Building, West Lafayette, IN. 47907-185 {jpark,kak}@purdue.edu
More informationSUMMARY: DISTINCTIVE IMAGE FEATURES FROM SCALE- INVARIANT KEYPOINTS
SUMMARY: DISTINCTIVE IMAGE FEATURES FROM SCALE- INVARIANT KEYPOINTS Cognitive Robotics Original: David G. Lowe, 004 Summary: Coen van Leeuwen, s1460919 Abstract: This article presents a method to extract
More informationCritique: Efficient Iris Recognition by Characterizing Key Local Variations
Critique: Efficient Iris Recognition by Characterizing Key Local Variations Authors: L. Ma, T. Tan, Y. Wang, D. Zhang Published: IEEE Transactions on Image Processing, Vol. 13, No. 6 Critique By: Christopher
More informationA Low Power, High Throughput, Fully Event-Based Stereo System: Supplementary Documentation
A Low Power, High Throughput, Fully Event-Based Stereo System: Supplementary Documentation Alexander Andreopoulos, Hirak J. Kashyap, Tapan K. Nayak, Arnon Amir, Myron D. Flickner IBM Research March 25,
More informationLane Markers Detection based on Consecutive Threshold Segmentation
ISSN 1746-7659, England, UK Journal of Information and Computing Science Vol. 6, No. 3, 2011, pp. 207-212 Lane Markers Detection based on Consecutive Threshold Segmentation Huan Wang +, Mingwu Ren,Sulin
More informationMulti-view stereo. Many slides adapted from S. Seitz
Multi-view stereo Many slides adapted from S. Seitz Beyond two-view stereo The third eye can be used for verification Multiple-baseline stereo Pick a reference image, and slide the corresponding window
More informationChapters 1 7: Overview
Chapters 1 7: Overview Photogrammetric mapping: introduction, applications, and tools GNSS/INS-assisted photogrammetric and LiDAR mapping LiDAR mapping: principles, applications, mathematical model, and
More informationStructured Light II. Guido Gerig CS 6320, Spring (thanks: slides Prof. S. Narasimhan, CMU, Marc Pollefeys, UNC)
Structured Light II Guido Gerig CS 6320, Spring 2013 (thanks: slides Prof. S. Narasimhan, CMU, Marc Pollefeys, UNC) http://www.cs.cmu.edu/afs/cs/academic/class/15385- s06/lectures/ppts/lec-17.ppt Variant
More informationProcessing 3D Surface Data
Processing 3D Surface Data Computer Animation and Visualisation Lecture 12 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing
More informationAn Efficient Single Chord-based Accumulation Technique (SCA) to Detect More Reliable Corners
An Efficient Single Chord-based Accumulation Technique (SCA) to Detect More Reliable Corners Mohammad Asiful Hossain, Abdul Kawsar Tushar, and Shofiullah Babor Computer Science and Engineering Department,
More informationMachine learning based automatic extrinsic calibration of an onboard monocular camera for driving assistance applications on smart mobile devices
Technical University of Cluj-Napoca Image Processing and Pattern Recognition Research Center www.cv.utcluj.ro Machine learning based automatic extrinsic calibration of an onboard monocular camera for driving
More informationcoding of various parts showing different features, the possibility of rotation or of hiding covering parts of the object's surface to gain an insight
Three-Dimensional Object Reconstruction from Layered Spatial Data Michael Dangl and Robert Sablatnig Vienna University of Technology, Institute of Computer Aided Automation, Pattern Recognition and Image
More informationDetecting motion by means of 2D and 3D information
Detecting motion by means of 2D and 3D information Federico Tombari Stefano Mattoccia Luigi Di Stefano Fabio Tonelli Department of Electronics Computer Science and Systems (DEIS) Viale Risorgimento 2,
More informationPerception. Autonomous Mobile Robots. Sensors Vision Uncertainties, Line extraction from laser scans. Autonomous Systems Lab. Zürich.
Autonomous Mobile Robots Localization "Position" Global Map Cognition Environment Model Local Map Path Perception Real World Environment Motion Control Perception Sensors Vision Uncertainties, Line extraction
More informationMeasurements using three-dimensional product imaging
ARCHIVES of FOUNDRY ENGINEERING Published quarterly as the organ of the Foundry Commission of the Polish Academy of Sciences ISSN (1897-3310) Volume 10 Special Issue 3/2010 41 46 7/3 Measurements using
More informationGaze interaction (2): models and technologies
Gaze interaction (2): models and technologies Corso di Interazione uomo-macchina II Prof. Giuseppe Boccignone Dipartimento di Scienze dell Informazione Università di Milano boccignone@dsi.unimi.it http://homes.dsi.unimi.it/~boccignone/l
More informationProf. Fanny Ficuciello Robotics for Bioengineering Visual Servoing
Visual servoing vision allows a robotic system to obtain geometrical and qualitative information on the surrounding environment high level control motion planning (look-and-move visual grasping) low level
More informationMotion and Tracking. Andrea Torsello DAIS Università Ca Foscari via Torino 155, Mestre (VE)
Motion and Tracking Andrea Torsello DAIS Università Ca Foscari via Torino 155, 30172 Mestre (VE) Motion Segmentation Segment the video into multiple coherently moving objects Motion and Perceptual Organization
More informationLight source estimation using feature points from specular highlights and cast shadows
Vol. 11(13), pp. 168-177, 16 July, 2016 DOI: 10.5897/IJPS2015.4274 Article Number: F492B6D59616 ISSN 1992-1950 Copyright 2016 Author(s) retain the copyright of this article http://www.academicjournals.org/ijps
More informationDetection and Classification of Painted Road Objects for Intersection Assistance Applications
Detection and Classification of Painted Road Objects for Intersection Assistance Applications Radu Danescu, Sergiu Nedevschi, Member, IEEE Abstract For a Driving Assistance System dedicated to intersection
More informationLooming Motion Segmentation in Vehicle Tracking System using Wavelet Transforms
Looming Motion Segmentation in Vehicle Tracking System using Wavelet Transforms K. SUBRAMANIAM, S. SHUKLA, S.S. DLAY and F.C. RIND Department of Electrical and Electronic Engineering University of Newcastle-Upon-Tyne
More informationHuman Detection. A state-of-the-art survey. Mohammad Dorgham. University of Hamburg
Human Detection A state-of-the-art survey Mohammad Dorgham University of Hamburg Presentation outline Motivation Applications Overview of approaches (categorized) Approaches details References Motivation
More information3D DEFORMATION MEASUREMENT USING STEREO- CORRELATION APPLIED TO EXPERIMENTAL MECHANICS
3D DEFORMATION MEASUREMENT USING STEREO- CORRELATION APPLIED TO EXPERIMENTAL MECHANICS Dorian Garcia, Jean-José Orteu École des Mines d Albi, F-81013 ALBI CT Cedex 09, France Dorian.Garcia@enstimac.fr,
More informationDigital Image Processing COSC 6380/4393
Digital Image Processing COSC 6380/4393 Lecture 21 Nov 16 th, 2017 Pranav Mantini Ack: Shah. M Image Processing Geometric Transformation Point Operations Filtering (spatial, Frequency) Input Restoration/
More informationTecnologie per la ricostruzione di modelli 3D da immagini. Marco Callieri ISTI-CNR, Pisa, Italy
Tecnologie per la ricostruzione di modelli 3D da immagini Marco Callieri ISTI-CNR, Pisa, Italy Who am I? Marco Callieri PhD in computer science Always had the like for 3D graphics... Researcher at the
More informationarxiv: v1 [cs.cv] 27 Jan 2015
A Cheap System for Vehicle Speed Detection Chaim Ginzburg, Amit Raphael and Daphna Weinshall School of Computer Science and Engineering, Hebrew University of Jerusalem, Israel arxiv:1501.06751v1 [cs.cv]
More informationScene Text Detection Using Machine Learning Classifiers
601 Scene Text Detection Using Machine Learning Classifiers Nafla C.N. 1, Sneha K. 2, Divya K.P. 3 1 (Department of CSE, RCET, Akkikkvu, Thrissur) 2 (Department of CSE, RCET, Akkikkvu, Thrissur) 3 (Department
More informationSTEREO VISION AND LASER STRIPERS FOR THREE-DIMENSIONAL SURFACE MEASUREMENTS
XVI CONGRESO INTERNACIONAL DE INGENIERÍA GRÁFICA STEREO VISION AND LASER STRIPERS FOR THREE-DIMENSIONAL SURFACE MEASUREMENTS BARONE, Sandro; BRUNO, Andrea University of Pisa Dipartimento di Ingegneria
More informationTHE development of in-vehicle assistance systems dedicated
1666 IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 53, NO. 6, NOVEMBER 2004 Pedestrian Detection for Driver Assistance Using Multiresolution Infrared Vision Massimo Bertozzi, Associate Member, IEEE,
More information(Refer Slide Time 00:17) Welcome to the course on Digital Image Processing. (Refer Slide Time 00:22)
Digital Image Processing Prof. P. K. Biswas Department of Electronics and Electrical Communications Engineering Indian Institute of Technology, Kharagpur Module Number 01 Lecture Number 02 Application
More informationFast Denoising for Moving Object Detection by An Extended Structural Fitness Algorithm
Fast Denoising for Moving Object Detection by An Extended Structural Fitness Algorithm ALBERTO FARO, DANIELA GIORDANO, CONCETTO SPAMPINATO Dipartimento di Ingegneria Informatica e Telecomunicazioni Facoltà
More informationФУНДАМЕНТАЛЬНЫЕ НАУКИ. Информатика 9 ИНФОРМАТИКА MOTION DETECTION IN VIDEO STREAM BASED ON BACKGROUND SUBTRACTION AND TARGET TRACKING
ФУНДАМЕНТАЛЬНЫЕ НАУКИ Информатика 9 ИНФОРМАТИКА UDC 6813 OTION DETECTION IN VIDEO STREA BASED ON BACKGROUND SUBTRACTION AND TARGET TRACKING R BOGUSH, S ALTSEV, N BROVKO, E IHAILOV (Polotsk State University
More informationFundamentals of Stereo Vision Michael Bleyer LVA Stereo Vision
Fundamentals of Stereo Vision Michael Bleyer LVA Stereo Vision What Happened Last Time? Human 3D perception (3D cinema) Computational stereo Intuitive explanation of what is meant by disparity Stereo matching
More informationCHAPTER 3. Single-view Geometry. 1. Consequences of Projection
CHAPTER 3 Single-view Geometry When we open an eye or take a photograph, we see only a flattened, two-dimensional projection of the physical underlying scene. The consequences are numerous and startling.
More informationColor Characterization and Calibration of an External Display
Color Characterization and Calibration of an External Display Andrew Crocker, Austin Martin, Jon Sandness Department of Math, Statistics, and Computer Science St. Olaf College 1500 St. Olaf Avenue, Northfield,
More informationPedestrian Localization and Tracking System with Kalman Filtering
Pedestrian Localization and Tracking System with Kalman Filtering M. Bertozzi, A. Broggi, A. Fascioli, A. Tibaldi Dipartimento di Ingegneria dell Informazione Università di Parma Parma, I-43100, ITALY
More informationMultiple View Geometry
Multiple View Geometry CS 6320, Spring 2013 Guest Lecture Marcel Prastawa adapted from Pollefeys, Shah, and Zisserman Single view computer vision Projective actions of cameras Camera callibration Photometric
More informationChapter 4. Chapter 4. Computer Graphics 2006/2007 Chapter 4. Introduction to 3D 1
Chapter 4 Chapter 4 Chapter 4. Introduction to 3D graphics 4.1 Scene traversal 4.2 Modeling transformation 4.3 Viewing transformation 4.4 Clipping 4.5 Hidden faces removal 4.6 Projection 4.7 Lighting 4.8
More informationT his paper discusses the main architectural issues of a challenging application of real-time
Real-Time Imaging 6, 313±324 (2000) doi:10.1006/rtim.1999.0191, available online at http://www.idealibrary.com on Architectural Issues on Vision-Based Automatic Vehicle Guidance: The Experience of the
More informationIntroduction to 3D Machine Vision
Introduction to 3D Machine Vision 1 Many methods for 3D machine vision Use Triangulation (Geometry) to Determine the Depth of an Object By Different Methods: Single Line Laser Scan Stereo Triangulation
More informationcse 252c Fall 2004 Project Report: A Model of Perpendicular Texture for Determining Surface Geometry
cse 252c Fall 2004 Project Report: A Model of Perpendicular Texture for Determining Surface Geometry Steven Scher December 2, 2004 Steven Scher SteveScher@alumni.princeton.edu Abstract Three-dimensional
More informationMeasurement of 3D Foot Shape Deformation in Motion
Measurement of 3D Foot Shape Deformation in Motion Makoto Kimura Masaaki Mochimaru Takeo Kanade Digital Human Research Center National Institute of Advanced Industrial Science and Technology, Japan The
More informationPractice Exam Sample Solutions
CS 675 Computer Vision Instructor: Marc Pomplun Practice Exam Sample Solutions Note that in the actual exam, no calculators, no books, and no notes allowed. Question 1: out of points Question 2: out of
More informationCOMPARATIVE STUDY OF DIFFERENT APPROACHES FOR EFFICIENT RECTIFICATION UNDER GENERAL MOTION
COMPARATIVE STUDY OF DIFFERENT APPROACHES FOR EFFICIENT RECTIFICATION UNDER GENERAL MOTION Mr.V.SRINIVASA RAO 1 Prof.A.SATYA KALYAN 2 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING PRASAD V POTLURI SIDDHARTHA
More informationEXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,
School of Computer Science and Communication, KTH Danica Kragic EXAM SOLUTIONS Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006, 14.00 19.00 Grade table 0-25 U 26-35 3 36-45
More informationTecnologie per la ricostruzione di modelli 3D da immagini. Marco Callieri ISTI-CNR, Pisa, Italy
Tecnologie per la ricostruzione di modelli 3D da immagini Marco Callieri ISTI-CNR, Pisa, Italy 3D from Photos Our not-so-secret dream: obtain a reliable and precise 3D from simple photos Why? Easier, less
More informationDesigning Applications that See Lecture 7: Object Recognition
stanford hci group / cs377s Designing Applications that See Lecture 7: Object Recognition Dan Maynes-Aminzade 29 January 2008 Designing Applications that See http://cs377s.stanford.edu Reminders Pick up
More information