Stereo Vision Image Processing Strategy for Moving Object Detecting
|
|
- Trevor Houston
- 6 years ago
- Views:
Transcription
1 Stereo Vision Image Processing Strategy for Moving Object Detecting SHIUH-JER HUANG, FU-REN YING Department of Mechanical Engineering National Taiwan University of Science and Technology No. 43, Keelung Road, Section 4, Taipei, 16, TAIWAN Abstract: - Here, a TMS32C6416 DSK board is integrated with two CMOS color image sensors to construct a new stereovision platform instead of current PC based or multi-cpu combination structures for detecting moving objects. A novel moving object detecting strategy is proposed by combining the image temporal differencing and the sum of absolute difference (SAD) matching schemes. This system can detect and track any moving object without object color and shape limitations. The subtraction image processing technique is employed to detect the moving object first based on single image. Then, the edge and SAD stereo matching schemes are used to establish the coordinate relationship of left-right two images. Finally, the depth of a moving object can be estimated for 3D position calculation based on stereo geometry relationship. Experimental results are used to evaluate this system dynamic performance. Key-Words: - Stereo vision, CMOS image sensor, and moving object detecting strategy. 1 Introduction Machine vision has been widely applied in a lot of 2D fields accompanied with the quick progressing of image processing technique[1]. The basic principle of human eyes can distinguish near and far objects is that human brain utilizes the view difference of two eyes images to convert into object depth information. Hence, two or more video cameras are selected to simulate two eyes function for constructing stereo vision systems [2]. Stereo vision system acquires two images from two corresponding cameras simultaneously. Specific mathematical operations software programs are designed and loaded into image processing CPU to simulate the images view difference calculation process. Then, the object depth information in an image can be derived from the sum of square difference (SSD) calculation of two images. How to extract the moving object from two 2D images becomes an important stereo image processing technique. Bae et. al [3] developed a stereo object tracking system by using two video cameras. The depth distribution information of both images can be calculated based on minimum mean of absolute difference scheme to establish disparity motion vector. Yoneyama et. al [4] used the motion vector information of Mpeg Video Stream to detect moving object location. Background subtraction scheme was used to identify a moving object [5] by comparing the current captured image with a preinput background image. The area with subtraction residue will be the coming or moving object. However, the basic background subtraction scheme has strict limitation on fixed background environment to achieve accurate identification. Hence, mathematical modeling analysis technique was employed to construct the background model and the mapping of environmental change [6]. Since background modeling needs complicate mathematical derivation and huge computing operations, the continuous images subtraction method is proposed to simplify this modeling analysis process. The new extracted image is used to compare with last captured image without input background information. The difference zone between those two images is defined as moving object location [7]. However, how to develop an ingenious stereo vision system with simple structure and low cost for stand-alone application is still a challenge work. Here, TMS32C6416 DSK board is integrated with two CMOS color image sensors to construct a stereo vision platform for acquiring and locating moving objects. A novel moving object detecting technique is proposed by combining the image temporal difference and the sum of absolute difference (SAD) matching schemes. Experimental results are used to evaluate the feasibility and reliability of this stereo vision system. ISSN: ISBN:
2 2 Stereo Vision and Image Extracting System Structure The overall DSP based stereo vision system structure is shown in Fig. 1. In order to integrate the DSK developing board and CMOS image sensors into a stereo vision system, the accompanied communication interface, image extracting daughter card, image pre-processing and appropriate time sequence control software need be designed and built. Since stereo vision is based on two CMOS images to calculate 3D coordinates, the extracted images synchronize is very important. Hence an appropriate checking process should be designed into the control software or this daughter circuit. In order to guarantee the synchronous transmission of raw data from two CMOS image sensors, data contents should be inspected at the end of first data receiving process. The feature of ineffective DARK pixels in data format has fixed location can be specified as the checking point. If both received image raw data formats are not matched, the OE enable control signal is re-started and checked it again. When DSK board receives two sets of synchronous image raw data, following color interpolation, brightness compensation and image gray scale calculation of image pre-processing operations are employed to recover the raw data into useful image information. The overall image extraction process flow chart is shown in Fig. 2. Since the commercial CMOS color image sensor has been installed a color filter array (CFA) ahead the image plane to obtain the RGB three different colors signals. Each pixel only need one sensor and provides one of the RGB color. Hence, un-sampling two colors should be calculated by using the interpolation operation. Here, the bilinear interpolation calculation [9] is employed. YCbCr color space is widely applied on digital image color space representation. Human eye has good acuminous with respect to brightness Y and it is described as image gray signal and the aberration signals are presented as Cb and Cr. The image preprocessing has transformed the 8 bits image raw data of the pixel into 24 bits RBG color space data. In order to reduce the un-necessary calculation of DSP processor, the RGB image data is converted into 8 bits gray signal again by the following formula Y.299 = Cr.167 Cb R.5 G.813 B (1) Fig. 1 Stereo vision system hardware structure. Fig. 2 Flow chart of image extraction process. 3 Object Detecting and Recognizing Strategy How to distinguish the object and background in an image is an important technique for machine vision practical application. Background subtraction scheme [5] used a pre-defined environmental background model stored in database for comparing with current captured image. Its robustness is limited to fixed background condition. Hence, mathematical modeling analysis technique was employed to construct background environmental change and mapping [6]. However, the background model transformation and mathematical operation are very complicate. Those methods all need predefined environmental background and object shape or color [7]. Their autonomous practical application is limited. Hence how to develop a robust moving object detecting scheme without environment and object feature limitations is a desirous research target. Here, a new recognition technique is proposed by combining the image temporal differencing strategy and the sum of absolute difference operation to detect and track the moving object inside an image with a moving block searching scheme. It can effectively reduce the computing time and achieve better system performance for movable platform application. ISSN: ISBN:
3 (A) Moving object captured and targeted If the background environment has certain change due to shadow and brightness variation or the platform moving, this background subtraction algorithm is difficult to compensate this change for accurately detecting moving object. Hence two following images temporal differencing technique was proposed to extend the application of background subtraction scheme. When the last image is subtracted from the current image, the area with moving object will have larger gray scale difference. Hence a threshold value can be selected to distinguish the moving object and background shifting just like image binary operation. The area with gray scale differential value larger than threshold value is marked as possible moving object location as Fig. 3. Fig. 3 Two flowing images subtraction for detecting moving object demonstration. It can be observed that two continuous images subtraction can only find the possible moving object zone. If the precise object location need be identified, it needs additional image processing techniques for managing this marked area. For example, object shape characteristic and specific color can be further employed to identify it. Here, the following images subtraction operation is extended to three following images subtraction for accurately marking the moving object location. Three following images subtraction operations can obtain two marked possible moving object zones. Then the precise moving object location can be identified based on intersection mathematical operation are described in eq. (2) to eq. (4). The geometry relationship explanation is depicted in Fig. 4. Dift 2, t 1 Dif t 1, t object t 1 Fig. 4 Three following images subtraction and intersection image operation flow. Dif Dif heightwidth t 2, t 1 = Binary framet 2( framet 1( ) x= y= ( (2) height width t 1, t = Binaryframe t 1( framex t(, ) x= y= ( (3) object t 1 = Dif t 2, t 1 Dif t 1, t (4) Binary(a) = 1, if(a > threshold), otherwise where frame t is the image at time t, frame t ( is the pixel gray scale at position ( in time t image, object is the possible moving t object zone at time t and Dif is the subtraction t, t +1 absolute value of frame t and frame t+ 1. (B) Moving object tracking Then, the image processing strategy is switched from continuous subtraction operation to the sum of absolute difference (SAD) scheme after the possible moving object zone was found. SAD method uses a reference moving object pattern to search the minimum SAD value within a specified area in next acquired image for locating the moving object translation position. The precise moving object extracted from last continuous subtraction operation can be selected as the reference moving object pattern for SAD operation. It is mathematical equation is ( ref H 1) ( ref W 1) SAD ( = framex ( + i, y+ j) ref( (5) i= j= where SAD( is the SAD calculation value at point ( inside the specified area, frame represents current image, ref depicts the moving object reference pattern, ref H and refw are the height and width of reference pattern, respectively. The position with minimum SAD value is specified as the new location of this moving object. Then the reference moving object pattern, ref H and refw, and the specified searching area are updated for next step operation. For effective combining both moving object detecting algorithms and achieving accurate moving object tracking purpose, a software monitoring control program is designed for its system. (C) CMOS Stereo vision structure ISSN: ISBN:
4 Since the targeted 2D moving object block is found based on single image of CMOS sensor only, we need another extracted image information come from the second CMOS sensor located at different position for comparison to derive the depth information of this moving object. The depth information can be calculated based on the optical geometrical relationship of both left-right image sensors, as Fig. 5. installed with parallel optical axes, they will be expected to have a horizontal direction pixels shifting. Hence the searching area on right hand side image is limited to about the same height as that of reference moving object pattern with two more pixel rows, as Fig. 7. (a) (b) Fig. 5 Relationship between stereo vision geometry and depth. optical (D) Two images stereo matching Stereo matching is to locate a specified target point of an object on a pair of left-right images with a fixed position dislocation. Their dislocation value can be used for 3D coordinate calculation. The passive stereo matching methods are performed by using the characteristic point of left-right images, for example: direct matching, block gray scale comparison, edge, projection.etc. Here the edge matching and direct matching schemes are described. Sobel [9] gradient operation is widely employed to find the gray scale variation of a picture for object edges detection. After taking Sobel edge detection operation for both left-right images, two sets of binary edge images are obtained as Fig 6 (a). A horizontal epipolar line is drawn on both binary edge images with the same height. The edge lines on both images will be cut into a couple of segments as Fig. 6 (b). Each segment length of both images is calculated and stored sequentially for comparison. It can be observed that L3 ~ L6 are corresponding to R2 ~ R5. The summation difference between left hand side segments and right side segments pixel numbers is the horizontal image shifting of left-right images. When the SAD scheme has targeted a moving object based on right hand side CMOS image, the reference moving object pattern is updated and used to search the matching object on left hand side image. Since two CMOS image sensors of the proposed stereo vision system are horizontally Fig. 6 (a) Binary edges images and (b) segment number cut by epipolar line. Fig. 7 Searching area definition by using SAD direct stereo matching. (E) Object depth estimation and 3D coordinate calculation: After the moving object is targeted and the stereo matching operation is completed, the object depth could be estimated for 3D coordinate calculation. The optical geometry relationship of this stereo vision system can be displayed as Fig. 5. Then the object depth D can be derived as s f D = (6) l + r where f is the CMOS focus, s is the distance between both CMOS sensors. L and r are the lengths with respect to left and right CMOS optical axes, respectively. Then 3D coordinates of this moving ISSN: ISBN:
5 object can be calculated based on the defined coordinate direction. Y = D f y X = D f x Z = D (7) 4 System Performance Evaluation and Experimental Results A DSK developing board based stereo vision system is constructed for real-time moving object detecting purpose. The overall system flow chart is shown in Fig. 8. In order to evaluate this stereo vision system performance and implementation limitation, following experiments are planned and investigated. The executing times of raw data extraction, continuous image subtraction, SAD moving object tracking, SAD stereo matching and edge stereo matching operations are about , , 1.756, 4.71 and ms, respectively. Here 24.5 ms is chosen as the synchronize signal for satisfying the ms full image raw data extracting requirement. The edge stereo matching and 3D coordinates calculation operation time is less than 5 ms. subtraction operations, respectively. The white color part represents the area with image change. Taking intersection operation from these two binary subtraction images can obtain the targeted reference moving object pattern with white boundary. After the moving object is targeted, the software control program is switched to SAD moving object tracking algorithm by using the reference moving object pattern established from images subtraction scheme. This SAD pattern matching operation is worked on the specified SAD searching range and the reference moving object pattern is updated continuously for adapting to the object moving condition change. Fig. 8 DSP based stereo vision overall system flow chart. Here, continuous images subtraction scheme is used to detect the moving object and target its location in image. If a running ball is moving into the stereo vision working space, the system is started to detect and target the moving object. Fig. 9 shows three continuous images at time step t-1, t and t+1 and the binary pictures of two relative Fig. 9 Three following images subtraction and moving object targeted in binary pictures. After the image edges of SAD reference moving object pattern are targeted, an epipolar line is marked on these edge patterns of both left-right images to calculate the characteristic interval for stereo matching comparison as Fig. 1. Then a 3D working space motion track with significant vertical direction change is planned for a moving ball to execute the moving object tracking experiment. When the ball is moving into system visual range and the moving ball has been targeted, the ball motion is changed into move by operator hand in the specified track. The experimental results are shown in Fig. 11. It can be observed that this stereo vision system can effectively track the ball motion in 3D working space. 5 Conclusion A novel low cost stereo vision system is designed for 3D moving object detecting and tracking. The related timing control, data communication interface and image pre-processing ISSN: ISBN:
6 software control programs are designed and integrated into this DSP hardware structure for stand-alone application purpose. A new moving object detecting technique is proposed by combining the temporal subtraction differencing and the sum of absolute differences (SAD) matching schemes to reduce the image processing computation effort. This system can be employed to detect and track any moving object without object color and shape limitations. It can be applied in mobile platform for stand-alone application, for example mobile robot or human interacting toys. Fig. 1 Draw epipolar line in SAD targeted moving object area. Y Coordinate (cm) X Coordinate (cm) Moving Object 6 Z Coordinate (cm) 8 1 Acknowledgement This research is supported by the National Science Council under the contract NSC E MY3. References: [1] Chern-Sheng Lin; Li-Wen Lue, An image system for fast positioning and accuracy inspection of ball grid array boards, Microelectronics Reliability Vol. 41, Issue: 1, pp , January 21. [2] [3] Masatoshi Okutomi and Takeo Kanade, A Multiple-Baseline Stereo, IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 15, No. 4, April, pp , [3] K. H. Bae, J. S. Koo and E. S. Kim, A New Stereo Object Tracking System Using Disparity Motion Vector, Optics Communications, Vol. 221, pp , 23. [4] Akio Yoneyama, Yasuyuki Nakajima, Hiromasa Yanagihara and Masaru Sugano, Moving Object Detection from MPEG Video Stream, IEICE Transactions, vol. J 81-D-II, No. 8, pp , Aug [5] Jae-Soo Lee, Choon-Weon Seo and Eun- Soo Kim, Implementation of opto-digital stereo object tracking system, Optics Communications, vol. 2, pp , 21. [6] Y. Ren, C. S. Chua and Y. K. Ho, Statistical Background Modeling for Nonstationary Camera, Pattern Recognition Letters, Vol. 24, pp , 23. [7] Jae-Soo Lee, Choon-Weon Seo and Eun- Soo Kim, Implementation of opto-digital stereo object tracking system, Optics Communications, vol. 2, pp , 21. [8] Hsin-Teng Sheu, Hung-Yi Chen and Wu- Chih Hu, Consistent Symmetric Axis Method for Robust Detection of Ellipses, IEEE Proceedings --- Vision, Image and Signal Processing, vol.144, no.6, pp , December [9] Rafael C., Gonzalez and Richard E. Woods, Digital Image Processing, Addison- Wesley, Fig. 11 A ball moving within a track with significant vertical height change. ISSN: ISBN:
An Edge Detection Algorithm for Online Image Analysis
An Edge Detection Algorithm for Online Image Analysis Azzam Sleit, Abdel latif Abu Dalhoum, Ibraheem Al-Dhamari, Afaf Tareef Department of Computer Science, King Abdulla II School for Information Technology
More informationMOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK
MOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK Mahamuni P. D 1, R. P. Patil 2, H.S. Thakar 3 1 PG Student, E & TC Department, SKNCOE, Vadgaon Bk, Pune, India 2 Asst. Professor,
More informationFingerprint Mosaicking by Rolling with Sliding
Fingerprint Mosaicking by Rolling with Sliding Kyoungtaek Choi, Hunjae Park, Hee-seung Choi and Jaihie Kim Department of Electrical and Electronic Engineering,Yonsei University Biometrics Engineering Research
More informationMeasurement of Pedestrian Groups Using Subtraction Stereo
Measurement of Pedestrian Groups Using Subtraction Stereo Kenji Terabayashi, Yuki Hashimoto, and Kazunori Umeda Chuo University / CREST, JST, 1-13-27 Kasuga, Bunkyo-ku, Tokyo 112-8551, Japan terabayashi@mech.chuo-u.ac.jp
More informationIntegration of Multiple-baseline Color Stereo Vision with Focus and Defocus Analysis for 3D Shape Measurement
Integration of Multiple-baseline Color Stereo Vision with Focus and Defocus Analysis for 3D Shape Measurement Ta Yuan and Murali Subbarao tyuan@sbee.sunysb.edu and murali@sbee.sunysb.edu Department of
More informationLecture 14, Video Coding Stereo Video Coding
Lecture 14, Video Coding Stereo Video Coding A further application of the tools we saw (particularly the motion compensation and prediction) is stereo video coding. Stereo video is used for creating a
More informationRobust and Accurate Detection of Object Orientation and ID without Color Segmentation
0 Robust and Accurate Detection of Object Orientation and ID without Color Segmentation Hironobu Fujiyoshi, Tomoyuki Nagahashi and Shoichi Shimizu Chubu University Japan Open Access Database www.i-techonline.com
More informationVideo Inter-frame Forgery Identification Based on Optical Flow Consistency
Sensors & Transducers 24 by IFSA Publishing, S. L. http://www.sensorsportal.com Video Inter-frame Forgery Identification Based on Optical Flow Consistency Qi Wang, Zhaohong Li, Zhenzhen Zhang, Qinglong
More informationAn Approach for Real Time Moving Object Extraction based on Edge Region Determination
An Approach for Real Time Moving Object Extraction based on Edge Region Determination Sabrina Hoque Tuli Department of Computer Science and Engineering, Chittagong University of Engineering and Technology,
More informationEvaluating Measurement Error of a 3D Movable Body Scanner for Calibration
Evaluating Measurement Error of a 3D Movable Body Scanner for Calibration YU-CHENG LIN Department of Industrial Engingeering and Management Overseas Chinese University No. 100 Chiaokwang Road, 408, Taichung
More informationOcclusion Detection of Real Objects using Contour Based Stereo Matching
Occlusion Detection of Real Objects using Contour Based Stereo Matching Kenichi Hayashi, Hirokazu Kato, Shogo Nishida Graduate School of Engineering Science, Osaka University,1-3 Machikaneyama-cho, Toyonaka,
More information3D Environment Measurement Using Binocular Stereo and Motion Stereo by Mobile Robot with Omnidirectional Stereo Camera
3D Environment Measurement Using Binocular Stereo and Motion Stereo by Mobile Robot with Omnidirectional Stereo Camera Shinichi GOTO Department of Mechanical Engineering Shizuoka University 3-5-1 Johoku,
More informationDigital Image Stabilization and Its Integration with Video Encoder
Digital Image Stabilization and Its Integration with Video Encoder Yu-Chun Peng, Hung-An Chang, Homer H. Chen Graduate Institute of Communication Engineering National Taiwan University Taipei, Taiwan {b889189,
More informationTransactions on Information and Communications Technologies vol 16, 1996 WIT Press, ISSN
ransactions on Information and Communications echnologies vol 6, 996 WI Press, www.witpress.com, ISSN 743-357 Obstacle detection using stereo without correspondence L. X. Zhou & W. K. Gu Institute of Information
More informationStudy on the Signboard Region Detection in Natural Image
, pp.179-184 http://dx.doi.org/10.14257/astl.2016.140.34 Study on the Signboard Region Detection in Natural Image Daeyeong Lim 1, Youngbaik Kim 2, Incheol Park 1, Jihoon seung 1, Kilto Chong 1,* 1 1567
More informationComplex Sensors: Cameras, Visual Sensing. The Robotics Primer (Ch. 9) ECE 497: Introduction to Mobile Robotics -Visual Sensors
Complex Sensors: Cameras, Visual Sensing The Robotics Primer (Ch. 9) Bring your laptop and robot everyday DO NOT unplug the network cables from the desktop computers or the walls Tuesday s Quiz is on Visual
More informationMatching. Compare region of image to region of image. Today, simplest kind of matching. Intensities similar.
Matching Compare region of image to region of image. We talked about this for stereo. Important for motion. Epipolar constraint unknown. But motion small. Recognition Find object in image. Recognize object.
More informationCS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching
Stereo Matching Fundamental matrix Let p be a point in left image, p in right image l l Epipolar relation p maps to epipolar line l p maps to epipolar line l p p Epipolar mapping described by a 3x3 matrix
More informationPupil Localization Algorithm based on Hough Transform and Harris Corner Detection
Pupil Localization Algorithm based on Hough Transform and Harris Corner Detection 1 Chongqing University of Technology Electronic Information and Automation College Chongqing, 400054, China E-mail: zh_lian@cqut.edu.cn
More informationDepth. Common Classification Tasks. Example: AlexNet. Another Example: Inception. Another Example: Inception. Depth
Common Classification Tasks Recognition of individual objects/faces Analyze object-specific features (e.g., key points) Train with images from different viewing angles Recognition of object classes Analyze
More informationVehicle Detection Method using Haar-like Feature on Real Time System
Vehicle Detection Method using Haar-like Feature on Real Time System Sungji Han, Youngjoon Han and Hernsoo Hahn Abstract This paper presents a robust vehicle detection approach using Haar-like feature.
More informationHigh Accuracy Depth Measurement using Multi-view Stereo
High Accuracy Depth Measurement using Multi-view Stereo Trina D. Russ and Anthony P. Reeves School of Electrical Engineering Cornell University Ithaca, New York 14850 tdr3@cornell.edu Abstract A novel
More informationDISTANCE MEASUREMENT USING STEREO VISION
DISTANCE MEASUREMENT USING STEREO VISION Sheetal Nagar 1, Jitendra Verma 2 1 Department of Electronics and Communication Engineering, IIMT, Greater Noida (India) 2 Department of computer science Engineering,
More informationStereo Image Rectification for Simple Panoramic Image Generation
Stereo Image Rectification for Simple Panoramic Image Generation Yun-Suk Kang and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju 500-712 Korea Email:{yunsuk,
More informationFace Recognition Using Vector Quantization Histogram and Support Vector Machine Classifier Rong-sheng LI, Fei-fei LEE *, Yan YAN and Qiu CHEN
2016 International Conference on Artificial Intelligence: Techniques and Applications (AITA 2016) ISBN: 978-1-60595-389-2 Face Recognition Using Vector Quantization Histogram and Support Vector Machine
More informationA Robust Two Feature Points Based Depth Estimation Method 1)
Vol.31, No.5 ACTA AUTOMATICA SINICA September, 2005 A Robust Two Feature Points Based Depth Estimation Method 1) ZHONG Zhi-Guang YI Jian-Qiang ZHAO Dong-Bin (Laboratory of Complex Systems and Intelligence
More informationDefect Inspection of Liquid-Crystal-Display (LCD) Panels in Repetitive Pattern Images Using 2D Fourier Image Reconstruction
Defect Inspection of Liquid-Crystal-Display (LCD) Panels in Repetitive Pattern Images Using D Fourier Image Reconstruction Du-Ming Tsai, and Yan-Hsin Tseng Department of Industrial Engineering and Management
More informationMORPHOLOGICAL EDGE DETECTION AND CORNER DETECTION ALGORITHM USING CHAIN-ENCODING
MORPHOLOGICAL EDGE DETECTION AND CORNER DETECTION ALGORITHM USING CHAIN-ENCODING Neeta Nain, Vijay Laxmi, Ankur Kumar Jain & Rakesh Agarwal Department of Computer Engineering Malaviya National Institute
More informationComputers and Mathematics with Applications. Vision-based vehicle detection for a driver assistance system
Computers and Mathematics with Applications 61 (2011) 2096 2100 Contents lists available at ScienceDirect Computers and Mathematics with Applications journal homepage: www.elsevier.com/locate/camwa Vision-based
More informationOptical Flow-Based Person Tracking by Multiple Cameras
Proc. IEEE Int. Conf. on Multisensor Fusion and Integration in Intelligent Systems, Baden-Baden, Germany, Aug. 2001. Optical Flow-Based Person Tracking by Multiple Cameras Hideki Tsutsui, Jun Miura, and
More informationProject Report for EE7700
Project Report for EE7700 Name: Jing Chen, Shaoming Chen Student ID: 89-507-3494, 89-295-9668 Face Tracking 1. Objective of the study Given a video, this semester project aims at implementing algorithms
More informationECE 172A: Introduction to Intelligent Systems: Machine Vision, Fall Midterm Examination
ECE 172A: Introduction to Intelligent Systems: Machine Vision, Fall 2008 October 29, 2008 Notes: Midterm Examination This is a closed book and closed notes examination. Please be precise and to the point.
More informationInternational Journal of Advanced Research in Computer Science and Software Engineering
Volume 2, Issue 1, January 2012 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: An analytical study on stereo
More informationDESIGNING A REAL TIME SYSTEM FOR CAR NUMBER DETECTION USING DISCRETE HOPFIELD NETWORK
DESIGNING A REAL TIME SYSTEM FOR CAR NUMBER DETECTION USING DISCRETE HOPFIELD NETWORK A.BANERJEE 1, K.BASU 2 and A.KONAR 3 COMPUTER VISION AND ROBOTICS LAB ELECTRONICS AND TELECOMMUNICATION ENGG JADAVPUR
More informationHuman Face Classification using Genetic Algorithm
Human Face Classification using Genetic Algorithm Tania Akter Setu Dept. of Computer Science and Engineering Jatiya Kabi Kazi Nazrul Islam University Trishal, Mymenshing, Bangladesh Dr. Md. Mijanur Rahman
More informationComputers and Mathematics with Applications. An embedded system for real-time facial expression recognition based on the extension theory
Computers and Mathematics with Applications 61 (2011) 2101 2106 Contents lists available at ScienceDirect Computers and Mathematics with Applications journal homepage: www.elsevier.com/locate/camwa An
More informationLecture 14: Computer Vision
CS/b: Artificial Intelligence II Prof. Olga Veksler Lecture : Computer Vision D shape from Images Stereo Reconstruction Many Slides are from Steve Seitz (UW), S. Narasimhan Outline Cues for D shape perception
More informationDevelopment of 3D Positioning Scheme by Integration of Multiple Wiimote IR Cameras
Proceedings of the 5th IIAE International Conference on Industrial Application Engineering 2017 Development of 3D Positioning Scheme by Integration of Multiple Wiimote IR Cameras Hui-Yuan Chan *, Ting-Hao
More informationA threshold decision of the object image by using the smart tag
A threshold decision of the object image by using the smart tag Chang-Jun Im, Jin-Young Kim, Kwan Young Joung, Ho-Gil Lee Sensing & Perception Research Group Korea Institute of Industrial Technology (
More informationCS 787: Assignment 4, Stereo Vision: Block Matching and Dynamic Programming Due: 12:00noon, Fri. Mar. 30, 2007.
CS 787: Assignment 4, Stereo Vision: Block Matching and Dynamic Programming Due: 12:00noon, Fri. Mar. 30, 2007. In this assignment you will implement and test some simple stereo algorithms discussed in
More informationCapturing, Modeling, Rendering 3D Structures
Computer Vision Approach Capturing, Modeling, Rendering 3D Structures Calculate pixel correspondences and extract geometry Not robust Difficult to acquire illumination effects, e.g. specular highlights
More informationChange detection using joint intensity histogram
Change detection using joint intensity histogram Yasuyo Kita National Institute of Advanced Industrial Science and Technology (AIST) Information Technology Research Institute AIST Tsukuba Central 2, 1-1-1
More informationCharacter Segmentation and Recognition Algorithm of Text Region in Steel Images
Character Segmentation and Recognition Algorithm of Text Region in Steel Images Keunhwi Koo, Jong Pil Yun, SungHoo Choi, JongHyun Choi, Doo Chul Choi, Sang Woo Kim Division of Electrical and Computer Engineering
More informationLaser sensors. Transmitter. Receiver. Basilio Bona ROBOTICA 03CFIOR
Mobile & Service Robotics Sensors for Robotics 3 Laser sensors Rays are transmitted and received coaxially The target is illuminated by collimated rays The receiver measures the time of flight (back and
More informationExtracting Road Signs using the Color Information
Extracting Road Signs using the Color Information Wen-Yen Wu, Tsung-Cheng Hsieh, and Ching-Sung Lai Abstract In this paper, we propose a method to extract the road signs. Firstly, the grabbed image is
More informationA reversible data hiding based on adaptive prediction technique and histogram shifting
A reversible data hiding based on adaptive prediction technique and histogram shifting Rui Liu, Rongrong Ni, Yao Zhao Institute of Information Science Beijing Jiaotong University E-mail: rrni@bjtu.edu.cn
More informationReview for the Final
Review for the Final CS 635 Review (Topics Covered) Image Compression Lossless Coding Compression Huffman Interpixel RLE Lossy Quantization Discrete Cosine Transform JPEG CS 635 Review (Topics Covered)
More informationMULTI ORIENTATION PERFORMANCE OF FEATURE EXTRACTION FOR HUMAN HEAD RECOGNITION
MULTI ORIENTATION PERFORMANCE OF FEATURE EXTRACTION FOR HUMAN HEAD RECOGNITION Panca Mudjirahardjo, Rahmadwati, Nanang Sulistiyanto and R. Arief Setyawan Department of Electrical Engineering, Faculty of
More informationA Study on Similarity Computations in Template Matching Technique for Identity Verification
A Study on Similarity Computations in Template Matching Technique for Identity Verification Lam, S. K., Yeong, C. Y., Yew, C. T., Chai, W. S., Suandi, S. A. Intelligent Biometric Group, School of Electrical
More informationRate Distortion Optimization in Video Compression
Rate Distortion Optimization in Video Compression Xue Tu Dept. of Electrical and Computer Engineering State University of New York at Stony Brook 1. Introduction From Shannon s classic rate distortion
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 14 130307 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Stereo Dense Motion Estimation Translational
More informationAccurate 3D Face and Body Modeling from a Single Fixed Kinect
Accurate 3D Face and Body Modeling from a Single Fixed Kinect Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this
More informationAn Image Based Approach to Compute Object Distance
An Image Based Approach to Compute Object Distance Ashfaqur Rahman * Department of Computer Science, American International University Bangladesh Dhaka 1213, Bangladesh Abdus Salam, Mahfuzul Islam, and
More informationRestoring Warped Document Image Based on Text Line Correction
Restoring Warped Document Image Based on Text Line Correction * Dep. of Electrical Engineering Tamkang University, New Taipei, Taiwan, R.O.C *Correspondending Author: hsieh@ee.tku.edu.tw Abstract Document
More informationVision-based Frontal Vehicle Detection and Tracking
Vision-based Frontal and Tracking King Hann LIM, Kah Phooi SENG, Li-Minn ANG and Siew Wen CHIN School of Electrical and Electronic Engineering The University of Nottingham Malaysia campus, Jalan Broga,
More informationA Road Marking Extraction Method Using GPGPU
, pp.46-54 http://dx.doi.org/10.14257/astl.2014.50.08 A Road Marking Extraction Method Using GPGPU Dajun Ding 1, Jongsu Yoo 1, Jekyo Jung 1, Kwon Soon 1 1 Daegu Gyeongbuk Institute of Science and Technology,
More informationGesture Recognition using Temporal Templates with disparity information
8- MVA7 IAPR Conference on Machine Vision Applications, May 6-8, 7, Tokyo, JAPAN Gesture Recognition using Temporal Templates with disparity information Kazunori Onoguchi and Masaaki Sato Hirosaki University
More informationFundamentals of Stereo Vision Michael Bleyer LVA Stereo Vision
Fundamentals of Stereo Vision Michael Bleyer LVA Stereo Vision What Happened Last Time? Human 3D perception (3D cinema) Computational stereo Intuitive explanation of what is meant by disparity Stereo matching
More informationPanoramic 3D Reconstruction Using Rotational Stereo Camera with Simple Epipolar Constraints
Panoramic 3D Reconstruction Using Rotational Stereo Camera with Simple Epipolar Constraints Wei Jiang Japan Science and Technology Agency 4-1-8, Honcho, Kawaguchi-shi, Saitama, Japan jiang@anken.go.jp
More informationVehicle Dimensions Estimation Scheme Using AAM on Stereoscopic Video
Workshop on Vehicle Retrieval in Surveillance (VRS) in conjunction with 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance Vehicle Dimensions Estimation Scheme Using
More informationReal-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images
Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images Abstract This paper presents a new method to generate and present arbitrarily
More informationSubpixel Corner Detection Using Spatial Moment 1)
Vol.31, No.5 ACTA AUTOMATICA SINICA September, 25 Subpixel Corner Detection Using Spatial Moment 1) WANG She-Yang SONG Shen-Min QIANG Wen-Yi CHEN Xing-Lin (Department of Control Engineering, Harbin Institute
More informationFlexible Calibration of a Portable Structured Light System through Surface Plane
Vol. 34, No. 11 ACTA AUTOMATICA SINICA November, 2008 Flexible Calibration of a Portable Structured Light System through Surface Plane GAO Wei 1 WANG Liang 1 HU Zhan-Yi 1 Abstract For a portable structured
More informationCOMPUTER-BASED WORKPIECE DETECTION ON CNC MILLING MACHINE TOOLS USING OPTICAL CAMERA AND NEURAL NETWORKS
Advances in Production Engineering & Management 5 (2010) 1, 59-68 ISSN 1854-6250 Scientific paper COMPUTER-BASED WORKPIECE DETECTION ON CNC MILLING MACHINE TOOLS USING OPTICAL CAMERA AND NEURAL NETWORKS
More informationDEPTH AND GEOMETRY FROM A SINGLE 2D IMAGE USING TRIANGULATION
2012 IEEE International Conference on Multimedia and Expo Workshops DEPTH AND GEOMETRY FROM A SINGLE 2D IMAGE USING TRIANGULATION Yasir Salih and Aamir S. Malik, Senior Member IEEE Centre for Intelligent
More informationOBSTACLE DETECTION WITH ACTIVE LASER TRIANGULATION
Advances in Production Engineering & Management 2 (2007) 2, 79-90 ISSN 1854-6250 Original scientific paper OBSTACLE DETECTION WITH ACTIVE LASER TRIANGULATION Klančnik, S. * ; Balič, J. * & Planinšič, P.
More informationIntegration of 3D Stereo Vision Measurements in Industrial Robot Applications
Integration of 3D Stereo Vision Measurements in Industrial Robot Applications Frank Cheng and Xiaoting Chen Central Michigan University cheng1fs@cmich.edu Paper 34, ENG 102 Abstract Three dimensional (3D)
More informationEXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,
School of Computer Science and Communication, KTH Danica Kragic EXAM SOLUTIONS Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006, 14.00 19.00 Grade table 0-25 U 26-35 3 36-45
More informationDepth Measurement and 3-D Reconstruction of Multilayered Surfaces by Binocular Stereo Vision with Parallel Axis Symmetry Using Fuzzy
Depth Measurement and 3-D Reconstruction of Multilayered Surfaces by Binocular Stereo Vision with Parallel Axis Symmetry Using Fuzzy Sharjeel Anwar, Dr. Shoaib, Taosif Iqbal, Mohammad Saqib Mansoor, Zubair
More informationHigh Performance VLSI Architecture of Fractional Motion Estimation for H.264/AVC
Journal of Computational Information Systems 7: 8 (2011) 2843-2850 Available at http://www.jofcis.com High Performance VLSI Architecture of Fractional Motion Estimation for H.264/AVC Meihua GU 1,2, Ningmei
More informationDense 3-D Reconstruction of an Outdoor Scene by Hundreds-baseline Stereo Using a Hand-held Video Camera
Dense 3-D Reconstruction of an Outdoor Scene by Hundreds-baseline Stereo Using a Hand-held Video Camera Tomokazu Satoy, Masayuki Kanbaray, Naokazu Yokoyay and Haruo Takemuraz ygraduate School of Information
More informationAn Improvement of the Occlusion Detection Performance in Sequential Images Using Optical Flow
, pp.247-251 http://dx.doi.org/10.14257/astl.2015.99.58 An Improvement of the Occlusion Detection Performance in Sequential Images Using Optical Flow Jin Woo Choi 1, Jae Seoung Kim 2, Taeg Kuen Whangbo
More informationIntegrating 3D Vision Measurements into Industrial Robot Applications
Integrating 3D Vision Measurements into Industrial Robot Applications by Frank S. Cheng cheng1fs@cmich.edu Engineering and echnology Central Michigan University Xiaoting Chen Graduate Student Engineering
More informationVector Bank Based Multimedia Codec System-on-a-Chip (SoC) Design
2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks Vector Bank Based Multimedia Codec System-on-a-Chip (SoC) Design Ruei-Xi Chen, Wei Zhao, Jeffrey Fan andasaddavari Computer
More informationCS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching
Stereo Matching Fundamental matrix Let p be a point in left image, p in right image l l Epipolar relation p maps to epipolar line l p maps to epipolar line l p p Epipolar mapping described by a 3x3 matrix
More informationChaplin, Modern Times, 1936
Chaplin, Modern Times, 1936 [A Bucket of Water and a Glass Matte: Special Effects in Modern Times; bonus feature on The Criterion Collection set] Multi-view geometry problems Structure: Given projections
More informationDetecting motion by means of 2D and 3D information
Detecting motion by means of 2D and 3D information Federico Tombari Stefano Mattoccia Luigi Di Stefano Fabio Tonelli Department of Electronics Computer Science and Systems (DEIS) Viale Risorgimento 2,
More informationFabric Defect Detection Based on Computer Vision
Fabric Defect Detection Based on Computer Vision Jing Sun and Zhiyu Zhou College of Information and Electronics, Zhejiang Sci-Tech University, Hangzhou, China {jings531,zhouzhiyu1993}@163.com Abstract.
More informationLane Markers Detection based on Consecutive Threshold Segmentation
ISSN 1746-7659, England, UK Journal of Information and Computing Science Vol. 6, No. 3, 2011, pp. 207-212 Lane Markers Detection based on Consecutive Threshold Segmentation Huan Wang +, Mingwu Ren,Sulin
More informationOutdoor Scene Reconstruction from Multiple Image Sequences Captured by a Hand-held Video Camera
Outdoor Scene Reconstruction from Multiple Image Sequences Captured by a Hand-held Video Camera Tomokazu Sato, Masayuki Kanbara and Naokazu Yokoya Graduate School of Information Science, Nara Institute
More informationRobust color segmentation algorithms in illumination variation conditions
286 CHINESE OPTICS LETTERS / Vol. 8, No. / March 10, 2010 Robust color segmentation algorithms in illumination variation conditions Jinhui Lan ( ) and Kai Shen ( Department of Measurement and Control Technologies,
More informationDEPTH ESTIMATION USING STEREO FISH-EYE LENSES
DEPTH ESTMATON USNG STEREO FSH-EYE LENSES Shishir Shah and J. K. Aggamal Computer and Vision Research Center Department of Electrical and Computer Engineering, ENS 520 The University of Texas At Austin
More informationSegmentation of Mushroom and Cap Width Measurement Using Modified K-Means Clustering Algorithm
Segmentation of Mushroom and Cap Width Measurement Using Modified K-Means Clustering Algorithm Eser SERT, Ibrahim Taner OKUMUS Computer Engineering Department, Engineering and Architecture Faculty, Kahramanmaras
More informationRange Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation. Range Imaging Through Triangulation
Obviously, this is a very slow process and not suitable for dynamic scenes. To speed things up, we can use a laser that projects a vertical line of light onto the scene. This laser rotates around its vertical
More informationChapter 3 Image Registration. Chapter 3 Image Registration
Chapter 3 Image Registration Distributed Algorithms for Introduction (1) Definition: Image Registration Input: 2 images of the same scene but taken from different perspectives Goal: Identify transformation
More informationA Survey of Light Source Detection Methods
A Survey of Light Source Detection Methods Nathan Funk University of Alberta Mini-Project for CMPUT 603 November 30, 2003 Abstract This paper provides an overview of the most prominent techniques for light
More informationMulti-view stereo. Many slides adapted from S. Seitz
Multi-view stereo Many slides adapted from S. Seitz Beyond two-view stereo The third eye can be used for verification Multiple-baseline stereo Pick a reference image, and slide the corresponding window
More informationMotion estimation for video compression
Motion estimation for video compression Blockmatching Search strategies for block matching Block comparison speedups Hierarchical blockmatching Sub-pixel accuracy Motion estimation no. 1 Block-matching
More informationInternational Journal of Advanced Research in Computer Science and Software Engineering
Volume 2, Issue 8, August 2012 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com A Study on Block
More information3-D TERRAIN RECONSTRUCTION WITH AERIAL PHOTOGRAPHY
3-D TERRAIN RECONSTRUCTION WITH AERIAL PHOTOGRAPHY Bin-Yih Juang ( 莊斌鎰 ) 1, and Chiou-Shann Fuh ( 傅楸善 ) 3 1 Ph. D candidate o Dept. o Mechanical Engineering National Taiwan University, Taipei, Taiwan Instructor
More informationMultiple Baseline Stereo
A. Coste CS6320 3D Computer Vision, School of Computing, University of Utah April 22, 2013 A. Coste Outline 1 2 Square Differences Other common metrics 3 Rectification 4 5 A. Coste Introduction The goal
More informationEE 264: Image Processing and Reconstruction. Image Motion Estimation I. EE 264: Image Processing and Reconstruction. Outline
1 Image Motion Estimation I 2 Outline 1. Introduction to Motion 2. Why Estimate Motion? 3. Global vs. Local Motion 4. Block Motion Estimation 5. Optical Flow Estimation Basics 6. Optical Flow Estimation
More informationA Keypoint Descriptor Inspired by Retinal Computation
A Keypoint Descriptor Inspired by Retinal Computation Bongsoo Suh, Sungjoon Choi, Han Lee Stanford University {bssuh,sungjoonchoi,hanlee}@stanford.edu Abstract. The main goal of our project is to implement
More informationTexture Sensitive Image Inpainting after Object Morphing
Texture Sensitive Image Inpainting after Object Morphing Yin Chieh Liu and Yi-Leh Wu Department of Computer Science and Information Engineering National Taiwan University of Science and Technology, Taiwan
More informationMotion Estimation. There are three main types (or applications) of motion estimation:
Members: D91922016 朱威達 R93922010 林聖凱 R93922044 謝俊瑋 Motion Estimation There are three main types (or applications) of motion estimation: Parametric motion (image alignment) The main idea of parametric motion
More informationProject Title: Welding Machine Monitoring System Phase II. Name of PI: Prof. Kenneth K.M. LAM (EIE) Progress / Achievement: (with photos, if any)
Address: Hong Kong Polytechnic University, Phase 8, Hung Hom, Kowloon, Hong Kong. Telephone: (852) 3400 8441 Email: cnerc.steel@polyu.edu.hk Website: https://www.polyu.edu.hk/cnerc-steel/ Project Title:
More informationCS5670: Computer Vision
CS5670: Computer Vision Noah Snavely, Zhengqi Li Stereo Single image stereogram, by Niklas Een Mark Twain at Pool Table", no date, UCR Museum of Photography Stereo Given two images from different viewpoints
More informationBiometric Security System Using Palm print
ISSN (Online) : 2319-8753 ISSN (Print) : 2347-6710 International Journal of Innovative Research in Science, Engineering and Technology Volume 3, Special Issue 3, March 2014 2014 International Conference
More information3D Modeling of Objects Using Laser Scanning
1 3D Modeling of Objects Using Laser Scanning D. Jaya Deepu, LPU University, Punjab, India Email: Jaideepudadi@gmail.com Abstract: In the last few decades, constructing accurate three-dimensional models
More informationDynamic 3-D surface profilometry using a novel color pattern encoded with a multiple triangular model
Dynamic 3-D surface profilometry using a novel color pattern encoded with a multiple triangular model Liang-Chia Chen and Xuan-Loc Nguyen Graduate Institute of Automation Technology National Taipei University
More information