Perceptual Quality Improvement of Stereoscopic Images

Size: px
Start display at page:

Download "Perceptual Quality Improvement of Stereoscopic Images"

Transcription

1 Perceptual Quality Improvement of Stereoscopic Images Jong In Gil and Manbae Kim Dept. of Computer and Communications Engineering Kangwon National University Chunchon, Republic of Korea, Abstract - In general, 3D scene depth is affected by intensity and saturation difference according to human factor. Utilizing this information, we propose a novel method to improve 3D perceived depth of stereoscopic images. By varying the RGB colors especially at adjacent areas of an edge pixel, the depth perception is expected to be enhanced. For this, two methods for intensity transformation and one for saturation processing are presented. Experiments performed on various stereoscopic images validate that the proposed methods deliver more enhanced 3D depth based on subjective test. Keywords: Stereoscopic image, perceptual quality, 3D perception 1 Introduction In general, stereoscopic images are acquired from two camera sensors. Displaying the images on a 3D monitor, humans can view and perceive 3D. In general, the stereoscopic images are delivered to viewers without any modification or enhancement. The human factor [1-4] indicates that the perceptual quality is related to the amount of intensity and saturation. For instance, objects with greater saturation is perceived close to the viewer compared with those with relatively smaller saturation even though they are located at the identical distance. This phenomenon is also applied to the intensity. Based on such a 3D human factor, this paper presents a novel method to enhance the stereoscopic images by varying the intensity and saturation values of left and right images. Fig. 1 shows an example of human illusion. We made a synthetic picture with varying intensity and saturation levels. We observe the left object more close to our eyes. As the saturation decreases, objects are perceived to be distant. Utilizing this human factor, a novel scheme for enhancing 3D is presented by expanding this phenomenon to a 3D stereoscopic image. While watching stereoscopic images, two objects at the same distance can be perceived at different depth according to either intensity or saturation levels. Fig. 1. Intensity and saturation levels decrease from left to right at the range of [1.0, 0.25]. This paper is organized as follows: Overall approach is introduced in Section 2. Image preprocessing is presented in Section 3. Section 4 presents the depth map filtering and the derivation of high-frequency components. The intensity and saturation processing schemes are presented in Section 5. Experimental results are discussed in Section 6 followed by the conclusion of Section 7. 2 Overall Method The stereoscopic image is composed of left and right images. As shown in Fig. 1, in the preprocessing, we estimate the magnitude and orientation of edges for left and right images, I L and I R. Given edge pixels, we extract highfrequency component from a depth map that can be obtained from stereo matching or a pre-made depth map. The depth map is low-pass filtered and the high-frequency components that exist at edge boundaries are derived. The high frequency component plays an important role in the intensity/saturation transformation. Finally, an output stereoscopic image I L and I R is generated. Fig. 2. The block diagram of the proposed method

2 3 Preprocessing The purpose of the preprocessing is two-folds: edge detection and depth map generation. To detect edge pixels, Sobel edge operator is used [5]. From the edge operator, edge magnitude and orientation can be computed. Fig. 3 shows the edge strength maps and binary edge maps after the thresholding of edge strength for left and right images, respectively. Fig. 5. Edge map obtained from Zhang-Suen thinning algorithm The edge map still contains small edge regions. Therefore, in order to remove such components, CCL (connected component labeling) is used. The labeled data smaller than P pixels is then eliminated. Fig. 6 shows the edge map after the CCL. Fig. 3. Edge map and binary edge map of left image and right image Fig. 6. Edge map after removing small edge components by CCL algorithm Since the edge noise might be present in the edge map, a min-max filter is applied. The output shown in Fig. 4 shows output where noisy edges are removed. Fig. 4. Noise-removed edge map after the min-max filter The next procedure is to derive edge boundary with maximum thickness of 1 or 2. Most thinning procedures repeatedly remove boundary pixels until a pixel set of 1 or 2 is found. Among them, Zhang-Suen thinning algorithm [6] that has been widely used due to the fast and simple implementation is adopted and the result is shown in Fig. 5. The edge orientation is important in the derivation of highfrequency components of a depth map. Since some edges might have inaccurate orientations, the adjacent edges might not have an identical orientation even for line edges. To solve this problem, a median filter is applied. Fig. 7 shows the input and median-filtered edge maps of left and right images. Fig. 7. shows the median-filtered edge maps Various disparity estimation methods for stereoscopic images have been proposed in the literature. Since the stereo matching is not our concern, we use depth maps provided by Middlebery site [7]. One of the depth maps of a stereoscopic image is shown in Fig. 8.

3 Fig.10. Horizontal and vertical filtering applied according to Fig. 8. Depth maps of Middlebery site [7] the edge orientation 4 Preprocessing Depth Map The depth at [0, 255] is defined as the distance between scene and a camera. We compute the difference between the original and the low-pass filtered depth map, thereby obtaining the high-frequency components. Given the input depth data D, we compute ΔD by D = G D D (1) with G D being the convolution of D and a Gaussian filter kernel with variance σ. ΔD contains local depth contrast, which can be interpreted as the following: ΔD 0 represents smooth areas of D, while ΔD > 0 represents areas of highly varying depth. More in detail, a negative ΔD < 0 represents areas of background objects that are close to other occluding areas, while a ΔD > 0 represents boundary areas of foreground objects. Fig. 9 illustrates the property of ΔD. Fig. 9. The sign of ΔD. The blue and red pixels have the positive and negative signs, respectively. The ΔD is computed only at edges of Fig. 7 and the implementation of Gaussian filtering depends on the edge orientation θ. For instance, as shown in Fig. 10, given an edge pixel (in red), vertical and horizontal filtering is performed based on the edge orientation. Fig. 11 shows the Gaussianfiltered depth map. Fig. 11. Gaussian-filtered depth maps 5 Intensity and Saturation Processing Utilizing ΔD, the following methods are presented: contrast variation and depth darkening for intensity transformation and saturation variation for saturation transformation. A) Contrast Variation As already mentioned, the ΔD contains information about the high-frequency property of a depth map. This information can be integrated by directly modulating the input image I. Consequently, we add the ΔD to each color channel by computing I ' = I + λ D (2) with λ being a user defined parameter. I {R, G, B}. In this method, in the case that the color of foreground objects is brighter than the background, the visual contrast can be reduced. The sign of λ affects whether either the foreground pixels become darker and the background pixels brighter, or vice versa. B) Depth Darkening In case that two regions of foreground and background have similar colors and different depths, a possible solution for missing color contrast is to introduce a kind of artificial contrast. In this situation, we only darken or brighten the background along spatially important edges by computing I ' = I + λ D (3) where ΔD indicates the negative ΔD. Depending upon the sign of λ, the background pixels can be darker or brighter.

4 C) Saturation Variation As mentioned, the amount of saturation can affect the 3D perception of stereoscopic images. To realize this, we present a method of adjusting saturation values of neighboring regions of edge pixels. The following equation transforms the input S using ΔD. + S' = S + λ D (4) where ΔD + is a positive component of ΔD. If we add ΔD + to S, the foreground saturation increases compared with the background. Then, HSI color is transformed into RGB. 6 Experimental Results The proposed methods were performed on various 2D images and depth maps. We illustrate the results for each test image. The first image is MSR breakdance image and depth sequences as shown in Fig. 4. The proposed methods were performed on a set of various stereoscopic images as shown in Fig. 12. The resulting images are shown in Fig. 13 through 15. Fig. 13 shows the output of the contrast variation and depth darkening. The intensity and saturation processing was performed on the adjacent region of edge pixels. The close-up of some particular edges is shown in Figs. 14 and 15. Further, the graph shows the variation of RGB values with respect to λ. The transformed RGB images from the saturation processing are shown in Fig.16. varied between [1.5, 3.0]. Depth perception was then subjectively judged on a scale of 1 (not good) to 5 (very good). On average, the score was higher than 3.5. The results are shown in Fig. 14. Fig. 13. Output stereoscopic images. contrast variation, and depth darkening Fig. 12. Test stereoscopic images [7] We observed the stereoscopic images with a 3D monitor. Our experimental results tested on stereoscopic 3D displays show that the perceived depth is appropriately improved proportional to the value of λ. To prove this, DQCQS (Double Stimulus Continuous Quality Scale) subjective test is performed. At the first stage, original views were displayed to five participants. Each participant watched the views for 10 seconds and their new views for the same period, and evaluated the effect of the 3D depth. The scaling factor was

5 7 Conclusions.In this paper, we presented novel schemes that could provide the improvement of 3D stereoscopic images. Following the human factor regarding intensity as well as saturation, it was the aim of this paper to expand such phenomenon to 3D human factor and to provide the 3D enhancement schemes. For this, two methods for intensity and one for saturation processing were proposed to achieve better 3D depth that was verified based on subjective evaluation. 8 Acknowledgement This work was supported by the MKE (The Ministry of Knowledge Economy), Korea, under the ITRC (Information Technology Research Center) support program supervised by the NIPA (National IT Industry Promotion Agency). (NIPA (C )) and by the IT R&D program of MKE/KCC/KEIT. [KI002058, Signal Processing Elements and their SoC Developments to Realize the Integrated Service System for Interactive Digital Holograms]. 9 References [1] L. M. J. Meesters, W. A. IJsselsteijn, and P. J. H. Seuntiens, A survey of perceptual evaluations and requirements of three-dimensional TV, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 14, No. 3, pp , [2] Blonde, L., Doyen, D., and Borel, T., 3D stereo rendering challenges and techniques, Information Sciences and Systems (CISS), th Annual Conference on, IEEE, pp. 1-6, [3] E. Lee, H. Heo, and K. Park, The comparative measurements of eyestrain caused by 2D and 3D displays, IEEE Trans. on Consumer Electronics, Vol. 56, Issue 3, pp , [4] L. Stelmach, W. Tam, F. Speranza, R. Renaud, and T. Martin, Improving the Visual Discomfort of Stereoscopic Images, Stereoscopic Displays and Virtual Systems X, Proceedings of SPIE-IS&T Electronic Imaging, SPIE Vol. 5006, pp , [5] M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis and Machine Vision, 3rd Ed., Tomson, [6] T. Y. Zhang and C. Y. Suen, A fast parallel algorithm for thinning digital patterns, Communication of ACM, 27(3), pp , [7] Fig. 14. Subjective tests for stereoscopic improvement

STUDY ON DISTORTION CONSPICUITY IN STEREOSCOPICALLY VIEWED 3D IMAGES

STUDY ON DISTORTION CONSPICUITY IN STEREOSCOPICALLY VIEWED 3D IMAGES STUDY ON DISTORTION CONSPICUITY IN STEREOSCOPICALLY VIEWED 3D IMAGES Ming-Jun Chen, 1,3, Alan C. Bovik 1,3, Lawrence K. Cormack 2,3 Department of Electrical & Computer Engineering, The University of Texas

More information

Applying Catastrophe Theory to Image Segmentation

Applying Catastrophe Theory to Image Segmentation Applying Catastrophe Theory to Image Segmentation Mohamad Raad, Majd Ghareeb, Ali Bazzi Department of computer and communications engineering Lebanese International University Beirut, Lebanon Abstract

More information

A threshold decision of the object image by using the smart tag

A threshold decision of the object image by using the smart tag A threshold decision of the object image by using the smart tag Chang-Jun Im, Jin-Young Kim, Kwan Young Joung, Ho-Gil Lee Sensing & Perception Research Group Korea Institute of Industrial Technology (

More information

Depth Budget for Visual Comfort in Stereoscopic Watching Environment

Depth Budget for Visual Comfort in Stereoscopic Watching Environment IJCSNS International Journal of Computer Science and Network Security, VOL.13 No.1, January 013 7 Depth Budget for Visual Comfort in Stereoscopic Watching Environment Jongyoung Kim, Namgyu Kim, and Seiwoong

More information

Image contrast enhancement based on local brightness and contouring artifact improvement for large-scale LCD TVs

Image contrast enhancement based on local brightness and contouring artifact improvement for large-scale LCD TVs Image contrast enhancement based on local brightness and contouring artifact improvement for large-scale LCD TVs JONG-HEE HWANG 1,2, JEAN Y. SONG 1, YOON-SIK CHOE 1 1 Department of Electrical and Electronics

More information

An Algorithm for Blurred Thermal image edge enhancement for security by image processing technique

An Algorithm for Blurred Thermal image edge enhancement for security by image processing technique An Algorithm for Blurred Thermal image edge enhancement for security by image processing technique Vinay Negi 1, Dr.K.P.Mishra 2 1 ECE (PhD Research scholar), Monad University, India, Hapur 2 ECE, KIET,

More information

3D Autostereoscopic Display Image Generation Framework using Direct Light Field Rendering

3D Autostereoscopic Display Image Generation Framework using Direct Light Field Rendering 3D Autostereoscopic Display Image Generation Framework using Direct Light Field Rendering Young Ju Jeong, Yang Ho Cho, Hyoseok Hwang, Hyun Sung Chang, Dongkyung Nam, and C. -C Jay Kuo; Samsung Advanced

More information

Keywords: Thresholding, Morphological operations, Image filtering, Adaptive histogram equalization, Ceramic tile.

Keywords: Thresholding, Morphological operations, Image filtering, Adaptive histogram equalization, Ceramic tile. Volume 3, Issue 7, July 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Blobs and Cracks

More information

A SXGA 3D Display Processor with Reduced Rendering Data and Enhanced Precision

A SXGA 3D Display Processor with Reduced Rendering Data and Enhanced Precision A SXGA 3D Display Processor with Reduced Rendering Data and Enhanced Precision Seok-Hoon Kim KAIST, Daejeon, Republic of Korea I. INTRODUCTION Recently, there has been tremendous progress in 3D graphics

More information

Filtering Images. Contents

Filtering Images. Contents Image Processing and Data Visualization with MATLAB Filtering Images Hansrudi Noser June 8-9, 010 UZH, Multimedia and Robotics Summer School Noise Smoothing Filters Sigmoid Filters Gradient Filters Contents

More information

Non-Linear Masking based Contrast Enhancement via Illumination Estimation

Non-Linear Masking based Contrast Enhancement via Illumination Estimation https://doi.org/10.2352/issn.2470-1173.2018.13.ipas-389 2018, Society for Imaging Science and Technology Non-Linear Masking based Contrast Enhancement via Illumination Estimation Soonyoung Hong, Minsub

More information

A Novel Filling Disocclusion Method Based on Background Extraction. in Depth-Image-Based-Rendering

A Novel Filling Disocclusion Method Based on Background Extraction. in Depth-Image-Based-Rendering A Novel Filling Disocclusion Method Based on Background Extraction in Depth-Image-Based-Rendering Zhenguo Lu,Yuesheng Zhu,Jian Chen ShenZhen Graduate School,Peking University,China Email:zglu@sz.pku.edu.cn,zhuys@pkusz.edu.cn

More information

COMBINING DEPTH INFORMATION AND LOCAL EDGE DETECTION FOR STEREO IMAGE ENHANCEMENT

COMBINING DEPTH INFORMATION AND LOCAL EDGE DETECTION FOR STEREO IMAGE ENHANCEMENT 20th European Signal Processing Conference (EUSIPCO 2012) Bucharest, Romania, August 27-31, 2012 COMBINING DEPTH INFORMATION AND LOCAL EDGE DETECTION FOR STEREO IMAGE ENHANCEMENT Walid Hachicha 1 Azeddine

More information

A Fast Circular Edge Detector for the Iris Region Segmentation

A Fast Circular Edge Detector for the Iris Region Segmentation A Fast Circular Edge Detector for the Iris Region Segmentation Yeunggyu Park, Hoonju Yun, Myongseop Song, and Jaihie Kim I.V. Lab. Dept. of Electrical and Computer Engineering, Yonsei University, 134Shinchon-dong,

More information

Automatic Shadow Removal by Illuminance in HSV Color Space

Automatic Shadow Removal by Illuminance in HSV Color Space Computer Science and Information Technology 3(3): 70-75, 2015 DOI: 10.13189/csit.2015.030303 http://www.hrpub.org Automatic Shadow Removal by Illuminance in HSV Color Space Wenbo Huang 1, KyoungYeon Kim

More information

DEPTH MAP ESTIMATION FROM SINGLE-VIEW IMAGE USING OBJECT CLASSIFICATION BASED ON BAYESIAN LEARNING

DEPTH MAP ESTIMATION FROM SINGLE-VIEW IMAGE USING OBJECT CLASSIFICATION BASED ON BAYESIAN LEARNING DEPTH MAP ESTIMATION FROM SINGLE-VIEW IMAGE USING OBJECT CLASSIFICATION BASED ON BAYESIAN LEARNING Jae-Il Jung and Yo-Sung Ho Gwangu Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu,

More information

EDGE BASED REGION GROWING

EDGE BASED REGION GROWING EDGE BASED REGION GROWING Rupinder Singh, Jarnail Singh Preetkamal Sharma, Sudhir Sharma Abstract Image segmentation is a decomposition of scene into its components. It is a key step in image analysis.

More information

Convergence Point Adjustment Methods for Minimizing Visual Discomfort Due to a Stereoscopic Camera

Convergence Point Adjustment Methods for Minimizing Visual Discomfort Due to a Stereoscopic Camera J. lnf. Commun. Converg. Eng. 1(4): 46-51, Dec. 014 Regular paper Convergence Point Adjustment Methods for Minimizing Visual Discomfort Due to a Stereoscopic Camera Jong-Soo Ha 1, Dae-Woong Kim, and Dong

More information

Lecture 4: Image Processing

Lecture 4: Image Processing Lecture 4: Image Processing Definitions Many graphics techniques that operate only on images Image processing: operations that take images as input, produce images as output In its most general form, an

More information

Crosstalk in multiview 3-D images

Crosstalk in multiview 3-D images Invited Paper Crosstalk in multiview 3-D images * Jung-Young Son, 1 Beom-Ryeol Lee, 2 Min-Chul Park, and 2 Thibault Leportier Dept. of Biomedical Engineering, Konyang University, Nonsan, Chungnam, 320-711,

More information

A Fast Image Multiplexing Method Robust to Viewer s Position and Lens Misalignment in Lenticular 3D Displays

A Fast Image Multiplexing Method Robust to Viewer s Position and Lens Misalignment in Lenticular 3D Displays A Fast Image Multiplexing Method Robust to Viewer s Position and Lens Misalignment in Lenticular D Displays Yun-Gu Lee and Jong Beom Ra Department of Electrical Engineering and Computer Science Korea Advanced

More information

Depth Estimation for View Synthesis in Multiview Video Coding

Depth Estimation for View Synthesis in Multiview Video Coding MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Depth Estimation for View Synthesis in Multiview Video Coding Serdar Ince, Emin Martinian, Sehoon Yea, Anthony Vetro TR2007-025 June 2007 Abstract

More information

CS4670: Computer Vision Noah Snavely

CS4670: Computer Vision Noah Snavely CS4670: Computer Vision Noah Snavely Lecture 2: Edge detection From Sandlot Science Announcements Project 1 released, due Friday, September 7 1 Edge detection Convert a 2D image into a set of curves Extracts

More information

Computer Vision I - Filtering and Feature detection

Computer Vision I - Filtering and Feature detection Computer Vision I - Filtering and Feature detection Carsten Rother 30/10/2015 Computer Vision I: Basics of Image Processing Roadmap: Basics of Digital Image Processing Computer Vision I: Basics of Image

More information

Extensions of One-Dimensional Gray-level Nonlinear Image Processing Filters to Three-Dimensional Color Space

Extensions of One-Dimensional Gray-level Nonlinear Image Processing Filters to Three-Dimensional Color Space Extensions of One-Dimensional Gray-level Nonlinear Image Processing Filters to Three-Dimensional Color Space Orlando HERNANDEZ and Richard KNOWLES Department Electrical and Computer Engineering, The College

More information

An Edge-Based Approach to Motion Detection*

An Edge-Based Approach to Motion Detection* An Edge-Based Approach to Motion Detection* Angel D. Sappa and Fadi Dornaika Computer Vison Center Edifici O Campus UAB 08193 Barcelona, Spain {sappa, dornaika}@cvc.uab.es Abstract. This paper presents

More information

Application of Run Length Encoding In Track Vision Inspection System KANG FEI

Application of Run Length Encoding In Track Vision Inspection System KANG FEI International Forum on Management, Education and Information Technology Application (IFMEITA 2016) Application of Run Length Encoding In Track Vision Inspection System KANG FEI Guidao jiaotong Polytechnic

More information

3D-OBJECT DETECTION METHOD BASED ON THE STEREO IMAGE TRANSFORMATION TO THE COMMON OBSERVATION POINT

3D-OBJECT DETECTION METHOD BASED ON THE STEREO IMAGE TRANSFORMATION TO THE COMMON OBSERVATION POINT 3D-OBJECT DETECTION METHOD BASED ON THE STEREO IMAGE TRANSFORMATION TO THE COMMON OBSERVATION POINT V. M. Lisitsyn *, S. V. Tikhonova ** State Research Institute of Aviation Systems, Moscow, Russia * lvm@gosniias.msk.ru

More information

Edge Detection. CSE 576 Ali Farhadi. Many slides from Steve Seitz and Larry Zitnick

Edge Detection. CSE 576 Ali Farhadi. Many slides from Steve Seitz and Larry Zitnick Edge Detection CSE 576 Ali Farhadi Many slides from Steve Seitz and Larry Zitnick Edge Attneave's Cat (1954) Origin of edges surface normal discontinuity depth discontinuity surface color discontinuity

More information

Perception. Autonomous Mobile Robots. Sensors Vision Uncertainties, Line extraction from laser scans. Autonomous Systems Lab. Zürich.

Perception. Autonomous Mobile Robots. Sensors Vision Uncertainties, Line extraction from laser scans. Autonomous Systems Lab. Zürich. Autonomous Mobile Robots Localization "Position" Global Map Cognition Environment Model Local Map Path Perception Real World Environment Motion Control Perception Sensors Vision Uncertainties, Line extraction

More information

Babu Madhav Institute of Information Technology Years Integrated M.Sc.(IT)(Semester - 7)

Babu Madhav Institute of Information Technology Years Integrated M.Sc.(IT)(Semester - 7) 5 Years Integrated M.Sc.(IT)(Semester - 7) 060010707 Digital Image Processing UNIT 1 Introduction to Image Processing Q: 1 Answer in short. 1. What is digital image? 1. Define pixel or picture element?

More information

Edge Detection. CS664 Computer Vision. 3. Edges. Several Causes of Edges. Detecting Edges. Finite Differences. The Gradient

Edge Detection. CS664 Computer Vision. 3. Edges. Several Causes of Edges. Detecting Edges. Finite Differences. The Gradient Edge Detection CS664 Computer Vision. Edges Convert a gray or color image into set of curves Represented as binary image Capture properties of shapes Dan Huttenlocher Several Causes of Edges Sudden changes

More information

Lecture 6: Edge Detection

Lecture 6: Edge Detection #1 Lecture 6: Edge Detection Saad J Bedros sbedros@umn.edu Review From Last Lecture Options for Image Representation Introduced the concept of different representation or transformation Fourier Transform

More information

Local Image preprocessing (cont d)

Local Image preprocessing (cont d) Local Image preprocessing (cont d) 1 Outline - Edge detectors - Corner detectors - Reading: textbook 5.3.1-5.3.5 and 5.3.10 2 What are edges? Edges correspond to relevant features in the image. An edge

More information

JNTUWORLD. 4. Prove that the average value of laplacian of the equation 2 h = ((r2 σ 2 )/σ 4 ))exp( r 2 /2σ 2 ) is zero. [16]

JNTUWORLD. 4. Prove that the average value of laplacian of the equation 2 h = ((r2 σ 2 )/σ 4 ))exp( r 2 /2σ 2 ) is zero. [16] Code No: 07A70401 R07 Set No. 2 1. (a) What are the basic properties of frequency domain with respect to the image processing. (b) Define the terms: i. Impulse function of strength a ii. Impulse function

More information

Short Survey on Static Hand Gesture Recognition

Short Survey on Static Hand Gesture Recognition Short Survey on Static Hand Gesture Recognition Huu-Hung Huynh University of Science and Technology The University of Danang, Vietnam Duc-Hoang Vo University of Science and Technology The University of

More information

Image processing. Reading. What is an image? Brian Curless CSE 457 Spring 2017

Image processing. Reading. What is an image? Brian Curless CSE 457 Spring 2017 Reading Jain, Kasturi, Schunck, Machine Vision. McGraw-Hill, 1995. Sections 4.2-4.4, 4.5(intro), 4.5.5, 4.5.6, 5.1-5.4. [online handout] Image processing Brian Curless CSE 457 Spring 2017 1 2 What is an

More information

CIRCULAR MOIRÉ PATTERNS IN 3D COMPUTER VISION APPLICATIONS

CIRCULAR MOIRÉ PATTERNS IN 3D COMPUTER VISION APPLICATIONS CIRCULAR MOIRÉ PATTERNS IN 3D COMPUTER VISION APPLICATIONS Setiawan Hadi Mathematics Department, Universitas Padjadjaran e-mail : shadi@unpad.ac.id Abstract Geometric patterns generated by superimposing

More information

Effect of Contrast on the Quality of 3D Visual Perception

Effect of Contrast on the Quality of 3D Visual Perception Effect of Contrast on the Quality of 3D Visual Perception Mahsa T. Pourazad TELUS Communications Company, Canada University of British Columbia, Canada pourazad@ece.ubc.ca Zicong Mai, Panos Nasiopoulos

More information

Change detection using joint intensity histogram

Change detection using joint intensity histogram Change detection using joint intensity histogram Yasuyo Kita National Institute of Advanced Industrial Science and Technology (AIST) Information Technology Research Institute AIST Tsukuba Central 2, 1-1-1

More information

Natural Viewing 3D Display

Natural Viewing 3D Display We will introduce a new category of Collaboration Projects, which will highlight DoCoMo s joint research activities with universities and other companies. DoCoMo carries out R&D to build up mobile communication,

More information

Practice Exam Sample Solutions

Practice Exam Sample Solutions CS 675 Computer Vision Instructor: Marc Pomplun Practice Exam Sample Solutions Note that in the actual exam, no calculators, no books, and no notes allowed. Question 1: out of points Question 2: out of

More information

Detecting motion by means of 2D and 3D information

Detecting motion by means of 2D and 3D information Detecting motion by means of 2D and 3D information Federico Tombari Stefano Mattoccia Luigi Di Stefano Fabio Tonelli Department of Electronics Computer Science and Systems (DEIS) Viale Risorgimento 2,

More information

Image Processing. Traitement d images. Yuliya Tarabalka Tel.

Image Processing. Traitement d images. Yuliya Tarabalka  Tel. Traitement d images Yuliya Tarabalka yuliya.tarabalka@hyperinet.eu yuliya.tarabalka@gipsa-lab.grenoble-inp.fr Tel. 04 76 82 62 68 Noise reduction Image restoration Restoration attempts to reconstruct an

More information

Efficient Viewer-Centric Depth Adjustment Based on Virtual Fronto-Parallel Planar Projection in Stereo 3D Images

Efficient Viewer-Centric Depth Adjustment Based on Virtual Fronto-Parallel Planar Projection in Stereo 3D Images 326 IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 16, NO. 2, FEBRUARY 2014 Efficient Viewer-Centric Depth Adjustment Based on Virtual Fronto-Parallel Planar Projection in Stereo 3D Images Hanje Park, Hoonjae Lee,

More information

Last update: May 4, Vision. CMSC 421: Chapter 24. CMSC 421: Chapter 24 1

Last update: May 4, Vision. CMSC 421: Chapter 24. CMSC 421: Chapter 24 1 Last update: May 4, 200 Vision CMSC 42: Chapter 24 CMSC 42: Chapter 24 Outline Perception generally Image formation Early vision 2D D Object recognition CMSC 42: Chapter 24 2 Perception generally Stimulus

More information

Vision-Based 3D Fingertip Interface for Spatial Interaction in 3D Integral Imaging System

Vision-Based 3D Fingertip Interface for Spatial Interaction in 3D Integral Imaging System International Conference on Complex, Intelligent and Software Intensive Systems Vision-Based 3D Fingertip Interface for Spatial Interaction in 3D Integral Imaging System Nam-Woo Kim, Dong-Hak Shin, Dong-Jin

More information

Lecture: Edge Detection

Lecture: Edge Detection CMPUT 299 Winter 2007 Lecture: Edge Detection Irene Cheng Overview. What is a pixel in an image? 2. How does Photoshop, + human assistance, detect an edge in a picture/photograph? 3. Behind Photoshop -

More information

Fog Simulation and Refocusing from Stereo Images

Fog Simulation and Refocusing from Stereo Images Fog Simulation and Refocusing from Stereo Images Yifei Wang epartment of Electrical Engineering Stanford University yfeiwang@stanford.edu bstract In this project, we use stereo images to estimate depth

More information

Solution: filter the image, then subsample F 1 F 2. subsample blur subsample. blur

Solution: filter the image, then subsample F 1 F 2. subsample blur subsample. blur Pyramids Gaussian pre-filtering Solution: filter the image, then subsample blur F 0 subsample blur subsample * F 0 H F 1 F 1 * H F 2 { Gaussian pyramid blur F 0 subsample blur subsample * F 0 H F 1 F 1

More information

A Nondestructive Bump Inspection in Flip Chip Component using Fuzzy Filtering and Image Processing

A Nondestructive Bump Inspection in Flip Chip Component using Fuzzy Filtering and Image Processing A Nondestructive Bump Inspection in Flip Chip Component using Fuzzy Filtering and Image Processing 103 A Nondestructive Bump Inspection in Flip Chip Component using Fuzzy Filtering and Image Processing

More information

Neighborhood operations

Neighborhood operations Neighborhood operations Generate an output pixel on the basis of the pixel and its neighbors Often involve the convolution of an image with a filter kernel or mask g ( i, j) = f h = f ( i m, j n) h( m,

More information

Concepts in. Edge Detection

Concepts in. Edge Detection Concepts in Edge Detection Dr. Sukhendu Das Deptt. of Computer Science and Engg., Indian Institute of Technology, Madras Chennai 600036, India. http://www.cs.iitm.ernet.in/~sdas Email: sdas@iitm.ac.in

More information

Computer Vision I - Basics of Image Processing Part 1

Computer Vision I - Basics of Image Processing Part 1 Computer Vision I - Basics of Image Processing Part 1 Carsten Rother 28/10/2014 Computer Vision I: Basics of Image Processing Link to lectures Computer Vision I: Basics of Image Processing 28/10/2014 2

More information

Implementation of a Pedestrian Detection Device based on CENTRIST for an Embedded Environment

Implementation of a Pedestrian Detection Device based on CENTRIST for an Embedded Environment , pp.123-127 http://dx.doi.org/10.14257/astl.2014.46.29 Implementation of a Pedestrian Detection Device based on CENTRIST for an Embedded Environment Yun-Seop Hwang 1, Jae-Chang Kwak 2, Kwang-Yeob Lee

More information

Color-Texture Segmentation of Medical Images Based on Local Contrast Information

Color-Texture Segmentation of Medical Images Based on Local Contrast Information Color-Texture Segmentation of Medical Images Based on Local Contrast Information Yu-Chou Chang Department of ECEn, Brigham Young University, Provo, Utah, 84602 USA ycchang@et.byu.edu Dah-Jye Lee Department

More information

Comparison between Various Edge Detection Methods on Satellite Image

Comparison between Various Edge Detection Methods on Satellite Image Comparison between Various Edge Detection Methods on Satellite Image H.S. Bhadauria 1, Annapurna Singh 2, Anuj Kumar 3 Govind Ballabh Pant Engineering College ( Pauri garhwal),computer Science and Engineering

More information

Robotics Programming Laboratory

Robotics Programming Laboratory Chair of Software Engineering Robotics Programming Laboratory Bertrand Meyer Jiwon Shin Lecture 8: Robot Perception Perception http://pascallin.ecs.soton.ac.uk/challenges/voc/databases.html#caltech car

More information

A Robust Method for Circle / Ellipse Extraction Based Canny Edge Detection

A Robust Method for Circle / Ellipse Extraction Based Canny Edge Detection International Journal of Research Studies in Science, Engineering and Technology Volume 2, Issue 5, May 2015, PP 49-57 ISSN 2349-4751 (Print) & ISSN 2349-476X (Online) A Robust Method for Circle / Ellipse

More information

Anno accademico 2006/2007. Davide Migliore

Anno accademico 2006/2007. Davide Migliore Robotica Anno accademico 6/7 Davide Migliore migliore@elet.polimi.it Today What is a feature? Some useful information The world of features: Detectors Edges detection Corners/Points detection Descriptors?!?!?

More information

MOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK

MOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK MOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK Mahamuni P. D 1, R. P. Patil 2, H.S. Thakar 3 1 PG Student, E & TC Department, SKNCOE, Vadgaon Bk, Pune, India 2 Asst. Professor,

More information

Intermediate view synthesis considering occluded and ambiguously referenced image regions 1. Carnegie Mellon University, Pittsburgh, PA 15213

Intermediate view synthesis considering occluded and ambiguously referenced image regions 1. Carnegie Mellon University, Pittsburgh, PA 15213 1 Intermediate view synthesis considering occluded and ambiguously referenced image regions 1 Jeffrey S. McVeigh *, M. W. Siegel ** and Angel G. Jordan * * Department of Electrical and Computer Engineering

More information

Real-time Detection of Illegally Parked Vehicles Using 1-D Transformation

Real-time Detection of Illegally Parked Vehicles Using 1-D Transformation Real-time Detection of Illegally Parked Vehicles Using 1-D Transformation Jong Taek Lee, M. S. Ryoo, Matthew Riley, and J. K. Aggarwal Computer & Vision Research Center Dept. of Electrical & Computer Engineering,

More information

Linear Operations Using Masks

Linear Operations Using Masks Linear Operations Using Masks Masks are patterns used to define the weights used in averaging the neighbors of a pixel to compute some result at that pixel Expressing linear operations on neighborhoods

More information

An Edge Detection Algorithm for Online Image Analysis

An Edge Detection Algorithm for Online Image Analysis An Edge Detection Algorithm for Online Image Analysis Azzam Sleit, Abdel latif Abu Dalhoum, Ibraheem Al-Dhamari, Afaf Tareef Department of Computer Science, King Abdulla II School for Information Technology

More information

Lecture 7: Most Common Edge Detectors

Lecture 7: Most Common Edge Detectors #1 Lecture 7: Most Common Edge Detectors Saad Bedros sbedros@umn.edu Edge Detection Goal: Identify sudden changes (discontinuities) in an image Intuitively, most semantic and shape information from the

More information

Conversion of 2D Image into 3D and Face Recognition Based Attendance System

Conversion of 2D Image into 3D and Face Recognition Based Attendance System Conversion of 2D Image into 3D and Face Recognition Based Attendance System Warsha Kandlikar, Toradmal Savita Laxman, Deshmukh Sonali Jagannath Scientist C, Electronics Design and Technology, NIELIT Aurangabad,

More information

Crosstalk reduces the amount of depth seen in 3D images of natural scenes

Crosstalk reduces the amount of depth seen in 3D images of natural scenes Crosstalk reduces the amount of depth seen in 3D images of natural scenes Inna Tsirlin *, Robert S. Allison and Laurie M. Wilcox Centre for Vision Research, York University, 4700 Keele st., Toronto, ON,

More information

Announcements. Edge Detection. An Isotropic Gaussian. Filters are templates. Assignment 2 on tracking due this Friday Midterm: Tuesday, May 3.

Announcements. Edge Detection. An Isotropic Gaussian. Filters are templates. Assignment 2 on tracking due this Friday Midterm: Tuesday, May 3. Announcements Edge Detection Introduction to Computer Vision CSE 152 Lecture 9 Assignment 2 on tracking due this Friday Midterm: Tuesday, May 3. Reading from textbook An Isotropic Gaussian The picture

More information

Feature Detectors - Canny Edge Detector

Feature Detectors - Canny Edge Detector Feature Detectors - Canny Edge Detector 04/12/2006 07:00 PM Canny Edge Detector Common Names: Canny edge detector Brief Description The Canny operator was designed to be an optimal edge detector (according

More information

CS4733 Class Notes, Computer Vision

CS4733 Class Notes, Computer Vision CS4733 Class Notes, Computer Vision Sources for online computer vision tutorials and demos - http://www.dai.ed.ac.uk/hipr and Computer Vision resources online - http://www.dai.ed.ac.uk/cvonline Vision

More information

Department of Computer Science University of Western Cape Computer Science Honours Project: Anaglyph Video By: Jihaad Pienaar Supervisors: Mehrdad

Department of Computer Science University of Western Cape Computer Science Honours Project: Anaglyph Video By: Jihaad Pienaar Supervisors: Mehrdad Department of Computer Science University of Western Cape Computer Science Honours Project: Anaglyph Video By: Jihaad Pienaar Supervisors: Mehrdad Ghaziasgar and James Connan Glossary Depth Map Stereo

More information

Saliency Extraction for Gaze-Contingent Displays

Saliency Extraction for Gaze-Contingent Displays In: Workshop on Organic Computing, P. Dadam, M. Reichert (eds.), Proceedings of the 34th GI-Jahrestagung, Vol. 2, 646 650, Ulm, September 2004. Saliency Extraction for Gaze-Contingent Displays Martin Böhme,

More information

Efficient Stereo Image Rectification Method Using Horizontal Baseline

Efficient Stereo Image Rectification Method Using Horizontal Baseline Efficient Stereo Image Rectification Method Using Horizontal Baseline Yun-Suk Kang and Yo-Sung Ho School of Information and Communicatitions Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro,

More information

Film Line scratch Detection using Neural Network and Morphological Filter

Film Line scratch Detection using Neural Network and Morphological Filter Film Line scratch Detection using Neural Network and Morphological Filter Kyung-tai Kim and Eun Yi Kim Dept. of advanced technology fusion, Konkuk Univ. Korea {kkt34, eykim}@konkuk.ac.kr Abstract This

More information

Triangular Mesh Segmentation Based On Surface Normal

Triangular Mesh Segmentation Based On Surface Normal ACCV2002: The 5th Asian Conference on Computer Vision, 23--25 January 2002, Melbourne, Australia. Triangular Mesh Segmentation Based On Surface Normal Dong Hwan Kim School of Electrical Eng. Seoul Nat

More information

CHAPTER 3 IMAGE ENHANCEMENT IN THE SPATIAL DOMAIN

CHAPTER 3 IMAGE ENHANCEMENT IN THE SPATIAL DOMAIN CHAPTER 3 IMAGE ENHANCEMENT IN THE SPATIAL DOMAIN CHAPTER 3: IMAGE ENHANCEMENT IN THE SPATIAL DOMAIN Principal objective: to process an image so that the result is more suitable than the original image

More information

Implementation of a Face Recognition System for Interactive TV Control System

Implementation of a Face Recognition System for Interactive TV Control System Implementation of a Face Recognition System for Interactive TV Control System Sang-Heon Lee 1, Myoung-Kyu Sohn 1, Dong-Ju Kim 1, Byungmin Kim 1, Hyunduk Kim 1, and Chul-Ho Won 2 1 Dept. IT convergence,

More information

Analysis of TFT-LCD Point Defect Detection System Based on Machine Vision

Analysis of TFT-LCD Point Defect Detection System Based on Machine Vision 09 nd International Conference on Computer Science and Advanced Materials (CSAM 09) Analysis of TFT-LCD Point Defect Detection System Based on Machine Vision Zhang Wenqian, Zhang Jinhong Department of

More information

Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features. Wei-Ta Chu

Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features. Wei-Ta Chu 1 Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features Wei-Ta Chu H.-H. Yeh, C.-Y. Yang, M.-S. Lee, and C.-S. Chen, Video Aesthetic Quality Assessment by Temporal

More information

FPGA IMPLEMENTATION FOR REAL TIME SOBEL EDGE DETECTOR BLOCK USING 3-LINE BUFFERS

FPGA IMPLEMENTATION FOR REAL TIME SOBEL EDGE DETECTOR BLOCK USING 3-LINE BUFFERS FPGA IMPLEMENTATION FOR REAL TIME SOBEL EDGE DETECTOR BLOCK USING 3-LINE BUFFERS 1 RONNIE O. SERFA JUAN, 2 CHAN SU PARK, 3 HI SEOK KIM, 4 HYEONG WOO CHA 1,2,3,4 CheongJu University E-maul: 1 engr_serfs@yahoo.com,

More information

THERE ARE two primary unwanted effects in 3-D TV:

THERE ARE two primary unwanted effects in 3-D TV: 482 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 23, NO. 3, MARCH 2013 Visual Comfort Enhancement for Stereoscopic Video Based on Binocular Fusion Characteristics Donghyun Kim,

More information

A Feature Point Matching Based Approach for Video Objects Segmentation

A Feature Point Matching Based Approach for Video Objects Segmentation A Feature Point Matching Based Approach for Video Objects Segmentation Yan Zhang, Zhong Zhou, Wei Wu State Key Laboratory of Virtual Reality Technology and Systems, Beijing, P.R. China School of Computer

More information

Scene Segmentation by Color and Depth Information and its Applications

Scene Segmentation by Color and Depth Information and its Applications Scene Segmentation by Color and Depth Information and its Applications Carlo Dal Mutto Pietro Zanuttigh Guido M. Cortelazzo Department of Information Engineering University of Padova Via Gradenigo 6/B,

More information

Edge detection. Goal: Identify sudden. an image. Ideal: artist s line drawing. object-level knowledge)

Edge detection. Goal: Identify sudden. an image. Ideal: artist s line drawing. object-level knowledge) Edge detection Goal: Identify sudden changes (discontinuities) in an image Intuitively, most semantic and shape information from the image can be encoded in the edges More compact than pixels Ideal: artist

More information

An Improvement of the Occlusion Detection Performance in Sequential Images Using Optical Flow

An Improvement of the Occlusion Detection Performance in Sequential Images Using Optical Flow , pp.247-251 http://dx.doi.org/10.14257/astl.2015.99.58 An Improvement of the Occlusion Detection Performance in Sequential Images Using Optical Flow Jin Woo Choi 1, Jae Seoung Kim 2, Taeg Kuen Whangbo

More information

Robot vision review. Martin Jagersand

Robot vision review. Martin Jagersand Robot vision review Martin Jagersand What is Computer Vision? Computer Graphics Three Related fields Image Processing: Changes 2D images into other 2D images Computer Graphics: Takes 3D models, renders

More information

Basic relations between pixels (Chapter 2)

Basic relations between pixels (Chapter 2) Basic relations between pixels (Chapter 2) Lecture 3 Basic Relationships Between Pixels Definitions: f(x,y): digital image Pixels: q, p (p,q f) A subset of pixels of f(x,y): S A typology of relations:

More information

Traffic Signs Recognition using HP and HOG Descriptors Combined to MLP and SVM Classifiers

Traffic Signs Recognition using HP and HOG Descriptors Combined to MLP and SVM Classifiers Traffic Signs Recognition using HP and HOG Descriptors Combined to MLP and SVM Classifiers A. Salhi, B. Minaoui, M. Fakir, H. Chakib, H. Grimech Faculty of science and Technology Sultan Moulay Slimane

More information

Correspondence and Stereopsis. Original notes by W. Correa. Figures from [Forsyth & Ponce] and [Trucco & Verri]

Correspondence and Stereopsis. Original notes by W. Correa. Figures from [Forsyth & Ponce] and [Trucco & Verri] Correspondence and Stereopsis Original notes by W. Correa. Figures from [Forsyth & Ponce] and [Trucco & Verri] Introduction Disparity: Informally: difference between two pictures Allows us to gain a strong

More information

Small Object Segmentation Based on Visual Saliency in Natural Images

Small Object Segmentation Based on Visual Saliency in Natural Images J Inf Process Syst, Vol.9, No.4, pp.592-601, December 2013 http://dx.doi.org/10.3745/jips.2013.9.4.592 pissn 1976-913X eissn 2092-805X Small Object Segmentation Based on Visual Saliency in Natural Images

More information

Filtering and Edge Detection. Computer Vision I. CSE252A Lecture 10. Announcement

Filtering and Edge Detection. Computer Vision I. CSE252A Lecture 10. Announcement Filtering and Edge Detection CSE252A Lecture 10 Announcement HW1graded, will be released later today HW2 assigned, due Wed. Nov. 7 1 Image formation: Color Channel k " $ $ # $ I r I g I b % " ' $ ' = (

More information

Image Segmentation Using Iterated Graph Cuts Based on Multi-scale Smoothing

Image Segmentation Using Iterated Graph Cuts Based on Multi-scale Smoothing Image Segmentation Using Iterated Graph Cuts Based on Multi-scale Smoothing Tomoyuki Nagahashi 1, Hironobu Fujiyoshi 1, and Takeo Kanade 2 1 Dept. of Computer Science, Chubu University. Matsumoto 1200,

More information

Stereo Image Rectification for Simple Panoramic Image Generation

Stereo Image Rectification for Simple Panoramic Image Generation Stereo Image Rectification for Simple Panoramic Image Generation Yun-Suk Kang and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju 500-712 Korea Email:{yunsuk,

More information

Multidimensional image retargeting

Multidimensional image retargeting Multidimensional image retargeting 9:00: Introduction 9:10: Dynamic range retargeting Tone mapping Apparent contrast and brightness enhancement 10:45: Break 11:00: Color retargeting 11:30: LDR to HDR 12:20:

More information

Ulrik Söderström 16 Feb Image Processing. Segmentation

Ulrik Söderström 16 Feb Image Processing. Segmentation Ulrik Söderström ulrik.soderstrom@tfe.umu.se 16 Feb 2011 Image Processing Segmentation What is Image Segmentation? To be able to extract information from an image it is common to subdivide it into background

More information

An Abstraction Technique for Producing 3D Visual Contents

An Abstraction Technique for Producing 3D Visual Contents , pp.353-360 http://dx.doi.org/10.14257/ijmue.2013.8.5.35 An Abstraction Technique for Producing 3D Visual Contents Kyungha Min Dept. of Digital Media, Sangmyung Univ., Seoul, Korea minkyungha@gmail.com

More information

PRE-PROCESSING OF HOLOSCOPIC 3D IMAGE FOR AUTOSTEREOSCOPIC 3D DISPLAYS

PRE-PROCESSING OF HOLOSCOPIC 3D IMAGE FOR AUTOSTEREOSCOPIC 3D DISPLAYS PRE-PROCESSING OF HOLOSCOPIC 3D IMAGE FOR AUTOSTEREOSCOPIC 3D DISPLAYS M.R Swash, A. Aggoun, O. Abdulfatah, B. Li, J. C. Fernández, E. Alazawi and E. Tsekleves School of Engineering and Design, Brunel

More information

Edge and local feature detection - 2. Importance of edge detection in computer vision

Edge and local feature detection - 2. Importance of edge detection in computer vision Edge and local feature detection Gradient based edge detection Edge detection by function fitting Second derivative edge detectors Edge linking and the construction of the chain graph Edge and local feature

More information

DETECTION OF SMOOTH TEXTURE IN FACIAL IMAGES FOR THE EVALUATION OF UNNATURAL CONTRAST ENHANCEMENT

DETECTION OF SMOOTH TEXTURE IN FACIAL IMAGES FOR THE EVALUATION OF UNNATURAL CONTRAST ENHANCEMENT DETECTION OF SMOOTH TEXTURE IN FACIAL IMAGES FOR THE EVALUATION OF UNNATURAL CONTRAST ENHANCEMENT 1 NUR HALILAH BINTI ISMAIL, 2 SOONG-DER CHEN 1, 2 Department of Graphics and Multimedia, College of Information

More information