Robust Frequency-tuned Salient Region Detection
|
|
- Gregory Arnold
- 5 years ago
- Views:
Transcription
1 Robust Frequency-tuned Salient Region Detection 1 Yong Zhang, 2 Yihua Lan, 3 Haozheng Ren, 4 Ming Li 1 School of Computer Engineering, Huaihai Institute of Technology, Lianyungang, China, zhyhglyg@126.com *2,Corresponding Author School of Computer Engineering, Huaihai Institute of Technology, Lianyungang, China,lanhua_2000@sina.com 3 School of Computer Engineering, Huaihai Institute of Technology, Lianyungang, China, renhaozheng666@163.com 4 Imaging Processing Business Dept of Beijing E-COM Technology CO., LTD., Beijing , China Beijing, China, @qq.com Abstract Detection of visually salient image regions has been of great research interest in recent years. It is useful for a wide range of applications such as object detection, video summarization and object segmentation. In this paper, we propose a modified method based on frequency-tuned (FT) model for salient region detection that outputs full resolution saliency maps with well-defined boundaries of salient objects. For FT model, saliency is considered as a distance to the mean spatial frequency content that is too simple for complex scenes and inconsistent with our usual sense. Our modified model, which called as Robust FT, following the assumptions of salient region, can get better saliency maps. We consider the mean spatial frequency content as background and formulate a much more robust model to descript it. By practical experiments, it is verified that our model obtains better results than original methods. 1. Introduction Keywords: Visual Saliency; Salient Region; Image Analysis Salient regions are generally regarded as the candidate of attention focus in human eyes. Each pixel in a salient region describes an important point of the object in the image or scene that is projected into the human visual system in a special location. The purpose of detecting salient region is to direct eye movements to the most relevant parts of the visual field [1-3]. It is also very useful for computer vision as they offer an efficient approach in processing complex scenes by locating those regions of interest for directing analysis in a similar way that is compared with human visual system. Therefore, detecting salient regions is a very important stage in object detection, which is widely used in object recognition, object tracing and image compression, to name a few [4-5]. Thus a number of researchers are attracted in this field for developing and investigating efficient techniques to detect salient regions. For the time being, many algorithms have been proposed to simulate this process. Among them, a model for generating salience maps which proposed by Koch and Ullman is recognized as the most influential approach [6]. In their studies, they proposed several viewpoints: first of all, they thought the different topographical maps which are called as early representation by them can be represented in parallel by a number of elementary features, such as color, orientation and so on. Secondly, they thought there is a selective mapping from the early topographical representation into a more central non-topographic representation. At last they proposed certain selection rules to determine which locations can be mapped into the central representation [6]. By using those viewpoints and methods, they attempted to address the question that how simply networks of neuron-like elements can account for a variety of phenomena associated with this shift of selective visual attention. In the end of their literature, Koch and Ullman suggest a possible way which contains three different stages for selective visual attention based on the discussions in their study. Since then, the model proposed by Koch and Ullman has been further researched by many researchers over three decades [7-8]. L. Itti, C. Koch and E. Niebur proposed a model of saliency-based visual attention for rapid scene analysis. Based on the International Journal of Digital Content Technology and its Applications(JDCTA) Volume6,Number20,November 2012 doi: /jdcta.vol6.issue
2 behavior and early primate visual system proposed by Koch and Ullman, L. Itti, C. Koch and E. Niebur combined multi-scale image features, such as colors, intensity and orientations etc., into a single topographical saliency map, then they used a dynamical neural network to select attended locations. The experimental results in their literature showed that their system can select a salient region to be analyzed detailedly by using a computationally efficient manner [7]. D. Walther and C. Koch propose a biologically plausible model of forming and attending to proto-objects, the experimental results showed that the model proposed by them can enable a model of object recognition in cortex to expand from recognizing individual objects in isolation to sequentially recognizing all objects in a more complex scene [8]. Paul L.Rosin proposed a simple method for detecting salient regions [1], the model only use edge detection, threshold decomposition, the distance transform and threshold and avoid the need to set any parameter. Experiments show that their model is effective and easy to be implemented. Although so many methods have been developed, most of them generate regions having low resolution and poorly defined borders. Recently, Achanta et al. [9] illustrated that most techniques in this area primarily operate using extremely low-frequency content in the image, and then they introduced a fast frequency-tuned (FT) approach for salient region detection that outputs full resolution maps with well-defined boundaries. The experimental resulting saliency maps got both higher precision and better recall than five state-of-the-art algorithms (including Itti et al. [10], Ma and Zhang [11], Harel et al. [12], Hou and Zhang [13] and Achanta et al. [14]) on object segmentation. In this paper, we first cover associated shortcomings of FT method, and discuss preliminary solutions of them. And then we present our novel method, which modifies the original one to achieve better performance. The experiments and results demonstrate that our method is a promising way. The rest of this paper as follows: in section 2, the problems of FT method are analyzed. Then the proposed robust FT method by us is introduced in section 3. Section 4 given the experimental and corresponding results. Discussion based on the experimental in section 3 is also presented. At last, conclusions will be given in the end of section Problems of FT method To develop the FT method, Achanta et al. [14] examine five state-of-the-art saliency detectors from a frequency domain perspective as mentioned above. IT method produces very blurry version of the original image because most of the high frequencies are removed. This means the saliency map is un-correct enough for segmentation. The MZ method is a block average method. Even for a good choice of block size, MZ can not give a clear saliency map. GB has the same problem as IT that discards most of the high frequencies, and produces a blurry image. The SR method is better than IT and GB for retaining high frequencies, which can get a similar result as MZ methods. The AC method is quite different from the above four methods. It retains the entire range, and all the high frequencies are retained but low frequencies are sometimes discarded. So its saliency map is quite sharp. For the analysis above, Achanta et al.[14] fined some requirements for a saliency detector: Emphasize the largest salient objects. Uniformly highlight whole salient regions. Establish well-defined boundaries of salient objects. Disregard high frequencies arising from texture, noise and blocking artifacts. Efficiently output full resolution saliency maps. The FT method is base on a DoG filter with large standard deviation ratio of Gaussian kernels. Because the great standard deviation is selected to be infinity, the saliency map is formulated as: S( x, y) = I - I ( x, y) (1) m whc where I m is the mean image feature vector (corresponding to the great standard deviation), Iwhc ( xy, ) is the corresponding image pixel vector value in the Gaussian blurred version of the original image (corresponding to the small standard deviation), and is the L 2 norm. A basic principle in visual system is to suppress the frequently occurring features, while at the same time keeps sensitive to features that deviate from the norm [15]. From this point of view, we consider 362
3 I m as a model of frequently occurring features the background. But there are at least two shortcomings of this model. Firstly, it is not a real background. In fact, it s the mean of background and foreground with different weights which even does not appear in the image. Secondly, just one point in the feature space will be too simple to be a background. Consider a tiny image with black and white background, and a small gray square at the center of the image. Then the background color will be gray (Fig.1). (a) a tiny image example (b) background computed by FT (c) the salient ratio image (d) the real background 1 (e) the real background 2 (f) the real salient ratio image Figure 1. The situation when FT fails. The salient region detection is essentially an unbalance classification problem. When the background is an isotropic Gaussian distribution and occupies a large proportion, the above model will work well. But when the background is complex, such as multi-gaussian distribution, the above model fails. To solve these problems, we need to form a relatively more complex model that describes the real background features without adding foreground factors. 3. The proposed Robust FT method In order to raise FT method s performance on complex background, while keeping the advantages of its efficiency, full resolution maps and well-defined boundaries, we suppose to extend this method as follow: 363
4 S( x, y) = min I -I ( x, y), iî N + (2) i g where I i is the i th background feature vector, I g is the Gaussian blurred image to avoid noise. This formulation model the background with a feature point set and the saliency of each pixel is measured by its shortest distance to the set. How can we get a series of background representatives without using a time-consuming sophisticated classification or clustering method? When we check the assumptions of salient region, we can find that salient region take the character of relatively small size (scale property), spatial concentration (for single object), and usually near the center of the image when the object is huge. Then any part of the image which contains a great portion of background pixels could be a candidate background modeling region (BMR). By this way, the FT model exploits the whole image as the only BMR. But it is not imperative. For simplicity and efficiency, we take four regions as BMRs in this paper: 1/3 top image I top, 1/3 bottom image I bottom, 1/3 right image I right and 1/3 left image I left. These regions are usually unbalanced, contain more background pixels than foreground pixels following the characters of salient region, and they are abundant enough to model backgrounds in common scenes. Another shortcoming of FT model is that the background point I m is usually not a real pixel value in the image. It s a mixture of background and foreground, so it can t suppress background pixels well. For example, consider a bi-valued image which has n 1 pixels of value v 1 and n 2 pixels of value v 2. The saliency of v 1 and v 2 are n2 Sv = v 1 1-v2 (3) n + n 1 2 n 1 Sv = v 2 1-v2 n1+ n2 ( 4 ) and the saliency ratio is Sv / S 1 v = n 2 2 / n1. So a color salient region, without any change of color value, will become not such salient as it grows a little bigger. This is inconsistent with our usual sense. For the pursuit of robust as human vision system, we employ the median point instead of the FT s mean point of the BMR to model the background region. Then the formulation becomes S( x, y) = min{ I - I ( x, y) } (5) median where I = median( I ), Î { top, bottom, right, left}. median The proposed salient region detection is in fact a cluster algorithm in the color space. The image color is sampled by the region we defined as the top, bottom, right and left particle of the image. The background color becomes several center points of the color space. All other pixels are gathered by the shortest distance from these centers. The FT method has only one center, so it s very hard to descript the distribution of image color space. Our method with several centers does a litter better. There is no doubt that some more complex methods which can descript the color distribution well will get much more better results, but suffer from high computing complex, as we can see in Fig.2. g 364
5 (a) the FT s description (b) the proposed description Figure 2. Color space description by FT and the proposed method. (bg: background; fg: foreground) 4. Experiments and results In this section, we present comparisons with our method against the FT method. In order to obtain an objective comparison result, we use a ground truth image database which used by Achanta et al. [9]. This accurate object-contour based ground truth database, which is publicly available, contains masks of 1000 images selected from another publicly available database used by Liu et al. [16] (example in Fig.3). The MATLAB implementation of FT method can be downloaded from Radhakrishna s homepage. The Lab color space is used as a feature space in our experiments. Each pixel is a [,, ] T L ab vector. A few results of saliency map generated by the two methods are shown in Fig.4. The test images contain objects of different sizes, positions and colors, and the backgrounds are also of great variety. Our method clearly outperforms the FT method of suppressing the background. To quantify the different performance of the two methods, we employ Foreground Saliency Ratio (FSR) to measure the saliency map of each image. The FSR can be defined as the formula (6): mean( S( x, y) Î Foreground) FSR = mean( S( x, y) Î Foreground) + mean( S( x, y) ÎBackground) (6) This criterion states that an optimal saliency map should response high in foreground regions and low in background regions. Fig. 5 shows the mean intensity of foreground map and background map of 1000 images, that ordered by their foreground map value. For FT method the average foreground and background map values of the whole 1000 images are and , while for our method
6 and This means our method suppresses the background much better than FT method. Fig. 6 shows FSR s of the database. The images are order by their FSR s by FT method. There are 958 of 1000 images on which our method get high FSR s, and the average FSR of the whole database is for our method and for FT method. (a) original image from [16] (b) ground truth mask from [9] Figure 3. Ground truth examples 366
7 Figure 4. Some results of our method in comparison with FT method. In each group, we present 1) the input image, 2) saliency map generated by FT method, 3) saliency map generated by our method. (a) mean intensity of FT method 367
8 (b) mean intensity of our method Figure 5. Plot of the mean intensity of the saliency map of foreground and background for 1000 images. The images are ordered by their mean intensity of the foreground. 5. Summary Figure 6. Foreground Saliency Ratio of 1000 images In this paper, a novel algorithm for salient region detection is proposed. The proposed method, which is based on FT method, is called as Robust-FT method. It extends the original FT method by modeling the background with a feature set rather than a single feature point, and employing a robust median operator to computer this set from candidate background modeling regions. The new method not only inherits the advantages of the original method, such as well-defined boundaries, full resolution, and computational efficiency, it performances much better suppressing of background, especially when the background is complex. 368
9 Acknowledgement This study was supported in part by the National Natural Science Foundation of China (Grant No ), and by the Science Foundation of Jiangsu Province (Grant No.BK ), and by the Huaihai Institute of Technology Natural Science Foundation (Grant No. Z ), and by the Construction Found of JiangSu for Key Disciplines in Applications of Computing. The authors are grateful to Dr. Zhifang Min, a senior engineer in Department of system, Huazhong Institute of Optoelectronics, for providing theoretical supports on this research. References [1] Hao Jiang, Jie Xu, "Matching objects in multi-camera surveillance without geometric cnstraints", International Journal of Digital Content Technology and its Applications, vol.5, no.6, pp.79-86, [2] Qiaorong Zhang, yongqiang Zhang, "Salient region detection in video using spatiotemporal visual attention model", International Journal of Digital Content Technology and its Applications, Vol.6, no.11, [3] M. Jian, J. Dong and J. Ma, "Image retrieval using wavelet-based salient regions," Imaging Science Journal, The, vol. 59, pp , [4] Songhe Feng, De Xu, Xu Yang, "Attention-driven salient edge (s) and region (s) extraction with application to CBIR," Signal Processing, vol. 90, pp. 1-15, [5] Yang Liu, Xueqing Li, Lei Wang, Yuzhen Niu, Feng Liu, "Oscillation analysis for salient object detection," Multimedia Tools and Applications, pp. 1-21, [6] C. Koch and S. Ullman, "Shifts in selective visual attention: towards the underlying neural circuitry," Hum Neurobiol, vol. 4, no.1, pp , [7] Laurent Itti, Christof Koch and Ernst Niebur, "A model of saliency-based visual attention for rapid scene analysis," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 20, pp , [8] Dirk Bernhardt-Walther, Christof Koch, "Modeling attention to salient proto-objects," Neural Networks, vol. 19, pp , [9] Radhakrishna Achanta, Sheila Hemami, Francisco Estrada, Susstrunk, Frequency-tuned Salient Region Detection, IEEE Conference on Computer Vision and Pattern Recognition, [10] L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vo.20, no.11, pp.: , [11] YuFei Ma, HongJiang Zhang, Contrast-based image attention analysis by using fuzzy growing, In ACM International Conference on Multimedia, [12] J. Harel, C. Koch, and P. Perona, Graph-base visual saliency, Advances in Neural Information Processing Systems, Vol.19,no.1, pp: , [13] Xiaodi Hou, Liqing Zhang, Saliency detection: A spectral residual approach, IEEE Conference on Computer Vision and Pattern Recognition, [14] Radhakrishna Achanta, Francisco Estrada, Patricia Wils, Sabine Susstrunk, Salient region detection and segmentation. International Conference on Computer Vision System, [15] C. Koch, and T. Poggio, Predicting the visual world: silence is golden. Nature Neuroscience, Vol.2, no.1, pp:9-10, [16] Tie Liu, Jian Sun, Nanning Zheng, Xiaoou Tang, Heung-Yeung Shum, Learning to detect a salient object. IEEE Conference on Computer Vision and Pattern Recognition,
Small Object Segmentation Based on Visual Saliency in Natural Images
J Inf Process Syst, Vol.9, No.4, pp.592-601, December 2013 http://dx.doi.org/10.3745/jips.2013.9.4.592 pissn 1976-913X eissn 2092-805X Small Object Segmentation Based on Visual Saliency in Natural Images
More informationA Survey on Detecting Image Visual Saliency
1/29 A Survey on Detecting Image Visual Saliency Hsin-Ho Yeh Institute of Information Science, Acamedic Sinica, Taiwan {hhyeh}@iis.sinica.edu.tw 2010/12/09 2/29 Outline 1 Conclusions 3/29 What is visual
More informationMain Subject Detection via Adaptive Feature Selection
Main Subject Detection via Adaptive Feature Selection Cuong Vu and Damon Chandler Image Coding and Analysis Lab Oklahoma State University Main Subject Detection is easy for human 2 Outline Introduction
More informationSalient Region Detection and Segmentation in Images using Dynamic Mode Decomposition
Salient Region Detection and Segmentation in Images using Dynamic Mode Decomposition Sikha O K 1, Sachin Kumar S 2, K P Soman 2 1 Department of Computer Science 2 Centre for Computational Engineering and
More informationIMAGE SALIENCY DETECTION VIA MULTI-SCALE STATISTICAL NON-REDUNDANCY MODELING. Christian Scharfenberger, Aanchal Jain, Alexander Wong, and Paul Fieguth
IMAGE SALIENCY DETECTION VIA MULTI-SCALE STATISTICAL NON-REDUNDANCY MODELING Christian Scharfenberger, Aanchal Jain, Alexander Wong, and Paul Fieguth Department of Systems Design Engineering, University
More information2.1 Optimized Importance Map
3rd International Conference on Multimedia Technology(ICMT 2013) Improved Image Resizing using Seam Carving and scaling Yan Zhang 1, Jonathan Z. Sun, Jingliang Peng Abstract. Seam Carving, the popular
More informationImage Compression and Resizing Using Improved Seam Carving for Retinal Images
Image Compression and Resizing Using Improved Seam Carving for Retinal Images Prabhu Nayak 1, Rajendra Chincholi 2, Dr.Kalpana Vanjerkhede 3 1 PG Student, Department of Electronics and Instrumentation
More informationFrequency-tuned Salient Region Detection
Frequency-tuned Salient Region Detection Radhakrishna Achanta, Sheila Hemami, Francisco Estrada, and Sabine Süsstrunk School of Computer and Communication Sciences (IC) Ecole Polytechnique Fédérale de
More informationSaliency Detection using Region-Based Incremental Center-Surround Distance
Saliency Detection using Region-Based Incremental Center-Surround Distance Minwoo Park Corporate Research and Engineering Eastman Kodak Company Rochester, NY, USA minwoo.park@kodak.com Mrityunjay Kumar
More informationInternational Conference on Information Sciences, Machinery, Materials and Energy (ICISMME 2015)
International Conference on Information Sciences, Machinery, Materials and Energy (ICISMME 2015) Brief Analysis on Typical Image Saliency Detection Methods Wenwen Pan, Xiaofei Sun, Xia Wang, Wei Zhang
More informationPERFORMANCE ANALYSIS OF COMPUTING TECHNIQUES FOR IMAGE DISPARITY IN STEREO IMAGE
PERFORMANCE ANALYSIS OF COMPUTING TECHNIQUES FOR IMAGE DISPARITY IN STEREO IMAGE Rakesh Y. Department of Electronics and Communication Engineering, SRKIT, Vijayawada, India E-Mail: rakesh.yemineni@gmail.com
More informationAUTONOMOUS IMAGE EXTRACTION AND SEGMENTATION OF IMAGE USING UAV S
AUTONOMOUS IMAGE EXTRACTION AND SEGMENTATION OF IMAGE USING UAV S Radha Krishna Rambola, Associate Professor, NMIMS University, India Akash Agrawal, Student at NMIMS University, India ABSTRACT Due to the
More informationSupplementary Material for submission 2147: Traditional Saliency Reloaded: A Good Old Model in New Shape
Supplementary Material for submission 247: Traditional Saliency Reloaded: A Good Old Model in New Shape Simone Frintrop, Thomas Werner, and Germán M. García Institute of Computer Science III Rheinische
More informationA Novel Approach for Saliency Detection based on Multiscale Phase Spectrum
A Novel Approach for Saliency Detection based on Multiscale Phase Spectrum Deepak Singh Department of Electronics & Communication National Institute of Technology Rourkela 769008, Odisha, India Email:
More informationDetecting Salient Contours Using Orientation Energy Distribution. Part I: Thresholding Based on. Response Distribution
Detecting Salient Contours Using Orientation Energy Distribution The Problem: How Does the Visual System Detect Salient Contours? CPSC 636 Slide12, Spring 212 Yoonsuck Choe Co-work with S. Sarma and H.-C.
More informationModeling Attention to Salient Proto-objects
Modeling Attention to Salient Proto-objects Dirk Bernhardt-Walther Collaborators: Laurent Itti Christof Koch Pietro Perona Tommy Poggio Maximilian Riesenhuber Ueli Rutishauser Beckman Institute, University
More informationSalient Region Detection and Segmentation
Salient Region Detection and Segmentation Radhakrishna Achanta, Francisco Estrada, Patricia Wils, and Sabine Süsstrunk School of Computer and Communication Sciences (I&C), Ecole Polytechnique Fédérale
More informationThe Vehicle Logo Location System based on saliency model
ISSN 746-7659, England, UK Journal of Information and Computing Science Vol. 0, No. 3, 205, pp. 73-77 The Vehicle Logo Location System based on saliency model Shangbing Gao,2, Liangliang Wang, Hongyang
More informationUnsupervised Saliency Estimation based on Robust Hypotheses
Utah State University DigitalCommons@USU Computer Science Faculty and Staff Publications Computer Science 3-2016 Unsupervised Saliency Estimation based on Robust Hypotheses Fei Xu Utah State University,
More informationVideo saliency detection by spatio-temporal sampling and sparse matrix decomposition
Video saliency detection by spatio-temporal sampling and sparse matrix decomposition * Faculty of Information Science and Engineering Ningbo University Ningbo 315211 CHINA shaofeng@nbu.edu.cn Abstract:
More informationA New Framework for Multiscale Saliency Detection Based on Image Patches
Neural Process Lett (2013) 38:361 374 DOI 10.1007/s11063-012-9276-3 A New Framework for Multiscale Saliency Detection Based on Image Patches Jingbo Zhou Zhong Jin Published online: 8 January 2013 Springer
More informationDETECTION OF IMAGE PAIRS USING CO-SALIENCY MODEL
DETECTION OF IMAGE PAIRS USING CO-SALIENCY MODEL N S Sandhya Rani 1, Dr. S. Bhargavi 2 4th sem MTech, Signal Processing, S. J. C. Institute of Technology, Chickballapur, Karnataka, India 1 Professor, Dept
More informationImage Resizing Based on Gradient Vector Flow Analysis
Image Resizing Based on Gradient Vector Flow Analysis Sebastiano Battiato battiato@dmi.unict.it Giovanni Puglisi puglisi@dmi.unict.it Giovanni Maria Farinella gfarinellao@dmi.unict.it Daniele Ravì rav@dmi.unict.it
More informationA Laplacian Based Novel Approach to Efficient Text Localization in Grayscale Images
A Laplacian Based Novel Approach to Efficient Text Localization in Grayscale Images Karthik Ram K.V & Mahantesh K Department of Electronics and Communication Engineering, SJB Institute of Technology, Bangalore,
More information2 Proposed Methodology
3rd International Conference on Multimedia Technology(ICMT 2013) Object Detection in Image with Complex Background Dong Li, Yali Li, Fei He, Shengjin Wang 1 State Key Laboratory of Intelligent Technology
More informationResearch on QR Code Image Pre-processing Algorithm under Complex Background
Scientific Journal of Information Engineering May 207, Volume 7, Issue, PP.-7 Research on QR Code Image Pre-processing Algorithm under Complex Background Lei Liu, Lin-li Zhou, Huifang Bao. Institute of
More informationVideo annotation based on adaptive annular spatial partition scheme
Video annotation based on adaptive annular spatial partition scheme Guiguang Ding a), Lu Zhang, and Xiaoxu Li Key Laboratory for Information System Security, Ministry of Education, Tsinghua National Laboratory
More informationData-driven Saliency Region Detection Based on Undirected Graph Ranking
Data-driven Saliency Region Detection Based on Undirected Graph Ranking Wenjie Zhang ; Qingyu Xiong 2 ; Shunhan Chen 3 College of Automation, 2 the School of Software Engineering, 3 College of Information
More informationDetection of Salient Region by Local Spatial Support & High Dimensional Color Transform
2017 IJSRST Volume 3 Issue 8 Print ISSN: 2395-6011 Online ISSN: 2395-602X Themed Section: Science and Technology Detection of Salient Region by Local Spatial Support & High Dimensional Color Transform
More informationAn Improved Image Resizing Approach with Protection of Main Objects
An Improved Image Resizing Approach with Protection of Main Objects Chin-Chen Chang National United University, Miaoli 360, Taiwan. *Corresponding Author: Chun-Ju Chen National United University, Miaoli
More informationAdaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision
Adaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision Zhiyan Zhang 1, Wei Qian 1, Lei Pan 1 & Yanjun Li 1 1 University of Shanghai for Science and Technology, China
More informationHierarchical Saliency Detection Supplementary Material
Hierarchical Saliency Detection Supplementary Material Qiong Yan Li Xu Jianping Shi Jiaya Jia The Chinese University of Hong Kong {qyan,xuli,pshi,leoia}@cse.cuhk.edu.hk http://www.cse.cuhk.edu.hk/leoia/proects/hsaliency/
More informationSALIENT OBJECT DETECTION VIA BACKGROUND CONTRAST
SALIENT OBJECT DETECTION VIA BACKGROUND CONTRAST Quan Zhou,, Nianyi Li 2,, Jianxin Chen, Liang Zhou, and Longin Jan Latecki 3 Key Lab of BB WL Comm & Sen Net Tech, Nanjing Univ of Posts & Telecom, Nanjing,
More informationDynamic visual attention: competitive versus motion priority scheme
Dynamic visual attention: competitive versus motion priority scheme Bur A. 1, Wurtz P. 2, Müri R.M. 2 and Hügli H. 1 1 Institute of Microtechnology, University of Neuchâtel, Neuchâtel, Switzerland 2 Perception
More informationSaliency Detection for Videos Using 3D FFT Local Spectra
Saliency Detection for Videos Using 3D FFT Local Spectra Zhiling Long and Ghassan AlRegib School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA ABSTRACT
More informationA Novel Approach to Saliency Detection Model and Its Applications in Image Compression
RESEARCH ARTICLE OPEN ACCESS A Novel Approach to Saliency Detection Model and Its Applications in Image Compression Miss. Radhika P. Fuke 1, Mr. N. V. Raut 2 1 Assistant Professor, Sipna s College of Engineering
More informationAn ICA based Approach for Complex Color Scene Text Binarization
An ICA based Approach for Complex Color Scene Text Binarization Siddharth Kherada IIIT-Hyderabad, India siddharth.kherada@research.iiit.ac.in Anoop M. Namboodiri IIIT-Hyderabad, India anoop@iiit.ac.in
More informationInternational Journal of Advance Engineering and Research Development
Scientific Journal of Impact Factor (SJIF): 4.72 International Journal of Advance Engineering and Research Development Volume 4, Issue 11, November -2017 e-issn (O): 2348-4470 p-issn (P): 2348-6406 Comparative
More informationAn Approach for Real Time Moving Object Extraction based on Edge Region Determination
An Approach for Real Time Moving Object Extraction based on Edge Region Determination Sabrina Hoque Tuli Department of Computer Science and Engineering, Chittagong University of Engineering and Technology,
More informationSupplementary Materials for Salient Object Detection: A
Supplementary Materials for Salient Object Detection: A Discriminative Regional Feature Integration Approach Huaizu Jiang, Zejian Yuan, Ming-Ming Cheng, Yihong Gong Nanning Zheng, and Jingdong Wang Abstract
More informationTHE HUMAN visual system interprets the world in a
1150 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 23, NO. 7, JULY 2013 Visual Saliency by Selective Contrast Qi Wang, Yuan Yuan, Senior Member, IEEE, and Pingkun Yan, Senior Member,
More informationFACULTY OF ENGINEERING AND INFORMATION TECHNOLOGY DEPARTMENT OF COMPUTER SCIENCE. Project Plan
FACULTY OF ENGINEERING AND INFORMATION TECHNOLOGY DEPARTMENT OF COMPUTER SCIENCE Project Plan Structured Object Recognition for Content Based Image Retrieval Supervisors: Dr. Antonio Robles Kelly Dr. Jun
More informationResearch of Traffic Flow Based on SVM Method. Deng-hong YIN, Jian WANG and Bo LI *
2017 2nd International onference on Artificial Intelligence: Techniques and Applications (AITA 2017) ISBN: 978-1-60595-491-2 Research of Traffic Flow Based on SVM Method Deng-hong YIN, Jian WANG and Bo
More informationSalient Region Detection using Weighted Feature Maps based on the Human Visual Attention Model
Salient Region Detection using Weighted Feature Maps based on the Human Visual Attention Model Yiqun Hu 2, Xing Xie 1, Wei-Ying Ma 1, Liang-Tien Chia 2 and Deepu Rajan 2 1 Microsoft Research Asia 5/F Sigma
More informationTexture Image Segmentation using FCM
Proceedings of 2012 4th International Conference on Machine Learning and Computing IPCSIT vol. 25 (2012) (2012) IACSIT Press, Singapore Texture Image Segmentation using FCM Kanchan S. Deshmukh + M.G.M
More informationA Hierarchical Visual Saliency Model for Character Detection in Natural Scenes
A Hierarchical Visual Saliency Model for Character Detection in Natural Scenes Renwu Gao 1, Faisal Shafait 2, Seiichi Uchida 3, and Yaokai Feng 3 1 Information Sciene and Electrical Engineering, Kyushu
More informationInternational Journal of Mechatronics, Electrical and Computer Technology
An Efficient Importance Map for Content Aware Image Resizing Abstract Ahmad Absetan 1* and Mahdi Nooshyar 2 1 Faculty of Engineering, University of MohagheghArdabili, Ardabil, Iran 2 Faculty of Engineering,
More informationA Model of Dynamic Visual Attention for Object Tracking in Natural Image Sequences
Published in Computational Methods in Neural Modeling. (In: Lecture Notes in Computer Science) 2686, vol. 1, 702-709, 2003 which should be used for any reference to this work 1 A Model of Dynamic Visual
More informationApplication of Geometry Rectification to Deformed Characters Recognition Liqun Wang1, a * and Honghui Fan2
6th International Conference on Electronic, Mechanical, Information and Management (EMIM 2016) Application of Geometry Rectification to Deformed Characters Liqun Wang1, a * and Honghui Fan2 1 School of
More informationA Method of weld Edge Extraction in the X-ray Linear Diode Arrays. Real-time imaging
17th World Conference on Nondestructive Testing, 25-28 Oct 2008, Shanghai, China A Method of weld Edge Extraction in the X-ray Linear Diode Arrays Real-time imaging Guang CHEN, Keqin DING, Lihong LIANG
More informationSaliency Detection in Aerial Imagery
Saliency Detection in Aerial Imagery using Multi-scale SLIC Segmentation Samir Sahli 1, Daniel A. Lavigne 2 and Yunlong Sheng 1 1- COPL, Image Science group, Laval University, Quebec, Canada 2- Defence
More informationRegional Principal Color Based Saliency Detection
Regional Principal Color Based Saliency Detection Jing Lou, Mingwu Ren*, Huan Wang School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu, China Abstract
More informationAn Efficient Salient Feature Extraction by Using Saliency Map Detection with Modified K-Means Clustering Technique
International Journal of Computational Engineering & Management, Vol. 15 Issue 5, September 2012 www..org 63 An Efficient Salient Feature Extraction by Using Saliency Map Detection with Modified K-Means
More informationInternational Journal of Modern Engineering and Research Technology
Volume 4, Issue 3, July 2017 ISSN: 2348-8565 (Online) International Journal of Modern Engineering and Research Technology Website: http://www.ijmert.org Email: editor.ijmert@gmail.com A Novel Approach
More informationEvaluation of regions-of-interest based attention algorithms using a probabilistic measure
Evaluation of regions-of-interest based attention algorithms using a probabilistic measure Martin Clauss, Pierre Bayerl and Heiko Neumann University of Ulm, Dept. of Neural Information Processing, 89081
More informationSaliency Detection: A Spectral Residual Approach
Saliency Detection: A Spectral Residual Approach Xiaodi Hou and Liqing Zhang Department of Computer Science, Shanghai Jiao Tong University No.8, Dongchuan Road, Shanghai http://bcmi.sjtu.edu.cn/ houxiaodi,
More informationTime Stamp Detection and Recognition in Video Frames
Time Stamp Detection and Recognition in Video Frames Nongluk Covavisaruch and Chetsada Saengpanit Department of Computer Engineering, Chulalongkorn University, Bangkok 10330, Thailand E-mail: nongluk.c@chula.ac.th
More informationDYNAMIC BACKGROUND SUBTRACTION BASED ON SPATIAL EXTENDED CENTER-SYMMETRIC LOCAL BINARY PATTERN. Gengjian Xue, Jun Sun, Li Song
DYNAMIC BACKGROUND SUBTRACTION BASED ON SPATIAL EXTENDED CENTER-SYMMETRIC LOCAL BINARY PATTERN Gengjian Xue, Jun Sun, Li Song Institute of Image Communication and Information Processing, Shanghai Jiao
More informationA Novel Approach to Image Segmentation for Traffic Sign Recognition Jon Jay Hack and Sidd Jagadish
A Novel Approach to Image Segmentation for Traffic Sign Recognition Jon Jay Hack and Sidd Jagadish Introduction/Motivation: As autonomous vehicles, such as Google s self-driving car, have recently become
More informationSTUDYING THE FEASIBILITY AND IMPORTANCE OF GRAPH-BASED IMAGE SEGMENTATION TECHNIQUES
25-29 JATIT. All rights reserved. STUDYING THE FEASIBILITY AND IMPORTANCE OF GRAPH-BASED IMAGE SEGMENTATION TECHNIQUES DR.S.V.KASMIR RAJA, 2 A.SHAIK ABDUL KHADIR, 3 DR.S.S.RIAZ AHAMED. Dean (Research),
More informationImage Segmentation Based on Watershed and Edge Detection Techniques
0 The International Arab Journal of Information Technology, Vol., No., April 00 Image Segmentation Based on Watershed and Edge Detection Techniques Nassir Salman Computer Science Department, Zarqa Private
More informationNTHU Rain Removal Project
People NTHU Rain Removal Project Networked Video Lab, National Tsing Hua University, Hsinchu, Taiwan Li-Wei Kang, Institute of Information Science, Academia Sinica, Taipei, Taiwan Chia-Wen Lin *, Department
More informationContent Based Image Retrieval Using Color Quantizes, EDBTC and LBP Features
Content Based Image Retrieval Using Color Quantizes, EDBTC and LBP Features 1 Kum Sharanamma, 2 Krishnapriya Sharma 1,2 SIR MVIT Abstract- To describe the image features the Local binary pattern (LBP)
More informationExtracting Layers and Recognizing Features for Automatic Map Understanding. Yao-Yi Chiang
Extracting Layers and Recognizing Features for Automatic Map Understanding Yao-Yi Chiang 0 Outline Introduction/ Problem Motivation Map Processing Overview Map Decomposition Feature Recognition Discussion
More informationCORRELATION BASED CAR NUMBER PLATE EXTRACTION SYSTEM
CORRELATION BASED CAR NUMBER PLATE EXTRACTION SYSTEM 1 PHYO THET KHIN, 2 LAI LAI WIN KYI 1,2 Department of Information Technology, Mandalay Technological University The Republic of the Union of Myanmar
More informationDETECTION OF SMOOTH TEXTURE IN FACIAL IMAGES FOR THE EVALUATION OF UNNATURAL CONTRAST ENHANCEMENT
DETECTION OF SMOOTH TEXTURE IN FACIAL IMAGES FOR THE EVALUATION OF UNNATURAL CONTRAST ENHANCEMENT 1 NUR HALILAH BINTI ISMAIL, 2 SOONG-DER CHEN 1, 2 Department of Graphics and Multimedia, College of Information
More informationMOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK
MOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK Mahamuni P. D 1, R. P. Patil 2, H.S. Thakar 3 1 PG Student, E & TC Department, SKNCOE, Vadgaon Bk, Pune, India 2 Asst. Professor,
More informationFingerprint Ridge Orientation Estimation Using A Modified Canny Edge Detection Mask
Fingerprint Ridge Orientation Estimation Using A Modified Canny Edge Detection Mask Laurice Phillips PhD student laurice.phillips@utt.edu.tt Margaret Bernard Senior Lecturer and Head of Department Margaret.Bernard@sta.uwi.edu
More informationBiometrics Technology: Image Processing & Pattern Recognition (by Dr. Dickson Tong)
Biometrics Technology: Image Processing & Pattern Recognition (by Dr. Dickson Tong) References: [1] http://homepages.inf.ed.ac.uk/rbf/hipr2/index.htm [2] http://www.cs.wisc.edu/~dyer/cs540/notes/vision.html
More informationFast and Efficient Saliency Detection Using Sparse Sampling and Kernel Density Estimation
Fast and Efficient Saliency Detection Using Sparse Sampling and Kernel Density Estimation Hamed Rezazadegan Tavakoli, Esa Rahtu, and Janne Heikkilä Machine Vision Group, Department of Electrical and Information
More informationSaliency Detection via Dense and Sparse Reconstruction
23 IEEE International Conference on Computer Vision Saliency Detection via Dense and Sparse Reconstruction Xiaohui Li, Huchuan Lu, Lihe Zhang, Xiang Ruan 2, and Ming-Hsuan Yang 3 Dalian University of Technology
More informationOutline 7/2/201011/6/
Outline Pattern recognition in computer vision Background on the development of SIFT SIFT algorithm and some of its variations Computational considerations (SURF) Potential improvement Summary 01 2 Pattern
More informationFace Alignment Under Various Poses and Expressions
Face Alignment Under Various Poses and Expressions Shengjun Xin and Haizhou Ai Computer Science and Technology Department, Tsinghua University, Beijing 100084, China ahz@mail.tsinghua.edu.cn Abstract.
More informationSALIENT OBJECT DETECTION VIA BACKGROUND CONTRAST
SALIENT OBJECT DETECTION VIA BACKGROUND CONTRAST Quan Zhou,, Nianyi Li 2,, Jianxin Chen, Shu Cai, and Longin Jan Latecki 3 Key Lab of Ministry of Education for Broad Band Communication & Sensor Network
More informationA Hybrid Face Detection System using combination of Appearance-based and Feature-based methods
IJCSNS International Journal of Computer Science and Network Security, VOL.9 No.5, May 2009 181 A Hybrid Face Detection System using combination of Appearance-based and Feature-based methods Zahra Sadri
More informationSpatio-temporal Saliency Detection Using Phase Spectrum of Quaternion Fourier Transform
Spatio-temporal Saliency Detection Using Phase Spectrum of Quaternion Fourier Transform Chenlei Guo, Qi Ma and Liming Zhang Department of Electronic Engineering, Fudan University No.220, Handan Road, Shanghai,
More informationGraph Matching Iris Image Blocks with Local Binary Pattern
Graph Matching Iris Image Blocs with Local Binary Pattern Zhenan Sun, Tieniu Tan, and Xianchao Qiu Center for Biometrics and Security Research, National Laboratory of Pattern Recognition, Institute of
More informationIncluding the Size of Regions in Image Segmentation by Region Based Graph
International Journal of Emerging Engineering Research and Technology Volume 3, Issue 4, April 2015, PP 81-85 ISSN 2349-4395 (Print) & ISSN 2349-4409 (Online) Including the Size of Regions in Image Segmentation
More informationAutomatic Shadow Removal by Illuminance in HSV Color Space
Computer Science and Information Technology 3(3): 70-75, 2015 DOI: 10.13189/csit.2015.030303 http://www.hrpub.org Automatic Shadow Removal by Illuminance in HSV Color Space Wenbo Huang 1, KyoungYeon Kim
More informationLAND COVER CHANGE DETECTION USING SALIENCY AND WAVELET TRANSFORMATION
LAND COVER CHANGE DETECTION USING SALIENCY AND WAVELET TRANSFORMATION Haopeng Zhang a, b,, Zhiguo Jiang a, b, Yan Cheng c a Image Processing Center, School of Astronautics, Beihang University, Beijing,
More informationProf. Feng Liu. Spring /26/2017
Prof. Feng Liu Spring 2017 http://www.cs.pdx.edu/~fliu/courses/cs510/ 04/26/2017 Last Time Re-lighting HDR 2 Today Panorama Overview Feature detection Mid-term project presentation Not real mid-term 6
More informationTEXT DETECTION AND RECOGNITION IN CAMERA BASED IMAGES
TEXT DETECTION AND RECOGNITION IN CAMERA BASED IMAGES Mr. Vishal A Kanjariya*, Mrs. Bhavika N Patel Lecturer, Computer Engineering Department, B & B Institute of Technology, Anand, Gujarat, India. ABSTRACT:
More informationA Modified Approach to Biologically Motivated Saliency Mapping
A Modified Approach to Biologically Motivated Saliency Mapping Shane Grant Department of Computer Science University of California, San Diego La Jolla, CA 9093 wgrant@ucsd.edu Kevin A Heins Department
More informationIMAGE DIGITIZATION BY WAVELET COEFFICIENT WITH HISTOGRAM SHAPING AND SPECIFICATION
IMAGE DIGITIZATION BY WAVELET COEFFICIENT WITH HISTOGRAM SHAPING AND SPECIFICATION Shivam Sharma 1, Mr. Lalit Singh 2 1,2 M.Tech Scholor, 2 Assistant Professor GRDIMT, Dehradun (India) ABSTRACT Many applications
More informationSalient Regions Detection for Indoor Robots using RGB-D Data
2015 IEEE International Conference on Robotics and Automation (ICRA) Washington State Convention Center Seattle, Washington, May 26-30, 2015 Salient Regions Detection for Indoor Robots using RGB-D Data
More informationResearch on Clearance of Aerial Remote Sensing Images Based on Image Fusion
Research on Clearance of Aerial Remote Sensing Images Based on Image Fusion Institute of Oceanographic Instrumentation, Shandong Academy of Sciences Qingdao, 266061, China E-mail:gyygyy1234@163.com Zhigang
More informationSaliency Segmentation based on Learning and Graph Cut Refinement
MEHRANI, VEKSLER: SALIENCY SEGM. BASED ON LEARNING AND GC REFINEMENT 1 Saliency Segmentation based on Learning and Graph Cut Refinement Paria Mehrani pmehrani@uwo.ca Olga Veksler olga@csd.uwo.ca Department
More informationSEMI-BLIND IMAGE RESTORATION USING A LOCAL NEURAL APPROACH
SEMI-BLIND IMAGE RESTORATION USING A LOCAL NEURAL APPROACH Ignazio Gallo, Elisabetta Binaghi and Mario Raspanti Universitá degli Studi dell Insubria Varese, Italy email: ignazio.gallo@uninsubria.it ABSTRACT
More informationresult, it is very important to design a simulation system for dynamic laser scanning
3rd International Conference on Multimedia Technology(ICMT 2013) Accurate and Fast Simulation of Laser Scanning Imaging Luyao Zhou 1 and Huimin Ma Abstract. In order to design a more accurate simulation
More informationCOLOR AND SHAPE BASED IMAGE RETRIEVAL
International Journal of Computer Science Engineering and Information Technology Research (IJCSEITR) ISSN 2249-6831 Vol.2, Issue 4, Dec 2012 39-44 TJPRC Pvt. Ltd. COLOR AND SHAPE BASED IMAGE RETRIEVAL
More informationA Fast Method of Vehicle Logo Location Honglin Li
6th International Conference on Sensor Network and Computer Engineering (ICSNCE 2016) A Fast Method of Vehicle Logo Location Honglin Li School of Information Engineering, Qujing Normal University, Qujing
More informationContent Based Image Retrieval Using Curvelet Transform
Content Based Image Retrieval Using Curvelet Transform Ishrat Jahan Sumana, Md. Monirul Islam, Dengsheng Zhang and Guojun Lu Gippsland School of Information Technology, Monash University Churchill, Victoria
More informationImage Edge Detection
K. Vikram 1, Niraj Upashyaya 2, Kavuri Roshan 3 & A. Govardhan 4 1 CSE Department, Medak College of Engineering & Technology, Siddipet Medak (D), 2&3 JBIET, Mpoinabad, Hyderabad, Indi & 4 CSE Dept., JNTUH,
More informationImage Retargetting on Video Based Detection
RESEARCH ARTICLE OPEN Image Retargetting on Video Based Detection ALOK THAKUR, NEERAJ TIWARI Electronics And Communication College-Tit Bhopal Emai-Aloksinghv@Yahoo.Com Assistant Professor, Electronics
More informationSurvey on Multi-Focus Image Fusion Algorithms
Proceedings of 2014 RAECS UIET Panjab University Chandigarh, 06 08 March, 2014 Survey on Multi-Focus Image Fusion Algorithms Rishu Garg University Inst of Engg & Tech. Panjab University Chandigarh, India
More informationEdge Detection (with a sidelight introduction to linear, associative operators). Images
Images (we will, eventually, come back to imaging geometry. But, now that we know how images come from the world, we will examine operations on images). Edge Detection (with a sidelight introduction to
More informationA Novel Multi-Frame Color Images Super-Resolution Framework based on Deep Convolutional Neural Network. Zhe Li, Shu Li, Jianmin Wang and Hongyang Wang
5th International Conference on Measurement, Instrumentation and Automation (ICMIA 2016) A Novel Multi-Frame Color Images Super-Resolution Framewor based on Deep Convolutional Neural Networ Zhe Li, Shu
More informationAn Introduction to Content Based Image Retrieval
CHAPTER -1 An Introduction to Content Based Image Retrieval 1.1 Introduction With the advancement in internet and multimedia technologies, a huge amount of multimedia data in the form of audio, video and
More informationInternational Journal of Computer Engineering and Applications, Volume XII, Issue I, Jan. 18, ISSN
International Journal of Computer Engineering and Applications, Volume XII, Issue I, Jan. 18, www.ijcea.com ISSN 2321-3469 SURVEY ON OBJECT TRACKING IN REAL TIME EMBEDDED SYSTEM USING IMAGE PROCESSING
More informationGraph-Based Superpixel Labeling for Enhancement of Online Video Segmentation
Graph-Based Superpixel Labeling for Enhancement of Online Video Segmentation Alaa E. Abdel-Hakim Electrical Engineering Department Assiut University Assiut, Egypt alaa.aly@eng.au.edu.eg Mostafa Izz Cairo
More information