Learning Sparse Feature for Eyeglasses Problem in Face Recognition

Size: px
Start display at page:

Download "Learning Sparse Feature for Eyeglasses Problem in Face Recognition"

Transcription

1 Learning Sparse Feature for Eyeglasses Problem in Face Recognition Dong Yi and Stan Z. Li* Center for Biometrics Security Research & National Laboratory of Pattern Recognition Institute of Automation, Chinese Academy of Sciences, Beijing, China Abstract Occlusion of eyeglasses, and strong specular reflections on eyeglasses (especially in near infrared (NIR) images), can deteriorate face recognition performance. In this paper, we present a novel method to overcome these problems. The proposed method applies the sparse representation (SR) technique in a local feature space so as to be more tolerant to mis-alignment and abnormal specular pixel values. The SR face features are further transformed by using discriminant analysis. These lead to a good balance between efficiency and robustness. Extensive experiments on a large NIR face database containing 292 persons with/without eyeglasses show the superiority of the proposed method compared with state-of-the-art methods. I. INTRODUCTION Eyeglasses can deteriorate face recognition performance in at least two ways: The first is when the enrolled faces are without eyeglasses whereas the probe faces wear eyeglasses, or vice versa. The second is due to strong specular highlight on glasses. We call these problems the eyeglasses problem for short. The first problem is related to occlusion. Four kinds of methods exist for dealing with occlusion in face recognition: part based methods [13], sub-sampling subspace [10], [7], synthesis based methods [23], and sparse representation (SR) [22]. Occluded area in face images may be lighten or discarded during face recognition. Occlusions also could be restored by some statistical learning or image processing steps [5], [23], [2], [6], and then conventional methods are used on them. For the convenience and practicality, this paper is mainly focused on SR. As reported in [22], SR needs little priori information about occlusion, such as position, size and magnitude, which can obtains good results when the proportion of occlusion is smaller than 60%. The second problem of strong specular reflections may happen while using active lighting to assist face imaging. That is the situation of NIR face recognition, where active near infrared illuminators are used to overcome environmental illumination changes [11], with a consequence that it can cause inaccurate eye localization, alignment and recognition. [11] has study the influence of strong specular on eye localization, and proposes a simple-to-complex boosting detector to deal with this problem obtaining satisfactory localization precision. But the influence on recognition is less analyzed in that work, in which just a small scale and unrealistic eyeglasses vs. non-eyeglasses experiment is conducted. In [14], the authors separate the diffuse and *Stan Z. Li is the corresponding author. specular reflection components from a single image by using color and polarization information, but it need additional hardware and cannot apply to monochrome NIR image. Compared with the first problem, strong specular reflection is usually of larger size and higher magnitude (e.g., 255), which can be seen as a more challenging case of occlusion. In this paper, we propose a more effective method to handle the eyeglasses problem by taking advantages of SR. Unlike the existing sparse representation that works on image pixels [22], we apply the sparse linear combination and sparse error model on discriminative local features instead. Because of the locality, sparse error model can still hold when it moves from pixels to local features. We can see in Fig. 1, that the error caused by eyeglasses in pixels and features are sparse concurrent. Meanwhile, local features are more robust to mis-alignment and more discriminative than pixels. Furthermore, the dimensionality of feature is usually much smaller than pixels, which can be computed more efficiently. Therefore our method, called local feature sparse representation, taking the advantages of local feature and sparse representation, can handle the eyeglasses problem and obtains good results on a challenging database. We make careful evaluation by considering different situations of eyeglasses vs. eyeglasses, eyeglasses vs. noneyeglasses, and non-eyeglasses vs. non-eyeglasses between intra and inter persons. Extensive experiments show that the proposed method outperforms the state-of-the-art methods in [11] and [22] significantly. In the case of coarse face alignment (according to two eyes), SR on pixels doesn t show its good performance as reported in [22]. Local feature based methods are always better than pixel based methods consistently. The rest of paper is organized as follows. Section II reviews some related works about occlusions in face recognition, eyeglasses removal and sparse representation. Section III discusses the influence of the eyeglasses problem on face recognition and gives some analysis. Section IV describes the proposed method in detail and its advantages compared to ordinary sparse representation. Section V outlines the database layout and experimental results. Section VI summarizes the paper. II. RELATED WORK The eyeglasses problem is closely related to occlusion, whether eyeglasses or specular highlight. Therefore, this

2 Fig. 1. The sparse error caused by eyeglasses in pixel and LBP feature space. (a) A face image with eyeglasses and specular highlight can be combined by its corresponding ideal (without eyeglasses) face image plus sparse error; (b) The proportion of LBP features selected by boosting in each region (left), the position of boosted 3072 LBP features in the face image (middle), and the sparse error in LBP feature space (right). section will review the related work from the perspective of occlusion in face recognition. As noticed in the early stage of face recognition [20], occlusion could degrade recognition performance shapely, and isn t fully solved today. Much effort has been made to achieve occlusion robust face recognition. In 2000, Leonardis et al. [10] showed the impact of occlusion on object recognition and proposed a sub-sampling based PCA to deal with it. Martinez [13] proposed a parted based method to solve occlusion problem in face recognition, in which each face are divided into many regions, analyzed in isolation and fused in a probabilistic way. In the last ten years, many works followed the direction of sub-sampling and part based method, such as [7], [9]. These works are shown to improve recognition performance, but they are not quite practical due to their computational complexity or needing human intervention (e.g., choosing the layout of partition). Image processing and synthesis techniques have also been used to overcome the eyeglasses occlusion problem in face recognition. In [19] a group of face images without eyeglasses was used to construct a PCA subspace. By projecting a new sample to the non-eyeglasses face subspace, eyeglasses in the face image could be removed with good quality. In 2005, Du et al. [5] improved the PCA method by using an iterated PCA, and achieve better results. Wu et al. [23] proposed an automatic system based on Bayesian inference to remove eyeglasses in face images consisting of three parts: eyeglasses detection, eyeglasses localization and eyeglasses removal. In the FERET [18] and a private database, their method obtained nearly perfect results, but they didn t do any experiments about face recognition. In order to prevent artifacts in the synthesized face images, this kinds of methods need precise key points localization, and are easy to fail while existing specular highlight on eyeglasses. Actually, through some experiments, we found face images after eyeglasses removal obviously lose some details in the eye region, and Fig. 2. Eyeglasses and highlight removal in face images. Top row shows face images with eyeglasses and specular highlight of three different persons. Bottom row is their corresponding results after removing eyeglasses and highlight. The eye region of the processed images become smoother than before. usually reduce recognition performance. Fig. 2 shows some eyeglasses and highlight removal results processed by an algorithm of us, which is not a strict implementation of [23] but as same as it in essence. SR [22] is an important and elegant solution for occlusion robust face recognition proposed recently. As stated by the authors, given a face image as probe, it could be sparsely represented by a linear combination of all face images in gallery plus a sparse error (e.g., partial occlusion). Through a L 1 minimization process [4], the sparse coefficient and occlusion error can be solved simultaneously. Owing to its sparse error model, SR can work well under large occlusion in theory and experiments. But as noted in [21], precise alignment is a key point to SR. Mis-alignment only in serval pixels may result in false non-sparse coefficient, and leading to false reject. Although the authors proposed several precise alignment algorithms in [21] and [17], these algorithms don t suit for large scale face recognition, because of their high complexity. Therefore, we consider mis-alignment robustness is a problem to be solved in SR. Obviously, local features, as a statistics in local regions, are more robust to small misalignment than pixels. III. THE EYEGLASSES PROBLEM IN NIR FACE RECOGNITION Eyeglasses are common in our daily life. During the face enrollment and recognition, many people may wear, change or remove their eyeglasses, so the status of eyeglasses in gallery and probe face images will be uncertain. In particular, active NIR lighting is a necessary component in NIR face recognition system. In face image acquisition process, the frontal active NIR lighting can cause unwanted specular highlight on eyeglasses. In the highlight region, the appearance under eyeglasses are definitely lost, as shown in Fig. 4. If we still use ordinary methods, e.g., PCA, LDA [1] and boosted LBP + LDA [11], on these occluded face images, eyeglasses will confuse the similarity metric in learned feature space and decrease the performance of face recognition. Fig. 3 shows a simple example to illustrate the influence of eyeglasses problem, that the difference between intra

3 TABLE I THE INFLUENCE OF EYEGLASSES ON RECOGNITION AND VALIDATION RATE AT FAR=0.01 UNDER VARIOUS SITUATIONS, WHICH IS EVALUATED USING BOOSTED LBP + LDA [11] Situations Recognition Rate Validation FAR= % 99.61% % 99.28% % 87.43% % 70.21% Fig. 3. Analysis the effects of eyeglasses and specular highlight on similarity scores. Top: Face matching without eyeglasses. Bottom: Face matching disturbed by eyeglasses, images in each column belonging to a person. Middle: Matching score matrix. (diagonal) and inter (off-diagonal) class similarity scores of boosted LBP [11] features are reduced by the eyeglasses and specular highlight. According to the distribution of eyeglasses in face images, the difficulties of the eyeglasses problem can be divided into the following situations from easy to hard: 1) All images without eyeglasses 2) All images with eyeglasses 3) All images in gallery without eyeglasses, and all images in probe with eyeglasses, or vice versa 4) Each person either without eyeglasses in gallery, with eyeglasses in probe or with eyeglasses in gallery, without eyeglasses in probe The state-of-the-art method in [11] can achieve nearly perfect recognition rate in the first and second cases. In the third case, intra and inter similarity scores decrease consistently, thus the recognition rate just drop a little. The fourth case is the most challenging situation we meet in practical applications, in which similarity metric is disturbed by the nearly random eyeglasses occlusion. Table I shows the influence of eyeglasses under various situations on a large database including 292 persons (the database will be described in section V). From the table we find the degradation rate of the fourth situation is the biggest one, especially in validation rate. To be more specific, the experiments in section V will focus on the hardest situation. As reviewed in section II, part based methods may be good to resist occlusions. We can divide each face images into several regions, e.g., four regions as shown in Fig. 1. During recognition, the eye region can be discarded or fused with a weight according to the size of occlusion. Eye region is often one of the most important component in face recognition, e.g., nearly making 1/3 contribution in the example shown in Fig. 1, so whether dropping it or choosing its weight is an obscure problem in real-world systems. Another considerable solution is to synthesize the occluded region by inpaiting [2] or learning based methods [23]. Image inpainting is suitable for texture synthesis but easy to fail on face images. Learning based methods can obtain good results in the human visual sense, as shown in Fig. 2, but don t take any additional information and cause loss of details in the eye region, that will reduce face recognition rate. Therefore, in NIR face recognition, eyeglasses is a very challenging problem must be conquered. Through rough observation, we find that eyeglasses and highlight occlusion in all face images usually don t exceed 40% of whole face. As reported in [22] and [24], under this level of occlusion, SR can work very well. However, a related work [21] and our experiments show SR on pixels is sensitive to mis-alignment. On a coarse aligned database, e.g., alignment according to the coordinates of two eyes, SR on pixels cannot work perfectly as in [22]. In this paper, we propose a local feature SR to obtain a good balance between efficiency and robustness. Fig. 1 shows a eyeglasses occluded NIR face image, a good NIR face image and its residual in pixel and LBP histogram bin feature [15], [12]. From the figure, we can see the residual error are both sparse in pixel and feature domains, so local feature SR is a reasonable solution for eyeglasses problem. The principles and advantages of local feature SR will be discussed in the following section. IV. LOCAL FEATURE SPARSE REPRESENTATION As stated above, local features are more robust to misalignment, more computation efficient than pixels, and sparse error model can hold from pixels to local features. Thus, we combine local feature and SR to solve the eyeglasses problem. In this section, we present two local feature SR methods, one based on multi-scale LBP histogram bins [15], [12], one based on LBP and LDA. As discussed in [11], LBP operator is invariant to monotonically transforming illumination, which achieves very high performance in NIR face recognition, so we choose LBP as basic local feature here. LBP can be applied in various scales and sub-windows. For a face image, huge LBP histogram features are generated, with millions of dimensions. Such high dimensional features are infeasible for practical application and most of them are useless for face recognition actually. Therefore, a small but effective subset is selected from the over-complete feature set by using AdaBoost [8], [11]. All the following steps will be applied on the boosted LBP feature set.

4 A. LBP + Sparse Representation Recently, SR (or compressive sensing) is popular in many fields [3], [4]. One of the most interesting applications is occlusion robust face recognition [22]. Assuming a occlusion in face image is not exceed a ratio (e.g., 60%), we can look the occlusion as a sparse error. A observed face image y can be represented by the following sparse linear combination and error model: y = Ax + e (1) where e is sparse error (occlusion). A is a group of vectorized face images we want to recognize (i.e., gallery). x is sparse linear combination coefficients. In cooperative-user NIR face recognition, face images in probe and gallery are all frontal and illumination uniform, hence any face image y belonging to the ith person will be lie in the linear span of the gallery face images of the ith person. Ideally, x s entries will be zeros except those associated with the ith person, and e will be the occlusion error. Owing to the locality of LBP, sparse error model still can hold, while moving from pixels to local features. We denote the LBP feature of y as y L, the LBP feature of A as A L, so the new model is y L = A L x + e (2) where e is the occlusion in LBP feature space, which is different from the pixel occlusion in Equ. (1). Merge the sparse coefficients and error, Equ. (2) can be written as y L = [ A L, I ][ x e ] = Bz (3) Given y L, A L, solving x and e can be seen as the following L 1 optimization problem min z 1 s.t. y L = Bz The above constraint must be an under-determined system of linear equations. As concluded in [24], many existing algorithms can recover the sparsest solution of problem (4). Considering the overall performance of those algorithms, we use Homotopy [16] in this paper. When the solution is of high-sparsity (e.g., smaller than 40%), Homotopy is very fast and can achieve high performance. As the entries of x encoding the identity information of the probe image y, we use it to do face recognition and validation. Reconstruction residual and sparsity concentration index (SCI) are defined in [22] for face recognition and validation respectively. Without loss of generality, we use a modified SCI (msci) in face recognition and the original SCI for validation experiments. The definition of msci is slightly modified from SCI as follows msci i (x) = n δ i(x) 1 / x 1 1 [0,1] (5) n 1 where i is the index of each class; n is the number of samples in gallery. For each class i, δ i (x) is the characteristic function that selects the coefficients associated with the ith class. The larger the corresponding msci i of a probe y, that y is (4) more similar with the ith class of the gallery. In experiments, (m)sci is used to generate recognition rate (rank1) and ROC curves. Note that, reconstruction residual and msci have very similar recognition performance in face recognition. We use msci here because it s faster than reconstruction residual. B. Extension to LDA LDA is widely used in face recognition for dimension reduction and discriminative feature extraction. Boosted local features are usually of relative higher dimensionality (e.g., ), which would burden the next L 1 minimization step. To improve the performance in accuracy and computation efficiency further, we incorporate LDA into local feature SR. As we know, LDA is a holistic projection operation, it cannot reserve the sparsity of error, that a sparse error (occlusion) in LBP feature space will not remain sparse in the LDA subspace. Despite of this, we still can solve this problem by doing a small modification on Equ. (3). Based on LBP features, we first train a LDA projection matrix P using intra-class and inter-class scatter matrix, then we project the probe and gallery features into the LDA subspace as Py L and PA L. Multiply matrix P on the two sides of Equ. (3), we get Py L = [ PA L, P ][ ] x (6) e Similar to Equ. (4), x and e can be solved by L 1 minimization. Note that e is still a sparse error in LBP feature space not in LDA subspace. (m)sci of x is used for face recognition and validation. V. EXPERIMENTS In this section, we aim to evaluate the performance of the proposed method in NIR face recognition with eyeglasses problem, and compare with conventional local feature method [11] and SR [22]. Five methods are evaluated as follows, 1) Boosted LBP + LDA + nearest neighborhood (NN) [11] 2) Down-sampled image + SR [22] 3) LDA + SR [22] 4) Boosted LBP + SR (proposed) 5) Boosted LBP + LDA + SR (proposed) For equity, all methods are trained and tested on the same databases. To obtain more comprehensive results, all methods are tested in two scenarios: recognition and validation. For a given probe sample, we must first decide if it s a valid sample from one of the persons in gallery (validation), then judge which person the sample belongs to (recognition). These two properties are both crucial for real-world recognition systems. A. Database Setup A database containing NIR face images of 1925 persons are prepared for AdaBoost and LDA training. And we collect an independent database for testing including face

5 Fig. 4. Some aligned face images according to eye coordinates in database images both with/without eyeglasses. The testing database includes 9988 face images of 292 persons, 8-20 images with eyeglasses and 8-20 images without eyeglasses for each person. Some face images in training and testing set are shown in Fig. 4. For the convenience of face recognition and validation, 4 subsets are constructed from the testing database as follows: 1) Gallery for recognition: 292 persons, half of them with eyeglasses, the other half without eyeglasses; 2) Probe for recognition: 292 persons, the other images not overlapped with subset 1); 3) Gallery for validation: randomly selected 146 persons, half of them with eyeglasses, the other half without eyeglasses; 4) Probe for validation: the other images of the same 146 persons in subset 3) as positive samples, all images of the other 146 persons not overlapped with subset 3) as negative samples. The partition rules conforms to the most challenging situation described in section III. Firstly, we detect the eye coordinates of face images by automatic face and eye detectors, and align them to pixels. For every aligned face image, an over-complete LBP features of dimension are extracted in multi-scale way. Then AdaBoost and LDA are both trained on the basis of the LBP features in training set. By using AdaBoost, the high dimensional LBP features can be reduced to 3072 dimensions. LDA further reduces the 3072 LBP features to 256 dimensions. The following experiments are conducted on 3072 or 256 dimensions. B. Face Recognition In this experiment, we test the rank1 recognition rate [18] of the five methods. Table II shows the rank1 recognition rates, where our proposed methods 4) and 5) achieve the best performance: 96.17% and 96.81%. The proposed methods are about 3% higher than conventional NIR face recognition method 1) and 16% higher than SR 3) and 4). Two conventional SR methods are poorer than the other methods, because of their sensitivity to mis-alignment and lack of discriminant. Although method 4) has nearly comparable recognition rate with 5), but is slower than 5). The computational cost per query are also list in table II. All methods are performed in MATLAB 7.8 on 64bits Windows 2003 with dual quad-core 2.66GHz Xeon processors Fig. 5. ROC curves of the five methods for face validation and 16GB of memory. We can see that 1) is the fastest method among them, but it doesn t deal with occlusion explicitly, with lower recognition rate than the proposed methods. Considering the overall (recognition rate and speed) performance, 5) is the most appropriate choice for practical applications, 96.81% recognition rate and 300ms per query against a gallery with 4997 samples. C. Face Validation Next, we demonstrate the performance of our methods for rejecting invalid probe images while accepting valid ones. As described above, the probe set for this experiment are composed by two parts, including 2528 positive samples and 4933 negative samples. By tuning the threshold τ in the range of SCI [0, 1], we generate a series ROC curves for method 2)-5) in Fig. 5. For comparison, the ROC curve of method 1) is generated according to the nearest neighborhood of cosine distance. From Fig. 5 we can see the five methods have similar performance rank with recognition experiment, except for 2) and 3), that is about 5) 4) > 1) > 2) > 3). The best methods 4) and 5) achieve 85.92% validation rate when FAR is 0.01, which has a big improvement (about 13%) compared with the current state-of-the-art method 1). The validation rates are list in table III at FAR=0.1, 0.01 and Considering the overall performance in face face recognition, validation and computational complexity, method 5) LBP+LDA+SR is the best one. VI. CONCLUSIONS Eyeglasses cause problems that must be conquered in face recognition. Although SR provides a good theoretical solution, it is prone to mis-alignment and usually of less discriminant. In this paper, we propose SR in a local feature space and extend it by collaborating with LDA. The experiments show LBP reserves the advantages of SR in dealing with occlusion while becoming less sensitive to mis-alignment

6 TABLE II COMPARISON OF RECOGNITION RATES AND AVERAGE RUN TIME PER QUERY FOR ALL METHODS No Method LBP+LDA+NN Down-sampled+SR LDA+SR LBP+SR LBP+LDA+SR Recognition Rate 93.77% 79.46% 79.82% 96.17% 96.81% Dimension x28= Run Time/Query 0.5ms 460ms 460ms 4100ms 300ms TABLE III COMPARISON OF VALIDATION RATES AT FAR=0.1, 0.01 AND FOR ALL METHODS No Method LBP+LDA+NN Down-sampled+SR LDA+SR LBP+SR LBP+LDA+SR FAR= % 75.83% 76.78% 96.04% 96.52% FAR= % 49.17% 33.98% 85.92% 85.92% FAR= % 32.32% 5.18% 68.83% 62.7% and more discriminant than SR derived from the image pixels. With respect to NIR face recognition with eyeglasses and specular highlight, LBP+SR is obviously better than the conventional NIR face recognition method and original SR in both recognition and validation rate. Moreover, the proposed LDA extension improves the recognition rate and computational speed further. Future work will focus on the choice of other local features and study how to introduce the location priori of eyeglasses into this framework. ACKNOWLEDGEMENTS We thank Shuixian Chen for helpful conversations and comments about this work. This work was supported by the Chinese National Natural Science Foundation Project # , National Science and Technology Support Program Project #2009BAK43B26, and AuthenMetric R&D Funds. REFERENCES [1] P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman. Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection. In Proceedings of the European Conference on Computer Vision, pages 45 58, [2] Marcelo Bertalmio, Guillermo Sapiro, Vincent Caselles, and Coloma Ballester. Image inpainting. In SIGGRAPH 00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pages , New York, NY, USA, [3] E.J. Candes and T. Tao. Decoding by linear programming. Information Theory, IEEE Transactions on, 51(12): , dec [4] Scott Shaobing Chen, David L. Donoho, and Michael A. Saunders. Atomic decomposition by basis pursuit. SIAM Journal on Scientific Computing, 20(1):33 61, [5] Cheng Du and Guangda Su. Eyeglasses removal from facial images. Pattern Recognition Letters, 26(14): , [6] Alexei A. Efros and Thomas K. Leung. Texture synthesis by nonparametric sampling. In ICCV 99: Proceedings of the International Conference on Computer Vision-Volume 2, page 1033, Washington, DC, USA, [7] S. Fidler, D. Skocaj, and A. Leonardis. Combining reconstructive and discriminative subspace methods for robust classification and regression by subsampling. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(3): , mar [8] Y. Freund and R.E. Schapire. An adaptive version of the boost by majority algorithm. Machine Learning, 43(3): , June [9] Jongsun Kim, Jongmoo Choi, Juneho Yi, and M. Turk. Effective representation using ica for face recognition robust to local distortion and partial occlusion. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 27(12): , dec [10] Aleš Leonardis and Horst Bischof. Robust recognition using eigenimages. Comput. Vis. Image Underst., 78(1):99 118, [11] Stan Z. Li, RuFeng Chu, ShengCai Liao, and Lun Zhang. Illumination invariant face recognition using near-infrared images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(Special issue on Biometrics: Progress and Directions), April [12] ShengCai Liao, XiangXin Zhu, Zhen Lei, Lun Zhang, and Stan Z. Li. Learning multi-scale block local binary patterns for face recognition. In ICB, pages , [13] A.M. Martinez. Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(6): , Jun [14] Shree K. Nayar, Xi-Sheng Fang, and Terrance Boult. Separation of reflection components using color and polarization. International Journal of Computer Vision, 21: , [15] T. Ojala, M. Pietikainen, and T. Maenpaa. Multiresolution grayscale and rotation invariant texture classification width local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7): , [16] MR Osborne, B Presnell, and BA Turlach. A new approach to variable selection in least squares problems. IMA Journal of Numerical Analysis, 20(3): , [17] Yigang Peng, A. Ganesh, J. Wright, Wenli Xu, and Yi Ma. RASL: Robust alignment by sparse and low-rank decomposition for linearly correlated images. pages , jun [18] P. J. Phillips, H. Wechsler, J. Huang,, and P. Rauss. The feret database and evaluation procedure for face recognition algorithms. Image and Vision Computing J, 16(5): , [19] Y. Saito, Y. Kenmochi, and K. Kotani. Estimation of eyeglassless facial images using principal component analysis. In Proceedings of IEEE International Conference on Image Processing, volume 4, pages , [20] M. A. Turk and A. P. Pentland. Face recognition using eigenfaces. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages , Hawaii, June [21] A. Wagner, J. Wright, A. Ganesh, Zihan Zhou, and Yi Ma. Towards a practical face recognition system: Robust registration and illumination by sparse representation. pages , jun [22] John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma. Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31: , [23] Chenyu Wu, Ce Liu, Heung-Yueng Shum, Ying-Qing Xu, and Zhengyou Zhang. Automatic eyeglasses removal from face images. IEEE Trans. Pattern Anal. Mach. Intell., 26(3): , [24] Allen Y. Yang, S. Shankar Sastry, Arvind Ganesh, and Yi Ma. Fast l1- minimization algirhtms and an application in robust face recognition: A review. In Proceedings of International Conference on Pattern Recognition, 2010.

Part-based Face Recognition Using Near Infrared Images

Part-based Face Recognition Using Near Infrared Images Part-based Face Recognition Using Near Infrared Images Ke Pan Shengcai Liao Zhijian Zhang Stan Z. Li Peiren Zhang University of Science and Technology of China Hefei 230026, China Center for Biometrics

More information

Part-based Face Recognition Using Near Infrared Images

Part-based Face Recognition Using Near Infrared Images Part-based Face Recognition Using Near Infrared Images Ke Pan Shengcai Liao Zhijian Zhang Stan Z. Li Peiren Zhang University of Science and Technology of China Hefei 230026, China Center for Biometrics

More information

Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma

Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma Presented by Hu Han Jan. 30 2014 For CSE 902 by Prof. Anil K. Jain: Selected

More information

Partial Face Matching between Near Infrared and Visual Images in MBGC Portal Challenge

Partial Face Matching between Near Infrared and Visual Images in MBGC Portal Challenge Partial Face Matching between Near Infrared and Visual Images in MBGC Portal Challenge Dong Yi, Shengcai Liao, Zhen Lei, Jitao Sang, and Stan Z. Li Center for Biometrics and Security Research, Institute

More information

Gabor Volume based Local Binary Pattern for Face Representation and Recognition

Gabor Volume based Local Binary Pattern for Face Representation and Recognition Gabor Volume based Local Binary Pattern for Face Representation and Recognition Zhen Lei 1 Shengcai Liao 1 Ran He 1 Matti Pietikäinen 2 Stan Z. Li 1 1 Center for Biometrics and Security Research & National

More information

An Adaptive Threshold LBP Algorithm for Face Recognition

An Adaptive Threshold LBP Algorithm for Face Recognition An Adaptive Threshold LBP Algorithm for Face Recognition Xiaoping Jiang 1, Chuyu Guo 1,*, Hua Zhang 1, and Chenghua Li 1 1 College of Electronics and Information Engineering, Hubei Key Laboratory of Intelligent

More information

Heat Kernel Based Local Binary Pattern for Face Representation

Heat Kernel Based Local Binary Pattern for Face Representation JOURNAL OF LATEX CLASS FILES 1 Heat Kernel Based Local Binary Pattern for Face Representation Xi Li, Weiming Hu, Zhongfei Zhang, Hanzi Wang Abstract Face classification has recently become a very hot research

More information

Robust Face Recognition via Sparse Representation

Robust Face Recognition via Sparse Representation Robust Face Recognition via Sparse Representation Panqu Wang Department of Electrical and Computer Engineering University of California, San Diego La Jolla, CA 92092 pawang@ucsd.edu Can Xu Department of

More information

Face Matching between Near Infrared and Visible Light Images

Face Matching between Near Infrared and Visible Light Images Face Matching between Near Infrared and Visible Light Images Dong Yi, Rong Liu, RuFeng Chu, Zhen Lei, and Stan Z. Li Center for Biometrics Security Research & National Laboratory of Pattern Recognition

More information

An Integrated Face Recognition Algorithm Based on Wavelet Subspace

An Integrated Face Recognition Algorithm Based on Wavelet Subspace , pp.20-25 http://dx.doi.org/0.4257/astl.204.48.20 An Integrated Face Recognition Algorithm Based on Wavelet Subspace Wenhui Li, Ning Ma, Zhiyan Wang College of computer science and technology, Jilin University,

More information

Learning to Recognize Faces in Realistic Conditions

Learning to Recognize Faces in Realistic Conditions 000 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050

More information

Decorrelated Local Binary Pattern for Robust Face Recognition

Decorrelated Local Binary Pattern for Robust Face Recognition International Journal of Advanced Biotechnology and Research (IJBR) ISSN 0976-2612, Online ISSN 2278 599X, Vol-7, Special Issue-Number5-July, 2016, pp1283-1291 http://www.bipublication.com Research Article

More information

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method Journal of Information Hiding and Multimedia Signal Processing c 2016 ISSN 2073-4212 Ubiquitous International Volume 7, Number 5, September 2016 Face Recognition ased on LDA and Improved Pairwise-Constrained

More information

Face Recognition via Sparse Representation

Face Recognition via Sparse Representation Face Recognition via Sparse Representation John Wright, Allen Y. Yang, Arvind, S. Shankar Sastry and Yi Ma IEEE Trans. PAMI, March 2008 Research About Face Face Detection Face Alignment Face Recognition

More information

Countermeasure for the Protection of Face Recognition Systems Against Mask Attacks

Countermeasure for the Protection of Face Recognition Systems Against Mask Attacks Countermeasure for the Protection of Face Recognition Systems Against Mask Attacks Neslihan Kose, Jean-Luc Dugelay Multimedia Department EURECOM Sophia-Antipolis, France {neslihan.kose, jean-luc.dugelay}@eurecom.fr

More information

Face detection and recognition. Detection Recognition Sally

Face detection and recognition. Detection Recognition Sally Face detection and recognition Detection Recognition Sally Face detection & recognition Viola & Jones detector Available in open CV Face recognition Eigenfaces for face recognition Metric learning identification

More information

Weighted Multi-scale Local Binary Pattern Histograms for Face Recognition

Weighted Multi-scale Local Binary Pattern Histograms for Face Recognition Weighted Multi-scale Local Binary Pattern Histograms for Face Recognition Olegs Nikisins Institute of Electronics and Computer Science 14 Dzerbenes Str., Riga, LV1006, Latvia Email: Olegs.Nikisins@edi.lv

More information

A Hierarchical Face Identification System Based on Facial Components

A Hierarchical Face Identification System Based on Facial Components A Hierarchical Face Identification System Based on Facial Components Mehrtash T. Harandi, Majid Nili Ahmadabadi, and Babak N. Araabi Control and Intelligent Processing Center of Excellence Department of

More information

A Representative Sample Selection Approach for SRC

A Representative Sample Selection Approach for SRC DEIM Forum 2011 E9-1 AliceChen, NTT, 239-0847 1-1 School of Computing Science, Simon Fraser University 8888 University Drive, Burnaby BC, V5A 1S6 Canada E-mail: {alice.chen,eda.takeharu,katafuchi.norifumi,kataoka.ryoji}@lab.ntt.co.jp

More information

Fuzzy Bidirectional Weighted Sum for Face Recognition

Fuzzy Bidirectional Weighted Sum for Face Recognition Send Orders for Reprints to reprints@benthamscience.ae The Open Automation and Control Systems Journal, 2014, 6, 447-452 447 Fuzzy Bidirectional Weighted Sum for Face Recognition Open Access Pengli Lu

More information

Haresh D. Chande #, Zankhana H. Shah *

Haresh D. Chande #, Zankhana H. Shah * Illumination Invariant Face Recognition System Haresh D. Chande #, Zankhana H. Shah * # Computer Engineering Department, Birla Vishvakarma Mahavidyalaya, Gujarat Technological University, India * Information

More information

Content Based Image Retrieval Using Color Quantizes, EDBTC and LBP Features

Content Based Image Retrieval Using Color Quantizes, EDBTC and LBP Features Content Based Image Retrieval Using Color Quantizes, EDBTC and LBP Features 1 Kum Sharanamma, 2 Krishnapriya Sharma 1,2 SIR MVIT Abstract- To describe the image features the Local binary pattern (LBP)

More information

CHAPTER 3 PRINCIPAL COMPONENT ANALYSIS AND FISHER LINEAR DISCRIMINANT ANALYSIS

CHAPTER 3 PRINCIPAL COMPONENT ANALYSIS AND FISHER LINEAR DISCRIMINANT ANALYSIS 38 CHAPTER 3 PRINCIPAL COMPONENT ANALYSIS AND FISHER LINEAR DISCRIMINANT ANALYSIS 3.1 PRINCIPAL COMPONENT ANALYSIS (PCA) 3.1.1 Introduction In the previous chapter, a brief literature review on conventional

More information

The HFB Face Database for Heterogeneous Face Biometrics Research

The HFB Face Database for Heterogeneous Face Biometrics Research The HFB Face Database for Heterogeneous Face Biometrics Research Stan Z. Li, Zhen Lei, Meng Ao Center for Biometrics and Security Research Institute of Automation, Chinese Academy of Sciences 95 Zhongguancun

More information

Restricted Nearest Feature Line with Ellipse for Face Recognition

Restricted Nearest Feature Line with Ellipse for Face Recognition Journal of Information Hiding and Multimedia Signal Processing c 2012 ISSN 2073-4212 Ubiquitous International Volume 3, Number 3, July 2012 Restricted Nearest Feature Line with Ellipse for Face Recognition

More information

Lecture 4 Face Detection and Classification. Lin ZHANG, PhD School of Software Engineering Tongji University Spring 2018

Lecture 4 Face Detection and Classification. Lin ZHANG, PhD School of Software Engineering Tongji University Spring 2018 Lecture 4 Face Detection and Classification Lin ZHANG, PhD School of Software Engineering Tongji University Spring 2018 Any faces contained in the image? Who are they? Outline Overview Face detection Introduction

More information

Local Similarity based Linear Discriminant Analysis for Face Recognition with Single Sample per Person

Local Similarity based Linear Discriminant Analysis for Face Recognition with Single Sample per Person Local Similarity based Linear Discriminant Analysis for Face Recognition with Single Sample per Person Fan Liu 1, Ye Bi 1, Yan Cui 2, Zhenmin Tang 1 1 School of Computer Science and Engineering, Nanjing

More information

Face Recognition At-a-Distance Based on Sparse-Stereo Reconstruction

Face Recognition At-a-Distance Based on Sparse-Stereo Reconstruction Face Recognition At-a-Distance Based on Sparse-Stereo Reconstruction Ham Rara, Shireen Elhabian, Asem Ali University of Louisville Louisville, KY {hmrara01,syelha01,amali003}@louisville.edu Mike Miller,

More information

The CASIA NIR-VIS 2.0 Face Database

The CASIA NIR-VIS 2.0 Face Database The CASIA NIR-VIS. Face Database Stan Z. Li, Dong Yi, Zhen Lei and Shengcai Liao Center for Biometrics and Security Research & National Laboratory of Pattern Recognition Institute of Automation, Chinese

More information

Heterogeneous Face Recognition from Local Structures of Normalized Appearance

Heterogeneous Face Recognition from Local Structures of Normalized Appearance Heterogeneous Face Recognition from Local Structures of Normalized Appearance Shengcai Liao, Dong Yi, Zhen Lei, Rui Qin, and Stan Z. Li Center for Biometrics and Security Research & National Laboratory

More information

Graph Matching Iris Image Blocks with Local Binary Pattern

Graph Matching Iris Image Blocks with Local Binary Pattern Graph Matching Iris Image Blocs with Local Binary Pattern Zhenan Sun, Tieniu Tan, and Xianchao Qiu Center for Biometrics and Security Research, National Laboratory of Pattern Recognition, Institute of

More information

Face Alignment under Partial Occlusion in Near Infrared Images

Face Alignment under Partial Occlusion in Near Infrared Images Face Alignment under Partial Occlusion in Near Infrared Images Sifei Liu,2, Dong Yi,BinLi 2,StanZ.Li,0 Institute of Automation, Chinese Academy of Sciences, Beijing 0090, China E-mail:{sfliu,dyi,szli}@cbsr.ia.ac.cn

More information

Virtual Training Samples and CRC based Test Sample Reconstruction and Face Recognition Experiments Wei HUANG and Li-ming MIAO

Virtual Training Samples and CRC based Test Sample Reconstruction and Face Recognition Experiments Wei HUANG and Li-ming MIAO 7 nd International Conference on Computational Modeling, Simulation and Applied Mathematics (CMSAM 7) ISBN: 978--6595-499-8 Virtual raining Samples and CRC based est Sample Reconstruction and Face Recognition

More information

Learning based face hallucination techniques: A survey

Learning based face hallucination techniques: A survey Vol. 3 (2014-15) pp. 37-45. : A survey Premitha Premnath K Department of Computer Science & Engineering Vidya Academy of Science & Technology Thrissur - 680501, Kerala, India (email: premithakpnath@gmail.com)

More information

Face Recognition with Local Line Binary Pattern

Face Recognition with Local Line Binary Pattern 2009 Fifth International Conference on Image and Graphics Face Recognition with Local Line Binary Pattern Amnart Petpon and Sanun Srisuk Department of Computer Engineering, Mahanakorn University of Technology

More information

A GENERIC FACE REPRESENTATION APPROACH FOR LOCAL APPEARANCE BASED FACE VERIFICATION

A GENERIC FACE REPRESENTATION APPROACH FOR LOCAL APPEARANCE BASED FACE VERIFICATION A GENERIC FACE REPRESENTATION APPROACH FOR LOCAL APPEARANCE BASED FACE VERIFICATION Hazim Kemal Ekenel, Rainer Stiefelhagen Interactive Systems Labs, Universität Karlsruhe (TH) 76131 Karlsruhe, Germany

More information

Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels

Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels Stan Z. Li, ChunShui Zhao, Meng Ao, Zhen Lei Center for Biometrics and Security Research & National Laboratory of Pattern

More information

Robust and Secure Iris Recognition

Robust and Secure Iris Recognition Robust and Secure Iris Recognition Vishal M. Patel University of Maryland, UMIACS pvishalm@umiacs.umd.edu IJCB 2011 Tutorial Sparse Representation and Low-Rank Representation for Biometrics Outline Iris

More information

Rotation Invariant Finger Vein Recognition *

Rotation Invariant Finger Vein Recognition * Rotation Invariant Finger Vein Recognition * Shaohua Pang, Yilong Yin **, Gongping Yang, and Yanan Li School of Computer Science and Technology, Shandong University, Jinan, China pangshaohua11271987@126.com,

More information

Linear Discriminant Analysis for 3D Face Recognition System

Linear Discriminant Analysis for 3D Face Recognition System Linear Discriminant Analysis for 3D Face Recognition System 3.1 Introduction Face recognition and verification have been at the top of the research agenda of the computer vision community in recent times.

More information

Local Gradient Order Pattern for Face Representation and Recognition

Local Gradient Order Pattern for Face Representation and Recognition Local Gradient Order Pattern for Face Representation and Recognition Zhen Lei, Dong Yi, and Stan Z. Li Center for Biometrics and Security Research & National Laboratory of Pattern Recognition, Institute

More information

IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 14, NO. 1, JANUARY Face Recognition Using LDA-Based Algorithms

IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 14, NO. 1, JANUARY Face Recognition Using LDA-Based Algorithms IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 14, NO. 1, JANUARY 2003 195 Brief Papers Face Recognition Using LDA-Based Algorithms Juwei Lu, Kostantinos N. Plataniotis, and Anastasios N. Venetsanopoulos Abstract

More information

Linear Discriminant Analysis in Ottoman Alphabet Character Recognition

Linear Discriminant Analysis in Ottoman Alphabet Character Recognition Linear Discriminant Analysis in Ottoman Alphabet Character Recognition ZEYNEB KURT, H. IREM TURKMEN, M. ELIF KARSLIGIL Department of Computer Engineering, Yildiz Technical University, 34349 Besiktas /

More information

On Modeling Variations for Face Authentication

On Modeling Variations for Face Authentication On Modeling Variations for Face Authentication Xiaoming Liu Tsuhan Chen B.V.K. Vijaya Kumar Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213 xiaoming@andrew.cmu.edu

More information

2 Proposed Methodology

2 Proposed Methodology 3rd International Conference on Multimedia Technology(ICMT 2013) Object Detection in Image with Complex Background Dong Li, Yali Li, Fei He, Shengjin Wang 1 State Key Laboratory of Intelligent Technology

More information

Shweta Gandhi, Dr.D.M.Yadav JSPM S Bhivarabai sawant Institute of technology & research Electronics and telecom.dept, Wagholi, Pune

Shweta Gandhi, Dr.D.M.Yadav JSPM S Bhivarabai sawant Institute of technology & research Electronics and telecom.dept, Wagholi, Pune Face sketch photo synthesis Shweta Gandhi, Dr.D.M.Yadav JSPM S Bhivarabai sawant Institute of technology & research Electronics and telecom.dept, Wagholi, Pune Abstract Face sketch to photo synthesis has

More information

Stepwise Nearest Neighbor Discriminant Analysis

Stepwise Nearest Neighbor Discriminant Analysis Stepwise Nearest Neighbor Discriminant Analysis Xipeng Qiu and Lide Wu Media Computing & Web Intelligence Lab Department of Computer Science and Engineering Fudan University, Shanghai, China xpqiu,ldwu@fudan.edu.cn

More information

Face and Nose Detection in Digital Images using Local Binary Patterns

Face and Nose Detection in Digital Images using Local Binary Patterns Face and Nose Detection in Digital Images using Local Binary Patterns Stanko Kružić Post-graduate student University of Split, Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture

More information

AUTOMATIC data summarization, which attempts to

AUTOMATIC data summarization, which attempts to 748 JOURNAL OF SOFTWARE, VOL. 9, NO. 3, MARCH 2014 Sparse Affinity Propagation for Image Analysis Xue Zhang, Jian Cheng Lv Machine Intelligence Laboratory, College of Computer Science, Sichuan University,

More information

Robust Face Recognition Using Enhanced Local Binary Pattern

Robust Face Recognition Using Enhanced Local Binary Pattern Bulletin of Electrical Engineering and Informatics Vol. 7, No. 1, March 2018, pp. 96~101 ISSN: 2302-9285, DOI: 10.11591/eei.v7i1.761 96 Robust Face Recognition Using Enhanced Local Binary Pattern Srinivasa

More information

An Iteratively Reweighted Least Square Implementation for Face Recognition

An Iteratively Reweighted Least Square Implementation for Face Recognition Vol. 6: 26-32 THE UNIVERSITY OF CENTRAL FLORIDA Published May 15, 2012 An Iteratively Reweighted Least Square Implementation for Face Recognition By: Jie Liang Faculty Mentor: Dr. Xin Li ABSTRACT: We propose,

More information

An Efficient Face Recognition using Discriminative Robust Local Binary Pattern and Gabor Filter with Single Sample per Class

An Efficient Face Recognition using Discriminative Robust Local Binary Pattern and Gabor Filter with Single Sample per Class An Efficient Face Recognition using Discriminative Robust Local Binary Pattern and Gabor Filter with Single Sample per Class D.R.MONISHA 1, A.USHA RUBY 2, J.GEORGE CHELLIN CHANDRAN 3 Department of Computer

More information

Face Recognition Using Ordinal Features

Face Recognition Using Ordinal Features Face Recognition Using Ordinal Features ShengCai Liao, Zhen Lei, XiangXin Zhu, ZheNan Sun, Stan Z. Li, and Tieniu Tan Center for Biometrics and Security Research & National Laboratory of Pattern Recognition,

More information

LOCAL APPEARANCE BASED FACE RECOGNITION USING DISCRETE COSINE TRANSFORM

LOCAL APPEARANCE BASED FACE RECOGNITION USING DISCRETE COSINE TRANSFORM LOCAL APPEARANCE BASED FACE RECOGNITION USING DISCRETE COSINE TRANSFORM Hazim Kemal Ekenel, Rainer Stiefelhagen Interactive Systems Labs, University of Karlsruhe Am Fasanengarten 5, 76131, Karlsruhe, Germany

More information

Diagonal Principal Component Analysis for Face Recognition

Diagonal Principal Component Analysis for Face Recognition Diagonal Principal Component nalysis for Face Recognition Daoqiang Zhang,2, Zhi-Hua Zhou * and Songcan Chen 2 National Laboratory for Novel Software echnology Nanjing University, Nanjing 20093, China 2

More information

Image-Based Face Recognition using Global Features

Image-Based Face Recognition using Global Features Image-Based Face Recognition using Global Features Xiaoyin xu Research Centre for Integrated Microsystems Electrical and Computer Engineering University of Windsor Supervisors: Dr. Ahmadi May 13, 2005

More information

Face Alignment Under Various Poses and Expressions

Face Alignment Under Various Poses and Expressions Face Alignment Under Various Poses and Expressions Shengjun Xin and Haizhou Ai Computer Science and Technology Department, Tsinghua University, Beijing 100084, China ahz@mail.tsinghua.edu.cn Abstract.

More information

An efficient face recognition algorithm based on multi-kernel regularization learning

An efficient face recognition algorithm based on multi-kernel regularization learning Acta Technica 61, No. 4A/2016, 75 84 c 2017 Institute of Thermomechanics CAS, v.v.i. An efficient face recognition algorithm based on multi-kernel regularization learning Bi Rongrong 1 Abstract. A novel

More information

Image Processing and Image Representations for Face Recognition

Image Processing and Image Representations for Face Recognition Image Processing and Image Representations for Face Recognition 1 Introduction Face recognition is an active area of research in image processing and pattern recognition. Since the general topic of face

More information

Illumination Invariant Face Recognition Based on Neural Network Ensemble

Illumination Invariant Face Recognition Based on Neural Network Ensemble Invariant Face Recognition Based on Network Ensemble Wu-Jun Li 1, Chong-Jun Wang 1, Dian-Xiang Xu 2, and Shi-Fu Chen 1 1 National Laboratory for Novel Software Technology Nanjing University, Nanjing 210093,

More information

Better than best: matching score based face registration

Better than best: matching score based face registration Better than best: based face registration Luuk Spreeuwers University of Twente Fac. EEMCS, Signals and Systems Group Hogekamp Building, 7522 NB Enschede The Netherlands l.j.spreeuwers@ewi.utwente.nl Bas

More information

NIST. Support Vector Machines. Applied to Face Recognition U56 QC 100 NO A OS S. P. Jonathon Phillips. Gaithersburg, MD 20899

NIST. Support Vector Machines. Applied to Face Recognition U56 QC 100 NO A OS S. P. Jonathon Phillips. Gaithersburg, MD 20899 ^ A 1 1 1 OS 5 1. 4 0 S Support Vector Machines Applied to Face Recognition P. Jonathon Phillips U.S. DEPARTMENT OF COMMERCE Technology Administration National Institute of Standards and Technology Information

More information

Subject-Oriented Image Classification based on Face Detection and Recognition

Subject-Oriented Image Classification based on Face Detection and Recognition 000 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050

More information

Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference

Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference Minh Dao 1, Xiang Xiang 1, Bulent Ayhan 2, Chiman Kwan 2, Trac D. Tran 1 Johns Hopkins Univeristy, 3400

More information

A Study on Similarity Computations in Template Matching Technique for Identity Verification

A Study on Similarity Computations in Template Matching Technique for Identity Verification A Study on Similarity Computations in Template Matching Technique for Identity Verification Lam, S. K., Yeong, C. Y., Yew, C. T., Chai, W. S., Suandi, S. A. Intelligent Biometric Group, School of Electrical

More information

Generic Face Alignment Using an Improved Active Shape Model

Generic Face Alignment Using an Improved Active Shape Model Generic Face Alignment Using an Improved Active Shape Model Liting Wang, Xiaoqing Ding, Chi Fang Electronic Engineering Department, Tsinghua University, Beijing, China {wanglt, dxq, fangchi} @ocrserv.ee.tsinghua.edu.cn

More information

Robust face recognition under the polar coordinate system

Robust face recognition under the polar coordinate system Robust face recognition under the polar coordinate system Jae Hyun Oh and Nojun Kwak Department of Electrical & Computer Engineering, Ajou University, Suwon, Korea Abstract In this paper, we propose a

More information

Supplementary Material : Partial Sum Minimization of Singular Values in RPCA for Low-Level Vision

Supplementary Material : Partial Sum Minimization of Singular Values in RPCA for Low-Level Vision Supplementary Material : Partial Sum Minimization of Singular Values in RPCA for Low-Level Vision Due to space limitation in the main paper, we present additional experimental results in this supplementary

More information

Hierarchical Ensemble of Gabor Fisher Classifier for Face Recognition

Hierarchical Ensemble of Gabor Fisher Classifier for Face Recognition Hierarchical Ensemble of Gabor Fisher Classifier for Face Recognition Yu Su 1,2 Shiguang Shan,2 Xilin Chen 2 Wen Gao 1,2 1 School of Computer Science and Technology, Harbin Institute of Technology, Harbin,

More information

Color Model Based Real-Time Face Detection with AdaBoost in Color Image

Color Model Based Real-Time Face Detection with AdaBoost in Color Image Color Model Based Real-Time Face Detection with AdaBoost in Color Image Yuxin Peng, Yuxin Jin,Kezhong He,Fuchun Sun, Huaping Liu,LinmiTao Department of Computer Science and Technology, Tsinghua University,

More information

Face Recognition Using Vector Quantization Histogram and Support Vector Machine Classifier Rong-sheng LI, Fei-fei LEE *, Yan YAN and Qiu CHEN

Face Recognition Using Vector Quantization Histogram and Support Vector Machine Classifier Rong-sheng LI, Fei-fei LEE *, Yan YAN and Qiu CHEN 2016 International Conference on Artificial Intelligence: Techniques and Applications (AITA 2016) ISBN: 978-1-60595-389-2 Face Recognition Using Vector Quantization Histogram and Support Vector Machine

More information

Learning Discriminative Local Patterns with Unrestricted Structure for Face Recognition

Learning Discriminative Local Patterns with Unrestricted Structure for Face Recognition Learning Discriminative Local Patterns with Unrestricted Structure for Face Recognition Douglas Brown, Yongsheng Gao, Jun Zhou School of Engineering Griffith University Brisbane, Australia {douglas.brown,

More information

Criminal Identification System Using Face Detection and Recognition

Criminal Identification System Using Face Detection and Recognition Criminal Identification System Using Face Detection and Recognition Piyush Kakkar 1, Mr. Vibhor Sharma 2 Information Technology Department, Maharaja Agrasen Institute of Technology, Delhi 1 Assistant Professor,

More information

An Acceleration Scheme to The Local Directional Pattern

An Acceleration Scheme to The Local Directional Pattern An Acceleration Scheme to The Local Directional Pattern Y.M. Ayami Durban University of Technology Department of Information Technology, Ritson Campus, Durban, South Africa ayamlearning@gmail.com A. Shabat

More information

A Distance-Based Classifier Using Dissimilarity Based on Class Conditional Probability and Within-Class Variation. Kwanyong Lee 1 and Hyeyoung Park 2

A Distance-Based Classifier Using Dissimilarity Based on Class Conditional Probability and Within-Class Variation. Kwanyong Lee 1 and Hyeyoung Park 2 A Distance-Based Classifier Using Dissimilarity Based on Class Conditional Probability and Within-Class Variation Kwanyong Lee 1 and Hyeyoung Park 2 1. Department of Computer Science, Korea National Open

More information

Image Based Feature Extraction Technique For Multiple Face Detection and Recognition in Color Images

Image Based Feature Extraction Technique For Multiple Face Detection and Recognition in Color Images Image Based Feature Extraction Technique For Multiple Face Detection and Recognition in Color Images 1 Anusha Nandigam, 2 A.N. Lakshmipathi 1 Dept. of CSE, Sir C R Reddy College of Engineering, Eluru,

More information

Morphable Displacement Field Based Image Matching for Face Recognition across Pose

Morphable Displacement Field Based Image Matching for Face Recognition across Pose Morphable Displacement Field Based Image Matching for Face Recognition across Pose Speaker: Iacopo Masi Authors: Shaoxin Li Xin Liu Xiujuan Chai Haihong Zhang Shihong Lao Shiguang Shan Work presented as

More information

FACE RECOGNITION USING SUPPORT VECTOR MACHINES

FACE RECOGNITION USING SUPPORT VECTOR MACHINES FACE RECOGNITION USING SUPPORT VECTOR MACHINES Ashwin Swaminathan ashwins@umd.edu ENEE633: Statistical and Neural Pattern Recognition Instructor : Prof. Rama Chellappa Project 2, Part (b) 1. INTRODUCTION

More information

Face detection and recognition. Many slides adapted from K. Grauman and D. Lowe

Face detection and recognition. Many slides adapted from K. Grauman and D. Lowe Face detection and recognition Many slides adapted from K. Grauman and D. Lowe Face detection and recognition Detection Recognition Sally History Early face recognition systems: based on features and distances

More information

Eye Detection by Haar wavelets and cascaded Support Vector Machine

Eye Detection by Haar wavelets and cascaded Support Vector Machine Eye Detection by Haar wavelets and cascaded Support Vector Machine Vishal Agrawal B.Tech 4th Year Guide: Simant Dubey / Amitabha Mukherjee Dept of Computer Science and Engineering IIT Kanpur - 208 016

More information

Postprint.

Postprint. http://www.diva-portal.org Postprint This is the accepted version of a paper presented at 14th International Conference of the Biometrics Special Interest Group, BIOSIG, Darmstadt, Germany, 9-11 September,

More information

Recognition of Non-symmetric Faces Using Principal Component Analysis

Recognition of Non-symmetric Faces Using Principal Component Analysis Recognition of Non-symmetric Faces Using Principal Component Analysis N. Krishnan Centre for Information Technology & Engineering Manonmaniam Sundaranar University, Tirunelveli-627012, India Krishnan17563@yahoo.com

More information

Multidirectional 2DPCA Based Face Recognition System

Multidirectional 2DPCA Based Face Recognition System Multidirectional 2DPCA Based Face Recognition System Shilpi Soni 1, Raj Kumar Sahu 2 1 M.E. Scholar, Department of E&Tc Engg, CSIT, Durg 2 Associate Professor, Department of E&Tc Engg, CSIT, Durg Email:

More information

A NOVEL APPROACH TO ACCESS CONTROL BASED ON FACE RECOGNITION

A NOVEL APPROACH TO ACCESS CONTROL BASED ON FACE RECOGNITION A NOVEL APPROACH TO ACCESS CONTROL BASED ON FACE RECOGNITION A. Hadid, M. Heikkilä, T. Ahonen, and M. Pietikäinen Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering

More information

COMBINING SPEEDED-UP ROBUST FEATURES WITH PRINCIPAL COMPONENT ANALYSIS IN FACE RECOGNITION SYSTEM

COMBINING SPEEDED-UP ROBUST FEATURES WITH PRINCIPAL COMPONENT ANALYSIS IN FACE RECOGNITION SYSTEM International Journal of Innovative Computing, Information and Control ICIC International c 2012 ISSN 1349-4198 Volume 8, Number 12, December 2012 pp. 8545 8556 COMBINING SPEEDED-UP ROBUST FEATURES WITH

More information

A Real Time Facial Expression Classification System Using Local Binary Patterns

A Real Time Facial Expression Classification System Using Local Binary Patterns A Real Time Facial Expression Classification System Using Local Binary Patterns S L Happy, Anjith George, and Aurobinda Routray Department of Electrical Engineering, IIT Kharagpur, India Abstract Facial

More information

CHAPTER 5 GLOBAL AND LOCAL FEATURES FOR FACE RECOGNITION

CHAPTER 5 GLOBAL AND LOCAL FEATURES FOR FACE RECOGNITION 122 CHAPTER 5 GLOBAL AND LOCAL FEATURES FOR FACE RECOGNITION 5.1 INTRODUCTION Face recognition, means checking for the presence of a face from a database that contains many faces and could be performed

More information

ROBUST LDP BASED FACE DESCRIPTOR

ROBUST LDP BASED FACE DESCRIPTOR ROBUST LDP BASED FACE DESCRIPTOR Mahadeo D. Narlawar and Jaideep G. Rana Department of Electronics Engineering, Jawaharlal Nehru College of Engineering, Aurangabad-431004, Maharashtra, India ABSTRACT This

More information

Light Field Occlusion Removal

Light Field Occlusion Removal Light Field Occlusion Removal Shannon Kao Stanford University kaos@stanford.edu Figure 1: Occlusion removal pipeline. The input image (left) is part of a focal stack representing a light field. Each image

More information

Misalignment-Robust Face Recognition

Misalignment-Robust Face Recognition Misalignment-Robust Face Recognition Huan Wang 1 Shuicheng Yan 2 Thomas Huang 3 Jianzhuang Liu 1 Xiaoou Tang 1,4 1 IE, Chinese University 2 ECE, National University 3 ECE, University of Illinois 4 Microsoft

More information

Partial Face Recognition

Partial Face Recognition Partial Face Recognition Shengcai Liao NLPR, CASIA April 29, 2015 Background Cooperated face recognition People are asked to stand in front of a camera with good illumination conditions Border pass, access

More information

Three-Dimensional Face Recognition: A Fishersurface Approach

Three-Dimensional Face Recognition: A Fishersurface Approach Three-Dimensional Face Recognition: A Fishersurface Approach Thomas Heseltine, Nick Pears, Jim Austin Department of Computer Science, The University of York, United Kingdom Abstract. Previous work has

More information

Face Recognition with Local Binary Patterns

Face Recognition with Local Binary Patterns Face Recognition with Local Binary Patterns Bachelor Assignment B.K. Julsing University of Twente Department of Electrical Engineering, Mathematics & Computer Science (EEMCS) Signals & Systems Group (SAS)

More information

Implementation of a Face Recognition System for Interactive TV Control System

Implementation of a Face Recognition System for Interactive TV Control System Implementation of a Face Recognition System for Interactive TV Control System Sang-Heon Lee 1, Myoung-Kyu Sohn 1, Dong-Ju Kim 1, Byungmin Kim 1, Hyunduk Kim 1, and Chul-Ho Won 2 1 Dept. IT convergence,

More information

APPLICATION OF LOCAL BINARY PATTERN AND PRINCIPAL COMPONENT ANALYSIS FOR FACE RECOGNITION

APPLICATION OF LOCAL BINARY PATTERN AND PRINCIPAL COMPONENT ANALYSIS FOR FACE RECOGNITION APPLICATION OF LOCAL BINARY PATTERN AND PRINCIPAL COMPONENT ANALYSIS FOR FACE RECOGNITION 1 CHETAN BALLUR, 2 SHYLAJA S S P.E.S.I.T, Bangalore Email: chetanballur7@gmail.com, shylaja.sharath@pes.edu Abstract

More information

Face Detection and Recognition in an Image Sequence using Eigenedginess

Face Detection and Recognition in an Image Sequence using Eigenedginess Face Detection and Recognition in an Image Sequence using Eigenedginess B S Venkatesh, S Palanivel and B Yegnanarayana Department of Computer Science and Engineering. Indian Institute of Technology, Madras

More information

Multi-feature face liveness detection method combining motion information

Multi-feature face liveness detection method combining motion information Volume 04 - Issue 11 November 2018 PP. 36-40 Multi-feature face liveness detection method combining motion information Changlin LI (School of Computer Science and Technology, University of Science and

More information

Object. Radiance. Viewpoint v

Object. Radiance. Viewpoint v Fisher Light-Fields for Face Recognition Across Pose and Illumination Ralph Gross, Iain Matthews, and Simon Baker The Robotics Institute, Carnegie Mellon University 5000 Forbes Avenue, Pittsburgh, PA 15213

More information

In Defense of Sparsity Based Face Recognition

In Defense of Sparsity Based Face Recognition 013 IEEE Conference on Computer Vision and Pattern Recognition In Defense of Sparsity Based Face Recognition Weihong Deng, Jiani Hu, Jun Guo Beijing University of Posts and Telecommunications, Beijing,

More information

Color Local Texture Features Based Face Recognition

Color Local Texture Features Based Face Recognition Color Local Texture Features Based Face Recognition Priyanka V. Bankar Department of Electronics and Communication Engineering SKN Sinhgad College of Engineering, Korti, Pandharpur, Maharashtra, India

More information