A Robust Elastic and Partial Matching Metric for Face Recognition

Size: px
Start display at page:

Download "A Robust Elastic and Partial Matching Metric for Face Recognition"

Transcription

1 A Robust Elastic and Partial Matching Metric or Face Recognition Gang Hua Amir Akbarzadeh Microsot Corporate One Microsot Way, Redmond, WA 9852 {ganghua, Abstract We present a robust elastic and partial matching metric or ace recognition. To handle challenges such as pose, acial expression and partial occlusion, we enable both elastic and partial matching by computing a part based ace representation. In which N local image descriptors are extracted rom densely sampled overlapping image patches. We then deine a distance metric where each descriptor in one ace is matched against its spatial neighborhood in the other ace and the minimal distance is recorded. For implicit partial matching, the list o all minimal distances are sorted in ascending order and the distance at the αn-th position is picked up as the inal distance. The parameter α 1 controls how much occlusion, acial expression changes, or pixel degradations we would allow. The optimal parameter values o this new distance metric are extensively studied and identiied with real-lie photo collections. We also reveal that iltering the ace image by a simple dierence o Gaussian brings signiicant robustness to lighting variations and beats the more utilized sel-quotient image. Extensive evaluations on ace recognition benchmarks show that our method is leading or is competitive in perormance when compared to state-o-the-art. 1. Introduction Face recognition has been extensively studied in the community or several decades [1, 2, 8, 14, 17, 24, 29, 3]. It has been shown by the ace recognition grand challenge [19] that under controlled settings, the recognition rate can be higher than 99% with alse acceptance rate as low as.1%. Nevertheless, this is not the case when perorming ace recognition in uncontrolled real lie photos [11]. Such photos include considerable visual variations caused by, or example, lighting [7, 21], dierence in pose [21], acial expression [2] and partial occlusion [2]. It has been demonstrated that state-o-the-art photometric rectiication techniques such as sel-quotient image [26] can largely mitigate lighting variations except or extreme Figure 1. Examples o matched aces in our experiments. Notice the signiicant variations in lighting, pose, acial expression as well as partial occlusion. Each row shows two pair o matched aces. cases. In our experiments, we reveal that a simple dierence o Gaussian (DoG) ilter outperorms the more utilized selquotient image method in handling normal lighting variations. Although there has been great research progress on ace alignment [12], signiicant pose variations may still exist ater alignment. Thereore, besides extreme lighting variation [7], pose, acial expression and partial occlusion remain great challenges. Intuitively, these challenges can largely be alleviated by designing robust ace distance metrics that leverage both elastic and partial matching. By design principle, there are two types o ace distance metrics: learning based metrics [24, 2, 8, 14, 3, 29] and hand-crated metrics [1, 18, 15]. Inspired by the seminal work o Turk and Pentland on Eigen-Faces [24], learning based distance metrics have been a very active topic in ace recognition. The predominant research eorts consist o identiying a discriminative embedding o aces in order to deine a distance metric. Fisher- Faces [2], Laplacian-Faces [8] and their regularized variants [5, 4, 3] are all along this line. Other learned met IEEE 12th International Conerence on Computer Vision (ICCV) /9/$ IEEE

2 rics include those based on SVMs [17] and Bayesian methods [16]. Nevertheless, learned metrics based on strongly supervised learning, such as linear discriminative embeddings [2, 8] or SVMs [17], need to be trained on the speciic data-set that they deal with and most oten the ace images need to be aligned well to acilitate learning o meaningul structure o acial appearances. This makes them more suitable or controlled surveillance scenarios with limited subjects where labeled gallery aces are ready to be used or training. In addition, the training data-set has to be large enough to reduce the risk o over-itting. For many ace recognition tasks on real-lie photos, these conditions may not be satisied. Hence, it is desirable to have a plug-and-play distance metric, which does not need to be trained and can conveniently be used in ace recognition tasks dealing with real-lie photos. Hand-crated distance metrics do not suer rom the problems conronting the learned metrics. They also provide much more lexibility in incorporating elastic and partial matching schemes. For example, Elastic Bunch Graph Matching (EBGM) [28] represents each ace by a graph, the nodes o which are a set o Gabor jets extracted rom acial land-marks. Then a graph matching algorithm is designed to calculate the distance between two ace representations. Notwithstanding their demonstrated success, graph matching is computationally intensive and the Gabor jets may not be discriminative enough or robust matching. Ahonen et al. [1] proposed a distance metric that is calculated by a weighted sum o χ 2 distances, each o which is calculated between histograms o local binary patterns (LBP) on non-overlapping image partitions. However, it does not enable elastic matching at all, and hence, it is not robust to pose variations. Vivek and Sudha [18] proposed a partial Hausdor distance metric where each pixel is represented as a binary vector similar to local binary pattern. The drawback o this method is that the spatial structure is largely discarded since a pixel in one ace could be matched with any other pixel having the same local binary pattern in the other ace. This is not desirable, especially when the aces are roughly aligned with each other. In search or a robust ace distance metric to handle all the challenges in ace recognition, we take a part based ace representation to enable elastic and partial matching, where a set o N local image descriptors [13, 27, 9, 23] are extracted rom overlapping and densely sampled image patches. Then, in the matching process, each local image descriptor in one ace image is compared against descriptors in its spatial neighborhood in the other ace image and the minimal distance is recorded. To perorm partial matching, the list o all recorded minimal distances are then sorted in ascending order and the distance at the αn-th position is picked up as the inal distance metric, where <α 1 is a control parameter on how much pixel degradation, acial expression changes and partial occlusions we would allow in the ace images. The optimal parameter settings o our distance metric is extensively studied on real lie photos obtained rom several people s amily & riends photo collections. With these optimal parameter settings, the proposed distance metric exhibits great robustness to pose variation, partial occlusion, as well as acial expression changes. This is demonstrated in our experiments on various ace recognition benchmarks. We present in Figure 1 some matched aces in our experiments on real-lie photo collections to demonstrate how robust our distance metric is to all the dierent visual variations. The design o our distance metric ollows the undamental principle o the generalized Hausdor distance. However, unlike its previous applications in ace recognition, in which it was used to match edge points in the image space [6, 22], our distance metric is deined in the eature space, i.e., the space o the local image descriptors. Furthermore, we reinorce constraints to only allow each local image descriptor to be matched with its spatial neighbors in the image space. This spatial constraint is essential or matching two ace images as shown in our experiments. This way, we perorm explicit elastic matching and implicit partial matching in an eicient and robust way. Our main contributions are two old: 1) We propose a novel robust partial matching metric or ace recognition, which perorms explicit elastic matching and implicit partial matching and shows leading perormance when compared to the state-o-the-art. 2) We empirically show that a simple dierence o Gaussian ilter outperorms the more utilized sel-quotient image and brings signiicant lighting invariance. 2. Part-based Face Representation Figure 2 presents our pipeline used to extract the representation o a ace. As illustrated in the igure, given an input image containing a ace, we irst run a variant [31] o the Viola-Jones ace detector [25]. Next, the detected ace image patch is ed into an eye detector, a convolutional neural network regressor, which localizes the let and right eye locations. Our geometric rectiication step is conducted by warping the ace patch with a similarity transormation that places the two eyes into canonical positions in a patch o size w w (w = 128 in our settings). The geometrically rectiied ace patch I is then passed through a DoG ilter to obtain the photometrically rectiied ace patch Î, i.e., Î = I σ1 I σ2, (1) where I σ is produced by smoothing I with a Gaussian kernel G σ with standard deviation o σ pixels. Our empirical 283

3 Face Detection Eye Detection Geometric Rectiication Photometric Rectiication Dense Overlapping Partitioning (a) (b) (c) (d) (e) { x x, x x, y y, y y} Descriptor Extraction () K K 2 1K 2K KK Face Representation (g) Figure 2. Our processing pipeline to extract the ace representation. investigations reveal that the combination o σ 1 =, which simply means no smoothing (i.e., I σ1 = I), and σ 2 =1is optimal. Ater the photometric rectiication step, we densely partition the ace image into N = K K overlapping patches o size n n (n =18in our settings), with both the horizontal and vertical step set to s pixels (s =2in our settings). To obtain our part-based representation, we compute a local image descriptor or each o the size n n small patches. We adopt a variant o the descriptor T2-S2-9 proposed by Winder and Brown [27], which essentially accumulates 4 dimensional histograms o rectiied image gradients { x x, x + x, y y, y + y } over 9 spatial pooling regions, as shown in Figure 2(). This descriptor provides excellent perormance when matching image patches subject to dierent lighting and geometric distortions. Ater we extract the local image descriptor or each o the local image patches, our inal ace representation is a matrix o N = K K local image descriptors, i.e., F =[ mn ], 1 <m<k, 1 <n<k (2) where mn corresponds to the descriptor extracted rom the patch at location (m s, n s) in pixel coordinates. Given such ace representations we now proceed to deine our distance metric. 3. Robust Elastic and Partial Matching Metric We would like to utilize both elastic and partial matching to handle the dierent visual variations in ace images. To calculate the distance between two ace representations F (1) and F (2), we irst perorm elastic matching or each local descriptor ij in F (1). This is done by inding that descriptor s best match among its spatially neighboring descriptors in F (2). More ormally, or each 1 i, j K, we have d( (1) ij )= min (1) ij (2) kl 1. (3) k,l: i s k s r, j s l s r 11 ij KK match each eature within region each min distance d 11 d 12 d ij d KK sort distances d 73 d 82 d 11 d 34 -th percentile as inal distance Figure 6. Illustration o our robust distance metric. Note however that the α-th percentile selection can be implemented with a quick selection algorithm, i.e. no explicit sorting is needed. where 1 stands or the L1 norm, and r is a parameter controlling how much elasticity we would allow during matching. We name the neighborhood deined by r as r- neighborhood. Then, let [d 1,d 2,,d αn,,d N ]=Sort ascend {d( (1) ij )}K i,j=1 (4) be the sorted distances o all d( (1) ij ) in ascending order, we deine d(f (1) F (2) )=d αn (5) as the directional distance rom F 1 to F 2, where α 1 is a control parameter or partial matching. Note that it is not needed to do an explicit sorting in the implementation, we can instead use a quick selection algorithm. The parameter α controls how much pixel degradation, partial occlusion or acial expression changes we expect in the ace images. Figure 6 visually illustrates how the distance metric is computed. r 284

4 Faces per person (#persons with one ace = 124) 14 Faces per person (#persons with one ace = 61) 7 #persons (total = 269) #persons (total = 1294) #aces (total = 856) (a) FF #aces (total = 4933) (b) FF2 Figure 3. Histogram o the number o subjects owning a speciic number o aces #persons:269 - #aces:856 DoG Sel quotient #persons: #aces:4933 DoG Sel quotient (a) FF (b) FF2 Figure 4. Comparison o DoG ilter with sel-quotient image. Similarly, we can also deine d(f (2) F (1) ) and it is clear that most oten d(f (1) F (2) ) d(f (2) F (1) ). To make our distance symmetric, our inal robust distance metric is deined as D(F (1),F (2) )=max(d(f (1) F (2) ),d(f (2) F (1) )). (6) The ollowing property o the proposed distance metric is trivially realized. Property 3.1 I D(F (1),F (2) ) <V, then at least α portion o the local image descriptors in F (1) (F (2) ) have a matched local descriptor in their r-neighborhood in F (2) (F (1) ) with distance less than V. Property 3.1 relects how the proposed distance metric perorms partial matching, i.e., the distance represents how well α portion o the ace images are matched. 4. Experiments We present extensive experiments to validate the quality o our ace distance metric. Our somewhat optimized C++ implementation executes the distance metric at a speed o.23ms or a pair o aces (on a machine with a single core 3.GHz CPU). This is excluding the time or extracting the ace representations. Below, we irst explore the parameter values o our distance metric on real-lie photo collections. Then, ixing the optimal parameter values, we perorm ex- 285

5 8 #persons:269 - #aces: #persons: #aces: step=1px step=2px step=3px step=4px step=1px step=2px step=3px step=4px #persons:269 - #aces: #persons: #aces: range=4px range=px range=all 4 35 range=4px range=px range=all #persons:269 - #aces:856 percentile=2% percentile=5% percentile=1% #persons: #aces:4933 percentile=2% percentile=5% percentile=1% (a) FF (b) FF2 Figure 5. From top row to bottom row, the ROC curves or dierent values o the parameters s, r, and α, respectively. Both on FF1 (Column (a)) and FF2 (Column (b)). tensive evaluation on benchmarks such as Labeled Faces in the Wild (LFW) [11], the Olivetti Research Laboratory (ORL) database [2], the Yale ace database [2], and the CMU PIE database [21]. To make the presentation more 286

6 concise, we call them LFW, ORL, Yale, and PIE, respectively Parameter Exploration There are three important parameters in our distance metric that we need to explore in order to obtain optimal perormance. The irst one is the patch sampling step parameter s in the ace representation pipeline. It determines how many densely sampled patch descriptors we generate. The parameter s should be careully chosen to balance between speed and recognition quality. The second parameter is the elasticity range parameter r, which deines the r- neighborhood an individual descriptor would match against. The third parameter is the partial matching control parameter α. As discussed beore, α controls how much pixel degradation, partial occlusion, or acial expression changes we would expect. To explore the eects o these parameters, we collected two real-lie photo collections rom several people s amily & riends photo albums. We manually tagged all the aces that were detected by our ace detector in these photos. We call them amily & riends data set one and two, or in short FF1 and FF2, respectively. FF1 has a total o 856 aces o 269 subjects. While FF2 contains 4933 aces o 1294 subjects. The number o aces per subject is not uniorm in these data sets. Figure 3 presents the distribution o how many aces images each subject has. The horizontal axis o the igure displays the number o aces, the vertical axis represents the number o subjects that have that number o aces. For example, in Figure 3 (a), we can see that there are 124 subjects in FF1 who only have 1 ace, and in Figure 3 (b), we can see that there are around 25 subjects in FF2 who have 2 aces. With each data set, we split the aces hal and hal per subject into two subsets. One subset is used as the gallery set and the other is used as the probe set. The recognition rate is evaluated by 1 nearest neighbor classiication. A ROC curve is generated by picking a threshold on a ratio o the distances between the query ace to the best matched gallery ace and the distance between the query ace to the second best matched gallery ace with a dierent identity than the best matched one. I the ratio is below a certain threshold, then we accept the match, otherwise we do not accept the match. The horizontal and vertical axis present the number o alsely and correctly recognized aces among the accepted matches, respectively. Both subsets are served as gallery set once so the inal ROC curve is the aggregation o two tests. We have exhaustively run evaluations with all possible combinations o the two photometric rectiication methods, i.e., DoG ilter and the sel-quotient image [26], with dierent settings o the parameters s, r and α. Our conclusion is that using the DoG ilter, with s =2pixel, r =4pixel, and α =.2 is the optimal setting. To better understand this investigation, in Figure 4 and 5, we present comparative ROC curves by setting each parameter to be a dierent value than the optimal one, while keeping the other settings at their optimal values. We also present in these igures the ground truth ROC curve (red dotted line) that a perect ace recognizer would achieve. Such a recognizer would reuse to accept a match or aces that do not have a corresponding gallery ace, while correctly matching all the other aces which do have corresponding gallery aces. More speciically, Figure 4 presents the recognition ROC curves using either the DoG ilter (blue curve) or selquotient image (green curve) or photometric rectiication. We can clearly observe, on both FF1 and FF2, that using DoG achieves signiicantly better recognition rate than using sel-quotient image. Similarly, the irst, second, and third row in Figure 5 presents the eect o dierent values o the parameters s, r, and α, respectively. We can clearly observe how the recognition perormance degrades when the value is not the optimal one. We did note that overall s = 1 (blue curve) obtained slightly better perormance than s =2. However, s =2 saves almost 4 times the computation time or extracting the local descriptors and also makes the ace representation size 4 times smaller. Thereore, we choose to use s =2at the slight sacriice o recognition perormance. Another observation is that the optimal setting or α, an optimal value o.2, implies that the best matched 2% region in the ace images largely determines the identity o the ace. Last but not least, we would like to emphasize the importance o using the parameter r to control the amount o elasticity we would allow in the distance metric. As clearly observed in the second row o Figure 5, neither allowing no elasticity r =(blue line in the igure) nor allowing maximal elasticity r>k(red line in the igure) is desired. The ormer does not handle pose variation well. While the latter does not take into consideration that ace images are very structured, especially ater they are roughly aligned. The matching o the local descriptors should not be over the whole ace image. In the ollowing, we exclusively use the identiied optimal settings or our distance metric to compare with the state-o-the-art on various ace recognition benchmarks Experiments on Recognition Benchmarks Face Recognition on LFW We irst present our recognition result on the LFW dataset [11]. We ollowed the test settings speciied in [11]. The evaluation o the quality o a ace recognition algorithm on LFW is to classiy a pair o aces as either match or nonmatch based on the distance between them. From dierent threshold settings, a ROC curve is generated. Figure 7 287

7 true positive rate Hybrid descriptor-based Merl+Nowak Nowak Merl This work alse positive rate Figure 7. Our perormance on the aces in the wild data set. Note that parameters or our algorithm is not tuned on this data set. presents the ROC curve rom our approach (black dotted line), along with the ROC curves o previous methods such as the hybrid descriptor based method proposed by Wol et al. [29], Nowak s method on image matching applied to ace recognition [17], the MERL ace recognizer [1], and the combined MERL+Nowak method [1]. As shown in Figure 7, our method outperorms both the MERL recognizer and Nowak s method in both the low and high alse positive regions. While the hybrid descriptor based method has the leading perormance in the low alse positive region and the MERL+Nowak method is leading in the high alse positive region. Moreover, our method outperorms MERL+Nowak in the low alse positive region and is comparable to the hybrid descriptor method in the high alse positive region. We must emphasize that in order to show the generalization ability o our method, we did not leverage the training data provided in LFW to tune the parameters o our algorithm, we simply used the parameters reported above. Also notice that our algorithm is the top perorming non-combination method, i.e. unlike hybrid descriptor-based and Merl+Nowak it does not combine the output o several algorithms Face Recognition on ORL, Yale, and PIE We perorm extensive experiments on three ace recognition benchmarks including Yale, ORL, and PIE 1. We briely describe each o the data-sets and our experimental setting: The Yale database contains 165 aces o 15 subjects. There are 11 aces per subject, which are o dierent acial expressions. We randomly select 5 aces per person to 1 The cropped and aligned aces o these datasets are obtained rom Dr. Deng Cai at Yale ORL PIE Base 43.8 ± ± ±.6 PCA 43.8 ± ± ±.6 16 LDA 21.2 ± ± ±.3 67 LPP 21.1 ± ± ± RLDA 17.4 ± ± ±.2 67 SLDA 14.9 ± ± ±.2 67 Ours 9.4 ± ± ±.2 Table 1. Error rates on three academic benchmarks. The table enumerates the average ace recognition error rate and the standard deviation in percentage over 5 runs. The subscripts present the optimal dimension o dierent embedding methods. orm the set o gallery aces, and the rest are used as the probe aces. The ORL database contains 4 aces o 4 subjects. There are 1 aces per subject, which were taken at dierent time, lighting, and acial expressions. We randomly select 5 images per subject to orm the set o gallery aces, and the rest are used to orm the probe set. The PIE dataset contains images o 68 subjects with 13 poses, 43 illumination conditions, and 4 expressions. We used the images o the 5 nearly rontal poses (C5, C7, C9, C27, C29) under all illumination conditions and expressions, i.e., a subset o 1156 ace images with 17 images per person. We randomly selected 3 images per person as the gallery aces, and the rest were used or testing. In our experiments, the ace images were all resized to with the eyes aligned in the same canonical location. For each data set, we randomly split it 5 times and we report the average recognition error rate in percentage, see Table 1. The matches are calculated by 1 nearest neighbor classiication. Note because the aces are already aligned, we bypassed the geometric rectiication step when calculating our ace representation. Since the various discriminative embedding methods show the state-o-the-art perormances on these dataset, we compare the perormance o our algorithm mainly to them, including the Fisher-Face (LDA) [2], Laplacian-Face (LPP) [8], spatially smooth Fisher-Face (SLDA) [5], and the regularized Fisher-Face (RLDA) [3]. We also present two baseline results: the irst one is taking Euclidean distances between the raw ace images, and the second one is using Eigen-Faces (PCA) [24]. The recognition error rates o all the methods are also summarized in Table 1 2. All the learned metrics are trained on the gallery aces. The ace image vectors are all normalized to be unit vectors in preprocessing, as suggested in [5, 3]. From Table 1, it can be seen that our ace distance met- 2 To generate the comparison results, we used the Matlab script rom Dr. Deng Cai at 288

8 ric outperorms all the learned metrics by a signiicant margin in all tests. This is even though we did not perorm any training or parameter tuning on these data sets. For example, our method achieves error rates o 9.4% ± 3.2%, 1% ±.9%, 2.4% ±.2% on Yale, ORL, and PIE, respectively, while the second best results achieved by SLDA are 14.9% ± 3.1%, 2.3% ± 1.%, and 3.6% ±.2%. These results clearly demonstrate the perormance and generalization ability o our method. 5. Conclusion and Future Work In this paper, we propose a robust distance metric or ace recognition. The distance metric incorporates the ideas o both elastic and partial matching. The metric can deal with all various visual variations ound in real lie ace photos. This includes lighting variation, dierence in pose, acial expression, as well as partial occlusion. We extensively studied the eects o dierent parameters when dealing with photos rom several people s real lie photo collections. The distance metric with the optimal parameter settings was then evaluated on various ace recognition benchmarks. The extensive evaluation demonstrated the excellent perormance o our proposed approach. We also demonstrated that a simple DoG iltering is better than the more utilized photometric rectiication method sel-quotient image in handling lighting variations. Future research includes urther exploration o using dierent local image descriptors as well as experimentation with the photometric rectiication algorithm to handle more extreme lighting variations. Reerences [1] T. Ahonen, A. Hadid, and M. Pietikainen. Face recognition with local binary patterns. In ECCV, 24. [2] P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman. Eigenaces vs. Fisheraces: Recognition using class speciic linear projection. IEEE Trans. PAMI, 19(7):711 72, Special Issue on Face Recognition. [3] D. Cai, X. He, and J. Han. Spectral regression or eicient regularized subspace learning. In ICCV, 27. [4] D. Cai, X. He, J. Han, and H.-J. Zhang. Orthogonal laplacianaces or ace recognition. IEEE Trans. Image Processing, 15(11): , November 26. [5] D. Cai, X. He, Y. Hu, J. Han, and T. Huang. Learning a spatially smooth subspace or ace recognition. In CVPR, 27. [6] Y. Gao and M. K. Leung. Face recognition using line edge map. IEEE Trans. PAMI, 24(6): , 22. [7] A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman. From ew to many: Illumination cone models or ace recognition under variable lighting and pose. IEEE Trans. PAMI, 23(6):643 66, 21. [8] X. He, S. Yan, Y. Hu, P. Niyogi, and H. Zhang. Face recognition using laplacianaces. IEEE Trans. PAMI, 27(3):328 34, March 25. [9] G. Hua, M. Brown, and S. Winder. Discriminant embedding or local image descriptors. In ICCV,27. [1] G. B. Huang, M. J. Jones, and E. Learned-Miller. Lw results using a combined nowak plus merl recognizer. In Faces in Real-Lie Images Workshop in ECCV, 28. [11] G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller. Labeled aces in the wild: a database or studying ace recognition in unconstrained environments. Technical Report 7-49, University o Massachusetts, Amherst, 27. [12] L. Liang, R. Xiao, F. Wen, and J. Sun. Face alignment via component based discriminative search. In ECCV, 28. [13] D. G. Lowe. Distinctive image eatures rom scale-invariant keypoints. IJCV, 6:91 11, 24. [14] S. Lucey and T. Chen. Learning patch dependencies or improved pose mismatched ace veriication. In CVPR, 26. [15] J. Luo, Y. Ma, E. Takikawa, S. Lao, M. Kawade, and B.- L. Lu. Person-speciic sit eatures or ace recognition. In Proc. ICASSP, 27. [16] B. Moghaddam, T. Jebara, and A. Pentland. Bayesian ace recognition. Pattern Recognition, 33(11): , 2. [17] E. Nowak and F. Jurie. Learning visual similarity measures or comparing never seen objects. In CVPR, 27. [18] V. E. P and N. Sudha. Robust hausdor distance measure or ace recognition. Pattern Recognition, 4(2): , 27. [19] P. J. Phillips, P. J. Flynn, T. Scruggs, K. W. Bowyer, J. Chang, K. Homan, J. Marques, J. Min, and W. Worek. Overview o the ace recognition grand challenge. In CVPR, 25. [2] F. Samaria and A. Harter. Parameterization o a stochastic model or human ace identiication. In WACV, [21] T. Sim, S. Baker, and M. Bsat. The cmu pose, illumination, and expression database. IEEE Trans. PAMI, 25(12): , December 23. [22] B. Takacs. Comparing ace images using the modiied hausdor distance. Pattern Recognition, 31(12): , [23] E. Tola, V. Leptit, and P. Fua. A ast local descriptor or dense matching. In CVPR, Anchograge, AK, June 28. [24] M. A. Turk and A. P. Pentland. Face recognition using eigenaces. In CVPR, pages , June [25] P. Viola and M. J. Jones. Robust real-time ace detection. IJCV, 57: , 24. [26] H. Wang, S. Z. Li, and Y. Wang. Generalized quotient image. In CVPR, 24. [27] S. Winder and M. Brown. Learning local image descriptors. In CVPR, 27. [28] L. Wiskott, J.-M. Fellous, N. Krüger, and C. von der Malsburg. Face recognition by elastic bunch graph matching. IEEE Trans. PAMI, 19(7): , [29] L. Wol, T. Hassner, and Y. Taigman. Descriptor based methods in the wild. In Faces in Real-Lie Images Workshop in ECCV, 28. [3] J. Wright and G. Hua. Implicit elastic matching with randomized projections or pose-variant ace recognition. In CVPR, 29. [31] C. Zhang and P. Viola. Multiple-instance pruning or learning eicient cascade detectors. In J. Platt, D. Koller, Y. Singer, and S. Roweis, editors, NIPS,

Learning to Recognize Faces in Realistic Conditions

Learning to Recognize Faces in Realistic Conditions 000 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050

More information

Face recognition using SURF features

Face recognition using SURF features ace recognition using SUR features Geng Du*, ei Su, Anni Cai Multimedia Communication and Pattern Recognition Labs, School of Information and Telecommunication Engineering, Beijing University of Posts

More information

Improving Alignment of Faces for Recognition

Improving Alignment of Faces for Recognition Improving Alignment o Faces or Recognition Md. Kamrul Hasan Département de génie inormatique et génie logiciel École Polytechnique de Montréal, Québec, Canada md-kamrul.hasan@polymtl.ca Christopher J.

More information

Gabor Volume based Local Binary Pattern for Face Representation and Recognition

Gabor Volume based Local Binary Pattern for Face Representation and Recognition Gabor Volume based Local Binary Pattern for Face Representation and Recognition Zhen Lei 1 Shengcai Liao 1 Ran He 1 Matti Pietikäinen 2 Stan Z. Li 1 1 Center for Biometrics and Security Research & National

More information

Decorrelated Local Binary Pattern for Robust Face Recognition

Decorrelated Local Binary Pattern for Robust Face Recognition International Journal of Advanced Biotechnology and Research (IJBR) ISSN 0976-2612, Online ISSN 2278 599X, Vol-7, Special Issue-Number5-July, 2016, pp1283-1291 http://www.bipublication.com Research Article

More information

Robust Face Recognition Using Enhanced Local Binary Pattern

Robust Face Recognition Using Enhanced Local Binary Pattern Bulletin of Electrical Engineering and Informatics Vol. 7, No. 1, March 2018, pp. 96~101 ISSN: 2302-9285, DOI: 10.11591/eei.v7i1.761 96 Robust Face Recognition Using Enhanced Local Binary Pattern Srinivasa

More information

ROBUST LDP BASED FACE DESCRIPTOR

ROBUST LDP BASED FACE DESCRIPTOR ROBUST LDP BASED FACE DESCRIPTOR Mahadeo D. Narlawar and Jaideep G. Rana Department of Electronics Engineering, Jawaharlal Nehru College of Engineering, Aurangabad-431004, Maharashtra, India ABSTRACT This

More information

Face Recognition using Hough Peaks extracted from the significant blocks of the Gradient Image

Face Recognition using Hough Peaks extracted from the significant blocks of the Gradient Image Face Recognition using Hough Peaks extracted rom the signiicant blocks o the Gradient Image Arindam Kar 1, Debotosh Bhattacharjee, Dipak Kumar Basu, Mita Nasipuri, Mahantapas Kundu 1 Indian Statistical

More information

An Associate-Predict Model for Face Recognition FIPA Seminar WS 2011/2012

An Associate-Predict Model for Face Recognition FIPA Seminar WS 2011/2012 An Associate-Predict Model for Face Recognition FIPA Seminar WS 2011/2012, 19.01.2012 INSTITUTE FOR ANTHROPOMATICS, FACIAL IMAGE PROCESSING AND ANALYSIS YIG University of the State of Baden-Wuerttemberg

More information

ROBUST FACE DETECTION UNDER CHALLENGES OF ROTATION, POSE AND OCCLUSION

ROBUST FACE DETECTION UNDER CHALLENGES OF ROTATION, POSE AND OCCLUSION ROBUST FACE DETECTION UNDER CHALLENGES OF ROTATION, POSE AND OCCLUSION Phuong-Trinh Pham-Ngoc, Quang-Linh Huynh Department o Biomedical Engineering, Faculty o Applied Science, Hochiminh University o Technology,

More information

Generic Face Alignment Using an Improved Active Shape Model

Generic Face Alignment Using an Improved Active Shape Model Generic Face Alignment Using an Improved Active Shape Model Liting Wang, Xiaoqing Ding, Chi Fang Electronic Engineering Department, Tsinghua University, Beijing, China {wanglt, dxq, fangchi} @ocrserv.ee.tsinghua.edu.cn

More information

MAPI Computer Vision. Multiple View Geometry

MAPI Computer Vision. Multiple View Geometry MAPI Computer Vision Multiple View Geometry Geometry o Multiple Views 2- and 3- view geometry p p Kpˆ [ K R t]p Geometry o Multiple Views 2- and 3- view geometry Epipolar Geometry The epipolar geometry

More information

Better than best: matching score based face registration

Better than best: matching score based face registration Better than best: based face registration Luuk Spreeuwers University of Twente Fac. EEMCS, Signals and Systems Group Hogekamp Building, 7522 NB Enschede The Netherlands l.j.spreeuwers@ewi.utwente.nl Bas

More information

Misalignment-Robust Face Recognition

Misalignment-Robust Face Recognition Misalignment-Robust Face Recognition Huan Wang 1 Shuicheng Yan 2 Thomas Huang 3 Jianzhuang Liu 1 Xiaoou Tang 1,4 1 IE, Chinese University 2 ECE, National University 3 ECE, University of Illinois 4 Microsoft

More information

Classification Method for Colored Natural Textures Using Gabor Filtering

Classification Method for Colored Natural Textures Using Gabor Filtering Classiication Method or Colored Natural Textures Using Gabor Filtering Leena Lepistö 1, Iivari Kunttu 1, Jorma Autio 2, and Ari Visa 1, 1 Tampere University o Technology Institute o Signal Processing P.

More information

Texture Features in Facial Image Analysis

Texture Features in Facial Image Analysis Texture Features in Facial Image Analysis Matti Pietikäinen and Abdenour Hadid Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering P.O. Box 4500, FI-90014 University

More information

CS 4495 Computer Vision A. Bobick. CS 4495 Computer Vision. Features 2 SIFT descriptor. Aaron Bobick School of Interactive Computing

CS 4495 Computer Vision A. Bobick. CS 4495 Computer Vision. Features 2 SIFT descriptor. Aaron Bobick School of Interactive Computing CS 4495 Computer Vision Features 2 SIFT descriptor Aaron Bobick School of Interactive Computing Administrivia PS 3: Out due Oct 6 th. Features recap: Goal is to find corresponding locations in two images.

More information

Heat Kernel Based Local Binary Pattern for Face Representation

Heat Kernel Based Local Binary Pattern for Face Representation JOURNAL OF LATEX CLASS FILES 1 Heat Kernel Based Local Binary Pattern for Face Representation Xi Li, Weiming Hu, Zhongfei Zhang, Hanzi Wang Abstract Face classification has recently become a very hot research

More information

Face Recognition Using Vector Quantization Histogram and Support Vector Machine Classifier Rong-sheng LI, Fei-fei LEE *, Yan YAN and Qiu CHEN

Face Recognition Using Vector Quantization Histogram and Support Vector Machine Classifier Rong-sheng LI, Fei-fei LEE *, Yan YAN and Qiu CHEN 2016 International Conference on Artificial Intelligence: Techniques and Applications (AITA 2016) ISBN: 978-1-60595-389-2 Face Recognition Using Vector Quantization Histogram and Support Vector Machine

More information

A GENERIC FACE REPRESENTATION APPROACH FOR LOCAL APPEARANCE BASED FACE VERIFICATION

A GENERIC FACE REPRESENTATION APPROACH FOR LOCAL APPEARANCE BASED FACE VERIFICATION A GENERIC FACE REPRESENTATION APPROACH FOR LOCAL APPEARANCE BASED FACE VERIFICATION Hazim Kemal Ekenel, Rainer Stiefelhagen Interactive Systems Labs, Universität Karlsruhe (TH) 76131 Karlsruhe, Germany

More information

Local features and image matching. Prof. Xin Yang HUST

Local features and image matching. Prof. Xin Yang HUST Local features and image matching Prof. Xin Yang HUST Last time RANSAC for robust geometric transformation estimation Translation, Affine, Homography Image warping Given a 2D transformation T and a source

More information

Face Identification by a Cascade of Rejection Classifiers

Face Identification by a Cascade of Rejection Classifiers Boston U. Computer Science Tech. Report No. BUCS-TR-2005-022, Jun. 2005. To appear in Proc. IEEE Workshop on Face Recognition Grand Challenge Experiments, Jun. 2005. Face Identification by a Cascade of

More information

An efficient face recognition algorithm based on multi-kernel regularization learning

An efficient face recognition algorithm based on multi-kernel regularization learning Acta Technica 61, No. 4A/2016, 75 84 c 2017 Institute of Thermomechanics CAS, v.v.i. An efficient face recognition algorithm based on multi-kernel regularization learning Bi Rongrong 1 Abstract. A novel

More information

Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels

Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels Stan Z. Li, ChunShui Zhao, Meng Ao, Zhen Lei Center for Biometrics and Security Research & National Laboratory of Pattern

More information

Vignette: Reimagining the Analog Photo Album

Vignette: Reimagining the Analog Photo Album Vignette: Reimagining the Analog Photo Album David Eng, Andrew Lim, Pavitra Rengarajan Abstract Although the smartphone has emerged as the most convenient device on which to capture photos, it lacks the

More information

CS485/685 Computer Vision Spring 2012 Dr. George Bebis Programming Assignment 2 Due Date: 3/27/2012

CS485/685 Computer Vision Spring 2012 Dr. George Bebis Programming Assignment 2 Due Date: 3/27/2012 CS8/68 Computer Vision Spring 0 Dr. George Bebis Programming Assignment Due Date: /7/0 In this assignment, you will implement an algorithm or normalizing ace image using SVD. Face normalization is a required

More information

COMBINING SPEEDED-UP ROBUST FEATURES WITH PRINCIPAL COMPONENT ANALYSIS IN FACE RECOGNITION SYSTEM

COMBINING SPEEDED-UP ROBUST FEATURES WITH PRINCIPAL COMPONENT ANALYSIS IN FACE RECOGNITION SYSTEM International Journal of Innovative Computing, Information and Control ICIC International c 2012 ISSN 1349-4198 Volume 8, Number 12, December 2012 pp. 8545 8556 COMBINING SPEEDED-UP ROBUST FEATURES WITH

More information

Probabilistic Elastic Matching for Pose Variant Face Verification

Probabilistic Elastic Matching for Pose Variant Face Verification Probabilistic Elastic Matching for Pose Variant Face Verification Haoxiang Li, Gang Hua Stevens Institute of Technology Hoboken, NJ 07030 {hli18, ghua}@stevens.edu Zhe Lin, Jonathan Brandt, Jianchao Yang

More information

Dynamic Local Ternary Pattern for Face Recognition and Verification

Dynamic Local Ternary Pattern for Face Recognition and Verification Dynamic Local Ternary Pattern for Face Recognition and Verification Mohammad Ibrahim, Md. Iftekharul Alam Efat, Humayun Kayesh Shamol, Shah Mostafa Khaled, Mohammad Shoyaib Institute of Information Technology

More information

The Analysis of Parameters t and k of LPP on Several Famous Face Databases

The Analysis of Parameters t and k of LPP on Several Famous Face Databases The Analysis of Parameters t and k of LPP on Several Famous Face Databases Sujing Wang, Na Zhang, Mingfang Sun, and Chunguang Zhou College of Computer Science and Technology, Jilin University, Changchun

More information

Small Sample Size Face Recognition using Random Quad-Tree based Ensemble Algorithm

Small Sample Size Face Recognition using Random Quad-Tree based Ensemble Algorithm Small Sample Size Face Recognition using Random Quad-Tree based Ensemble Algorithm Cuicui Zhang, Xuefeng Liang, Takashi Matsuyama Graduate School of Informatics, Kyoto University, Kyoto 606-8501, Japan

More information

Face Detection and Recognition in an Image Sequence using Eigenedginess

Face Detection and Recognition in an Image Sequence using Eigenedginess Face Detection and Recognition in an Image Sequence using Eigenedginess B S Venkatesh, S Palanivel and B Yegnanarayana Department of Computer Science and Engineering. Indian Institute of Technology, Madras

More information

ROBUST PARTIAL FACE RECOGNITION USING INSTANCE-TO-CLASS DISTANCE

ROBUST PARTIAL FACE RECOGNITION USING INSTANCE-TO-CLASS DISTANCE ROBUST PARTIAL FACE RECOGNITION USING INSTANCE-TO-CLASS DISTANCE Junlin Hu 1, Jiwen Lu 2, and Yap-Peng Tan 1 1 School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore

More information

Local Gradient Order Pattern for Face Representation and Recognition

Local Gradient Order Pattern for Face Representation and Recognition Local Gradient Order Pattern for Face Representation and Recognition Zhen Lei, Dong Yi, and Stan Z. Li Center for Biometrics and Security Research & National Laboratory of Pattern Recognition, Institute

More information

Selection of Scale-Invariant Parts for Object Class Recognition

Selection of Scale-Invariant Parts for Object Class Recognition Selection of Scale-Invariant Parts for Object Class Recognition Gy. Dorkó and C. Schmid INRIA Rhône-Alpes, GRAVIR-CNRS 655, av. de l Europe, 3833 Montbonnot, France fdorko,schmidg@inrialpes.fr Abstract

More information

Face detection and recognition. Detection Recognition Sally

Face detection and recognition. Detection Recognition Sally Face detection and recognition Detection Recognition Sally Face detection & recognition Viola & Jones detector Available in open CV Face recognition Eigenfaces for face recognition Metric learning identification

More information

Learning Visual Semantics: Models, Massive Computation, and Innovative Applications

Learning Visual Semantics: Models, Massive Computation, and Innovative Applications Learning Visual Semantics: Models, Massive Computation, and Innovative Applications Part II: Visual Features and Representations Liangliang Cao, IBM Watson Research Center Evolvement of Visual Features

More information

Distribution Fields with Adaptive Kernels for Large Displacement Image Alignment

Distribution Fields with Adaptive Kernels for Large Displacement Image Alignment MEARS et al.: DISTRIBUTION FIELDS WITH ADAPTIVE KERNELS 1 Distribution Fields with Adaptive Kernels or Large Displacement Image Alignment Benjamin Mears bmears@cs.umass.edu Laura Sevilla Lara bmears@cs.umass.edu

More information

Feature-Aging for Age-Invariant Face Recognition

Feature-Aging for Age-Invariant Face Recognition Feature-Aging for Age-Invariant Face Recognition Huiling Zhou, Kwok-Wai Wong, and Kin-Man Lam, Centre for Signal Processing, Department of Electronic and Information Engineering, The Hong Kong Polytechnic

More information

Hybrid Deep Learning for Face Verification

Hybrid Deep Learning for Face Verification 2013 IEEE International Conference on Computer Vision Hybrid Deep Learning for Face Verification Yi Sun 1 Xiaogang Wang 2,3 Xiaoou Tang 1,3 1 Department of Information Engineering, The Chinese University

More information

Large-scale Datasets: Faces with Partial Occlusions and Pose Variations in the Wild

Large-scale Datasets: Faces with Partial Occlusions and Pose Variations in the Wild Large-scale Datasets: Faces with Partial Occlusions and Pose Variations in the Wild Tarik Alafif, Zeyad Hailat, Melih Aslan and Xuewen Chen Computer Science Department, Wayne State University Detroit,

More information

Subject-Oriented Image Classification based on Face Detection and Recognition

Subject-Oriented Image Classification based on Face Detection and Recognition 000 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050

More information

A Cylindrical Surface Model to Rectify the Bound Document Image

A Cylindrical Surface Model to Rectify the Bound Document Image A Cylindrical Surace Model to Rectiy the Bound Document Image Huaigu Cao, Xiaoqing Ding, Changsong Liu Department o Electronic Engineering, Tsinghua University State Key Laboratory o Intelligent Technology

More information

Image-Based Face Recognition using Global Features

Image-Based Face Recognition using Global Features Image-Based Face Recognition using Global Features Xiaoyin xu Research Centre for Integrated Microsystems Electrical and Computer Engineering University of Windsor Supervisors: Dr. Ahmadi May 13, 2005

More information

SIFT - scale-invariant feature transform Konrad Schindler

SIFT - scale-invariant feature transform Konrad Schindler SIFT - scale-invariant feature transform Konrad Schindler Institute of Geodesy and Photogrammetry Invariant interest points Goal match points between images with very different scale, orientation, projective

More information

Face Recognition Under varying Lighting Conditions and Noise Using Texture Based and SIFT Feature Sets

Face Recognition Under varying Lighting Conditions and Noise Using Texture Based and SIFT Feature Sets IJCST Vo l. 3, Is s u e 4, Oc t - De c 2012 ISSN : 0976-8491 (Online) ISSN : 2229-4333 (Print) Face Recognition Under varying Lighting Conditions and Noise Using Texture Based and SIFT Feature Sets 1 Vishnupriya.

More information

Image Processing. Image Features

Image Processing. Image Features Image Processing Image Features Preliminaries 2 What are Image Features? Anything. What they are used for? Some statements about image fragments (patches) recognition Search for similar patches matching

More information

Local features: detection and description. Local invariant features

Local features: detection and description. Local invariant features Local features: detection and description Local invariant features Detection of interest points Harris corner detection Scale invariant blob detection: LoG Description of local patches SIFT : Histograms

More information

Head Frontal-View Identification Using Extended LLE

Head Frontal-View Identification Using Extended LLE Head Frontal-View Identification Using Extended LLE Chao Wang Center for Spoken Language Understanding, Oregon Health and Science University Abstract Automatic head frontal-view identification is challenging

More information

Image Based Feature Extraction Technique For Multiple Face Detection and Recognition in Color Images

Image Based Feature Extraction Technique For Multiple Face Detection and Recognition in Color Images Image Based Feature Extraction Technique For Multiple Face Detection and Recognition in Color Images 1 Anusha Nandigam, 2 A.N. Lakshmipathi 1 Dept. of CSE, Sir C R Reddy College of Engineering, Eluru,

More information

A Hierarchical Face Identification System Based on Facial Components

A Hierarchical Face Identification System Based on Facial Components A Hierarchical Face Identification System Based on Facial Components Mehrtash T. Harandi, Majid Nili Ahmadabadi, and Babak N. Araabi Control and Intelligent Processing Center of Excellence Department of

More information

The SIFT (Scale Invariant Feature

The SIFT (Scale Invariant Feature The SIFT (Scale Invariant Feature Transform) Detector and Descriptor developed by David Lowe University of British Columbia Initial paper ICCV 1999 Newer journal paper IJCV 2004 Review: Matt Brown s Canonical

More information

Intensity-Depth Face Alignment Using Cascade Shape Regression

Intensity-Depth Face Alignment Using Cascade Shape Regression Intensity-Depth Face Alignment Using Cascade Shape Regression Yang Cao 1 and Bao-Liang Lu 1,2 1 Center for Brain-like Computing and Machine Intelligence Department of Computer Science and Engineering Shanghai

More information

Face Recognition Using SIFT- PCA Feature Extraction and SVM Classifier

Face Recognition Using SIFT- PCA Feature Extraction and SVM Classifier IOSR Journal of VLSI and Signal Processing (IOSR-JVSP) Volume 5, Issue 2, Ver. II (Mar. - Apr. 2015), PP 31-35 e-issn: 2319 4200, p-issn No. : 2319 4197 www.iosrjournals.org Face Recognition Using SIFT-

More information

Local Similarity based Linear Discriminant Analysis for Face Recognition with Single Sample per Person

Local Similarity based Linear Discriminant Analysis for Face Recognition with Single Sample per Person Local Similarity based Linear Discriminant Analysis for Face Recognition with Single Sample per Person Fan Liu 1, Ye Bi 1, Yan Cui 2, Zhenmin Tang 1 1 School of Computer Science and Engineering, Nanjing

More information

Robust Face Recognition via Sparse Representation

Robust Face Recognition via Sparse Representation Robust Face Recognition via Sparse Representation Panqu Wang Department of Electrical and Computer Engineering University of California, San Diego La Jolla, CA 92092 pawang@ucsd.edu Can Xu Department of

More information

IMPROVED FACE RECOGNITION USING ICP TECHNIQUES INCAMERA SURVEILLANCE SYSTEMS. Kirthiga, M.E-Communication system, PREC, Thanjavur

IMPROVED FACE RECOGNITION USING ICP TECHNIQUES INCAMERA SURVEILLANCE SYSTEMS. Kirthiga, M.E-Communication system, PREC, Thanjavur IMPROVED FACE RECOGNITION USING ICP TECHNIQUES INCAMERA SURVEILLANCE SYSTEMS Kirthiga, M.E-Communication system, PREC, Thanjavur R.Kannan,Assistant professor,prec Abstract: Face Recognition is important

More information

Recognition of Animal Skin Texture Attributes in the Wild. Amey Dharwadker (aap2174) Kai Zhang (kz2213)

Recognition of Animal Skin Texture Attributes in the Wild. Amey Dharwadker (aap2174) Kai Zhang (kz2213) Recognition of Animal Skin Texture Attributes in the Wild Amey Dharwadker (aap2174) Kai Zhang (kz2213) Motivation Patterns and textures are have an important role in object description and understanding

More information

LOCAL APPEARANCE BASED FACE RECOGNITION USING DISCRETE COSINE TRANSFORM

LOCAL APPEARANCE BASED FACE RECOGNITION USING DISCRETE COSINE TRANSFORM LOCAL APPEARANCE BASED FACE RECOGNITION USING DISCRETE COSINE TRANSFORM Hazim Kemal Ekenel, Rainer Stiefelhagen Interactive Systems Labs, University of Karlsruhe Am Fasanengarten 5, 76131, Karlsruhe, Germany

More information

Local invariant features

Local invariant features Local invariant features Tuesday, Oct 28 Kristen Grauman UT-Austin Today Some more Pset 2 results Pset 2 returned, pick up solutions Pset 3 is posted, due 11/11 Local invariant features Detection of interest

More information

Multiple Kernel Learning for Emotion Recognition in the Wild

Multiple Kernel Learning for Emotion Recognition in the Wild Multiple Kernel Learning for Emotion Recognition in the Wild Karan Sikka, Karmen Dykstra, Suchitra Sathyanarayana, Gwen Littlewort and Marian S. Bartlett Machine Perception Laboratory UCSD EmotiW Challenge,

More information

Discriminative classifiers for image recognition

Discriminative classifiers for image recognition Discriminative classifiers for image recognition May 26 th, 2015 Yong Jae Lee UC Davis Outline Last time: window-based generic object detection basic pipeline face detection with boosting as case study

More information

Face Recognition with Local Line Binary Pattern

Face Recognition with Local Line Binary Pattern 2009 Fifth International Conference on Image and Graphics Face Recognition with Local Line Binary Pattern Amnart Petpon and Sanun Srisuk Department of Computer Engineering, Mahanakorn University of Technology

More information

Outline 7/2/201011/6/

Outline 7/2/201011/6/ Outline Pattern recognition in computer vision Background on the development of SIFT SIFT algorithm and some of its variations Computational considerations (SURF) Potential improvement Summary 01 2 Pattern

More information

Linear Discriminant Analysis for 3D Face Recognition System

Linear Discriminant Analysis for 3D Face Recognition System Linear Discriminant Analysis for 3D Face Recognition System 3.1 Introduction Face recognition and verification have been at the top of the research agenda of the computer vision community in recent times.

More information

Face Recognition Using Phase-Based Correspondence Matching

Face Recognition Using Phase-Based Correspondence Matching Face Recognition Using Phase-Based Correspondence Matching Koichi Ito Takafumi Aoki Graduate School of Information Sciences, Tohoku University, 6-6-5, Aramaki Aza Aoba, Sendai-shi, 98 8579 Japan ito@aoki.ecei.tohoku.ac.jp

More information

Face Recognition Based On Granular Computing Approach and Hybrid Spatial Features

Face Recognition Based On Granular Computing Approach and Hybrid Spatial Features Face Recognition Based On Granular Computing Approach and Hybrid Spatial Features S.Sankara vadivu 1, K. Aravind Kumar 2 Final Year Student of M.E, Department of Computer Science and Engineering, Manonmaniam

More information

A Real Time Facial Expression Classification System Using Local Binary Patterns

A Real Time Facial Expression Classification System Using Local Binary Patterns A Real Time Facial Expression Classification System Using Local Binary Patterns S L Happy, Anjith George, and Aurobinda Routray Department of Electrical Engineering, IIT Kharagpur, India Abstract Facial

More information

IMAGE RETRIEVAL USING VLAD WITH MULTIPLE FEATURES

IMAGE RETRIEVAL USING VLAD WITH MULTIPLE FEATURES IMAGE RETRIEVAL USING VLAD WITH MULTIPLE FEATURES Pin-Syuan Huang, Jing-Yi Tsai, Yu-Fang Wang, and Chun-Yi Tsai Department of Computer Science and Information Engineering, National Taitung University,

More information

Combining Gabor Features: Summing vs.voting in Human Face Recognition *

Combining Gabor Features: Summing vs.voting in Human Face Recognition * Combining Gabor Features: Summing vs.voting in Human Face Recognition * Xiaoyan Mu and Mohamad H. Hassoun Department of Electrical and Computer Engineering Wayne State University Detroit, MI 4822 muxiaoyan@wayne.edu

More information

Weight-optimal Local Binary Patterns

Weight-optimal Local Binary Patterns Weight-optimal Local Binary Patterns Felix Juefei-Xu and Marios Savvides Carnegie Mellon University Abstract. In this work, we have proposed a learning paradigm for obtaining weight-optimal local binary

More information

Restricted Nearest Feature Line with Ellipse for Face Recognition

Restricted Nearest Feature Line with Ellipse for Face Recognition Journal of Information Hiding and Multimedia Signal Processing c 2012 ISSN 2073-4212 Ubiquitous International Volume 3, Number 3, July 2012 Restricted Nearest Feature Line with Ellipse for Face Recognition

More information

Video Google faces. Josef Sivic, Mark Everingham, Andrew Zisserman. Visual Geometry Group University of Oxford

Video Google faces. Josef Sivic, Mark Everingham, Andrew Zisserman. Visual Geometry Group University of Oxford Video Google faces Josef Sivic, Mark Everingham, Andrew Zisserman Visual Geometry Group University of Oxford The objective Retrieve all shots in a video, e.g. a feature length film, containing a particular

More information

FACE RECOGNITION USING SUPPORT VECTOR MACHINES

FACE RECOGNITION USING SUPPORT VECTOR MACHINES FACE RECOGNITION USING SUPPORT VECTOR MACHINES Ashwin Swaminathan ashwins@umd.edu ENEE633: Statistical and Neural Pattern Recognition Instructor : Prof. Rama Chellappa Project 2, Part (b) 1. INTRODUCTION

More information

Appearance Manifold of Facial Expression

Appearance Manifold of Facial Expression Appearance Manifold of Facial Expression Caifeng Shan, Shaogang Gong and Peter W. McOwan Department of Computer Science Queen Mary, University of London, London E1 4NS, UK {cfshan, sgg, pmco}@dcs.qmul.ac.uk

More information

Disguised Face Identification (DFI) with Facial KeyPoints using Spatial Fusion Convolutional Network. Nathan Sun CIS601

Disguised Face Identification (DFI) with Facial KeyPoints using Spatial Fusion Convolutional Network. Nathan Sun CIS601 Disguised Face Identification (DFI) with Facial KeyPoints using Spatial Fusion Convolutional Network Nathan Sun CIS601 Introduction Face ID is complicated by alterations to an individual s appearance Beard,

More information

Aggregating Descriptors with Local Gaussian Metrics

Aggregating Descriptors with Local Gaussian Metrics Aggregating Descriptors with Local Gaussian Metrics Hideki Nakayama Grad. School of Information Science and Technology The University of Tokyo Tokyo, JAPAN nakayama@ci.i.u-tokyo.ac.jp Abstract Recently,

More information

Human Face Recognition Using Weighted Vote of Gabor Magnitude Filters

Human Face Recognition Using Weighted Vote of Gabor Magnitude Filters Human Face Recognition Using Weighted Vote of Gabor Magnitude Filters Iqbal Nouyed, Graduate Student member IEEE, M. Ashraful Amin, Member IEEE, Bruce Poon, Senior Member IEEE, Hong Yan, Fellow IEEE Abstract

More information

Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma

Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma Presented by Hu Han Jan. 30 2014 For CSE 902 by Prof. Anil K. Jain: Selected

More information

Textured 3D Face Recognition using Biological Vision-based Facial Representation and Optimized Weighted Sum Fusion

Textured 3D Face Recognition using Biological Vision-based Facial Representation and Optimized Weighted Sum Fusion Textured 3D Face Recognition using Biological Vision-based Facial Representation and Optimized Weighted Sum Fusion Di Huang 1, Wael Ben Soltana 1, Mohsen Ardabilian 1, Yunhong Wang 2, and Liming Chen 1

More information

on learned visual embedding patrick pérez Allegro Workshop Inria Rhônes-Alpes 22 July 2015

on learned visual embedding patrick pérez Allegro Workshop Inria Rhônes-Alpes 22 July 2015 on learned visual embedding patrick pérez Allegro Workshop Inria Rhônes-Alpes 22 July 2015 Vector visual representation Fixed-size image representation High-dim (100 100,000) Generic, unsupervised: BoW,

More information

A Novel Method of Face Recognition Using Lbp, Ltp And Gabor Features

A Novel Method of Face Recognition Using Lbp, Ltp And Gabor Features A Novel Method of Face Recognition Using Lbp, Ltp And Gabor Features Koneru. Anuradha, Manoj Kumar Tyagi Abstract:- Face recognition has received a great deal of attention from the scientific and industrial

More information

A NOVEL APPROACH TO ACCESS CONTROL BASED ON FACE RECOGNITION

A NOVEL APPROACH TO ACCESS CONTROL BASED ON FACE RECOGNITION A NOVEL APPROACH TO ACCESS CONTROL BASED ON FACE RECOGNITION A. Hadid, M. Heikkilä, T. Ahonen, and M. Pietikäinen Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering

More information

Dimension Reduction CS534

Dimension Reduction CS534 Dimension Reduction CS534 Why dimension reduction? High dimensionality large number of features E.g., documents represented by thousands of words, millions of bigrams Images represented by thousands of

More information

A New Multi Fractal Dimension Method for Face Recognition with Fewer Features under Expression Variations

A New Multi Fractal Dimension Method for Face Recognition with Fewer Features under Expression Variations A New Multi Fractal Dimension Method for Face Recognition with Fewer Features under Expression Variations Maksud Ahamad Assistant Professor, Computer Science & Engineering Department, Ideal Institute of

More information

Illumination invariant face recognition and impostor rejection using different MINACE filter algorithms

Illumination invariant face recognition and impostor rejection using different MINACE filter algorithms Illumination invariant face recognition and impostor rejection using different MINACE filter algorithms Rohit Patnaik and David Casasent Dept. of Electrical and Computer Engineering, Carnegie Mellon University,

More information

A comparative study of Four Neighbour Binary Patterns in Face Recognition

A comparative study of Four Neighbour Binary Patterns in Face Recognition A comparative study of Four Neighbour Binary Patterns in Face Recognition A. Geetha, 2 Y. Jacob Vetha Raj,2 Department of Computer Applications, Nesamony Memorial Christian College,Manonmaniam Sundaranar

More information

SUPER RESOLUTION IMAGE BY EDGE-CONSTRAINED CURVE FITTING IN THE THRESHOLD DECOMPOSITION DOMAIN

SUPER RESOLUTION IMAGE BY EDGE-CONSTRAINED CURVE FITTING IN THE THRESHOLD DECOMPOSITION DOMAIN SUPER RESOLUTION IMAGE BY EDGE-CONSTRAINED CURVE FITTING IN THE THRESHOLD DECOMPOSITION DOMAIN Tsz Chun Ho and Bing Zeng Department o Electronic and Computer Engineering The Hong Kong University o Science

More information

arxiv: v3 [cs.cv] 3 Oct 2012

arxiv: v3 [cs.cv] 3 Oct 2012 Combined Descriptors in Spatial Pyramid Domain for Image Classification Junlin Hu and Ping Guo arxiv:1210.0386v3 [cs.cv] 3 Oct 2012 Image Processing and Pattern Recognition Laboratory Beijing Normal University,

More information

Evaluation and comparison of interest points/regions

Evaluation and comparison of interest points/regions Introduction Evaluation and comparison of interest points/regions Quantitative evaluation of interest point/region detectors points / regions at the same relative location and area Repeatability rate :

More information

Preprocessing and Feature Sets for Robust Face Recognition

Preprocessing and Feature Sets for Robust Face Recognition Preprocessing and Feature Sets for Robust Face Recognition Xiaoyang Tan and Bill Triggs LJK-INRIA, 655 avenue de l Europe, Montbonnot 38330, France Xiaoyang.Tan@inria.fr, Bill.Triggs@imag.fr Abstract Many

More information

Performance Evaluation of Scale-Interpolated Hessian-Laplace and Haar Descriptors for Feature Matching

Performance Evaluation of Scale-Interpolated Hessian-Laplace and Haar Descriptors for Feature Matching Performance Evaluation of Scale-Interpolated Hessian-Laplace and Haar Descriptors for Feature Matching Akshay Bhatia, Robert Laganière School of Information Technology and Engineering University of Ottawa

More information

Sparse Variation Dictionary Learning for Face Recognition with A Single Training Sample Per Person

Sparse Variation Dictionary Learning for Face Recognition with A Single Training Sample Per Person Sparse Variation Dictionary Learning for Face Recognition with A Single Training Sample Per Person Meng Yang, Luc Van Gool ETH Zurich Switzerland {yang,vangool}@vision.ee.ethz.ch Lei Zhang The Hong Kong

More information

Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions

Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions Xiaoyang Tan and Bill Triggs INRIA & Laboratoire Jean Kuntzmann, 655 avenue de l Europe, Montbonnot 38330, France

More information

FACE DETECTION USING LOCAL HYBRID PATTERNS. Chulhee Yun, Donghoon Lee, and Chang D. Yoo

FACE DETECTION USING LOCAL HYBRID PATTERNS. Chulhee Yun, Donghoon Lee, and Chang D. Yoo FACE DETECTION USING LOCAL HYBRID PATTERNS Chulhee Yun, Donghoon Lee, and Chang D. Yoo Department of Electrical Engineering, Korea Advanced Institute of Science and Technology chyun90@kaist.ac.kr, iamdh@kaist.ac.kr,

More information

Neighbourhood Operations

Neighbourhood Operations Neighbourhood Operations Neighbourhood operations simply operate on a larger neighbourhood o piels than point operations Origin Neighbourhoods are mostly a rectangle around a central piel Any size rectangle

More information

A New Gabor Phase Difference Pattern for Face and Ear Recognition

A New Gabor Phase Difference Pattern for Face and Ear Recognition A New Gabor Phase Difference Pattern for Face and Ear Recognition Yimo Guo 1,, Guoying Zhao 1, Jie Chen 1, Matti Pietikäinen 1 and Zhengguang Xu 1 Machine Vision Group, Department of Electrical and Information

More information

Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor

Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor Author Zhang, Baochang, Gao, Yongsheng, Zhao, Sanqiang, Liu, Jianzhuang Published 2010 Journal

More information

Automatic Video Segmentation for Czech TV Broadcast Transcription

Automatic Video Segmentation for Czech TV Broadcast Transcription Automatic Video Segmentation or Czech TV Broadcast Transcription Jose Chaloupka Laboratory o Computer Speech Processing, Institute o Inormation Technology and Electronics Technical University o Liberec

More information

A Survey on Face-Sketch Matching Techniques

A Survey on Face-Sketch Matching Techniques A Survey on Face-Sketch Matching Techniques Reshma C Mohan 1, M. Jayamohan 2, Arya Raj S 3 1 Department of Computer Science, SBCEW 2 Department of Computer Science, College of Applied Science 3 Department

More information