Human Face Recognition Using Generalized. Kernel Fisher Discriminant
|
|
- Eleanore Black
- 5 years ago
- Views:
Transcription
1 Human Face Recognton Usng Generalzed Kernel Fsher Dscrmnant ng-yu Sun,2 De-Shuang Huang Ln Guo. Insttute of Intellgent Machnes, Chnese Academy of Scences, P.O.ox 30, Hefe, Anhu, Chna. 2. Department of Automaton, Unversty of Scence and echnology of Chna Emals: Abstract- In ths paper the generalzed kernel fsher dscrmnant (GKFD) method s used to do pattern feature extracton and recognton for human face mage. Frst, we extend the KFD orgnally used n pattern classfcaton problems to the generalzed KFD (GKFD), whch wll be used n feature extracton problems. Compared to several commonly used feature extracton methods, the GKFD can not only reduce the dmenson of nput pattern, but also provde the useful nformaton for pattern classfcaton. Further, ths GKFD also performs well for lnearly nonseparable pattern classfcaton problems for t possesses a nonlnear transformaton capablty. Fnally, the expermental results on human face recognton problems demonstrate the effectveness and effcency of our approach. Introducton In classfcaton and other data analytc tasks t s often necessary to perform pre-processng on the data before applyng the algorthm at hand. he most common pre-processng method s to extract features from problems nvolved so that the tasks are easly resolved. Feature extracton for classfcaton dffers sgnfcantly from feature extracton for descrbng data. For example, Prncpal component analyss (PCA) s to fnd drectons [6][7] that have mnmal reconstructon error by descrbng as much varance of the data as possble wth m orthogonal drectons whle Fsher Lnear Dscrmnant (FLD) [4] s to choose proectons that dfferent classes of patterns are well separated. So, the FLD can provde the useful nformaton for classfcaton whle the PCA s mostly used to perform the dmenson reducton. It should be noted that the FLD s only a lnear transformaton, whch maxmzes the rato of the determnant of the between-class scatter matrx of the proected samples to the determnant of the wthn-class scatter matrx of the proected samples. As a result, the FLD method s of globally optmal performance only for lnear separable problems. Hence, to overcome ths drawback for the FLD, a kernel dea, whch was orgnally appled n Support Vector Machnes (SVMs) [], can be used to construct a new kernel based FLD. Consequently, ths method s also referred to as kernel fsher dscrmnant (KFD). In fact, the KFD has been successfully used n pattern recognton problems, but t can only solve those problems wth two classes. For more detals, please refer to [2][3]. In ths paper we wll extend the KFD to do feature extracton for multple classes of problems. hus, the method s also named as generalzed KFD (GKFD). hose features obtaned by ths GKFD are drectly classfed by the nearest neghbor method. In ths paper, we take the human face recognton data for example to conduct the 466
2 related experments. he expermental results verfy the effectveness and effcency of our proposed GKFD. 2 A Novel Method for Feature Extracton ased on Generalzed Kernel Fsher Dscrmnant Input space Feature space for performng the feature extracton of multclass pattern recognton problems. Consderng a set of n sample vectors{ x,x,,x}, assume that each vector 2 n belongs to one of c classes{ X, X,, X }. o 2 derve the GKFD, we frst map the data { x,x,,x} 2 n by, a non-lnear mappng, nto c feature space F. hen n F, the optmal subspace, opt, that we wll fnd, s determned as fellow: Fg he sketch of the man dea of the KFD. y usng a kernel functon, the orgnal nonlnear separable data n nput space becomes lnear separable n feature space. As we have ponted out n Secton, the FLD s only a lnear transformaton, and t s of globally optmal performance only for lnear separable data. ut for most real-world data they are lnearly nonseparable, or nonlnearly separable. o overcome ths lmtaton, the KFD method s proposed [2]. he man dea of the KFD, whch has been proved powerful n pattern recognton problems, s to address the problem of the FLD n a kernel feature space, thereby yeldng a nonlnear dscrmnant n nput space (as shown n Fg ). For a set of orgnal nonlnear separable data, the kernel method [] can guarantee to make nonlnear data become lnear separable f ths data s mapped to a feature space by a kernel functon. th ths dea the KFD ams at resolvng a bnary classfcaton problem that frst proects all the data to the optmal proecton vector found by KFD, and then classfes these data accordng to ther proecton values. ut for a multclass classfcaton problem, only one proecton vector s not enough, so n ths secton we wll extend the KFD to the generalzed KFD (GKFD) opt where S = arg max = [ w, w2,, w ] m () S S and S are the correspondng between-class scatter and wthn-class scatter matrces n F,.e., S c ( µ µ )( µ µ = ) = c ( ( ) µ )( ( ) µ = ) k k = xk X µ = ( x ) k, µ = n x N k X n = w wth S n (2) x x (3) ( x ). Each n eqn.() can be computed by solvng the followng generalzed egenvalue problems: S w = λ S w (4) From the theory of reproducng kernels we know that any soluton w F must be n the spannng space of the mapped data,.e., w span{ ( x), ( x2),..., ( x n)}, whch can be wrtten as = n α x = w ( ) (5) Usng ths expanson, the numerator of eqn.() can be rewrtten as: where w S w = α Mα (6) 467
3 c M = ( M M)( M M) (7) = ( x ) ( x ) = k( x, x ) (8) α = α α α (9) [, 2,..., n ] In eqn. (7) we have defned as ( M) = k( x, x k) (0) n x M = n k X n = k( x, x ) () Now, consderng the denomnator of eqn.(), and usng smlar transformaton, we have: where c = w S w = α Lα (2) w L = K ( I N ) K ; K s an matrx wth ( K ) = k( x, x ), x X nm n m the dentty matrx and n entres n. m n n ; I s the matrx wth all Combnng eqn.(6) and eqn.(2), the optmal subspace, opt, can be determned by followng formula: α Mα αopt = arg max = [ α, α2,, αm ] (3) α α Lα and the followng eqn.(4). o extract the features of a new pattern x wth the GKFD, we smply proect the mapped pattern ( x ) onto ths subspace, and the result s descrbed n eqn.(5). From the above analyses, we can obtan several conclusons as stated n the followng remarks: Remarks: ) From the expresson of S, we can see that assumng the dmenson of the mapped space s r, then, rank( S ) mn( r, c ). As lterature [3] has outlned, the dmenson of the feature space s equal to or hgher than the number, n, of tranng samples, whch makes the regularzaton necessary. Accordngly, there are at most c- generalzed egenvectors correspondng to nonzero egenvalues. In other words, the GKFD can transform the new pattern x to a vector wth the dmenson of c-. 2) Also t can be found that the relaton, rank( S ) mn( r, n ), holds. Due to r > n, so rank( L) = rank( S ) n. Obvously, the matrx L s a sngular one. o overcome ths problem, we can use the same method as n [2][3], add a multple of the dentty matrx to L: Lµ = L+ µ I. (6) 3) A very mportant problem of the GKFD s how to select the kernel functons and ther parameters snce dfferent kernel functons wll has dfferent effects on the performance of the problems nvolved. So far, however, how to select the kernel functon s stll open. Usually the canddates of optmal kernel functons are determned by usng some heurstc rules, where the one that mnmzes a gven crteron s chosen. A most commonly used method s cross n n n opt = [ w, w2,, wm ] = α( x ), α2( x ),, αm( xm ) (4) = = = n n n ( x) opt = α( x ) ( x), α2( x ) ( x),, αm( xm ) ( x ) = = = n n n = αk( x x), α2k( x x),, αmk( xm x ) (5) = = = 468
4 valdaton method,.e., the tranng samples are dvded nto k subsets, each of whch has the same number of samples. hen the performance of each canddate s evaluated k-tmes. In the -th ( =,2,..., k ) teraton, the data except for the -th one s used to conduct the tranng phase whle the -th one s used to conduct the testng phase. At last, the canddate that acheves the best performance s selected. he extreme case that k s equal to the number of samples s called leave-one-out cross valdaton. paper the nearest neghbor method s selected as the effcent classfer for human face mage. 4 Experment Results o verfy the effectveness and effcency of our approach, n the followng we wll present the related expermental results for human face mage recognton.. 3 Human Face Image Recognton ased on the Nearest Neghbor Method Perhaps the smplest classfcaton scheme s the nearest neghbor classfer (NNC) n the mage classfcaton. Under ths scheme, an mage n the test set s recognzed by assgnng to t the label of the closest pont n the tranng set, where the dstance s measured n the mage space. If all the mages are normalzed to have zero mean and unt varance, then ths procedure s equvalent to choosng the mage n the tranng set that best correlates wth the test mage. In fact, because of the normalzaton process, the normalzed mages are ndependent of lght source ntensty. ut ths NNC procedure has two well-known dsadvantages. Frst, f the mage n the tranng set and the test set are gathered under varyng lghtng condtons, then the correspondng ponts n the mage space may not be tghtly clustered. Second, ths NNC procedure s also computatonally expensve. However, our proposed GKFD can overcome these drawbacks, thus, the nearest neghbor methods can work effcently as a classfer after feature extracton by GKFD. he reason s that on the one hand, the mage from the same class set can gather tghtly after GKFD transform; on the other hand, the dmenson of the transformed sample ponts s sgnfcantly reduced. So n ths Fg 2 Example mages from one subect n ORL database Our experments were performed usng ORL database. hs database ncludes 400 dfferent mages of 40 dstnct subects (ten ones per person), respectvely. For some of the subects, the mages were taken at dfferent tme. Moreover, there are varatons n facal expresson, e.g., open/closed eyes, smlng/nonsmlng, and facal detals, e.g., glasses/no glasses, etc. Fg 2 shows ten mages of a subect. he orgnal face mages were all szed nto 92 2 wth a 256-level gray scale. Frst the face mages are preprocessed by twce dscrete wavelet transformaton. he sze of each mage s reduced to As a result, the computatonal complexty further decreases. he experments were performed wth fve tranng mages and fve test mages per person, thus a total of 200 tranng mages and 200 test mages are formed. Assume that there exsts no overlappng between the tranng and test sets. Snce the recognton performance s affected by the selecton of the tranng mages, the reported results were obtaned by tranng 20 recognzers wth dfferent tranng examples that are formed by randomly selectng fve ones from ten mages 469
5 per subect. he reported classfcaton error has been averaged over all 20 expermental results. In our experments the Radal ass Functon of Gaussan form: 2 (, 2) = exp( 2 σ ) k x x x x (7) s used as kernel functon and the correspondng parameter s selected through leave-one-out method. (a) proposed approach, here we use the nearest neghbor method to perform the classfcaton on the features extracted from the ORL database by the GKFD. Fg 4 shows the plot of the error rates vs. the change of dmenson for four feature extracton methods of PCA, GKFD, PCA+FLD and PCA+GKFD. From ths fgure we can fnd that the error rate of the GKFD s the smallest among the four methods. Note that the FLD can not be appled on the orgnal data drectly for t can only process the data wth the dmenson lower than n-c, so the PCA has to be used before the FLD. able also shows the comparsons of the smallest error rate vs the reduced dmenson for four feature extracton methods. From ths table t can be found that the GKFD can get better performance for lnearly nonseparable pattern recognton problems able Performance comparson of four feature extracton methods Reduced Methods Error Rate (%) dmenson PCA FLD PCA+GKFD GKFD (b) Fg 3 he data dstrbuton of 3 components for 3 subects after (a) PCA and (b) GKFD PCA+FLD PCA gkfd GKFD PCA+gKFD PCA+GKFD In order to vsualze the dstrbuton of human face mage samples, we take 3 components correspondng to the frst 3 largest egenvalues of the PCA and the GKFD to draw the 3-dmensonal topology. From Fg 3 we can fnd that the orgnally overlapped data can be more easly classfed after feature extracton by the GKFD whle the 3 components for the PCA are somewhat overlapped. In order to further test the performance of our So called the classfcaton error s meant the percentage of samples erroneously labeled. R ate Er o r Number of Dmenson Fg 4 the error rate curves vs the change of dmenson for four methods of PCA, FLD, GKFD and PCA+GKFD Note that n the testng case the error rate of the PCA+GKFD s hgher than that of the GKFD. he reason possbly s that the data after PCA 470
6 transformaton have lost some features of the orgnal data. In addton, able 2 also gves a summary of the performance comparsons of fve classfcaton systems for recognzng the data from the ORL database. he correspondng error rates are the averages of 20 smulatons. However, the ndvdual smulaton of the GKFD n experment sometmes shows that the error rate s as low as 0.5%. In concluson, the above expermental results show that the GKFD plus the nearest neghbor method can effcently solve those nonlnearly separable pattern recognton problems wth multple classes compared to other tradtonal methods. able 2 Performance comparson of fve classfcaton systems Systems Error rate (%) Egnfaces[8] 0.0 Pesudo-2DHMM[8] 5.0 Probablstc decson-based neural network[9] 4.0 Lnear SVMs[0] 3.0 GKFD+NN Conclusons In ths paper we extended the KFD, orgnally used as classfers, to the feature extracton felds. he correspondng performance was verfed by the human face mage data from the ORL database. From the obtaned expermental results we can draw the followng conclusons: ) Unlke the KFD amng at fndng one optmal proecton drecton to perform bnary classfcaton problem, the GKFD ams at fndng an optmal subspace n the feature space to do the feature extracton for those multclass problems. 2) he GKFD performs well for lnearly nonseparable pattern recognton problems for t s a nonlnear transformaton. So t can almost get the optmal results for nonlnearly separable data. 3) Unlke the FLD, the GKFD can be appled to the orgnal data drectly no matter what the number of the dmenson s. 4) In ths paper the nearest neghbor method s used as the classfer due to ts smplcty. If ths method s combned wth some advanced classfcaton methods such as RFN, and SVMs, etc., the error rate can be further reduced. Future works wll nclude extendng ths method to solve those problems wth a large scale of database. References: [] V. Vapnk, he nature of Statstcal Learnng heory, New York: ley, 998. [2] S. Mka, G. Ra tsch, J. eston,. Scho lkopf, and K. Mu ller, Fsher Dscrmnant Analyss wth Kernels, Neural Networks for Sgnal Processng, vol. 9, pp. 4-48, 999. [3] K.-R. Müller and S.Mka, An Introducton to Kernel-ased Learnng Algorthms, IEEE ransacton on Neural Networks, Vol.2, NO.2.pp.8-200,200. [4] R.A Fsher, he use of Multple Measure n axonomc Problems, Ann.Eugencs, vol.7, pp.79-88,936. [5] N.elhumeur and P.Hespanha, Egenface vs. Fsherfaces:Recognton Usng Class Specfc Lnear Probecton, IEEE ransacton on Pattern Analyss, Vol.2, NO.2.pp.8-200,200. [6] R. Lotlkar and R. Kothar, Fractonal-step dmensonalty reducton, IEEE rans. Pattern Anal. Machne Intell., vol. 22, pp , [7] M.urk and A.Pentland, Egnefaces for Recognton J,Cogntve Neuroscence, Vol.3, no.,99. [8] F. S. Samara, Face recognton usng hdden Markov models, Ph.D. dssertaton, Unv. Cambrdge, Cambrdge, U.K., 994. [9] S.-H. Ln, S.-Y. Kung, and L.-J. Ln, Face recognton/detecton by probablstc decson-based neural network, IEEE rans. Neural Networks, vol. 8, 47
7 pp. 4 32, Jan [0] G. D. Guo, S. Z. L, and K. L. Chan, Face recognton by support vector machnes, n Proc. Int. Conf. Automatc Face and Gesture Recognton, pp
Recognizing Faces. Outline
Recognzng Faces Drk Colbry Outlne Introducton and Motvaton Defnng a feature vector Prncpal Component Analyss Lnear Dscrmnate Analyss !"" #$""% http://www.nfotech.oulu.f/annual/2004 + &'()*) '+)* 2 ! &
More informationFace Recognition University at Buffalo CSE666 Lecture Slides Resources:
Face Recognton Unversty at Buffalo CSE666 Lecture Sldes Resources: http://www.face-rec.org/algorthms/ Overvew of face recognton algorthms Correlaton - Pxel based correspondence between two face mages Structural
More informationClassifier Selection Based on Data Complexity Measures *
Classfer Selecton Based on Data Complexty Measures * Edth Hernández-Reyes, J.A. Carrasco-Ochoa, and J.Fco. Martínez-Trndad Natonal Insttute for Astrophyscs, Optcs and Electroncs, Lus Enrque Erro No.1 Sta.
More informationLearning the Kernel Parameters in Kernel Minimum Distance Classifier
Learnng the Kernel Parameters n Kernel Mnmum Dstance Classfer Daoqang Zhang 1,, Songcan Chen and Zh-Hua Zhou 1* 1 Natonal Laboratory for Novel Software Technology Nanjng Unversty, Nanjng 193, Chna Department
More informationFeature Reduction and Selection
Feature Reducton and Selecton Dr. Shuang LIANG School of Software Engneerng TongJ Unversty Fall, 2012 Today s Topcs Introducton Problems of Dmensonalty Feature Reducton Statstc methods Prncpal Components
More informationSupport Vector Machines
/9/207 MIST.6060 Busness Intellgence and Data Mnng What are Support Vector Machnes? Support Vector Machnes Support Vector Machnes (SVMs) are supervsed learnng technques that analyze data and recognze patterns.
More informationFace Recognition Based on SVM and 2DPCA
Vol. 4, o. 3, September, 2011 Face Recognton Based on SVM and 2DPCA Tha Hoang Le, Len Bu Faculty of Informaton Technology, HCMC Unversty of Scence Faculty of Informaton Scences and Engneerng, Unversty
More informationCluster Analysis of Electrical Behavior
Journal of Computer and Communcatons, 205, 3, 88-93 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/cc http://dx.do.org/0.4236/cc.205.350 Cluster Analyss of Electrcal Behavor Ln Lu Ln Lu, School
More informationTwo-Dimensional Supervised Discriminant Projection Method For Feature Extraction
Appl. Math. Inf. c. 6 No. pp. 8-85 (0) Appled Mathematcs & Informaton cences An Internatonal Journal @ 0 NP Natural cences Publshng Cor. wo-dmensonal upervsed Dscrmnant Proecton Method For Feature Extracton
More informationRECOGNIZING GENDER THROUGH FACIAL IMAGE USING SUPPORT VECTOR MACHINE
Journal of Theoretcal and Appled Informaton Technology 30 th June 06. Vol.88. No.3 005-06 JATIT & LLS. All rghts reserved. ISSN: 99-8645 www.jatt.org E-ISSN: 87-395 RECOGNIZING GENDER THROUGH FACIAL IMAGE
More informationSupport Vector Machines
Support Vector Machnes Decson surface s a hyperplane (lne n 2D) n feature space (smlar to the Perceptron) Arguably, the most mportant recent dscovery n machne learnng In a nutshell: map the data to a predetermned
More informationAnnouncements. Supervised Learning
Announcements See Chapter 5 of Duda, Hart, and Stork. Tutoral by Burge lnked to on web page. Supervsed Learnng Classfcaton wth labeled eamples. Images vectors n hgh-d space. Supervsed Learnng Labeled eamples
More informationClassification of Face Images Based on Gender using Dimensionality Reduction Techniques and SVM
Classfcaton of Face Images Based on Gender usng Dmensonalty Reducton Technques and SVM Fahm Mannan 260 266 294 School of Computer Scence McGll Unversty Abstract Ths report presents gender classfcaton based
More informationEdge Detection in Noisy Images Using the Support Vector Machines
Edge Detecton n Nosy Images Usng the Support Vector Machnes Hlaro Gómez-Moreno, Saturnno Maldonado-Bascón, Francsco López-Ferreras Sgnal Theory and Communcatons Department. Unversty of Alcalá Crta. Madrd-Barcelona
More informationLearning a Class-Specific Dictionary for Facial Expression Recognition
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 16, No 4 Sofa 016 Prnt ISSN: 1311-970; Onlne ISSN: 1314-4081 DOI: 10.1515/cat-016-0067 Learnng a Class-Specfc Dctonary for
More informationDiscriminative Dictionary Learning with Pairwise Constraints
Dscrmnatve Dctonary Learnng wth Parwse Constrants Humn Guo Zhuoln Jang LARRY S. DAVIS UNIVERSITY OF MARYLAND Nov. 6 th, Outlne Introducton/motvaton Dctonary Learnng Dscrmnatve Dctonary Learnng wth Parwse
More informationAn Application of the Dulmage-Mendelsohn Decomposition to Sparse Null Space Bases of Full Row Rank Matrices
Internatonal Mathematcal Forum, Vol 7, 2012, no 52, 2549-2554 An Applcaton of the Dulmage-Mendelsohn Decomposton to Sparse Null Space Bases of Full Row Rank Matrces Mostafa Khorramzadeh Department of Mathematcal
More informationClassification / Regression Support Vector Machines
Classfcaton / Regresson Support Vector Machnes Jeff Howbert Introducton to Machne Learnng Wnter 04 Topcs SVM classfers for lnearly separable classes SVM classfers for non-lnearly separable classes SVM
More informationMachine Learning 9. week
Machne Learnng 9. week Mappng Concept Radal Bass Functons (RBF) RBF Networks 1 Mappng It s probably the best scenaro for the classfcaton of two dataset s to separate them lnearly. As you see n the below
More informationFacial Expression Recognition Based on Local Binary Patterns and Local Fisher Discriminant Analysis
WSEAS RANSACIONS on SIGNAL PROCESSING Shqng Zhang, Xaomng Zhao, Bcheng Le Facal Expresson Recognton Based on Local Bnary Patterns and Local Fsher Dscrmnant Analyss SHIQING ZHANG, XIAOMING ZHAO, BICHENG
More informationParallelism for Nested Loops with Non-uniform and Flow Dependences
Parallelsm for Nested Loops wth Non-unform and Flow Dependences Sam-Jn Jeong Dept. of Informaton & Communcaton Engneerng, Cheonan Unversty, 5, Anseo-dong, Cheonan, Chungnam, 330-80, Korea. seong@cheonan.ac.kr
More informationSubspace clustering. Clustering. Fundamental to all clustering techniques is the choice of distance measure between data points;
Subspace clusterng Clusterng Fundamental to all clusterng technques s the choce of dstance measure between data ponts; D q ( ) ( ) 2 x x = x x, j k = 1 k jk Squared Eucldean dstance Assumpton: All features
More informationMULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION
MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION Paulo Quntlano 1 & Antono Santa-Rosa 1 Federal Polce Department, Brasla, Brazl. E-mals: quntlano.pqs@dpf.gov.br and
More informationLecture 4: Principal components
/3/6 Lecture 4: Prncpal components 3..6 Multvarate lnear regresson MLR s optmal for the estmaton data...but poor for handlng collnear data Covarance matrx s not nvertble (large condton number) Robustness
More informationFace Recognition Method Based on Within-class Clustering SVM
Face Recognton Method Based on Wthn-class Clusterng SVM Yan Wu, Xao Yao and Yng Xa Department of Computer Scence and Engneerng Tong Unversty Shangha, Chna Abstract - A face recognton method based on Wthn-class
More informationA Binarization Algorithm specialized on Document Images and Photos
A Bnarzaton Algorthm specalzed on Document mages and Photos Ergna Kavalleratou Dept. of nformaton and Communcaton Systems Engneerng Unversty of the Aegean kavalleratou@aegean.gr Abstract n ths paper, a
More informationOutline. Discriminative classifiers for image recognition. Where in the World? A nearest neighbor recognition example 4/14/2011. CS 376 Lecture 22 1
4/14/011 Outlne Dscrmnatve classfers for mage recognton Wednesday, Aprl 13 Krsten Grauman UT-Austn Last tme: wndow-based generc obect detecton basc ppelne face detecton wth boostng as case study Today:
More informationA Modified Median Filter for the Removal of Impulse Noise Based on the Support Vector Machines
A Modfed Medan Flter for the Removal of Impulse Nose Based on the Support Vector Machnes H. GOMEZ-MORENO, S. MALDONADO-BASCON, F. LOPEZ-FERRERAS, M. UTRILLA- MANSO AND P. GIL-JIMENEZ Departamento de Teoría
More informationModular PCA Face Recognition Based on Weighted Average
odern Appled Scence odular PCA Face Recognton Based on Weghted Average Chengmao Han (Correspondng author) Department of athematcs, Lny Normal Unversty Lny 76005, Chna E-mal: hanchengmao@163.com Abstract
More informationContent Based Image Retrieval Using 2-D Discrete Wavelet with Texture Feature with Different Classifiers
IOSR Journal of Electroncs and Communcaton Engneerng (IOSR-JECE) e-issn: 78-834,p- ISSN: 78-8735.Volume 9, Issue, Ver. IV (Mar - Apr. 04), PP 0-07 Content Based Image Retreval Usng -D Dscrete Wavelet wth
More informationThe Research of Support Vector Machine in Agricultural Data Classification
The Research of Support Vector Machne n Agrcultural Data Classfcaton Le Sh, Qguo Duan, Xnmng Ma, Me Weng College of Informaton and Management Scence, HeNan Agrcultural Unversty, Zhengzhou 45000 Chna Zhengzhou
More informationCollaboratively Regularized Nearest Points for Set Based Recognition
Academc Center for Computng and Meda Studes, Kyoto Unversty Collaboratvely Regularzed Nearest Ponts for Set Based Recognton Yang Wu, Mchhko Mnoh, Masayuk Mukunok Kyoto Unversty 9/1/013 BMVC 013 @ Brstol,
More informationLocal Quaternary Patterns and Feature Local Quaternary Patterns
Local Quaternary Patterns and Feature Local Quaternary Patterns Jayu Gu and Chengjun Lu The Department of Computer Scence, New Jersey Insttute of Technology, Newark, NJ 0102, USA Abstract - Ths paper presents
More information12/2/2009. Announcements. Parametric / Non-parametric. Case-Based Reasoning. Nearest-Neighbor on Images. Nearest-Neighbor Classification
Introducton to Artfcal Intellgence V22.0472-001 Fall 2009 Lecture 24: Nearest-Neghbors & Support Vector Machnes Rob Fergus Dept of Computer Scence, Courant Insttute, NYU Sldes from Danel Yeung, John DeNero
More informationClassifying Acoustic Transient Signals Using Artificial Intelligence
Classfyng Acoustc Transent Sgnals Usng Artfcal Intellgence Steve Sutton, Unversty of North Carolna At Wlmngton (suttons@charter.net) Greg Huff, Unversty of North Carolna At Wlmngton (jgh7476@uncwl.edu)
More informationMachine Learning. Support Vector Machines. (contains material adapted from talks by Constantin F. Aliferis & Ioannis Tsamardinos, and Martin Law)
Machne Learnng Support Vector Machnes (contans materal adapted from talks by Constantn F. Alfers & Ioanns Tsamardnos, and Martn Law) Bryan Pardo, Machne Learnng: EECS 349 Fall 2014 Support Vector Machnes
More informationCompetitive Sparse Representation Classification for Face Recognition
Vol. 6, No. 8, 05 Compettve Sparse Representaton Classfcaton for Face Recognton Yng Lu Chongqng Key Laboratory of Computatonal Intellgence Chongqng Unversty of Posts and elecommuncatons Chongqng, Chna
More informationRange images. Range image registration. Examples of sampling patterns. Range images and range surfaces
Range mages For many structured lght scanners, the range data forms a hghly regular pattern known as a range mage. he samplng pattern s determned by the specfc scanner. Range mage regstraton 1 Examples
More informationOutline. Self-Organizing Maps (SOM) US Hebbian Learning, Cntd. The learning rule is Hebbian like:
Self-Organzng Maps (SOM) Turgay İBRİKÇİ, PhD. Outlne Introducton Structures of SOM SOM Archtecture Neghborhoods SOM Algorthm Examples Summary 1 2 Unsupervsed Hebban Learnng US Hebban Learnng, Cntd 3 A
More informationCombination of Local Multiple Patterns and Exponential Discriminant Analysis for Facial Recognition
Sensors & ransducers 203 by IFSA http://.sensorsportal.com Combnaton of Local Multple Patterns and Exponental Dscrmnant Analyss for Facal Recognton, 2 Lfang Zhou, 2 Bn Fang, 3 Wesheng L, 3 Ldou Wang College
More informationTsinghua University at TAC 2009: Summarizing Multi-documents by Information Distance
Tsnghua Unversty at TAC 2009: Summarzng Mult-documents by Informaton Dstance Chong Long, Mnle Huang, Xaoyan Zhu State Key Laboratory of Intellgent Technology and Systems, Tsnghua Natonal Laboratory for
More informationAppearance-based Statistical Methods for Face Recognition
47th Internatonal Symposum ELMAR-2005, 08-10 June 2005, Zadar, Croata Appearance-based Statstcal Methods for Face Recognton Kresmr Delac 1, Mslav Grgc 2, Panos Latss 3 1 Croatan elecom, Savsa 32, Zagreb,
More informationThe Discriminate Analysis and Dimension Reduction Methods of High Dimension
Open Journal of Socal Scences, 015, 3, 7-13 Publshed Onlne March 015 n ScRes. http://www.scrp.org/journal/jss http://dx.do.org/10.436/jss.015.3300 The Dscrmnate Analyss and Dmenson Reducton Methods of
More informationFeature Selection By KDDA For SVM-Based MultiView Face Recognition
SEI 007 4 rth Internatonal Conference: Scences of Electronc, echnologes of Informaton and elecommuncatons March 5-9, 007 UNISIA Feature Selecton By KDDA For SVM-Based MultVew Face ecognton Seyyed Majd
More informationA Robust LS-SVM Regression
PROCEEDIGS OF WORLD ACADEMY OF SCIECE, EGIEERIG AD ECHOLOGY VOLUME 7 AUGUS 5 ISS 37- A Robust LS-SVM Regresson József Valyon, and Gábor Horváth Abstract In comparson to the orgnal SVM, whch nvolves a quadratc
More informationSolving two-person zero-sum game by Matlab
Appled Mechancs and Materals Onlne: 2011-02-02 ISSN: 1662-7482, Vols. 50-51, pp 262-265 do:10.4028/www.scentfc.net/amm.50-51.262 2011 Trans Tech Publcatons, Swtzerland Solvng two-person zero-sum game by
More informationComputer Aided Drafting, Design and Manufacturing Volume 25, Number 2, June 2015, Page 14
Computer Aded Draftng, Desgn and Manufacturng Volume 5, Number, June 015, Page 14 CADDM Face Recognton Algorthm Fusng Monogenc Bnary Codng and Collaboratve Representaton FU Yu-xan, PENG Lang-yu College
More informationSUMMARY... I TABLE OF CONTENTS...II INTRODUCTION...
Summary A follow-the-leader robot system s mplemented usng Dscrete-Event Supervsory Control methods. The system conssts of three robots, a leader and two followers. The dea s to get the two followers to
More informationMargin-Constrained Multiple Kernel Learning Based Multi-Modal Fusion for Affect Recognition
Margn-Constraned Multple Kernel Learnng Based Mult-Modal Fuson for Affect Recognton Shzh Chen and Yngl Tan Electrcal Engneerng epartment The Cty College of New Yor New Yor, NY USA {schen, ytan}@ccny.cuny.edu
More informationSelf-Supervised Learning Based on Discriminative Nonlinear Features for Image Classification
Self-Supervsed Learnng Based on Dscrmnatve Nonlnear Features for Image Classfcaton Q an, Yng Wu 2, Je Yu, homas S. Huang 3 Department of Computer Scence, Unversty of exas at San Antono, San Antono, X 78249
More informationA Fast Content-Based Multimedia Retrieval Technique Using Compressed Data
A Fast Content-Based Multmeda Retreval Technque Usng Compressed Data Borko Furht and Pornvt Saksobhavvat NSF Multmeda Laboratory Florda Atlantc Unversty, Boca Raton, Florda 3343 ABSTRACT In ths paper,
More informationOn Modeling Variations For Face Authentication
On Modelng Varatons For Face Authentcaton Xaomng Lu Tsuhan Chen B.V.K. Vjaya Kumar Department of Electrcal and Computer Engneerng, Carnege Mellon Unversty Abstract In ths paper, we present a scheme for
More informationFeature Extraction Based on Maximum Nearest Subspace Margin Criterion
Neural Process Lett DOI 10.7/s11063-012-9252-y Feature Extracton Based on Maxmum Nearest Subspace Margn Crteron Y Chen Zhenzhen L Zhong Jn Sprnger Scence+Busness Meda New York 2012 Abstract Based on the
More informationLearning a Locality Preserving Subspace for Visual Recognition
Learnng a Localty Preservng Subspace for Vsual Recognton Xaofe He *, Shucheng Yan #, Yuxao Hu, and Hong-Jang Zhang Mcrosoft Research Asa, Bejng 100080, Chna * Department of Computer Scence, Unversty of
More informationOutline. Type of Machine Learning. Examples of Application. Unsupervised Learning
Outlne Artfcal Intellgence and ts applcatons Lecture 8 Unsupervsed Learnng Professor Danel Yeung danyeung@eee.org Dr. Patrck Chan patrckchan@eee.org South Chna Unversty of Technology, Chna Introducton
More informationLaplacian Eigenmap for Image Retrieval
Laplacan Egenmap for Image Retreval Xaofe He Partha Nyog Department of Computer Scence The Unversty of Chcago, 1100 E 58 th Street, Chcago, IL 60637 ABSTRACT Dmensonalty reducton has been receved much
More informationIncremental MQDF Learning for Writer Adaptive Handwriting Recognition 1
200 2th Internatonal Conference on Fronters n Handwrtng Recognton Incremental MQDF Learnng for Wrter Adaptve Handwrtng Recognton Ka Dng, Lanwen Jn * School of Electronc and Informaton Engneerng, South
More informationDetermining the Optimal Bandwidth Based on Multi-criterion Fusion
Proceedngs of 01 4th Internatonal Conference on Machne Learnng and Computng IPCSIT vol. 5 (01) (01) IACSIT Press, Sngapore Determnng the Optmal Bandwdth Based on Mult-crteron Fuson Ha-L Lang 1+, Xan-Mn
More informationCorrelative features for the classification of textural images
Correlatve features for the classfcaton of textural mages M A Turkova 1 and A V Gadel 1, 1 Samara Natonal Research Unversty, Moskovskoe Shosse 34, Samara, Russa, 443086 Image Processng Systems Insttute
More informationProblem Definitions and Evaluation Criteria for Computational Expensive Optimization
Problem efntons and Evaluaton Crtera for Computatonal Expensve Optmzaton B. Lu 1, Q. Chen and Q. Zhang 3, J. J. Lang 4, P. N. Suganthan, B. Y. Qu 6 1 epartment of Computng, Glyndwr Unversty, UK Faclty
More informationFACE RECOGNITION USING MAP DISCRIMINANT ON YCBCR COLOR SPACE
FAC RCOGNIION USING MAP DISCRIMINAN ON YCBCR COLOR SPAC I Gede Pasek Suta Wjaya lectrcal ngneerng Department, ngneerng Faculty, Mataram Unversty. Jl. Majapaht 62 Mataram, West Nusa enggara, Indonesa. mal:
More informationA Genetic Programming-PCA Hybrid Face Recognition Algorithm
Journal of Sgnal and Informaton Processng, 20, 2, 70-74 do:0.4236/jsp.20.23022 Publshed Onlne August 20 (http://www.scrp.org/journal/jsp) A Genetc Programmng-PCA Hybrd Face Recognton Algorthm Behzad Bozorgtabar,
More informationBOOSTING CLASSIFICATION ACCURACY WITH SAMPLES CHOSEN FROM A VALIDATION SET
1 BOOSTING CLASSIFICATION ACCURACY WITH SAMPLES CHOSEN FROM A VALIDATION SET TZU-CHENG CHUANG School of Electrcal and Computer Engneerng, Purdue Unversty, West Lafayette, Indana 47907 SAUL B. GELFAND School
More informationHistogram-Enhanced Principal Component Analysis for Face Recognition
Hstogram-Enhanced Prncpal Component Analyss for Face ecognton Ana-ara Sevcenco and Wu-Sheng Lu Dept. of Electrcal and Computer Engneerng Unversty of Vctora sevcenco@engr.uvc.ca, wslu@ece.uvc.ca Abstract
More informationPCA Based Gait Segmentation
Honggu L, Cupng Sh & Xngguo L PCA Based Gat Segmentaton PCA Based Gat Segmentaton Honggu L, Cupng Sh, and Xngguo L 2 Electronc Department, Physcs College, Yangzhou Unversty, 225002 Yangzhou, Chna 2 Department
More informationLecture 5: Multilayer Perceptrons
Lecture 5: Multlayer Perceptrons Roger Grosse 1 Introducton So far, we ve only talked about lnear models: lnear regresson and lnear bnary classfers. We noted that there are functons that can t be represented
More informationWIRELESS CAPSULE ENDOSCOPY IMAGE CLASSIFICATION BASED ON VECTOR SPARSE CODING.
WIRELESS CAPSULE ENDOSCOPY IMAGE CLASSIFICATION BASED ON VECTOR SPARSE CODING Tao Ma 1, Yuexan Zou 1 *, Zhqang Xang 1, Le L 1 and Y L 1 ADSPLAB/ELIP, School of ECE, Pekng Unversty, Shenzhen 518055, Chna
More informationFeature Extractions for Iris Recognition
Feature Extractons for Irs Recognton Jnwook Go, Jan Jang, Yllbyung Lee, and Chulhee Lee Department of Electrcal and Electronc Engneerng, Yonse Unversty 134 Shnchon-Dong, Seodaemoon-Gu, Seoul, KOREA Emal:
More informationA Fast Visual Tracking Algorithm Based on Circle Pixels Matching
A Fast Vsual Trackng Algorthm Based on Crcle Pxels Matchng Zhqang Hou hou_zhq@sohu.com Chongzhao Han czhan@mal.xjtu.edu.cn Ln Zheng Abstract: A fast vsual trackng algorthm based on crcle pxels matchng
More informationDetection of an Object by using Principal Component Analysis
Detecton of an Object by usng Prncpal Component Analyss 1. G. Nagaven, 2. Dr. T. Sreenvasulu Reddy 1. M.Tech, Department of EEE, SVUCE, Trupath, Inda. 2. Assoc. Professor, Department of ECE, SVUCE, Trupath,
More informationKernel Collaborative Representation Classification Based on Adaptive Dictionary Learning
Internatonal Journal of Intellgent Informaton Systems 2018; 7(2): 15-22 http://www.scencepublshnggroup.com/j/js do: 10.11648/j.js.20180702.11 ISSN: 2328-7675 (Prnt); ISSN: 2328-7683 (Onlne) Kernel Collaboratve
More informationAn Efficient Illumination Normalization Method with Fuzzy LDA Feature Extractor for Face Recognition
www.mer.com Vol.2, Issue.1, pp-060-065 ISS: 2249-6645 An Effcent Illumnaton ormalzaton Meod w Fuzzy LDA Feature Extractor for Face Recognton Behzad Bozorgtabar 1, Hamed Azam 2 (Department of Electrcal
More informationKent State University CS 4/ Design and Analysis of Algorithms. Dept. of Math & Computer Science LECT-16. Dynamic Programming
CS 4/560 Desgn and Analyss of Algorthms Kent State Unversty Dept. of Math & Computer Scence LECT-6 Dynamc Programmng 2 Dynamc Programmng Dynamc Programmng, lke the dvde-and-conquer method, solves problems
More informationOrthogonal Complement Component Analysis for Positive Samples in SVM Based Relevance Feedback Image Retrieval
Orthogonal Complement Component Analyss for ostve Samples n SVM Based Relevance Feedback Image Retreval Dacheng Tao and Xaoou Tang Department of Informaton Engneerng The Chnese Unversty of Hong Kong {dctao2,
More informationFeature Selection for Target Detection in SAR Images
Feature Selecton for Detecton n SAR Images Br Bhanu, Yngqang Ln and Shqn Wang Center for Research n Intellgent Systems Unversty of Calforna, Rversde, CA 95, USA Abstract A genetc algorthm (GA) approach
More informationPictures at an Exhibition
1 Pctures at an Exhbton Stephane Kwan and Karen Zhu Department of Electrcal Engneerng Stanford Unversty, Stanford, CA 9405 Emal: {skwan1, kyzhu}@stanford.edu Abstract An mage processng algorthm s desgned
More informationSmoothing Spline ANOVA for variable screening
Smoothng Splne ANOVA for varable screenng a useful tool for metamodels tranng and mult-objectve optmzaton L. Rcco, E. Rgon, A. Turco Outlne RSM Introducton Possble couplng Test case MOO MOO wth Game Theory
More informationFACIAL FEATURE EXTRACTION TECHNIQUES FOR FACE RECOGNITION
Journal of omputer Scence 10 (12): 2360-2365, 2014 ISSN: 1549-3636 2014 Rahb H. Abyev, hs open access artcle s dstrbuted under a reatve ommons Attrbuton (-BY) 3.0 lcense do:10.3844/jcssp.2014.2360.2365
More informationPERFORMANCE EVALUATION FOR SCENE MATCHING ALGORITHMS BY SVM
PERFORMACE EVALUAIO FOR SCEE MACHIG ALGORIHMS BY SVM Zhaohu Yang a, b, *, Yngyng Chen a, Shaomng Zhang a a he Research Center of Remote Sensng and Geomatc, ongj Unversty, Shangha 200092, Chna - yzhac@63.com
More information6.854 Advanced Algorithms Petar Maymounkov Problem Set 11 (November 23, 2005) With: Benjamin Rossman, Oren Weimann, and Pouya Kheradpour
6.854 Advanced Algorthms Petar Maymounkov Problem Set 11 (November 23, 2005) Wth: Benjamn Rossman, Oren Wemann, and Pouya Kheradpour Problem 1. We reduce vertex cover to MAX-SAT wth weghts, such that the
More informationEYE CENTER LOCALIZATION ON A FACIAL IMAGE BASED ON MULTI-BLOCK LOCAL BINARY PATTERNS
P.G. Demdov Yaroslavl State Unversty Anatoly Ntn, Vladmr Khryashchev, Olga Stepanova, Igor Kostern EYE CENTER LOCALIZATION ON A FACIAL IMAGE BASED ON MULTI-BLOCK LOCAL BINARY PATTERNS Yaroslavl, 2015 Eye
More informationRobust visual tracking based on Informative random fern
5th Internatonal Conference on Computer Scences and Automaton Engneerng (ICCSAE 205) Robust vsual trackng based on Informatve random fern Hao Dong, a, Ru Wang, b School of Instrumentaton Scence and Opto-electroncs
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 15
CS434a/541a: Pattern Recognton Prof. Olga Veksler Lecture 15 Today New Topc: Unsupervsed Learnng Supervsed vs. unsupervsed learnng Unsupervsed learnng Net Tme: parametrc unsupervsed learnng Today: nonparametrc
More informationThe Greedy Method. Outline and Reading. Change Money Problem. Greedy Algorithms. Applications of the Greedy Strategy. The Greedy Method Technique
//00 :0 AM Outlne and Readng The Greedy Method The Greedy Method Technque (secton.) Fractonal Knapsack Problem (secton..) Task Schedulng (secton..) Mnmum Spannng Trees (secton.) Change Money Problem Greedy
More informationThe Study of Remote Sensing Image Classification Based on Support Vector Machine
Sensors & Transducers 03 by IFSA http://www.sensorsportal.com The Study of Remote Sensng Image Classfcaton Based on Support Vector Machne, ZHANG Jan-Hua Key Research Insttute of Yellow Rver Cvlzaton and
More informationPositive Semi-definite Programming Localization in Wireless Sensor Networks
Postve Sem-defnte Programmng Localzaton n Wreless Sensor etworks Shengdong Xe 1,, Jn Wang, Aqun Hu 1, Yunl Gu, Jang Xu, 1 School of Informaton Scence and Engneerng, Southeast Unversty, 10096, anjng Computer
More informationFace Recognition Methods Based on Feedforward Neural Networks, Principal Component Analysis and Self-Organizing Map
RADIOENGINEERING, VOL. 16, NO. 1, APRIL 2007 51 Face Recognton Methods Based on Feedforward Neural Networks, Prncpal Component Analyss and Self-Organzng Map Mloš ORAVEC, Jarmla PAVLOVIČOVÁ Dept. of elecommuncatons,
More informationPalmprint Recognition Using Directional Representation and Compresses Sensing
Research Journal of Appled Scences, Engneerng and echnology 4(22): 4724-4728, 2012 ISSN: 2040-7467 Maxwell Scentfc Organzaton, 2012 Submtted: March 31, 2012 Accepted: Aprl 30, 2012 Publshed: November 15,
More informationUsing Fuzzy Logic to Enhance the Large Size Remote Sensing Images
Internatonal Journal of Informaton and Electroncs Engneerng Vol. 5 No. 6 November 015 Usng Fuzzy Logc to Enhance the Large Sze Remote Sensng Images Trung Nguyen Tu Huy Ngo Hoang and Thoa Vu Van Abstract
More informationOptimal Workload-based Weighted Wavelet Synopses
Optmal Workload-based Weghted Wavelet Synopses Yoss Matas School of Computer Scence Tel Avv Unversty Tel Avv 69978, Israel matas@tau.ac.l Danel Urel School of Computer Scence Tel Avv Unversty Tel Avv 69978,
More informationLECTURE : MANIFOLD LEARNING
LECTURE : MANIFOLD LEARNING Rta Osadchy Some sldes are due to L.Saul, V. C. Raykar, N. Verma Topcs PCA MDS IsoMap LLE EgenMaps Done! Dmensonalty Reducton Data representaton Inputs are real-valued vectors
More informationFEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur
FEATURE EXTRACTION Dr. K.Vjayarekha Assocate Dean School of Electrcal and Electroncs Engneerng SASTRA Unversty, Thanjavur613 41 Jont Intatve of IITs and IISc Funded by MHRD Page 1 of 8 Table of Contents
More informationFace Recognition by Fusing Binary Edge Feature and Second-order Mutual Information
Face Recognton by Fusng Bnary Edge Feature and Second-order Mutual Informaton Jatao Song, Bejng Chen, We Wang, Xaobo Ren School of Electronc and Informaton Engneerng, Nngbo Unversty of Technology Nngbo,
More informationCorner-Based Image Alignment using Pyramid Structure with Gradient Vector Similarity
Journal of Sgnal and Informaton Processng, 013, 4, 114-119 do:10.436/jsp.013.43b00 Publshed Onlne August 013 (http://www.scrp.org/journal/jsp) Corner-Based Image Algnment usng Pyramd Structure wth Gradent
More informationTone-Aware Sparse Representation for Face Recognition
Tone-Aware Sparse Representaton for Face Recognton Lngfeng Wang, Huayu Wu and Chunhong Pan Abstract It s stll a very challengng task to recognze a face n a real world scenaro, snce the face may be corrupted
More informationDiscriminative classifiers for object classification. Last time
Dscrmnatve classfers for object classfcaton Thursday, Nov 12 Krsten Grauman UT Austn Last tme Supervsed classfcaton Loss and rsk, kbayes rule Skn color detecton example Sldng ndo detecton Classfers, boostng
More informationHierarchical clustering for gene expression data analysis
Herarchcal clusterng for gene expresson data analyss Gorgo Valentn e-mal: valentn@ds.unm.t Clusterng of Mcroarray Data. Clusterng of gene expresson profles (rows) => dscovery of co-regulated and functonally
More informationUsing Neural Networks and Support Vector Machines in Data Mining
Usng eural etworks and Support Vector Machnes n Data Mnng RICHARD A. WASIOWSKI Computer Scence Department Calforna State Unversty Domnguez Hlls Carson, CA 90747 USA Abstract: - Multvarate data analyss
More informationAn AAM-based Face Shape Classification Method Used for Facial Expression Recognition
Internatonal Journal of Research n Engneerng and Technology (IJRET) Vol. 2, No. 4, 23 ISSN 2277 4378 An AAM-based Face Shape Classfcaton Method Used for Facal Expresson Recognton Lunng. L, Jaehyun So,
More informationExperimental Analysis on Character Recognition using Singular Value Decomposition and Random Projection
Expermental Analyss on Character Recognton usng Sngular Value Decomposton and Random Projecton Manjusha K. 1, Anand Kumar M. 2, Soman K. P. 3 Centre for Excellence n Computatonal Engneerng and Networkng,
More information