LEARNING A WARPED SUBSPACE MODEL OF FACES WITH IMAGES OF UNKNOWN POSE AND ILLUMINATION

Size: px
Start display at page:

Download "LEARNING A WARPED SUBSPACE MODEL OF FACES WITH IMAGES OF UNKNOWN POSE AND ILLUMINATION"

Transcription

1 LEARNING A WARPED SUBSPACE MODEL OF FACES WITH IMAGES OF UNKNOWN POSE AND ILLUMINATION Jhun Hamm, and Danel D. Lee GRASP Laboratory, Unversty of Pennsylvana, 3330 Walnut Street, Phladelpha, PA, USA jhham@seas.upenn.edu, ddlee@seas.upenn.edu Keywords: Abstract: mage-based modelng, probablstc generatve model, llumnaton subspace, super-resoluton, MAP estmaton, multscale mage regstraton In ths paper we tackle the problem of learnng the appearances of a person s face from mages wth both unknown pose and llumnaton. The unknown, smultaneous change n pose and llumnaton makes t dffcult to learn 3D face models from data wthout manual labelng and trackng of features. In comparson, mage-based models do not requre geometrc knowledge of faces but only the statstcs of data tself, and therefore are easer to tran wth mages wth such varatons. We take an mage-based approach to the problem and propose a generatve model of a warped llumnaton subspace. Image varatons due to llumnaton change are accounted for by a low-dmensonal lnear subspace, whereas varatons due to pose change are approxmated by a geometrc warpng of mages n the subspace. We demonstrate that ths model can be effcently learned va MAP estmaton and multscale regstraton technques. Wth ths learned warped subspace we can jontly estmate the pose and the lghtng condtons of test mages and mprove recognton of faces under novel poses and llumnatons. We test our algorthm wth synthetc faces and real mages from the CMU PIE and Yale face databases. The results show mprovements n predcton and recognton performance compared to other standard methods. 1 INTRODUCTION We tackle the problem of learnng generatve models of a person s face from mages wth both unknown pose and llumnaton. The appearance of a person s face undergoes large varatons as llumnaton and vewng drectons change. A full 3D model of a face allows us to synthesze mages at arbtrary poses and llumnaton condtons. However, learnng such a 3D model from mages alone s very dffcult snce t requres that feature correspondences are known accurately, even under dramatc lghtng changes. In ths paper we develop an mage-based approach, whch does not use 3D models nor solve correspondence problems, but nstead drectly learns the statstcal propertes of mages under pose and llumnaton varatons. (see Fg. 1). One of the smplest mage-based models of Fgure 1: Typcal unlabeled mages wth both varyng pose and llumnaton condtons make t dffcult to learn 3D structures drectly from sample mages. We am to learn an appearance model of a person s face gven such mages wthout fndng, labelng and trackng features between frames. faces s an Egenface model (Turk and Pentland, 1991), whch models data as an affne subspace n the space of pxel ntenstes. Although Egenfaces were orgnally appled to mage varatons across dfferent people, a subspace model can explan the llumnaton varaton of a sngle per-

2 n the subspace. A schematc of the warped subspace s depcted n Fg Related Work Fgure 2: A probablstc model of pose and llumnaton varatons. The ellpsod n the mddle represents frontal mages wth all possble llumnatons, lyng closely on a low-dmensonal subspace. As the vewpont changes from a rght-profle to a left-profle pose, the ellpsod s transported contnuously along a nonlnear manfold. We model ths nonlnear varaton wth a geometrc warpng of mages. son exceptonally well (Hallnan, 1994; Epsten et al., 1995). The so-called llumnaton subspace has been thoroughly studed theoretcally (Ramamoorth, 2002; Basr and Jacobs, 2003). However, such a lnear subspace model cannot cope wth the smultaneous nonlnear change of poses. On the other hand, suppose we are gven multple-pose vews of a face under a fxed lghtng condton. If the pose change s moderate, we can learn a generatve model by geometrcally regsterng the mult-vew mages and probablstcally combnng them to estmate the unknown latent mage. Such generatve models have been proposed for the super-resoluton problem (Harde et al., 1997; Tppng and Bshop, 2002; Capel and Zsserman, 2003). However, prevous work consders only a sngle latent mage rather than a latent subspace, and therefore can handle only one-dmensonal llumnaton changes and not the full range of llumnaton varatons from arbtrary lght sources. In ths paper we model the smultaneous change of pose and llumnaton of a person s face by a novel warped subspace model. Image varatons due to llumnaton change at a fxed pose are captured by a low-dmensonal llumnaton subspace; and varatons due to pose change are approxmated by a geometrc warpng of mages Image-based models of faces have been proposed before. A popular mult-pose representaton of mages s the lght-feld presentaton, whch models the radance of lght as a functon of the 5D pose of the observer (Gross et al., 2002a; Gross et al., 2002b; Zhou and Chellappa, 2004). Theoretcally, the lght-feld model provdes posenvarant recognton of mages taken wth arbtrary camera and pose when the llumnaton condton s fxed. Zhou et al. extended the lght-feld model to a blnear model whch allows smultaneous change of pose and llumnaton (Zhou and Chellappa, 2004). However, n practce, the camera pose of the test mage has to be known beforehand to compare t wth the pre-computed lghtfeld, whch effectvely amounts to knowng the correspondence n 3D model-based approaches. Ths model s also unable to extend to the representaton to a novel pose. In the super-resoluton feld, the dea of usng latent subspaces n generatve models has been suggested by (Capel and Zsserman, 2001; Gunturk et al., 2003). However the learned subspaces reflect mxed contrbutons from pose, llumnaton, subject denttes, etc. In our case the subspace encodes 3D structure, albedo and the lowpass flterng nature of the Lambertan reflectance functon (Basr and Jacobs, 2003), and the pose change s dedcated to geometrc transforms. Furthermore, we show how to learn the bass, pose and llumnaton condtons drectly and smultaneously from a few mages of both unknown pose and llumnaton. In our method we estmate the geometrc warpng varable va a contnuous optmzaton nstead of searchng over a lmted or fnte set of predefned transformatons (Harde et al., 1997; Frey and Jojc, 1999; Tppng and Bshop, 2002). The remander of the paper s organzed as follows. In Sec. 2, we formulate the warped subspace model n a probablstc generatve framework, and descrbe how to jontly estmate the pose and the llumnaton wth a known bass. In Sec. 3, we descrbe a maxmum a posteror (MAP) approach to the learnng of a bass as well as the estmaton of pose and llumnaton smultaneously, and explan how a pror dstrbuton and effcent optmzaton can be employed to learn the model. In Sec. 4, we perform recog-

3 nton experments on real data sets. We conclude wth dscussons n Sec JOINT ESTIMATION OF POSE AND ILLUMINATION In ths secton we explan the elements of generatve models of mages and optmzaton technques to jontly estmate pose and llumnaton. 2.1 Generatve Model of Mult-vew Images A smple generatve model common to superresoluton methods s the followng: x = W g z + ɛ, (1) where x s an observed mage, z s a latent mage, and W g s a warpng operator on the latent mage: let z(u, v) be the pxel ntensty at (u, v) R 2 and T g : R 2 R 2 be a transform of coordnates paramaterzed by g, then (W g z)(u, v) = z(tg 1 (u, v)). In the fnte-pxel doman, we assume x and z are D-dmensonal vectors of mage ntenstes where D s the number of pxels, and W g s a D D matrx representng the warpng and the subsequent nterpolaton. From the defnton above, the W g s a nonlnear functon of warpng varables g; however, t s a lnear functon of mages z, whch can be seen by the equalty W g (a 1 I 1 + a 2 I 2 ) = a 1 (W g I 1 ) + a 2 (W g I 2 ), for any two mages I 1 and I 2 and real numbers a 1 and a 2. We consder the perspectve transforms n ths paper, so g s a 8-dmensonal vector. The X = {x 1,..., x N } and G = {g 1,..., g N } denote aggregates of N observed mages and N warpng varables. If the nose ɛ s an ndependent, addtve Gaussan nose, that s p(x z, g) N (W g z, Ψ), then the log-lkelhood of the observed samples X becomes L = log p(x z, G) = log p(x z, g ) = 1 (x W g z) Ψ 1 (x W g z)(2) 2 plus a constant. The maxmum lkelhood (ML) estmates of the latent mage z and the warpng parameters G are found by computng argmn z,g (x W g z) Ψ 1 (x W g z). 2.2 Warped Illumnaton Subspace The prevous model (1) can only explan the change of appearance from a sngle latent mage. Instead, we want z to be a combnaton of bass mages z = Bs, where B s a D d matrx and s s d-dmensonal vector and d D. Our choce of B comes from the low-dmensonal nature of llumnaton subspaces of convex Lambertan objects: an mage llumnated from arbtrary lght source dstrbuton can be approxmated well by a combnaton of four or nne-dmensonal bass (Basr and Jacobs, 2003). In ths settng, B encodes 3D structure, albedo and the low-pass flterng nature of Lambertan reflectance, and the varables s determne the dstrbuton of lght sources. Let us call s llumnaton coeffcents. The correspondng generatve model s x = W g Bs + ɛ. (3) Snce the warpng W g s a lnear transform of mages, the W g maps a subspace to another subspace. In ths sense we call our model a warped subspace model (refer to Fg. 2). 2.3 Optmzaton Gven an ensemble of mages of the same object wth unknown llumnaton and pose, we can learn g and s by mnmzng the ML cost: C = 2 log p(x B, S, G) = x W g Bs 2 Ψ. (4) We wll use the notaton y 2 Ψ to denote the quadratc form y 2 Ψ = y Ψ 1 y. In superresoluton approaches, the warpng varables g are typcally computed once n a preprocessng step. Snce we are dealng wth mages under arbtrary llumnaton change, a drect regstraton based on ntensty s bound to fal. We overcome ths problem by updatng the regstraton varable g and llumnaton coeffcent s n an alternatng fashon Estmatng Warpng Varables g To mnmze (4) wth respect to g we use a multscale regstraton technque (Vasconcelos and Lppman, 2005) to speed up computatons and avod local mnma. At each level of coarse-tofne mage resolutons, regstraton s done by the Gauss-Newton method descrbed n the followng.

4 Orgnal Bass (B) Illumnated (x=bs) Warped (x=wbs) Fgure 3: Modelng pose and lghtng changes wth a warped subspace model. By estmatng the llumnaton coeffcents s and the warpng varables g wth a known bass B, we can mtate the orgnal pose and lghtng on the left by the lnear combnaton (x = Bs) followed by the geometrcal warpng (x = W gbs). For smplcty assume the cost C s the sum of squared dfferences of two mages I 1 and I 2 C = u,v [I 1 (u, v) I 2 (T 1 g (u, v))] 2. (5) The Gauss-Newton method fnds the mnmum of (5) by the update rule: g n+1 = g n α( 2 gc g n) 1 g C g n, (6) where g C and 2 gc are the gradent and the Hessan of C, respectvely. These are computed from the frst- and the second-order dervatves of T wth respect to g, and the frst- and the secondorder dervatves of mages wth respect to the coordnates (u, v). To apply the technque, we frst generate mage pyramds for I 1 and I 2, we update g by (6) at the coarsest level of the pyramds untl convergence, and repeat the teraton at the fner levels Estmatng Illumnaton Coeffcents s Mnmzng the cost (4) wth respect to s s straghtforward. By settng C s = 2B W Ψ 1 (W Bs x ) = 0 we get the lnear equaton (B W Ψ 1 W B)s = B W Ψ 1 x, (7) whch can be drectly solved by nvertng d d matrx. Note that d D. 2.4 Experments wth Synthetc Data We test the alternatng mnmzaton scheme wth synthetc face data. For ths purpose, we frst generated synthetc mages from a 3D model of a person wth a fxed pose and varyng llumnatons, from whch an emprcal bass B s computed by sngular value decomposton (SVD). The number of bass vector d = 5 was chosen to contan more than 98.8 percent of the total energy, whch agrees wth emprcal (Epsten et al., 1995) and analytcal (Ramamoorth, 2002) studes. A number of mages were randomly rendered wth varyng pose ( yaw 15, ptch 12 ) and varyng lght source drecton ( yaw 60, ptch 50 ). The nose statstcs Ψ were manually determned from the statstcs of the error between the true and the reconstructed mages. Fgure 3 shows the bass mages and the result of jont estmaton. 3 SIMULTANEOUS LEARNING OF BASIS In the prevous secton we showed how to jontly estmate pose and lghtng condtons of test mages from a known bass. However, n practce we do not know the bass for a gven person beforehand. In ths secton we demonstrate an effcent method of learnng the bass as well. 3.1 MAP Estmaton By consderng B also as an unknown varable the ML cost (4) becomes certanly harder to mnmze. The man dffculty les n the degeneracy of the product W Bs. Frst, the product Bs s degenerate up to matrx multplcatons of any nonsngular matrx A, that s, Bs = BA 1 As. We wll mpose orthogonalty on the bass B B = I, but the B and s are stll degenerate up to a d d rotaton matrx. Secondly, W and Bs are also degenerate. One can warp the bass by some transformaton T and compensate t by ts n-

5 verse: W Bs = W T 1 T Bs. To releve the dffculty, we assume a Gaussan process pror on B and a Gaussan densty pror on g. These prors can break the degeneracy by preferrng specfc values of (W, B, s) among those whch gve the same value of W Bs Gaussan Process Pror for Images In super-resoluton problems, fndng latent mages z s usually ll-posed and a pror s requred for z. One of the commonly used prors s the Gaussan MRF (Capel and Zsserman, 2003) of the form p(z) = 1 Z exp( z Qz), whch can be vewed as a Gaussan random process pror on z N (µ, Φ) whose covarance reflects the MRF propertes. We propose the followng pror: f b j denotes the j-th column of B, then each {b j } has the..d. Gaussan pror b j N (µ, Φ). It s typcal to assume µ = 0 for allow arbtrary mages, but we can also use the emprcal bass mages, such as those from the prevous experments wth synthetc faces. We further assume b j s are ndepent. For Φ we choose RBF covarance descrbed n (Tppng and Bshop, 2002): f the - th and j-th entres of z correspond to the pxels (u, v ) and (u j, v j ) n mage coordnates, then [Φ] j exp ( 1 2r {(u 2 u j ) 2 + (v v j ) 2 } ). The nverse Q = Φ 1 of the RBF covarance penalze abrupt changes n the values of nearby pxels and act as a smoothness pror. In practce, the Q = Φ 1 need not be nvertble, and can be made sparse to speed up computatons. The ndependence assumpton on the bass mages {b j } may seem too restrctve, because the bass mages {b j } may be correlated. However, the MRF pror serves manly as the smoothness regularzer and the ndependence only mples that the bass mages are ndependently smooth. Besdes, assumng the full dependency of bass mages s not practcal due to the sheer sze of the covarance matrx Regularzed Warpng A pror for g can prevent unrealstc overregstraton and make the problem better-posed. We penalzed the L 2 norm of the dsplacement feld. Suppose (δu, δv) = T g (u, v) (u, v) s the dsplacement feld of the transform T g, then the norm (u,v) (δu)2 + (δv) 2 measure the overall dstorton the transform T g nduces. The secondorder approxmaton to the squared norm around g = 0 s (u,v) {( g δu) g} 2 + {( g δv) g} 2 = g Λg The correspondng regularzaton term log p(g) = λg Λg s added to the regstraton error term (5) n our multscale regstraton procedure. For perspectve transforms, the Λ s a 8 8 matrx whch doesn t depend on data. 3.2 Optmzaton The proposed MAP cost s as follows: C = 2 log [p(x B, S, G)p(B)p(G)] = x W g Bs 2 Ψ + λ +ηn j g Λg b j µ j 2 Φ + const (8) The mnmzaton s smlarly done by alternatng between mnmzatons over B, s and g. Mnmzng over the latter two s the same as prevous secton, and we only descrbe mnmzaton over B Fndng Bass Images B The dervatve of C w.r.t B s C B = 2 W Ψ 1 (W Bs x )s +2ηNΦ 1 (B µ), where µ = [µ 1...µ d ]. An exact soluton s gven by settng C B = 0: W Ψ 1 (W Bs x )s + ηnφ 1 (B µ) = 0. (9) We can solve the equaton ether drectly or by a conjugate gradent method. After updatng B, we orthogonalze t by a Gram-Schmdt procedure. 3.3 Algorthm The fnal algorthm s summarzed below: 1. ntalze g, s and B. 2. for = 1,..., N, mnmze C over g by multscale regstraton. 3. for = 1,..., N, solve (7) for s by nverson. 4. solve (9) for B by scaled conjugate gradent. 5. orthogonalze B by Gram-Schmdt procedure. 6. repeat 2 5 untl convergence.

6 4 APPLICATIONS TO FACE RECOGNITION In ths secton we perform predcton and recognton experments wth real mages from the Yale face and CMU-PIE databases. 4.1 Yale Face Database The Yale face database (Georghades et al., 2001) conssts of mages from 10 subjects under 9 dfferent poses and 43 dfferent lghtng condtons. 1 From the orgnal mages we roughly crop face regons and resze them to mages (D = 1600). Each mage s then normalzed to have the same sum-of-squares. All mages are globally rescaled to have the mn/max value of 0/1. As a tranng set of each subject we randomly select two mages wth arbtrary lghtng condton per pose, to get a total of 2 9 = 18 mages of unknown pose and llumnaton of the subject. The test set of each subject comprses all remanng mages whch are not n the tranng set ( = 369) of the subject. The 43 lghtng condtons n the test set are dvded nto four subsets as explaned n (Georghades et al., 2001) accordng to the angle the lght source drecton makes wth the frontal drecton. The four subsets conssts of 6, 12, 12, and 13 lghtng condtons respectvely wth ncreasng angles. We generated multple pars of tranng/test sets to get averaged results from random choces of tranng set. 4.2 CMU PIE Database The CMU-PIE database (Sm et al., 2003) conssts of mages from 68 subjects under 13 dfferent poses and 43 dfferent lghtng condtons. We arbtrarly chose the same number (=10) of subjects as the Yale face n our tests.among 13 orgnal camera poses, we have chosen 7 poses whose angles wth the frontal camera pose are roughly less than 40, 2 and 21 lghtng condtons wthout background lghts. We smlarly detect and crop face regons from the orgnal data to a sze of and rescale the ntensty. As a tranng set of each subject we randomly select two mages of arbtrary lghtng condton 1 two of the lghtng condtons ( A-005E+10 and A+050E-40 ) are dropped due to erroneous recordng. 2 cameras numbered 05, 07, 09, 11, 27, 29, 37 per pose to get a total of 2 7 = 14 mages of unknown pose and llumnaton of the subject. The test set of each subject comprses all remanng mages whch are not n the tranng set ( = 133) of the subject. We also dvded the testng set nto three subsets, accordng to the angle the lght source drecton makes wth the frontal axs (0 20, 20 35, ). The four subsets conssts of 7, 6, and 8 lghtng condtons respectvely. We also generated multple pars of tranng/test sets for CMU PIE. 4.3 Parameter Selecton In an earler secton we emprcally determned the value of d and Ψ from synthetc data. Smlarly, we manually chose the parameters {λ, η, Φ} by expermentng wth synthetc faces. The λ relates to the amount of warpng and {η, Φ} relates to the smoothness of mages. As these parameters do not reflect the pecularty of each person, we can the same values for the Yale face and CMU PIE database as the values for synthetc data wthout exhaustve fne-tunngs. 4.4 Predcton Results We demonstrate the advantage of havng a nonlnear warpng to a lnear subspace model n predcton. From 18 (and 14) mages of a person from the Yale face (and CMU PIE) database, we learn the two sets of bases: Lnear subspace: 5-dmensonal bass B j ln s computed from SVD of the tranng data of j-th subject. The predcton ˆx s gven by ˆx = B j ln (Bj ln ) x. Warped subspace: 5-dmensonal bass B j warp, warpng varable g j, and lght coeffcents s j are computed from the tranng data of j-th subject, by mnmzng the MAP cost (8) teratvely from the ntal value B j ln. The predcton ˆx s gven by ˆx = W g j B j warps j. Fgure 4 shows sample results from the two methods. Quanttatve evaluatons are performed as follows. Predcton error for each mage s defned as the fractonal error between true the mage x and the predcted mage ˆx: err = x ˆx 2 / x 2 averaged over all test mages. The result s shown n Table 1. Our method reduces the error to percent of the error from the lnear model.

7 Orgnal Lnear subspace Warped subspace Lnear subspace Warped subspace Learned bass : Orgnal Learned bass : Fgure 4: Experments wth the Yale face (upper) and CMU PIE (lower) databases. Reconstructons of the orgnal mages wth a lnear subspace model (mddle) and wth a warped subspace model (rght) are compared along wth the learned bases from the two methods. The warped subspace model shows ncreased resolutons and sharpness n the learned bass and the reconstructed mages. Subset # Lnear Warped Subset # Lnear Warped Table 1: Average predcton error kx x k2 /kxk2 of lnear vs warped subspace models from the Yale face (upper) and and CMU PIE (lower) databases. 4.5 Recognton Results We compare recognton performance of our method wth four other standard appearancebased methods suggested n (Georghades et al., 2001). These nclude the nearest-neghbor classfers whch do not use subject dentty n tranng: correlaton, egenface, and egenface wthout the frst three egenvectors. For these we have used 50 egenvectors. The other two methods are the same as n the predcton experments (lnear subspace and warped subspace). The average recognton errors were computed over all condtons and all subjects from Yale face and CMU PIE databases, shown n Fg CONCLUSION The Egenface s an almost two-decade old subspace model. Stll, t serves as a fundamental mage-based model due to ts smplcty. In ths work we revamped the subspace model to a warped subspace model whch can cope wth both the lnear varablty n llumnaton and the nonlnear varablty n pose. Gven a few tranng mages, the model can estmate the bass, pose and llumnaton condtons smultaneously va MAP estmaton and multscale regstraton technque. Expermental results confrm the advantage of the warped subspace model over the standard magebased models n predcton and recognton tasks.

8 Yale face CMU PIE Error rate corr eg egwo3 lnear warped Subset # Subset # Fgure 5: Average recognton error of fve algorthms for the Yale face (left) and CMU PIE (rght) databases. The warped subspace model acheves the smallest error across dfferent test subsets of lghtng varatons. We are currently workng on ncreasng the range of pose our model can handle. REFERENCES Basr, R. and Jacobs, D. W. (2003). Lambertan reflectance and lnear subspaces. IEEE Trans. Pattern Analyss and Machne Intellgence, 25(2): Capel, D. and Zsserman, A. (2003). Computer vson appled to super resoluton. IEEE Sgnal Processng Magazne, 20(3): Capel, D. P. and Zsserman, A. (2001). Superresoluton from multple vews usng learnt mage models. In CVPR, volume 2, pages Epsten, R., Hallnan, P., and Yulle, A. (1995). 5 ± 2 Egenmages suffce: An emprcal nvestgaton of low-dmensonal lghtng models. In Proceedngs of IEEE Workshop on Physcs-Based Modelng n Computer Vson, pages Frey, B. J. and Jojc, N. (1999). Transformed component analyss: Jont estmaton of spatal transformatons and mage components. In ICCV, page 1190, Washngton, DC, USA. IEEE Computer Socety. Georghades, A. S., Belhumeur, P. N., and Kregman, D. J. (2001). From few to many: Illumnaton cone models for face recognton under varable lghtng and pose. IEEE Trans. Pattern Analyss and Machne Intellgence, 23(6): Gross, R., Matthews, I., and Baker, S. (2002a). Egen lght-felds and face recognton across pose. In FGR 02: Proceedngs of the Ffth IEEE Internatonal Conference on Automatc Face and Gesture Recognton, page 3, Washngton, DC, USA. IEEE Computer Socety. Gross, R., Matthews, I., and Baker, S. (2002b). Fsher lght-felds for face recognton across pose and llumnaton. In Proceedngs of the 24th DAGM Symposum on Pattern Recognton, pages , London, UK. Sprnger-Verlag. Gunturk, B. K., Batur, A. U., Altunbasak, Y., III, M. H. H., and Mersereau, R. M. (2003). Egenfacedoman super-resoluton for face recognton. IEEE Trans. Image Processng, 12(5): Hallnan, P. (1994). A low-dmensonal representaton of human faces for arbtrary lghtng condtons. In Proc. IEEE Conf. Computer Vson and Pattern Recognton, pages Harde, R. C., Barnard, K. J., and Armstrong, E. E. (1997). Jont MAP regstraton and hghresoluton mage estmaton usng a sequence of undersampled mages. IEEE Trans. Image Processng, 6(12): Ramamoorth, R. (2002). Analytc PCA constructon for theoretcal analyss of lghtng varablty n mages of a Lambertan object. IEEE Trans. Pattern Analyss and Machne Intellgence, 24(10): Sm, T., Baker, S., and Bsat, M. (2003). The CMU pose, llumnaton, and expresson (PIE) database. IEEE Trans. Pattern Analyss and Machne Intellgence, 25(12): Tppng, M. E. and Bshop, C. M. (2002). Bayesan mage super-resoluton. In Becker, S., Thrun, S., and Obermayer, K., edtors, NIPS, pages MIT Press. Turk, M. and Pentland, A. P. (1991). Egenfaces for recognton. Journal of Cogntve Neuroscence, 3(1): Vasconcelos, N. and Lppman, A. (2005). A multresoluton manfold dstance for nvarant mage smlarty. IEEE Trans. Multmeda, 7(1): Zhou, S. K. and Chellappa, R. (2004). Illumnatng lght feld: Image-based face recognton across llumnatons and poses. In FGR, pages IEEE Computer Socety.

Face Recognition University at Buffalo CSE666 Lecture Slides Resources:

Face Recognition University at Buffalo CSE666 Lecture Slides Resources: Face Recognton Unversty at Buffalo CSE666 Lecture Sldes Resources: http://www.face-rec.org/algorthms/ Overvew of face recognton algorthms Correlaton - Pxel based correspondence between two face mages Structural

More information

Object Recognition Based on Photometric Alignment Using Random Sample Consensus

Object Recognition Based on Photometric Alignment Using Random Sample Consensus Vol. 44 No. SIG 9(CVIM 7) July 2003 3 attached shadow photometrc algnment RANSAC RANdom SAmple Consensus Yale Face Database B RANSAC Object Recognton Based on Photometrc Algnment Usng Random Sample Consensus

More information

Improvement of Spatial Resolution Using BlockMatching Based Motion Estimation and Frame. Integration

Improvement of Spatial Resolution Using BlockMatching Based Motion Estimation and Frame. Integration Improvement of Spatal Resoluton Usng BlockMatchng Based Moton Estmaton and Frame Integraton Danya Suga and Takayuk Hamamoto Graduate School of Engneerng, Tokyo Unversty of Scence, 6-3-1, Nuku, Katsuska-ku,

More information

Feature Reduction and Selection

Feature Reduction and Selection Feature Reducton and Selecton Dr. Shuang LIANG School of Software Engneerng TongJ Unversty Fall, 2012 Today s Topcs Introducton Problems of Dmensonalty Feature Reducton Statstc methods Prncpal Components

More information

CS 534: Computer Vision Model Fitting

CS 534: Computer Vision Model Fitting CS 534: Computer Vson Model Fttng Sprng 004 Ahmed Elgammal Dept of Computer Scence CS 534 Model Fttng - 1 Outlnes Model fttng s mportant Least-squares fttng Maxmum lkelhood estmaton MAP estmaton Robust

More information

Learning the Kernel Parameters in Kernel Minimum Distance Classifier

Learning the Kernel Parameters in Kernel Minimum Distance Classifier Learnng the Kernel Parameters n Kernel Mnmum Dstance Classfer Daoqang Zhang 1,, Songcan Chen and Zh-Hua Zhou 1* 1 Natonal Laboratory for Novel Software Technology Nanjng Unversty, Nanjng 193, Chna Department

More information

Determining the Optimal Bandwidth Based on Multi-criterion Fusion

Determining the Optimal Bandwidth Based on Multi-criterion Fusion Proceedngs of 01 4th Internatonal Conference on Machne Learnng and Computng IPCSIT vol. 5 (01) (01) IACSIT Press, Sngapore Determnng the Optmal Bandwdth Based on Mult-crteron Fuson Ha-L Lang 1+, Xan-Mn

More information

An efficient method to build panoramic image mosaics

An efficient method to build panoramic image mosaics An effcent method to buld panoramc mage mosacs Pattern Recognton Letters vol. 4 003 Dae-Hyun Km Yong-In Yoon Jong-Soo Cho School of Electrcal Engneerng and Computer Scence Kyungpook Natonal Unv. Abstract

More information

A Binarization Algorithm specialized on Document Images and Photos

A Binarization Algorithm specialized on Document Images and Photos A Bnarzaton Algorthm specalzed on Document mages and Photos Ergna Kavalleratou Dept. of nformaton and Communcaton Systems Engneerng Unversty of the Aegean kavalleratou@aegean.gr Abstract n ths paper, a

More information

S1 Note. Basis functions.

S1 Note. Basis functions. S1 Note. Bass functons. Contents Types of bass functons...1 The Fourer bass...2 B-splne bass...3 Power and type I error rates wth dfferent numbers of bass functons...4 Table S1. Smulaton results of type

More information

A Bilinear Model for Sparse Coding

A Bilinear Model for Sparse Coding A Blnear Model for Sparse Codng Davd B. Grmes and Rajesh P. N. Rao Department of Computer Scence and Engneerng Unversty of Washngton Seattle, WA 98195-2350, U.S.A. grmes,rao @cs.washngton.edu Abstract

More information

Content Based Image Retrieval Using 2-D Discrete Wavelet with Texture Feature with Different Classifiers

Content Based Image Retrieval Using 2-D Discrete Wavelet with Texture Feature with Different Classifiers IOSR Journal of Electroncs and Communcaton Engneerng (IOSR-JECE) e-issn: 78-834,p- ISSN: 78-8735.Volume 9, Issue, Ver. IV (Mar - Apr. 04), PP 0-07 Content Based Image Retreval Usng -D Dscrete Wavelet wth

More information

Range images. Range image registration. Examples of sampling patterns. Range images and range surfaces

Range images. Range image registration. Examples of sampling patterns. Range images and range surfaces Range mages For many structured lght scanners, the range data forms a hghly regular pattern known as a range mage. he samplng pattern s determned by the specfc scanner. Range mage regstraton 1 Examples

More information

Subspace clustering. Clustering. Fundamental to all clustering techniques is the choice of distance measure between data points;

Subspace clustering. Clustering. Fundamental to all clustering techniques is the choice of distance measure between data points; Subspace clusterng Clusterng Fundamental to all clusterng technques s the choce of dstance measure between data ponts; D q ( ) ( ) 2 x x = x x, j k = 1 k jk Squared Eucldean dstance Assumpton: All features

More information

Outline. Discriminative classifiers for image recognition. Where in the World? A nearest neighbor recognition example 4/14/2011. CS 376 Lecture 22 1

Outline. Discriminative classifiers for image recognition. Where in the World? A nearest neighbor recognition example 4/14/2011. CS 376 Lecture 22 1 4/14/011 Outlne Dscrmnatve classfers for mage recognton Wednesday, Aprl 13 Krsten Grauman UT-Austn Last tme: wndow-based generc obect detecton basc ppelne face detecton wth boostng as case study Today:

More information

Classification of Face Images Based on Gender using Dimensionality Reduction Techniques and SVM

Classification of Face Images Based on Gender using Dimensionality Reduction Techniques and SVM Classfcaton of Face Images Based on Gender usng Dmensonalty Reducton Technques and SVM Fahm Mannan 260 266 294 School of Computer Scence McGll Unversty Abstract Ths report presents gender classfcaton based

More information

Multi-View Face Alignment Using 3D Shape Model for View Estimation

Multi-View Face Alignment Using 3D Shape Model for View Estimation Mult-Vew Face Algnment Usng 3D Shape Model for Vew Estmaton Yanchao Su 1, Hazhou A 1, Shhong Lao 1 Computer Scence and Technology Department, Tsnghua Unversty Core Technology Center, Omron Corporaton ahz@mal.tsnghua.edu.cn

More information

Support Vector Machines

Support Vector Machines /9/207 MIST.6060 Busness Intellgence and Data Mnng What are Support Vector Machnes? Support Vector Machnes Support Vector Machnes (SVMs) are supervsed learnng technques that analyze data and recognze patterns.

More information

Scan Conversion & Shading

Scan Conversion & Shading Scan Converson & Shadng Thomas Funkhouser Prnceton Unversty C0S 426, Fall 1999 3D Renderng Ppelne (for drect llumnaton) 3D Prmtves 3D Modelng Coordnates Modelng Transformaton 3D World Coordnates Lghtng

More information

Detection of an Object by using Principal Component Analysis

Detection of an Object by using Principal Component Analysis Detecton of an Object by usng Prncpal Component Analyss 1. G. Nagaven, 2. Dr. T. Sreenvasulu Reddy 1. M.Tech, Department of EEE, SVUCE, Trupath, Inda. 2. Assoc. Professor, Department of ECE, SVUCE, Trupath,

More information

Scan Conversion & Shading

Scan Conversion & Shading 1 3D Renderng Ppelne (for drect llumnaton) 2 Scan Converson & Shadng Adam Fnkelsten Prnceton Unversty C0S 426, Fall 2001 3DPrmtves 3D Modelng Coordnates Modelng Transformaton 3D World Coordnates Lghtng

More information

Collaboratively Regularized Nearest Points for Set Based Recognition

Collaboratively Regularized Nearest Points for Set Based Recognition Academc Center for Computng and Meda Studes, Kyoto Unversty Collaboratvely Regularzed Nearest Ponts for Set Based Recognton Yang Wu, Mchhko Mnoh, Masayuk Mukunok Kyoto Unversty 9/1/013 BMVC 013 @ Brstol,

More information

Face Recognition by Fusing Binary Edge Feature and Second-order Mutual Information

Face Recognition by Fusing Binary Edge Feature and Second-order Mutual Information Face Recognton by Fusng Bnary Edge Feature and Second-order Mutual Informaton Jatao Song, Bejng Chen, We Wang, Xaobo Ren School of Electronc and Informaton Engneerng, Nngbo Unversty of Technology Nngbo,

More information

Unsupervised Learning and Clustering

Unsupervised Learning and Clustering Unsupervsed Learnng and Clusterng Why consder unlabeled samples?. Collectng and labelng large set of samples s costly Gettng recorded speech s free, labelng s tme consumng 2. Classfer could be desgned

More information

A Fast Visual Tracking Algorithm Based on Circle Pixels Matching

A Fast Visual Tracking Algorithm Based on Circle Pixels Matching A Fast Vsual Trackng Algorthm Based on Crcle Pxels Matchng Zhqang Hou hou_zhq@sohu.com Chongzhao Han czhan@mal.xjtu.edu.cn Ln Zheng Abstract: A fast vsual trackng algorthm based on crcle pxels matchng

More information

LECTURE : MANIFOLD LEARNING

LECTURE : MANIFOLD LEARNING LECTURE : MANIFOLD LEARNING Rta Osadchy Some sldes are due to L.Saul, V. C. Raykar, N. Verma Topcs PCA MDS IsoMap LLE EgenMaps Done! Dmensonalty Reducton Data representaton Inputs are real-valued vectors

More information

Robust Dictionary Learning with Capped l 1 -Norm

Robust Dictionary Learning with Capped l 1 -Norm Proceedngs of the Twenty-Fourth Internatonal Jont Conference on Artfcal Intellgence (IJCAI 205) Robust Dctonary Learnng wth Capped l -Norm Wenhao Jang, Fepng Ne, Heng Huang Unversty of Texas at Arlngton

More information

Parallelism for Nested Loops with Non-uniform and Flow Dependences

Parallelism for Nested Loops with Non-uniform and Flow Dependences Parallelsm for Nested Loops wth Non-unform and Flow Dependences Sam-Jn Jeong Dept. of Informaton & Communcaton Engneerng, Cheonan Unversty, 5, Anseo-dong, Cheonan, Chungnam, 330-80, Korea. seong@cheonan.ac.kr

More information

Discriminative Dictionary Learning with Pairwise Constraints

Discriminative Dictionary Learning with Pairwise Constraints Dscrmnatve Dctonary Learnng wth Parwse Constrants Humn Guo Zhuoln Jang LARRY S. DAVIS UNIVERSITY OF MARYLAND Nov. 6 th, Outlne Introducton/motvaton Dctonary Learnng Dscrmnatve Dctonary Learnng wth Parwse

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 15

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 15 CS434a/541a: Pattern Recognton Prof. Olga Veksler Lecture 15 Today New Topc: Unsupervsed Learnng Supervsed vs. unsupervsed learnng Unsupervsed learnng Net Tme: parametrc unsupervsed learnng Today: nonparametrc

More information

Fitting & Matching. Lecture 4 Prof. Bregler. Slides from: S. Lazebnik, S. Seitz, M. Pollefeys, A. Effros.

Fitting & Matching. Lecture 4 Prof. Bregler. Slides from: S. Lazebnik, S. Seitz, M. Pollefeys, A. Effros. Fttng & Matchng Lecture 4 Prof. Bregler Sldes from: S. Lazebnk, S. Setz, M. Pollefeys, A. Effros. How do we buld panorama? We need to match (algn) mages Matchng wth Features Detect feature ponts n both

More information

Sum of Linear and Fractional Multiobjective Programming Problem under Fuzzy Rules Constraints

Sum of Linear and Fractional Multiobjective Programming Problem under Fuzzy Rules Constraints Australan Journal of Basc and Appled Scences, 2(4): 1204-1208, 2008 ISSN 1991-8178 Sum of Lnear and Fractonal Multobjectve Programmng Problem under Fuzzy Rules Constrants 1 2 Sanjay Jan and Kalash Lachhwan

More information

Recognizing Faces. Outline

Recognizing Faces. Outline Recognzng Faces Drk Colbry Outlne Introducton and Motvaton Defnng a feature vector Prncpal Component Analyss Lnear Dscrmnate Analyss !"" #$""% http://www.nfotech.oulu.f/annual/2004 + &'()*) '+)* 2 ! &

More information

Lecture 4: Principal components

Lecture 4: Principal components /3/6 Lecture 4: Prncpal components 3..6 Multvarate lnear regresson MLR s optmal for the estmaton data...but poor for handlng collnear data Covarance matrx s not nvertble (large condton number) Robustness

More information

A Robust Method for Estimating the Fundamental Matrix

A Robust Method for Estimating the Fundamental Matrix Proc. VIIth Dgtal Image Computng: Technques and Applcatons, Sun C., Talbot H., Ourseln S. and Adraansen T. (Eds.), 0- Dec. 003, Sydney A Robust Method for Estmatng the Fundamental Matrx C.L. Feng and Y.S.

More information

Support Vector Machines

Support Vector Machines Support Vector Machnes Decson surface s a hyperplane (lne n 2D) n feature space (smlar to the Perceptron) Arguably, the most mportant recent dscovery n machne learnng In a nutshell: map the data to a predetermned

More information

Classifier Selection Based on Data Complexity Measures *

Classifier Selection Based on Data Complexity Measures * Classfer Selecton Based on Data Complexty Measures * Edth Hernández-Reyes, J.A. Carrasco-Ochoa, and J.Fco. Martínez-Trndad Natonal Insttute for Astrophyscs, Optcs and Electroncs, Lus Enrque Erro No.1 Sta.

More information

Adaptive Transfer Learning

Adaptive Transfer Learning Adaptve Transfer Learnng Bn Cao, Snno Jaln Pan, Yu Zhang, Dt-Yan Yeung, Qang Yang Hong Kong Unversty of Scence and Technology Clear Water Bay, Kowloon, Hong Kong {caobn,snnopan,zhangyu,dyyeung,qyang}@cse.ust.hk

More information

MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION

MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION Paulo Quntlano 1 & Antono Santa-Rosa 1 Federal Polce Department, Brasla, Brazl. E-mals: quntlano.pqs@dpf.gov.br and

More information

Competitive Sparse Representation Classification for Face Recognition

Competitive Sparse Representation Classification for Face Recognition Vol. 6, No. 8, 05 Compettve Sparse Representaton Classfcaton for Face Recognton Yng Lu Chongqng Key Laboratory of Computatonal Intellgence Chongqng Unversty of Posts and elecommuncatons Chongqng, Chna

More information

An Application of the Dulmage-Mendelsohn Decomposition to Sparse Null Space Bases of Full Row Rank Matrices

An Application of the Dulmage-Mendelsohn Decomposition to Sparse Null Space Bases of Full Row Rank Matrices Internatonal Mathematcal Forum, Vol 7, 2012, no 52, 2549-2554 An Applcaton of the Dulmage-Mendelsohn Decomposton to Sparse Null Space Bases of Full Row Rank Matrces Mostafa Khorramzadeh Department of Mathematcal

More information

Image Alignment CSC 767

Image Alignment CSC 767 Image Algnment CSC 767 Image algnment Image from http://graphcs.cs.cmu.edu/courses/15-463/2010_fall/ Image algnment: Applcatons Panorama sttchng Image algnment: Applcatons Recognton of object nstances

More information

An Entropy-Based Approach to Integrated Information Needs Assessment

An Entropy-Based Approach to Integrated Information Needs Assessment Dstrbuton Statement A: Approved for publc release; dstrbuton s unlmted. An Entropy-Based Approach to ntegrated nformaton Needs Assessment June 8, 2004 Wllam J. Farrell Lockheed Martn Advanced Technology

More information

FEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur

FEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur FEATURE EXTRACTION Dr. K.Vjayarekha Assocate Dean School of Electrcal and Electroncs Engneerng SASTRA Unversty, Thanjavur613 41 Jont Intatve of IITs and IISc Funded by MHRD Page 1 of 8 Table of Contents

More information

Tsinghua University at TAC 2009: Summarizing Multi-documents by Information Distance

Tsinghua University at TAC 2009: Summarizing Multi-documents by Information Distance Tsnghua Unversty at TAC 2009: Summarzng Mult-documents by Informaton Dstance Chong Long, Mnle Huang, Xaoyan Zhu State Key Laboratory of Intellgent Technology and Systems, Tsnghua Natonal Laboratory for

More information

Lobachevsky State University of Nizhni Novgorod. Polyhedron. Quick Start Guide

Lobachevsky State University of Nizhni Novgorod. Polyhedron. Quick Start Guide Lobachevsky State Unversty of Nzhn Novgorod Polyhedron Quck Start Gude Nzhn Novgorod 2016 Contents Specfcaton of Polyhedron software... 3 Theoretcal background... 4 1. Interface of Polyhedron... 6 1.1.

More information

The Quotient Image: Class Based Re-rendering and Recognition With Varying Illuminations

The Quotient Image: Class Based Re-rendering and Recognition With Varying Illuminations The Quotent Image: Class Based Re-renderng and Recognton Wth Varyng Illumnatons Tammy Rkln-Ravv and Amnon Shashua Insttute of Computer Scence, The Hebrew Unversty, Jerusalem 91904, Israel e-mal: ftammy,

More information

Robust Face Alignment for Illumination and Pose Invariant Face Recognition

Robust Face Alignment for Illumination and Pose Invariant Face Recognition Robust Face Algnment for Illumnaton and Pose Invarant Face Recognton Fath Kahraman 1, Bnnur Kurt 2, Muhttn Gökmen 2 Istanbul Techncal Unversty, 1 Informatcs Insttute, 2 Computer Engneerng Department 34469

More information

Integrated Expression-Invariant Face Recognition with Constrained Optical Flow

Integrated Expression-Invariant Face Recognition with Constrained Optical Flow Integrated Expresson-Invarant Face Recognton wth Constraned Optcal Flow Chao-Kue Hseh, Shang-Hong La 2, and Yung-Chang Chen Department of Electrcal Engneerng, Natonal Tsng Hua Unversty, Tawan 2 Department

More information

SVM-based Learning for Multiple Model Estimation

SVM-based Learning for Multiple Model Estimation SVM-based Learnng for Multple Model Estmaton Vladmr Cherkassky and Yunqan Ma Department of Electrcal and Computer Engneerng Unversty of Mnnesota Mnneapols, MN 55455 {cherkass,myq}@ece.umn.edu Abstract:

More information

Multi-stable Perception. Necker Cube

Multi-stable Perception. Necker Cube Mult-stable Percepton Necker Cube Spnnng dancer lluson, Nobuuk Kaahara Fttng and Algnment Computer Vson Szelsk 6.1 James Has Acknowledgment: Man sldes from Derek Hoem, Lana Lazebnk, and Grauman&Lebe 2008

More information

Registration of Expressions Data using a 3D Morphable Model

Registration of Expressions Data using a 3D Morphable Model Regstraton of Expressons Data usng a 3D Morphable Model Curzo Basso DISI, Unverstà d Genova, Italy Emal: curzo.basso@ds.unge.t Thomas Vetter Departement Informatk, Unverstät Basel, Swtzerland Emal: thomas.vetter@unbas.ch

More information

Computer Animation and Visualisation. Lecture 4. Rigging / Skinning

Computer Animation and Visualisation. Lecture 4. Rigging / Skinning Computer Anmaton and Vsualsaton Lecture 4. Rggng / Sknnng Taku Komura Overvew Sknnng / Rggng Background knowledge Lnear Blendng How to decde weghts? Example-based Method Anatomcal models Sknnng Assume

More information

Lecture 5: Multilayer Perceptrons

Lecture 5: Multilayer Perceptrons Lecture 5: Multlayer Perceptrons Roger Grosse 1 Introducton So far, we ve only talked about lnear models: lnear regresson and lnear bnary classfers. We noted that there are functons that can t be represented

More information

High-Boost Mesh Filtering for 3-D Shape Enhancement

High-Boost Mesh Filtering for 3-D Shape Enhancement Hgh-Boost Mesh Flterng for 3-D Shape Enhancement Hrokazu Yagou Λ Alexander Belyaev y Damng We z Λ y z ; ; Shape Modelng Laboratory, Unversty of Azu, Azu-Wakamatsu 965-8580 Japan y Computer Graphcs Group,

More information

Computer Vision I. Xbox Kinnect: Rectification. The Fundamental matrix. Stereo III. CSE252A Lecture 16. Example: forward motion

Computer Vision I. Xbox Kinnect: Rectification. The Fundamental matrix. Stereo III. CSE252A Lecture 16. Example: forward motion Xbox Knnect: Stereo III Depth map http://www.youtube.com/watch?v=7qrnwoo-8a CSE5A Lecture 6 Projected pattern http://www.youtube.com/watch?v=ceep7x-z4wy The Fundamental matrx Rectfcaton The eppolar constrant

More information

Corner-Based Image Alignment using Pyramid Structure with Gradient Vector Similarity

Corner-Based Image Alignment using Pyramid Structure with Gradient Vector Similarity Journal of Sgnal and Informaton Processng, 013, 4, 114-119 do:10.436/jsp.013.43b00 Publshed Onlne August 013 (http://www.scrp.org/journal/jsp) Corner-Based Image Algnment usng Pyramd Structure wth Gradent

More information

SLAM Summer School 2006 Practical 2: SLAM using Monocular Vision

SLAM Summer School 2006 Practical 2: SLAM using Monocular Vision SLAM Summer School 2006 Practcal 2: SLAM usng Monocular Vson Javer Cvera, Unversty of Zaragoza Andrew J. Davson, Imperal College London J.M.M Montel, Unversty of Zaragoza. josemar@unzar.es, jcvera@unzar.es,

More information

Learning a Class-Specific Dictionary for Facial Expression Recognition

Learning a Class-Specific Dictionary for Facial Expression Recognition BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 16, No 4 Sofa 016 Prnt ISSN: 1311-970; Onlne ISSN: 1314-4081 DOI: 10.1515/cat-016-0067 Learnng a Class-Specfc Dctonary for

More information

Human Face Recognition Using Generalized. Kernel Fisher Discriminant

Human Face Recognition Using Generalized. Kernel Fisher Discriminant Human Face Recognton Usng Generalzed Kernel Fsher Dscrmnant ng-yu Sun,2 De-Shuang Huang Ln Guo. Insttute of Intellgent Machnes, Chnese Academy of Scences, P.O.ox 30, Hefe, Anhu, Chna. 2. Department of

More information

Outline. Type of Machine Learning. Examples of Application. Unsupervised Learning

Outline. Type of Machine Learning. Examples of Application. Unsupervised Learning Outlne Artfcal Intellgence and ts applcatons Lecture 8 Unsupervsed Learnng Professor Danel Yeung danyeung@eee.org Dr. Patrck Chan patrckchan@eee.org South Chna Unversty of Technology, Chna Introducton

More information

What are the camera parameters? Where are the light sources? What is the mapping from radiance to pixel color? Want to solve for 3D geometry

What are the camera parameters? Where are the light sources? What is the mapping from radiance to pixel color? Want to solve for 3D geometry Today: Calbraton What are the camera parameters? Where are the lght sources? What s the mappng from radance to pel color? Why Calbrate? Want to solve for D geometry Alternatve approach Solve for D shape

More information

Histogram-Enhanced Principal Component Analysis for Face Recognition

Histogram-Enhanced Principal Component Analysis for Face Recognition Hstogram-Enhanced Prncpal Component Analyss for Face ecognton Ana-ara Sevcenco and Wu-Sheng Lu Dept. of Electrcal and Computer Engneerng Unversty of Vctora sevcenco@engr.uvc.ca, wslu@ece.uvc.ca Abstract

More information

Ecient Computation of the Most Probable Motion from Fuzzy. Moshe Ben-Ezra Shmuel Peleg Michael Werman. The Hebrew University of Jerusalem

Ecient Computation of the Most Probable Motion from Fuzzy. Moshe Ben-Ezra Shmuel Peleg Michael Werman. The Hebrew University of Jerusalem Ecent Computaton of the Most Probable Moton from Fuzzy Correspondences Moshe Ben-Ezra Shmuel Peleg Mchael Werman Insttute of Computer Scence The Hebrew Unversty of Jerusalem 91904 Jerusalem, Israel Emal:

More information

Parallel Numerics. 1 Preconditioning & Iterative Solvers (From 2016)

Parallel Numerics. 1 Preconditioning & Iterative Solvers (From 2016) Technsche Unverstät München WSe 6/7 Insttut für Informatk Prof. Dr. Thomas Huckle Dpl.-Math. Benjamn Uekermann Parallel Numercs Exercse : Prevous Exam Questons Precondtonng & Iteratve Solvers (From 6)

More information

Analysis of Continuous Beams in General

Analysis of Continuous Beams in General Analyss of Contnuous Beams n General Contnuous beams consdered here are prsmatc, rgdly connected to each beam segment and supported at varous ponts along the beam. onts are selected at ponts of support,

More information

Feature Extraction Based on Maximum Nearest Subspace Margin Criterion

Feature Extraction Based on Maximum Nearest Subspace Margin Criterion Neural Process Lett DOI 10.7/s11063-012-9252-y Feature Extracton Based on Maxmum Nearest Subspace Margn Crteron Y Chen Zhenzhen L Zhong Jn Sprnger Scence+Busness Meda New York 2012 Abstract Based on the

More information

12/2/2009. Announcements. Parametric / Non-parametric. Case-Based Reasoning. Nearest-Neighbor on Images. Nearest-Neighbor Classification

12/2/2009. Announcements. Parametric / Non-parametric. Case-Based Reasoning. Nearest-Neighbor on Images. Nearest-Neighbor Classification Introducton to Artfcal Intellgence V22.0472-001 Fall 2009 Lecture 24: Nearest-Neghbors & Support Vector Machnes Rob Fergus Dept of Computer Scence, Courant Insttute, NYU Sldes from Danel Yeung, John DeNero

More information

Prof. Feng Liu. Spring /24/2017

Prof. Feng Liu. Spring /24/2017 Prof. Feng Lu Sprng 2017 ttp://www.cs.pd.edu/~flu/courses/cs510/ 05/24/2017 Last me Compostng and Mattng 2 oday Vdeo Stablzaton Vdeo stablzaton ppelne 3 Orson Welles, ouc of Evl, 1958 4 Images courtesy

More information

Skew Angle Estimation and Correction of Hand Written, Textual and Large areas of Non-Textual Document Images: A Novel Approach

Skew Angle Estimation and Correction of Hand Written, Textual and Large areas of Non-Textual Document Images: A Novel Approach Angle Estmaton and Correcton of Hand Wrtten, Textual and Large areas of Non-Textual Document Images: A Novel Approach D.R.Ramesh Babu Pyush M Kumat Mahesh D Dhannawat PES Insttute of Technology Research

More information

Fuzzy Filtering Algorithms for Image Processing: Performance Evaluation of Various Approaches

Fuzzy Filtering Algorithms for Image Processing: Performance Evaluation of Various Approaches Proceedngs of the Internatonal Conference on Cognton and Recognton Fuzzy Flterng Algorthms for Image Processng: Performance Evaluaton of Varous Approaches Rajoo Pandey and Umesh Ghanekar Department of

More information

MOTION BLUR ESTIMATION AT CORNERS

MOTION BLUR ESTIMATION AT CORNERS Gacomo Boracch and Vncenzo Caglot Dpartmento d Elettronca e Informazone, Poltecnco d Mlano, Va Ponzo, 34/5-20133 MILANO boracch@elet.polm.t, caglot@elet.polm.t Keywords: Abstract: Pont Spread Functon Parameter

More information

TN348: Openlab Module - Colocalization

TN348: Openlab Module - Colocalization TN348: Openlab Module - Colocalzaton Topc The Colocalzaton module provdes the faclty to vsualze and quantfy colocalzaton between pars of mages. The Colocalzaton wndow contans a prevew of the two mages

More information

Announcements. Supervised Learning

Announcements. Supervised Learning Announcements See Chapter 5 of Duda, Hart, and Stork. Tutoral by Burge lnked to on web page. Supervsed Learnng Classfcaton wth labeled eamples. Images vectors n hgh-d space. Supervsed Learnng Labeled eamples

More information

6.854 Advanced Algorithms Petar Maymounkov Problem Set 11 (November 23, 2005) With: Benjamin Rossman, Oren Weimann, and Pouya Kheradpour

6.854 Advanced Algorithms Petar Maymounkov Problem Set 11 (November 23, 2005) With: Benjamin Rossman, Oren Weimann, and Pouya Kheradpour 6.854 Advanced Algorthms Petar Maymounkov Problem Set 11 (November 23, 2005) Wth: Benjamn Rossman, Oren Wemann, and Pouya Kheradpour Problem 1. We reduce vertex cover to MAX-SAT wth weghts, such that the

More information

PCA Based Gait Segmentation

PCA Based Gait Segmentation Honggu L, Cupng Sh & Xngguo L PCA Based Gat Segmentaton PCA Based Gat Segmentaton Honggu L, Cupng Sh, and Xngguo L 2 Electronc Department, Physcs College, Yangzhou Unversty, 225002 Yangzhou, Chna 2 Department

More information

Reducing Frame Rate for Object Tracking

Reducing Frame Rate for Object Tracking Reducng Frame Rate for Object Trackng Pavel Korshunov 1 and We Tsang Oo 2 1 Natonal Unversty of Sngapore, Sngapore 11977, pavelkor@comp.nus.edu.sg 2 Natonal Unversty of Sngapore, Sngapore 11977, oowt@comp.nus.edu.sg

More information

Face Recognition Based on SVM and 2DPCA

Face Recognition Based on SVM and 2DPCA Vol. 4, o. 3, September, 2011 Face Recognton Based on SVM and 2DPCA Tha Hoang Le, Len Bu Faculty of Informaton Technology, HCMC Unversty of Scence Faculty of Informaton Scences and Engneerng, Unversty

More information

Cluster Analysis of Electrical Behavior

Cluster Analysis of Electrical Behavior Journal of Computer and Communcatons, 205, 3, 88-93 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/cc http://dx.do.org/0.4236/cc.205.350 Cluster Analyss of Electrcal Behavor Ln Lu Ln Lu, School

More information

Tone-Aware Sparse Representation for Face Recognition

Tone-Aware Sparse Representation for Face Recognition Tone-Aware Sparse Representaton for Face Recognton Lngfeng Wang, Huayu Wu and Chunhong Pan Abstract It s stll a very challengng task to recognze a face n a real world scenaro, snce the face may be corrupted

More information

A Background Subtraction for a Vision-based User Interface *

A Background Subtraction for a Vision-based User Interface * A Background Subtracton for a Vson-based User Interface * Dongpyo Hong and Woontack Woo KJIST U-VR Lab. {dhon wwoo}@kjst.ac.kr Abstract In ths paper, we propose a robust and effcent background subtracton

More information

EYE CENTER LOCALIZATION ON A FACIAL IMAGE BASED ON MULTI-BLOCK LOCAL BINARY PATTERNS

EYE CENTER LOCALIZATION ON A FACIAL IMAGE BASED ON MULTI-BLOCK LOCAL BINARY PATTERNS P.G. Demdov Yaroslavl State Unversty Anatoly Ntn, Vladmr Khryashchev, Olga Stepanova, Igor Kostern EYE CENTER LOCALIZATION ON A FACIAL IMAGE BASED ON MULTI-BLOCK LOCAL BINARY PATTERNS Yaroslavl, 2015 Eye

More information

Biostatistics 615/815

Biostatistics 615/815 The E-M Algorthm Bostatstcs 615/815 Lecture 17 Last Lecture: The Smplex Method General method for optmzaton Makes few assumptons about functon Crawls towards mnmum Some recommendatons Multple startng ponts

More information

Learning the Multilinear Structure of Visual Data

Learning the Multilinear Structure of Visual Data Learnng the Multlnear Structure of Vsual Data Mengjao Wang Yanns Panagaks Patrck Snape Stefanos Zaferou Imperal College London {m.wang15,.panagaks,p.snape,s.zaferou}@mperal.ac.uk Abstract Statstcal decomposton

More information

A Scalable Projective Bundle Adjustment Algorithm using the L Norm

A Scalable Projective Bundle Adjustment Algorithm using the L Norm Sxth Indan Conference on Computer Vson, Graphcs & Image Processng A Scalable Projectve Bundle Adjustment Algorthm usng the Norm Kaushk Mtra and Rama Chellappa Dept. of Electrcal and Computer Engneerng

More information

A Range Image Refinement Technique for Multi-view 3D Model Reconstruction

A Range Image Refinement Technique for Multi-view 3D Model Reconstruction A Range Image Refnement Technque for Mult-vew 3D Model Reconstructon Soon-Yong Park and Mural Subbarao Electrcal and Computer Engneerng State Unversty of New York at Stony Brook, USA E-mal: parksy@ece.sunysb.edu

More information

Problem Definitions and Evaluation Criteria for Computational Expensive Optimization

Problem Definitions and Evaluation Criteria for Computational Expensive Optimization Problem efntons and Evaluaton Crtera for Computatonal Expensve Optmzaton B. Lu 1, Q. Chen and Q. Zhang 3, J. J. Lang 4, P. N. Suganthan, B. Y. Qu 6 1 epartment of Computng, Glyndwr Unversty, UK Faclty

More information

A Fast Content-Based Multimedia Retrieval Technique Using Compressed Data

A Fast Content-Based Multimedia Retrieval Technique Using Compressed Data A Fast Content-Based Multmeda Retreval Technque Usng Compressed Data Borko Furht and Pornvt Saksobhavvat NSF Multmeda Laboratory Florda Atlantc Unversty, Boca Raton, Florda 3343 ABSTRACT In ths paper,

More information

Machine Learning. Topic 6: Clustering

Machine Learning. Topic 6: Clustering Machne Learnng Topc 6: lusterng lusterng Groupng data nto (hopefully useful) sets. Thngs on the left Thngs on the rght Applcatons of lusterng Hypothess Generaton lusters mght suggest natural groups. Hypothess

More information

Structure from Motion

Structure from Motion Structure from Moton Structure from Moton For now, statc scene and movng camera Equvalentl, rgdl movng scene and statc camera Lmtng case of stereo wth man cameras Lmtng case of multvew camera calbraton

More information

On Modeling Variations For Face Authentication

On Modeling Variations For Face Authentication On Modelng Varatons For Face Authentcaton Xaomng Lu Tsuhan Chen B.V.K. Vjaya Kumar Department of Electrcal and Computer Engneerng, Carnege Mellon Unversty Abstract In ths paper, we present a scheme for

More information

Image Representation & Visualization Basic Imaging Algorithms Shape Representation and Analysis. outline

Image Representation & Visualization Basic Imaging Algorithms Shape Representation and Analysis. outline mage Vsualzaton mage Vsualzaton mage Representaton & Vsualzaton Basc magng Algorthms Shape Representaton and Analyss outlne mage Representaton & Vsualzaton Basc magng Algorthms Shape Representaton and

More information

Calibrating a single camera. Odilon Redon, Cyclops, 1914

Calibrating a single camera. Odilon Redon, Cyclops, 1914 Calbratng a sngle camera Odlon Redon, Cclops, 94 Our goal: Recover o 3D structure Recover o structure rom one mage s nherentl ambguous??? Sngle-vew ambgut Sngle-vew ambgut Rashad Alakbarov shadow sculptures

More information

Assignment # 2. Farrukh Jabeen Algorithms 510 Assignment #2 Due Date: June 15, 2009.

Assignment # 2. Farrukh Jabeen Algorithms 510 Assignment #2 Due Date: June 15, 2009. Farrukh Jabeen Algorthms 51 Assgnment #2 Due Date: June 15, 29. Assgnment # 2 Chapter 3 Dscrete Fourer Transforms Implement the FFT for the DFT. Descrbed n sectons 3.1 and 3.2. Delverables: 1. Concse descrpton

More information

IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. *, NO. *, Dictionary Pair Learning on Grassmann Manifolds for Image Denoising

IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. *, NO. *, Dictionary Pair Learning on Grassmann Manifolds for Image Denoising IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. *, NO. *, 2015 1 Dctonary Par Learnng on Grassmann Manfolds for Image Denosng Xanhua Zeng, We Ban, We Lu, Jale Shen, Dacheng Tao, Fellow, IEEE Abstract Image

More information

An Image Fusion Approach Based on Segmentation Region

An Image Fusion Approach Based on Segmentation Region Rong Wang, L-Qun Gao, Shu Yang, Yu-Hua Cha, and Yan-Chun Lu An Image Fuson Approach Based On Segmentaton Regon An Image Fuson Approach Based on Segmentaton Regon Rong Wang, L-Qun Gao, Shu Yang 3, Yu-Hua

More information

2x x l. Module 3: Element Properties Lecture 4: Lagrange and Serendipity Elements

2x x l. Module 3: Element Properties Lecture 4: Lagrange and Serendipity Elements Module 3: Element Propertes Lecture : Lagrange and Serendpty Elements 5 In last lecture note, the nterpolaton functons are derved on the bass of assumed polynomal from Pascal s trangle for the fled varable.

More information

Hermite Splines in Lie Groups as Products of Geodesics

Hermite Splines in Lie Groups as Products of Geodesics Hermte Splnes n Le Groups as Products of Geodescs Ethan Eade Updated May 28, 2017 1 Introducton 1.1 Goal Ths document defnes a curve n the Le group G parametrzed by tme and by structural parameters n the

More information

Kernel Collaborative Representation Classification Based on Adaptive Dictionary Learning

Kernel Collaborative Representation Classification Based on Adaptive Dictionary Learning Internatonal Journal of Intellgent Informaton Systems 2018; 7(2): 15-22 http://www.scencepublshnggroup.com/j/js do: 10.11648/j.js.20180702.11 ISSN: 2328-7675 (Prnt); ISSN: 2328-7683 (Onlne) Kernel Collaboratve

More information

Scale Selective Extended Local Binary Pattern For Texture Classification

Scale Selective Extended Local Binary Pattern For Texture Classification Scale Selectve Extended Local Bnary Pattern For Texture Classfcaton Yutng Hu, Zhlng Long, and Ghassan AlRegb Multmeda & Sensors Lab (MSL) Georga Insttute of Technology 03/09/017 Outlne Texture Representaton

More information