A robust model-based tracker combining geometrical and color edge information

Size: px
Start display at page:

Download "A robust model-based tracker combining geometrical and color edge information"

Transcription

1 213 IEEE/RSJ Internatonal Conference on Intellgent Robots and Systems (IROS) November 3-7, 213. Tokyo, Japan A robust model-based tracker combnng geometrcal and color edge nformaton Antone Pett, Erc Marchand, Keyvan Kanan Abstract Ths paper focuses on the ssue of estmatng the complete 3D pose of the camera wth respect to a potentally textureless object, through model-based trackng. We propose to robustly combne complementary geometrcal and color edgebased features n the mnmzaton process, and to ntegrate a multple-hypotheses framework n the geometrcal edge-based regstraton phase. In order to deal wth complex 3D models, our method takes advantage of GPU acceleraton. Promsng results, outperformng classcal state-of-art approaches, have been obtaned for space robotcs applcatons on varous real and synthetc mage sequences and usng satellte mock-ups as targets. I. INTRODUCTION Determnng the complete 3D pose of the camera wth respect to the object s a key requrement n many robotc applcatons nvolvng 3D objects, especally n the case of autonomous, vson-based and uncooperatve space rendezvous wth space targets or debrs [3], [15]. Based on the knowledge of the 3D model of the target, common approaches address ths problem by usng ether texture [2] or edge features [5], [6], [1], [15]. Edge features offer a good nvarance to llumnaton changes or mage nose, condtons whch can be encountered n space envronments and are partcularly sutable for poorly textured objects such as space objects. For such class of approaches, the pose computaton s acheved by mnmzng the dstance between the projected edges of the 3D model and the correspondng edge features n the mage, usng weghted numercal nonlnear optmzaton technques lke Newton-Raphson or Levenberg-Marquardt. But though they have proven ther effcency, ths technque requres an mage extracton process whch can nvolve outlers and, contrary to feature ponts whch can be specfcally descrbed, suffer from havng smlar appearances. It can result n ambgutes between dfferent edges, leadng to trackng falures, partcularly n the case of complex objects lke satelltes or space debrs. Thus we propose a method to mprove the accuracy and the robustness of 3D model-based trackng, whle preservng reasonable computatonal costs. A. Related works In the recent lterature could be dstngushed three dfferent knds of approaches tacklng ths problem: One soluton s to combne the nformaton provded by edges wth nformaton provded by other features, A. Pett s wth INRIA Rennes - Bretagne Atlantque, Lagadc Team, France, Antone.Gullaume.Pett@nra.fr E. Marchand s wth Unversté de Rennes 1, IRISA, Lagadc Team, France, Erc.Marchand@rsa.fr K. Kanan s wth Astrum, Toulouse, France such as nterest ponts [16], [17], [19], color [13], or by addtonal sensors [8]. Some researches have focused on the low-level robustness. To reject outlers n the edge matchng process, methods lke RANSAC [2], [4] or the use of M-Estmators such as the Tukey estmator [5], [19] are common trends to make the algorthm robust to occlusons and llumnaton varatons. Also, nstead of handlng a sngle hypothess for a potental edge n the mage, multple hypotheses are extracted and regstered n the pose estmaton [18], [19]. Other studes have consdered Bayesan flters such as Kalman flter [21] and more recently partcle flters [4], [9], [18]. For such methods, a set of hypotheses on the camera pose s propagated wth respect to a dynamc model. The pose s then estmated by evaluatng the lkelhood of the hypotheses n the mage. In [18] the partcle set s effcently guded from edge low-level hypotheses. A lmtaton of these methods often les n ther executon tme. We propose, n the sprt of [13], to ntegrate geometrcal and color features along edges n the pose estmaton phase. The general dea s to combne n the crteron to be optmzed a geometrcal nformaton provded by the dstances between model and mage edges wth a denser color nformaton through object/background color separaton statstcs along the model edges. A low-level multple hypotheses edge matchng process s also embedded n our framework. Lke n our prevous work [15], the model projecton and model edge generaton phase reles on the graphcs process unts (GPU) n order to handle complex 3D models, of any shape and to be reasonably tme-consumng. We choose to restrct to a sngle nonlnear mnmzaton n our pose estmaton technque due to computatonal lmts fxed by our applcaton, but ntegratng our method nto a partcle flterng framework, as n [4], [18] would also mprove performances. The remander of the paper s organzed as follows. Secton II presents the general pose estmaton framework. Secton III and IV respectvely descrbe how the geometrcal and color features are determned and combned. Fnally some expermental results are provded n Secton V. II. COMBINING GEOMETRICAL AND COLOR EDGE-BASED FEATURES IN 3D MODEL-BASED TRACKING Our problem s restrcted to model-based trackng, usng a 3D model of the target. The goal s to estmate the camera pose r by mnmzng, wth respect to r, the error between the observed data s and the current value s(r) of the same /13/$ IEEE 3719

2 features projected n the mage accordng to the current pose: (r) = ρ(s (r) s ) (1) where ρ s a robust estmator, whch reduces the senstvty to outlers. Ths s a non-lnear mnmzaton problem wth respect to the pose parameters r. We follow the Vrtual Vsual Servong framework [5], smlar to the Gauss-Newton approach. In ths sense, we consder a robust control law whch computes the vrtual camera velocty skew v n order to mnmze s(r) s : v = λ(dl s ) + D(s(r) s ) (2) where L s + s the pseudo nverse of L s, the nteracton (or Jacoban) matrx of the feature vector s, whch lnks v to the velocty of the features n the mage. λ s a proportonal gan and D s a weghtng matrx assocated to the Tukey robust estmator. Fnally, the new pose r k+1, represented by ts homogeneous matrx c k+1 M o, can be computed usng the exponental map [11]: c k+1 M o = c k+1 M ck c k M o = e vc k M o (3) Our challenge s to combne geometrcal edge-based features wth a complementary type of features n order to overcome the lmtatons of classcal edge-based approaches. Snce we deal wth potentally textureless 3D objects, combnng ths nformaton wth texture features would not be sutable. Besdes, our dea s to avod any mage extracton or segmentaton that would lead to outlers and msmatches and that would make some nformaton lost. We propose to rely on denser and more accurate features. In ths sense, we follow [13], for whch color features are ntegrated wth classcal geometrcal edge-based features. These features refer to the Contractng Curve Algorthm [7], whch s desgned to optmze the separaton of color statstcs collected on both sdes of the projected edges of the 3D model. can then be rewrtten as: = w g g + w c c (4) g refers to the geometrcal error functon and c stands for the color-based one. w g and w c are weghtng parameters. Both knds of features rely on the projecton of the 3D model, n the vcnty of the projected model edges. III. GEOMETRICAL EDGE FEATURES A. Model projecton and generaton of model edge ponts As n our prevous work [15], we propose to automatcally manage the projecton of the model and to determne the vsble and promnent edges from the rendered scene, by consderng the drect use of a complete model, whch can be textured or not. By usng the graphcs process unts (GPU) and a 3D renderng engne, we avod any manual pre-processng. For each acqured mage I k+1, the model s rendered wth respect to the prevous pose r k. The goal s to obtan a set of 3D ponts X that belong to target rms, edges and vsble textures from the rendered scene. By processng the depth buffer through a Laplacan flter, we can determne the dscontnutes whch sut the geometrcal appearance of the vsble scene, resultng n a bnary edge map. We have mplemented the flterng computatons on the GPU through shader programmng, reducng computatonal tme. In the case of a textured 3D model, we propose to combne the depth dscontnutes wth texture dscontnutes. The rendered textures are passed through a Canny edge algorthm and the obtaned edges are added to the ones generated from the depth buffer. We can sample ths set of edge ponts along the x and y coordnates of the mage n order to keep a reasonable number ponts x. The 3D coordnates of the determned edge ponts n the scene are retreved usng the depth buffer and the pose used to project the model. Besdes, the computaton of both the edge and color based objectve functons requres the orentaton of the edge underlyng a pont x. For the texture edges, t s done wthn the Canny algorthm on the rendered textures. For the depth edges, we compute the Sobel gradents along x and y on a graylevel mage of the normal map of the scene, fltered usng a Gaussan kernel, snce the renderng phase can suffer from alasng. These basc mage processng steps are processed on the GPU, optmzng computatons. B. Feature computaton and nteracton matrx The edge-based functon g s computed n a smlar way to [15]. From the model edge ponts we perform a 1D search along the normal of the underlyng edge of each x (r k ). A common approach s to choose the pxel wth the maxmum gradent as the matchng edge pont x n the mage. Once correspondences are establshed, we consder the dstance between the projected 3D lne l (r) underlyng the projected model edge pont x (r) (projected from the 3D pont X ) and the selected matchng pont x n the mage. g can be wrtten as: g = ρ g (s g (r) sg ) = ρ g (d (l (r), x ))) (5) wth s g = d (l (r), x )), sg = and ρ g s a Tukey robust estmator. Ths functon mproves the approaches n [4], [13], [2], whch consder the dstance between x (r) and x along the 2D normal vector to the edge underlyng x (r k ), determned at the model projecton phase. A key requrement to our method s to compute the 3D equaton of the lne l n the world frame n order to perform ts projecton durng the mnmzaton process and to compute the nteracton matrx L d, related to the pont to lne dstance. Ths s addressed through the knowledge of the edge orentaton durng the renderng phase and the knowledge of the normal to the surface underlyng l, retreved wth the rendered normal map. For the complete computaton of L d, see [5]. C. Multple-hypotheses framework Regardng the geometrcal edge regstraton process, a novel multple-hypotheses soluton s proposed to mprove robustness. Ths approach extends the one presented n [15], [19] by takng advantage of some elements proposed by [18]. In [15], the dea was to consder and regster dfferent hypotheses correspondng to potental edges. They correspond to dfferent local extrema of the gradent along the scan lne. But the projected model edge ponts are treated 372

3 ndependently, regardless ther membershp to prmtves such as lnes or partcular curves. To overcome ths ssue, the dea s to cluster the model edge ponts nto dfferent prmtves and to regster dfferent hypotheses consstently wth these prmtves. Here, we restrct to lne prmtves, for computatonal reasons. a) Clusterng model edge ponts nto lnes: from the edge map provded by the projecton of the 3D model, a set of N l 2D lne segments {l } N l =1 s extracted usng a Hough lne detector. A model edge pont x k for whch the dstance to the closest lne s under a certan threshold s assocated to ths lne. We obtan a set of clusters {C } N l =1 of model edge ponts correspondng to the extracted lnes {l } N l =1. b) Multple-hypotheses regstraton: for each cluster C, we process n a smlar manner to [18]. For a pont x n C, we consder several edge hypotheses x,l (see Fgure 1). These canddates are then classfed nto k sets of ponts or classes {c m} k m=1 usng the k-mean algorthm, each c m beng represented by a mean lne lm, whch best fts the ponts of c m, and a correspondng weght wm. wm represents the lkelhood of class c m wth respect to the others n C. x',2 x',1 x', Class c 2 Lne l 2 x (r k ) Class c 1 Lne l 1 Class c Lne l Correspondng mage edge Model projected edge Extracted lne l Fg. 1: Multple hypotheses framework. Ponts x (blue dots) form the cluster C correspondng to the extracted lne l. For a pont x, several hypotheses x,l are regstered, and are used to buld classes c m ted to lnes l m. The hypotheses n the class c 1 (red dots), whch matches l, wll have hgher weghts than the hypotheses of classes c and c 2 (green and lght blue dots), whch correspond to clutter. Thus model edge ponts x wll more lkely converge towards the hypotheses of class c 1. In [18], random weghted draws are then performed n order to get several hypotheses on the pose. Snce t s tme consumng, here, we smply use the weghts wm to determne the probablty π,l of a canddate x,l to belong to a lne. If c m l denotes the class ncludng x,l, we have: π,l = p(c m l x,l) = p(c m l )p(x,l c m l ) (6) wth p(c m l ) wm l and where the probablty p(x,l c m l ) s related to the dstance between x,l and the mean lne lm l assocated to c m l. The functon correspondng to the ponts x clustered nto the lne classes {C } N l =1 can be wrtten as: g = ρ g (mn π,l (d (l (r), x )))) (7) l j wth l the projected lne, for pose r, underlyng x. For the remanng ponts x whch have not been classfed nto lne clusters, we apply the multple hypotheses approach proposed n [15], gvng: g 1 = ρ g 1 (mn d (l (r), x )) (8) j g = g + g 1 (9) IV. COLOR FEATURES The color-based functon c s elaborated to characterze the separaton between both sdes of projected model edges, by relyng on color nformaton. In order to compute c, as n [13], we restrct ourself to slhouette edges, snce t makes more sense than for crease or texture edges and t lmts the computatonal burden. The prncple s to compute local color statstcs (means and covarances) along the normal to the projected model slhouette edges, on both sdes. Then for each pxel along the normal, we determne a resdual representng the consstency of the pxel wth these statstcs, accordng to a fuzzy membershp rule to each sde. A frst contrbuton we propose s to use a robust M-estmator n the computaton of c. Another contrbuton conssts n addng consstency wth respect to the color statstcs computed on the prevous frame. A. Computaton of color local statstcs Gven the set of projected slhouette model edge ponts x (r), determned from X (see Secton III), we compute color statstcs up to the 2 nd order, on both sde of the edge (object O and background B) usng 2D + 1 pxels along the edge normal n, up to a dstance L (see Fgure 2). For the object sde, we have: ν,o = D j= D µ O ν 1,O = ν 2,O = D j= D D j= D µ O I(y ) (1) µ O I(y )I(y ) T (11) y = x (r) + Ldn are the pxels located on both sdes. d = j D s the normalzed sgned dstance to x (r). I(y ) s the RGB color vector of pxel y and µ O are local weghts gvng a hgher confdence on the object sde, close to the edge (see [7]). As n [13] these statstcs are then blurred wth respect to the other slhouette ponts, and normalzed, to defne RGB means I O and covarances R O for x (r): ν k,o = e λ j ν k,o j, k =, 1, 2 j (12) I O = ν 1,O,O ν and RO = ν 2,O,O ν We proceed the same way for the background B. (13) B. Feature computaton and nteracton matrx The consstency of observed color components of pxels y accordng to the computed color statstcs are evaluated usng a functon a(d) as a fuzzy membershp rule to the object, wth: a(d) = 1 2 (erf( d + 1), d = 1..1 (14) 2σ 3721

4 Background Ī B, R B Ī O, R O Object n x (r) L y, j Model slhouette projected edge Fg. 2: Collecton of local color statstcs on both the background (B) and object (O) sdes. erf s the error functon [1]. σ s a standard devaton defnng the sharpness of the membershp rule. Both object and background statstcs can thus be mxed: Î (r) = a(d(r))i O + (1 a(d(r)))i B (15) ˆR (r) = a(d(r))r O + (1 a(d(r)))r B (16) and the error e c (r) = Î(r) I(y ) defne the color feature s c (r) as: s c (r) = s normalzed to e c 1 (r)t ˆR e c (r) (17) Î (r) represents a desred color value for the j th pxel y on the normal n, wether t s on the object O or background sde B, wth j = Dd(r). The dea s to optmze the poston d(r) of the membershp rule a along the normal, so that the desred value Î(r) best matches the actual value I(y ), mnmzng e c (r) and sc (r). The dependence of ˆR (r) on to the pose r s neglected to reduce computatons. In order to cope wth possble outlers and to mprove robustness, we propose to ntegrate a M-estmator n c, whch becomes: c = ρ c (s c (r) s c ) (18) j = ρ c ( e c 1 (r)t ˆR e c (r)) j wth s c =. As for g, we choose a Tukey estmator. The nteracton matrx L s c can be computed as follows: L s c = sc (r) = 1 s c and the nteracton matrx L e c L e c = Î(r) ( ec (r) T ) ˆR 1 e c (r) (19) = ec (r) = (I O I B ) a(d(r)) d d s computed as: (2) C. Temporal consstency For more accuracy, we ntroduce a temporal constrant to the objectve functon by consderng the nformaton of past frames. The dea s to ntegrate the color statstcs computed on the prevous frame P I for the slhouette edge ponts x (r k ) at the frst teraton of the mnmzaton process. e c (r) becomes: e c (r) = αî(r) + β( P Î (r)) I(y ) (23) wth α + β = 1, and we have: L e c = α Î,d(r) + β P Î (r) = (α(i O I B ) + β( P I O P I B )) a(d(r)) D. Combnaton wth geometrcal features As n [4], [13], d = 1 L nt L x wth L x = x(r) beng the nteracton matrx of a pont, whch s gven by: 2.8GHz Intel Core 7 CPU. For all the followng tests, our [ ] 1/Z x/z xy (1 + x L x = K 2 ) y algorthm has been ntalzed manually. Besdes, snce t s 1/Z y/z (1 + y 2 ) xy x not avalable onlne, we have not mplemented the algorthm [ ] (21) of [13] exactly the same way as n the paper. Instead we wth fx K = (22) have equvalently tested our new soluton wthout the M- f y Estmators for both edge-based and color-based objectve the focal rato parameters of the camera. (x, y) denotes the functons, wthout the multple-hypotheses framework and meter coordnates of the mage pont x, and Z the depth of wthout the temporal consstency for the color-based functon. the correspondng 3D pont (24) The combnaton of the geometrcal features and color features s g (r) and sc (r) n the Vrtual Vsual Servong framework s acheved by stackng these features nto a global feature vector s and ther correspondng nteracton matrx nto a global nteracton matrx: s = [ w g s g 1 w g s g N g w c s c 1,1 w c s c N s,2d L s = [ w g L g 1 w g L g N g w c L c 1,1 w c L c N s,2d ] T (25) wth N g the number of geometrcal features. N s refers to the number of model edge ponts belongng to the slhouette of the projected model, so that N c = 2DN s accounts for the number of color features, wth D the range along the normals to the edge ponts. s s a N g + N c vector and L s s a (N g + N c ) 6 matrx. Regardng the weghtng matrx D, t s wrtten as D = blockdag(d g, D c ), where D g and D c are the weghtng matrces assocated to the robust estmators ρ g and ρ c. V. EXPERIMENTAL RESULTS In ths secton we valdate the proposed method, both qualtatvely on real mages and qualtatvely on synthetc mages and the advantages of our contrbutons are verfed. A. Implementaton The renderng process of the 3D polygonal and textured model reles on OpenSceneGraph, whch s flexble 3D renderng engne. As presented n Secton II.B, we have consdered shader programmng for some mage processng steps durng the renderng and edge generaton phases. Ths s done usng OpenGL Shadng Language (GLSL). The remander of the algorthm has been mplemented thanks to the C++ VSP lbrary [12]. Regardng hardware, an NVIDIA NVS 31M graphc card has been used, along wth a ] T

5 B. Results on synthetc mages Poston / z Rotaton / z (Roll) Error (rad.) Error (m) Rotaton / y (Yaw) Error (rad.) Error (m) Poston / y Poston / x Rotaton / x (Ptch).3.2 Error (rad.) Error (m) We have acheved a quanttatve evaluaton of our algorthm on synthetc mages, usng a realstc ray-tracng smulator developed by Astrum for space envronments. We present the same sequence as n [15], whch features a Spot satellte and whch s provded wth ground truth. For space debrs removal concerns, we consder an arbtrary rotaton for the target atttude and a chaser spacecraft s supposed to be located on a smlar orbt, wth a slghtly dfferent eccentrcty n order to make the chaser fly around the target. We have nvestgated the performances of our algorthm comparatvely to our former soluton [15], whch we denote as the Nomnal Mode () and to our mplementaton of the method presented n [13], denoted by (see provded vdeo). The results can be seen on Fgure 4 where the accuracy of rotaton and translaton components of an estmated camera pose r wth respects to the true pose r s determned throughout the sequence, through error plots on the pose parameters. For our new soluton and for, the trackng s properly performed, as depcted on the mage sequence on Fgure 3. In terms of pose errors, the approach presented n ths paper shows better performances, especally when the satellte s far, wth low lumnosty (between frame 12 and 15). Wth, the trackng fals, manly due to the absence of a multple hypothess framework and to the absence of Mestmators for both edge-based and color-based functons Fg. 4: Estmated camera pose parameters of the target over all the sequence, along wth the ground truth, for the nomnal mode (), the soluton mplemented from [13] (), and the proposed soluton. TABLE I: RMS errors for the Nomnal Mode (), along wth the dfferent contrbutons (C1, C2, C3), for frames tx, ty, tz (n meters) and Rx, Ry, Rz (n radans) respectvely refer to translaton and rotaton (Euler angles) parameters. Mode, C1, C2, C2, C3, C1, C2, C3 tx ty tz Rx Ry Rz advantages of the proposed methods. Executon tmes are also gven (Table II). C. Results on real mages Fg. 3: Trackng for the Spot sequence wth the proposed method. We have also examned and verfed the effectveness and beneft of some of our contrbutons whch are: Incorporatng lne prmtves nto our multplehypotheses framework for the edge-based regstraton process, what s descrbed n Secton III.B. Ths contrbuton s denoted by C1. Integratng the color-based objectve functon to the global functon, denoted by C2. Temporal consstency for the color-based functon (C3), presented n Secton IV.C. The results are represented on Table I by root mean square errors on the pose parameters between frame 12 and 15, whch s the most challengng phase, to better enhance the Soyuz sequence: ths sequence shows the Soyuz TMA3M undockng from the Internatonal Space Staton (ISS). We also run on ths sequence the Nomnal Mode () [15], the algorthm presented n [13] () and the one descrbed n ths paper. As seen on Fgures 5, the trackng s successfully acheved, whereas t tends to fal for both (Fgure 6a) and (Fgure 6b) modes. Fg. 5: Trackng for the Soyuz sequence wth the new proposed soluton 3723

6 TABLE II: Mean executon tmes for frames Mode Tme (s).85, C1.111, C2.31, C2, C3.36, C1, C2, C3.344 a b Fg. 6: Trackng for the Soyuz sequence wth (a) and (b). Mock-ups vdeo sequences: two sequences are processed. In a smlar way to our former work [14], the frst one has been taken on the Lagadc robotc platform and Astrum provded a 1/5 mock-up of Amazonas-2, a telecom satellte. A sx degrees of freedom robot has been used to smulate a space rendezvous, wth a camera mounted on the endeffector of the robot, and enables to have regular and qute realstc movements. Let us however note that the specfc dynamc of the chaser spacecraft s not consdered n ths paper. Sun llumnaton s also smulated by a spot lght located around the scene. As the complete 3D model of the satellte shows dfferences wth respect to the mock-up, t has been redesgned manually. Trackng results can be observed on Fgure 7(a-c). The second sequences has been provded by Astrum and concerns a fly-around a mock-up of Envsat, an observaton satellte whch can be now consdered as a space debrs (Fgure 7(d-f)). a b c d e f Fg. 7: Trackng results for the sequences nvolvng Amazonas (a-c) and Envsat (d-f) mock-ups. VI. CONCLUSION In ths paper we have presented a robust and hybrd approach of 3D vsual model-based object trackng. The general dea was to combne n the global crteron to be mnmzed two complementary cues: a geometrcal one, relyng on dstances between edge features, and a ntensty-based one, relyng on color features computed around slhouette edges. For robustness purposes, we employed a new multple hypotheses framework takng advantage of lne prmtves, along wth M-estmators for both objectve functons, and we added temporal consstency for the color-based features. Our approach has been tested va varous experments, on both synthetc and real mages, n whch our contrbutons have shown notable results and mprovements n terms of accuracy and robustness, wth regards to state-of-the art approaches. REFERENCES [1] M. Abramowtz. Handbook of Mathematcal Functons, Wth Formulas, Graphs, and Mathematcal Tables,. Dover Publcatons, [2] G. Bleser, Y. Pastarmov, and D. Strcker. Real-tme 3d camera trackng for ndustral augmented realty applcatons. Journal of WSCG, pages 47 54, 25. [3] C. Bonnal, J.M. Ruault, and M.C. Desjean. Actve debrs removal: Recent progress and current trends. Acta Astronautca, 85:51 6, 213. [4] C. Cho and H. I. Chrstensen. Robust 3d vsual trackng usng partcle flterng on the specal eucldean group: A combned approach of keypont and edge features. Int. J. Rob. Res., 31(4): , Aprl 212. [5] A.I. Comport, E. Marchand, M. Pressgout, and F. Chaumette. Realtme markerless trackng for augmented realty: the vrtual vsual servong framework. IEEE Trans. on Vsualzaton and Computer Graphcs, 12(4): , July 26. [6] T. Drummond and R. Cpolla. Real-tme vsual trackng of complex structures. IEEE Trans. on Pattern Analyss and Machne Intellgence, 24(7): , July 22. [7] R. Hanek and M. Beetz. The contractng curve densty algorthm: Fttng parametrc curve models to mages usng local self-adaptng separaton crtera. Int. J. of Computer Vson, 59(3): , 24. [8] G. Klen and T. Drummond. Tghtly ntegrated sensor fuson for robust vsual trackng. 22(1): , 24. [9] G. Klen and D. Murray. Full-3d edge trackng wth a partcle flter. In Proc. Brtsh Machne Vson Conference, BMVC 6, volume 3, pages , Ednburgh, September 26. [1] D.G. Lowe. Fttng parameterzed three-dmensonal models to mages. IEEE Trans. on Pattern Analyss and Machne Intellgence, 13(5):441 45, May [11] Y. Ma, S. Soatto, J. Košecká, and S. Sastry. An nvtaton to 3-D vson. Sprnger, 24. [12] E. Marchand, F. Spndler, and F. Chaumette. VSP for vsual servong: a generc software platform wth a wde class of robot control sklls. IEEE Robotcs and Automaton Magazne, 12(4):4 52, December 25. [13] G. Pann, E. Roth, and A. Knoll. Robust contour-based object trackng ntegratng color and edge lkelhoods. In Proc. of the Vson, Modelng, and Vsualzaton Conference 28, VMV 28, pages , Konstanz, Germany, October 28. [14] A. Pett, E. Marchand, and K. Kanan. Vson-based space autonomous rendezvous : A case study. In IEEE/RSJ Int. Conf. on Intellgent Robots and Systems, IROS 11, pages , San Francsco, USA, September 211. [15] A. Pett, E. Marchand, and K. Kanan. Trackng complex targets for space rendezvous and debrs removal applcatons. In IEEE/RSJ Int. Conf. on Intellgent Robots and Systems, IROS 12, pages , Vlamoura, Portugal, October 212. [16] M. Pressgout and E. Marchand. Real-tme hybrd trackng usng edge and texture nformaton. Int. Journal of Robotcs Research, IJRR, 26(7): , July 27. [17] E. Rosten and T. Drummond. Fusng ponts and lnes for hgh performance trackng. In IEEE Int. Conf. on Computer Vson, volume 2, pages , Bejng, Chna, 25. [18] C. Teulère, E. Marchand, and L. Eck. Usng multple hypothess n model-based trackng. In IEEE Int. Conf. on Robotcs and Automaton, ICRA 1, pages , Anchorage, Alaska, May 21. [19] L. Vacchett, V. Lepett, and P. Fua. Combnng edge and texture nformaton for real-tme accurate 3d camera trackng. In ACM/IEEE Int. Symp. on Mxed and Augmented Realty, ISMAR 4, pages 48 57, Arlngton, VA, November 24. [2] H. Wuest and D. Strcker. Trackng of ndustral objects by usng cad models. Journal of Vrtual Realty and Broadcastng, 4(1), Aprl 27. [21] Y. Yoon, A. Kosaka, and A. C. Kak. A new kalman-flter-based framework for fast and accurate vsual trackng of rgd objects. IEEE Trans. on Robotcs, 24(5): , October

Combining complementary edge, point and color cues in model-based tracking for highly dynamic scenes

Combining complementary edge, point and color cues in model-based tracking for highly dynamic scenes Combnng complementary edge, pont and color cues n model-based trackng for hghly dynamc scenes Antone Pett, Erc Marchand, Keyvan Kanan Abstract Ths paper focuses on the ssue of estmatng the complete 3D

More information

SLAM Summer School 2006 Practical 2: SLAM using Monocular Vision

SLAM Summer School 2006 Practical 2: SLAM using Monocular Vision SLAM Summer School 2006 Practcal 2: SLAM usng Monocular Vson Javer Cvera, Unversty of Zaragoza Andrew J. Davson, Imperal College London J.M.M Montel, Unversty of Zaragoza. josemar@unzar.es, jcvera@unzar.es,

More information

CS 534: Computer Vision Model Fitting

CS 534: Computer Vision Model Fitting CS 534: Computer Vson Model Fttng Sprng 004 Ahmed Elgammal Dept of Computer Scence CS 534 Model Fttng - 1 Outlnes Model fttng s mportant Least-squares fttng Maxmum lkelhood estmaton MAP estmaton Robust

More information

ViSP: A Software Environment for Eye-in-Hand Visual Servoing

ViSP: A Software Environment for Eye-in-Hand Visual Servoing VSP: A Software Envronment for Eye-n-Hand Vsual Servong Érc Marchand IRISA - INRIA Rennes Campus de Beauleu, F-3542 Rennes Cedex Emal: Erc.Marchand@rsa.fr Abstract In ths paper, we descrbe a modular software

More information

Improvement of Spatial Resolution Using BlockMatching Based Motion Estimation and Frame. Integration

Improvement of Spatial Resolution Using BlockMatching Based Motion Estimation and Frame. Integration Improvement of Spatal Resoluton Usng BlockMatchng Based Moton Estmaton and Frame Integraton Danya Suga and Takayuk Hamamoto Graduate School of Engneerng, Tokyo Unversty of Scence, 6-3-1, Nuku, Katsuska-ku,

More information

Feature Reduction and Selection

Feature Reduction and Selection Feature Reducton and Selecton Dr. Shuang LIANG School of Software Engneerng TongJ Unversty Fall, 2012 Today s Topcs Introducton Problems of Dmensonalty Feature Reducton Statstc methods Prncpal Components

More information

Active Contours/Snakes

Active Contours/Snakes Actve Contours/Snakes Erkut Erdem Acknowledgement: The sldes are adapted from the sldes prepared by K. Grauman of Unversty of Texas at Austn Fttng: Edges vs. boundares Edges useful sgnal to ndcate occludng

More information

Fitting: Deformable contours April 26 th, 2018

Fitting: Deformable contours April 26 th, 2018 4/6/08 Fttng: Deformable contours Aprl 6 th, 08 Yong Jae Lee UC Davs Recap so far: Groupng and Fttng Goal: move from array of pxel values (or flter outputs) to a collecton of regons, objects, and shapes.

More information

METRIC ALIGNMENT OF LASER RANGE SCANS AND CALIBRATED IMAGES USING LINEAR STRUCTURES

METRIC ALIGNMENT OF LASER RANGE SCANS AND CALIBRATED IMAGES USING LINEAR STRUCTURES METRIC ALIGNMENT OF LASER RANGE SCANS AND CALIBRATED IMAGES USING LINEAR STRUCTURES Lorenzo Sorg CIRA the Italan Aerospace Research Centre Computer Vson and Vrtual Realty Lab. Outlne Work goal Work motvaton

More information

A Binarization Algorithm specialized on Document Images and Photos

A Binarization Algorithm specialized on Document Images and Photos A Bnarzaton Algorthm specalzed on Document mages and Photos Ergna Kavalleratou Dept. of nformaton and Communcaton Systems Engneerng Unversty of the Aegean kavalleratou@aegean.gr Abstract n ths paper, a

More information

Image Alignment CSC 767

Image Alignment CSC 767 Image Algnment CSC 767 Image algnment Image from http://graphcs.cs.cmu.edu/courses/15-463/2010_fall/ Image algnment: Applcatons Panorama sttchng Image algnment: Applcatons Recognton of object nstances

More information

Corner-Based Image Alignment using Pyramid Structure with Gradient Vector Similarity

Corner-Based Image Alignment using Pyramid Structure with Gradient Vector Similarity Journal of Sgnal and Informaton Processng, 013, 4, 114-119 do:10.436/jsp.013.43b00 Publshed Onlne August 013 (http://www.scrp.org/journal/jsp) Corner-Based Image Algnment usng Pyramd Structure wth Gradent

More information

Skew Angle Estimation and Correction of Hand Written, Textual and Large areas of Non-Textual Document Images: A Novel Approach

Skew Angle Estimation and Correction of Hand Written, Textual and Large areas of Non-Textual Document Images: A Novel Approach Angle Estmaton and Correcton of Hand Wrtten, Textual and Large areas of Non-Textual Document Images: A Novel Approach D.R.Ramesh Babu Pyush M Kumat Mahesh D Dhannawat PES Insttute of Technology Research

More information

High-Boost Mesh Filtering for 3-D Shape Enhancement

High-Boost Mesh Filtering for 3-D Shape Enhancement Hgh-Boost Mesh Flterng for 3-D Shape Enhancement Hrokazu Yagou Λ Alexander Belyaev y Damng We z Λ y z ; ; Shape Modelng Laboratory, Unversty of Azu, Azu-Wakamatsu 965-8580 Japan y Computer Graphcs Group,

More information

3D model-based tracking for UAV indoor localisation

3D model-based tracking for UAV indoor localisation 3D model-based tracng for UAV ndoor localsaton Célne Teulère, Erc Marchand, Laurent Ec Abstract Ths paper proposes a novel model-based tracng approach for 3D localsaton. One man dffculty of standard model-based

More information

FEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur

FEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur FEATURE EXTRACTION Dr. K.Vjayarekha Assocate Dean School of Electrcal and Electroncs Engneerng SASTRA Unversty, Thanjavur613 41 Jont Intatve of IITs and IISc Funded by MHRD Page 1 of 8 Table of Contents

More information

A Fast Visual Tracking Algorithm Based on Circle Pixels Matching

A Fast Visual Tracking Algorithm Based on Circle Pixels Matching A Fast Vsual Trackng Algorthm Based on Crcle Pxels Matchng Zhqang Hou hou_zhq@sohu.com Chongzhao Han czhan@mal.xjtu.edu.cn Ln Zheng Abstract: A fast vsual trackng algorthm based on crcle pxels matchng

More information

A Robust Method for Estimating the Fundamental Matrix

A Robust Method for Estimating the Fundamental Matrix Proc. VIIth Dgtal Image Computng: Technques and Applcatons, Sun C., Talbot H., Ourseln S. and Adraansen T. (Eds.), 0- Dec. 003, Sydney A Robust Method for Estmatng the Fundamental Matrx C.L. Feng and Y.S.

More information

Support Vector Machines

Support Vector Machines /9/207 MIST.6060 Busness Intellgence and Data Mnng What are Support Vector Machnes? Support Vector Machnes Support Vector Machnes (SVMs) are supervsed learnng technques that analyze data and recognze patterns.

More information

Range images. Range image registration. Examples of sampling patterns. Range images and range surfaces

Range images. Range image registration. Examples of sampling patterns. Range images and range surfaces Range mages For many structured lght scanners, the range data forms a hghly regular pattern known as a range mage. he samplng pattern s determned by the specfc scanner. Range mage regstraton 1 Examples

More information

Hermite Splines in Lie Groups as Products of Geodesics

Hermite Splines in Lie Groups as Products of Geodesics Hermte Splnes n Le Groups as Products of Geodescs Ethan Eade Updated May 28, 2017 1 Introducton 1.1 Goal Ths document defnes a curve n the Le group G parametrzed by tme and by structural parameters n the

More information

S1 Note. Basis functions.

S1 Note. Basis functions. S1 Note. Bass functons. Contents Types of bass functons...1 The Fourer bass...2 B-splne bass...3 Power and type I error rates wth dfferent numbers of bass functons...4 Table S1. Smulaton results of type

More information

A Fast Content-Based Multimedia Retrieval Technique Using Compressed Data

A Fast Content-Based Multimedia Retrieval Technique Using Compressed Data A Fast Content-Based Multmeda Retreval Technque Usng Compressed Data Borko Furht and Pornvt Saksobhavvat NSF Multmeda Laboratory Florda Atlantc Unversty, Boca Raton, Florda 3343 ABSTRACT In ths paper,

More information

User Authentication Based On Behavioral Mouse Dynamics Biometrics

User Authentication Based On Behavioral Mouse Dynamics Biometrics User Authentcaton Based On Behavoral Mouse Dynamcs Bometrcs Chee-Hyung Yoon Danel Donghyun Km Department of Computer Scence Department of Computer Scence Stanford Unversty Stanford Unversty Stanford, CA

More information

Outline. Type of Machine Learning. Examples of Application. Unsupervised Learning

Outline. Type of Machine Learning. Examples of Application. Unsupervised Learning Outlne Artfcal Intellgence and ts applcatons Lecture 8 Unsupervsed Learnng Professor Danel Yeung danyeung@eee.org Dr. Patrck Chan patrckchan@eee.org South Chna Unversty of Technology, Chna Introducton

More information

Computer Animation and Visualisation. Lecture 4. Rigging / Skinning

Computer Animation and Visualisation. Lecture 4. Rigging / Skinning Computer Anmaton and Vsualsaton Lecture 4. Rggng / Sknnng Taku Komura Overvew Sknnng / Rggng Background knowledge Lnear Blendng How to decde weghts? Example-based Method Anatomcal models Sknnng Assume

More information

Content Based Image Retrieval Using 2-D Discrete Wavelet with Texture Feature with Different Classifiers

Content Based Image Retrieval Using 2-D Discrete Wavelet with Texture Feature with Different Classifiers IOSR Journal of Electroncs and Communcaton Engneerng (IOSR-JECE) e-issn: 78-834,p- ISSN: 78-8735.Volume 9, Issue, Ver. IV (Mar - Apr. 04), PP 0-07 Content Based Image Retreval Usng -D Dscrete Wavelet wth

More information

Image Representation & Visualization Basic Imaging Algorithms Shape Representation and Analysis. outline

Image Representation & Visualization Basic Imaging Algorithms Shape Representation and Analysis. outline mage Vsualzaton mage Vsualzaton mage Representaton & Vsualzaton Basc magng Algorthms Shape Representaton and Analyss outlne mage Representaton & Vsualzaton Basc magng Algorthms Shape Representaton and

More information

An Application of the Dulmage-Mendelsohn Decomposition to Sparse Null Space Bases of Full Row Rank Matrices

An Application of the Dulmage-Mendelsohn Decomposition to Sparse Null Space Bases of Full Row Rank Matrices Internatonal Mathematcal Forum, Vol 7, 2012, no 52, 2549-2554 An Applcaton of the Dulmage-Mendelsohn Decomposton to Sparse Null Space Bases of Full Row Rank Matrces Mostafa Khorramzadeh Department of Mathematcal

More information

Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input

Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input Real-tme Jont Tracng of a Hand Manpulatng an Object from RGB-D Input Srnath Srdhar 1 Franzsa Mueller 1 Mchael Zollhöfer 1 Dan Casas 1 Antt Oulasvrta 2 Chrstan Theobalt 1 1 Max Planc Insttute for Informatcs

More information

Fuzzy Filtering Algorithms for Image Processing: Performance Evaluation of Various Approaches

Fuzzy Filtering Algorithms for Image Processing: Performance Evaluation of Various Approaches Proceedngs of the Internatonal Conference on Cognton and Recognton Fuzzy Flterng Algorthms for Image Processng: Performance Evaluaton of Varous Approaches Rajoo Pandey and Umesh Ghanekar Department of

More information

Determining the Optimal Bandwidth Based on Multi-criterion Fusion

Determining the Optimal Bandwidth Based on Multi-criterion Fusion Proceedngs of 01 4th Internatonal Conference on Machne Learnng and Computng IPCSIT vol. 5 (01) (01) IACSIT Press, Sngapore Determnng the Optmal Bandwdth Based on Mult-crteron Fuson Ha-L Lang 1+, Xan-Mn

More information

Tracking complex targets for space rendezvous and debris removal applications

Tracking complex targets for space rendezvous and debris removal applications Tracking complex targets for space rendezvous and debris removal applications Antoine Petit, Eric Marchand, Keyvan Kanani Abstract In the context of autonomous rendezvous and space debris removal, visual

More information

The Codesign Challenge

The Codesign Challenge ECE 4530 Codesgn Challenge Fall 2007 Hardware/Software Codesgn The Codesgn Challenge Objectves In the codesgn challenge, your task s to accelerate a gven software reference mplementaton as fast as possble.

More information

Proper Choice of Data Used for the Estimation of Datum Transformation Parameters

Proper Choice of Data Used for the Estimation of Datum Transformation Parameters Proper Choce of Data Used for the Estmaton of Datum Transformaton Parameters Hakan S. KUTOGLU, Turkey Key words: Coordnate systems; transformaton; estmaton, relablty. SUMMARY Advances n technologes and

More information

Machine Learning: Algorithms and Applications

Machine Learning: Algorithms and Applications 14/05/1 Machne Learnng: Algorthms and Applcatons Florano Zn Free Unversty of Bozen-Bolzano Faculty of Computer Scence Academc Year 011-01 Lecture 10: 14 May 01 Unsupervsed Learnng cont Sldes courtesy of

More information

An efficient method to build panoramic image mosaics

An efficient method to build panoramic image mosaics An effcent method to buld panoramc mage mosacs Pattern Recognton Letters vol. 4 003 Dae-Hyun Km Yong-In Yoon Jong-Soo Cho School of Electrcal Engneerng and Computer Scence Kyungpook Natonal Unv. Abstract

More information

Multi-view 3D Position Estimation of Sports Players

Multi-view 3D Position Estimation of Sports Players Mult-vew 3D Poston Estmaton of Sports Players Robbe Vos and Wlle Brnk Appled Mathematcs Department of Mathematcal Scences Unversty of Stellenbosch, South Afrca Emal: vosrobbe@gmal.com Abstract The problem

More information

Lecture #15 Lecture Notes

Lecture #15 Lecture Notes Lecture #15 Lecture Notes The ocean water column s very much a 3-D spatal entt and we need to represent that structure n an economcal way to deal wth t n calculatons. We wll dscuss one way to do so, emprcal

More information

A Background Subtraction for a Vision-based User Interface *

A Background Subtraction for a Vision-based User Interface * A Background Subtracton for a Vson-based User Interface * Dongpyo Hong and Woontack Woo KJIST U-VR Lab. {dhon wwoo}@kjst.ac.kr Abstract In ths paper, we propose a robust and effcent background subtracton

More information

y and the total sum of

y and the total sum of Lnear regresson Testng for non-lnearty In analytcal chemstry, lnear regresson s commonly used n the constructon of calbraton functons requred for analytcal technques such as gas chromatography, atomc absorpton

More information

Cluster Analysis of Electrical Behavior

Cluster Analysis of Electrical Behavior Journal of Computer and Communcatons, 205, 3, 88-93 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/cc http://dx.do.org/0.4236/cc.205.350 Cluster Analyss of Electrcal Behavor Ln Lu Ln Lu, School

More information

A Unified Framework for Semantics and Feature Based Relevance Feedback in Image Retrieval Systems

A Unified Framework for Semantics and Feature Based Relevance Feedback in Image Retrieval Systems A Unfed Framework for Semantcs and Feature Based Relevance Feedback n Image Retreval Systems Ye Lu *, Chunhu Hu 2, Xngquan Zhu 3*, HongJang Zhang 2, Qang Yang * School of Computng Scence Smon Fraser Unversty

More information

What are the camera parameters? Where are the light sources? What is the mapping from radiance to pixel color? Want to solve for 3D geometry

What are the camera parameters? Where are the light sources? What is the mapping from radiance to pixel color? Want to solve for 3D geometry Today: Calbraton What are the camera parameters? Where are the lght sources? What s the mappng from radance to pel color? Why Calbrate? Want to solve for D geometry Alternatve approach Solve for D shape

More information

NAG Fortran Library Chapter Introduction. G10 Smoothing in Statistics

NAG Fortran Library Chapter Introduction. G10 Smoothing in Statistics Introducton G10 NAG Fortran Lbrary Chapter Introducton G10 Smoothng n Statstcs Contents 1 Scope of the Chapter... 2 2 Background to the Problems... 2 2.1 Smoothng Methods... 2 2.2 Smoothng Splnes and Regresson

More information

Fitting & Matching. Lecture 4 Prof. Bregler. Slides from: S. Lazebnik, S. Seitz, M. Pollefeys, A. Effros.

Fitting & Matching. Lecture 4 Prof. Bregler. Slides from: S. Lazebnik, S. Seitz, M. Pollefeys, A. Effros. Fttng & Matchng Lecture 4 Prof. Bregler Sldes from: S. Lazebnk, S. Setz, M. Pollefeys, A. Effros. How do we buld panorama? We need to match (algn) mages Matchng wth Features Detect feature ponts n both

More information

Ecient Computation of the Most Probable Motion from Fuzzy. Moshe Ben-Ezra Shmuel Peleg Michael Werman. The Hebrew University of Jerusalem

Ecient Computation of the Most Probable Motion from Fuzzy. Moshe Ben-Ezra Shmuel Peleg Michael Werman. The Hebrew University of Jerusalem Ecent Computaton of the Most Probable Moton from Fuzzy Correspondences Moshe Ben-Ezra Shmuel Peleg Mchael Werman Insttute of Computer Scence The Hebrew Unversty of Jerusalem 91904 Jerusalem, Israel Emal:

More information

Pose Estimation in Heavy Clutter using a Multi-Flash Camera

Pose Estimation in Heavy Clutter using a Multi-Flash Camera 2010 IEEE Internatonal Conference on Robotcs and Automaton Anchorage Conventon Dstrct May 3-8, 2010, Anchorage, Alaska, USA Pose Estmaton n Heavy Clutter usng a Mult-Flash Camera Mng-Yu Lu, Oncel Tuzel,

More information

Detection of an Object by using Principal Component Analysis

Detection of an Object by using Principal Component Analysis Detecton of an Object by usng Prncpal Component Analyss 1. G. Nagaven, 2. Dr. T. Sreenvasulu Reddy 1. M.Tech, Department of EEE, SVUCE, Trupath, Inda. 2. Assoc. Professor, Department of ECE, SVUCE, Trupath,

More information

Smoothing Spline ANOVA for variable screening

Smoothing Spline ANOVA for variable screening Smoothng Splne ANOVA for varable screenng a useful tool for metamodels tranng and mult-objectve optmzaton L. Rcco, E. Rgon, A. Turco Outlne RSM Introducton Possble couplng Test case MOO MOO wth Game Theory

More information

MOTION BLUR ESTIMATION AT CORNERS

MOTION BLUR ESTIMATION AT CORNERS Gacomo Boracch and Vncenzo Caglot Dpartmento d Elettronca e Informazone, Poltecnco d Mlano, Va Ponzo, 34/5-20133 MILANO boracch@elet.polm.t, caglot@elet.polm.t Keywords: Abstract: Pont Spread Functon Parameter

More information

NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS

NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS ARPN Journal of Engneerng and Appled Scences 006-017 Asan Research Publshng Network (ARPN). All rghts reserved. NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS Igor Grgoryev, Svetlana

More information

Unsupervised Learning and Clustering

Unsupervised Learning and Clustering Unsupervsed Learnng and Clusterng Why consder unlabeled samples?. Collectng and labelng large set of samples s costly Gettng recorded speech s free, labelng s tme consumng 2. Classfer could be desgned

More information

Term Weighting Classification System Using the Chi-square Statistic for the Classification Subtask at NTCIR-6 Patent Retrieval Task

Term Weighting Classification System Using the Chi-square Statistic for the Classification Subtask at NTCIR-6 Patent Retrieval Task Proceedngs of NTCIR-6 Workshop Meetng, May 15-18, 2007, Tokyo, Japan Term Weghtng Classfcaton System Usng the Ch-square Statstc for the Classfcaton Subtask at NTCIR-6 Patent Retreval Task Kotaro Hashmoto

More information

Visual Servoing of Presenters in Augmented Virtual Reality TV Studios

Visual Servoing of Presenters in Augmented Virtual Reality TV Studios The 2010 IEEE/RSJ Internatonal Conference on Intellgent Robots and Systems October 18-22, 2010, Tape, Tawan Vsual Servong of Presenters n Augmented Vrtual Realty TV Studos Suraj Nar, Thorsten Röder, Gorgo

More information

Lobachevsky State University of Nizhni Novgorod. Polyhedron. Quick Start Guide

Lobachevsky State University of Nizhni Novgorod. Polyhedron. Quick Start Guide Lobachevsky State Unversty of Nzhn Novgorod Polyhedron Quck Start Gude Nzhn Novgorod 2016 Contents Specfcaton of Polyhedron software... 3 Theoretcal background... 4 1. Interface of Polyhedron... 6 1.1.

More information

Analysis of Continuous Beams in General

Analysis of Continuous Beams in General Analyss of Contnuous Beams n General Contnuous beams consdered here are prsmatc, rgdly connected to each beam segment and supported at varous ponts along the beam. onts are selected at ponts of support,

More information

The Greedy Method. Outline and Reading. Change Money Problem. Greedy Algorithms. Applications of the Greedy Strategy. The Greedy Method Technique

The Greedy Method. Outline and Reading. Change Money Problem. Greedy Algorithms. Applications of the Greedy Strategy. The Greedy Method Technique //00 :0 AM Outlne and Readng The Greedy Method The Greedy Method Technque (secton.) Fractonal Knapsack Problem (secton..) Task Schedulng (secton..) Mnmum Spannng Trees (secton.) Change Money Problem Greedy

More information

Problem Definitions and Evaluation Criteria for Computational Expensive Optimization

Problem Definitions and Evaluation Criteria for Computational Expensive Optimization Problem efntons and Evaluaton Crtera for Computatonal Expensve Optmzaton B. Lu 1, Q. Chen and Q. Zhang 3, J. J. Lang 4, P. N. Suganthan, B. Y. Qu 6 1 epartment of Computng, Glyndwr Unversty, UK Faclty

More information

An Iterative Solution Approach to Process Plant Layout using Mixed Integer Optimisation

An Iterative Solution Approach to Process Plant Layout using Mixed Integer Optimisation 17 th European Symposum on Computer Aded Process Engneerng ESCAPE17 V. Plesu and P.S. Agach (Edtors) 2007 Elsever B.V. All rghts reserved. 1 An Iteratve Soluton Approach to Process Plant Layout usng Mxed

More information

MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION

MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION Paulo Quntlano 1 & Antono Santa-Rosa 1 Federal Polce Department, Brasla, Brazl. E-mals: quntlano.pqs@dpf.gov.br and

More information

3D vector computer graphics

3D vector computer graphics 3D vector computer graphcs Paolo Varagnolo: freelance engneer Padova Aprl 2016 Prvate Practce ----------------------------------- 1. Introducton Vector 3D model representaton n computer graphcs requres

More information

Resolving Ambiguity in Depth Extraction for Motion Capture using Genetic Algorithm

Resolving Ambiguity in Depth Extraction for Motion Capture using Genetic Algorithm Resolvng Ambguty n Depth Extracton for Moton Capture usng Genetc Algorthm Yn Yee Wa, Ch Kn Chow, Tong Lee Computer Vson and Image Processng Laboratory Dept. of Electronc Engneerng The Chnese Unversty of

More information

An Entropy-Based Approach to Integrated Information Needs Assessment

An Entropy-Based Approach to Integrated Information Needs Assessment Dstrbuton Statement A: Approved for publc release; dstrbuton s unlmted. An Entropy-Based Approach to ntegrated nformaton Needs Assessment June 8, 2004 Wllam J. Farrell Lockheed Martn Advanced Technology

More information

Optimizing Document Scoring for Query Retrieval

Optimizing Document Scoring for Query Retrieval Optmzng Document Scorng for Query Retreval Brent Ellwen baellwe@cs.stanford.edu Abstract The goal of ths project was to automate the process of tunng a document query engne. Specfcally, I used machne learnng

More information

Lecture 13: High-dimensional Images

Lecture 13: High-dimensional Images Lec : Hgh-dmensonal Images Grayscale Images Lecture : Hgh-dmensonal Images Math 90 Prof. Todd Wttman The Ctadel A grayscale mage s an nteger-valued D matrx. An 8-bt mage takes on values between 0 and 55.

More information

Geometric Primitive Refinement for Structured Light Cameras

Geometric Primitive Refinement for Structured Light Cameras Self Archve Verson Cte ths artcle as: Fuersattel, P., Placht, S., Maer, A. Ress, C - Geometrc Prmtve Refnement for Structured Lght Cameras. Machne Vson and Applcatons 2018) 29: 313. Geometrc Prmtve Refnement

More information

Line-based Camera Movement Estimation by Using Parallel Lines in Omnidirectional Video

Line-based Camera Movement Estimation by Using Parallel Lines in Omnidirectional Video 01 IEEE Internatonal Conference on Robotcs and Automaton RverCentre, Sant Paul, Mnnesota, USA May 14-18, 01 Lne-based Camera Movement Estmaton by Usng Parallel Lnes n Omndrectonal Vdeo Ryosuke kawansh,

More information

Unsupervised Learning

Unsupervised Learning Pattern Recognton Lecture 8 Outlne Introducton Unsupervsed Learnng Parametrc VS Non-Parametrc Approach Mxture of Denstes Maxmum-Lkelhood Estmates Clusterng Prof. Danel Yeung School of Computer Scence and

More information

Robust visual tracking based on Informative random fern

Robust visual tracking based on Informative random fern 5th Internatonal Conference on Computer Scences and Automaton Engneerng (ICCSAE 205) Robust vsual trackng based on Informatve random fern Hao Dong, a, Ru Wang, b School of Instrumentaton Scence and Opto-electroncs

More information

Multi-stable Perception. Necker Cube

Multi-stable Perception. Necker Cube Mult-stable Percepton Necker Cube Spnnng dancer lluson, Nobuuk Kaahara Fttng and Algnment Computer Vson Szelsk 6.1 James Has Acknowledgment: Man sldes from Derek Hoem, Lana Lazebnk, and Grauman&Lebe 2008

More information

Hierarchical Optimization on Manifolds for Online 2D and 3D Mapping

Hierarchical Optimization on Manifolds for Online 2D and 3D Mapping Herarchcal Optmzaton on Manfolds for Onlne 2D and 3D Mappng Gorgo Grsett Raner Kümmerle Cyrll Stachnss Udo Frese Chrstoph Hertzberg Abstract In ths paper, we present a new herarchcal optmzaton soluton

More information

R s s f. m y s. SPH3UW Unit 7.3 Spherical Concave Mirrors Page 1 of 12. Notes

R s s f. m y s. SPH3UW Unit 7.3 Spherical Concave Mirrors Page 1 of 12. Notes SPH3UW Unt 7.3 Sphercal Concave Mrrors Page 1 of 1 Notes Physcs Tool box Concave Mrror If the reflectng surface takes place on the nner surface of the sphercal shape so that the centre of the mrror bulges

More information

Structure from Motion

Structure from Motion Structure from Moton Structure from Moton For now, statc scene and movng camera Equvalentl, rgdl movng scene and statc camera Lmtng case of stereo wth man cameras Lmtng case of multvew camera calbraton

More information

Reducing Frame Rate for Object Tracking

Reducing Frame Rate for Object Tracking Reducng Frame Rate for Object Trackng Pavel Korshunov 1 and We Tsang Oo 2 1 Natonal Unversty of Sngapore, Sngapore 11977, pavelkor@comp.nus.edu.sg 2 Natonal Unversty of Sngapore, Sngapore 11977, oowt@comp.nus.edu.sg

More information

Fusion of Data from Head-Mounted and Fixed Sensors 1

Fusion of Data from Head-Mounted and Fixed Sensors 1 Frst Internatonal Workshop on Augmented Realty, Nov., 998, San Francsco. Fuson of Data from Head-ounted and Fxed Sensors Abstract Wllam A. Hoff Engneerng Dvson, Colorado School of nes Golden, Colorado

More information

Video Object Tracking Based On Extended Active Shape Models With Color Information

Video Object Tracking Based On Extended Active Shape Models With Color Information CGIV'2002: he Frst Frst European Conference Colour on Colour n Graphcs, Imagng, and Vson Vdeo Object rackng Based On Extended Actve Shape Models Wth Color Informaton A. Koschan, S.K. Kang, J.K. Pak, B.

More information

Learning the Kernel Parameters in Kernel Minimum Distance Classifier

Learning the Kernel Parameters in Kernel Minimum Distance Classifier Learnng the Kernel Parameters n Kernel Mnmum Dstance Classfer Daoqang Zhang 1,, Songcan Chen and Zh-Hua Zhou 1* 1 Natonal Laboratory for Novel Software Technology Nanjng Unversty, Nanjng 193, Chna Department

More information

Object Contour Tracking Using Multi-feature Fusion based Particle Filter

Object Contour Tracking Using Multi-feature Fusion based Particle Filter Object Contour Tracng Usng Mult-feature Fuson based Partcle Flter Xaofeng Lu 1,3, L Song 1,2, Songyu Yu 1, Nam Lng 2 Insttute of Image Communcaton and Informaton Processng 1 Shangha Jao Tong Unversty,

More information

Mathematics 256 a course in differential equations for engineering students

Mathematics 256 a course in differential equations for engineering students Mathematcs 56 a course n dfferental equatons for engneerng students Chapter 5. More effcent methods of numercal soluton Euler s method s qute neffcent. Because the error s essentally proportonal to the

More information

Help for Time-Resolved Analysis TRI2 version 2.4 P Barber,

Help for Time-Resolved Analysis TRI2 version 2.4 P Barber, Help for Tme-Resolved Analyss TRI2 verson 2.4 P Barber, 22.01.10 Introducton Tme-resolved Analyss (TRA) becomes avalable under the processng menu once you have loaded and selected an mage that contans

More information

Signature and Lexicon Pruning Techniques

Signature and Lexicon Pruning Techniques Sgnature and Lexcon Prunng Technques Srnvas Palla, Hansheng Le, Venu Govndaraju Centre for Unfed Bometrcs and Sensors Unversty at Buffalo {spalla2, hle, govnd}@cedar.buffalo.edu Abstract Handwrtten word

More information

3D INDUSTRIAL RECONSTRUCTION BY FITTING CSG MODELS TO A COMBINATION OF IMAGES AND POINT CLOUDS

3D INDUSTRIAL RECONSTRUCTION BY FITTING CSG MODELS TO A COMBINATION OF IMAGES AND POINT CLOUDS 3D INDUSTRIAL RECONSTRUCTION BY FITTING CSG MODELS TO A COMBINATION OF IMAGES AND POINT CLOUDS Tahr Rabban, Frank van den Heuvel * Secton of Photogrammetry and Remote Sensng, Faculty of Aerospace Engneerng,

More information

Subspace clustering. Clustering. Fundamental to all clustering techniques is the choice of distance measure between data points;

Subspace clustering. Clustering. Fundamental to all clustering techniques is the choice of distance measure between data points; Subspace clusterng Clusterng Fundamental to all clusterng technques s the choce of dstance measure between data ponts; D q ( ) ( ) 2 x x = x x, j k = 1 k jk Squared Eucldean dstance Assumpton: All features

More information

MOTION PANORAMA CONSTRUCTION FROM STREAMING VIDEO FOR POWER- CONSTRAINED MOBILE MULTIMEDIA ENVIRONMENTS XUNYU PAN

MOTION PANORAMA CONSTRUCTION FROM STREAMING VIDEO FOR POWER- CONSTRAINED MOBILE MULTIMEDIA ENVIRONMENTS XUNYU PAN MOTION PANORAMA CONSTRUCTION FROM STREAMING VIDEO FOR POWER- CONSTRAINED MOBILE MULTIMEDIA ENVIRONMENTS by XUNYU PAN (Under the Drecton of Suchendra M. Bhandarkar) ABSTRACT In modern tmes, more and more

More information

Compiler Design. Spring Register Allocation. Sample Exercises and Solutions. Prof. Pedro C. Diniz

Compiler Design. Spring Register Allocation. Sample Exercises and Solutions. Prof. Pedro C. Diniz Compler Desgn Sprng 2014 Regster Allocaton Sample Exercses and Solutons Prof. Pedro C. Dnz USC / Informaton Scences Insttute 4676 Admralty Way, Sute 1001 Marna del Rey, Calforna 90292 pedro@s.edu Regster

More information

Edge Detection in Noisy Images Using the Support Vector Machines

Edge Detection in Noisy Images Using the Support Vector Machines Edge Detecton n Nosy Images Usng the Support Vector Machnes Hlaro Gómez-Moreno, Saturnno Maldonado-Bascón, Francsco López-Ferreras Sgnal Theory and Communcatons Department. Unversty of Alcalá Crta. Madrd-Barcelona

More information

A B-Snake Model Using Statistical and Geometric Information - Applications to Medical Images

A B-Snake Model Using Statistical and Geometric Information - Applications to Medical Images A B-Snake Model Usng Statstcal and Geometrc Informaton - Applcatons to Medcal Images Yue Wang, Eam Khwang Teoh and Dnggang Shen 2 School of Electrcal and Electronc Engneerng, Nanyang Technologcal Unversty

More information

Feature-based image registration using the shape context

Feature-based image registration using the shape context Feature-based mage regstraton usng the shape context LEI HUANG *, ZHEN LI Center for Earth Observaton and Dgtal Earth, Chnese Academy of Scences, Bejng, 100012, Chna Graduate Unversty of Chnese Academy

More information

Lecture 5: Multilayer Perceptrons

Lecture 5: Multilayer Perceptrons Lecture 5: Multlayer Perceptrons Roger Grosse 1 Introducton So far, we ve only talked about lnear models: lnear regresson and lnear bnary classfers. We noted that there are functons that can t be represented

More information

Solving two-person zero-sum game by Matlab

Solving two-person zero-sum game by Matlab Appled Mechancs and Materals Onlne: 2011-02-02 ISSN: 1662-7482, Vols. 50-51, pp 262-265 do:10.4028/www.scentfc.net/amm.50-51.262 2011 Trans Tech Publcatons, Swtzerland Solvng two-person zero-sum game by

More information

A Clustering Algorithm for Key Frame Extraction Based on Density Peak

A Clustering Algorithm for Key Frame Extraction Based on Density Peak Journal of Computer and Communcatons, 2018, 6, 118-128 http://www.scrp.org/ournal/cc ISSN Onlne: 2327-5227 ISSN Prnt: 2327-5219 A Clusterng Algorthm for Key Frame Extracton Based on Densty Peak Hong Zhao

More information

Some material adapted from Mohamed Younis, UMBC CMSC 611 Spr 2003 course slides Some material adapted from Hennessy & Patterson / 2003 Elsevier

Some material adapted from Mohamed Younis, UMBC CMSC 611 Spr 2003 course slides Some material adapted from Hennessy & Patterson / 2003 Elsevier Some materal adapted from Mohamed Youns, UMBC CMSC 611 Spr 2003 course sldes Some materal adapted from Hennessy & Patterson / 2003 Elsever Scence Performance = 1 Executon tme Speedup = Performance (B)

More information

The Research of Ellipse Parameter Fitting Algorithm of Ultrasonic Imaging Logging in the Casing Hole

The Research of Ellipse Parameter Fitting Algorithm of Ultrasonic Imaging Logging in the Casing Hole Appled Mathematcs, 04, 5, 37-3 Publshed Onlne May 04 n ScRes. http://www.scrp.org/journal/am http://dx.do.org/0.436/am.04.584 The Research of Ellpse Parameter Fttng Algorthm of Ultrasonc Imagng Loggng

More information

Feature-Area Optimization: A Novel SAR Image Registration Method

Feature-Area Optimization: A Novel SAR Image Registration Method Feature-Area Optmzaton: A Novel SAR Image Regstraton Method Fuqang Lu, Fukun B, Lang Chen, Hao Sh and We Lu Abstract Ths letter proposes a synthetc aperture radar (SAR) mage regstraton method named Feature-Area

More information

Type-2 Fuzzy Non-uniform Rational B-spline Model with Type-2 Fuzzy Data

Type-2 Fuzzy Non-uniform Rational B-spline Model with Type-2 Fuzzy Data Malaysan Journal of Mathematcal Scences 11(S) Aprl : 35 46 (2017) Specal Issue: The 2nd Internatonal Conference and Workshop on Mathematcal Analyss (ICWOMA 2016) MALAYSIAN JOURNAL OF MATHEMATICAL SCIENCES

More information

An inverse problem solution for post-processing of PIV data

An inverse problem solution for post-processing of PIV data An nverse problem soluton for post-processng of PIV data Wt Strycznewcz 1,* 1 Appled Aerodynamcs Laboratory, Insttute of Avaton, Warsaw, Poland *correspondng author: wt.strycznewcz@lot.edu.pl Abstract

More information

Color in OpenGL Polygonal Shading Light Source in OpenGL Material Properties Normal Vectors Phong model

Color in OpenGL Polygonal Shading Light Source in OpenGL Material Properties Normal Vectors Phong model Color n OpenGL Polygonal Shadng Lght Source n OpenGL Materal Propertes Normal Vectors Phong model 2 We know how to rasterze - Gven a 3D trangle and a 3D vewpont, we know whch pxels represent the trangle

More information

Face Recognition University at Buffalo CSE666 Lecture Slides Resources:

Face Recognition University at Buffalo CSE666 Lecture Slides Resources: Face Recognton Unversty at Buffalo CSE666 Lecture Sldes Resources: http://www.face-rec.org/algorthms/ Overvew of face recognton algorthms Correlaton - Pxel based correspondence between two face mages Structural

More information

An Image Fusion Approach Based on Segmentation Region

An Image Fusion Approach Based on Segmentation Region Rong Wang, L-Qun Gao, Shu Yang, Yu-Hua Cha, and Yan-Chun Lu An Image Fuson Approach Based On Segmentaton Regon An Image Fuson Approach Based on Segmentaton Regon Rong Wang, L-Qun Gao, Shu Yang 3, Yu-Hua

More information