Simultaneous Localization and Mapping with Stereo Vision

Size: px
Start display at page:

Download "Simultaneous Localization and Mapping with Stereo Vision"

Transcription

1 Simulaneous Localizaion and Mapping wih Sereo Vision Mahew N. Dailey Compuer Science and Informaion Managemen Asian Insiue of Technology Pahumhani, Thailand Manukid Parnichkun Mecharonics Asian Insiue of Technology Pahumhani, Thailand Absrac In he simulaneous localizaion and mapping (SLAM) problem, a mobile robo mus build a map of is environmen while simulaneously deermining is locaion wihin ha map. We propose a new algorihm, for visual SLAM (VSLAM), in which he robo s only sensory informaion is video imagery. Our approach combines sereo vision wih a popular sequenial Mone Carlo (SMC) algorihm, he Rao-Blackwellised paricle filer, o simulaneously explore muliple hypoheses abou he robo s six degree-of-freedom rajecory hrough space and mainain a disinc sochasic map for each of hose candidae rajecories. We demonsrae he algorihm s effeciveness in mapping a large oudoor virual realiy environmen in he presence of odomery error. Keywords Localizaion, mapping, sereo vision, Rao- Blackwellised paricle filer, visual landmarks I. INTRODUCTION Simulaneous Localizaion and Mapping (SLAM) is he problem of a mobile robo consrucing a meric map from noisy sensor readings while simulaneously esimaing is locaion from he parial map and noisy odomery measuremens. SLAM is one of he fundamenal challenges for mobile roboics research. Alough recen years have seen grea advances in 2D mapping wih laser range finders, exclusively vision-based SLAM (VSLAM) is sill limied o relaively small scale, highly srucured indoor environmens. We are ineresed in aking VSLAM beyond he ypical office building environmen ino larger, bu sill srucured, environmens such as college campuses, office parks, and shopping malls. Poenial applicaion areas include securiy, inspecion, landscape mainenance, agriculure, and personal service. Achieving his goal wihou giving he robo an a-priori map requires new echnology. The majoriy of vision-based SLAM research o dae has focused on auomaic consrucion of occupancy grids or opological maps (see [8] for a survey), boh of which are inappropriae for large-scale meric mapping. The ideal approach would consruc a sparse 3D represenaion of he environmen. Early VSLAM sysems did use sparse feaures, bu hey ypically compressed he map o 2D. For example, Kriegman, Triendl, and Binford s sysem [11] uses a sereo sensor o exrac verical lines from he environmen. Observed lines are used o reduce odomeric uncerainy using an exended Kalman filer (EKF), hen he observaions are in urn used o updae an environmen map conaining 2D poin feaures represening he observed verical lines. Yagi, Nishizawa, and Yachida s sysem [21] ook a similar approach bu used a single omnidireciona vision sensor and accumulaion of measuremens over ime, raher han sereo, o deermine he posiions of verical line landmarks. These sysems and ohers have amply demonsraed he efficacy of VSLAM based on line landmarks in consrained indoor environmens wih smooh floors. Faugeras and colleagues [1], [22] were he firs o develop a VSLAM sysem soring a sparse 3D map. Their sysem firs consrucs a local 3D line segmen map of he curren scene using rinocular sereo. I explicily represens he uncerainy abou each feaure s robo-relaive pose in he form of a covariance marix. The new local map is regisered agains he curren global map and used o updae an esimae of he robo s posiion using an EKF. Finally, assuming he robo s posiion, he global map is be updaed wih he freshly observed feaures, again using EKFs. Se, Lowe, and Lile [16] demonsrae he use of SIFT (scale invarian feaure ransform) poin feaures as landmarks for he VSLAM problem. Their sysem also uses a rinocular sereo camera rig and models he posiional uncerainy of he landmarks wih Kalman filers. Sim and Dudek [17] ake a differen approach; raher han prespecifying he feaures (lines, poins, corners, and so on) ha should be used for map building and localizaion, heir sysem learns generaive models for he appearance of salien feaures during exploraion. Unil quie recenly, mos VSLAM sysems limied hemselves by separaing he moion esimaion and map esimaion problems. Typically, a each sep, he robo s locaion would be esimaed via Bayesian inference or some oher esimaion echnique, hen ha posiion would be assumed for he map updae. While his approach leads o fas algorihms, no considering alernaive robo poses when esimaing landmark posiions is subopimal. Oher researchers in he roboics communiy ook a formal probabilisic approach and explored he possibiliy of represening, a each poin in ime, he full join poserior disribuion over robo rajecories and landmark /06/$20.00 c 2006 IEEE ICARCV 2006

2 posiions. Smih, Self, and Cheeseman [19] inroduced he sochasic map, which represens no only he posiions of landmarks in he world wih heir associaed uncerainies, bu also he uncerainy of he robo s posiion, he covariance beween each pair of landmarks, and he covariance beween he robo s posiion and each landmark. This seminal heoreical work inspired many successful SLAM sysems, e.g. [2], [7], [12]. In a paricularly impressive demonsraion of he power of he sochasic map approach, Davison and colleagues [5], [6] have solved he VSLAM problem wih poin landmarks exraced from a single camera wihou odomery. Their sysem runs in real ime a 30 Hz. While he sochasic map very accuraely represens all of he available informaion abou landmark and robo posiions (wihin he limis of he Gaussian approximaion), he mehod unforunaely canno scale o he housands of landmarks needed for large-scale environmens, due o he size of he full covariance marix. Murphy [13], however, recognized ha in SLAM, map elemens are condiionally independen given he robo s rajecory hrough ime. He used his insigh in he design of he Rao-Blackwellised paricle filer (RBPF), in which he join poserior over robo rajecories and maps is represened by a se of samples or paricles, each paricle conaining one possible robo rajecory and he corresponding sochasic map. The fac ha he robo s rajecory is fixed for a given paricle has an imporan consequence: all of he covariances beween differen map elemens in he sochasic map become 0. For a landmark map, his means he covariance marix for each individual landmark is sufficien o represen all of he available knowledge of he environmen. Murphy only demonsraed he RBPF on a oy problem, bu more recen work has applied he echnique o he real world wih immense success. Monemerlo, Thrun, and colleagues [20] use he RBPF and 2D poin landmarks measured by a laser scanner o consruc large-scale 2D maps. In heir sysem, each paricle represens a possible robo rajecory, se of daa associaions, and landmark map. The maps are sored in a ree srucure ha allows sharing subrees beween paricles, allowing a real-ime implemenaion ha scales o housands of landmarks. Eliazar and Parr [9] also use he RBPF and a laser scanner for SLAM, bu build a 2D occupancy grid raher han a landmark daabase. Their algorihm also requires a sophisicaed daa srucure ha allows sharing maps beween paricles. Even more recenly, researchers have begun o apply he RBPF o he VSLAM problem. Sim e al. [18] exrac SIFT poin feaures from sereo daa and combine he observaions wih visual odomery o build 3D landmark maps. According o he auhors, his sae-of-he ar sysem has consruced he larges and mos deailed VSLAM map ever, in a large indoor laboraory environmen. In our work, we ake a similar approach, combining he RBPF wih vision sensors, excep ha we use 3D line segmens for localizaion and map building, raher han he more commonly used poin feaures [18], [20]. Line parameers can be esimaed more accuraely han poins, since he esimae incorporaes more observed daa. This means i may be possible o obain more accurae robo localizaion from line landmarks han poin landmarks, depending on he characerisics of he robo s workspace. Lines also provide more informaion abou he environmen s geomery han do poins, allowing more sophisicaed inference abou he srucure of he world. However, lines also have an imporan disadvanage wih respec o poins: hey are less disincive, making i more difficul o find correc correspondences beween a se of observed lines and he lines in a sored model. We overcome his difficuly by sampling many possible poses from he robo s moion model, obaining a differen possible observaion-model correspondence given each robo pose, and allowing he fies correspondences o survive in he paricle filer. Our algorihm is called VL-SLAM (Visual Line-based SLAM). Here we describe VL-SLAM and demonsrae is effeciveness in a series of experimens. The main conribuions of his paper are 1) an effecive sensor model for line landmarks obained from a sereo camera rig, 2) a new proposal disribuion for he RBPF ha overcomes he limiaions imposed by highly uncerain correspondences, and 3) experimenal evidence of he feasibiliy of VL-SLAM using realisic, albei synheic, daa. II. VL-SLAM VL-SLAM is based on he FasSLAM family of algorihms proposed by Monemerlo, Thrun and colleagues [20]. A each poin 1... T, he robo performs an acion u aking i from posiion s 1 o s and uses is sensors o obain an observaion z. We seek a recursive esimae of p(s 0:, Θ u 1:, z 1: ) (1) where Θ is a map conaining he posiions of each of a se of poin landmarks. Raher han esimae he disribuion (1) analyically, we approximae he poserior wih a discree se of M samples (someimes called paricles) { < s [m] 0:, Θ[m] 0: >, where each index m 1... M }. (2) Here s [m] 0: is he specific robo rajecory from ime 0 o ime associaed wih paricle m, and Θ [m] 0: is he sochasic landmark map associaed wih paricle m (he map is derived from s [m] 0:, z 1:, and u 1: ). FasSLAM (and VL-SLAM) use he sequenial Mone Carlo echniques of sequenial imporance sampling and imporance resampling. Firs, for each paricle, we sample from some proposal disribuion π(s 0:, Θ 0: z 1:, u 1: ) (3) o obain a emporary se of paricles for ime, hen evaluae he imporance weigh w [m] for each emporary paricle, where w(s 0:, Θ 0: ) = p(s 0:, Θ 0: u 1:, z 1: ) π(s 0:, Θ 0: u 1:, z 1, ). (4) The imporance weighs are normalized o sum o 1, hen we sample M paricles, wih replacemen, from he emporary paricle se according o he normalized weighs.

3 VL-SLAM exends FasSLAM wih a new sensor model for 3D line segmens and a new proposal disribuion π( ) appropriae for environmens wih highly ambiguous observaionmodel correspondences. We firs describe he 3D line segmen sensor model hen VL-SLAM proposal disribuion. A. VL-SLAM 3D Line Segmen Sensor Model Afer each robo moion u, a se of rinocular sereo images is capured, and a se z of landmark measuremens (line segmens) is exraced from hose images. These line segmen measuremens, along wih he measured moion u, are used o updae each paricle s map and posiion esimae. Our sysem assumes a calibraed sereo camera rig wih hree pinhole cameras. I can handle general fundamenal marices (he images need no be perfecly recified), bu we do assume ha one camera is roughly horizonally displaced and a second camera is roughly verically displaced from a hird (reference) camera. The basic 2D feaure in our sysem is he line segmen. We exrac line segmens using Canny s mehod [4] following he implemenaion in VISTA [14]. The edge deecor firs performs nonmaxima suppression, links he edge pixels ino chains, and reains he srong edges wih hyseresis. Once edge chains are exraced from he image, we approximae each chain by a sequence of line segmens. Shor line segmens, indicaing edges wih high curvaure, are simply discarded in he curren sysem. We use a sraighforward sereo maching algorihm similar o he approach of [22]. For each line segmen in he reference image, we compue he segmen s midpoin, hen consider each segmen inersecing ha midpoin s epipolar line in he horizonally displaced image. Segmens no meeing line orienaion and dispariy consrains are discarded. Each of hese poenial maches deermines he locaion and orienaion of a segmen in he hird image. If such a consisen segmen is indeed found in he hird image, he poenial mach is reained; oherwise i is discarded. If a he end of his process, we have one and only one consisen mach, we assume i correc; oherwise, he reference image line segmen is simply ignored. Now our goal is o esimae a hree-dimensional line from he hree observed wo-dimensional lines. Infinie lines have four insrinsic parameers, so i would make sense o use a four-dimensional represenaion of a lines. However, since VL-SLAM uses a Kalman filer o combine landmark observaions, we require a linear parameerizaion of landmarks, and no linear four-dimensional represenaion of lines exiss [1]. Insead we represen lines wih six componens: a 3D poin represening he midpoin of he observed line segmen and a 3D vecor whose direcion represens he direcion of he line and whose lengh represens he disance from he line segmen s midpoin o one of is endpoins. This 6D represenaion behaves well under linear combinaion, so long as he direcion vecors are flipped o have a posiive do produc. Firs we obain a maximum likelihood esimae of he infinie 3D line s parameers assuming Gaussian measuremen error in he image using Levenberg-Marquard minimizaion [15]. As an iniial esimae of he line s parameers, we use he 3D line (uniquely) deermined by wo of he 2D line segmen measuremens. Once he infinie line has been esimaed, we find he segmen s exrema and midpoin using he observed daa. Through each sep of he 3D line esimaion process, we mainain explici Gaussian error esimaes. We begin by assuming spherical Gaussian measuremen error in he image wih a sandard deviaion of one pixel. Arranging he n (x, y) coordinaes of he pixels in a line as a column vecor x, he covariance of x is simply Σ x = I 2n 2n. Since he vecor of parameers l describing he 2D line bes fiing x is a nonlinear funcion l = f(x), he covariance of l is Σ l = JΣ x J T, where J is he Jacobian marix f x evaluaed a x. The maximum likelihood esimae of he 3D line obained from he hree 2D line segmens l = (l 1, l 2, l 3 ) is clearly no a simple funcion, since i is compued by an ieraive opimizaion procedure. However, if l = f(l) is he funcion mapping from he parameer space o he measuremen space, i urns ou ha, o firs order, ˆL is a random variable wih covariance marix (J T Σ l J) 1, where J is he Jacobian marix l L [10]. The rank of he resuling covariance marix is only four, however, so o consrain he remaining wo degrees of freedom, we add o he rank-deficien covariance marix a covariance marix describing he expeced error in our esimae of he segmen s midpoin and anoher covariance marix describing he expeced error in our esimae of he segmen s lengh. This gives us a full-rank covariance marix ha resrics maching line segmens o no only be similar in erms of heir supporing infinie line, bu also o overlap and have similar lengh. Once he six-dimensional represenaion of an observed 3D line is esimaed from a rinocular line correspondence, i is necessary o ransform ha line from camera coordinaes ino robo coordinaes, since he reference camera is in general ranslaed and roaed relaive o he robo iself. I is also necessary o ransform landmarks from robo coordinaes ino world coordinaes, when he robo s posiion is deermined, for insance, and from world coordinaes back o robo coordinaes, when a landmark in he map is considered as a possible mach for an observed (robo coordinae) landmark. In each of hese cases, he ransformed line L = (L) is compued as a nonlinear funcion of he original line, and he ransformed line s covariance is propagaed by Σ L = JΣ L J T, where J is he Jacobian marix L evaluaed a L. B. VL-SLAM Proposal Disribuion The proposal disribuion π( ) (3) can be any disribuion ha is sraighforward o sample from. However, i is bes if π( ) closely approximaes he full join poserior (1), in which case he imporance weighs will be nearly uniform, and mos paricles will survive he resampling sep. In FasSLAM 1.0 [20], he proposal disribuion is simply p(s s 1, u ), i.e. he moion model predicing s given a previous posiion s 1 and acion u. The auhors observe ha his proposal disribuion,

4 Fig. 1. (a) (b) (c) Sample rinocular image se capured in simulaion. (a) Reference image. (b) Horizonally aligned image. (c) Verically aligned image. while simple o sample from, does no ake ino accoun he curren observaion z. This leads o FasSLAM 2.0, in which he proposal disribuion is p(s s [m] 0: 1, Θ[m] 0: 1, u 1:, z 1: ). This disribuion akes no only he previous robo pose s 1 and curren acion u ino accoun, bu also considers he curren map Θ 0: 1 and new observaion z. In he general case, his disribuion could be quie difficul o sample from, bu he auhors find ha by linearizing he sensor model and applying he Markov assumpion, he proposal disribuion can be approximaed o firs order by a Gaussian disribuion whose mean and covariance can be calculaed from known quaniies, if he correspondence beween he observaion z and he curren map Θ 0: 1 is known. When he correspondences are unknown (he usual case in SLAM), FasSLAM 2.0 assumes he maximum likelihood correspondence or draws a sample from a probabiliy disribuion over all possible correspondences. When he observaions and landmarks are sparse, as is he case in he FasSLAM environmen, his is sraighforward, and FasSLAM 2.0 is much more successful han FasSLAM 1.0, since i uses he available se of paricles wisely [20]. In VL-SLAM, however, each observaion consiss of on he order of 100 individual 3D line segmens, and ypically he landmark daabase conains several poenial maches for each observed line. This means ha i is impossible o consider even a small fracion of he possible correspondences for each paricle. In pracice, o limi he compuaional complexiy, we mus draw a single correspondence from he se of all possible correspondences wihou considering oo many alernaives. Bu how can we choose a likely correspondence for a given observaion? In VL-SLAM, when propagaing a paricle forward from ime 1 o ime, we firs fraw a sample s from he robo s moion model o esablish a correspondence beween he observed line segmens and he curren map (resembling FasSLAM 1.0), hen from ha inermediae sample poin, assuming he esablished correspondence, sample again, from he FasSLAM 2.0 proposal disribuion. As in FasSLAM 2.0, he proposal disribuion is closer o he full join poserior disribuion, concenraing more of he emporary paricles in regions of high probabiliy according o he full join poserior. To calculae he imporance weighs for he he VL-SLAM proposal disribuion, we firs inroduce random variables n indicaing he correspondence beween he line segmens observed a ime and he map. In VL-SLAM, he mh paricle s map Θ [m] 0: is a deerminisic funcion of he sampled rajecory s [m] 0:, he sampled correspondences n[m] 1:, and he observaions z 1:, so we rewrie he desired full join poserior as p(s 0:, n 1: u 1:, z 1: ). (5) Now, assuming we have a good esimae of he full join poserior a ime 1, he VL-SLAM proposal disribuion can be wrien as he produc n [m] p(n [m], s [m], s [m] 0: 1, n[m] 0: 1, z 1:, u 1: ) s [m] s [m] 0: 1, n[m] 1: 1, z 1: 1, u 1: ) p(s [m] s [m] 0: 1, n[m] 1: 1, z 1: 1, u 1: ) 0: 1, n[m] 0: 1 u 1: 1, z 1: ), (6) where s represens he inermediae sample drawn from he moion model. For he mh paricle, he imporance weigh is he raio of he expressions in (5) and (6), which, wih several applicaions of Bayes rule and he Markov assumpion, can be closely approximaed as (deails ommied): w [m] = s [m] 1, u )p(z s [m] 0:, n[m] 1:, z 1: 1) z, s [m], n [m] 1:, s[m] 0: 1, z 1: 1, u 1: )p(s [m] s [m] 1, u ) (7) Following [20], we linearize he sensor model and moion model, which leads o sraighforward Gaussian approximaions for each of he erms in (7). Excep for he sensor model and proposal disribuion jus described, VL-SLAM is similar o FasSLAM (see [20] for deails). Once correspondences and he sampled pose are deermined for an individual paricle, each observed landmark is combined wih is corresponding map landmark using an exended Kalman filer, or iniialized as a new landmark in he map. To achieve fas search for landmarks corresponding o a given observaion, each paricle s map is sored in a binary k- D ree whose leaves are he 3D line segmens wih associaed Gaussian uncerainies. However, o minimize oal memory requiremens and o enable consan-ime copying of maps

5 during he resampling sage, he paricles are allowed o share subrees. As we shall see in he nex secion, he diversiy of possible correspondences inroduced by he firs sampling sep (as in FasSLAM 1.0), combined wih he use of he curren observaion z in he proposal disribuion (as in FasSLAM 2.0), allows VL-SLAM o ouperform boh FasSLAM 1.0 and FasSLAM 2.0 on a challenging synheic esbed. III. EXPERIMENTAL RESULTS To enable rigorous esing of VL-SLAM in an environmen wih a precisely known ground ruh, we implemened a virual realiy simulaion allowing a virual robo o move hrough a virual world rendered wih OpenGL from a VRML model. We chose as an environmen a publically-available 3D model of Housesead s for, a Roman garrison from he 3rd cenury A.D. on Hadrian s Wall in Briain [3]. A sample view from our virual rinocular sereo rig is shown in Figure 1. We eleoperaed our virual robo hrough his virual world in a long loop of abou 300m. A approximaely 1m inervals, he virual camera rig was insruced o capure a se of sills from is hree cameras. The virual camera models a real 10cm baseline, 70 field of view rinocular rig we recenly buil in our lab. To make he daase somewha challenging, we simulaed he effecs of a raveling on an imperfec oudoor surface, so ha he robo s verical (Z) posiion varied approximaely ±0.04m from 0, is pich and roll varied ±2.5 degrees from 0, and is yaw varied ±3 degrees from is expeced course. This environmen is an ineresing esbed for VL-SLAM because, on he one hand, i generaes many long, srong, sraigh edges ha should be useful for localizaion. On he oher hand, i is highly exured, creaing a large number of edges, and he exures are highly repeiive in many places, leading o many ambiguiies for correspondence algorihms. I is also large enough o preclude fine-grained grid-based echniques and noisy enough o preclude he use of fla-earh or hree-degree-of-freedom assumpions. We compared VL-SLAM wih our own implemenaions of FasSLAM 1.0 and 2.0. As previously discussed, FasSLAM 2.0 was no designed o handle large observaions wih highly uncerain correspondences. In our implemenaion, we simply obain he maximum likelihood correspondence assuming he robo is a he posiion obained by propagaing s [m] 1 forward in ime according o odomery o obain ŝ [m]. Wih his cavea abou he FasSLAM 2.0 resuls, Figure 2 shows one measure of each algorihm s performance: he log-likelihood of he observaion daa given he bes paricle s robo rajecory sample and map; Figure 3 shows he final map according o he bes VL-SLAM paricle. All of he localizaion algorihms do much beer han he baseline (odomery-only) algorihm. Due o is commimen o robo posiion ŝ [m] when deermining correspondences in our implemenaion, FasSLAM 2.0 fares raher poorly. Since FasSLAM 1.0 samples from he moion model before obaining a correspondence, i performs much beer, bu VL-SLAM, which combines he bes feaures of boh algorihms, ouperforms hem boh. IV. CONCLUSION In his paper, we have demonsraed he feasibiliy of VL- SLAM on a challenging synheic daa se. The VL-SLAM proposal disribuion improves on FasSLAM in environmens wih large numbers of ambiguous observaions. However, Figure 2 shows ha here is sill improvemen o be made: he log-likelihood of he observaions given perfec localizaion is sill much beer han he log-likelihood of he observaions under VL-SLAM s model. This means here is sill informaion abou he robo s posiion o be exploied in he observed daa. This is also evidenced in Figure 3, which compares he VL- SLAM map o he map consruced wih perfec knowledge of he robo s locaion. Alhough he map is locally fairly accurae, global drif occurs hroughou he run, prevening he algorihm from closing he loop when he robo reurns o is saring posiion. This is mos likely due o an impoverished se of paricles. In fuure work, we plan o improve VL-SLAM s loop closing behavior and evaluae he algorihm on a variey of indoor and oudoor real-world daa ses. ACKNOWLEDGMENTS This research was suppored by Thailand Research Fund gran MRG o MND. REFERENCES [1] N. Ayache and D. Faugeras. Mainaining represenaions of he environmen of a mobile robo. IEEE Transacions on Roboics and Auomaion, 5(6): , [2] S. Borhwick and H. Durran-Whye. Simulaneous localisaion and map building for auonomous guided vehicles. In Proceedings of he IEEE/RSJ/GI Inernaional Conference on Inelligen Robos and Sysems (IROS), pages , [3] Briish Broadcasing Corporaion. Housesead s For (3D model), hp:// hisory/3d/housead.shml. [4] J. Canny. A compuaional approach o edge deecion. IEEE Transacions on Paern Analysis and Machine Inelligence, 8(6), [5] A. Davison. Real-ime simulaneous localisaion and mapping wih a single camera. In Proceedings of he Inernaional Conference on Compuer Vision (ICCV), pages , [6] A. Davison, Y. Cid, and N. Kia. Real-ime 3D SLAM wih wide-angle vision. In Proceedings of he IFAC Symposium on Inelligen Auonomous Vehicles, [7] A. Davison and N. Kia. 3D simulaneous localisaion and map-building using acive vision for a robo moving on undulaing errain. In Proceedings of he IEEE Conference on Compuer Vision and Paern Recogniion (CVPR), pages , [8] G. DeSouza and A. Kak. Vision for mobile robo navigaion: A survey. IEEE Transacions on Paern Analysis and Machine Inelligence, 24(2): , [9] A. Eliazar and R. Parr. DP-SLAM 2.0. In Proceedings of he IEEE Inernaional Conference on Roboics and Auomaion (ICRA), [10] R. Harley and A. Zisserman. Muliple View Geomery in Compuer Vision. Universiy Press, Cambridge, UK, [11] D. Kriegman, F. Triendl, and T. Binford. Sereo vision and navigaion in buildings for mobile robos. IEEE Transacions on Roboics and Auomaion, 5(6): , [12] P. Mouarlier and R. Chaila. Sochasic mulisensory daa fusion for mobile robo locaion and environmen modeling. In 5h Inernaional Symposium on Roboics Research, [13] K. Murphy. Bayesian map learning in dynamic environmens. In Advances in Neural Informaion Processing Sysems (NIPS), [14] A. Pope and D. Lowe. Visa: A sofware environmen for compuer vision research. In IEEE Conference on Compuer Vision and Paern Recogniion, [15] W. Press, B. Flannery, S. Teukolsky, and W. Veerling. Numerical Recipes in C. Cambridge Universiy Press, Cambridge, UK, 1988.

6 -400 Log Likelihood FasSLAM 1.0 FasSLAM 2.0 VL-SLAM Perfec localizaion Odomery only Number of paricles Fig. 2. Log likelihood of line observaions according o he bes paricle s sampled robo posiion and map, averaged over 320 ses of observaions. Fig. 3. (a) Map consruced by VL-SLAM (a), compared o he he map assuming perfec knowledge of he robo s rajecory (b). (b) [16] S. Se, D. Lowe, and J. Lile. Mobile robo localizaion and mapping wih uncerainy using scale-invarian visual landmarks. The Inernaional Journal of Roboics Research, 21(8): , [17] R. Sim and G. Dudek. Learning generaive models of scene feaures. Inernaional Journal of Compuer Vision, 60(1):45 61, [18] R. Sim, P. Elinas, M. Griffin, and J. Lile. Vision-based SLAM using he Rao-Blackwellised paricle filer. In IJCAI Workshop on Reasoning wih Uncerainy in Roboics (RUR), [19] R. Smih, M. Self, and P. Cheeseman. Esimaing uncerain spaial relaionships in roboics. In I. Cox and G. Wilfong, ediors, Auonomous Robo Vehicles. Springer Verlag, [20] S. Thrun, M. Monemerlo, D. Koller, B. Wegbrei, J. Nieo, and E. Nebo. FasSLAM: An efficien soluion o he simulaneous localizaion and mapping problem wih unknown daa associaion. Journal of Machine Learning Research, To appear. [21] Y. Yagi, Y. Nishizawa, and M. Yachida. Map-based navigaion for a mobile robo wih omnidirecional image sensor copis. IEEE Transacions on Roboics and Auomaion, 11(5): , [22] Z. Zhang and O. Faugeras. 3D Dynamic Scene Analysis. Springer-Verlag, 1992.

Visual Indoor Localization with a Floor-Plan Map

Visual Indoor Localization with a Floor-Plan Map Visual Indoor Localizaion wih a Floor-Plan Map Hang Chu Dep. of ECE Cornell Universiy Ihaca, NY 14850 hc772@cornell.edu Absrac In his repor, a indoor localizaion mehod is presened. The mehod akes firsperson

More information

Improving Occupancy Grid FastSLAM by Integrating Navigation Sensors

Improving Occupancy Grid FastSLAM by Integrating Navigation Sensors Improving Occupancy Grid FasSLAM by Inegraing Navigaion Sensors Chrisopher Weyers Sensors Direcorae Air Force Research Laboraory Wrigh-Paerson AFB, OH 45433 Gilber Peerson Deparmen of Elecrical and Compuer

More information

Mobile Robots Mapping

Mobile Robots Mapping Mobile Robos Mapping 1 Roboics is Easy conrol behavior percepion modelling domain model environmen model informaion exracion raw daa planning ask cogniion reasoning pah planning navigaion pah execuion

More information

Learning in Games via Opponent Strategy Estimation and Policy Search

Learning in Games via Opponent Strategy Estimation and Policy Search Learning in Games via Opponen Sraegy Esimaion and Policy Search Yavar Naddaf Deparmen of Compuer Science Universiy of Briish Columbia Vancouver, BC yavar@naddaf.name Nando de Freias (Supervisor) Deparmen

More information

Rao-Blackwellized Particle Filtering for Probing-Based 6-DOF Localization in Robotic Assembly

Rao-Blackwellized Particle Filtering for Probing-Based 6-DOF Localization in Robotic Assembly MITSUBISHI ELECTRIC RESEARCH LABORATORIES hp://www.merl.com Rao-Blackwellized Paricle Filering for Probing-Based 6-DOF Localizaion in Roboic Assembly Yuichi Taguchi, Tim Marks, Haruhisa Okuda TR1-8 June

More information

CAMERA CALIBRATION BY REGISTRATION STEREO RECONSTRUCTION TO 3D MODEL

CAMERA CALIBRATION BY REGISTRATION STEREO RECONSTRUCTION TO 3D MODEL CAMERA CALIBRATION BY REGISTRATION STEREO RECONSTRUCTION TO 3D MODEL Klečka Jan Docoral Degree Programme (1), FEEC BUT E-mail: xkleck01@sud.feec.vubr.cz Supervised by: Horák Karel E-mail: horak@feec.vubr.cz

More information

SLAM in Large Indoor Environments with Low-Cost, Noisy, and Sparse Sonars

SLAM in Large Indoor Environments with Low-Cost, Noisy, and Sparse Sonars SLAM in Large Indoor Environmens wih Low-Cos, Noisy, and Sparse Sonars Teddy N. Yap, Jr. and Chrisian R. Shelon Deparmen of Compuer Science and Engineering Universiy of California, Riverside, CA 92521,

More information

Robot localization under perceptual aliasing conditions based on laser reflectivity using particle filter

Robot localization under perceptual aliasing conditions based on laser reflectivity using particle filter Robo localizaion under percepual aliasing condiions based on laser refleciviy using paricle filer DongXiang Zhang, Ryo Kurazume, Yumi Iwashia, Tsuomu Hasegawa Absrac Global localizaion, which deermines

More information

STEREO PLANE MATCHING TECHNIQUE

STEREO PLANE MATCHING TECHNIQUE STEREO PLANE MATCHING TECHNIQUE Commission III KEY WORDS: Sereo Maching, Surface Modeling, Projecive Transformaion, Homography ABSTRACT: This paper presens a new ype of sereo maching algorihm called Sereo

More information

A Matching Algorithm for Content-Based Image Retrieval

A Matching Algorithm for Content-Based Image Retrieval A Maching Algorihm for Conen-Based Image Rerieval Sue J. Cho Deparmen of Compuer Science Seoul Naional Universiy Seoul, Korea Absrac Conen-based image rerieval sysem rerieves an image from a daabase using

More information

Visual Perception as Bayesian Inference. David J Fleet. University of Toronto

Visual Perception as Bayesian Inference. David J Fleet. University of Toronto Visual Percepion as Bayesian Inference David J Flee Universiy of Torono Basic rules of probabiliy sum rule (for muually exclusive a ): produc rule (condiioning): independence (def n ): Bayes rule: marginalizaion:

More information

IROS 2015 Workshop on On-line decision-making in multi-robot coordination (DEMUR 15)

IROS 2015 Workshop on On-line decision-making in multi-robot coordination (DEMUR 15) IROS 2015 Workshop on On-line decision-making in muli-robo coordinaion () OPTIMIZATION-BASED COOPERATIVE MULTI-ROBOT TARGET TRACKING WITH REASONING ABOUT OCCLUSIONS KAROL HAUSMAN a,, GREGORY KAHN b, SACHIN

More information

Learning nonlinear appearance manifolds for robot localization

Learning nonlinear appearance manifolds for robot localization Learning nonlinear appearance manifolds for robo localizaion Jihun Hamm, Yuanqing Lin, and Daniel. D. Lee GRAS Lab, Deparmen of Elecrical and Sysems Engineering Universiy of ennsylvania, hiladelphia, A

More information

Implementing Ray Casting in Tetrahedral Meshes with Programmable Graphics Hardware (Technical Report)

Implementing Ray Casting in Tetrahedral Meshes with Programmable Graphics Hardware (Technical Report) Implemening Ray Casing in Terahedral Meshes wih Programmable Graphics Hardware (Technical Repor) Marin Kraus, Thomas Erl March 28, 2002 1 Inroducion Alhough cell-projecion, e.g., [3, 2], and resampling,

More information

A Fast Stereo-Based Multi-Person Tracking using an Approximated Likelihood Map for Overlapping Silhouette Templates

A Fast Stereo-Based Multi-Person Tracking using an Approximated Likelihood Map for Overlapping Silhouette Templates A Fas Sereo-Based Muli-Person Tracking using an Approximaed Likelihood Map for Overlapping Silhouee Templaes Junji Saake Jun Miura Deparmen of Compuer Science and Engineering Toyohashi Universiy of Technology

More information

Real-time 2D Video/3D LiDAR Registration

Real-time 2D Video/3D LiDAR Registration Real-ime 2D Video/3D LiDAR Regisraion C. Bodenseiner Fraunhofer IOSB chrisoph.bodenseiner@iosb.fraunhofer.de M. Arens Fraunhofer IOSB michael.arens@iosb.fraunhofer.de Absrac Progress in LiDAR scanning

More information

EECS 487: Interactive Computer Graphics

EECS 487: Interactive Computer Graphics EECS 487: Ineracive Compuer Graphics Lecure 7: B-splines curves Raional Bézier and NURBS Cubic Splines A represenaion of cubic spline consiss of: four conrol poins (why four?) hese are compleely user specified

More information

Large-scale 3D Outdoor Mapping and On-line Localization using 3D-2D Matching

Large-scale 3D Outdoor Mapping and On-line Localization using 3D-2D Matching Large-scale 3D Oudoor Mapping and On-line Localizaion using 3D-D Maching Takahiro Sakai, Kenji Koide, Jun Miura, and Shuji Oishi Absrac Map-based oudoor navigaion is an acive research area in mobile robos

More information

Probabilistic Detection and Tracking of Motion Discontinuities

Probabilistic Detection and Tracking of Motion Discontinuities Probabilisic Deecion and Tracking of Moion Disconinuiies Michael J. Black David J. Flee Xerox Palo Alo Research Cener 3333 Coyoe Hill Road Palo Alo, CA 94304 fblack,fleeg@parc.xerox.com hp://www.parc.xerox.com/fblack,fleeg/

More information

Robust 3D Visual Tracking Using Particle Filtering on the SE(3) Group

Robust 3D Visual Tracking Using Particle Filtering on the SE(3) Group Robus 3D Visual Tracking Using Paricle Filering on he SE(3) Group Changhyun Choi and Henrik I. Chrisensen Roboics & Inelligen Machines, College of Compuing Georgia Insiue of Technology Alana, GA 3332,

More information

Reinforcement Learning by Policy Improvement. Making Use of Experiences of The Other Tasks. Hajime Kimura and Shigenobu Kobayashi

Reinforcement Learning by Policy Improvement. Making Use of Experiences of The Other Tasks. Hajime Kimura and Shigenobu Kobayashi Reinforcemen Learning by Policy Improvemen Making Use of Experiences of The Oher Tasks Hajime Kimura and Shigenobu Kobayashi Tokyo Insiue of Technology, JAPAN genfe.dis.iech.ac.jp, kobayasidis.iech.ac.jp

More information

A time-space consistency solution for hardware-in-the-loop simulation system

A time-space consistency solution for hardware-in-the-loop simulation system Inernaional Conference on Advanced Elecronic Science and Technology (AEST 206) A ime-space consisency soluion for hardware-in-he-loop simulaion sysem Zexin Jiang a Elecric Power Research Insiue of Guangdong

More information

Robust Visual Tracking for Multiple Targets

Robust Visual Tracking for Multiple Targets Robus Visual Tracking for Muliple Targes Yizheng Cai, Nando de Freias, and James J. Lile Universiy of Briish Columbia, Vancouver, B.C., Canada, V6T 1Z4 {yizhengc, nando, lile}@cs.ubc.ca Absrac. We address

More information

FACIAL ACTION TRACKING USING PARTICLE FILTERS AND ACTIVE APPEARANCE MODELS. Soumya Hamlaoui & Franck Davoine

FACIAL ACTION TRACKING USING PARTICLE FILTERS AND ACTIVE APPEARANCE MODELS. Soumya Hamlaoui & Franck Davoine FACIAL ACTION TRACKING USING PARTICLE FILTERS AND ACTIVE APPEARANCE MODELS Soumya Hamlaoui & Franck Davoine HEUDIASYC Mixed Research Uni, CNRS / Compiègne Universiy of Technology BP 20529, 60205 Compiègne

More information

Improved TLD Algorithm for Face Tracking

Improved TLD Algorithm for Face Tracking Absrac Improved TLD Algorihm for Face Tracking Huimin Li a, Chaojing Yu b and Jing Chen c Chongqing Universiy of Poss and Telecommunicaions, Chongqing 400065, China a li.huimin666@163.com, b 15023299065@163.com,

More information

Occlusion-Free Hand Motion Tracking by Multiple Cameras and Particle Filtering with Prediction

Occlusion-Free Hand Motion Tracking by Multiple Cameras and Particle Filtering with Prediction 58 IJCSNS Inernaional Journal of Compuer Science and Nework Securiy, VOL.6 No.10, Ocober 006 Occlusion-Free Hand Moion Tracking by Muliple Cameras and Paricle Filering wih Predicion Makoo Kao, and Gang

More information

RGB-D Object Tracking: A Particle Filter Approach on GPU

RGB-D Object Tracking: A Particle Filter Approach on GPU RGB-D Objec Tracking: A Paricle Filer Approach on GPU Changhyun Choi and Henrik I. Chrisensen Cener for Roboics & Inelligen Machines College of Compuing Georgia Insiue of Technology Alana, GA 3332, USA

More information

Image segmentation. Motivation. Objective. Definitions. A classification of segmentation techniques. Assumptions for thresholding

Image segmentation. Motivation. Objective. Definitions. A classification of segmentation techniques. Assumptions for thresholding Moivaion Image segmenaion Which pixels belong o he same objec in an image/video sequence? (spaial segmenaion) Which frames belong o he same video sho? (emporal segmenaion) Which frames belong o he same

More information

Sam knows that his MP3 player has 40% of its battery life left and that the battery charges by an additional 12 percentage points every 15 minutes.

Sam knows that his MP3 player has 40% of its battery life left and that the battery charges by an additional 12 percentage points every 15 minutes. 8.F Baery Charging Task Sam wans o ake his MP3 player and his video game player on a car rip. An hour before hey plan o leave, he realized ha he forgo o charge he baeries las nigh. A ha poin, he plugged

More information

Terrain Based GPS Independent Lane-Level Vehicle Localization using Particle Filter and Dead Reckoning

Terrain Based GPS Independent Lane-Level Vehicle Localization using Particle Filter and Dead Reckoning Terrain Based GPS Independen -Level Vehicle Localizaion using Paricle Filer and Dead Reckoning Hamad Ahmed and Muhammad Tahir Deparmen of Elecrical Engineering, Lahore Universiy of Managemen Sciences,

More information

Upper Body Tracking for Human-Machine Interaction with a Moving Camera

Upper Body Tracking for Human-Machine Interaction with a Moving Camera The 2009 IEEE/RSJ Inernaional Conference on Inelligen Robos and Sysems Ocober -5, 2009 S. Louis, USA Upper Body Tracking for Human-Machine Ineracion wih a Moving Camera Yi-Ru Chen, Cheng-Ming Huang, and

More information

Video Content Description Using Fuzzy Spatio-Temporal Relations

Video Content Description Using Fuzzy Spatio-Temporal Relations Proceedings of he 4s Hawaii Inernaional Conference on Sysem Sciences - 008 Video Conen Descripion Using Fuzzy Spaio-Temporal Relaions rchana M. Rajurkar *, R.C. Joshi and Sananu Chaudhary 3 Dep of Compuer

More information

Gauss-Jordan Algorithm

Gauss-Jordan Algorithm Gauss-Jordan Algorihm The Gauss-Jordan algorihm is a sep by sep procedure for solving a sysem of linear equaions which may conain any number of variables and any number of equaions. The algorihm is carried

More information

AUTOMATIC 3D FACE REGISTRATION WITHOUT INITIALIZATION

AUTOMATIC 3D FACE REGISTRATION WITHOUT INITIALIZATION Chaper 3 AUTOMATIC 3D FACE REGISTRATION WITHOUT INITIALIZATION A. Koschan, V. R. Ayyagari, F. Boughorbel, and M. A. Abidi Imaging, Roboics, and Inelligen Sysems Laboraory, The Universiy of Tennessee, 334

More information

MODEL BASED TECHNIQUE FOR VEHICLE TRACKING IN TRAFFIC VIDEO USING SPATIAL LOCAL FEATURES

MODEL BASED TECHNIQUE FOR VEHICLE TRACKING IN TRAFFIC VIDEO USING SPATIAL LOCAL FEATURES MODEL BASED TECHNIQUE FOR VEHICLE TRACKING IN TRAFFIC VIDEO USING SPATIAL LOCAL FEATURES Arun Kumar H. D. 1 and Prabhakar C. J. 2 1 Deparmen of Compuer Science, Kuvempu Universiy, Shimoga, India ABSTRACT

More information

An Iterative Scheme for Motion-Based Scene Segmentation

An Iterative Scheme for Motion-Based Scene Segmentation An Ieraive Scheme for Moion-Based Scene Segmenaion Alexander Bachmann and Hildegard Kuehne Deparmen for Measuremen and Conrol Insiue for Anhropomaics Universiy of Karlsruhe (H), 76 131 Karlsruhe, Germany

More information

Motion Level-of-Detail: A Simplification Method on Crowd Scene

Motion Level-of-Detail: A Simplification Method on Crowd Scene Moion Level-of-Deail: A Simplificaion Mehod on Crowd Scene Absrac Junghyun Ahn VR lab, EECS, KAIST ChocChoggi@vr.kais.ac.kr hp://vr.kais.ac.kr/~zhaoyue Recen echnological improvemen in characer animaion

More information

Stereo Vision Based Navigation of a Six-Legged Walking Robot in Unknown Rough Terrain

Stereo Vision Based Navigation of a Six-Legged Walking Robot in Unknown Rough Terrain Sereo Vision Based Navigaion of a Six-Legged Walking Robo in Unknown Rough Terrain Anne Selzer, Heiko Hirschmüller, Marin Görner Absrac This paper presens a visual navigaion algorihm for he six-legged

More information

In Proceedings of CVPR '96. Structure and Motion of Curved 3D Objects from. using these methods [12].

In Proceedings of CVPR '96. Structure and Motion of Curved 3D Objects from. using these methods [12]. In Proceedings of CVPR '96 Srucure and Moion of Curved 3D Objecs from Monocular Silhouees B Vijayakumar David J Kriegman Dep of Elecrical Engineering Yale Universiy New Haven, CT 652-8267 Jean Ponce Compuer

More information

In fmri a Dual Echo Time EPI Pulse Sequence Can Induce Sources of Error in Dynamic Magnetic Field Maps

In fmri a Dual Echo Time EPI Pulse Sequence Can Induce Sources of Error in Dynamic Magnetic Field Maps In fmri a Dual Echo Time EPI Pulse Sequence Can Induce Sources of Error in Dynamic Magneic Field Maps A. D. Hahn 1, A. S. Nencka 1 and D. B. Rowe 2,1 1 Medical College of Wisconsin, Milwaukee, WI, Unied

More information

Low-Cost WLAN based. Dr. Christian Hoene. Computer Science Department, University of Tübingen, Germany

Low-Cost WLAN based. Dr. Christian Hoene. Computer Science Department, University of Tübingen, Germany Low-Cos WLAN based Time-of-fligh fligh Trilaeraion Precision Indoor Personnel Locaion and Tracking for Emergency Responders Third Annual Technology Workshop, Augus 5, 2008 Worceser Polyechnic Insiue, Worceser,

More information

MORPHOLOGICAL SEGMENTATION OF IMAGE SEQUENCES

MORPHOLOGICAL SEGMENTATION OF IMAGE SEQUENCES MORPHOLOGICAL SEGMENTATION OF IMAGE SEQUENCES B. MARCOTEGUI and F. MEYER Ecole des Mines de Paris, Cenre de Morphologie Mahémaique, 35, rue Sain-Honoré, F 77305 Fonainebleau Cedex, France Absrac. In image

More information

SLAM WITH KLT POINT FEATURES. P.O. Box 22, Thammasat-Rangsit Post Office, Pathumthani Thailand

SLAM WITH KLT POINT FEATURES. P.O. Box 22, Thammasat-Rangsit Post Office, Pathumthani Thailand SLAM WITH KLT POINT FEATURES Yoichi Nakaguro, 1 Matthew Dailey, Stanislav Makhanov 1 1 Sirindhorn International Institute of Technology, Thammasat University P.O. Box, Thammasat-Rangsit Post Office, Pathumthani

More information

Multiple View Discriminative Appearance Modeling with IMCMC for Distributed Tracking

Multiple View Discriminative Appearance Modeling with IMCMC for Distributed Tracking Muliple View Discriminaive ing wih IMCMC for Disribued Tracking Sanhoshkumar Sunderrajan, B.S. Manjunah Deparmen of Elecrical and Compuer Engineering Universiy of California, Sana Barbara {sanhosh,manj}@ece.ucsb.edu

More information

Analysis of Various Types of Bugs in the Object Oriented Java Script Language Coding

Analysis of Various Types of Bugs in the Object Oriented Java Script Language Coding Indian Journal of Science and Technology, Vol 8(21), DOI: 10.17485/ijs/2015/v8i21/69958, Sepember 2015 ISSN (Prin) : 0974-6846 ISSN (Online) : 0974-5645 Analysis of Various Types of Bugs in he Objec Oriened

More information

arxiv: v1 [cs.cv] 11 Jan 2019

arxiv: v1 [cs.cv] 11 Jan 2019 A General Opimizaion-based Framework for Global Pose Esimaion wih Muliple Sensors arxiv:191.3642v1 [cs.cv] 11 Jan 219 Tong Qin, Shaozu Cao, Jie Pan, and Shaojie Shen Absrac Accurae sae esimaion is a fundamenal

More information

A Hierarchical Object Recognition System Based on Multi-scale Principal Curvature Regions

A Hierarchical Object Recognition System Based on Multi-scale Principal Curvature Regions A Hierarchical Objec Recogniion Sysem Based on Muli-scale Principal Curvaure Regions Wei Zhang, Hongli Deng, Thomas G Dieerich and Eric N Morensen School of Elecrical Engineering and Compuer Science Oregon

More information

MATH Differential Equations September 15, 2008 Project 1, Fall 2008 Due: September 24, 2008

MATH Differential Equations September 15, 2008 Project 1, Fall 2008 Due: September 24, 2008 MATH 5 - Differenial Equaions Sepember 15, 8 Projec 1, Fall 8 Due: Sepember 4, 8 Lab 1.3 - Logisics Populaion Models wih Harvesing For his projec we consider lab 1.3 of Differenial Equaions pages 146 o

More information

A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER

A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER ABSTRACT Modern graphics cards for compuers, and especially heir graphics processing unis (GPUs), are designed for fas rendering of graphics.

More information

Proceeding of the 6 th International Symposium on Artificial Intelligence and Robotics & Automation in Space: i-sairas 2001, Canadian Space Agency,

Proceeding of the 6 th International Symposium on Artificial Intelligence and Robotics & Automation in Space: i-sairas 2001, Canadian Space Agency, Proceeding of he 6 h Inernaional Symposium on Arificial Inelligence and Roboics & Auomaion in Space: i-sairas 00, Canadian Space Agency, S-Huber, Quebec, Canada, June 8-, 00. Muli-resoluion Mapping Using

More information

Video-Based Face Recognition Using Probabilistic Appearance Manifolds

Video-Based Face Recognition Using Probabilistic Appearance Manifolds Video-Based Face Recogniion Using Probabilisic Appearance Manifolds Kuang-Chih Lee Jeffrey Ho Ming-Hsuan Yang David Kriegman klee10@uiuc.edu jho@cs.ucsd.edu myang@honda-ri.com kriegman@cs.ucsd.edu Compuer

More information

Multi-Target Detection and Tracking from a Single Camera in Unmanned Aerial Vehicles (UAVs)

Multi-Target Detection and Tracking from a Single Camera in Unmanned Aerial Vehicles (UAVs) 2016 IEEE/RSJ Inernaional Conference on Inelligen Robos and Sysems (IROS) Daejeon Convenion Cener Ocober 9-14, 2016, Daejeon, Korea Muli-Targe Deecion and Tracking from a Single Camera in Unmanned Aerial

More information

Real Time Integral-Based Structural Health Monitoring

Real Time Integral-Based Structural Health Monitoring Real Time Inegral-Based Srucural Healh Monioring The nd Inernaional Conference on Sensing Technology ICST 7 J. G. Chase, I. Singh-Leve, C. E. Hann, X. Chen Deparmen of Mechanical Engineering, Universiy

More information

Scale Recovery for Monocular Visual Odometry Using Depth Estimated with Deep Convolutional Neural Fields

Scale Recovery for Monocular Visual Odometry Using Depth Estimated with Deep Convolutional Neural Fields Scale Recovery for Monocular Visual Odomery Using Deph Esimaed wih Deep Convoluional Neural Fields Xiaochuan Yin, Xiangwei Wang, Xiaoguo Du, Qijun Chen Tongji Universiy yinxiaochuan@homail.com,wangxiangwei.cpp@gmail.com,

More information

Dynamic Route Planning and Obstacle Avoidance Model for Unmanned Aerial Vehicles

Dynamic Route Planning and Obstacle Avoidance Model for Unmanned Aerial Vehicles Volume 116 No. 24 2017, 315-329 ISSN: 1311-8080 (prined version); ISSN: 1314-3395 (on-line version) url: hp://www.ijpam.eu ijpam.eu Dynamic Roue Planning and Obsacle Avoidance Model for Unmanned Aerial

More information

4.1 3D GEOMETRIC TRANSFORMATIONS

4.1 3D GEOMETRIC TRANSFORMATIONS MODULE IV MCA - 3 COMPUTER GRAPHICS ADMN 29- Dep. of Compuer Science And Applicaions, SJCET, Palai 94 4. 3D GEOMETRIC TRANSFORMATIONS Mehods for geomeric ransformaions and objec modeling in hree dimensions

More information

CENG 477 Introduction to Computer Graphics. Modeling Transformations

CENG 477 Introduction to Computer Graphics. Modeling Transformations CENG 477 Inroducion o Compuer Graphics Modeling Transformaions Modeling Transformaions Model coordinaes o World coordinaes: Model coordinaes: All shapes wih heir local coordinaes and sies. world World

More information

Hierarchical Information Fusion for Human Upper Limb Motion Capture

Hierarchical Information Fusion for Human Upper Limb Motion Capture 1h Inernaional Conference on Informaion Fusion Seale, WA, USA, July 6-9, 009 Hierarchical Informaion Fusion for Human Upper Limb Moion Capure Zhiqiang Zhang 1,, Zhipei Huang 1 and Jiankang Wu 1, 1 Graduae

More information

3-D Object Modeling and Recognition for Telerobotic Manipulation

3-D Object Modeling and Recognition for Telerobotic Manipulation Research Showcase @ CMU Roboics Insiue School of Compuer Science 1995 3-D Objec Modeling and Recogniion for Teleroboic Manipulaion Andrew Johnson Parick Leger Regis Hoffman Marial Heber James Osborn Follow

More information

Quantitative macro models feature an infinite number of periods A more realistic (?) view of time

Quantitative macro models feature an infinite number of periods A more realistic (?) view of time INFINIE-HORIZON CONSUMPION-SAVINGS MODEL SEPEMBER, Inroducion BASICS Quaniaive macro models feaure an infinie number of periods A more realisic (?) view of ime Infinie number of periods A meaphor for many

More information

IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART A: SYSTEMS AND HUMANS 1

IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART A: SYSTEMS AND HUMANS 1 TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART A: SYSTEMS AND HUMANS 1 Adapive Appearance Model and Condensaion Algorihm for Robus Face Tracking Yui Man Lui, Suden Member,, J. Ross Beveridge, Member,,

More information

An Adaptive Spatial Depth Filter for 3D Rendering IP

An Adaptive Spatial Depth Filter for 3D Rendering IP JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, VOL.3, NO. 4, DECEMBER, 23 175 An Adapive Spaial Deph Filer for 3D Rendering IP Chang-Hyo Yu and Lee-Sup Kim Absrac In his paper, we presen a new mehod

More information

Research Article Auto Coloring with Enhanced Character Registration

Research Article Auto Coloring with Enhanced Character Registration Compuer Games Technology Volume 2008, Aricle ID 35398, 7 pages doi:0.55/2008/35398 Research Aricle Auo Coloring wih Enhanced Characer Regisraion Jie Qiu, Hock Soon Seah, Feng Tian, Quan Chen, Zhongke Wu,

More information

MOTION TRACKING is a fundamental capability that

MOTION TRACKING is a fundamental capability that TECHNICAL REPORT CRES-05-008, CENTER FOR ROBOTICS AND EMBEDDED SYSTEMS, UNIVERSITY OF SOUTHERN CALIFORNIA 1 Real-ime Moion Tracking from a Mobile Robo Boyoon Jung, Suden Member, IEEE, Gaurav S. Sukhame,

More information

Image Based Computer-Aided Manufacturing Technology

Image Based Computer-Aided Manufacturing Technology Sensors & Transducers 03 by IFSA hp://www.sensorsporal.com Image Based Compuer-Aided Manufacuring Technology Zhanqi HU Xiaoqin ZHANG Jinze LI Wei LI College of Mechanical Engineering Yanshan Universiy

More information

LAMP: 3D Layered, Adaptive-resolution and Multiperspective Panorama - a New Scene Representation

LAMP: 3D Layered, Adaptive-resolution and Multiperspective Panorama - a New Scene Representation Submission o Special Issue of CVIU on Model-based and Image-based 3D Scene Represenaion for Ineracive Visualizaion LAMP: 3D Layered, Adapive-resoluion and Muliperspecive Panorama - a New Scene Represenaion

More information

AML710 CAD LECTURE 11 SPACE CURVES. Space Curves Intrinsic properties Synthetic curves

AML710 CAD LECTURE 11 SPACE CURVES. Space Curves Intrinsic properties Synthetic curves AML7 CAD LECTURE Space Curves Inrinsic properies Synheic curves A curve which may pass hrough any region of hreedimensional space, as conrased o a plane curve which mus lie on a single plane. Space curves

More information

arxiv: v1 [cs.cv] 11 Jan 2019

arxiv: v1 [cs.cv] 11 Jan 2019 A General Opimizaion-based Framewor for Local Odomery Esimaion wih Muliple Sensors Tong Qin, Jie Pan, Shaozu Cao, and Shaojie Shen arxiv:191.3638v1 [cs.cv] 11 Jan 219 Absrac Nowadays, more and more sensors

More information

Definition and examples of time series

Definition and examples of time series Definiion and examples of ime series A ime series is a sequence of daa poins being recorded a specific imes. Formally, le,,p be a probabiliy space, and T an index se. A real valued sochasic process is

More information

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors We are InechOpen, he world s leading publisher of Open Access books Buil by scieniss, for scieniss 4,000 116,000 120M Open access books available Inernaional auhors and ediors Downloads Our auhors are

More information

A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER

A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER Gusaf Hendeby, Jeroen D. Hol, Rickard Karlsson, Fredrik Gusafsson Deparmen of Elecrical Engineering Auomaic Conrol Linköping Universiy,

More information

Michiel Helder and Marielle C.T.A Geurts. Hoofdkantoor PTT Post / Dutch Postal Services Headquarters

Michiel Helder and Marielle C.T.A Geurts. Hoofdkantoor PTT Post / Dutch Postal Services Headquarters SHORT TERM PREDICTIONS A MONITORING SYSTEM by Michiel Helder and Marielle C.T.A Geurs Hoofdkanoor PTT Pos / Duch Posal Services Headquarers Keywords macro ime series shor erm predicions ARIMA-models faciliy

More information

Computer representations of piecewise

Computer representations of piecewise Edior: Gabriel Taubin Inroducion o Geomeric Processing hrough Opimizaion Gabriel Taubin Brown Universiy Compuer represenaions o piecewise smooh suraces have become vial echnologies in areas ranging rom

More information

Shortest Path Algorithms. Lecture I: Shortest Path Algorithms. Example. Graphs and Matrices. Setting: Dr Kieran T. Herley.

Shortest Path Algorithms. Lecture I: Shortest Path Algorithms. Example. Graphs and Matrices. Setting: Dr Kieran T. Herley. Shores Pah Algorihms Background Seing: Lecure I: Shores Pah Algorihms Dr Kieran T. Herle Deparmen of Compuer Science Universi College Cork Ocober 201 direced graph, real edge weighs Le he lengh of a pah

More information

Scheduling. Scheduling. EDA421/DIT171 - Parallel and Distributed Real-Time Systems, Chalmers/GU, 2011/2012 Lecture #4 Updated March 16, 2012

Scheduling. Scheduling. EDA421/DIT171 - Parallel and Distributed Real-Time Systems, Chalmers/GU, 2011/2012 Lecture #4 Updated March 16, 2012 EDA421/DIT171 - Parallel and Disribued Real-Time Sysems, Chalmers/GU, 2011/2012 Lecure #4 Updaed March 16, 2012 Aemps o mee applicaion consrains should be done in a proacive way hrough scheduling. Schedule

More information

IntentSearch:Capturing User Intention for One-Click Internet Image Search

IntentSearch:Capturing User Intention for One-Click Internet Image Search JOURNAL OF L A T E X CLASS FILES, VOL. 6, NO. 1, JANUARY 2010 1 InenSearch:Capuring User Inenion for One-Click Inerne Image Search Xiaoou Tang, Fellow, IEEE, Ke Liu, Jingyu Cui, Suden Member, IEEE, Fang

More information

Indoor SLAM for Micro Aerial Vehicles Using Visual and Laser Sensor Fusion

Indoor SLAM for Micro Aerial Vehicles Using Visual and Laser Sensor Fusion Indoor SLAM for Micro Aerial Vehicles Ug Visual and Laser Sensor Fusion Elena López, Rafael Barea, Alejandro Gómez, Álvaro Salos, Luis M. Bergasa, Eduardo J. Molinos and Abdelkrim Nemra * Absrac This paper

More information

STRING DESCRIPTIONS OF DATA FOR DISPLAY*

STRING DESCRIPTIONS OF DATA FOR DISPLAY* SLAC-PUB-383 January 1968 STRING DESCRIPTIONS OF DATA FOR DISPLAY* J. E. George and W. F. Miller Compuer Science Deparmen and Sanford Linear Acceleraor Cener Sanford Universiy Sanford, California Absrac

More information

Network management and QoS provisioning - QoS in Frame Relay. . packet switching with virtual circuit service (virtual circuits are bidirectional);

Network management and QoS provisioning - QoS in Frame Relay. . packet switching with virtual circuit service (virtual circuits are bidirectional); QoS in Frame Relay Frame relay characerisics are:. packe swiching wih virual circui service (virual circuis are bidirecional);. labels are called DLCI (Daa Link Connecion Idenifier);. for connecion is

More information

Tracking a Large Number of Objects from Multiple Views

Tracking a Large Number of Objects from Multiple Views Tracking a Large Number of Objecs from Muliple Views Zheng Wu 1, Nickolay I. Hrisov 2, Tyson L. Hedrick 3, Thomas H. Kun 2, Margri Beke 1 1 Deparmen of Compuer Science, Boson Universiy 2 Deparmen of Biology,

More information

Sequential Monte Carlo Tracking for Marginal Artery Segmentation on CT Angiography by Multiple Cue Fusion

Sequential Monte Carlo Tracking for Marginal Artery Segmentation on CT Angiography by Multiple Cue Fusion Sequenial Mone Carlo Tracking for Marginal Arery Segmenaion on CT Angiography by Muliple Cue Fusion Shijun Wang, Brandon Peplinski, Le Lu, Weidong Zhang, Jianfei Liu, Zhuoshi Wei, and Ronald M. Summers

More information

TrackNet: Simultaneous Detection and Tracking of Multiple Objects

TrackNet: Simultaneous Detection and Tracking of Multiple Objects TrackNe: Simulaneous Deecion and Tracking of Muliple Objecs Chenge Li New York Universiy cl2840@nyu.edu Gregory Dobler New York Universiy greg.dobler@nyu.edu Yilin Song New York Universiy ys1297@nyu.edu

More information

Image Content Representation

Image Content Representation Image Conen Represenaion Represenaion for curves and shapes regions relaionships beween regions E.G.M. Perakis Image Represenaion & Recogniion 1 Reliable Represenaion Uniqueness: mus uniquely specify an

More information

Improving 2D Reactive Navigators with Kinect

Improving 2D Reactive Navigators with Kinect Improving 2D Reacive Navigaors wih Kinec Javier Gonzalez-Jimenez, J.R. Ruiz-Sarmieno, and Cipriano Galindo Sysem Enginnering and Auomaion Dp., Malaga, Spain {javiergonzalez, joaraul, cgalindo}@uma.es Keywords:

More information

Robust Multi-view Face Detection Using Error Correcting Output Codes

Robust Multi-view Face Detection Using Error Correcting Output Codes Robus Muli-view Face Deecion Using Error Correcing Oupu Codes Hongming Zhang,2, Wen GaoP P, Xilin Chen 2, Shiguang Shan 2, and Debin Zhao Deparmen of Compuer Science and Engineering, Harbin Insiue of Technolog

More information

Optimal Crane Scheduling

Optimal Crane Scheduling Opimal Crane Scheduling Samid Hoda, John Hooker Laife Genc Kaya, Ben Peerson Carnegie Mellon Universiy Iiro Harjunkoski ABB Corporae Research EWO - 13 November 2007 1/16 Problem Track-mouned cranes move

More information

4. Minimax and planning problems

4. Minimax and planning problems CS/ECE/ISyE 524 Inroducion o Opimizaion Spring 2017 18 4. Minima and planning problems ˆ Opimizing piecewise linear funcions ˆ Minima problems ˆ Eample: Chebyshev cener ˆ Muli-period planning problems

More information

J. Vis. Commun. Image R.

J. Vis. Commun. Image R. J. Vis. Commun. Image R. 20 (2009) 9 27 Conens liss available a ScienceDirec J. Vis. Commun. Image R. journal homepage: www.elsevier.com/locae/jvci Face deecion and racking using a Boosed Adapive Paricle

More information

SENSING using 3D technologies, structured light cameras

SENSING using 3D technologies, structured light cameras IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 39, NO. 10, OCTOBER 2017 2045 Real-Time Enhancemen of Dynamic Deph Videos wih Non-Rigid Deformaions Kassem Al Ismaeil, Suden Member,

More information

ACQUIRING high-quality and well-defined depth data. Online Temporally Consistent Indoor Depth Video Enhancement via Static Structure

ACQUIRING high-quality and well-defined depth data. Online Temporally Consistent Indoor Depth Video Enhancement via Static Structure SUBMITTED TO TRANSACTION ON IMAGE PROCESSING 1 Online Temporally Consisen Indoor Deph Video Enhancemen via Saic Srucure Lu Sheng, Suden Member, IEEE, King Ngi Ngan, Fellow, IEEE, Chern-Loon Lim and Songnan

More information

An Improved Square-Root Nyquist Shaping Filter

An Improved Square-Root Nyquist Shaping Filter An Improved Square-Roo Nyquis Shaping Filer fred harris San Diego Sae Universiy fred.harris@sdsu.edu Sridhar Seshagiri San Diego Sae Universiy Seshigar.@engineering.sdsu.edu Chris Dick Xilinx Corp. chris.dick@xilinx.com

More information

Wheelchair-user Detection Combined with Parts-based Tracking

Wheelchair-user Detection Combined with Parts-based Tracking Wheelchair-user Deecion Combined wih Pars-based Tracking Ukyo Tanikawa 1, Yasuomo Kawanishi 1, Daisuke Deguchi 2,IchiroIde 1, Hiroshi Murase 1 and Ryo Kawai 3 1 Graduae School of Informaion Science, Nagoya

More information

PART 1 REFERENCE INFORMATION CONTROL DATA 6400 SYSTEMS CENTRAL PROCESSOR MONITOR

PART 1 REFERENCE INFORMATION CONTROL DATA 6400 SYSTEMS CENTRAL PROCESSOR MONITOR . ~ PART 1 c 0 \,).,,.,, REFERENCE NFORMATON CONTROL DATA 6400 SYSTEMS CENTRAL PROCESSOR MONTOR n CONTROL DATA 6400 Compuer Sysems, sysem funcions are normally handled by he Monior locaed in a Peripheral

More information

Viewpoint Invariant 3D Landmark Model Inference from Monocular 2D Images Using Higher-Order Priors

Viewpoint Invariant 3D Landmark Model Inference from Monocular 2D Images Using Higher-Order Priors Viewpoin Invarian 3D Landmark Model Inference from Monocular 2D Images Using Higher-Order Priors Chaohui Wang 1,2, Yun Zeng 3, Loic Simon 1, Ioannis Kakadiaris 4, Dimiris Samaras 3, Nikos Paragios 1,2

More information

Research Article Particle Filtering: The Need for Speed

Research Article Particle Filtering: The Need for Speed Hindawi Publishing Corporaion EURASIP Journal on Advances in Signal Processing Volume 2010, Aricle ID 181403, 9 pages doi:10.1155/2010/181403 Research Aricle Paricle Filering: The Need for Speed Gusaf

More information

Detection and segmentation of moving objects in highly dynamic scenes

Detection and segmentation of moving objects in highly dynamic scenes Deecion and segmenaion of moving objecs in highly dynamic scenes Aurélie Bugeau Parick Pérez INRIA, Cenre Rennes - Breagne Alanique Universié de Rennes, Campus de Beaulieu, 35 042 Rennes Cedex, France

More information

Landmarks: A New Model for Similarity-Based Pattern Querying in Time Series Databases

Landmarks: A New Model for Similarity-Based Pattern Querying in Time Series Databases Lmarks: A New Model for Similariy-Based Paern Querying in Time Series Daabases Chang-Shing Perng Haixun Wang Sylvia R. Zhang D. So Parker perng@cs.ucla.edu hxwang@cs.ucla.edu Sylvia Zhang@cle.com so@cs.ucla.edu

More information

Real-Time Non-Rigid Multi-Frame Depth Video Super-Resolution

Real-Time Non-Rigid Multi-Frame Depth Video Super-Resolution Real-Time Non-Rigid Muli-Frame Deph Video Super-Resoluion Kassem Al Ismaeil 1, Djamila Aouada 1, Thomas Solignac 2, Bruno Mirbach 2, Björn Oersen 1 1 Inerdisciplinary Cenre for Securiy, Reliabiliy, and

More information

FIELD PROGRAMMABLE GATE ARRAY (FPGA) AS A NEW APPROACH TO IMPLEMENT THE CHAOTIC GENERATORS

FIELD PROGRAMMABLE GATE ARRAY (FPGA) AS A NEW APPROACH TO IMPLEMENT THE CHAOTIC GENERATORS FIELD PROGRAMMABLE GATE ARRAY (FPGA) AS A NEW APPROACH TO IMPLEMENT THE CHAOTIC GENERATORS Mohammed A. Aseeri and M. I. Sobhy Deparmen of Elecronics, The Universiy of Ken a Canerbury Canerbury, Ken, CT2

More information

Spline Curves. Color Interpolation. Normal Interpolation. Last Time? Today. glshademodel (GL_SMOOTH); Adjacency Data Structures. Mesh Simplification

Spline Curves. Color Interpolation. Normal Interpolation. Last Time? Today. glshademodel (GL_SMOOTH); Adjacency Data Structures. Mesh Simplification Las Time? Adjacency Daa Srucures Spline Curves Geomeric & opologic informaion Dynamic allocaion Efficiency of access Mesh Simplificaion edge collapse/verex spli geomorphs progressive ransmission view-dependen

More information