arxiv: v1 [cs.ro] 8 Jul 2016

Transcription

1 Non-Central Catadoptrc Cameras Pose Estmaton usng 3D Lnes* André Mateus, Pedro Mraldo and Pedro U. Lma arxv: v1 [cs.ro] 8 Jul 2016 Abstract In ths artcle we purpose a novel method for planar pose estmaton of moble robots. Ths method s based on an analytc soluton (whch we derved) for the projecton of 3D straght lnes, onto the mrror of Non-Central Catadoptrc Cameras (NCCS). The resultng soluton s rewrtten as a functon of the rotaton and translaton parameters, whch s then used as an error functon for a set of mrror ponts. Those should be the result of the projecton of a set of ponts ncdent wth the respectve 3D lnes. The camera s pose s gven by mnmzng the error functon, wth the assocated constrants. The method s valdated by experments both wth synthetc and real data. The latter was collected from a moble robot equpped wth a NCCS. I. INTRODUCTION The ablty of a robot to estmate ts absolute pose and/or localze tself n the envronment s a fundamental task for an autonomous robot. The pose estmaton problem conssts n fndng the rgd transformaton, between the robot s frame and the world coordnates system, whch s defned by a rotaton and a translaton. In ths work, a robot s equpped wth a NCCS on-board, whch s used to estmate ts pose. Catadoptrc devces have been n used n some applcaton s robotcs, an example s robot competons, [1]. The majorty of vson-based pose estmaton methods proposed n the lterature focus on perspectve cameras, [2]. Examples of methods are: [3], [4] usng non-mnmal number of known 3D ponts; [5] non-mnmal solutons usng 3D lnes; and [6], [7] for mnmal solutons usng both ponts and lnes. The wdespread use of ths type of cameras s due to ther smplcty and well-known mathematcal model. However, ther feld of vew (FOV) s lmted. In order to overcome that lmtaton, the focus s ncreasngly shftng towards other magng devces, whch ensure a wder FOV, the most notable are the catadoptrc cameras, [8]. These cameras combne quadrc mrrors wth perspectve cameras for ncreased FOV. Some of these devces were bult to comply wth the central projecton model, e.g. [9], [10]. However, n general (and n practce) ths constrant s not verfed. Thus, the catadoptrc camera systems are, most of the tmes, non-central cameras,.e., they do no verfy the central projecton model [11]. The problem of absolute pose estmaton, based on general non-central camera models, as been addressed by Chen and Chang, [12], Schweghofer and Pnz, [13], Nster and Stewenus, [14] and Mraldo and Araujo, [15] for the known matchng between 3D ponts and ther correspondent mage All authors are wth the Insttute for Systems and Robotcs, Insttuto Superor Técnco, Unversdade de Lsboa, Torre Norte - 7 Pso Av.Rovsco Pas, Lsboa, Portugal. E-Mal: pmraldo@sr.tecnco.ulsboa.pt pxels. Ths problem was also addressed for known 3D lnes at Mraldo et al., [16], for the 3D pose, and at Mraldo and Araujo, [17], for the planar pose (the problem addressed n ths work). The problem of the projecton of 3D ponts onto mrrors and, consequently, to mages of non-central catadoptrc cameras as been studed by some authors, n the last few years. For nstance at [18], Gonçalves proposed an teratve soluton to ths problem. Later, Agrawal et. al. [19], proposed an exact projecton model (but stll teratve for general confguratons) for NCCS. They derved a forward projecton equaton, wth no restrctons n the camera s locaton, where the projecton pont on a rotatonally symmetrc quadrc mrror can be found (n general) by solvng an 8 th degree polynomal equaton. However, n practce, t s useful to use other features, such as 3D straght lnes. Snce the lnes are an one dmenson object, the assocaton between ther features n the world and ts respectve mages s easer and, thus, can be used for a wde range of applcatons. Ths work s two-sded, we frst derve the equaton, whch represents the projecton of a 3D straght lne onto the mrror s surface of non-central catadoptrc cameras (henceforward denoted as reflecton curve). We concluded that the curve can be analytcally represented by a 10 th degree polynomal equaton. Then, we address the planar pose estmaton problem by means of an objectve cost functon. Ths was obtaned by rewrtng the reflecton curve as a functon of the rgd transformaton parameters. The objectve cost functon s then appled to a set of mrror ponts (n the camera reference frame), whch belong to the reflecton curve of known 3D lnes (n the world frame). The soluton s found by mnmzng the sum of the absolute value of the cost functon for each pont of each lne. The methods are valdated through synthetc data n dfferent types of mrrors. The pose estmaton method s also valdated wth real data, from a NCCS mounted on top of a moble robot. Throughout ths artcle, we denote vectors by lowercase bold letters, e.g. b, matrces are denoted by uppercase bold letters, e.g. A, and regular lowercase letters represent zero dmenson elements. The symbol s used to represent up to a scale factor equatons. The superscrpts (W) and (C) represent elements n the world and camera frames respectvely. Captal greek symbols represent 3D elements, e.g. Γ(x, y, z), lowercase symbols represent 2D elements, e.g. γ(y,z), wth the excepton of the symbols λ and θ, whch represent problem varables. Ths paper s structured as follows: Secton II presents the reflecton curve dervaton; n Secton III we descrbe the pose estmaton method. Sectons IV-A and IV-B present

2 m(λ) Mrror Snce the normal vector at the reflecton pont on the mrror les on the reflecton plane, any pont defned by k = m(λ + νn, also belongs to the plane. Settng ν = 1, the pont 3D Scene v r (λ) v (λ) Γ k = [0 0 z Az + B/2] T, (5) p. = q+λd Camera can be defned. Snce ths pont les on the reflecton plane, t can be defned by π. = p(λ) k o. Computng the plane equaton from the prevous defnton and solvng for x, we obtan x = c2 3 [y,z]λ + c2 4 [y,z] c 1 1 [z]λ + c1 2 [z], (6) where c j [.] s a jth order polynomal equaton. Replacng (6) n the mrror equaton (1), and rearrangng t, we get Fg. 1. Representaton of a 3D lnes and ts respectve reflecton curve on the mrror (n red). the results usng synthetc and real data respectvely. Fnally conclusons are presented n Secton V II. 3D LINE PROJECTION ONTO NON-CENTRAL CATADIOPTRIC CAMERAS In ths secton we derve the equaton that represents the reflecton curve of a 3D straght lne on the mrror. The soluton should be of the type Γ(x, y, z) = 0, n order to verfy f the pont (x,y,z) belongs to the curve, Fg. 1. Ths dervaton was based on the same constrants used at Agrawal et al. [19] Consder a catadoptrc system, whch conssts of a perspectve camera, centered at o = (0,o y,o z ) P 3, and a rotatonal symmetrc quadrc mrror. Wthout loss of generalty, let us consder the z axs as the mrrors rotaton axs. Thus the mrror can be descrbed by Ω(x,y,z). = x 2 + y 2 + Az 2 + Bz C = 0, (1) where A, B, and C are the quadrc mrror parameters. Consder also a 3D straght lne defned by a pont, q, and a drecton, d, so that any pont on the lne can be gven by l. = p(λ) = q + λd, for some λ. (2) From the Snell s law, we get two well-known constrants: Any pont n a 3D lne, ts reflecton pont on the mrror, and the camera s effectve vew pont defne the reflecton plane, π; The angle between the ncomng rays and the normal at the mrror s surface s equal to the angle between reflected rays and the normal. The former can be wrtten as π. = p(λ) m(λ) o, (3) where m(λ) = (x(λ), y(λ), z(λ)), represent a reflecton pont, for some λ. The normal vector can be computed by takng the gradent of (1), resultng n n = Ω(x,y,z) = [x y Az + B/2] T. (4) c 4 5 [y,z]λ 2 + c 4 6 [y,z]λ + c4 7[y,z] = 0. (7) In order to get an analytcal equaton for the projecton of lnes, the parameter λ, must be removed. To acheve that, we take the advantage of the fact that the reflected ray, v r (λ), must go through the respectve 3D lne pont, p(λ), such that v r (λ) (p(λ) m(λ)) = 0. (8) Besdes, from Snell s law, one can derve v r (λ) v (λ) 2n v (λ) T n n T n and, snce the scale of v r (λ) s not mportant, t can be rewrtten as (9) v r (λ) 4(n T n)v (λ) 8n(v (λ) T n). (10) Fnally the ncdent ray, v (λ), can be wrtten as v (λ) m(λ) o (11) Replacng (11) and (4) n (10), and then ths last one n (8), three lnear dependent equatons are obtaned. Thus, they represent one sngle constrant. For smplcty sake, we take the equaton ndependent of the varable x. Solvng the chosen equaton for λ, we get λ = c3 9 [y,z] c 3 (12) 8 [y,z]. Replacng λ on (7), after some smplfcaton, we get γ(y,z) = c 4 5 [y,z](c3 9 [y,z])2 c 4 6 [y,z]c3 8 [y,z]c3 9 [y,z] + c4 7[y,z](c 3 8 [y,z])2 = 0, (13) where γ(y,z) s a 10 th order polynomal. Moreover replacng (12) n (6) we obtan x = c2 3 [y,z]c3 9 [y,z] + c2 4 [y,z]c3 8 [y,z] c 1 1 [z]c3 9 [y,z] + c1 2 (z)c3 8 [y,z] = c5 11 [y,z] c 4 (14) 10 [y,z]. In concluson, a pont (x,y,z) n the mrror belongs to the reflecton curve of the 3D straght lne (defned n (2)), f and only f (13) are verfed.

3 Fg. 2. Representaton of the proposed problem wth N = 3 and M = 10. Notce that the 3D lnes and the respectve 3D ponts (starts) are not ncdent. III. PLANAR POSE ESTIMATION FROM 3D STRAIGHT LINES In the prevous secton, an analytcal soluton for the projecton of 3D straght lnes onto the mrror of NCCS was derved. In ths secton that equaton s rewrtten, n order to obtan an error functon for the estmaton of the absolute planar pose. The problem of pose estmaton conssts n fndng the rotaton matrx R SO (3) and translaton vector t R 3, whch defne the rgd transformaton between the world and camera s reference frames. Keep n mnd that only the planar pose estmaton s consdered, we have three degrees of freedom. Assumng that the robot/camera s movng on a plane parallel to the xy plane, those degrees of freedom correspond to a rotaton angle (θ) around one axs (the z axs) and the other two to the translaton (t x and t y ). In ths scenaro, the rotaton matrx and translaton vector are cθ sθ 0 R = sθ cθ 0 and t = t x t y c te, (15) where cθ and sθ represent cos(θ), and sn(θ) respectvely and c te s a known constant. Thus the unknowns of the problem are the rotaton angle θ, t x and t y. Let us consder a set of N known straght lnes n the world frame, l (W) (flled lnes n open space on Fg. 2), for = 1,...,N, whch are not algned wth the camera s coordnate system. Consder also a set of M pxels u, j, for j = 1,...,M, whch correspond to the j th pont n the mage of the th straght lne. Snce the NCCS s consdered to be calbrated (we known the projecton matrx and the parameters of (1)), the reflecton ponts on the mrror m (C), j (star ponts on the mrror, Fg. 2), correspondent to the pxels u, j, are easly obtaned. Notce that these reflecton ponts are represented n the camera s coordnate system, whle the lnes are represented n the world s coordnate system. To compute these ponts, one needs to re-project the pxels and ntersect the respectve camera s projecton lne wth the mrror. Gven that the reflecton curve equaton (derved n Secton II) assumes that both the lnes and the mrror ponts are n the same reference frame, we cannot apply (13) drectly. In order to have both the lnes and the mrror ponts on the same reference frame, there are two optons. The frst conssts of havng the lnes poston fxed and apply a rgd transformaton to the camera system (both the mrror and the perspectve camera). However, the respectve formulaton for the problem, would not be trval. The second opton conssts n applyng a rgd transformaton to the lnes, havng the camera coordnate system fxed. Consderng both lnes and mrror ponts on the camera reference frame, the dervaton s smpler. Let us consder the second opton (as shown n Fg. 2). Applyng the rgd transformaton to the lnes defned by (2)(flled lnes n open space on Fg. 2), one gets p(λ) (C) = Rp(λ) (W) + t = λrd (W) + Rq (W) + t, (16) where p(λ) (C) represents a lne n the camera frame (n Fg. 2 are represented by the star ponts n 3D). Now, that both mrror ponts and 3D lnes are n the same coordnate system, (13) can be rewrtten. The goal of ths reformulaton s to estmate the transformaton appled to the lnes n the world coordnate system, n order to ther reflecton curves ntersect the mrror ponts n the camera coordnate system. By replacng (16) n (3) and followng the steps of the dervaton descrbed n Secton II, we get a functon γ r (y,z,θ,t x,t y ) = 0, (17) whch s a functon of not only the mrror pont coordnates, but also of the rgd transformaton parameters. Gven that we know a set of mrror ponts of the transformed lnes, we have a set of y and z parameters, whch means that we can consder that (17) depends only on the rgd transformaton parameters (becomng γ r (θ,t x,t y )). To smplfy the rotaton parameter (whch nclude non-lnear sne and cosne functons), we consder as unknowns the varables cθ and sθ. Snce these parameters are not ndependent, we have to take nto account the followng constrant g 1 (cθ,sθ) = cθ 2 + sθ 2 = 1. (18) As a result, the fnal equaton for the reflecton curve, as a functon of the rgd transformaton parameters, s gven by γ r (cθ,sθ,t x,t y ) = c 4 12[cθ,sθ,t x,t y ] + c 3 13 [cθ,sθ,t x,t y ] + c 2 14[cθ,sθ,t x,t y ] + c 1 15 [cθ,sθ,t x,t y ] + c (19) Besdes the constrant on the rotaton parameters, one must keep n mnd that, for the pont to be on the reflecton curve, we have to take nto account not only (13), but also (14). In order to account for (14), another constrant s consdered g 2 (cθ,sθ,t x,t y ) = x c2 18 [cθ,sθ,t 2 x,t y ] c 1 17 [cθ,sθ,t x,t y ] = 0. (20)

4 TABLE I MIRROR PARAMETERS AND COP POSITION FOR EACH MIRROR. Mrror Type Parameter Hyperbolc Parabolc Spherc A B C COP (x,y,z) (0, 25, 25) (0, 30, 20) (0, -15, 55) Fg. 3. Straght lnes projecton onto the mrror of a non-central catadoptrc camera. Flled lnes n the mrror represent the reflecton curve of each lne. The star shape ponts on the straght lnes represent the select ponts of each lne to project usng the method n Agrawal et. al. [19], the ponts resultng from ths method are plotted on the mrror s surface. The small axs represents the perspectve camera COP. Then, the absolute pose problem for NCCS, usng 3D straght lnes, s formulated as an optmzaton problem by takng the absolute value of the sum of the functon gama r (cθ,sθ,t x,t y ), for all matchngs between 3D straght lnes and the respectve mage pxels. The formal formulaton s gven by 1 mn cθ,sθ,t x,t y NM N =1 M j=1 s.t. c 1 (cθ,sθ) = 1 γ r (cθ,sθ,t x,t y ) c 2 (cθ,sθ,t x,t y ) = 0. (21) To conclude, the rotaton and translaton s gven by (15), that satsfy (21). Most of the tmes, the pose s gven by the rotaton and translaton that transform the ponts from the camera to the world coordnate systems. In order to obtan ths transformaton, one just needs to apply the nverse rgd transformaton p (W) = R T p (C) R T t, (22) where p (W) and p (C) represent a pont n the world and camera reference frames respectvely. IV. EXPERIMENTAL RESULTS The proposed methods were evaluate by performng test wth synthetc and real data. We used the Synthetc data to evaluate the performance of the pose estmaton method n the presence of nose, both n the mage of the lnes ponts and n the 3D poston of the lnes. The synthetc data tests were performed for the 3 dfferent types of mrrors, as defne n (1). The parameters and the poston of the COP, used n these experments, are shown n Table I. In addton (also wth synthetc data), ts performance for dfferent number of lnes s evaluated. The real data tests show an applcaton of the pose estmaton method to localze a moble robot. A. Usng Synthetc Data Before testng the pose estmaton method, we valdate the straght lne projecton equaton, derved n Secton II. In order to do that we defned a small set of lnes, the poston of the perspectve camera (COP), the mrror parameters, and appled (13) and (14). Afterwards, we selected a set of ponts of each lne, appled the method proposed n Agrawal et. al. [19] and verfed f the resultng ponts, where concdent wth the prevous computed reflecton curves. In order to llustrate ths results we plotted the lnes, mrror, COP, and ponts usng MATLAB. The results can be seen n Fg. 3. Regardng synthetc data-sets, three tests were performed on the pose estmaton method, to assess ts performance. The frst and second focused on evaluatng the effects of nosy data n the fnal soluton. The thrd conssted n evaluatng the performance for dfferent number of lnes. Two dfferent types of nosy data were consdered, nose added n the lne mage pxels (frst test), and nose added on the coordnates of the lnes n the world reference frame (second and thrd tests). The data-sets were generated n MATLAB and the pose estmaton algorthm was mplemented usng ts optmzaton toolbox (code wll be avalable on the authors page). The procedure for generatng the data-sets was as follows: a set of N 3D straght lnes were randomly generated, p (λ) (W). Those lnes were obtaned by takng a set N arbtrary ponts, q (W), and drectons, d (W), wth unt length, whch defne lnes known to have a soluton for the projecton scheme descrbed n Sec. II. To each pont a random 3D rgd transformaton, (defned by a random rotaton matrx R 1 and a random translaton vector t 1 ) s appled, to each drecton a 3D random rotaton (R 2 ) s appled. Keep n mnd that these rotaton matrces and translaton vector are ndependently generated (randomly) for each pont and drecton. Each lne wll then be defned by p (λ) (W) = λr 2 d (W) + R 1 q (W) + t 1. (23) The lnes defned by (23) are then transformed by the random ground truth rotaton and translaton parameters (15). From the resultng lnes, a set of M ponts per lne are selected and projected to the mrror usng the method n [19], yeldng the ponts, m (C) j, whch represent the projecton of the j th pont of the th lne. The goal of the frst test was to evaluate the method performance n the presence of nosy data. In ths test, nose was added to pxels of the mages of each lne pont.

5 (a) Box plot of the absolute rotaton error n degrees for dfferent levels of nosy pxels and three dferent mrrors. (b) Box plot of the norm of the translaton error n degrees for dfferent levels of nosy pxels and three dferent mrrors. Fg. 4. Method performance under nosy mage pxels. For ths experment the data-set was generated for M = 5 and N = 20. The nose was ntroduced by addng samples from a normal dstrbuton wth zero mean and ncreasng standard devaton (x-axs) of the plots. The red lnes n the box plots represent the medan of the errors.. Gven that, the camera s ntrnsc parameters were known, the process of addng nose to the pxels was straght forward. The frst step was projectng the set of ponts m (C) j to the mage plane. Then to the resultng pxels were added samples from a normal dstrbuton wth zero mean and standard devaton rangng from 0 to 10. Fnally, the pxels were re-projected onto the mrror by ntersectng the resultng drectons (nverse projecton of the camera s pxels) wth the known mrror equaton (1). For each value of the standard devaton, 1000 trals were performed. Henceforward consder a tral to be the executon of the method for a data-set generated as descrbed prevously. Results for three dfferent types of mrrors are presented n Fg. 4(a) and Fg. 4(b). The second test conssted on addng nose to the straght lnes ponts before projectng them onto the mrror. The nose s ntroduced by addng samples of a normal dstrbuton wth zero mean and standard devaton rangng from 0 to 10. Afterwards they are projected onto the mrror and the resultng ponts are the ones used to estmate the pose. The results for the absolute rotaton angle and the norm of the translaton error are presented n Fg. 5(a) and Fg. 5(b). Fnally the thrd test was smlar to the second, wth the dfference that the nose standard devaton was fxed at 5cm, and what vares throughout the trals s the number of lnes M used by the method. The results for the absolute rotaton angle and the norm of the translaton error are presented n Fg. 6(a) and Fg. 6(b). B. Usng Real Data The applcaton consdered for the real data experments was vsual navgaton. For that purpose we mounted a non-central catadoptrc camera, composed by a perspectve camera and a sphercal mrror, on top of a Poneer-3DX robotc platform. The NCCS was calbrated wth the method proposed at Perdgoto and Araujo [20]. The 3D world lnes consdered were four green lnes on the ground. In order to generate a data-set, we need to assocate pxels n the mage to the lnes, that assocaton s performed n four steps. Frst we apply a color threshold (n ths case green) to the mage and then morphologcal operators to remove nose; then fnd blobs by close contour extracton. The frst mage s used as reference to assocate manually the blobs wth the 3D lnes. For consequent mages the process s automatc. Fnally we take 75 pxels of each lne mage from the assocated blobs. Images from the camera n the setup and the lnes detected wth the method prevously descrbed are presented n Fg. 7(a) and Fg. 7(b) Gven that the method requres the mrror ponts as well, we use the scheme prevously dscussed. The projecton lne for each pxel s computed and ntersected wth the mrror (1). All the mage processng steps were mplemented n C++, usng OpenCV. The optmzaton step was mplemented usng the MAT- LAB s Optmzaton Toolbox. The communcaton between the camera, the lne-pxel assocaton, the optmzaton software and the robot was handle resortng to the Robot Operatve System (ROS) topc API. The results of ths test were recorded n a vdeo, consstng of the robot s pose throughout the executon of a trajectory. Ths vdeo wll be sent as supplementary materal. V. CONCLUSIONS A. Analyss of the Expermental Results Ths secton presents the analyss of the expermental results of the pose estmaton method presented n Sectons IV- A and IV-B. Startng by the synthetc data experments. Three dfferent tests were performed. The frst conssted on assessng the method performance n presence of nosy mages. As we can see from Fg. 4(a) the method proved to be robust to nosy

6 (a) Box plot of the absolute rotaton error n degrees for dfferent levels of nosy world ponts. (b) Box plot of the absolute rotaton error n degrees for dfferent levels of nosy world ponts. Fg. 5. Method performance under nosy world ponts. For ths experment the data-set was generated for M = 10 and N = 20. The nose was ntroduced by addng samples from a normal dstrbuton wth zero mean and ncreasng standard devaton (x-axs) of the plots. The red lnes n the box plots represent the medan of the errors. (a) Box plot of the absolute rotaton error n degrees for dfferent number of lnes. (b) Box plot of the absolute rotaton error n degrees for dfferent number of lnes. Fg. 6. Method performance under nosy world ponts. For ths experment the data-set was generated for dfferent number of lnes M and N = 20. The nose was ntroduced by addng samples from a normal dstrbuton wth zero mean and standard devaton of 5cm (x-axs) of the plots. The red lnes n the box plots represent the medan of the errors. mages, n the rotaton estmaton, wth the medan of the absolute rotaton angle error never gong above 0.6 degrees for every standard devaton value and for all mrrors. The translaton error was measured by the norm of the dfference between the ground truth and the estmated translatons n both drectons (x and y). Agan the results for the translaton prove the robustness of the method wth the maxmum medan of the error beng less than 2cm, for a nose value of 10 pxels. Then the performance under nose n the 3D lnes was evaluated. In Fg. 5(a) we present the absolute rotaton angle error evoluton wth the ncreasng of the nose standard devaton. It can be seen that the method stll presented a good performance, however t presented a slghtly hgher error than for the pxel nose. As far as the norm of translaton error, Fg. 5(a), the same behavor was seen, the medan of the error s small, but s slghtly hgher than the prevous experment. The last test wth synthetc data evaluated how the number of 3D lnes consdered n the method affect ts performance. As expected and shown n Fg.6(a) and n Fg.Fg.6(b), both the rotaton and translaton decrease consderably when the number of lnes ncreases. The real data experments, as seen n the vdeo (sent as supplementary materal) the robot exhbted a good performance. Keep n mnd that the only sensor used throughout ths experments was the NCCS. Fnally a bref comment on the convergence of the method. The method converges even for ntal values dstant from the optmal value, however the computaton tme ncreases as the ntal value e set further away from the optmal. Ths s expected, snce the optmzer wll need to compute more

7 (a) Non-central catadoptrc camera mage, wth the lne detected marked wth dfferent colors. (b) Non-central catadoptrc camera mage from another vew, wth the lne detected marked wth dfferent colors. Fg. 7. Two mages from the NCCS mounted on top of the moble platform throughout one real data experment. The lnes marked n the mages were the detected wth the method descrbed n Secton IV-B. teratons to reach the optmal value. Ths was seen especally n the synthetc data tests. In the real data experments ths problem dd not had a hgh nfluence n the computaton tme, because the ntal value n each tme step was set to the prevous estmated pose. B. Closure In ths artcle we purpose a novel method for planar pose estmaton of moble robots. Ths method s specfc to noncentral catadoptrc cameras and s based on the projecton of 3D straght lnes onto the mrror of those devces. Ths projecton s gven by a 10 th polynomal equaton, whose dervaton we also presented n ths paper. Ths equaton s, then, rewrtten as a functon of the rgd transformaton parameters and used to formulate an optmzaton problem for the pose estmaton. The pose estmaton method was valdated wth synthetc and real data. The former proved that the method s robust to the presence of nose both n the 3D lnes and n the mage pxels. Besdes, they showed that the performance of the method ncreases sgnfcantly wth the number of lnes consdered. Fnally, we showed the method performance n a vsual navgaton context wth a real robot. REFERENCES [1] C. F. Marques and P. U. Lma, Vson-based self-localzaton for soccer robots, IEEE/RSJ Proc. Int l Conference on Intellgent Robot Systems (IROS), [2] R. I. Hartley and A. Zsserman, Multple Vew Geometry n Computer Vson (2nd eddton). Cambrdge Unversty Press, [3] H. Araujo, R. L. Carceron, and C. M. Brown, A fully projectve formulaton to mprove the accuracy of lowe s pose-estmaton algorthm, Computer Vson and Image Understandng, [4] F. Moreno-Noguer, V. Lepett, and P. Fua, Accurate non-teratve o(n) soluton to the pnp problem, IEEE Int l Conf. on Computer Vson (ICCV), [5] A. Ansar and K. Danlds, Lnear pose estmaton from ponts or lnes, IEEE Trans. on Pattern Analyss and Machne Intellgence, [6] S. Ramalngam, S. Bouazz, and P. Sturm, Pose estmaton usng both ponts and lnes for geo-localzaton, IEEE Proc. Int l Conf. on Robotcs and Automaton (ICRA), [7] R. M. Haralck, C.-N. Lee, K. Ottenberg, and M. Nlle, Revew and analyss of solutons of the three pont perspectve pose estmaton problem, Int l J. of Computer Vson, [8] S. K. Nayar, Catadoptrc omndrectonal camera, IEEE Proc. Computer Vson and Pattern Recognton (CVPR), [9] S. Baker and S. K. Nayar, A Theory of Sngle-Vewpont Catadoptrc Image Formaton, Int l J. of Computer Vson, [10] C. Geyer and K. Danlds, A unfyng theory for central panoramc systems and practcal mplcatons, Proc. European Conf. Computer Vson (ECCV), [11] R. Swamnathan, M. D. Grossberg, and S. K. Nayar, Non-sngle Vewpont Catadoptrc Cameras: Geometry and Analyss, Int l J. of Computer Vson, [12] C.-S. Chen and W.-Y. Chang, Pose estmaton for generalzed magng devce va solvng non-perspectve n pont problem, IEEE Proc. Int l Conf. on Robotcs and Automaton (ICRA), [13] G. Schweghofer and A. Pnz, Globally optmal o(n) soluton to the pnp problemfor general cameramodels, Proc. Brtsh Machne Vson Conf., [14] D. Nster and H. Stewenus, A mnmal soluton to the generalsed 3-pont pose problem, IEEE Proc. on Computer Vson and Pattern Recognton (CVPR), [15] P. Mraldo and H. Araujo, A smple and robust soluton to the mnmal general pose estmaton, IEEE Proc. Int l Conf. on Robotcs and Automaton (ICRA), [16] P. Mraldo, H. Araujo, and N. Gonçalves, Pose estmaton for general cameras usng lnes, IEEE Trans. Cybermetc (Systems, Man, and Cybernetcs, Part B), [17] P. Mraldo and H. Araujo, Planar pose estmaton for general cameras usng known 3d lnes, Int l Conf. Intellgent Robots and Systems (IROS), [18] N. Gonçalves, On the reflecton pont where lght reflects to a known destnaton on quadratc surfaces, Optcs Letters, [19] A. Agrawal, Y. Taguch, and S. Ramalngam, Beyond Alhazen s Problem: Analytcal Projecton Model for Non-Central Catadoptrc Cameras wth Quadrc Mrrors, IEEE Proc. on Computer Vson and Pattern Recognton (CVPR), [20] L. Perdgoto and H. Araujo, Calbraton of mrror poston and extrnsc parameters n axal non-central catadoptrc systems, Computer Vson and Image Understandng, 2015.