Upper Body Tracking for Human-Machine Interaction with a Moving Camera

Size: px
Start display at page:

Download "Upper Body Tracking for Human-Machine Interaction with a Moving Camera"

Transcription

1 The 2009 IEEE/RSJ Inernaional Conference on Inelligen Robos and Sysems Ocober -5, 2009 S. Louis, USA Upper Body Tracking for Human-Machine Ineracion wih a Moving Camera Yi-Ru Chen, Cheng-Ming Huang, and Li-Chen Fu, IEEE fellow Absrac This research presens an upper body racking mehod wih a monocular camera. The human model is defined in a high dimensional sae space. We hereby propose a hierarchical srucure model o solve he racking problem by SIR (Sampling Imporance Resampling) paricle filer wih pariioned sampling. The image spaial and emporal informaion is used o rack he human body and esimae he human posure. When doing he human-machine ineracion, a saic monocular camera may no ge pleny of informaion from 2D images, so we mus move he camera plaform o a beer posiion for acquiring more enriched image informaion. The proposed upper body racking echnique will hen adjus o esimaing he human posure during he camera moving. To validae he effeciveness of he proposed racking approach, exensive experimens have been performed, of which he resul appear o be quie promising. I. ITRODUCTIO ITH he rapid developmen of inexpensive and high Wechnology machines, robos are more and more popularly seen o be equipped wih differen capabiliies. Human-machine ineracion becomes an increasingly imporan issue. There are many ways for humans o communicae wih he robos, like using he normal compuer device, such as keypad and mouse, microphone (for sound), camera (for vision), force sensor (for ouch), laser and ulrasound (for deph informaion). In recen years, vision-based analysis on human s moion analysis has become a popular problem due o a number of poenial applicaions, like biomechanical analysis, compuer animaion, surveillance sysem, pedesrian alarm on approaching vehicles, human-machine inerface, human-robo ineracion, ec. This research field has been widely surveyed in he lieraure [-5]. In paricular, Moeslund e al. [3] presened an overview which decomposes he flow of he visual sysem ino several processes, including he iniializaion, racking procedure, pose esimaion, and recogniion. The firs sep of heir proposed algorihm o analyze human s moion is human deecion. In differen siuaions, we may pay aenion on he differen pars of he body. The work in [5] gave an overview of human racking via racking of some body pars such as face, hands, fingers, ec. Manuscrip received March, This work was suppored bby aional Science Council, Taiwan, under Gran SC E Y. R. Chen and C. M. Huang are wih he Deparmen of Elecrical Engineering, aional Taiwan Universiy, Taiwan, ROC. L. C. Fu is wih he Deparmen of Elecrical Engineering and Compuer Science and Informaion Engineering, aional Taiwan Universiy, Taiwan, ROC ( lichen@nu.edu.w). The resuls of racking differen body pars may lead o differen applicaions. For example, racking he full human body can be applied in securiy-sensiive environmen, such as banks, parking los and airpors. Leg racking can be used in gai recogniion, human idenificaion and rajecory analysis. Hand racking has a number of applicaions such as gesure and sign language recogniion for human-compuer ineracion. Face racking can be uilized for human idenificaion, meeing analysis, and camera s auomaed focus. In fac, he upper body racking, which is also he focus of his paper, is an imporan subjec in he field of human-robo ineracion especially when home robos come ino play, because he image informaion will be sufficien o analyze he user informaion, like face and arm. Thus, he upper body posure analysis becomes an insrucion during he human-robo ineracion. There are many ways for human or posure deecion. In radiion, he works esimae he human by marking he human body pars [6] or by asking he human o wear some special clohes [7]. However, his is inconvenien and can only be used in special siuaions wih he complee equipmens being insalled. To improve he mehods, many researches provide oher alernaive approaches wihou relying on markers worn or aached ono he human body. The learning-based mehod [8] is applied o deec he human posiion. Using he background subracion or foreground segmenaion echniques, he silhouee-based mehods [9] can be uilized o deec humans wih a saic camera. Lasly, he dense dispariy map is consruced for esimaing human posure by using he 3D informaion from a muli-camera sysem [0]. In order o combine he posure deecion algorihm wih he human-robo inerface, he racking sysem may no be able o assume ha he environmen is wih saic background and camera since boh he human and he camera mouned on he robo may move while ineracing. Wihou such assumpion, i becomes more difficul for he sysem o fulfill he racking objecive since now he sysem can no always rely on use of background subracion o ge a foreground silhouee. This paper presens a vision-based racking algorihm ha racks he 3D upper body posure of a human. Concerning he processing ime, applying some deecion echnique in each frame during he course of racking a human generally will no be efficien. Combining hose racking algorihms can reduce he complexiy and save he compuaion cos. Besides, racking human beings is one of he mos difficul asks, because human s moions are fas, nonlinear, unpredicable, /09/$ IEEE 97

2 and here are so many kinds of possible human posure. So far in he lieraure, he paricle filer, which is a popular racking algorihm, can successfully solve he non-gaussian sae esimaion problems in nonlinear sysems. As a consequence, his paper deals wih he human racking problem by employing he paricle filer as a basic racking echnique. Besides ha, we also adop he opical flow o find he moion par and he movemen in he image so ha he human model can be robusly idenified, which in urn will faciliae accomplishmen of racking. This paper is organized as follows. In Secion II, we firs inroduce our human model and paricle filer. And hen in Secion III, we describe he racking algorihm and he feaure we used in his paper. In Secion IV, we describe he scenario of human-robo ineracion wih monocular camera. In Secion V, we demonsrae some experimenal resul o validae he effeciveness of he proposed racking approach. Finally, we conclude his paper in Secion VI wih some relevan discussion. II. HUMA MODEL AD TRACKIG FILTER A. Human Model Definiion As discussed in he previous work [5], here are a few kinds of human model which can be caegorized ino 2D models and 3D models. In 2D models, hey usually ry o fi he body conour by ellipse and recangle. There are wo kinds of 3D models, namely, sick model and volumeric model. The sick model also named skeleon model in which skeleons are conneced by he joins. The volumeric model defines a 3D model o represen he 2D conour, such as a cylinder o represen a recangle, a cone o represen a riangle, and a sphere o represen a circle. Here we use 3D sick model o deermine he join posiions. As shown in Fig., p 0 is he origin of he coordinae sysem. In general, he size of every par is proporional o he face size. We model he head as an ellipse whose raio beween lengh of he minor axis o ha of he major axis is :.2. Bu he shoulder widh and arm lengh are more differen from one person o anoher. In order o improve he accuracy of he model, we need an iniial pose as shown in Fig. o decide he shoulder widh and he arm lengh of one specific user. Afer aking he proper size from he user, we can sar he racking sysem. The human model consiss of head, shoulders, elbows and wriss. ex, we use he paricle filer o esimae he paricle sae which comprises join angles of each body par. The shoulder join ( θ, φ, ρ ) can be represened in he spherical coordinae sysem S which is cenered a shoulder posiion. We perform coordinae ransformaion hrough he following operaions. Firs, we roae he x-axis in S wih angle θ abou he y-axis, and hen roae x-axis wih angle φ abou y -axis, finally roae y-axis wih angle ρ abou z-axis. Afer ha, we ranslae he curren coordinae sysem o elbow coordinae sysem H, and roae y-axis abou z-axis wih angle γ. The deails of he ransformaion menioned above all are illusraed in Fig. 2 and 3, wih all he relaionships and limiaions of angles provided. Fig.. Human model wih he iniial posure. Fig. 2. Join angle for he shoulder wih limied range. Fig. 3. Join angle for he elbow wih limied range. The sick beween p 5 and p 7 lies on he plane decided by he roaion angle ρ L. The 3D human model will be projeced ono he image plane, and hen we evaluae he join angles o fi he human model. We have o decide he relaionships of posiion, scale and orienaion beween he human model and he image plane, as shown in Fig. 4. The posiion of p 0 on he image coordinae and he scale r of he human model are decided by he posiion p = ( x, y) and he size of he head, because he head deecor is much more reliable han oher limb deecor. And hen, he human body will be prediced wih an orienaionα. Afer deermining he relaionships of posiion, scale and orienaion, we can projec he human model ono he image plane. Fig. 4. Parameers ( xyrα,,, ) of upper body projecion. B. Sampling Imporance Resampling (SIR) Paricle Filer Paricle filer, which is based on Bayesian filer wih sequenial Mone Carlo mehod, is a soluion of racking problem based on saisical esimaion. According o Bayesian Theorem, he condiional probabiliy funcion is ( ) ( ) ( ) ( ) p x z p z x p x x p x z dx, () 0: 0: n where x denoe he sae vecor in, and z denoe he m observaion vecor in. In he Bayesian framework, we wan o recursively calculae he belief in he sae x wih all 98

3 pas observaions z 0: = { zi, i =, }, so i is required o p x z. Paricle filer approximaes he Bayesian filer by sequenial Mone Carlo () i () i using a se of weighed paricles x, w. The consruc he poserior ( 0: ) weighs of he samples are normalized, i.e. i he poserior a ime can be approximaed as ( ) () i () i ( ) δ 0: i= { } = = w i () i =, hen p x z w x x, (2) where δ () is he kernel funcion, such as Dirac s dela funcion or Gaussian kernel. One of he general paricle filers is sampling imporance resampling (SIR) paricle filer [], he paricles are generaed from he poserior as a proposal imporance densiy funcion from previous frame. The resampling sep solves he degeneracy problem by he emporal informaion and draws he paricles wih beer observaion inerpreaion bu i causes los of paricles wih he same sae and losses he diversiy of he paricles. This problem is known as impoverishmen phenomenon. To avoid he impoverishmen phenomenon and improve he degeneracy problem, some algorihms employ complex sampling sraegies or specific prior knowledge abou he objecs, such as pariioned sampling [2], layered sampling [3], annealed imporance sampling [4], paricle swarm opimizaion [5], and scaer search echnique [6]. The impoverishmen phenomenon is more obviously in high dimensional sae space. Furhermore, in high dimension sae space, he complexiy and inefficiency grows exponenially. In order o cover he high dimensional sae space, he number of paricles has sufficienly large. In his paper, we combine he SIR paricle filer wih pariioned sampling no only o overcome he degeneracy problem and impoverishmen phenomenon, bu also deal wih he high dimensional sae space. C. Pariioned Sampling Pariioned sampling is a sraegy o alleviae he inense need for a large number of paricles in a high dimensional sae space. This sraegy decomposes he sae space ino wo or more pariions, and sequenially applies appropriae weighed resampling operaion for each pariion. I has been used in he racking of ariculaed objecs [2], fusing he sensors providing informaion abou differen sae space dimensions [7], and human moion capure [8]. Pariioned sampling is suiable for objecs wih hierarchical srucure. [9] proposes a hierarchical par-based deecion, based on he higher reliabiliy of he head-and-orso deecor. This paper follows he idea, so we decompose he high dimensional sae space of he upper body ino wo pars, ha is, for he upper body posure racking, we firs localize he head and orso posiion, nex esimae he arm posure. We don decompose he arm posure ino upper arm and forearm, because he connecion beween upper arm and forearm is igh. Even hough we don model upper arm and forearm separaely, he number of paricles based on our mehod is sill much less han he number of paricles wihou decomposing he high dimensionaliy of he whole upper body. III. UPPER BODY TRACKIG Paricle filer wih he pariioned sampling is used here o solve he upper body racking problem. For saring he sysem, we se an iniial pose as shown in Fig. o consruc he body characerisic of he individual user, such as shoulder widh and arm lengh. While he sysem deecs he human face, i will ry o fi he iniial pose. If he sysem has well fiing, hen i sars he upper body racking procedure. Oherwise, he sysem deermines he person does no wan o inerac wih he robo. Afer seing hese parameers, he 3D human posure which has menioned in Secion II.A can be evaluaed for each paricle. Then measure he weigh of each paricle by likelihood funcion, also called finess and weighing funcion which influences he accuracy and complexiy mos. There are kind of common feaures, such as edge, conour, symmery, exure, color, silhouee, deph, moion. If we can combine several feaures o ge he high accuracy rae, we will loss he efficiency of he sysem. Here, we use edge, color and opical flow informaion o evaluae he likelihood funcion. Knowing he weigh of each paricle, we can evaluae he poserior probabiliy densiy funcion and esimae he arge posiion. In he high dimensional sae space of human model, we use pariioned sampling o draw paricles more efficienly so he paricles number can be reduced. The mos reliable par deecor in human body is he head deecor [9]. We firs decide he sae of head posiion ( x, y ), scale r, and orienaion α of human body. And hen we can use pariioned sampling o generae oher sae ( θr, φr, ρr, γr) for righ arm and ( θl, φl, ρl, γ L) for lef arm. The sae x = ( x, y, r, α),( θ, φ, ρ, γ ),( θ, φ, ρ, γ ), (3) R R R R L L L L can model he upper body posure. By projecing he human model on he image plane, we can ge he image observaion for each sae x and evaluae he weigh of each paricle in full sae space. Bu in cluer environmen, here should conain much edge informaion in he background. The likelihood funcion is no enough o make he accurae decision, even wih he human body consrains. So in he differen siuaion, we use differen mehod o deec he moion body par. We separae he scenario ino saic camera and moion camera which can decide by he camera moion feedback informaion. According o he camera movemen, we use several ways o capure moion region and enhance he edge in he moion region. A. Color Hisogram The color hisogram is compued in YCrCb color space. The reference color model is consruced wih Cr-Cb channel 99

4 o exclude illuminaion influence which is mainly conained in Y channel. The 2D 2 bins reference color hisogram denoed as ref href { href ( i, j) } i=, j= 2 i=, j= h =. (4) The color likelihood funcion is measured wih he Bhaacharyya disance beween he reference hisogram and he hisogram corresponding o each paricle: f i= j= 2 h, h h i, j h i, j, (5) ( x' ) = ( ) ' ( ) i= j= x color ref ref where h x ' is he hisogram corresponding o each paricle, x ' is he subsae abou he measuremen par. For example, if now we esimae he righ arm, hen x ' will conain ( θr, φr, ρr, γ R). The likelihood funcion of color hisogram is defined as he following p ( ) 2 color z x' exp fcolor ( ref, ' ) h h x. (6) B. Enhanced Edge Conour The edge informaion can be uilized o disinguish he oulier of each body par. The conour of head is modeled by ellipse emplae, and he conour of orso and arms are modeled by recangle emplae. Define he conour maching funcion as d i i fconour ( ') = x =, (7) where d i is he disance beween maximum edge and conour emplae, and is he number of sample poins along he conour. The smaller d i represens ha he edge approaches he conour emplae more closely. As a resul, he likelihood of enhanced edge conour is measured by 2 p ( z x conour ') exp fconour ( x '). (8) The edge obained from single image frame is obvious disinguish each human par and background in he simple environmen. However, in he complex environmen, here may exis srong edge in background. The srong edge is easy o arac he concenrae of paricles. In order o enhance he edge around he human, he moion deecion is used. Two kinds of mehods are used for moion deecion wih saic or moion camera. Wih he saic camera, he background image can no sure be aken, so he moving edge is proposed. Two coninuous images are compared o find he differen par. Wih he moion camera, he opical flow can evaluae he differen movemen objec. C. Par Movemen The color and edge only fi he model in 2D, bu he deph informaion is los. To improve he 3D model, he opical flow is a general feaure in a moion video. The feaure poin f ( k ) [20] can exraced from he image and compue he displacemen by racking hese feaure poins a frame. Here, he feaure poins are racked by KLT algorihm [20], which evaluaes he sum-of-squared-difference beween image frames. The movemen of opical flow and he paricle sae variaion for differen body par can be esimae he likelihood funcion. Firs, by he resul of iniializaion, he feaure poins is idenified ino differen body par, such as head, orso, righ arm, and lef arm. ex, we can generae a feaure poin se Bi for each body par: ( ) ( ), ( ) B = f k = x k y k k par i, (9) { ( ) } i where i = H (head), T (orso), LA (lef arm), RA (righ arm) or B (background). By knowing he posiion f ( k ) of each feaure poins, we can approximae he moion model. To simplify our moion model, we do no consider he deph beween objecs in he background and he camera. We only use a simple ranslaion model. Because we have he informaion of which feaure poin belongs o which body par, so we firs evaluae he disance ( k l ) and angle ( k ϕ ) beween feaure poins ( k f ) belong o par i and he cener O, i of he par i wih ( k) ( k) = f O, (0) l, i ( ) ( k) ( k) ϕ =, i f O. () di, x ' beween he feaure poins and he paricle sae of each par: ( k ) ( k) ( k ( ) ) ( k) l x' l ϕ ( x' ) ϕ di, ( x ') = +, (2) 2 ( k) ( k K ) i k i l ϕ where i =H, T, LA and RA. So we can uilize he movemen similariy o generae he likelihood funcion pmovemen ( z x ) for he paricle filer: 2 p ( z x movemen ) exp fmovemen ( x ), (3) in which fovemen ( x' ) = d, i ( x '). (4) 4 i= H, T, LA, RA By using he movemen informaion from feaure poins, we can improve he accuracy of he human posure. And hen, we can evaluae he similariy ( ) D. Overall Likelihood The overall likelihood funcion is he muliply of each cues menioned above C ' ' color Cconour p z x p z x p z x' ( ) color ( ) conour ( ) C ( ') movemen p movemen z x, (5) where he order C color, C conour and C movemen is he weigh of each cue. Usually he weigh are he same, only in special siuaion, he weigh should be modified, such as, C conour should be larger in he complex environmen, and C color should be larger if he background conains he objec wih similar color. 920

5 paricles are employed in he second and hird subspaces. In he following experimenal resuls, we presen some snapshos during he upper body racking in differen scenarios. Fig. 5. The sysem flow char. The overall racking framework is summarized in Fig. 5. The sysem is riggered wih an iniial pose as shown in Fig., and characerisic parameers of he human model are evaluaed from he deeced pose. Pariioned sampling decomposes he sae space ino hree subspaces. The firs space covers he sae describing he head and orso orienaion, and he second and hird subspaces cover he saes for he lef and righ arms. The paricles in he firs pariion are drawn from he likelihood funcion wih he color and conour. The paricles in he second and hird pariions are drawn from he likelihood funcion wih he color, conour and movemen. (a) Resul of iniializaion (b) Frame #36 Fig. 6. The likelihood funcion only wih conour informaion. (a) The likelihood funcion only wih conour informaion. (b) The likelihood funcion wih conour, color, and movemen informaion. Fig. 7. Effec of he moion informaion for he movemen in 3D. IV. HUMA ROBOT ITERACTIO The naural human-robo ineracion should be followed he ease body language for he user in face-o-face ineracion. Using he upper body racking algorihm, he human posure can be analyzed. Only wih he monocular camera, he loss of he deph informaion is difficul o reconsruc he 3D model. However he robo can modify he 3D posure esimaion by change he view angle. The moion informaion changes he human orienaion and he posiion, so he resul can analyze from he well undersanding posiion. A general insrucion is poining gesure as he movemen of he arm owards a poining arge. The robo can esimae he human posure and move o he arge a he same ime by correcing he posure wih 3D human model. Afer saring he racking sysem, he robo can also rack his user and esimae his posure unil he sysem over. Wihou he assumpion for saic camera, he user can inerac wih robo a he comforable posiion, such as si on sofa, or spacious room. This upper body racking algorihm is a echnique which can combine wih oher gesure recogniion and decide he robo behavior. V. EXPERIMETAL RESULT The upper body racking algorihm has been esed on several image sequences, including saic camera and moving camera plaform. In he iniializaion, 4 parameers, which are he lengh and widh for upper arm and forearm, for human model will be deermined. Then he 2 saes in (3) for modeling he 3D human posure will be esimaed hierarchically. When doing he racking wih pariioned sampling, 50 paricles are used in he firs space, and 80 (a) The likelihood funcion only wih conour informaion. (b) The likelihood funcion wih conour, color, and movemen informaion. (c) Edge Image for his scenario. Fig. 8. Effec of he movemen informaion in complex environmen wih noisy edge. Firs, we show he resul only use he conour informaion as described in Secion III.B wih saic camera in he simple environmen in Fig. 6. The resul is good enough for he simple acion wihou orienaion and movemen in 3D. To demonsrae he effec of he movemen of feaure poins wih saic camera in he simple environmen, he resul is shown is Fig. 7. In Fig. 8(a), he join angle beween upper arm and forearm is drif. The join angle is decreasing due o he conour is equally srong in he wrong posure. In fac, he join angle is sill 80 degree which shown in Fig. 8(b). The displacemen obained from feaure poins has anoher benefi. In he es sequence, here have much noise edge in he complex environmen, so he racker wihou feaure poins is easily disurbed by he background. Wih he assisance of he movemen informaion from feaure poins, he proposed racker can successfully esimae he arm posiion. The human size can no evaluae from he disance beween he human o camera, bu can be modified by he scale of he 92

6 head, because he size of every par is in proporion o he face size. As shown in Fig. 9, even he human close or move away, he racker can capure he human wih righ size. Fig. 9. The face scale influence. The human posure is projeced on he image plane. There have some similar image observaion by differen posure according o he projecion, even he movemen of feaure poins can no solve he projecion problem. Here, we can move he camera plaform o a beer posiion, and hen correc he human posure. For example, when he shoulder angle θ < 60, he racker can fi he righ join posiion, bu over his range, even hough he racker sill mach wih he arm, he join posiion drifed away. By moving he camera plaform, he join posiion can be modified o he righ posiion. Figure 0 presens his siuaion, and he proposed racker gradually obain he correc posure of righ arm. Fig. 0. Moving camera plaform o modified he human posure. VI. COCLUSIO This paper presened an upper body racking algorihm based on paricle filer wih pariioned sampling. The model uses color, edge and movemen informaion. Unlike oher racking algorihm which requires he background informaion o cu a human silhouee, we do no need a saic background. In order o apply he algorihm o human-machine ineracion, our approach can handle he siuaion wih moving camera plaform and uilize he differen view angle o correc he 3D human posure. The compuaional ime for he overall sysem now is abou 5 fps, which achieves he near real-ime performance. In his paper, he human model only limied he join angle, so someimes i may generae impossible posure. In he fuure, we plan o combine learning based human model, such as rained by SVM (suppor vecor machine) or RVM (relevance vecor machine), o prove he human posure esimae. Moreover, we will examine and analysis our sysem in more complicaed scenarios of human-robo ineracion and aim o reduce he overall compuaional ime. ACKOWLEDGMET This work was suppored by he aional Science Council of he Republic of China under Gran SC E REFERECES [] J. K. Aggarwal and Q. Cai, "Human moion analysis: a review," in onrigid and Ariculaed Moion Workshop, 997. Proceedings., IEEE, 997, pp [2] D. M. Gavrila, "The visual analysis of human movemen: A survey," Compuer Vision and Image Undersanding, vol. 73, pp , 999. [3] T. B. Moeslund and E. Granum, "A survey of compuer vision-based human moion capure," Compuer Vision and Image Undersanding, vol. 8, pp , 200. [4] T. B. Moeslund, A. Hilon, and V. Krüger, "A survey of advances in vision-based human moion capure and analysis," Compuer Vision and Image Undersanding, vol. 04, pp , [5] J. J. Wang and S. Singh, "Video analysis of human dynamics--a survey," Real-Time Imaging, vol. 9, pp , [6] J. Lee, J. Chai, P. S. A. Reisma, J. K. Hodgins, and. S. Pollard, "Ineracive conrol of avaars animaed wih human moion daa," ACM Transacions on Graphics (TOG) archive, vol. 2, pp , [7] K. Dong-Wan and J. Ohya, "Esimaing Posures of a human wearing a muliple-colored sui based on color informaion processing," in Mulimedia and Expo, ICME '03. Proceedings Inernaional Conference on, 2003, pp. I-26-4 vol.. [8]. Dalal and B. Triggs, "Hisograms of oriened gradiens for human deecion," in Compuer Vision and Paern Recogniion, CVPR IEEE Compuer Sociey Conference on, 2005, pp vol.. [9] W. Liang, T. Tieniu,. Huazhong, and H. Weiming, "Silhouee analysis-based gai recogniion for human idenificaion," Paern Analysis and Machine Inelligence, IEEE Transacions on, vol. 25, pp , [0]. Jojic, M. Turk, and T. S. Huang, "Tracking self-occluding ariculaed objecs in dense dispariy maps," in Compuer Vision, 999. The Proceedings of he Sevenh IEEE Inernaional Conference on, 999, pp vol.. [] M. S. Arulampalam, S. Maskell,. Gordon, and T. Clapp, "A uorial on paricle filers for online nonlinear/non-gaussian Bayesian racking," Signal Processing, IEEE Transacions on, vol. 50, pp , [2] J. MacCormick and M. Isard, "Pariioned sampling, ariculaed objecs and inerface-qualiy hand racking," Lecure oes in Compuer Science, vol. 843, pp. 3-9, [3] J. MacCormick and A. Blake, "A probabilisic exclusion principle for racking muliple objecs," in Compuer Vision, 999. The Proceedings of he Sevenh IEEE Inernaional Conference on, 999, pp vol.. [4] J. Deuscher, A. Blake, and I. Reid, "Ariculaed body moion capure by annealed paricle filering," in Compuer Vision and Paern Recogniion, Proceedings. IEEE Conference on, 2000, pp vol.2. [5] Q. Wang, L. Xie, J. Liu, and Z. Xiang, "Enhancing paricle swarm opimizaion based paricle filer racker," Compuaional Inelligence, pp , [6] J. J. Panrigo, A. S. Monemayor, and R. Cabido, "Scaer Search Paricle Filer for 2D Real-Time Hands and Face Tracking," Image Analysis and Processing, pp , [7] P. Perez, J. Vermaak, and A. Blake, "Daa fusion for visual racking wih paricles," Proceedings of he IEEE, vol. 92, pp , [8] J. Deuscher, A. Davison, and I. Reid, "Auomaic pariioning of high dimensional search spaces associaed wih ariculaed body moion capure," in Compuer Vision and Paern Recogniion, 200. CVPR 200. Proceedings of he 200 IEEE Compuer Sociey Conference on, 200, pp. II-669-II-676 vol.2. [9] R. avaranam, A. Thayananhan, P. Torr, and R. Cipolla, "Hierarchical par-based human body pose esimaion," in Paern Analysis, Saisical Modelling and Compuaional Learning Oxford, UK, [20] S. Jianbo and C. Tomasi, "Good feaures o rack," in Compuer Vision and Paern Recogniion, 994. Proceedings CVPR '94., 994 IEEE Compuer Sociey Conference on, 994, pp

Improved TLD Algorithm for Face Tracking

Improved TLD Algorithm for Face Tracking Absrac Improved TLD Algorihm for Face Tracking Huimin Li a, Chaojing Yu b and Jing Chen c Chongqing Universiy of Poss and Telecommunicaions, Chongqing 400065, China a li.huimin666@163.com, b 15023299065@163.com,

More information

Visual Perception as Bayesian Inference. David J Fleet. University of Toronto

Visual Perception as Bayesian Inference. David J Fleet. University of Toronto Visual Percepion as Bayesian Inference David J Flee Universiy of Torono Basic rules of probabiliy sum rule (for muually exclusive a ): produc rule (condiioning): independence (def n ): Bayes rule: marginalizaion:

More information

STEREO PLANE MATCHING TECHNIQUE

STEREO PLANE MATCHING TECHNIQUE STEREO PLANE MATCHING TECHNIQUE Commission III KEY WORDS: Sereo Maching, Surface Modeling, Projecive Transformaion, Homography ABSTRACT: This paper presens a new ype of sereo maching algorihm called Sereo

More information

Occlusion-Free Hand Motion Tracking by Multiple Cameras and Particle Filtering with Prediction

Occlusion-Free Hand Motion Tracking by Multiple Cameras and Particle Filtering with Prediction 58 IJCSNS Inernaional Journal of Compuer Science and Nework Securiy, VOL.6 No.10, Ocober 006 Occlusion-Free Hand Moion Tracking by Muliple Cameras and Paricle Filering wih Predicion Makoo Kao, and Gang

More information

Learning in Games via Opponent Strategy Estimation and Policy Search

Learning in Games via Opponent Strategy Estimation and Policy Search Learning in Games via Opponen Sraegy Esimaion and Policy Search Yavar Naddaf Deparmen of Compuer Science Universiy of Briish Columbia Vancouver, BC yavar@naddaf.name Nando de Freias (Supervisor) Deparmen

More information

Detection Tracking and Recognition of Human Poses for a Real Time Spatial Game

Detection Tracking and Recognition of Human Poses for a Real Time Spatial Game Deecion Tracking and Recogniion of Human Poses for a Real Time Spaial Game Feifei Huo, Emile A. Hendriks, A.H.J. Oomes Delf Universiy of Technology The Neherlands f.huo@udelf.nl Pascal van Beek, Remco

More information

CAMERA CALIBRATION BY REGISTRATION STEREO RECONSTRUCTION TO 3D MODEL

CAMERA CALIBRATION BY REGISTRATION STEREO RECONSTRUCTION TO 3D MODEL CAMERA CALIBRATION BY REGISTRATION STEREO RECONSTRUCTION TO 3D MODEL Klečka Jan Docoral Degree Programme (1), FEEC BUT E-mail: xkleck01@sud.feec.vubr.cz Supervised by: Horák Karel E-mail: horak@feec.vubr.cz

More information

A Fast Stereo-Based Multi-Person Tracking using an Approximated Likelihood Map for Overlapping Silhouette Templates

A Fast Stereo-Based Multi-Person Tracking using an Approximated Likelihood Map for Overlapping Silhouette Templates A Fas Sereo-Based Muli-Person Tracking using an Approximaed Likelihood Map for Overlapping Silhouee Templaes Junji Saake Jun Miura Deparmen of Compuer Science and Engineering Toyohashi Universiy of Technology

More information

Video Content Description Using Fuzzy Spatio-Temporal Relations

Video Content Description Using Fuzzy Spatio-Temporal Relations Proceedings of he 4s Hawaii Inernaional Conference on Sysem Sciences - 008 Video Conen Descripion Using Fuzzy Spaio-Temporal Relaions rchana M. Rajurkar *, R.C. Joshi and Sananu Chaudhary 3 Dep of Compuer

More information

MODEL BASED TECHNIQUE FOR VEHICLE TRACKING IN TRAFFIC VIDEO USING SPATIAL LOCAL FEATURES

MODEL BASED TECHNIQUE FOR VEHICLE TRACKING IN TRAFFIC VIDEO USING SPATIAL LOCAL FEATURES MODEL BASED TECHNIQUE FOR VEHICLE TRACKING IN TRAFFIC VIDEO USING SPATIAL LOCAL FEATURES Arun Kumar H. D. 1 and Prabhakar C. J. 2 1 Deparmen of Compuer Science, Kuvempu Universiy, Shimoga, India ABSTRACT

More information

A Matching Algorithm for Content-Based Image Retrieval

A Matching Algorithm for Content-Based Image Retrieval A Maching Algorihm for Conen-Based Image Rerieval Sue J. Cho Deparmen of Compuer Science Seoul Naional Universiy Seoul, Korea Absrac Conen-based image rerieval sysem rerieves an image from a daabase using

More information

Real-Time Avatar Animation Steered by Live Body Motion

Real-Time Avatar Animation Steered by Live Body Motion Real-Time Avaar Animaion Seered by Live Body Moion Oliver Schreer, Ralf Tanger, Peer Eiser, Peer Kauff, Bernhard Kaspar, and Roman Engler 3 Fraunhofer Insiue for Telecommunicaions/Heinrich-Herz-Insiu,

More information

Visual Indoor Localization with a Floor-Plan Map

Visual Indoor Localization with a Floor-Plan Map Visual Indoor Localizaion wih a Floor-Plan Map Hang Chu Dep. of ECE Cornell Universiy Ihaca, NY 14850 hc772@cornell.edu Absrac In his repor, a indoor localizaion mehod is presened. The mehod akes firsperson

More information

Robot localization under perceptual aliasing conditions based on laser reflectivity using particle filter

Robot localization under perceptual aliasing conditions based on laser reflectivity using particle filter Robo localizaion under percepual aliasing condiions based on laser refleciviy using paricle filer DongXiang Zhang, Ryo Kurazume, Yumi Iwashia, Tsuomu Hasegawa Absrac Global localizaion, which deermines

More information

Motion Level-of-Detail: A Simplification Method on Crowd Scene

Motion Level-of-Detail: A Simplification Method on Crowd Scene Moion Level-of-Deail: A Simplificaion Mehod on Crowd Scene Absrac Junghyun Ahn VR lab, EECS, KAIST ChocChoggi@vr.kais.ac.kr hp://vr.kais.ac.kr/~zhaoyue Recen echnological improvemen in characer animaion

More information

Tracking Appearances with Occlusions

Tracking Appearances with Occlusions Tracking ppearances wih Occlusions Ying Wu, Ting Yu, Gang Hua Deparmen of Elecrical & Compuer Engineering Norhwesern Universiy 2145 Sheridan oad, Evanson, IL 60208 {yingwu,ingyu,ganghua}@ece.nwu.edu bsrac

More information

FACIAL ACTION TRACKING USING PARTICLE FILTERS AND ACTIVE APPEARANCE MODELS. Soumya Hamlaoui & Franck Davoine

FACIAL ACTION TRACKING USING PARTICLE FILTERS AND ACTIVE APPEARANCE MODELS. Soumya Hamlaoui & Franck Davoine FACIAL ACTION TRACKING USING PARTICLE FILTERS AND ACTIVE APPEARANCE MODELS Soumya Hamlaoui & Franck Davoine HEUDIASYC Mixed Research Uni, CNRS / Compiègne Universiy of Technology BP 20529, 60205 Compiègne

More information

Implementing Ray Casting in Tetrahedral Meshes with Programmable Graphics Hardware (Technical Report)

Implementing Ray Casting in Tetrahedral Meshes with Programmable Graphics Hardware (Technical Report) Implemening Ray Casing in Terahedral Meshes wih Programmable Graphics Hardware (Technical Repor) Marin Kraus, Thomas Erl March 28, 2002 1 Inroducion Alhough cell-projecion, e.g., [3, 2], and resampling,

More information

J. Vis. Commun. Image R.

J. Vis. Commun. Image R. J. Vis. Commun. Image R. 20 (2009) 9 27 Conens liss available a ScienceDirec J. Vis. Commun. Image R. journal homepage: www.elsevier.com/locae/jvci Face deecion and racking using a Boosed Adapive Paricle

More information

A Face Detection Method Based on Skin Color Model

A Face Detection Method Based on Skin Color Model A Face Deecion Mehod Based on Skin Color Model Dazhi Zhang Boying Wu Jiebao Sun Qinglei Liao Deparmen of Mahemaics Harbin Insiue of Technology Harbin China 150000 Zhang_dz@163.com mahwby@hi.edu.cn sunjiebao@om.com

More information

CENG 477 Introduction to Computer Graphics. Modeling Transformations

CENG 477 Introduction to Computer Graphics. Modeling Transformations CENG 477 Inroducion o Compuer Graphics Modeling Transformaions Modeling Transformaions Model coordinaes o World coordinaes: Model coordinaes: All shapes wih heir local coordinaes and sies. world World

More information

Multi-Target Detection and Tracking from a Single Camera in Unmanned Aerial Vehicles (UAVs)

Multi-Target Detection and Tracking from a Single Camera in Unmanned Aerial Vehicles (UAVs) 2016 IEEE/RSJ Inernaional Conference on Inelligen Robos and Sysems (IROS) Daejeon Convenion Cener Ocober 9-14, 2016, Daejeon, Korea Muli-Targe Deecion and Tracking from a Single Camera in Unmanned Aerial

More information

Robust Visual Tracking for Multiple Targets

Robust Visual Tracking for Multiple Targets Robus Visual Tracking for Muliple Targes Yizheng Cai, Nando de Freias, and James J. Lile Universiy of Briish Columbia, Vancouver, B.C., Canada, V6T 1Z4 {yizhengc, nando, lile}@cs.ubc.ca Absrac. We address

More information

Image segmentation. Motivation. Objective. Definitions. A classification of segmentation techniques. Assumptions for thresholding

Image segmentation. Motivation. Objective. Definitions. A classification of segmentation techniques. Assumptions for thresholding Moivaion Image segmenaion Which pixels belong o he same objec in an image/video sequence? (spaial segmenaion) Which frames belong o he same video sho? (emporal segmenaion) Which frames belong o he same

More information

Real-time 2D Video/3D LiDAR Registration

Real-time 2D Video/3D LiDAR Registration Real-ime 2D Video/3D LiDAR Regisraion C. Bodenseiner Fraunhofer IOSB chrisoph.bodenseiner@iosb.fraunhofer.de M. Arens Fraunhofer IOSB michael.arens@iosb.fraunhofer.de Absrac Progress in LiDAR scanning

More information

Wheelchair-user Detection Combined with Parts-based Tracking

Wheelchair-user Detection Combined with Parts-based Tracking Wheelchair-user Deecion Combined wih Pars-based Tracking Ukyo Tanikawa 1, Yasuomo Kawanishi 1, Daisuke Deguchi 2,IchiroIde 1, Hiroshi Murase 1 and Ryo Kawai 3 1 Graduae School of Informaion Science, Nagoya

More information

Image Based Computer-Aided Manufacturing Technology

Image Based Computer-Aided Manufacturing Technology Sensors & Transducers 03 by IFSA hp://www.sensorsporal.com Image Based Compuer-Aided Manufacuring Technology Zhanqi HU Xiaoqin ZHANG Jinze LI Wei LI College of Mechanical Engineering Yanshan Universiy

More information

Video-Based Face Recognition Using Probabilistic Appearance Manifolds

Video-Based Face Recognition Using Probabilistic Appearance Manifolds Video-Based Face Recogniion Using Probabilisic Appearance Manifolds Kuang-Chih Lee Jeffrey Ho Ming-Hsuan Yang David Kriegman klee10@uiuc.edu jho@cs.ucsd.edu myang@honda-ri.com kriegman@cs.ucsd.edu Compuer

More information

Robust Multi-view Face Detection Using Error Correcting Output Codes

Robust Multi-view Face Detection Using Error Correcting Output Codes Robus Muli-view Face Deecion Using Error Correcing Oupu Codes Hongming Zhang,2, Wen GaoP P, Xilin Chen 2, Shiguang Shan 2, and Debin Zhao Deparmen of Compuer Science and Engineering, Harbin Insiue of Technolog

More information

NEWTON S SECOND LAW OF MOTION

NEWTON S SECOND LAW OF MOTION Course and Secion Dae Names NEWTON S SECOND LAW OF MOTION The acceleraion of an objec is defined as he rae of change of elociy. If he elociy changes by an amoun in a ime, hen he aerage acceleraion during

More information

Rao-Blackwellized Particle Filtering for Probing-Based 6-DOF Localization in Robotic Assembly

Rao-Blackwellized Particle Filtering for Probing-Based 6-DOF Localization in Robotic Assembly MITSUBISHI ELECTRIC RESEARCH LABORATORIES hp://www.merl.com Rao-Blackwellized Paricle Filering for Probing-Based 6-DOF Localizaion in Roboic Assembly Yuichi Taguchi, Tim Marks, Haruhisa Okuda TR1-8 June

More information

Probabilistic Detection and Tracking of Motion Discontinuities

Probabilistic Detection and Tracking of Motion Discontinuities Probabilisic Deecion and Tracking of Moion Disconinuiies Michael J. Black David J. Flee Xerox Palo Alo Research Cener 3333 Coyoe Hill Road Palo Alo, CA 94304 fblack,fleeg@parc.xerox.com hp://www.parc.xerox.com/fblack,fleeg/

More information

4.1 3D GEOMETRIC TRANSFORMATIONS

4.1 3D GEOMETRIC TRANSFORMATIONS MODULE IV MCA - 3 COMPUTER GRAPHICS ADMN 29- Dep. of Compuer Science And Applicaions, SJCET, Palai 94 4. 3D GEOMETRIC TRANSFORMATIONS Mehods for geomeric ransformaions and objec modeling in hree dimensions

More information

Real Time Integral-Based Structural Health Monitoring

Real Time Integral-Based Structural Health Monitoring Real Time Inegral-Based Srucural Healh Monioring The nd Inernaional Conference on Sensing Technology ICST 7 J. G. Chase, I. Singh-Leve, C. E. Hann, X. Chen Deparmen of Mechanical Engineering, Universiy

More information

A Bayesian Approach to Video Object Segmentation via Merging 3D Watershed Volumes

A Bayesian Approach to Video Object Segmentation via Merging 3D Watershed Volumes A Bayesian Approach o Video Objec Segmenaion via Merging 3D Waershed Volumes Yu-Pao Tsai 1,3, Chih-Chuan Lai 1,2, Yi-Ping Hung 1,2, and Zen-Chung Shih 3 1 Insiue of Informaion Science, Academia Sinica,

More information

MOTION DETECTORS GRAPH MATCHING LAB PRE-LAB QUESTIONS

MOTION DETECTORS GRAPH MATCHING LAB PRE-LAB QUESTIONS NME: TE: LOK: MOTION ETETORS GRPH MTHING L PRE-L QUESTIONS 1. Read he insrucions, and answer he following quesions. Make sure you resae he quesion so I don hae o read he quesion o undersand he answer..

More information

Moving Object Detection Using MRF Model and Entropy based Adaptive Thresholding

Moving Object Detection Using MRF Model and Entropy based Adaptive Thresholding Moving Objec Deecion Using MRF Model and Enropy based Adapive Thresholding Badri Narayan Subudhi, Pradipa Kumar Nanda and Ashish Ghosh Machine Inelligence Uni, Indian Saisical Insiue, Kolkaa, 700108, India,

More information

Dynamic Route Planning and Obstacle Avoidance Model for Unmanned Aerial Vehicles

Dynamic Route Planning and Obstacle Avoidance Model for Unmanned Aerial Vehicles Volume 116 No. 24 2017, 315-329 ISSN: 1311-8080 (prined version); ISSN: 1314-3395 (on-line version) url: hp://www.ijpam.eu ijpam.eu Dynamic Roue Planning and Obsacle Avoidance Model for Unmanned Aerial

More information

Multiple View Discriminative Appearance Modeling with IMCMC for Distributed Tracking

Multiple View Discriminative Appearance Modeling with IMCMC for Distributed Tracking Muliple View Discriminaive ing wih IMCMC for Disribued Tracking Sanhoshkumar Sunderrajan, B.S. Manjunah Deparmen of Elecrical and Compuer Engineering Universiy of California, Sana Barbara {sanhosh,manj}@ece.ucsb.edu

More information

AUTOMATIC 3D FACE REGISTRATION WITHOUT INITIALIZATION

AUTOMATIC 3D FACE REGISTRATION WITHOUT INITIALIZATION Chaper 3 AUTOMATIC 3D FACE REGISTRATION WITHOUT INITIALIZATION A. Koschan, V. R. Ayyagari, F. Boughorbel, and M. A. Abidi Imaging, Roboics, and Inelligen Sysems Laboraory, The Universiy of Tennessee, 334

More information

Simultaneous Localization and Mapping with Stereo Vision

Simultaneous Localization and Mapping with Stereo Vision Simulaneous Localizaion and Mapping wih Sereo Vision Mahew N. Dailey Compuer Science and Informaion Managemen Asian Insiue of Technology Pahumhani, Thailand Email: mdailey@ai.ac.h Manukid Parnichkun Mecharonics

More information

MORPHOLOGICAL SEGMENTATION OF IMAGE SEQUENCES

MORPHOLOGICAL SEGMENTATION OF IMAGE SEQUENCES MORPHOLOGICAL SEGMENTATION OF IMAGE SEQUENCES B. MARCOTEGUI and F. MEYER Ecole des Mines de Paris, Cenre de Morphologie Mahémaique, 35, rue Sain-Honoré, F 77305 Fonainebleau Cedex, France Absrac. In image

More information

Robust 3D Visual Tracking Using Particle Filtering on the SE(3) Group

Robust 3D Visual Tracking Using Particle Filtering on the SE(3) Group Robus 3D Visual Tracking Using Paricle Filering on he SE(3) Group Changhyun Choi and Henrik I. Chrisensen Roboics & Inelligen Machines, College of Compuing Georgia Insiue of Technology Alana, GA 3332,

More information

MOTION TRACKING is a fundamental capability that

MOTION TRACKING is a fundamental capability that TECHNICAL REPORT CRES-05-008, CENTER FOR ROBOTICS AND EMBEDDED SYSTEMS, UNIVERSITY OF SOUTHERN CALIFORNIA 1 Real-ime Moion Tracking from a Mobile Robo Boyoon Jung, Suden Member, IEEE, Gaurav S. Sukhame,

More information

RGB-D Object Tracking: A Particle Filter Approach on GPU

RGB-D Object Tracking: A Particle Filter Approach on GPU RGB-D Objec Tracking: A Paricle Filer Approach on GPU Changhyun Choi and Henrik I. Chrisensen Cener for Roboics & Inelligen Machines College of Compuing Georgia Insiue of Technology Alana, GA 3332, USA

More information

EECS 487: Interactive Computer Graphics

EECS 487: Interactive Computer Graphics EECS 487: Ineracive Compuer Graphics Lecure 7: B-splines curves Raional Bézier and NURBS Cubic Splines A represenaion of cubic spline consiss of: four conrol poins (why four?) hese are compleely user specified

More information

Real time 3D face and facial feature tracking

Real time 3D face and facial feature tracking J Real-Time Image Proc (2007) 2:35 44 DOI 10.1007/s11554-007-0032-2 ORIGINAL RESEARCH PAPER Real ime 3D face and facial feaure racking Fadi Dornaika Æ Javier Orozco Received: 23 November 2006 / Acceped:

More information

In fmri a Dual Echo Time EPI Pulse Sequence Can Induce Sources of Error in Dynamic Magnetic Field Maps

In fmri a Dual Echo Time EPI Pulse Sequence Can Induce Sources of Error in Dynamic Magnetic Field Maps In fmri a Dual Echo Time EPI Pulse Sequence Can Induce Sources of Error in Dynamic Magneic Field Maps A. D. Hahn 1, A. S. Nencka 1 and D. B. Rowe 2,1 1 Medical College of Wisconsin, Milwaukee, WI, Unied

More information

Gauss-Jordan Algorithm

Gauss-Jordan Algorithm Gauss-Jordan Algorihm The Gauss-Jordan algorihm is a sep by sep procedure for solving a sysem of linear equaions which may conain any number of variables and any number of equaions. The algorihm is carried

More information

Evaluation and Improvement of Region-based Motion Segmentation

Evaluation and Improvement of Region-based Motion Segmentation Evaluaion and Improvemen of Region-based Moion Segmenaion Mark Ross Universiy Koblenz-Landau, Insiue of Compuaional Visualisics, Universiässraße 1, 56070 Koblenz, Germany Email: ross@uni-koblenz.de Absrac

More information

LAMP: 3D Layered, Adaptive-resolution and Multiperspective Panorama - a New Scene Representation

LAMP: 3D Layered, Adaptive-resolution and Multiperspective Panorama - a New Scene Representation Submission o Special Issue of CVIU on Model-based and Image-based 3D Scene Represenaion for Ineracive Visualizaion LAMP: 3D Layered, Adapive-resoluion and Muliperspecive Panorama - a New Scene Represenaion

More information

Analysis of Various Types of Bugs in the Object Oriented Java Script Language Coding

Analysis of Various Types of Bugs in the Object Oriented Java Script Language Coding Indian Journal of Science and Technology, Vol 8(21), DOI: 10.17485/ijs/2015/v8i21/69958, Sepember 2015 ISSN (Prin) : 0974-6846 ISSN (Online) : 0974-5645 Analysis of Various Types of Bugs in he Objec Oriened

More information

4. Minimax and planning problems

4. Minimax and planning problems CS/ECE/ISyE 524 Inroducion o Opimizaion Spring 2017 18 4. Minima and planning problems ˆ Opimizing piecewise linear funcions ˆ Minima problems ˆ Eample: Chebyshev cener ˆ Muli-period planning problems

More information

A new algorithm for small object tracking based on super-resolution technique

A new algorithm for small object tracking based on super-resolution technique A new algorihm for small objec racking based on super-resoluion echnique Yabunayya Habibi, Dwi Rana Sulisyaningrum, and Budi Seiyono Ciaion: AIP Conference Proceedings 1867, 020024 (2017); doi: 10.1063/1.4994427

More information

Research Article Auto Coloring with Enhanced Character Registration

Research Article Auto Coloring with Enhanced Character Registration Compuer Games Technology Volume 2008, Aricle ID 35398, 7 pages doi:0.55/2008/35398 Research Aricle Auo Coloring wih Enhanced Characer Regisraion Jie Qiu, Hock Soon Seah, Feng Tian, Quan Chen, Zhongke Wu,

More information

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors We are InechOpen, he world s leading publisher of Open Access books Buil by scieniss, for scieniss 4,000 116,000 120M Open access books available Inernaional auhors and ediors Downloads Our auhors are

More information

Sam knows that his MP3 player has 40% of its battery life left and that the battery charges by an additional 12 percentage points every 15 minutes.

Sam knows that his MP3 player has 40% of its battery life left and that the battery charges by an additional 12 percentage points every 15 minutes. 8.F Baery Charging Task Sam wans o ake his MP3 player and his video game player on a car rip. An hour before hey plan o leave, he realized ha he forgo o charge he baeries las nigh. A ha poin, he plugged

More information

Projection & Interaction

Projection & Interaction Projecion & Ineracion Algebra of projecion Canonical viewing volume rackball inerface ransform Hierarchies Preview of Assignmen #2 Lecure 8 Comp 236 Spring 25 Projecions Our lives are grealy simplified

More information

An Adaptive Spatial Depth Filter for 3D Rendering IP

An Adaptive Spatial Depth Filter for 3D Rendering IP JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, VOL.3, NO. 4, DECEMBER, 23 175 An Adapive Spaial Deph Filer for 3D Rendering IP Chang-Hyo Yu and Lee-Sup Kim Absrac In his paper, we presen a new mehod

More information

A High-Speed Adaptive Multi-Module Structured Light Scanner

A High-Speed Adaptive Multi-Module Structured Light Scanner A High-Speed Adapive Muli-Module Srucured Ligh Scanner Andreas Griesser 1 Luc Van Gool 1,2 1 Swiss Fed.Ins.of Techn.(ETH) 2 Kaholieke Univ. Leuven D-ITET/Compuer Vision Lab ESAT/VISICS Zürich, Swizerland

More information

Track-based and object-based occlusion for people tracking refinement in indoor surveillance

Track-based and object-based occlusion for people tracking refinement in indoor surveillance Trac-based and objec-based occlusion for people racing refinemen in indoor surveillance R. Cucchiara, C. Grana, G. Tardini Diparimeno di Ingegneria Informaica - Universiy of Modena and Reggio Emilia Via

More information

COSC 3213: Computer Networks I Chapter 6 Handout # 7

COSC 3213: Computer Networks I Chapter 6 Handout # 7 COSC 3213: Compuer Neworks I Chaper 6 Handou # 7 Insrucor: Dr. Marvin Mandelbaum Deparmen of Compuer Science York Universiy F05 Secion A Medium Access Conrol (MAC) Topics: 1. Muliple Access Communicaions:

More information

IntentSearch:Capturing User Intention for One-Click Internet Image Search

IntentSearch:Capturing User Intention for One-Click Internet Image Search JOURNAL OF L A T E X CLASS FILES, VOL. 6, NO. 1, JANUARY 2010 1 InenSearch:Capuring User Inenion for One-Click Inerne Image Search Xiaoou Tang, Fellow, IEEE, Ke Liu, Jingyu Cui, Suden Member, IEEE, Fang

More information

IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART A: SYSTEMS AND HUMANS 1

IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART A: SYSTEMS AND HUMANS 1 TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART A: SYSTEMS AND HUMANS 1 Adapive Appearance Model and Condensaion Algorihm for Robus Face Tracking Yui Man Lui, Suden Member,, J. Ross Beveridge, Member,,

More information

User Adjustable Process Scheduling Mechanism for a Multiprocessor Embedded System

User Adjustable Process Scheduling Mechanism for a Multiprocessor Embedded System Proceedings of he 6h WSEAS Inernaional Conference on Applied Compuer Science, Tenerife, Canary Islands, Spain, December 16-18, 2006 346 User Adjusable Process Scheduling Mechanism for a Muliprocessor Embedded

More information

An Iterative Scheme for Motion-Based Scene Segmentation

An Iterative Scheme for Motion-Based Scene Segmentation An Ieraive Scheme for Moion-Based Scene Segmenaion Alexander Bachmann and Hildegard Kuehne Deparmen for Measuremen and Conrol Insiue for Anhropomaics Universiy of Karlsruhe (H), 76 131 Karlsruhe, Germany

More information

In Proceedings of CVPR '96. Structure and Motion of Curved 3D Objects from. using these methods [12].

In Proceedings of CVPR '96. Structure and Motion of Curved 3D Objects from. using these methods [12]. In Proceedings of CVPR '96 Srucure and Moion of Curved 3D Objecs from Monocular Silhouees B Vijayakumar David J Kriegman Dep of Elecrical Engineering Yale Universiy New Haven, CT 652-8267 Jean Ponce Compuer

More information

Detection and segmentation of moving objects in highly dynamic scenes

Detection and segmentation of moving objects in highly dynamic scenes Deecion and segmenaion of moving objecs in highly dynamic scenes Aurélie Bugeau Parick Pérez INRIA, Cenre Rennes - Breagne Alanique Universié de Rennes, Campus de Beaulieu, 35 042 Rennes Cedex, France

More information

Reinforcement Learning by Policy Improvement. Making Use of Experiences of The Other Tasks. Hajime Kimura and Shigenobu Kobayashi

Reinforcement Learning by Policy Improvement. Making Use of Experiences of The Other Tasks. Hajime Kimura and Shigenobu Kobayashi Reinforcemen Learning by Policy Improvemen Making Use of Experiences of The Oher Tasks Hajime Kimura and Shigenobu Kobayashi Tokyo Insiue of Technology, JAPAN genfe.dis.iech.ac.jp, kobayasidis.iech.ac.jp

More information

Hierarchical Information Fusion for Human Upper Limb Motion Capture

Hierarchical Information Fusion for Human Upper Limb Motion Capture 1h Inernaional Conference on Informaion Fusion Seale, WA, USA, July 6-9, 009 Hierarchical Informaion Fusion for Human Upper Limb Moion Capure Zhiqiang Zhang 1,, Zhipei Huang 1 and Jiankang Wu 1, 1 Graduae

More information

Optimal Crane Scheduling

Optimal Crane Scheduling Opimal Crane Scheduling Samid Hoda, John Hooker Laife Genc Kaya, Ben Peerson Carnegie Mellon Universiy Iiro Harjunkoski ABB Corporae Research EWO - 13 November 2007 1/16 Problem Track-mouned cranes move

More information

Vision-Based Traffic Measurement System

Vision-Based Traffic Measurement System *J. M. Wang, **S. L. Chang, **Y. C. Chung, and **S. W. Chen Deparmen of Informaion and Compuer Educaion *Naional Taiwan Universiy **Naional Taiwan Normal Universiy Taipei, Taiwan schen@csie.nnu.edu.w Absrac

More information

A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER

A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER ABSTRACT Modern graphics cards for compuers, and especially heir graphics processing unis (GPUs), are designed for fas rendering of graphics.

More information

Multi-camera multi-object voxel-based Monte Carlo 3D tracking strategies

Multi-camera multi-object voxel-based Monte Carlo 3D tracking strategies RESEARCH Open Access Muli-camera muli-objec voxel-based Mone Carlo 3D racking sraegies Crisian Canon-Ferrer *, Josep R Casas, Monse Pardàs and Enric Mone Absrac This aricle presens a new approach o he

More information

Gender Classification of Faces Using Adaboost*

Gender Classification of Faces Using Adaboost* Gender Classificaion of Faces Using Adaboos* Rodrigo Verschae 1,2,3, Javier Ruiz-del-Solar 1,2, and Mauricio Correa 1,2 1 Deparmen of Elecrical Engineering, Universidad de Chile 2 Cener for Web Research,

More information

ACQUIRING high-quality and well-defined depth data. Online Temporally Consistent Indoor Depth Video Enhancement via Static Structure

ACQUIRING high-quality and well-defined depth data. Online Temporally Consistent Indoor Depth Video Enhancement via Static Structure SUBMITTED TO TRANSACTION ON IMAGE PROCESSING 1 Online Temporally Consisen Indoor Deph Video Enhancemen via Saic Srucure Lu Sheng, Suden Member, IEEE, King Ngi Ngan, Fellow, IEEE, Chern-Loon Lim and Songnan

More information

Track and Cut: simultaneous tracking and segmentation of multiple objects with graph cuts

Track and Cut: simultaneous tracking and segmentation of multiple objects with graph cuts INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE Track and Cu: simulaneous racking and segmenaion of muliple objecs wih graph cus Aurélie Bugeau Parick Pérez N 6337 Ocober 2007 Thèmes COM

More information

Tracking Deforming Objects Using Particle Filtering for Geometric Active Contours

Tracking Deforming Objects Using Particle Filtering for Geometric Active Contours 1470 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 29, NO. 8, AUGUST 2007 Tracking Deforming Objecs Using Paricle Filering for Geomeric Acive Conours Yogesh Rahi, Member, IEEE, NamraaVaswani,

More information

Graffiti Detection Using Two Views

Graffiti Detection Using Two Views Graffii Deecion Using wo Views Luigi Di Sefano Federico ombari Alessandro Lanza luigi.disefano@unibo.i federico.ombari@unibo.i alanza@arces.unibo.i Sefano Maoccia sefano.maoccia@unibo.i Sefano Moni sefano.moni3@sudio.unibo.i

More information

Tracking a Large Number of Objects from Multiple Views

Tracking a Large Number of Objects from Multiple Views Tracking a Large Number of Objecs from Muliple Views Zheng Wu 1, Nickolay I. Hrisov 2, Tyson L. Hedrick 3, Thomas H. Kun 2, Margri Beke 1 1 Deparmen of Compuer Science, Boson Universiy 2 Deparmen of Biology,

More information

FIELD PROGRAMMABLE GATE ARRAY (FPGA) AS A NEW APPROACH TO IMPLEMENT THE CHAOTIC GENERATORS

FIELD PROGRAMMABLE GATE ARRAY (FPGA) AS A NEW APPROACH TO IMPLEMENT THE CHAOTIC GENERATORS FIELD PROGRAMMABLE GATE ARRAY (FPGA) AS A NEW APPROACH TO IMPLEMENT THE CHAOTIC GENERATORS Mohammed A. Aseeri and M. I. Sobhy Deparmen of Elecronics, The Universiy of Ken a Canerbury Canerbury, Ken, CT2

More information

A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER

A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER A GRAPHICS PROCESSING UNIT IMPLEMENTATION OF THE PARTICLE FILTER Gusaf Hendeby, Jeroen D. Hol, Rickard Karlsson, Fredrik Gusafsson Deparmen of Elecrical Engineering Auomaic Conrol Linköping Universiy,

More information

AML710 CAD LECTURE 11 SPACE CURVES. Space Curves Intrinsic properties Synthetic curves

AML710 CAD LECTURE 11 SPACE CURVES. Space Curves Intrinsic properties Synthetic curves AML7 CAD LECTURE Space Curves Inrinsic properies Synheic curves A curve which may pass hrough any region of hreedimensional space, as conrased o a plane curve which mus lie on a single plane. Space curves

More information

3-D Object Modeling and Recognition for Telerobotic Manipulation

3-D Object Modeling and Recognition for Telerobotic Manipulation Research Showcase @ CMU Roboics Insiue School of Compuer Science 1995 3-D Objec Modeling and Recogniion for Teleroboic Manipulaion Andrew Johnson Parick Leger Regis Hoffman Marial Heber James Osborn Follow

More information

Improving Occupancy Grid FastSLAM by Integrating Navigation Sensors

Improving Occupancy Grid FastSLAM by Integrating Navigation Sensors Improving Occupancy Grid FasSLAM by Inegraing Navigaion Sensors Chrisopher Weyers Sensors Direcorae Air Force Research Laboraory Wrigh-Paerson AFB, OH 45433 Gilber Peerson Deparmen of Elecrical and Compuer

More information

Terrain Based GPS Independent Lane-Level Vehicle Localization using Particle Filter and Dead Reckoning

Terrain Based GPS Independent Lane-Level Vehicle Localization using Particle Filter and Dead Reckoning Terrain Based GPS Independen -Level Vehicle Localizaion using Paricle Filer and Dead Reckoning Hamad Ahmed and Muhammad Tahir Deparmen of Elecrical Engineering, Lahore Universiy of Managemen Sciences,

More information

Fusion of Multiple Cues from Color and Depth Domains using Occlusion Aware Bayesian Tracker

Fusion of Multiple Cues from Color and Depth Domains using Occlusion Aware Bayesian Tracker Fusion of Muliple Cues from Color and Deph Domains using Occlusion Aware Bayesian Tracker Kourosh MESHGI Shin-ichi MAEDA Shigeyuki OBA and Shin ISHII Graduae School of Informaics, Kyoo Universiy, Gokasho,

More information

Weighted Voting in 3D Random Forest Segmentation

Weighted Voting in 3D Random Forest Segmentation Weighed Voing in 3D Random Fores Segmenaion M. Yaqub,, P. Mahon 3, M. K. Javaid, C. Cooper, J. A. Noble NDORMS, Universiy of Oxford, IBME, Deparmen of Engineering Science, Universiy of Oxford, 3 MRC Epidemiology

More information

THE goal of this work is to develop statistical models for

THE goal of this work is to develop statistical models for IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 32, NO. 4, APRIL 2010 579 Nonsaionary Shape Aciviies: Dynamic Models for Landmark Shape Change and Applicaions Samarji Das, Suden Member,

More information

Tracking a Large Number of Objects from Multiple Views

Tracking a Large Number of Objects from Multiple Views Boson Universiy Compuer Science Deparmen Technical Repor BUCS-TR 2009-005 Tracking a Large Number of Objecs from Muliple Views Zheng Wu 1, Nickolay I. Hrisov 2, Tyson L. Hedrick 3, Thomas H. Kun 2, Margri

More information

A METHOD OF MODELING DEFORMATION OF AN OBJECT EMPLOYING SURROUNDING VIDEO CAMERAS

A METHOD OF MODELING DEFORMATION OF AN OBJECT EMPLOYING SURROUNDING VIDEO CAMERAS A METHOD OF MODELING DEFORMATION OF AN OBJECT EMLOYING SURROUNDING IDEO CAMERAS Joo Kooi TAN, Seiji ISHIKAWA Deparmen of Mechanical and Conrol Engineering Kushu Insiue of Technolog, Japan ehelan@is.cnl.kuech.ac.jp,

More information

A Framework for Applying Point Clouds Grabbed by Multi-Beam LIDAR in Perceiving the Driving Environment

A Framework for Applying Point Clouds Grabbed by Multi-Beam LIDAR in Perceiving the Driving Environment Sensors 215, 15, 21931-21956; doi:1.339/s15921931 Aricle OPEN ACCESS sensors ISSN 1424-822 www.mdpi.com/journal/sensors A Framewor for Applying Poin Clouds Grabbed by Muli-Beam LIDAR in Perceiving he Driving

More information

STRING DESCRIPTIONS OF DATA FOR DISPLAY*

STRING DESCRIPTIONS OF DATA FOR DISPLAY* SLAC-PUB-383 January 1968 STRING DESCRIPTIONS OF DATA FOR DISPLAY* J. E. George and W. F. Miller Compuer Science Deparmen and Sanford Linear Acceleraor Cener Sanford Universiy Sanford, California Absrac

More information

Low-Cost WLAN based. Dr. Christian Hoene. Computer Science Department, University of Tübingen, Germany

Low-Cost WLAN based. Dr. Christian Hoene. Computer Science Department, University of Tübingen, Germany Low-Cos WLAN based Time-of-fligh fligh Trilaeraion Precision Indoor Personnel Locaion and Tracking for Emergency Responders Third Annual Technology Workshop, Augus 5, 2008 Worceser Polyechnic Insiue, Worceser,

More information

IROS 2015 Workshop on On-line decision-making in multi-robot coordination (DEMUR 15)

IROS 2015 Workshop on On-line decision-making in multi-robot coordination (DEMUR 15) IROS 2015 Workshop on On-line decision-making in muli-robo coordinaion () OPTIMIZATION-BASED COOPERATIVE MULTI-ROBOT TARGET TRACKING WITH REASONING ABOUT OCCLUSIONS KAROL HAUSMAN a,, GREGORY KAHN b, SACHIN

More information

MATH Differential Equations September 15, 2008 Project 1, Fall 2008 Due: September 24, 2008

MATH Differential Equations September 15, 2008 Project 1, Fall 2008 Due: September 24, 2008 MATH 5 - Differenial Equaions Sepember 15, 8 Projec 1, Fall 8 Due: Sepember 4, 8 Lab 1.3 - Logisics Populaion Models wih Harvesing For his projec we consider lab 1.3 of Differenial Equaions pages 146 o

More information

Shortest Path Algorithms. Lecture I: Shortest Path Algorithms. Example. Graphs and Matrices. Setting: Dr Kieran T. Herley.

Shortest Path Algorithms. Lecture I: Shortest Path Algorithms. Example. Graphs and Matrices. Setting: Dr Kieran T. Herley. Shores Pah Algorihms Background Seing: Lecure I: Shores Pah Algorihms Dr Kieran T. Herle Deparmen of Compuer Science Universi College Cork Ocober 201 direced graph, real edge weighs Le he lengh of a pah

More information

A Novel Approach for Monocular 3D Object Tracking in Cluttered Environment

A Novel Approach for Monocular 3D Object Tracking in Cluttered Environment Inernaional Journal of Compuaional Inelligence Research ISSN 0973-1873 Volume 13, Number 5 (2017), pp. 851-864 Research India Publicaions hp://www.ripublicaion.com A Novel Approach for Monocular 3D Objec

More information

Nonparametric CUSUM Charts for Process Variability

Nonparametric CUSUM Charts for Process Variability Journal of Academia and Indusrial Research (JAIR) Volume 3, Issue June 4 53 REEARCH ARTICLE IN: 78-53 Nonparameric CUUM Chars for Process Variabiliy D.M. Zombade and V.B. Ghue * Dep. of aisics, Walchand

More information

Definition and examples of time series

Definition and examples of time series Definiion and examples of ime series A ime series is a sequence of daa poins being recorded a specific imes. Formally, le,,p be a probabiliy space, and T an index se. A real valued sochasic process is

More information