arxiv: v1 [stat.me] 28 Feb 2018

Transcription

1 Statstcal shape analyss n a Bayesan framework for shapes n two and three dmensons. arxv: v1 [stat.me] 28 Feb 2018 Thoma Tsfts 1 1 Unversty of Bath, Department of Mathematcal Scences, Bath, UK. E-mal for correspondence: t.tsfts@bath.ac.uk Abstract: In ths paper, we descrbe a novel shape classfcaton method whch s embedded n the Bayesan paradgm. We dscuss the modellng and the arsen shape classfcaton algorthm for two and three dmensonal data shapes. We conclude by evaluatng the effcency and effcacy of the proposed algorthm on the Kma shape database for the two dmensonal case. Keywords: shape analyss; classfcaton; planar shape model 1 Introducton Shape s an mportant feature of objects; t can be used n many applcatons such as the recognton and classfcaton of objects n mages. In the approach we take we represent such objects and ther boundares as contnuous planar curves (.e. one-dmensonal lnes whch denote the outlne of the object) and study ther shapes. Our goal s to develop shape models, statstcal procedures and classfcaton methods of contnuous planar shape curves and establsh the statstcal framework needed for ther classfcaton. In partcular, we study how to classfy shapes that are generated by such curves and how we can probablstcally assgn them nto ther respectve categores; gven a set of pre-determned classes we would lke to classfy the observed data shapes we here defne a data shape y to be one of the shapes that we observed.e. an ordered set of ponts n R 2 or R 3. These questons occur n many applcatons of shape modellng and thus are of broad nterest. Ths paper was publshed as a part of the proceedngs of the 31st Internatonal Workshop on Statstcal Modellng, INSA Rennes, 4 8 July The copyrght remans wth the author(s). Permsson to reproduce or extract any parts of ths abstract should be requested from the author(s).

2 2 Statstcal shape analyss 2 Modellng and classfcaton The problem of classfcaton can be mathematcally formulated as the posteror probablty of the class n queston gven the observed data; that s by P(C y) where C C the class of the object and y Y the set of all the observed data shapes. In a Bayesan framework, classfcaton s performed by maxmsng the posteror probablty of the class whch by Bayes theorem s: P(C y) P(y C)P(C). For smplcty we choose the pror P(C) over the classes to be unform although t can be freely chosen. The major task s then to calculate the lkelhood whch we partton over nusance parameters that correspond to the data formaton process; ths mples the margnalsaton of the lkelhood over smlarty transformatons, namely translatons, scales and rotatons g G R m (R + SO(m)), bjectons b : [1,...n] [1,...n], shape curves β B R m n /(R m (R + SO(m))), samplng functons s S and the nherent observatonal nose σ. For our applcatons we choose the observatonal model to represent errors n shape pont collecton as addtve Gaussan whte nose so that the lkelhood functon for the complete data s gven by: P(y C) = b B Dβ Ds Dg dσ P(b)P(s)P(g)P(σ)P(β C) exp ( 1 2σ 2 n =1 y g β(s(b 1 )) 2 ) (1) wth a number of smplfyng ndependence assumptons made. In order to estmate the posteror probablty of a class, one should evaluate the sums and ntegrals over the nusance parameters. In the next sectons we dscuss our computatonal strateges for dealng wth these evaluatons for both two and three dmensonal shape data. 3 The two dmensonal case Our man goal s to evaluate the ntegrals n expresson (1) and thus perform Maxmum a Posteror (MAP) of a certan class gven the data. In prevous work, e.g. Dryden and Marda (1998) and Srvastava and Jermyn (2009) the ntegratons over the nusance parameters were evaluated numercally by a zeroth order Laplace approxmaton. In Tsfts et al. (2014) we ntroduced an analytc way of carryng out the group ntegratons and the ntegratons over σ resultng n a closed form expresson. To acheve that, we had to make an approprate and statstcally sgnfcant choce of prors. Intally, we used Jeffreys jont pror for g G R 2 (R + SO(2)) and σ however due to nduced dvergences a regularzed

3 Tsfts 3 verson was employed. Although ths broke the nvarance of the orgnal posteror, the result of ths ntegraton was found to be: P(y b, β, s) = 1 Z b B Dβ Ds ñ 2 ñṽar(y) Cov(v, 2 y) + 2ζ ñṽar(v) + 1/B2 n α P(b)P(s)P(β C) (2) where B, α, ζ are approprate regulators, [ Z the normalsaton constant, n the sample ponts and Cov(v, y) = 1 ñ v ȳ 1 ñ j v ȳ j ]. For detals regardng the prors and the calculatons refer to Tsfts et al. (2014). The proposed algorthm returns hgh classfcaton rates. To demonstrate ts effcency we encounter an example on two shape databases n secton 5. 4 The three dmensonal case Another problem of nterest s the generalsaton of the prevous case to ts three dmensonal equvalent by assumng that y R 3. The three dmensonal case s treated n a smlar way as the two dmensonal case: our goal s to classfy a shape by performng MAP on the class C. We follow the same steps as n the two-dmensonal case and we margnalse the lkelhood over the nusance parameters that take part n the data formaton process however smlarty transformatons are now represented by g G R 3 (R + SO(3)) snce y R 3. The challenge s the analytc evaluaton of the ntegrals of the margnalsed lkelhood and especally the ntegraton over three-dmensonal rotatons. Intally, translatons were ntegrated aganst the unform Haar measure. The result, as expected, was analogous to the two dmensonal case and had to be ntegrated wth respect to rotatons. For the ntegraton, we chose to represent rotatons as unt quaternons; the full quaternonc space s descrbed by: H = {a + b + cj + dka, b, c, d R} wth, j, k the three specal unt magnary quaternons. An mportant pont about quaternons, s the fact that they do not commute. The bass quaternons ant-commute and they provde a representaton of SU(2). The value of the commutator s [y, q] = 2y q, wth y, q H and y, q ther vectoral parts. For the ntegraton over quaternons, we choose to ntegrate over the full quaternonc space R 4 and mpose a constrant that takes nto account only unt quaternons. Snce unt quaternons lve on the surface of the unt 4- sphere, we mpose the constrant δ( q 2 1). Ths δ-functon s nvarant under the acton of SU(2) on the parameters snce rotatons act by sometres and thus do not change the length of the quaternons. Integratng the result of translatons over rotatons by mposng the constrant one has:

4 4 Statstcal shape analyss P (y b, β, s, σ) = d 4 q δ( q 2 1) exp ( N Y 2 2nσ 2 ) N Y 2 2σ 2 (3) To perform the ntegraton, we replace the δ-functon by ts Fourer equvalent whch ntroduces a second ntegraton that can be smplfed to: P (y b, β, s, σ) = dk d 4 q exp ( k( q 2 1) ) exp = 1 2π ( N Y 2 2nσ 2 ) N Y 2 2σ 2 dk d 4 q exp ( k) exp ( 4n [q T M(k)q] ) (4) where M j (k) = kδ j +δ 0 (ˆv T ŷ) +(1 δ 01 )(1 δ 0 ) [ ] ŷ ˆv) j δ j ˆv T ŷ) the symmetrsed, postve defnte 4 4 covarance matrx of the q components. We now dscuss the ntegral over the quaternonc parameters that generate the SO(3) rotatons. We followed Wood (1993) and calculated the approprate Haar measure for the quaternonc representaton whch was proven to be related to the normalsaton constant of the Bngham dstrbuton. The result of ntegratng over k wll supply the Haar measure on the space of unt quaternons and restrct our parameters q to ths surface. By dagonalsng M we can rewrte the exponent of expresson (4) as: exp ( 4n [q T M(k)q] ) ( = exp 4n S 3 λ q 2 d[ q] ) (5) Here, the q generate rotatons n SO(3) whch wll be unformly dstrbuted f and only f the q are unform on a unt hemsphere n R 4. Ths means that choosng the usual unform measure on S 3 for d[ q] nduces the Haar measure on the space of rotatons. Ths ensures that the chosen measure n (4) s the approprate one and nduces nvarance under the act of rotatons so that we do not favour one rotaton over another. Returnng to expresson (4), t s easy to see that the ntegral wth respect to q refers to a multvarate Gaussan dstrbuton. Assumng that the egenvalues of matrx M are negatve the evaluaton of the quaternonc ntegral of ths multvarate Gaussan dstrbuton s: P (y b, β, s, σ) = 1 2π 1 2π d 4 q dk exp ( k) exp ( 4n [q T M(k)q] ) dk exp ( k) 4 n π 2 det(m) (6)

5 Tsfts 5 wth det(m) the determnant of matrx M whch has k dependence and s nvarant to rotatons of y snce t has been wrtten n a manfestly rotatonally nvarant way. It s common practce to evaluate ntegrals of ths form by contour ntegraton. For ths we would have to promote k to the complex plane and choose an approprate path n the k-plane. Snce the expresson of the determnant s not a perfect square, the presence of the square root n the denomnator nstead of turnng ponts at whch the denomnator vanshes nto poles, t turns them nto branch cuts makng the ntegraton over these extremely dffcult. Thus contour ntegraton cannot be of help and the ntegral over k cannot be done analytcally. We were thus forced to Taylor expand the square root n the denomnator of expresson (6) n order to be able to analytcally approxmate the ntegral. However, ths represents an mportant step towards generalsng our work on planar shapes to three-dmensonal curves. The calculatons of the ntegraton of the remanng nusance parameters are challengng, although postve developments have been made towards a seres soluton. We leave the remanng calculaton for future consderaton as an extenson of the analyss presented here. Ths work s stll n progress but shows promsng sgns of mprovng upon the current shape classfcaton methods n three-dmensons. 5 Example n two-dmensons In order for the algorthm s effcacy on the classfcaton of two-dmensonal data shapes to be tested and verfed, examples from two shape databases were consdered: the Kma and a smulated letter database. In the latter case the applcaton of our algorthm comes wth a warnng; ordnarly the orentaton of letters s crucal (for example W versus M and C versus U) whereas our lkelhood has been constructed to be nvarant under rotatons of the data. The tests on ths database should be understood as a general test of our algorthm whch s used for demonstratonal purposes and not as a serous proposal for recognton of wrtten letters. Both databases were comprsed of bnary mages whch were used for tranng and testng purposes. The shapes boundares were extracted by MAT- LAB bult-n functons and smulated shapes played the role of the observed data sets. The proposed algorthm was tested on the smulated data sets and ts classfcaton results are very postve, as s llustrated n Fgure 1. For the Kma database we found that for 10 runs of 10 shapes each, the average classfcaton level was ˆµ = 59% ± 7% wth the average success rate beng more than ˆµ = 80% ± 5%. From these experments we concluded that the number of sampled ponts s crucal snce as soon as the number of ponts ncreases to more than 50 the confdence levels become almost 90 percent. For the alphabet database, the results for the average classfcaton level were ˆµ = 77% ± 5% wth the average success rate ˆµ = 73% ± 6%. The

6 6 Statstcal shape analyss evaluaton of the performance of the algorthm n three-dmensons could be tested by usng examples from 3D geologcal sand formatons as prevously dscussed n Tsfts et al (2014). FIGURE 1. Classfcaton results for a Kma shape and the letter E. References Dryden, I.L. and Marda, K (1998). Statstcal shape analyss. J. Wley. Kma, B.B (2015), Kma database. Avalable at dmc/. Srvastava, A. and Jermyn, I.H. (2009), Lookng for shapes n 2D cluttered pont clouds, IEEE Trans. Patt. Anal. Mach. Intell., 31(9), Tsfts, T., Jermyn, I. and Enbeck, J. (2014) Bayesan shape modellng of cross-sectonal geologcal data, n 29th Internatonal Workshop on Statstcal Modellng, July 2014, Goettngen, Germany; proceedngs, Amsterdam: Statstcal Modellng Socety, , [arxv: [stat.me]]. Wood, A.T.A. (1993), Estmaton of the concentraton parameters of the Fsher matrx dstrbuton on SO(3) and the Bngham dstrbuton on S q, q 2, Australan Journal of Statstcs, 35 (1),