Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques
|
|
- Jesse Wilkins
- 5 years ago
- Views:
Transcription
1 Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, 2005 Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques João Manuel R. S. Tavares * and Luísa Ferreira Bastos + * Laboratório de Óptica e Mecânica Experimental, Instituto de Engenharia Mecânica e Gestão Industrial / Departamento de Engenharia Mecânica e Gestão Industrial, Faculdade de Engenharia da Universidade do Porto, Rua Dr. Roberto Frias, s/n, , Porto, PORTUGAL + Laboratório de Óptica e Mecânica Experimental, Instituto de Engenharia Mecânica e Gestão Industrial, Rua Dr. Roberto Frias, s/n, , Porto, PORTUGAL Received 20 December 2004; accepted 9 March 2005 Abstract This paper presents an improved approach for matching objects represented in dynamic pedobarography image sequences, based on finite element modeling, modal analysis and optimization techniques. In this work, the determination of correspondences between objects data points is improved by using optimization techniques and, because the number of data points of each object is not necessary the same, a new algorithm to match the excess points is also proposed. This new matching algorithm uses a neighbourhood criterion and can overcome some disadvantages of the usual one to one matching. The considered approach allows the determination of correspondences between 2D or 3D objects data points, and is here apply in dynamic pedobarography images. Key Words: Computacional Vision, Deformable Objects, Dynamic Pedobarography, FEM, Matching, Medical Imaging, Modal Analysis, Optimization Techniques. 1 Introduction In several areas of Computational Vision, one of the main problems consists in the determination of correspondences between objects represented in different images, and on the computation of robust canonical descriptors that can be used for their recognition. In this paper, is presented a methodology to address the above problem, based on an approach initially proposed by Sclaroff [1], [2], and in this work improved by using optimization algorithms in the matching phase. A new algorithm to determine the correspondences between excess models nodes is also proposed, and can be used when the objects to be matched are represented by different number of data points. With this new algorithm, we can successfully overcome some disadvantages of the usual one to one matching as, for example, loss of information along image sequences. The application of the proposed matching methodology on deformable objects represented in dynamic pedobarography image sequences leads to very promising results, and will be discussed in this paper. Correspondence to: <tavares@fe.up.pt> Recommended for acceptance by Perales F., Draper B. ELCVIA ISSN: Published by Computer Vision Center / Universitat Autonoma de Barcelona, Barcelona, Spain
2 2 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, 2005 The following sections present a brief introduction to the background problem, the dynamic pedobarography principle, the used object models, the proposed matching methodology, experimental results obtained on deformable objects represented in dynamic pedobarography images and some conclusions. 1.1 Background There is an eigen methods class [2] that derives its parameterization directly from objects data shape. Some of these techniques also try to determine, explicitly and automatically, the correspondences between characteristic points sets, while others try to match images using more global approaches instead of local ones. Each eigen method decomposes the object deformation in an orthogonal and ordered base. Usually, solution methods for the matching problem include several restrictions that prevent inadequate matches according to some criteria, as for example: order [3], [4]; rigidity [3], [4]; unicity [5]; visibility [6]; and proximity [2]. Some of these methods are image correlation (it is presumed that the images are similar) [7], point proximity [8], and smoothness of disparity fields [3]. The matching problem can also be interpreted as an optimization problem, in which the objective function can, for example, depend on any criteria mentioned in the previous paragraph, and the restrictions considered must form a non-empty space of possible solutions. To solve this optimization problem, it can be used dynamic programming [3], graphs [4] and convex minimization [7]. Non-optimal approaches include, for example, greedy algorithms [9], simulated annealing [10], relaxation [5], etc. To determine correspondences between two objects, Belongie [11] considered shapes context and a similar optimization technique to the one used in this work. Although shape description algorithms have usually a higher computational efficiency, the modeling methodology considered in this work as the major advantage of attributing a physical behaviour to each object to be matched, through the consideration of a virtual elastic material. 2 Dynamic Pedobarography Pedobarography refers to measuring and visualizing the distribution of pressure under the foot sole. The recording of pedobarographic data along the duration of a step, in normal walking conditions, permits the dynamic analysis of the foot behavior. This introduction of the time dimension augments the potential of this type of clinical examination as an auxiliary tool for diagnostics and therapy planning [12]. The basic pedobarography system consists of a transparent plate trans-illuminated through its borders in such a way that the light is internally reflected. The plate is covered on its top by a single or dual thin layer of soft porous plastic material where the pressure is applied (see Figure 1). foot pressure lamp opaque layer glass or acrylic plate reflected light foot pressure Figure 1: Basic (pedo)barography principle. When observed from below, in the absence of applied pressure the plate is dark. However, when pressure is applied on top of the plastic layer, the plate displays bright areas that correspond to the light crossing the plate after reflection on the plastic layer. This reflection occurs due to the alteration of the local relation of light refraction indices resulting from the depletion of the air interface between the glass plate and the plastic layer. A good choice of materials and an adequate calibration of the image acquisition system, allow a nearly proportional relation between the local pressure and the observed brightness. Using a practical setup as the one represented in Figure 2, a time sequence of pressure images can be captured. Figure 3 shows thirteen images of a captured sample sequence; as can be verified, the image data is
3 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, very dense, as opposed to other measuring methods, and very rich in terms of the information it conveys on the interaction between the foot sole and the flat plate. Video 1 shows the image sequence considered. pedobarography table glass + contact layer camera mirror Figure 2: Basic setup of a pedobarography system Figure 3: Example of a captured sequence composed by thirteen images.
4 4 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, 2005 Video 1: Animation of the thirteen images of the sample sequence (click to see the video). 3 Object Models In the initial stages of the work, the object contours in each image were extracted and the matching process was oriented to the contours pixels [2], [13]. A practical difficulty arising from this approach is the possible existence of more than one contour for the object represented in each image (i. e. see Figure 7). To find the correspondence between each contours pair along the image sequence, two possible solutions were considered: i) use of a Kalman filtering (see [13], for example) approach to estimate and track the location of the contours centroids along the image sequence; ii) use of a measure of the deformation energy necessary to align each contour pairs, selecting the lower energy pairs. However, an additional problem is still present: the possibility that along the image sequence various contours will merge or split. In order to accommodate this possibility, a new model has been developed, similar to the one used in various applications working with controlled environment, such as in face analysis and recognition [14], [15]: The brightness level of each pixel is considered as the third coordinate of a 3D surface point. The resulting single surface model solves the two aforementioned problems. The use of the surface model, also simplifies the consideration of isobaric contours, which are important in pedobarographic analysis, either for matching contours of equal pressure along the time sequence or for matching contours of different pressure in a single image [12], [13]. The following sections describe the object models used in this work and briefly describe their construction. Each model has its own advantages and shortcomings; for every particular problem, the best choice must be made [12], [13]. 3.1 Contour Model To determine the correspondence among two contours were used two modeling approaches: For each contour is used a single 2D Sclaroff s isoparametric finite element. In building this type of element, no previous ordering of the data points is required and Gaussian functions are used as interpolations functions. The method to determine the mass and stiffness matrices for this 2D element is described in, for example, [1]. For each contour is built a finite elements model using linear axial finite elements (Figure 4). For this type of discretisation a previous ordering of the contour data points is required. The matrix formulation for these finite elements can be found in [16], for example.
5 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, e 1 e 8 1 e e e 3 e e 4 e 5 Figure 4: Modeling a contour by using a set of axial finite elements. e i To determine in each image the contour pixels, are used standard image processing and analysis techniques; namely, thresholding, edge enhancement, hysteresis line detection and tracking [2]. For example, Figures 6 and 7 show the intermediate result and the final contours obtained from the image of Figure 5. The sampled contours obtained from the thirteen images shown in Figure 3 are presented in Figure 8. Figure 5: Image (negated) where contours must be found. Figure 6: Result image after edge enhancement. Figure 7: Contours obtained by a line detection and tracking algorithm [2]. 3.2 Surface Model For the surface model, two approaches were also considered: A single 3D Sclaroff s isoparametric finite element is used for each surface to be matched. Again, it must be noticed that there is no requirement for previous ordering of the surface nodes. The matrix building for these finite elements can be found in [1]. Each surface model is built by using linear axial finite elements (Figure 9). The previous ordering of the surface data points is required. The matrix formulation for these finite elements can be found in [16], for example. The used methodology to determine the data points of each surface can be summarized as follows: 1. Noise pixels (that is, pixels with brightness lower than a calibration threshold level) are removed and a Gaussian-shaped smoothing filter is applied to the image (Figure 10); 2. The circumscribing rectangle of the object to be modeled is determined and the image is sampled within that area (Figure 11); 3. A 2D Delaunay triangulation (see, for example, [25, 26]) is performed on the sampled points, using the point brightness as the third coordinate; 4. In order to reduce the number of nodes used, and thus the computational cost, the triangular mesh is simplified using a decimation algorithm (see, for example, [25, 26]); 5. To reduce the high frequency noise associated to the mesh, is used a Laplacian smoothing algorithm (see, for example, [25, 26]); 6. Finally, in order to have similar ranges of values in all coordinates, a scale change is performed on the third coordinate (derived from brightness) (Figure 12).
6 6 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, Figure 8: Sampled contours obtained from the original image sequence of Figure 3. Figure 9: Modeling a surface by using a set of axial finite elements. (Each node is connected to its neighbors through axial elements.)
7 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, Figure 10: Image (negated) after noise removal and Gaussian filtering. Figure 11: Object sampling. Figure 12: Resulting surface. The surfaces obtained from the original images presented in Figure 3 are visible in Figure 13. The original images with identification (ID) 0 (zero) and 1 (one) were not considered Figure 13: Surfaces obtained from the last eleven images of the example sequence. 3.3 Isobaric Contour Model As in the two previous models, the approaches used to match isobaric contours are:
8 8 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, 2005 A single Sclaroff s isoparametric finite element, either 2D or 3D, is used to model each contour. A set of linear axial finite elements are used to build each contour model. The isobaric contours are extracted from the correspondent surface, beforehand obtained using the procedures described in the previous section (Figure 14). Figure 14: Ten isobaric contours extracted from the surface of figure Matching Methodology Figure 15 displays a diagram of the adopted physical matching methodology. The locations of the objects data points in each image, X = [ X1 X m ], are used as the nodes of a finite elements model made of an elastic material. Next, the eigenmodes { φ } i of the model are computed, providing an orthogonal description of the object and its natural deformations, ordered by frequency. Using a matrix based notation, the eigenvectors Ω can be written as in equation (1) for 2D objects and as matrix [ Φ ] and the eigenvalues diagonal matrix [ ] in equation (2) for 3D objects. The eigenvectors, also called shape vectors [1], [2], [16], [17], describe how each vibration mode deforms the object by changing the original data point locations: X = X + a{ φ }. [ ] {} φ {} φ {} u T 1 2 T 1 {} u m Φ = and [ ] 1 2m = T {} v Ω = ω 2m [ ] {} φ {} φ {} v T m {} u T 1 {} u {} v T T {} v { w} ω m T 2 1 ω1 0 Φ = = and [ ] 1 3m Ω = 2 0 ω 3m m T 1 T { w} m 0 deformed, (1). (2) The first three (in 2D) or six (in 3D) vibration modes are the rigid body modes of translation and rotation; the remaining modes are non-rigid [1], [2], [16], [17]. In general, lower frequency modes describe global deformations, while higher frequency modes essentially describe local deformations. This type of ordering, from global to local behaviour, is quite useful for object matching and recognition. i
9 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, Figure 15: Diagram of the adopted matching methodology. The eigenmodes also form an orthogonal, object-centred coordinate system for the location of the data points, i.e., the location of each point is uniquely described in terms of each eigenmode displacement. The transformation between the Cartesian image coordinates and the modal coordinates system is achieved through the eigenvectors matrix of the physical model. Two sets of data points, for example, corresponding to the objects represented in two different images of a sequence, are to be compared in the modal eigenspace. The main idea is that the low order modes of two similar objects will be very close, even in the presence of an affine transformation, a non-rigid deformation, a local shape variation, or noise. Using the above concept, data correspondence is obtained by modal matching. In this work, two matching search procedures are considered: (i) a local search or (ii) a global search. Both search strategies consider an Z, constructed from the Euclidian distance between the characteristic vectors of each affinity matrix [ ] physical model, whose elements are, for 2D and for 3D, respectively: 2 {} {} {} {} Z = u u + v v ij t, i t+ 1, j t, i t 1, j 2 2 {} {} {} {} { } { } 2 +, (3) Zij = u u + v v + w w. (4) ti, t+ 1, j ti, t+ 1, j ti, t+ 1, j The local search strategy was proposed in the original modal matching methodology [1], [2], [13], and basically it consists in seeking each row of the affinity matrix for its lowest value, considering the associated correspondence if, and only if, that value is also the lowest of the related column. With this search philosophy, the models nodes are considered as independent entities and so the original object structure is ignore. 2
10 10 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, 2005 As previously referred, the matching problem considering only matches of type one to one and objects with equal number of data points can be considered as a classical assignment problem, which is a particular case of an optimization problem [18], [20]. In the formulation of this type of problem is assumed that: the number of data points of both objects is the same, n ; it is known the assignment cost, Z ij, of each pair of points ( i, j ), where i is a point of object t and j is a point of object t + 1. As the notation tries to evidence, this assignment cost is equal to the element in line i and column j of the affinity matrix, [ Z ]. The assignment problem initially appeared to mathematically formulate problems in which n jobs/works must be distributed by n tasks, with the restriction that each job/work had to be assigned to one, and only one, task and vice-versa, subject to the minimization of the global assignment cost. In this work, the jobs/works are the data points of the object t and the tasks are the data points of the object t + 1. So, for the mathematical formulation of this matching problem, let s consider: 1 if point i of t is assigned to point j of t+ 1 x ij =, (5) 0 otherwise with i, j = 1,2,..., n. Next expressions follow the typical structure of a mathematical programming problem, with an objective function and a set of restrictions in the problem s variables: minimize f n n = Z x i= 1j= 1 ij ij, (6) n subject to xij = 1, with i = 1,2,..., n, (7) j = 1 n xij = 1, with j = 1,2,..., n, (8) i = 1 and x { 0,1 }, i, j. (9) ij In equation (6), the function f takes the value of the assignment total cost. The first restriction (7), forces each data point in object t to be assigned to one, and only one, data point in object t + 1. The second restriction (8), forces each data point in object t +1 to be assigned to one, and only one, data point in object t. The third and last restriction (9), forces the problem s variables, x ij ( i, j = 1,2,..., n ), to take one of the two possible values { 0,1 }. To solve the assignment (matching) problem we considered three algorithms: the Hungarian method [18], [19]; the Simplex method for flow problems [18], [21]; and the LAPm algorithm [18], [22]. The Hungarian method is the most well known method for the resolution of the assignment problem. The Simplex method for flow problems solves problems with less rigid restrictions than the assignment problem, but where this last can be included as a special case. The LAPm method is a considerably recent algorithm developed to solve classical assignment problems. Once the optimal global matching solution is found, as in the original local matching procedure, the matches that exceed a pre-established matching threshold level are eliminated from that solution. The relevance of this restriction is higher with this global matching approach, because a solution of the assignment problem always has the maximum number of matches of type one to one, due to the problem s restrictions. Case the number of data points of the two objects to be matches are different, with the usual matching restriction that allows only matches of type one to one, will necessarily exist data points that won t be matched. The solution found was initially add fictitious points to the model with fewer data points; this way, we solve the optimization problem requirement of the affinity matrix be necessarily square. Then, after the
11 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, optimization phase, we have some real objects data points, the excess points, matched with the fictitious elements previously add. Finally, these excess points are matched adequately with real objects data points, using a neighbourhood and an affinity criterion, as follows: For each excess point, the developed algorithm fits it between its matched nearest neighbours; From the correspondences of those neighbours in the other object, it is determined the best correspondence for the excess point, minimizing the costs and considering that the neighbours must remain as so and that there mustn t exist crossed matches; As in the optimization phase, the obtained matches will only be considered as good matches if, and only if, the pre-established matching threshold level is respected. With this solution, for the excess objects data points are allowed matches of type one to many or vice versa. Note that, for all the used methodologies in the matching framework it s not considered any additional information about the original image sequence neither about the represented objects. 5 Results The presented matching methodology was integrated in a generic software platform for deformable objects [2], [23], previous developed using Microsoft Visual C ++, the Newmat [24] library for matrix computation and the VTK - The Visualization Toolkit [25], [26] for 3D visualization, mesh triangulation, simplification and smoothing, and for isobaric contours extraction. This section presents some experimental results obtained on objects extracted from dynamic pedobarography images, using the adopted matching methodology. First, are presented results considering contour, then surface, and finally isocontour models. In all cases, the object pairs considered were just selected for example purposes. All the results presented in this section, were obtained considering in the objects modeling the Sclaroff s isoparametric finite element and rubber as the virtual elastic material, and using 25% of the models vibration modes in the matching phase. 5.1 Contour object matching Considering the pairs of contours with ID 2/3, 3/4 and 10/11, previously presented in Figure 8, using the matching methodology adopted, we obtain the matches shown in Figures 16, 17, and 18, respectively. In these figures, the contours data points, and also the matched pairs, are connected for better visualization. Local matching: 53 Optimization matching: 64 Figure 16: Matches obtained between contours with ID 2 (64 nodes) and 3 (64 nodes). The matches found between the contours extracted from the last eleven images (ID 2 to 12) of the example sequence, are present in Figure 19. With Videos 2, 3 and 4 it is possible to see these matches along the image sequence. The number and the percentage of matches obtained during the same sequence are indicated in Table 1. The results obtained using the local search strategy, were in range of 50.2% to 82.8% and present all good quality; instead, the optimization search procedure had always 100% of matching success, and in generally the found matches also have good quality and the excess nodes were reasonably matched.
12 12 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, 2005 One important remark is the use of the same methodology parameters for all matching cases. If the parameters were adjusted for each contour pair, the results could be improved. In the same way, the matching threshold level was chosen to allow all the established matches, avoiding the rejection of the less adequate matches (see Figure 18, for example). Local matching: 44 Optimization matching: 64 Excess nodes matching: 67 Figure 17: Matches obtained between contours with ID 3 (64 nodes) and 4 (67 nodes). Local matching: 24 Optimization matching: 48 Optimization matching: 47 (reducing the matching threshold level to eliminate the wrong match) Considering 50% of the modes: (local deformations) Local matching: 32 Optimization matching: 48 Figure 18: Matches obtained between contours with ID 10 (48 nodes) and 11 (48 nodes).
13 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, Local matching Optimization matching Figure 19: Matches obtained between all eleven contours (from ID 2 to 12). Local matching Optimization matching Excess nodes matching Videos 2, 3 and 4: Matches found between the contours extracted from the last eleven images of the example sequence (click to see the video). Local Optimization Excess Nodes contours ID Nº Nodes Nº Match % Match Nº Match % Match Nº Match 2, 3 64/ ,8% % 3, 4 64/ ,8% % 67 4, 5 67/ ,1% % 5, 6 67/ ,4% % 67 6, 7 64/ ,3% % 64 7, 8 58/ ,8% % 58 8, 9 51/ ,0% % 51 9, 10 50/ ,2% % 50 10, 11 48/ ,0% % 11, 12 48/ ,3% % 48 Table 1: Number (Nº Match) and percentage of matches (% Match) obtained between the contours extracted from the last eleven images (ID 2 to 12) of the example sequence.
14 14 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, Surface matching The matches found between the surfaces models with ID 2/3, 4/5 and 11/12, each one build from the correspondent image of the example sequence, using the adopted matching methodology, are shown in the Figures 20, 21, and 22, respectively. In these figures, the matched nodes are connected for better viewing and two different views are presented. The number and the percentage of matches obtained considering the surfaces models build from the last eleven images of the example sequence are indicated in Table 2. The results of the local search strategy were in range of 33.3% to 87.8%, and, attending to the high objects deformation, we can consider that the found matches have good quality. In other hand, the search strategy based on optimization techniques had always 100%, and generally the matches present also good quality. As in the contour case, all the parameters of the matching methodology were considered constant along the sequence. Local matching: 48 Optimization matching: 116 Figure 20: Matches obtained between surfaces with ID 2 (116 nodes) and 3 (131 nodes). Local matching: 64 Optimization matching: 125 Figure 21: Matches obtained between surfaces with ID 4 (131 nodes) and 5 (125 nodes).
15 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, Local matching: 32 Optimization matching: 85 Figure 22: Matches obtained between surfaces with ID 11 (99 nodes) and 12 (85 nodes). Local Optimization Surfaces ID Nº Nodes Nº Match % Match Nº Match % Match 2, 3 116/ ,3% % 3, 4 131/ ,8% % 4, 5 131/ ,2% % 5, 6 125/ ,5% % 6, 7 109/ ,7% % 7, 8 107/ ,3% % 8, 9 96/ ,1% % 9, 10 98/ ,9% % 10, 11 95/ ,7% % 11, 12 99/ ,4% % Table 2: Number (Nº Match) and percentage of matches (% Match) obtained with the surfaces build from the last eleven images of the example sequence. 5.3 Isocontour matching Using the proposed matching methodology to establish the correspondences between the isocontours with ID 1/2, 4/5, and 6/7, all extracted from the image with ID 6 of the example sequence, were obtained the matches shown in Figures 23, 24, and 25, respectively. As in the surface case, in these figures the matched nodes are connected and two different views are presented. The matches found considering eleven isocontours extracted from the same image (with ID 6) of the example sequence are shown in Figure 26. With Videos 5 and 6 it is possible to see these matches along the referred isocontour sequence. The number and the percentage of the obtained matches considering the referred eleven isocontours are indicated in the Table 3. Using the local search strategy, the results obtained were in range of 50.0% to 94.1%, and the matches found could be considered of good quality. Instead, the search based on optimization techniques had always 100% of matching success, and in generally the matches found have also good quality and the excess nodes were reasonably matched. As in the contour and surface cases, the matching results obtained could be improved if the parameters of the adopted methodology were adjusted for each isocontour pair.
16 16 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, 2005 Local matching: 52 Optimization matching: 76 Figure 23: Matches obtained between isocontours with ID 1 (76 nodes) and 2 (76 nodes). Local matching: 40 Optimization matching: 70 Excess nodes matching: 76 Figure 24: Matches obtained between isocontours with ID 4 (76 nodes) and 5 (70 nodes). 6 Conclusions The several experimental tests carried through this work, some reported in this paper, allow the presentation of some observations and conclusions. The physical methodology proposed, for the determination of correspondences between two objects, using optimization techniques on the matching phase, when compared with the one previously developed that considers local search, obtained always an equal or higher number of satisfactory matches. It was also verified that the number of matches found is independent from the optimization algorithm considered. In some experimental cases, in order to obtain a higher number of satisfactory matches using the local search strategy, the parameters of the physical methodology had to be carefully chosen. In those same cases, the application of the optimization strategy in the matching phase, beyond the good quality of the matches found, revealed less sensible to the methodology parameters. This suggests that using the proposed global
17 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, search strategy in the matching phase, the adopted physical methodology become easier to handle and also more adjustable to different kinds of applications. Local matching: 24 Optimization matching: 46 Excess nodes matching: 54 Figure 25: Matches obtained between isocontours with ID 6 (54 nodes) and 7 (46 nodes). Local matching: Optimization matching: Excess nodes matching: Figure 26: Matches obtained between the eleven isocontours extracted from the image with ID 6 of the example sequence.
18 18 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, 2005 Local Optimization Excess Nodes Isocontours ID Nº Nodes Nº Match % Match Nº Match % Match Nº Match 1, 2 76/ ,4% % 2, 3 76/ ,4% % 76 3, 4 74/ ,6% % 76 4, 5 76/ ,1% % 76 5, 6 70/ ,3% % 70 6, 7 54/ ,2% % 54 7, 8 46/ ,9% % 46 8, 9 38/ ,0% % 38 9, 10 34/ ,1% % 10, 11 34/ ,0% % Table 3: Nu mber (Nº Matc h) and percentage of mat ches (% Match) obtained with the eleven isocontours extracted from the im age with ID 6 of the example sequence. Local matching Optimization matching Videos 5 and 6: Matches found between the isocontours extracted from the image with ID 6 of the example sequence (click to see the video). To have satisfactory matching results in some of the examples considered, when compared with the local search strategy, the global search strategy always required an inferior number of eigenvectors in the affinity matrix construction. This suggests that the total computational effort of the global matching methodology can be reduced if optimization techniques are considered. In terms of execution time, the optimization algorithm that uses the Hungarian method showed to be of low efficiency. In the several experimental examples performed, the Simplex algorithm for flow problems revealed the most efficient among the optimization algorithms considered. The execution time of LAPm algorithm was higher than the Simplex algorithm for flow problems, even being a more specific algorithm for this type of problems. This can be dew to the interval in which lay the elements of the affinity matrix, [0; 1], since when this algorithm was tested in [27] it revealed the most efficient when the considered interval was [1; 100]. In the several experimental tests performed considering contour objects, the implemented algorithm for the determination of correspondences of the excess data points always finds satisfactory matches. That allows us to conclude that the referred algorithm can become an interesting base for the development of new solutions for the determination of matches of type one to many and vice versa, and that should be ported to more complex objects (i. e., surfaces). The experimental results shown in this paper, confirm that the proposed physical methodology can satisfactory match objects represented in dynamic pedobarography images, and that the use of the pixel
19 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, brightness values as a third Cartesian coordinate is very satisfactory, both in terms of its interpretation as pressure, and in solving the problems associated to merging or the splitting of objects. References [1] S. E. Sclaroff and A. Pentland, Modal Matching for Correspondence and Recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, pp , 1995 [2] J. M. R. S. Tavares, PhD Thesis, Análise de Movimento de Corpos Deformáveis usando Visão Computacional, in Faculdade de Engenharia da Universidade do Porto, Portugal, 2000 [3] Y. Ohta and T. Kanade, Stereo by Intra- and Inter-Scanline Search using Dynamic Programming, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 7, pp , 1985 [4] S. Roy and I. J. Cox, A Maximum-Flow Formulation of the N-camera Stereo Correspondence Problem, presented at International Conference on Computer Vision (ICCV'98), Bombay, India, 1998 [5] S. Gold, A. Rangarajan, C. P. La, S. Pappu and E. Mjolsness, New algorithms for 2D and 3D point matching: pose estimation and correspondence, Pattern Recognition, vol. 31, pp , 1998 [6] C. Silva, PhD Thesis, 3D Motion and Dense Structure Estimation: Representation for Visual Perception and the Interpretation of Occlusions, in Instituto Superior Técnico: Universidade Técnica de Lisboa, 2001 [7] J. L. Maciel and J. P. Costeira, A Global Solution to Sparse Correspondence Problems, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, pp , 2003 [8] Z. Zhang, Iterative Point Matching for Registration of Free-Form Curves, INRIA, Technical Report RR-1658, April 1992 [9] M. S. Wu and J. J. Leou, A Bipartite Matching Approach to Feature Correspondence in Stereo Vision, Pattern Recognition Letters, vol. 16, pp , 1995 [10] J. P. P. Starink and E. Backer, Finding Point Correspondences using Simulated Annealing, Pattern Recognition, vol. 28, pp , 1995 [11] S. Belongie, J. Malik and J. Puzicha, Shape Matching and Object Recognition using Shape Context, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, pp , 2002 [12] A. J. Padilha, L. A. Serra, S. A. Pires and A. F. N. Silva, Caracterização Espacio-Temporal de Pressões Plantares em Pedobarografia Dinâmica, FEUP/INEB, Relatório Interno, 1995 [13] J. M. R. S. Tavares, J. Barbosa and A. Padilha, Matching Image Objects in Dynamic Pedobarography, presented at 11th Portuguese Conference on Pattern Recognition (RecPad'00), Porto, Portugal, 2000 [14] T. F. Cootes and C. J. Taylor, Modelling Object Appearance Using The Grey-Level Surface, presented at British Machine Vision Conference (BMVC 94), 1994 [15] B. Moghaddam, C. Nastar and A. P. Pentland, Bayesian Face Recognition using Deformable Intensity Surfaces, MIT Media Laboratory, Technical Report Nº 371, 1996 [16] K.-J. Bathe, Finite Element Procedures, Prentice Hall, 1996 [17] S. Graham Kelly, Fundamentals of Mechanical Vibrations, McGraw-Hill, 1993 [18] L. F. Bastos and J. M. R. S. Tavares, Optimization in Modal Matching for Correspondence of Objects Nodal Points, presented at 7th Portuguese Conference on Biomedical Engineering (BioEng'2003), Fundação Calouste Gulbenkian, Lisboa, Portugal, 2003 [19] F. S. Hillier and G. J. Lieberman, Introduction to Operations Research. Mcgraw-Hill International Editions, 1995 [20] L. F. Bastos, MSc Thesis, Optimização da Determinação das Correspondências entre Objectos Deformáveis no Espaço Modal, in Faculdades de Engenharia e Ciências: Universidade do Porto, Portugal, 2003 [21] A. Löbel, MFC - A Network Simplex Implementation, Konrad-Zuse-Zentrum für Informationstechnik Berlin, Division Scientific Computing, Department Optimization, 2000
20 20 Tavares et al. / Electronic Letters on Computer Vision and Image Analysis 5(3):1-20, 2005 [22] A. Volgenant, Linear and Semi-Assignment Problems: A Core Oriented Approach, Computers and Operations Research, vol. 23, pp , 1996 [23] J. M. R. S. Tavares, J. Barbosa and A. Padilha, Apresentação de um Banco de Desenvolvimento e Ensaio para Objectos Deformáveis, Revista Electrónica de Sistemas de Informação, vol. 1, 2002 [24] R. Davies, Newmat, A matrix library in C ++, 2005 [25] The VTK User s Guide, Kitware Inc., 2003 [26] W. Schroeder, K. Martin and B. Lorensen, The Visualization Toolkit, 3rd Edition, Kitware Inc, 2002 [27] M. Dell Amico and P. Tooth, Algorithms and Codes for Dense Assignment Problems: The State of The Art, Discrete Applied Mathematics, 100, pp , 2000
IMPROVEMENT OF MODAL MATCHING IMAGE OBJECTS IN DYNAMIC PEDOBAROGRAPHY USING OPTIMIZATION TECHNIQUES
IMPROVEMENT OF MODAL MATCHING IMAGE OBJECTS IN DYNAMIC PEDOBAROGRAPHY USING OPTIMIZATION TECHNIQUES João Manuel R. S. Tavares * and Luísa Ferreira Bastos + * Laboratório de Óptica e Mecânica Experimental,
More informationMATCHING OF OBJECTS NODAL POINTS IMPROVEMENT USING OPTIMIZATION
MATCHING OF OBJECTS NODAL POINTS IMPROVEMENT USING OPTIMIZATION Luísa F. Bastos Laboratório de Óptica e Mecânica Experimental, Instituto de Engenharia Mecânica e Gestão Industrial Rua Dr. Roberto Frias,
More informationMATCHING OF OBJECTS NODAL POINTS IMPROVEMENT USING OPTIMIZATION
MATCHING OF OBJECTS NODAL POINTS IMPROVEMENT USING OPTIMIZATION Luísa F. Bastos LOME - Laboratório de Óptica e Mecânica Experimental INEGI - Instituto de Engenharia Mecânica e Gestão Industrial Porto,
More informationA PHYSICAL SIMULATION OF OBJECTS BEHAVIOUR BY FINITE ELEMENT METHOD, MODAL MATCHING AND DYNAMIC EQUILIBRIUM EQUATION
A PHYSICAL SIMULATION OF OBJECTS BEHAVIOUR BY FINITE ELEMENT METHOD, MODAL MATCHING AND DYNAMIC EQUILIBRIUM EQUATION Raquel Ramos Pinho, João Manuel R. S. Tavares FEUP Faculty of Engineering, University
More informationAutomatic Modelling Image Represented Objects Using a Statistic Based Approach
Automatic Modelling Image Represented Objects Using a Statistic Based Approach Maria João M. Vasconcelos 1, João Manuel R. S. Tavares 1,2 1 FEUP Faculdade de Engenharia da Universidade do Porto 2 LOME
More informationTRACKING FEATURES WITH KALMAN FILTERING, MAHALANOBIS DISTANCE AND A MANAGEMENT MODEL
USNCCM IX, San Francisco, CA, USA, July 22-26 2007 TRACKING FEATURES WITH KALMAN FILTERING, MAHALANOBIS Raquel R. Pinho, Miguel V. Correia, João Manuel R. S. Tavares FEUP Faculdade de Engenharia da Universidade
More informationAlgorithm of dynamic programming for optimization. defined by ordered points
Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Francisco P. M. Oliveira, i João Manuel R. S. Tavares tavares@fe.up.pt www.fe.up.pt/~tavares
More informationShape Descriptor using Polar Plot for Shape Recognition.
Shape Descriptor using Polar Plot for Shape Recognition. Brijesh Pillai ECE Graduate Student, Clemson University bpillai@clemson.edu Abstract : This paper presents my work on computing shape models that
More informationRotation Invariant Image Registration using Robust Shape Matching
International Journal of Electronic and Electrical Engineering. ISSN 0974-2174 Volume 7, Number 2 (2014), pp. 125-132 International Research Publication House http://www.irphouse.com Rotation Invariant
More informationAn Adaptive Eigenshape Model
An Adaptive Eigenshape Model Adam Baumberg and David Hogg School of Computer Studies University of Leeds, Leeds LS2 9JT, U.K. amb@scs.leeds.ac.uk Abstract There has been a great deal of recent interest
More informationBiomedical Imaging Registration Trends and Applications. Francisco P. M. Oliveira, João Manuel R. S. Tavares
Biomedical Imaging Registration Trends and Applications Francisco P. M. Oliveira, João Manuel R. S. Tavares tavares@fe.up.pt, www.fe.up.pt/~tavares Outline 1. Introduction 2. Spatial Registration of (2D
More informationSpatio-Temporal Registration of Biomedical Images by Computational Methods
Spatio-Temporal Registration of Biomedical Images by Computational Methods Francisco P. M. Oliveira, João Manuel R. S. Tavares tavares@fe.up.pt, www.fe.up.pt/~tavares Outline 1. Introduction 2. Spatial
More informationTracking of Human Body using Multiple Predictors
Tracking of Human Body using Multiple Predictors Rui M Jesus 1, Arnaldo J Abrantes 1, and Jorge S Marques 2 1 Instituto Superior de Engenharia de Lisboa, Postfach 351-218317001, Rua Conselheiro Emído Navarro,
More informationHuman motion analysis: methodologies and applications
Human motion analysis: methodologies and applications Maria João M. Vasconcelos, João Manuel R. S. Tavares maria.vasconcelos@fe.up.pt CMBBE 2008 8th International Symposium on Computer Methods in Biomechanics
More informationCS 565 Computer Vision. Nazar Khan PUCIT Lectures 15 and 16: Optic Flow
CS 565 Computer Vision Nazar Khan PUCIT Lectures 15 and 16: Optic Flow Introduction Basic Problem given: image sequence f(x, y, z), where (x, y) specifies the location and z denotes time wanted: displacement
More informationSnakes, level sets and graphcuts. (Deformable models)
INSTITUTE OF INFORMATION AND COMMUNICATION TECHNOLOGIES BULGARIAN ACADEMY OF SCIENCE Snakes, level sets and graphcuts (Deformable models) Centro de Visión por Computador, Departament de Matemàtica Aplicada
More informationBiomedical Image Analysis based on Computational Registration Methods. João Manuel R. S. Tavares
Biomedical Image Analysis based on Computational Registration Methods João Manuel R. S. Tavares tavares@fe.up.pt, www.fe.up.pt/~tavares Outline 1. Introduction 2. Methods a) Spatial Registration of (2D
More informationTowards the completion of assignment 1
Towards the completion of assignment 1 What to do for calibration What to do for point matching What to do for tracking What to do for GUI COMPSCI 773 Feature Point Detection Why study feature point detection?
More informationGuidelines for proper use of Plate elements
Guidelines for proper use of Plate elements In structural analysis using finite element method, the analysis model is created by dividing the entire structure into finite elements. This procedure is known
More informationChaplin, Modern Times, 1936
Chaplin, Modern Times, 1936 [A Bucket of Water and a Glass Matte: Special Effects in Modern Times; bonus feature on The Criterion Collection set] Multi-view geometry problems Structure: Given projections
More informationFast Lighting Independent Background Subtraction
Fast Lighting Independent Background Subtraction Yuri Ivanov Aaron Bobick John Liu [yivanov bobick johnliu]@media.mit.edu MIT Media Laboratory February 2, 2001 Abstract This paper describes a new method
More informationProcessing 3D Surface Data
Processing 3D Surface Data Computer Animation and Visualisation Lecture 15 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing
More informationNonrigid Surface Modelling. and Fast Recovery. Department of Computer Science and Engineering. Committee: Prof. Leo J. Jia and Prof. K. H.
Nonrigid Surface Modelling and Fast Recovery Zhu Jianke Supervisor: Prof. Michael R. Lyu Committee: Prof. Leo J. Jia and Prof. K. H. Wong Department of Computer Science and Engineering May 11, 2007 1 2
More informationSearch by Shape Examples: Modeling Nonrigid Deformation
Boston University Computer Science Dept. TR94-015 Appeared in Proc. 28th Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA. Oct. 1994. Search by Shape Examples: Modeling Nonrigid
More informationFundamentals of Stereo Vision Michael Bleyer LVA Stereo Vision
Fundamentals of Stereo Vision Michael Bleyer LVA Stereo Vision What Happened Last Time? Human 3D perception (3D cinema) Computational stereo Intuitive explanation of what is meant by disparity Stereo matching
More informationAugmented Reality VU. Computer Vision 3D Registration (2) Prof. Vincent Lepetit
Augmented Reality VU Computer Vision 3D Registration (2) Prof. Vincent Lepetit Feature Point-Based 3D Tracking Feature Points for 3D Tracking Much less ambiguous than edges; Point-to-point reprojection
More informationRobust Point Correspondence by Concave Minimization
Robust Point Correspondence by Concave Minimization João Maciel Λ and João Costeira Instituto de Sistemas e Robótica Instituto Superior Técnico Av. Rovisco Pais, 1049-001 Lisboa Codex, PORTUGAL fmaciel,jpcg@isr.ist.utl.pt
More informationModel-based segmentation and recognition from range data
Model-based segmentation and recognition from range data Jan Boehm Institute for Photogrammetry Universität Stuttgart Germany Keywords: range image, segmentation, object recognition, CAD ABSTRACT This
More informationOn-line and Off-line 3D Reconstruction for Crisis Management Applications
On-line and Off-line 3D Reconstruction for Crisis Management Applications Geert De Cubber Royal Military Academy, Department of Mechanical Engineering (MSTA) Av. de la Renaissance 30, 1000 Brussels geert.de.cubber@rma.ac.be
More informationProcessing 3D Surface Data
Processing 3D Surface Data Computer Animation and Visualisation Lecture 12 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing
More informationDISTANCE MAPS: A ROBUST ILLUMINATION PREPROCESSING FOR ACTIVE APPEARANCE MODELS
DISTANCE MAPS: A ROBUST ILLUMINATION PREPROCESSING FOR ACTIVE APPEARANCE MODELS Sylvain Le Gallou*, Gaspard Breton*, Christophe Garcia*, Renaud Séguier** * France Telecom R&D - TECH/IRIS 4 rue du clos
More informationEE368 Project Report CD Cover Recognition Using Modified SIFT Algorithm
EE368 Project Report CD Cover Recognition Using Modified SIFT Algorithm Group 1: Mina A. Makar Stanford University mamakar@stanford.edu Abstract In this report, we investigate the application of the Scale-Invariant
More informationAnalysis and optimization of reinforced concrete slabs
Analysis and optimization of reinforced concrete slabs A.J.M. de Figueiredo, A.M. Adao da Fonseca, A.F.M. Azevedo Department of Civil Engineering, Faculty of Engineering, University of Porto, Rua dos Bragas,
More informationChapter 9 Object Tracking an Overview
Chapter 9 Object Tracking an Overview The output of the background subtraction algorithm, described in the previous chapter, is a classification (segmentation) of pixels into foreground pixels (those belonging
More informationA Method of Automated Landmark Generation for Automated 3D PDM Construction
A Method of Automated Landmark Generation for Automated 3D PDM Construction A. D. Brett and C. J. Taylor Department of Medical Biophysics University of Manchester Manchester M13 9PT, Uk adb@sv1.smb.man.ac.uk
More informationImage processing and features
Image processing and features Gabriele Bleser gabriele.bleser@dfki.de Thanks to Harald Wuest, Folker Wientapper and Marc Pollefeys Introduction Previous lectures: geometry Pose estimation Epipolar geometry
More informationCS 664 Segmentation. Daniel Huttenlocher
CS 664 Segmentation Daniel Huttenlocher Grouping Perceptual Organization Structural relationships between tokens Parallelism, symmetry, alignment Similarity of token properties Often strong psychophysical
More informationMatching 3D Lung Surfaces with the Shape Context Approach. 1)
Matching 3D Lung Surfaces with the Shape Context Approach. 1) Martin Urschler, Horst Bischof Institute for Computer Graphics and Vision, TU Graz Inffeldgasse 16, A-8010 Graz E-Mail: {urschler, bischof}@icg.tu-graz.ac.at
More informationStereo Vision. MAN-522 Computer Vision
Stereo Vision MAN-522 Computer Vision What is the goal of stereo vision? The recovery of the 3D structure of a scene using two or more images of the 3D scene, each acquired from a different viewpoint in
More informationProcessing 3D Surface Data
Processing 3D Surface Data Computer Animation and Visualisation Lecture 17 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing
More informationStereo. Outline. Multiple views 3/29/2017. Thurs Mar 30 Kristen Grauman UT Austin. Multi-view geometry, matching, invariant features, stereo vision
Stereo Thurs Mar 30 Kristen Grauman UT Austin Outline Last time: Human stereopsis Epipolar geometry and the epipolar constraint Case example with parallel optical axes General case with calibrated cameras
More informationCS 4495 Computer Vision Motion and Optic Flow
CS 4495 Computer Vision Aaron Bobick School of Interactive Computing Administrivia PS4 is out, due Sunday Oct 27 th. All relevant lectures posted Details about Problem Set: You may *not* use built in Harris
More informationMotion Tracking and Event Understanding in Video Sequences
Motion Tracking and Event Understanding in Video Sequences Isaac Cohen Elaine Kang, Jinman Kang Institute for Robotics and Intelligent Systems University of Southern California Los Angeles, CA Objectives!
More informationAn Edge-Based Approach to Motion Detection*
An Edge-Based Approach to Motion Detection* Angel D. Sappa and Fadi Dornaika Computer Vison Center Edifici O Campus UAB 08193 Barcelona, Spain {sappa, dornaika}@cvc.uab.es Abstract. This paper presents
More informationProf. Fanny Ficuciello Robotics for Bioengineering Visual Servoing
Visual servoing vision allows a robotic system to obtain geometrical and qualitative information on the surrounding environment high level control motion planning (look-and-move visual grasping) low level
More informationIterative Estimation of 3D Transformations for Object Alignment
Iterative Estimation of 3D Transformations for Object Alignment Tao Wang and Anup Basu Department of Computing Science, Univ. of Alberta, Edmonton, AB T6G 2E8, Canada Abstract. An Iterative Estimation
More informationA Robust and Efficient Motion Segmentation Based on Orthogonal Projection Matrix of Shape Space
A Robust and Efficient Motion Segmentation Based on Orthogonal Projection Matrix of Shape Space Naoyuki ICHIMURA Electrotechnical Laboratory 1-1-4, Umezono, Tsukuba Ibaraki, 35-8568 Japan ichimura@etl.go.jp
More informationCOMPUTER ANALYSIS OF OBJECTS MOVEMENT IN IMAGE SEQUENCES: METHODS AND APPLICATIONS
COMPUTER ANALYSIS OF OBJECTS MOVEMENT IN IMAGE SEQUENCES: METHODS AND APPLICATIONS João Manuel R. S. Tavares, Fernando J. S. Carvalho, Francisco P. M. Oliveira, Ilda M. Sá Reis, Maria João M. Vasconcelos,
More informationImage Segmentation and Registration
Image Segmentation and Registration Dr. Christine Tanner (tanner@vision.ee.ethz.ch) Computer Vision Laboratory, ETH Zürich Dr. Verena Kaynig, Machine Learning Laboratory, ETH Zürich Outline Segmentation
More informationMotion Estimation. There are three main types (or applications) of motion estimation:
Members: D91922016 朱威達 R93922010 林聖凱 R93922044 謝俊瑋 Motion Estimation There are three main types (or applications) of motion estimation: Parametric motion (image alignment) The main idea of parametric motion
More informationA METHOD TO MODELIZE THE OVERALL STIFFNESS OF A BUILDING IN A STICK MODEL FITTED TO A 3D MODEL
A METHOD TO MODELIE THE OVERALL STIFFNESS OF A BUILDING IN A STICK MODEL FITTED TO A 3D MODEL Marc LEBELLE 1 SUMMARY The aseismic design of a building using the spectral analysis of a stick model presents
More informationPattern Recognition Methods for Object Boundary Detection
Pattern Recognition Methods for Object Boundary Detection Arnaldo J. Abrantesy and Jorge S. Marquesz yelectronic and Communication Engineering Instituto Superior Eng. de Lisboa R. Conselheiro Emídio Navarror
More informationPERFORMANCE CAPTURE FROM SPARSE MULTI-VIEW VIDEO
Stefan Krauß, Juliane Hüttl SE, SoSe 2011, HU-Berlin PERFORMANCE CAPTURE FROM SPARSE MULTI-VIEW VIDEO 1 Uses of Motion/Performance Capture movies games, virtual environments biomechanics, sports science,
More informationCar tracking in tunnels
Czech Pattern Recognition Workshop 2000, Tomáš Svoboda (Ed.) Peršlák, Czech Republic, February 2 4, 2000 Czech Pattern Recognition Society Car tracking in tunnels Roman Pflugfelder and Horst Bischof Pattern
More informationSurface Registration. Gianpaolo Palma
Surface Registration Gianpaolo Palma The problem 3D scanning generates multiple range images Each contain 3D points for different parts of the model in the local coordinates of the scanner Find a rigid
More informationOutline 7/2/201011/6/
Outline Pattern recognition in computer vision Background on the development of SIFT SIFT algorithm and some of its variations Computational considerations (SURF) Potential improvement Summary 01 2 Pattern
More informationTopics to be Covered in the Rest of the Semester. CSci 4968 and 6270 Computational Vision Lecture 15 Overview of Remainder of the Semester
Topics to be Covered in the Rest of the Semester CSci 4968 and 6270 Computational Vision Lecture 15 Overview of Remainder of the Semester Charles Stewart Department of Computer Science Rensselaer Polytechnic
More informationRecognition of Non-symmetric Faces Using Principal Component Analysis
Recognition of Non-symmetric Faces Using Principal Component Analysis N. Krishnan Centre for Information Technology & Engineering Manonmaniam Sundaranar University, Tirunelveli-627012, India Krishnan17563@yahoo.com
More informationFeature Tracking and Optical Flow
Feature Tracking and Optical Flow Prof. D. Stricker Doz. G. Bleser Many slides adapted from James Hays, Derek Hoeim, Lana Lazebnik, Silvio Saverse, who 1 in turn adapted slides from Steve Seitz, Rick Szeliski,
More informationThe Insight Toolkit. Image Registration Algorithms & Frameworks
The Insight Toolkit Image Registration Algorithms & Frameworks Registration in ITK Image Registration Framework Multi Resolution Registration Framework Components PDE Based Registration FEM Based Registration
More informationStereo and Epipolar geometry
Previously Image Primitives (feature points, lines, contours) Today: Stereo and Epipolar geometry How to match primitives between two (multiple) views) Goals: 3D reconstruction, recognition Jana Kosecka
More informationA Statistical Consistency Check for the Space Carving Algorithm.
A Statistical Consistency Check for the Space Carving Algorithm. A. Broadhurst and R. Cipolla Dept. of Engineering, Univ. of Cambridge, Cambridge, CB2 1PZ aeb29 cipolla @eng.cam.ac.uk Abstract This paper
More informationAn Improved Management Model for Tracking Multiple Features in Long Image Sequences
An Improved Management Model for Tracking Multiple Features in Long Image Sequences RAQUEL R. PINHO 1, JOÃO MANUEL R. S. TAVARES 2, MIGUEL V. CORREIA 3 1 FEUP - Faculdade de Engenharia da Universidade
More informationBroad field that includes low-level operations as well as complex high-level algorithms
Image processing About Broad field that includes low-level operations as well as complex high-level algorithms Low-level image processing Computer vision Computational photography Several procedures and
More informationLecture 7: Segmentation. Thursday, Sept 20
Lecture 7: Segmentation Thursday, Sept 20 Outline Why segmentation? Gestalt properties, fun illusions and/or revealing examples Clustering Hierarchical K-means Mean Shift Graph-theoretic Normalized cuts
More informationELEC Dr Reji Mathew Electrical Engineering UNSW
ELEC 4622 Dr Reji Mathew Electrical Engineering UNSW Review of Motion Modelling and Estimation Introduction to Motion Modelling & Estimation Forward Motion Backward Motion Block Motion Estimation Motion
More informationFusion of 3D B-spline surface patches reconstructed from image sequences
Fusion of 3D B-spline surface patches reconstructed from image sequences Roger Mohr ChangSheng Zhao Gautier Koscielny LFA-NR A 46 Avenue FBlix Viallet 38031 Grenoble cedex France Abstract This paper considers
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 14 130307 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Stereo Dense Motion Estimation Translational
More informationCalibration of bi-planar radiography with minimal phantoms
Calibration of bi-planar radiography with minimal phantoms INEB - Instituto de Engenharia Biomédica Daniel Moura, Jorge Barbosa, João Tavares, Ana Reis INEB Instituto de Engenharia Biomédica, Laboratório
More informationImage Segmentation Using Wavelets
International Journal of Scientific & Engineering Research Volume 3, Issue 12, December-2012 1 Image Segmentation Using Wavelets Ratinder Kaur, V. K. Banga, Vipul Sharma Abstract-In our proposed technique
More informationUsing temporal seeding to constrain the disparity search range in stereo matching
Using temporal seeding to constrain the disparity search range in stereo matching Thulani Ndhlovu Mobile Intelligent Autonomous Systems CSIR South Africa Email: tndhlovu@csir.co.za Fred Nicolls Department
More informationCS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching
Stereo Matching Fundamental matrix Let p be a point in left image, p in right image l l Epipolar relation p maps to epipolar line l p maps to epipolar line l p p Epipolar mapping described by a 3x3 matrix
More information1 Introduction Estimating feature correspondences between two or more images is a long standing fundamental problem in Computer Vision. Most methods f
Robust Point Correspondence by Concave Minimization Jo~ao Maciel Λ and Jo~ao Costeira Instituto de Sistemas e Robótica Instituto Superior Técnico Av. Rovisco Pais, 1049-001 Lisboa, PORTUGAL Abstract We
More informationRuch (Motion) Rozpoznawanie Obrazów Krzysztof Krawiec Instytut Informatyki, Politechnika Poznańska. Krzysztof Krawiec IDSS
Ruch (Motion) Rozpoznawanie Obrazów Krzysztof Krawiec Instytut Informatyki, Politechnika Poznańska 1 Krzysztof Krawiec IDSS 2 The importance of visual motion Adds entirely new (temporal) dimension to visual
More informationMulti-stable Perception. Necker Cube
Multi-stable Perception Necker Cube Spinning dancer illusion, Nobuyuki Kayahara Multiple view geometry Stereo vision Epipolar geometry Lowe Hartley and Zisserman Depth map extraction Essential matrix
More informationImage Segmentation. Segmentation is the process of partitioning an image into regions
Image Segmentation Segmentation is the process of partitioning an image into regions region: group of connected pixels with similar properties properties: gray levels, colors, textures, motion characteristics
More informationStructure from Motion. Introduction to Computer Vision CSE 152 Lecture 10
Structure from Motion CSE 152 Lecture 10 Announcements Homework 3 is due May 9, 11:59 PM Reading: Chapter 8: Structure from Motion Optional: Multiple View Geometry in Computer Vision, 2nd edition, Hartley
More informationAnalysis of Image and Video Using Color, Texture and Shape Features for Object Identification
IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 16, Issue 6, Ver. VI (Nov Dec. 2014), PP 29-33 Analysis of Image and Video Using Color, Texture and Shape Features
More informationCorner Detection. Harvey Rhody Chester F. Carlson Center for Imaging Science Rochester Institute of Technology
Corner Detection Harvey Rhody Chester F. Carlson Center for Imaging Science Rochester Institute of Technology rhody@cis.rit.edu April 11, 2006 Abstract Corners and edges are two of the most important geometrical
More informationCurvature Estimation on Smoothed 3-D Meshes
Curvature Estimation on Smoothed 3-D Meshes Peter Yuen, Nasser Khalili and Farzin Mokhtarian Centre for Vision, Speech and Signal Processing School of Electronic Engineering, Information Technology and
More informationClassification and Generation of 3D Discrete Curves
Applied Mathematical Sciences, Vol. 1, 2007, no. 57, 2805-2825 Classification and Generation of 3D Discrete Curves Ernesto Bribiesca Departamento de Ciencias de la Computación Instituto de Investigaciones
More informationMotion Estimation for Video Coding Standards
Motion Estimation for Video Coding Standards Prof. Ja-Ling Wu Department of Computer Science and Information Engineering National Taiwan University Introduction of Motion Estimation The goal of video compression
More informationCS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching
Stereo Matching Fundamental matrix Let p be a point in left image, p in right image l l Epipolar relation p maps to epipolar line l p maps to epipolar line l p p Epipolar mapping described by a 3x3 matrix
More informationMicro-scale Stereo Photogrammetry of Skin Lesions for Depth and Colour Classification
Micro-scale Stereo Photogrammetry of Skin Lesions for Depth and Colour Classification Tim Lukins Institute of Perception, Action and Behaviour 1 Introduction The classification of melanoma has traditionally
More information1314. Estimation of mode shapes expanded from incomplete measurements
34. Estimation of mode shapes expanded from incomplete measurements Sang-Kyu Rim, Hee-Chang Eun, Eun-Taik Lee 3 Department of Architectural Engineering, Kangwon National University, Samcheok, Korea Corresponding
More informationCombinatorial optimization and its applications in image Processing. Filip Malmberg
Combinatorial optimization and its applications in image Processing Filip Malmberg Part 1: Optimization in image processing Optimization in image processing Many image processing problems can be formulated
More informationSIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014
SIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014 SIFT SIFT: Scale Invariant Feature Transform; transform image
More informationFinite Element Analysis Prof. Dr. B. N. Rao Department of Civil Engineering Indian Institute of Technology, Madras. Lecture - 36
Finite Element Analysis Prof. Dr. B. N. Rao Department of Civil Engineering Indian Institute of Technology, Madras Lecture - 36 In last class, we have derived element equations for two d elasticity problems
More informationA Finite Element Method for Deformable Models
A Finite Element Method for Deformable Models Persephoni Karaolani, G.D. Sullivan, K.D. Baker & M.J. Baines Intelligent Systems Group, Department of Computer Science University of Reading, RG6 2AX, UK,
More informationMulti-Scale Free-Form Surface Description
Multi-Scale Free-Form Surface Description Farzin Mokhtarian, Nasser Khalili and Peter Yuen Centre for Vision Speech and Signal Processing Dept. of Electronic and Electrical Engineering University of Surrey,
More informationNormalized cuts and image segmentation
Normalized cuts and image segmentation Department of EE University of Washington Yeping Su Xiaodan Song Normalized Cuts and Image Segmentation, IEEE Trans. PAMI, August 2000 5/20/2003 1 Outline 1. Image
More informationDigital Image Processing
Digital Image Processing Third Edition Rafael C. Gonzalez University of Tennessee Richard E. Woods MedData Interactive PEARSON Prentice Hall Pearson Education International Contents Preface xv Acknowledgments
More informationCOMP 558 lecture 22 Dec. 1, 2010
Binocular correspondence problem Last class we discussed how to remap the pixels of two images so that corresponding points are in the same row. This is done by computing the fundamental matrix, defining
More informationStereo Vision II: Dense Stereo Matching
Stereo Vision II: Dense Stereo Matching Nassir Navab Slides prepared by Christian Unger Outline. Hardware. Challenges. Taxonomy of Stereo Matching. Analysis of Different Problems. Practical Considerations.
More informationImage Processing, Analysis and Machine Vision
Image Processing, Analysis and Machine Vision Milan Sonka PhD University of Iowa Iowa City, USA Vaclav Hlavac PhD Czech Technical University Prague, Czech Republic and Roger Boyle DPhil, MBCS, CEng University
More information[ Ω 1 ] Diagonal matrix of system 2 (updated) eigenvalues [ Φ 1 ] System 1 modal matrix [ Φ 2 ] System 2 (updated) modal matrix Φ fb
Proceedings of the IMAC-XXVIII February 1 4, 2010, Jacksonville, Florida USA 2010 Society for Experimental Mechanics Inc. Modal Test Data Adjustment For Interface Compliance Ryan E. Tuttle, Member of the
More informationLS-DYNA s Linear Solver Development Phase 2: Linear Solution Sequence
LS-DYNA s Linear Solver Development Phase 2: Linear Solution Sequence Allen T. Li 1, Zhe Cui 2, Yun Huang 2 1 Ford Motor Company 2 Livermore Software Technology Corporation Abstract This paper continues
More informationEdge and corner detection
Edge and corner detection Prof. Stricker Doz. G. Bleser Computer Vision: Object and People Tracking Goals Where is the information in an image? How is an object characterized? How can I find measurements
More informationA Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields
A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields Lars König, Till Kipshagen and Jan Rühaak Fraunhofer MEVIS Project Group Image Registration,
More information3D VISUALIZATION OF SEGMENTED CRUCIATE LIGAMENTS 1. INTRODUCTION
JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 10/006, ISSN 164-6037 Paweł BADURA * cruciate ligament, segmentation, fuzzy connectedness,3d visualization 3D VISUALIZATION OF SEGMENTED CRUCIATE LIGAMENTS
More information