Coupled Bayesian Framework for Dual Energy Image Registration

Size: px
Start display at page:

Download "Coupled Bayesian Framework for Dual Energy Image Registration"

Transcription

1 in Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Vol. 2, pp , 2006 Coupled Bayesian Framework for Dual Energy Image Registration Hao Wu University of Maryland College Park, MD wh2003 AT cfar.umd.edu Yunqiang Chen and Tong Fang Siemens Corporate Research 755 College Rd E, Princeton, NJ {yunqiang.chen, tong.fang} AT siemens.com Abstract Image registration for X-ray dual energy imaging is challenging due to the overlaid transparent layers (i.e., the bone and soft tissue) and the different appearances between the dual images acquired with X-rays at different energy spectra. Moreover, subpixel accuracy is necessary for good reconstruction of the bone and soft-tissue layers. This paper addresses these problems with a novel coupled Bayesian framework, in which the registration and reconstruction can effectively reinforce each other. With the reconstruction results, we can design accurate matching criteria for aligning the dual images, instead of treating them as multi-modality registration. Furthermore, prior knowledge of the bone and soft tissue can be exploited to detect poor reconstruction due to inaccurate registration; and hence correct registration errors in the coupled framework. A multiscale freeform registration algorithm is implemented to achieve subpixel registration accuracy. Promising results are obtained in the experiments. 1. Introduction Image registration finds various applications in computer vision and medical imaging. Different registration methods have been developed for rigid or non-rigid deformations [7, 8, 4, 1]. Some recent research exts image registration to fuse images from different modalities [14, 6, 10, 16]. However, it remains a challenging task to achieve robust and accurate registration in X-ray dual energy imaging. Dual images obtained with X-rays at different energy spectra have different appearances, which complicates the designing of appropriate similarity measurements for image alignment. Mutual information has been proposed for multimodality image registration [7, 8, 4, 1], but it is difficult to meet the subpixel-accuracy requirement for good reconstruction of the bone and soft-tissue layers the final goal of the dual energy imaging. In this paper we propose a coupled Bayesian method based on the image formation model of dual energy imaging to solve image registration and reconstruction jointly. Dual energy imaging is designed to improve conventional chest radiography, which suffers from low sensitivity for detecting lung nodules or other subtle details due to the overlap of bone structures and soft tissue. Dual energy imaging is designed to separate the bone and soft tissue from two X-ray images acquired at different energy spectra. Since the attenuation coefficients of bone and soft tissue follow different functions of the energy, the dual images can be weighted and subtracted to acquire the separated soft tissue specific and bone specific images, thereby allowing better evaluations of the lung nodules or pleural calcification [15]. Image registration is a key component in the dualexposure method, which performs the image acquisition procedure at two different kv(p) levels in two exposures and provides better image quality than the one-shot method [12]. The time gap between the two exposures can be about ms, during which patient or anatomical motions may result in motion artifacts in the weighted subtraction. It is necessary to align the two images before subtraction. The dual images are overlays of two layers (i.e., the bone B and soft tissue S). The image formation model is: I 1 = a B + b S I 2 = c T (B) + d T (S) where a, b, c, and d are known constants reflecting the attenuation coefficients of the bone and soft tissue to the X-ray at different spectra. Based on the two observed images I 1 and I 2, we need to reconstruct the bone B and the soft tissue S as well as the non-rigid motion T. For the simplest case, where there is no motion between the dual images, the bone and soft tissue can be easily obtained through weighted subtraction of I 1 and I 2 : B = (d I 1 b I 2 )/(a d b c) S = (a I 2 c I 1 )/(a d b c) In traditional dual energy imaging, image registration is a preprocessing step to align I 1 and I 2, followed by the weighted subtraction in Eq. (2). However, there are several problems in that scheme: (1) (2)

2 The images I 1 and I 2 have different appearances due to different attenuation coefficients. No simple similarity measurement can be designed to guide the registration process. Cross-correlation or mutual information [5] might be used, but they assume only very general depencies between the two images and neglect the image formation model in Eq. (1). It is more difficult to achieve robust registration with high accuracy. Reconstruction of bone B and soft tissue S is highly depent on the accuracy of the non-rigid registration. From Eq. (2), we can see that any registration error will be amplified by 1/(a d b c), which could be very large when the ratio of the coefficients (a/c and b/d) are similar. Our experiments show that subpixel accuracy is necessary for good reconstruction. The subtraction procedure in Eq. (2) assumes perfectly aligned dual images. No registration error can be corrected in this step. Also, the subtraction does not utilize any prior knowledge of the bone and soft tissue (e.g., smoothness constraint and edge modeling), which have been very helpful in image restoration. In this paper, we propose a coupled Bayesian framework to register the dual images and reconstruct the bone and soft-tissue layers jointly. In the coupled framework, the two processes reinforce each other and can achieve more robust and accurate results. First, with explicit modeling of the bone and soft tissue, we can design accurate similarity measurements for the registration process instead of treating the dual images as if from different modalities and rely on more difficult multi-modality registration techniques. Second, prior knowledge and constraints of the bone and soft tissue can be easily integrated to check the validity of the reconstruction results. Most important, registration error that causes invalid reconstruction (e.g. highly correlated bone and soft-tissue layers) can be detected and minimized in the coupled framework. To achieve subpixel accuracy in nonrigid registration, we design a hierarchical free-form registration algorithm with successive accuracy adjustment. The organization of this paper is as follows. In section 2 we first formulate the dual energy imaging problem with a coupled Bayesian framework. In section 3, hierarchical free-form non-rigid registration algorithm is presented to achieve sub-pixel accuracy. Promising experimental results and conclusions are given in sections 4 and 5, respectively. 2. Coupled Bayesian Framework for Registration and Reconstruction 2.1. Traditional Bayesian Framework Image registration is an ill-posed problem, in the sense that it is usually under-determined and there may be many possible solutions. The problem becomes even more complicated for non-rigid registration. Prior knowledge/constraints of the imaging process and possible deformation are necessary for robust and accurate registration methods. A Bayesian framework provides a natural way to incorporate various constraints based on prior knowledge [2, 16]. The objective of image registration is to find the most probable deformation T which maximizes the posterior probability P (T I 1, I 2 ). From Bayesian rule, we have: P (T I 1, I 2 ) = P (I 1, I 2 T )P (T ) P (I 1, I 2 ) where P (I 1, I 2 ) is a constant term with respect to T. Therefore, the maximum a posterior (MAP) solution to the registration problem can be obtained as follows: T = arg max T log P (I 1, I 2 T ) + log P (T ) where P (I 1, I 2 T ) defines the similarity measurement to judge how well the deformation T aligns the two images. For example, sum of squared difference (SSD) is used for single modality and mutual information term is widely used for multimodality images. P (T ) represents the prior knowledge of the deformation field T, e.g. smoothness. Dual energy imaging is usually done in two steps. First, the dual images are registered by a multimodality registration method. Then, a weighted subtraction in Eq. (2) is used to reconstruct the underlying bone and soft-tissue layers. We can see that this is not an optimal solution. The final goal of dual energy imaging is to reconstruct the bone and soft-tissue layers. The subtraction procedure assumes no error in the registration. It tries to reconstruct B and S to literally match every pixel of I 1 and I 2 based on T. A unique solution of B and S can always be found, no matter how poorly T is estimated, and there is no scheme to correct the registration error when the reconstruction is not good. Combining registration and reconstruction is necessary to form a closed loop to adjust the registration result if the reconstructed bone and soft-tissue layers are poor (e.g., highly depent). Furthermore, without knowing the bone and soft-tissue layers, it is very difficult to define a similarity measurement P (I 1, I 2 T ), because the images are generated with X-rays at different energy spectra and have different intensity values even without deformation. It is possible to treat the dual images as if they are from different modalities and to design the similarity measurement based on mutual information or cross correlation. Those measurements neglect the image formation model in Eq. (1) and assume only very general depencies in the dual images. Hence, they are more susceptible to false matching when dealing with spatial variant bone and soft-tissue layers.

3 by: Figure 1. Dual Energy Image Formation Model It is obvious that registration and reconstruction can be better addressed jointly. A related idea is proposed in [13], where registration and segmentation are solved jointly by coupled partial differential equations. Segmentation is represented by a level-set function to separate the image into exclusive parts. In our case, the bone and soft-tissue layers are transparent and overlaid together to generate the acquired images. Hence, we need to model the underlying bone and soft-tissue layers with two extra appearance templates and handle the layer reconstruction and the registration jointly Coupled Registration and Reconstruction As we have pointed out, the composition characteristics of dual energy imaging make it very challenging for traditional methods. We propose a new method based on the image formation model of the dual imaging process, which leads naturally to a coupled framework integrating registration and reconstruction together. The dual images are generated according to Eq. (1) and can be illustrated by Fig. 1. It becomes clear that all the difficulties arise from the fact that the bone B and soft tissue S cannot be observed directly. Instead they are overlaid with different coefficients to form images with different appearances. Considering the hidden variables B and S jointly during the registration process, we can formulate the dual energy image registration as follows: P (T, B, S I 1, I 2 ) = P (I 1, I 2 T, B, S)P (T, B, S) P (I 1, I 2 ) With the assumption that T, B and S are mutually indepent, the MAP solution to this problem can be obtained (3) T = arg max log P (I 1, I 2 T, B, S)+log[P (T )P (B)P (S)] T,B,S (4) This MAP solution leads naturally to the conclusion that the registration and reconstruction are to be solved jointly. The deformation T, the bone B and the soft tissue S should be updated together to match the acquired dual images I 1 and I 2. The prior knowledge about the deformation and the appearance of the layers (i.e., P (T ), P (B) and P (S)) can be easily integrated to refine the reconstruction. For example, P (B) and P (S) can model the smoothness constraint with edge modeling and P (T ) can regularize the smoothness of the deformation field. Unlike the traditional subtraction method, if the reconstructed B and S do not satisfy the prior knowledge due to registration error, T will also be updated and corrected to achieve the optimal solution. Furthermore, by introducing bone and soft-tissue layers explicitly, the similarity measurement P (I 1, I 2 T, B, S) can be easily derived. We do not have to rely on the mutual information or cross correlation to judge the matching of the dual images even though they have different appearances. Assuming the imaging noise is zero mean Gaussian, a good estimation of B, S and T should allow us to synthesize the dual images and therefore minimize the following cost function: log P (I 1, I 2 T, B, S) I 1 a B b S 2 + I 2 c T (B) d T (S) 2 This is more accurate matching criteria than mutual information or cross correlation and less susceptible to false matching, and hence allows more robust registration with sub-pixel accuracy. It can be seen that, in the proposed coupled Bayesian framework, the registration and reconstruction reinforce each other and can provide better results than traditional schemes. In the following subsections, we explain the prior knowledge and constraints we enforce and a detailed implementation of the proposed registration method Enforcing Prior Knowledge and Constraints Based on the proposed coupled Bayesian framework, we can easily enforce various prior knowledge or constraints into this optimization scheme and can guarantee a more stable and physically meaningful registration and reconstruction result. In our experiments, we make the following assumptions and constraints which are generally true in dual energy imaging: The deformation between the dual images (e.g., patient aspiration) can be modeled by a non-rigid dense deformation field T. We assume that the deformation field

4 is smooth across the image. With this assumption, we can choose the P (T ) in Eq. (4) as: log P (T ) T T 2 where T is the average deformation within the neighborhood (i.e., the low-pass filtered version of T ). The bone and soft-tissue layers should satisfy the smoothness constraint with edge modeling. Let e be the edge map, where e(p) = 1 means the corresponding pixel p is an edge point and the smoothness constraint should be suppressed. To prevent all the pixels from being classified as edge points, λ e is used to penalize the edge points. Then we have: log P (B) ((1 e) B B 2 + λ e e) log P (S) ((1 e ) S S 2 + λ ee ) where B and S are the average bone and soft tissue within the neighborhood. Registration error is a major factor in poor reconstruction. In the coupled framework, it is possible to correct the misalignment that causes significant reconstruction error. Usually, misaligned dual images cannot cancel out the bone or soft-tissue and cause highly correlated artifacts in reconstructed bone and soft-tissue layers. Hence, indepent analysis between the bone and soft tissue can help detect and correct the registration error. As pointed out in [3], Bayesian frameworks alone cannot guarantee the indepence constraint even though the indepence is used to factorize the joint probabilities. We should explicitly enforce the indepence by minimizing mutual information MI(B, S). Using λ i to control the weighting of each constraint, the complete objective function, C, to be minimized can be derived as follows: C = I 1 a B b S 2 + I 2 c T (B) d T (S) 2 + λ 1 ((1 e) B B 2 + λ e e + (1 e ) S S 2 + λ ee ) + λ 2 T T 2 + λ 3 MI(B, S) (5) 2.4. Optimization The previous cost function is optimized using a variational approach in an iterative manner. To initialize the algorithm, we do a rough registration based on Harris corner detection on the dual images. Correspondence is found based on the cross correlation in the neighborhood around the detected corners. Then the initial deformation of each pixel is approximated by the weighted average of the nearest four corners. Based on this deformation field, we can also generate the initial reconstruction of the bone and soft tissue, using the weighted subtraction in Eq. (2). We first fix the T and try to optimize the B and S. For each pixel, we search within a search range B k+1 = B k + δ 1 and S k+1 = S k + δ 2 to find the B k+1 and S k+1 that minimize the cost function in Eq. (5). We then fix the B and S and try to optimize the deformation field T. We adopt a free-form deformation model that is controlled by regularly distributed control points (i.e., rectangular grids). Hierarchical searching strategy is used to optimize the deformation model to achieve sub-pixel accuracy successively as explained in next section in detail. This optimization strategy is described as following algorithm: Algorithm 1: Optimization Scheme Data: Given Dual Energy images I 1, I 2. Result: Reconstructed Deformation Field T, bone layer B and soft-tissue layer S. Use some traditional geometric based registration algorithm followed by simple subtraction process to get T 0, B 0, S 0. while stop do Fix T k, find the B k+1, S k+1 for each pixel p do In a search range m δ 1 m, n δ 2 n, for each pixel p, each term in Eq. (5) is computed corresponding to Bp k + δ 1, Sp k + δ 2 to find the optimal δ opt 1 and δ opt 2. Update: Bp k+1 = Bp k + δ opt 1 ; = Sp k + δ opt S k+1 p 2 ; If B k+1 B k 2 ε B and S k+1 S k 2 ε S stop. Otherwise, continue. Fix B k+1, S k+1, find T k+1 to optimize the cost function in Eq. (5) using the hierarchical searching strategy described in section 3 and Algorithm 2. If T k+1 T k 2 ε T, stop. Otherwise, continue. In the above optimization scheme, the mutual information is computationally very expensive. We adopt the approximation described in [3], which approximate the entropy term, e.g. H(X) = p(x) log p(x) by Taylor expansion: x log x = x 0 + (1 + log x 0 )x + O(x x 0 ) 2 where the entropy and joint entropy can be approximated

5 Figure 2. Rectangular free-form deformation model and Gaussian pyramid structures for fast and stable registration by a summation within a neighborhood and hence can be calculated efficiently. For more details, refer to [3]. 3. Sub-pixel Free-form Non-rigid Registration In the previous section, we defined the objective function in Eq. (5) and the iterative optimization scheme in Algorithm 1. For each iteration, based on the refined bone B k and soft tissue S k from the previous iteration, we can further refine the registration result T k+1. The algorithm is detailed in this section. A non-rigid registration algorithm for Digital Subtraction Angiography based on geometric features matching is proposed in [9]. Geometric feature points are extracted and matched, based on which triangle meshes are built to define the deformation model. However, the geometric features are depent on the image content and may not be dense enough and accurate enough for dual energy image registration. We take a similar approach to [11], where a region-based free-form registration algorithm is used to register breast MR images. Regularly distributed control points are used to control the deformation of images for the alignment. It can utilize all the information in the image, rather than being based on the sparse feature points. Instead of using cubic B-splines to interpolate the control points, we use rectangularly spaced control points to control the free-form deformation (FFD), which has better localization and less computation. The performance is almost the same when the control points are dense enough. A Gaussian Pyramid structure is used for the hierarchical searching strategy in our algorithm to improve the speed and stability of the optimization procedure. Figure 2 illustrates our deformation model and the hierarchical optimization strategy. The registration is refined in a coarse-to-fine manner. When the optimal solution for the coarse level is reached, we double the density of the control points and map it to the next finer level and further refine the control points based on the finer resolution image. This scheme converges faster and is less susceptible to local minima. For each layer, we deform the bone B and soft tissue S (i.e. c B + d S) to match the observed image I 2 by the control points. For each control point, we search within a local search region to map it to a new coordinate in image I 2 and update the matching cost between c B + d S and I 2 within the affected regions (each control point affects the four rectangular regions around it). For subpixel accuracy, the search step is set to be smaller than one pixel. In our experiments, we use 0.25 pixel as the search step when we reach the finest level. Suppose the control points on c B +d S are at (x 1, y 1 ), (x 2, y 2 ), (x 3, y 3 ), (x 4, y 4 ) and correspond to (x 1, y 1), (x 2, y 2), (x 3, y 3) and (x 4, y 4) in I 2 respectively. The pixel (x p, y p ) inside the grid on c B+d S will be map to (x p, y p) in I 2 based on bilinear interpolation as follows: where [x p, y p] T = (1 b) V 1 T + b V 2 T a = (y p y 1 )/(y 2 y 1 ), b = (x p x 1 )/(x 3 x 1 ) [ ] [ ] x V 1 = [1 a, a] 1 y 1 x 2 y 2, V x 2 = [1 a, a] 3 y 3 x 4 y 4 There are other ways to find the coordinate mapping, such as Homography matrix transformation. From our experiments, we find bilinear geometric interpolation is stable and accurate compared to other transformation methods and more computationally efficient. Given pixel correspondence, we can easily compute the cost function I 2 c T (B) d T (S) 2 + λ 2 T T 2 and find the control mesh that minimizes the cost function. The searching strategy for finding the optimal deformation model T is given in Algorithm 2: 4. Experiments The proposed algorithm is applied to the X-ray dual energy chest imaging. Experiments and comparisons on both real images and synthesized images show the improvement of the proposed coupled registration method on registration accuracy and the reconstruction results. For comparison, we also implemented a separated method, which registers the dual images first and then uses weighted subtraction to reconstruct the bone and soft-tissue layers. To register the dual images, maximization of mutual information is used to guide the registration [5]. The non-parametric density estimation technique for calculating the joint entropy between the dual images can, to some extent, handle the non-stationary mapping function between the dual images. We replace our cost function in Eq. (5)

6 Algorithm 2: Hierarchical free-form non-rigid registration In the Gaussian Pyramid, from coarse level 0 to fine level N, do the following: while k N do while stop do Update deformation M i+1 k (x, y) for kth level for each control point Mk i (x, y) do Searching in its neighborhood to find the optimal control mesh that minimizes the matching cost. Update M i+1 k (x, y) to the optimal position; If M i+1 k Mk i 2 ε k, stop. increase the density of control points to generate the initial Mk+1 0 i+1 (x, y), map Mk (x, y) to (x, y); M 0 k+1 increase k to k + 1 and reset i to 0; Figure 3. X-ray dual energy chest imaging by maximizing the mutual information between dual images and apply the same hierarchical free-form registration method to align the dual images. Based on the registration results, weighted subtraction is performed to separate the bone and soft-tissue layers. Fig. 3 shows the dual images for chest imaging. There are both bone and soft-tissue structures overlaid in the images, which makes detecting lung nodules or other subtle details more difficult. Reconstruction of the bone and soft tissue specific images can greatly increase its diagnostic value. Accurate registration is necessary for good reconstruction of the bone and soft tissue. Otherwise, the image difference caused by registration error can easily become much more significant than the different characteristics of the bone and soft tissue. Now we compare the separated method with our coupled method. In the separated method, maximization of the mutual information handles the different appearances between the dual images reasonably well. But when the bone and soft tissue both have complex structures overlaid together, it is very difficult to estimate the mapping function robustly and accurately. Also, there is no scheme to refine the registration, even if the reconstruction results do not satisfy our prior knowledge in the separated scheme. The reconstruction results of the separated method are shown in Fig. 4 (a) and (b). There are some noticeable artifacts when bone edges and soft-tissue structures are overlaid together. The coupled method provides much better results in Fig. 4 (c) and (d). It can be seen that the reconstructed results are much smoother and cleaner. To compare the results quantitatively, we also do some tests with synthesized motion so that we have ground truth for accurate error analysis. We select the previous reconstructed bone and soft tissue as ground truth to generate a pair of synthesized images. A transformation field that expands the lung region is applied to simulate an aspiration motion. Quantitative results and comparisons between the separated method and our coupled method are summarized in the following tables. First we compare the registration accuracy. The estimated deformation field T is compared with the ground truth (the synthesized motion). The average and maximum absolute registration error (in pixels) is listed as follows: Error in T Average Max Variance Separated Method Coupled Method It can be seen that the separated registration method achieves reasonably good results with maximum registration error of only pixels. However, the proposed coupled framework further improves the registration accuracy and provides consistently better results throughout the image. The mean and the variance of the registration error are much smaller in the coupled method. We also compare the error in the reconstructed bone and soft-tissue layers. The absolute difference between the reconstructed results and the ground truth is normalized by the maximal intensity value of the bone and soft-tissue images. The errors in different methods are listed in the following table: Error in B Average Max Variance Separated Method e-4 Coupled Method e-4 Error in S Average Max Variance Separated Method e-4 Coupled Method e-5 It is clearly shown that our coupled method generates consistently better reconstruction results. In Fig. 5, comparison on another pair of dual images is shown. The coupled method provides better results on dif-

7 Figure 4. Comparison between the traditional separated registration method and our coupled method: (a) and (b) are the reconstructed bone and soft-tissue layers based on the traditional separated registration method. (c) and (d) are the results from our coupled method. ferent data set under different imaging conditions. 5. Conclusions In this paper, we propose a coupled Bayesian framework for registering dual energy images and reconstruction of the overlaid bone and soft-tissue layers jointly. It is a considerable improvement over the traditional separated scheme where multi-modality image registration is first applied and followed by a simple weighted subtraction to reconstruct the bone and soft tissue. More prior knowledge is included in the proposed framework and results in more stable and physically meaningful results. The proposed coupled algorithm could be more helpful for low-dose X-ray imaging to reduce radiation to the patients. In low-dose X-ray imaging, the signal/noise ratio drops significantly and causes severe challenges. We plan to look in that direction in the future. References [1] L. G. Brown. A survey of image registration techniques. ACM Computing Surveys (CSUR), ACM Press, 24(4): , [2] P. Cachier and N. Ayache. Regularization in image non-rigid registration: I. trade-off between smoothness and intensity similarity. technical report, INRIA, [3] Y. Chen, H. Wang, T. Fang, and J. Tyan. Mutual information regularized bayesian framework for multiple image restoration. In Proc. IEEE Int l Conf. on Computer Vision, volume 1, pages , [4] W. Crum, T. Hartkens, and D. Hill. Non-rigid image registration: theory and practice. British Journal of Radiology, 77: , [5] J. Kim, V. Kolmogorov, and R. Zabih. Visual correspondence using energy minimization and mutual information. In Proc. IEEE Int l Conf. on Computer Vision, 2003.

8 Figure 5. Comparison of another pair of dual images: (a) and (b) are the reconstruction results of the traditional separated method. (c) and (d) are the results from our coupled method. [6] F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens. Multimodality image registration by maximization of mutual information. Medical Imaging, IEEE Transactions on, 16(2): , April [7] J. B. A. Maintz and M. A. Viergever. A survey of medical image registration. Medical Image Analysis,Oxford University Press, 2(1):1 37, [8] C. R. Maurer and J. M. Fitzpatrick. A Review of Medical Image Registration. American Association of Neurological Surgeons, [9] E. H. W. Meijering, K. J. Zuiderveld, and M. A. Viergever. Image registration for digital subtraction angiography. International Journal of Computer Vision, 31(2/3): , April [10] J. Pluim, J. Maintz, and M. Viergever. Mutual-informationbased registration of medical images: a survey. Medical Imaging, IEEE Transactions on, 22(8): , Aug [11] D. Rueckert, L. Sonoda, C. Hayes, D. Hill, M. Leach, and D. Hawkes. Nonrigid registration using free-form deformations: application to breast mr images. Medical Imaging, IEEE Transactions on, 18(8): , Aug [12] C. C. Shaw and D. Gur. Comparision of three different techniques for dual-energy subtraction imaging in digital radiography: A signal-to-noise analysis. In Medical Imaging VI: Instrumentation, Proc. SPIE, volume 1651, pages , [13] G. Unal and G. Slabaugh. Coupled PDEs for non-rigid registration and segmentation. In Proc. IEEE Int l Conf. on Comput. Vis. and Patt. Recog., pages , [14] W. M. Wells, P. Viola, H. Atsumi, S. Nakajima, and R. Kikinis. Multi-modal volume registration by maximization of mutual information. Medical Image Analysis, 1(1):35 51, [15] G. J. Whitman, L. T. Niklason, M. Pandit, L. C. Oliver, E. H. Atkins, O. Kinnard, A. H. Alexander, M. K. Weiss, K. Sunku, E. S. Schulze, and R. E. Greene. Dual-energy digital subtraction chest radiography: technical considerations. Current Problems in Diagnnostic Radiology, 31(2):48 62, Apr [16] J. Zhang and A. Rangarajan. Bayesian multimodality non-rigid image registration via conditional density estimation. Information Processing in Medical Imaging (IPMI), Springer LNCS 2732: , 2003.

Nonrigid Registration using Free-Form Deformations

Nonrigid Registration using Free-Form Deformations Nonrigid Registration using Free-Form Deformations Hongchang Peng April 20th Paper Presented: Rueckert et al., TMI 1999: Nonrigid registration using freeform deformations: Application to breast MR images

More information

Fast Image Registration via Joint Gradient Maximization: Application to Multi-Modal Data

Fast Image Registration via Joint Gradient Maximization: Application to Multi-Modal Data MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Fast Image Registration via Joint Gradient Maximization: Application to Multi-Modal Data Xue Mei, Fatih Porikli TR-19 September Abstract We

More information

Multi-modal Image Registration Using the Generalized Survival Exponential Entropy

Multi-modal Image Registration Using the Generalized Survival Exponential Entropy Multi-modal Image Registration Using the Generalized Survival Exponential Entropy Shu Liao and Albert C.S. Chung Lo Kwee-Seong Medical Image Analysis Laboratory, Department of Computer Science and Engineering,

More information

A Pyramid Approach For Multimodality Image Registration Based On Mutual Information

A Pyramid Approach For Multimodality Image Registration Based On Mutual Information Pyramid pproach For Multimodality Image Registration ased On Mutual Information Hua-mei Chen Department of Electrical Engineering and Computer Science 121 Link Hall Syracuse University Syracuse, NY 13244

More information

Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information

Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information Andreas Biesdorf 1, Stefan Wörz 1, Hans-Jürgen Kaiser 2, Karl Rohr 1 1 University of Heidelberg, BIOQUANT, IPMB,

More information

Non-Rigid Multimodal Medical Image Registration using Optical Flow and Gradient Orientation

Non-Rigid Multimodal Medical Image Registration using Optical Flow and Gradient Orientation M. HEINRICH et al.: MULTIMODAL REGISTRATION USING GRADIENT ORIENTATION 1 Non-Rigid Multimodal Medical Image Registration using Optical Flow and Gradient Orientation Mattias P. Heinrich 1 mattias.heinrich@eng.ox.ac.uk

More information

Using K-means Clustering and MI for Non-rigid Registration of MRI and CT

Using K-means Clustering and MI for Non-rigid Registration of MRI and CT Using K-means Clustering and MI for Non-rigid Registration of MRI and CT Yixun Liu 1,2 and Nikos Chrisochoides 2 1 Department of Computer Science, College of William and Mary, enjoywm@cs.wm.edu 2 Department

More information

EE795: Computer Vision and Intelligent Systems

EE795: Computer Vision and Intelligent Systems EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 14 130307 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Stereo Dense Motion Estimation Translational

More information

Multi-Modal Volume Registration Using Joint Intensity Distributions

Multi-Modal Volume Registration Using Joint Intensity Distributions Multi-Modal Volume Registration Using Joint Intensity Distributions Michael E. Leventon and W. Eric L. Grimson Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA leventon@ai.mit.edu

More information

EE795: Computer Vision and Intelligent Systems

EE795: Computer Vision and Intelligent Systems EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 11 140311 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Motion Analysis Motivation Differential Motion Optical

More information

Bildverarbeitung für die Medizin 2007

Bildverarbeitung für die Medizin 2007 Bildverarbeitung für die Medizin 2007 Image Registration with Local Rigidity Constraints Jan Modersitzki Institute of Mathematics, University of Lübeck, Wallstraße 40, D-23560 Lübeck 1 Summary Registration

More information

A Radiometry Tolerant Method for Direct 3D/2D Registration of Computed Tomography Data to X-ray Images

A Radiometry Tolerant Method for Direct 3D/2D Registration of Computed Tomography Data to X-ray Images A Radiometry Tolerant Method for Direct 3D/2D Registration of Computed Tomography Data to X-ray Images Transfer Function Independent Registration Boris Peter Selby 1, Georgios Sakas 2, Stefan Walter 1,

More information

Image Registration with Local Rigidity Constraints

Image Registration with Local Rigidity Constraints Image Registration with Local Rigidity Constraints Jan Modersitzki Institute of Mathematics, University of Lübeck, Wallstraße 40, D-23560 Lübeck Email: modersitzki@math.uni-luebeck.de Abstract. Registration

More information

Matching. Compare region of image to region of image. Today, simplest kind of matching. Intensities similar.

Matching. Compare region of image to region of image. Today, simplest kind of matching. Intensities similar. Matching Compare region of image to region of image. We talked about this for stereo. Important for motion. Epipolar constraint unknown. But motion small. Recognition Find object in image. Recognize object.

More information

An Introduction to Statistical Methods of Medical Image Registration

An Introduction to Statistical Methods of Medical Image Registration his is page 1 Printer: Opaque this An Introduction to Statistical Methods of Medical Image Registration Lilla Zöllei, John Fisher, William Wells ABSRAC After defining the medical image registration problem,

More information

Deformable Registration Using Scale Space Keypoints

Deformable Registration Using Scale Space Keypoints Deformable Registration Using Scale Space Keypoints Mehdi Moradi a, Purang Abolmaesoumi a,b and Parvin Mousavi a a School of Computing, Queen s University, Kingston, Ontario, Canada K7L 3N6; b Department

More information

2D-3D Registration using Gradient-based MI for Image Guided Surgery Systems

2D-3D Registration using Gradient-based MI for Image Guided Surgery Systems 2D-3D Registration using Gradient-based MI for Image Guided Surgery Systems Yeny Yim 1*, Xuanyi Chen 1, Mike Wakid 1, Steve Bielamowicz 2, James Hahn 1 1 Department of Computer Science, The George Washington

More information

An Automated Image-based Method for Multi-Leaf Collimator Positioning Verification in Intensity Modulated Radiation Therapy

An Automated Image-based Method for Multi-Leaf Collimator Positioning Verification in Intensity Modulated Radiation Therapy An Automated Image-based Method for Multi-Leaf Collimator Positioning Verification in Intensity Modulated Radiation Therapy Chenyang Xu 1, Siemens Corporate Research, Inc., Princeton, NJ, USA Xiaolei Huang,

More information

Automatic Subthalamic Nucleus Targeting for Deep Brain Stimulation. A Validation Study

Automatic Subthalamic Nucleus Targeting for Deep Brain Stimulation. A Validation Study Automatic Subthalamic Nucleus Targeting for Deep Brain Stimulation. A Validation Study F. Javier Sánchez Castro a, Claudio Pollo a,b, Jean-Guy Villemure b, Jean-Philippe Thiran a a École Polytechnique

More information

Support Vector Machine Density Estimator as a Generalized Parzen Windows Estimator for Mutual Information Based Image Registration

Support Vector Machine Density Estimator as a Generalized Parzen Windows Estimator for Mutual Information Based Image Registration Support Vector Machine Density Estimator as a Generalized Parzen Windows Estimator for Mutual Information Based Image Registration Sudhakar Chelikani 1, Kailasnath Purushothaman 1, and James S. Duncan

More information

Local Image Registration: An Adaptive Filtering Framework

Local Image Registration: An Adaptive Filtering Framework Local Image Registration: An Adaptive Filtering Framework Gulcin Caner a,a.murattekalp a,b, Gaurav Sharma a and Wendi Heinzelman a a Electrical and Computer Engineering Dept.,University of Rochester, Rochester,

More information

Non-rigid Image Registration using Electric Current Flow

Non-rigid Image Registration using Electric Current Flow Non-rigid Image Registration using Electric Current Flow Shu Liao, Max W. K. Law and Albert C. S. Chung Lo Kwee-Seong Medical Image Analysis Laboratory, Department of Computer Science and Engineering,

More information

Image Segmentation and Registration

Image Segmentation and Registration Image Segmentation and Registration Dr. Christine Tanner (tanner@vision.ee.ethz.ch) Computer Vision Laboratory, ETH Zürich Dr. Verena Kaynig, Machine Learning Laboratory, ETH Zürich Outline Segmentation

More information

An Approach for Reduction of Rain Streaks from a Single Image

An Approach for Reduction of Rain Streaks from a Single Image An Approach for Reduction of Rain Streaks from a Single Image Vijayakumar Majjagi 1, Netravati U M 2 1 4 th Semester, M. Tech, Digital Electronics, Department of Electronics and Communication G M Institute

More information

Accurate 3D Face and Body Modeling from a Single Fixed Kinect

Accurate 3D Face and Body Modeling from a Single Fixed Kinect Accurate 3D Face and Body Modeling from a Single Fixed Kinect Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this

More information

Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC

Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC Shuji Sakai, Koichi Ito, Takafumi Aoki Graduate School of Information Sciences, Tohoku University, Sendai, 980 8579, Japan Email: sakai@aoki.ecei.tohoku.ac.jp

More information

Nonrigid Registration Using a Rigidity Constraint

Nonrigid Registration Using a Rigidity Constraint Nonrigid Registration Using a Rigidity Constraint Marius Staring, Stefan Klein and Josien P.W. Pluim Image Sciences Institute, University Medical Center Utrecht, P.O. Box 85500, 3508 GA, Room Q0S.459,

More information

Introduction to Image Super-resolution. Presenter: Kevin Su

Introduction to Image Super-resolution. Presenter: Kevin Su Introduction to Image Super-resolution Presenter: Kevin Su References 1. S.C. Park, M.K. Park, and M.G. KANG, Super-Resolution Image Reconstruction: A Technical Overview, IEEE Signal Processing Magazine,

More information

A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields

A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields Lars König, Till Kipshagen and Jan Rühaak Fraunhofer MEVIS Project Group Image Registration,

More information

Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System

Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System Simon Placht, Christian Schaller, Michael Balda, André Adelt, Christian Ulrich, Joachim Hornegger Pattern Recognition Lab,

More information

Detection & Classification of Lung Nodules Using multi resolution MTANN in Chest Radiography Images

Detection & Classification of Lung Nodules Using multi resolution MTANN in Chest Radiography Images The International Journal Of Engineering And Science (IJES) ISSN (e): 2319 1813 ISSN (p): 2319 1805 Pages 98-104 March - 2015 Detection & Classification of Lung Nodules Using multi resolution MTANN in

More information

DUAL energy X-ray radiography [1] can be used to separate

DUAL energy X-ray radiography [1] can be used to separate IEEE TRANSACTIONS ON NUCLEAR SCIENCE, VOL. 53, NO. 1, FEBRUARY 2006 133 A Scatter Correction Using Thickness Iteration in Dual-Energy Radiography S. K. Ahn, G. Cho, and H. Jeon Abstract In dual-energy

More information

SIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014

SIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014 SIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014 SIFT SIFT: Scale Invariant Feature Transform; transform image

More information

A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation

A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation , pp.162-167 http://dx.doi.org/10.14257/astl.2016.138.33 A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation Liqiang Hu, Chaofeng He Shijiazhuang Tiedao University,

More information

William Yang Group 14 Mentor: Dr. Rogerio Richa Visual Tracking of Surgical Tools in Retinal Surgery using Particle Filtering

William Yang Group 14 Mentor: Dr. Rogerio Richa Visual Tracking of Surgical Tools in Retinal Surgery using Particle Filtering Mutual Information Computation and Maximization Using GPU Yuping Lin and Gérard Medioni Computer Vision and Pattern Recognition Workshops (CVPR) Anchorage, AK, pp. 1-6, June 2008 Project Summary and Paper

More information

A 2D-3D Image Registration Algorithm using Log-Polar Transforms for Knee Kinematic Analysis

A 2D-3D Image Registration Algorithm using Log-Polar Transforms for Knee Kinematic Analysis A D-D Image Registration Algorithm using Log-Polar Transforms for Knee Kinematic Analysis Masuma Akter 1, Andrew J. Lambert 1, Mark R. Pickering 1, Jennie M. Scarvell and Paul N. Smith 1 School of Engineering

More information

Deformable Segmentation using Sparse Shape Representation. Shaoting Zhang

Deformable Segmentation using Sparse Shape Representation. Shaoting Zhang Deformable Segmentation using Sparse Shape Representation Shaoting Zhang Introduction Outline Our methods Segmentation framework Sparse shape representation Applications 2D lung localization in X-ray 3D

More information

Correspondence Detection Using Wavelet-Based Attribute Vectors

Correspondence Detection Using Wavelet-Based Attribute Vectors Correspondence Detection Using Wavelet-Based Attribute Vectors Zhong Xue, Dinggang Shen, and Christos Davatzikos Section of Biomedical Image Analysis, Department of Radiology University of Pennsylvania,

More information

Dense Image-based Motion Estimation Algorithms & Optical Flow

Dense Image-based Motion Estimation Algorithms & Optical Flow Dense mage-based Motion Estimation Algorithms & Optical Flow Video A video is a sequence of frames captured at different times The video data is a function of v time (t) v space (x,y) ntroduction to motion

More information

Fingerprint Mosaicking by Rolling with Sliding

Fingerprint Mosaicking by Rolling with Sliding Fingerprint Mosaicking by Rolling with Sliding Kyoungtaek Choi, Hunjae Park, Hee-seung Choi and Jaihie Kim Department of Electrical and Electronic Engineering,Yonsei University Biometrics Engineering Research

More information

Low-Dose Dual-Energy CT for PET Attenuation Correction with Statistical Sinogram Restoration

Low-Dose Dual-Energy CT for PET Attenuation Correction with Statistical Sinogram Restoration Low-Dose Dual-Energy CT for PET Attenuation Correction with Statistical Sinogram Restoration Joonki Noh, Jeffrey A. Fessler EECS Department, The University of Michigan Paul E. Kinahan Radiology Department,

More information

Multiple Motion and Occlusion Segmentation with a Multiphase Level Set Method

Multiple Motion and Occlusion Segmentation with a Multiphase Level Set Method Multiple Motion and Occlusion Segmentation with a Multiphase Level Set Method Yonggang Shi, Janusz Konrad, W. Clem Karl Department of Electrical and Computer Engineering Boston University, Boston, MA 02215

More information

Annales UMCS Informatica AI 1 (2003) UMCS. Registration of CT and MRI brain images. Karol Kuczyński, Paweł Mikołajczak

Annales UMCS Informatica AI 1 (2003) UMCS. Registration of CT and MRI brain images. Karol Kuczyński, Paweł Mikołajczak Annales Informatica AI 1 (2003) 149-156 Registration of CT and MRI brain images Karol Kuczyński, Paweł Mikołajczak Annales Informatica Lublin-Polonia Sectio AI http://www.annales.umcs.lublin.pl/ Laboratory

More information

A Generic Framework for Non-rigid Registration Based on Non-uniform Multi-level Free-Form Deformations

A Generic Framework for Non-rigid Registration Based on Non-uniform Multi-level Free-Form Deformations A Generic Framework for Non-rigid Registration Based on Non-uniform Multi-level Free-Form Deformations Julia A. Schnabel 1, Daniel Rueckert 2, Marcel Quist 3, Jane M. Blackall 1, Andy D. Castellano-Smith

More information

Distance Transforms in Multi Channel MR Image Registration

Distance Transforms in Multi Channel MR Image Registration Distance Transforms in Multi Channel MR Image Registration Min Chen 1, Aaron Carass 1, John Bogovic 1, Pierre-Louis Bazin 2 and Jerry L. Prince 1 1 Image Analysis and Communications Laboratory, 2 The Laboratory

More information

Peripheral drift illusion

Peripheral drift illusion Peripheral drift illusion Does it work on other animals? Computer Vision Motion and Optical Flow Many slides adapted from J. Hays, S. Seitz, R. Szeliski, M. Pollefeys, K. Grauman and others Video A video

More information

Intraoperative Prostate Tracking with Slice-to-Volume Registration in MR

Intraoperative Prostate Tracking with Slice-to-Volume Registration in MR Intraoperative Prostate Tracking with Slice-to-Volume Registration in MR Sean Gill a, Purang Abolmaesumi a,b, Siddharth Vikal a, Parvin Mousavi a and Gabor Fichtinger a,b,* (a) School of Computing, Queen

More information

2 Michael E. Leventon and Sarah F. F. Gibson a b c d Fig. 1. (a, b) Two MR scans of a person's knee. Both images have high resolution in-plane, but ha

2 Michael E. Leventon and Sarah F. F. Gibson a b c d Fig. 1. (a, b) Two MR scans of a person's knee. Both images have high resolution in-plane, but ha Model Generation from Multiple Volumes using Constrained Elastic SurfaceNets Michael E. Leventon and Sarah F. F. Gibson 1 MIT Artificial Intelligence Laboratory, Cambridge, MA 02139, USA leventon@ai.mit.edu

More information

Lesion Segmentation and Bias Correction in Breast Ultrasound B-mode Images Including Elastography Information

Lesion Segmentation and Bias Correction in Breast Ultrasound B-mode Images Including Elastography Information Lesion Segmentation and Bias Correction in Breast Ultrasound B-mode Images Including Elastography Information Gerard Pons a, Joan Martí a, Robert Martí a, Mariano Cabezas a, Andrew di Battista b, and J.

More information

Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences

Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences Jian Wang 1,2, Anja Borsdorf 2, Joachim Hornegger 1,3 1 Pattern Recognition Lab, Friedrich-Alexander-Universität

More information

Gradient-Based Differential Approach for Patient Motion Compensation in 2D/3D Overlay

Gradient-Based Differential Approach for Patient Motion Compensation in 2D/3D Overlay Gradient-Based Differential Approach for Patient Motion Compensation in 2D/3D Overlay Jian Wang, Anja Borsdorf, Benno Heigl, Thomas Köhler, Joachim Hornegger Pattern Recognition Lab, Friedrich-Alexander-University

More information

Atlas Based Segmentation of the prostate in MR images

Atlas Based Segmentation of the prostate in MR images Atlas Based Segmentation of the prostate in MR images Albert Gubern-Merida and Robert Marti Universitat de Girona, Computer Vision and Robotics Group, Girona, Spain {agubern,marly}@eia.udg.edu Abstract.

More information

Segmentation and Tracking of Partial Planar Templates

Segmentation and Tracking of Partial Planar Templates Segmentation and Tracking of Partial Planar Templates Abdelsalam Masoud William Hoff Colorado School of Mines Colorado School of Mines Golden, CO 800 Golden, CO 800 amasoud@mines.edu whoff@mines.edu Abstract

More information

CS 4495 Computer Vision Motion and Optic Flow

CS 4495 Computer Vision Motion and Optic Flow CS 4495 Computer Vision Aaron Bobick School of Interactive Computing Administrivia PS4 is out, due Sunday Oct 27 th. All relevant lectures posted Details about Problem Set: You may *not* use built in Harris

More information

Evaluation of Spectrum Mismatching using Spectrum Binning Approach for Statistical Polychromatic Reconstruction in CT

Evaluation of Spectrum Mismatching using Spectrum Binning Approach for Statistical Polychromatic Reconstruction in CT Evaluation of Spectrum Mismatching using Spectrum Binning Approach for Statistical Polychromatic Reconstruction in CT Qiao Yang 1,4, Meng Wu 2, Andreas Maier 1,3,4, Joachim Hornegger 1,3,4, Rebecca Fahrig

More information

Occluded Facial Expression Tracking

Occluded Facial Expression Tracking Occluded Facial Expression Tracking Hugo Mercier 1, Julien Peyras 2, and Patrice Dalle 1 1 Institut de Recherche en Informatique de Toulouse 118, route de Narbonne, F-31062 Toulouse Cedex 9 2 Dipartimento

More information

Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference

Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference Minh Dao 1, Xiang Xiang 1, Bulent Ayhan 2, Chiman Kwan 2, Trac D. Tran 1 Johns Hopkins Univeristy, 3400

More information

Nonrigid Surface Modelling. and Fast Recovery. Department of Computer Science and Engineering. Committee: Prof. Leo J. Jia and Prof. K. H.

Nonrigid Surface Modelling. and Fast Recovery. Department of Computer Science and Engineering. Committee: Prof. Leo J. Jia and Prof. K. H. Nonrigid Surface Modelling and Fast Recovery Zhu Jianke Supervisor: Prof. Michael R. Lyu Committee: Prof. Leo J. Jia and Prof. K. H. Wong Department of Computer Science and Engineering May 11, 2007 1 2

More information

Using temporal seeding to constrain the disparity search range in stereo matching

Using temporal seeding to constrain the disparity search range in stereo matching Using temporal seeding to constrain the disparity search range in stereo matching Thulani Ndhlovu Mobile Intelligent Autonomous Systems CSIR South Africa Email: tndhlovu@csir.co.za Fred Nicolls Department

More information

Robust Point Matching for Two-Dimensional Nonrigid Shapes

Robust Point Matching for Two-Dimensional Nonrigid Shapes Robust Point Matching for Two-Dimensional Nonrigid Shapes Yefeng Zheng and David Doermann Language and Media Processing Laboratory Institute for Advanced Computer Studies University of Maryland, College

More information

3/27/2012 WHY SPECT / CT? SPECT / CT Basic Principles. Advantages of SPECT. Advantages of CT. Dr John C. Dickson, Principal Physicist UCLH

3/27/2012 WHY SPECT / CT? SPECT / CT Basic Principles. Advantages of SPECT. Advantages of CT. Dr John C. Dickson, Principal Physicist UCLH 3/27/212 Advantages of SPECT SPECT / CT Basic Principles Dr John C. Dickson, Principal Physicist UCLH Institute of Nuclear Medicine, University College London Hospitals and University College London john.dickson@uclh.nhs.uk

More information

Non-Rigid Registration of Medical Images: Theory, Methods and Applications

Non-Rigid Registration of Medical Images: Theory, Methods and Applications Non-Rigid Registration of Medical Images: Theory, Methods and Applications Daniel Rueckert Paul Aljabar Medical mage registration [1] plays an increasingly important role in many clinical applications

More information

Selection of Scale-Invariant Parts for Object Class Recognition

Selection of Scale-Invariant Parts for Object Class Recognition Selection of Scale-Invariant Parts for Object Class Recognition Gy. Dorkó and C. Schmid INRIA Rhône-Alpes, GRAVIR-CNRS 655, av. de l Europe, 3833 Montbonnot, France fdorko,schmidg@inrialpes.fr Abstract

More information

Guide wire tracking in interventional radiology

Guide wire tracking in interventional radiology Guide wire tracking in interventional radiology S.A.M. Baert,W.J. Niessen, E.H.W. Meijering, A.F. Frangi, M.A. Viergever Image Sciences Institute, University Medical Center Utrecht, rm E 01.334, P.O.Box

More information

VIDEO OBJECT SEGMENTATION BY EXTENDED RECURSIVE-SHORTEST-SPANNING-TREE METHOD. Ertem Tuncel and Levent Onural

VIDEO OBJECT SEGMENTATION BY EXTENDED RECURSIVE-SHORTEST-SPANNING-TREE METHOD. Ertem Tuncel and Levent Onural VIDEO OBJECT SEGMENTATION BY EXTENDED RECURSIVE-SHORTEST-SPANNING-TREE METHOD Ertem Tuncel and Levent Onural Electrical and Electronics Engineering Department, Bilkent University, TR-06533, Ankara, Turkey

More information

SIMULATIVE ANALYSIS OF EDGE DETECTION OPERATORS AS APPLIED FOR ROAD IMAGES

SIMULATIVE ANALYSIS OF EDGE DETECTION OPERATORS AS APPLIED FOR ROAD IMAGES SIMULATIVE ANALYSIS OF EDGE DETECTION OPERATORS AS APPLIED FOR ROAD IMAGES Sukhpreet Kaur¹, Jyoti Saxena² and Sukhjinder Singh³ ¹Research scholar, ²Professsor and ³Assistant Professor ¹ ² ³ Department

More information

Motion Estimation for Video Coding Standards

Motion Estimation for Video Coding Standards Motion Estimation for Video Coding Standards Prof. Ja-Ling Wu Department of Computer Science and Information Engineering National Taiwan University Introduction of Motion Estimation The goal of video compression

More information

Feature Based Registration - Image Alignment

Feature Based Registration - Image Alignment Feature Based Registration - Image Alignment Image Registration Image registration is the process of estimating an optimal transformation between two or more images. Many slides from Alexei Efros http://graphics.cs.cmu.edu/courses/15-463/2007_fall/463.html

More information

Iterative methods for use with the Fast Multipole Method

Iterative methods for use with the Fast Multipole Method Iterative methods for use with the Fast Multipole Method Ramani Duraiswami Perceptual Interfaces and Reality Lab. Computer Science & UMIACS University of Maryland, College Park, MD Joint work with Nail

More information

Use of Shape Deformation to Seamlessly Stitch Historical Document Images

Use of Shape Deformation to Seamlessly Stitch Historical Document Images Use of Shape Deformation to Seamlessly Stitch Historical Document Images Wei Liu Wei Fan Li Chen Jun Sun Satoshi Naoi In China, efforts are being made to preserve historical documents in the form of digital

More information

Efficient population registration of 3D data

Efficient population registration of 3D data Efficient population registration of 3D data Lilla Zöllei 1, Erik Learned-Miller 2, Eric Grimson 1, William Wells 1,3 1 Computer Science and Artificial Intelligence Lab, MIT; 2 Dept. of Computer Science,

More information

Non-rigid Registration using Discrete MRFs: Application to Thoracic CT Images

Non-rigid Registration using Discrete MRFs: Application to Thoracic CT Images Non-rigid Registration using Discrete MRFs: Application to Thoracic CT Images Ben Glocker 1, Nikos Komodakis 2, Nikos Paragios 3,4, and Nassir Navab 1 1 Computer Aided Medical Procedures (CAMP), TU Mï

More information

Non-Rigid Image Registration III

Non-Rigid Image Registration III Non-Rigid Image Registration III CS6240 Multimedia Analysis Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore Leow Wee Kheng (CS6240) Non-Rigid Image Registration

More information

Utilizing Salient Region Features for 3D Multi-Modality Medical Image Registration

Utilizing Salient Region Features for 3D Multi-Modality Medical Image Registration Utilizing Salient Region Features for 3D Multi-Modality Medical Image Registration Dieter Hahn 1, Gabriele Wolz 2, Yiyong Sun 3, Frank Sauer 3, Joachim Hornegger 1, Torsten Kuwert 2 and Chenyang Xu 3 1

More information

Rigid and Deformable Vasculature-to-Image Registration : a Hierarchical Approach

Rigid and Deformable Vasculature-to-Image Registration : a Hierarchical Approach Rigid and Deformable Vasculature-to-Image Registration : a Hierarchical Approach Julien Jomier and Stephen R. Aylward Computer-Aided Diagnosis and Display Lab The University of North Carolina at Chapel

More information

Nonrigid Registration with Adaptive, Content-Based Filtering of the Deformation Field

Nonrigid Registration with Adaptive, Content-Based Filtering of the Deformation Field Nonrigid Registration with Adaptive, Content-Based Filtering of the Deformation Field Marius Staring*, Stefan Klein and Josien P.W. Pluim Image Sciences Institute, University Medical Center Utrecht, P.O.

More information

ANALYSIS OF RELIABILITY AND IMPACT FACTORS OF MUTUAL INFORMATION SIMILARITY CRITERION FOR REMOTE SENSING IMAGERY TEMPLATE MATCHING

ANALYSIS OF RELIABILITY AND IMPACT FACTORS OF MUTUAL INFORMATION SIMILARITY CRITERION FOR REMOTE SENSING IMAGERY TEMPLATE MATCHING ANALYSIS OF RELIABILITY AND IMPACT FACTORS OF MUTUAL INFORMATION SIMILARITY CRITERION FOR REMOTE SENSING IMAGERY TEMPLATE MATCHING H.L. Wang a,, R. An b, * Q. Zhang b, C.Y. Chen b a College of Geography

More information

ECSE 626 Project Report Multimodality Image Registration by Maximization of Mutual Information

ECSE 626 Project Report Multimodality Image Registration by Maximization of Mutual Information ECSE 626 Project Report Multimodality Image Registration by Maximization of Mutual Information Emmanuel Piuze McGill University Montreal, Qc, Canada. epiuze@cim.mcgill.ca Abstract In 1997, Maes et al.

More information

Corner Detection. GV12/3072 Image Processing.

Corner Detection. GV12/3072 Image Processing. Corner Detection 1 Last Week 2 Outline Corners and point features Moravec operator Image structure tensor Harris corner detector Sub-pixel accuracy SUSAN FAST Example descriptor: SIFT 3 Point Features

More information

A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images

A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images Jianhua Yao 1, Russell Taylor 2 1. Diagnostic Radiology Department, Clinical Center,

More information

Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting

Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting R. Maier 1,2, K. Kim 1, D. Cremers 2, J. Kautz 1, M. Nießner 2,3 Fusion Ours 1

More information

SCALE INVARIANT TEMPLATE MATCHING

SCALE INVARIANT TEMPLATE MATCHING Volume 118 No. 5 2018, 499-505 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu SCALE INVARIANT TEMPLATE MATCHING Badrinaathan.J Srm university Chennai,India

More information

Structure-adaptive Image Denoising with 3D Collaborative Filtering

Structure-adaptive Image Denoising with 3D Collaborative Filtering , pp.42-47 http://dx.doi.org/10.14257/astl.2015.80.09 Structure-adaptive Image Denoising with 3D Collaborative Filtering Xuemei Wang 1, Dengyin Zhang 2, Min Zhu 2,3, Yingtian Ji 2, Jin Wang 4 1 College

More information

Interactive Deformable Registration Visualization and Analysis of 4D Computed Tomography

Interactive Deformable Registration Visualization and Analysis of 4D Computed Tomography Interactive Deformable Registration Visualization and Analysis of 4D Computed Tomography Burak Erem 1, Gregory C. Sharp 2, Ziji Wu 2, and David Kaeli 1 1 Department of Electrical and Computer Engineering,

More information

The SIFT (Scale Invariant Feature

The SIFT (Scale Invariant Feature The SIFT (Scale Invariant Feature Transform) Detector and Descriptor developed by David Lowe University of British Columbia Initial paper ICCV 1999 Newer journal paper IJCV 2004 Review: Matt Brown s Canonical

More information

Automatic Generation of Shape Models Using Nonrigid Registration with a Single Segmented Template Mesh

Automatic Generation of Shape Models Using Nonrigid Registration with a Single Segmented Template Mesh Automatic Generation of Shape Models Using Nonrigid Registration with a Single Segmented Template Mesh Geremy Heitz, Torsten Rohlfing, and Calvin R. Maurer, Jr. Image Guidance Laboratories Department of

More information

BSB663 Image Processing Pinar Duygulu. Slides are adapted from Selim Aksoy

BSB663 Image Processing Pinar Duygulu. Slides are adapted from Selim Aksoy BSB663 Image Processing Pinar Duygulu Slides are adapted from Selim Aksoy Image matching Image matching is a fundamental aspect of many problems in computer vision. Object or scene recognition Solving

More information

Novel Iterative Back Projection Approach

Novel Iterative Back Projection Approach IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661, p- ISSN: 2278-8727Volume 11, Issue 1 (May. - Jun. 2013), PP 65-69 Novel Iterative Back Projection Approach Patel Shreyas A. Master in

More information

Ninio, J. and Stevens, K. A. (2000) Variations on the Hermann grid: an extinction illusion. Perception, 29,

Ninio, J. and Stevens, K. A. (2000) Variations on the Hermann grid: an extinction illusion. Perception, 29, Ninio, J. and Stevens, K. A. (2000) Variations on the Hermann grid: an extinction illusion. Perception, 29, 1209-1217. CS 4495 Computer Vision A. Bobick Sparse to Dense Correspodence Building Rome in

More information

Motion Estimation using Block Overlap Minimization

Motion Estimation using Block Overlap Minimization Motion Estimation using Block Overlap Minimization Michael Santoro, Ghassan AlRegib, Yucel Altunbasak School of Electrical and Computer Engineering, Georgia Institute of Technology Atlanta, GA 30332 USA

More information

Adaptive Local Multi-Atlas Segmentation: Application to Heart Segmentation in Chest CT Scans

Adaptive Local Multi-Atlas Segmentation: Application to Heart Segmentation in Chest CT Scans Adaptive Local Multi-Atlas Segmentation: Application to Heart Segmentation in Chest CT Scans Eva M. van Rikxoort, Ivana Isgum, Marius Staring, Stefan Klein and Bram van Ginneken Image Sciences Institute,

More information

SINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC

SINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC SINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC Randa Atta, Rehab F. Abdel-Kader, and Amera Abd-AlRahem Electrical Engineering Department, Faculty of Engineering, Port

More information

Feature Tracking and Optical Flow

Feature Tracking and Optical Flow Feature Tracking and Optical Flow Prof. D. Stricker Doz. G. Bleser Many slides adapted from James Hays, Derek Hoeim, Lana Lazebnik, Silvio Saverse, who 1 in turn adapted slides from Steve Seitz, Rick Szeliski,

More information

Local Feature Detectors

Local Feature Detectors Local Feature Detectors Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr Slides adapted from Cordelia Schmid and David Lowe, CVPR 2003 Tutorial, Matthew Brown,

More information

Non-rigid Image Registration

Non-rigid Image Registration Overview Non-rigid Image Registration Introduction to image registration - he goal of image registration - Motivation for medical image registration - Classification of image registration - Nonrigid registration

More information

Image Coding with Active Appearance Models

Image Coding with Active Appearance Models Image Coding with Active Appearance Models Simon Baker, Iain Matthews, and Jeff Schneider CMU-RI-TR-03-13 The Robotics Institute Carnegie Mellon University Abstract Image coding is the task of representing

More information

Computer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks

Computer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks Computer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks Du-Yih Tsai, Masaru Sekiya and Yongbum Lee Department of Radiological Technology, School of Health Sciences, Faculty of

More information

maximum likelihood estimates. The performance of

maximum likelihood estimates. The performance of International Journal of Computer Science and Telecommunications [Volume 2, Issue 6, September 2] 8 ISSN 247-3338 An Efficient Approach for Medical Image Segmentation Based on Truncated Skew Gaussian Mixture

More information

Robust Model-Free Tracking of Non-Rigid Shape. Abstract

Robust Model-Free Tracking of Non-Rigid Shape. Abstract Robust Model-Free Tracking of Non-Rigid Shape Lorenzo Torresani Stanford University ltorresa@cs.stanford.edu Christoph Bregler New York University chris.bregler@nyu.edu New York University CS TR2003-840

More information

Robust Visual Tracking Using the Time-Reversibility Constraint

Robust Visual Tracking Using the Time-Reversibility Constraint Robust Visual Tracking Using the Time-Reversibility Constraint Hao Wu, Rama Chellappa, Aswin C. Sankaranarayanan and Shaohua Kevin Zhou Center for Automation Research, University of Maryland, College Park,

More information