Non-Rigid Image Registration III
|
|
- Mavis Collins
- 6 years ago
- Views:
Transcription
1 Non-Rigid Image Registration III CS6240 Multimedia Analysis Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 1 / 47
2 Variational Approach Basic ideas [Fis05, Mod04]: T denotes template image to be deformed. Represent deformation of T by displacement u(x) of point x, i.e., x in T becomes x+u(x) in the deformed template. T u denotes the deformed template image. (a) Template image T (b) Deformed template image T u. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 2 / 47
3 R denotes the fixed reference or target object. D(R,T;u) denotes the difference between fixed R and T after deformation u. Find u that minimizes D(R,T;u). This problem is ill-posed; need regularizer (smoothing function) S. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 3 / 47
4 The problem can be formulated as follows: Given reference image R, template image T, difference measure D, regularizer S, find the displacements u(x) of points x in T that minimizes the error E where α is a regularization parameter. E = D(R,T;u)+αS(u) (1) Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 4 / 47
5 Apply variational calculus method: 1 When E is minimized, u satisfies the Euler-Lagrange equation: αa(u)+f(u) = 0. (2) A(u) is obtained from S(u). Force term F(u) is obtained from D(R,T;u). 2 Apply time-marching method to obtain 3 Apply semi-implicit discretization to obtain u t +αa(u)+f(u) = 0. (3) u(k +1) u(k)+γ[αau(k +1)+F(u(k))] = 0. (4) Au is obtained from A(u). 4 Rearrange to obtain the iterative equation: u(k +1) = (I+γαA) 1 [u(k) γf(u(k))]. (5) Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 5 / 47
6 Types of difference measure Sum-squared difference Cross correlation Mutual information Types of regularizer (smoothing function) Elastic Fluid Diffusion Curvature Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 6 / 47
7 Sum-Squared Difference D(R,T;u) = 1 [R(x) T(x+u(x))] 2 dx 2 = 1 [R(x) T u (x)] 2 dx 2 (6) This is ok for R and T with similar intensity and contrast. Force F(u) is given by [Fis05, Mod04]: F(u) = (R(x) T u (x)) T u (x). (7) Need to apply d-linear interpolation to compute T u, where d is the number of dimensions of the images. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 7 / 47
8 Mutual Information P R (r): probability that a point in R has the value r. P Tu (t): probability that a point in T u has the value t. P R,Tu (r,t): joint probability that the corresponding points in R and T u have the values r and t respectively. Mutual information (MI) M(R,T u ) is given by M(R,T u ) = P R,Tu (r,t)log P R,T u (r,t) drdt. (8) P R (r)p Tu (t) MI can also be computed by entropy H: where M(R,T u ) = H(R)+H(T u ) H(R,T u ) (9) H(R) = H(R,T u ) = P R (r)logp R (r)dr P R,Tu (r,t)logp R,Tu (r,t)drdt. (10) Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 8 / 47
9 Distance measure D(R,T;u) = M(R,T u ). Force F(u) is given by [Fis05]: [ 1 P Tu (t) F(u) = P Tu (t) t 1 P R,Tu (r,t) ] P R,Tu (r,t) T u (x) (11) t Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 9 / 47
10 Notes: Also need to apply d-linear interpolation to compute T u. MI has been widely used for registering images with different intensities and contrasts (e.g., [Vio95, VI97]). MI is not differentiable if the probability densities are non-smooth. Can approximate using Parzen window technique [DH73, Vio95] which is differentiable. MI objective function sometimes reaches its global minimum at an incorrect alignment, even when a correct alignment between the images exists [PMV00]. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 10 / 47
11 Elastic Registration Elastic Registration Based on physical properties of elastic body. Applying external force to an elastic body results in deformation or strain of the body. Strain is related to tension or stress of the body. The body s shape results from an equilibrium of external force and internal stress. Model the smoothing function S(u) by elastic potential. Allow for stretching or shrinking without tearing. Let u = (u 1,...,u d ) T, x = (x 1,...,x d ) T where d is the number of dimensions of the images. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 11 / 47
12 Elastic Registration Elastic potential P(u) is given by P(u) = µ 4 d j,k=1 where λ and µ are the Lamé s elastic coefficients. ( uk + u ) 2 j + λ x j x k 2 ( u)2 dx (12) For 2D case (x 1 = x,x 2 = y), [ ( u1 ) 2 ( ) 2 u2 P(u) = µ ( u2 + u ) ] λ x 1 x 2 2 x 1 x 2 2 ( u)2 dx (13) Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 12 / 47
13 Elastic Registration Elastic regularizer gives the equation [BK89, Fis05, Mod04]: A(u) = µ 2 u+(λ+µ) u. (14) ( ) T =,..., is the gradient operator. x 1 x d d 2 2 = is the Laplacian operator. x 2 i=1 i 2 u = ( 2 u 1,..., 2 u d ) T. d u i u = is the divergence of u. x i i=1 Typically, λ = 0. If λ 0, stretching in one direction is accompanied by shrinking in the perpendicular direction. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 13 / 47
14 Elastic Registration Boundary Conditions Explicit boundary conditions can be imposed to further influence how the template is deformed. Without lack of generality, assume that the images are bounded within the internal [0, 1]. The following are possible explicit boundary conditions (2D case): Zero Padding (Dirichlet): u(x) = 0 for image boundary points x. Mirroring (Neumann): u l (x) n(x) = 0 for image boundary points x, and outer normal unit vectors n at image boundary. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 14 / 47
15 Elastic Registration Sliding: Template image boundary is mapped to reference image boundary, and boundary points can slide along the boundaries. u 1 u 2 u 2 u 1 u 1 (x,x 2 ) = u 2 (x 1,x) = 0, for x = 0,1 and x j [0,1]. u 2 (x,x 2 ) x 1 = u 1(x 1,x) x 2 = 0, Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 15 / 47
16 Elastic Registration Bending: Corners of template image boundaries are fixed to those of reference image boundaries, and the sides can bend inward or outward. u 1 u 2 u 1 u 2 u 2 (x,x 2 ) = u 1 (x 1,x) = 0, for x = 0,1 and x j [0,1]. u 1 (x,x 2 ) x 1 = u 2(x 1,x) x 2 = 0, Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 16 / 47
17 Elastic Registration Periodic: The template image is mapped onto a torus. u 2 u 1 u 1 u 2 u 1 (0,x 2 ) = u 1 (1,x 2 ), u 2 (x 1,0) = u 2 (x 1,1), for x j [0,1]. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 17 / 47
18 Elastic Registration Finite Difference Approximation The iterative algorithm involves computing the inverse of (I+γαA). The matrix A is obtained from finite difference approximation of A(u). For 2D case, A(u) = µ 2 u+(λ+µ) u (λ+2µ) 2 x 2 +µ 2 1 x 2 2 = 2 (λ+µ) x 1 x 2 2 (λ+µ) x 1 x 2 µ 2 x 2 +(λ+2µ) 2 1 x 2 2 [ ] u1 (x) u 2 (x) The above equation can then be approximated by finite difference method into the form Au(x). (15) Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 18 / 47
19 Elastic Registration Notes: The above matrix is for one pixel of a 2-D image. For a d-dimensional image with N voxels, the u vector has dn entries, and the A matrix has dn dn entries! Many of the entries are 0. But there are still many non-zero entries. Direct inversion of (I+γαA) is possible only for small images. The entries in A also depend on the boundary condition used. With periodic boundary condition, FFT method can be used to implement an O(N logn) algorithm. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 19 / 47
20 Elastic Registration Non-zero patterns of the matrix A [Mod04]: (a) 2D case, 5 7. (b) 3D case, Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 20 / 47
21 Elastic Registration Example 1: Elastic registration of disk to C [Mod04]: (a) Reference image. (b) Template image. (c) Shaded template. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 21 / 47
22 Elastic Registration (d) Dirichlet. (e) Neumann. (e) Periodic. (g) Periodic. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 22 / 47
23 Elastic Registration Example 2: Elastic registration of hand image [Mod04]: (a) Reference image. (b) Template image. (c) Affine registered template. (d) Elastically registered template. Notes: Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 23 / 47
24 Fluid Registration Fluid Registration Based on simplified model of fluid. Elastic models: spatial smoothing of displacement field. Fluid models: spatial smoothing of velocity field. Let P(u) denote elastic potential. Then, fluid regularizer S(u) = P( u/ t). Fluid regularizer gives the equation [Mod04]: A(u) = µ 2 v+(λ+µ) v, v = u t. (16) Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 24 / 47
25 Fluid Registration Example 1: Fluid registration of disk to C [Mod04]: (a) Elastically registered template. (b) Fluid registered template. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 25 / 47
26 Fluid Registration Example 2: Fluid registration of hand image [Mod04]: (a) Fluid registration only. (b) Affine + fluid registration. Notes: Fluid registration can produce more deformation than elastic registration. Non-rigid registration without linear pre-registration can cause too much deformation even though the difference is minimized. Linear (affine or similarity) pre-registration is needed to normalize the size, position, and orientation. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 26 / 47
27 Diffusion Registration Diffusion Registration Based on intensity gradient; non-physical. Diffusion regularizer is given by the equation [FM99, Mod04]: S(u) = 1 2 d l=1 ( u l ) T u l dx = 1 2 d l=1 u l 2 dx (17) with Neumann boundary condition: ( u l (x)) T n(x) = 0 (18) for image boundary points x, and outer normal unit vectors n at image boundary. This regularizer smoothes the deformation while minimizing oscillations of the components of the displacement u. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 27 / 47
28 Diffusion Registration Diffusion regularizer gives the equation [Fis05, Mod04]: Notes: A(u) = 2 u. (19) Diffusion registration can be regarded as a special case of elastic registration without the u term. Diffusion registration can be extended to velocity-based method like fluid registration. Discrete Cosine Transform method can be used to implement an O(N logn) algorithm. Additive Operator Splitting method can be used to implement an O(N) algorithm. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 28 / 47
29 Diffusion Registration Example 1: Diffusion registration of disk to C [Mod04]: (a) Elastically registered. (b) Diffusion registered. (c) Diffusion registered. (d) Velocity-based diffusion. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 29 / 47
30 Diffusion Registration Example 2: Diffusion registration of hand image [Mod04]: (a) Elastically registered. (b) Affine + diffusion registration. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 30 / 47
31 Demons Registration Demons Registration Diffusion registration is related to Thirion s demons registration [Thi98]. Basic ideas: Place demons at certain locations in the image. Demons decide whether movement of particles of template image reduces difference between reference and template images. Apply optical flow method to compute the required displacement. Apply low-pass (Gaussian) filtering to produce smooth solution. In ideal case, T u (x) = R(x). Apply optical flow method: dt u dt where v = x/ t. Then, = T u t +( T u) T v = 0. (20) ( T u ) T v = T u = T u (x,t) T u (x,t+1). (21) t Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 31 / 47
32 Demons Registration Template image is deformed to match reference image. So, we can regard T u (x,t+1) as R(x). A solution of the above equation is T u (x) v(x) = (T u (x) R(x)) T u (x) 2. (22) The above solution is undefined when T u = 0. To handle this situation, Thirion suggests including a non-zero term κ in the denominator: where κ = T u (x) R(x). v(x) = (T u(x) R(x)) T u (x) T u (x) 2 +κ 2 (23) Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 32 / 47
33 Demons Registration Relationship to diffusion registration [Mod04]: Can formulate a diffusion registration with appropriate difference measure such that the derived force F(u) = v. Under mild conditions, a solution u(x) of the Euler-Lagrange equation is the convolution of F with a Gaussian kernel, i.e., Demons method. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 33 / 47
34 Curvature Registration Curvature Registration Elastic, fluid, and diffusion registrations are sensitive with respect to linear pre-registration. Rigid (or affine) pre-registration is needed to roughly align images before non-rigid registration. Curvature registration is less dependent on initial configuration of reference and template images. Difference measure is the sum-squared difference: D(R,T;u) = 1 [R(x) T u (x)] 2 dx. (24) 2 Curvature regularizer is given by S(u) = 1 2 d l=1 ( 2 u l ) 2 dx (25) Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 34 / 47
35 Curvature Registration with Neumann boundary conditions u l = 2 u l = 0 (26) for image boundary points x. Curvature regularizer gives the equation A(u) = 2 2 u. (27) Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 35 / 47
36 Curvature Registration Notes: ( 2 u l ) 2 can be viewed as an approximation of curvature. Thus, the idea of the regularizer is to minimize the curvature of the components of the displacement. The discretized Acurv = A 2 diff. Discrete Cosine Transform method can be used to implement an O(N logn) algorithm. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 36 / 47
37 Curvature Registration Example 1: Deformed grid after curvature registration [Mod04]: (a) Reference image. (b) Template image. (c) Fluid registration. (d) Curvature registration. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 37 / 47
38 Curvature Registration Example 2: Curvature registration of disk to C [Mod04]: (a) Fluid registered. (b) Curvature registered. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 38 / 47
39 Curvature Registration Example 3: Curvature registration of hand image [Mod04]: (a) Curvature registration only. (b) Affine + curvature registration. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 39 / 47
40 Summary Summary Elastic registration Based on properties of elastic object. A(u) = µ 2 u+(λ+µ) u. Physically meaningful deformation. Small, local deformation. With periodic boundary condition, FFT method can be used to implement an O(N logn) algorithm. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 40 / 47
41 Summary Fluid registration Based on simplified properties of fluid. A(u) = µ 2 v+(λ+µ) v, v = u t. Physically meaningful deformation. Can produce very large deformation. With periodic boundary condition, FFT method can be used to implement an O(N logn) algorithm. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 41 / 47
42 Summary Diffusion registration Based on 1st order spatial derivatives of displacement. Non-physical model. Small deformation. A(u) = 2 u. Can be combined with fluid idea to obtain large deformation. Additive Operator Splitting method can be used to implement an O(N) algorithm. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 42 / 47
43 Summary Curvature registration Based on 2nd order spatial derivatives of displacement. Non-physical model. A(u) = 2 2 u. Kernel contains affine transformation. Small deformation. Can be combined with fluid idea to obtain large deformation. Discrete Cosine Transform method can be used to implement an O(N logn) algorithm. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 43 / 47
44 Summary Sample execution time [Mod04]: (a) Elastic. (b) Diffusion & curvature. Further notes: Software toolkit available, e.g., FLIRT [FM03]. Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 44 / 47
45 Summary Further reading: More details on non-rigid registration methods: [Mod04]. Comparing various non-rigid registration methods: [Mod04], Sections 13.3, How to choose parameter values: [Mod04], Section Extensions of the methods: [Mod04], Section Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 45 / 47
46 Reference References I R. Bajcsy and S. Kovačič. Multiresolution elastic matching. Computer Vision, Graphics, and Image Processing, 46:1 21, R. Duda and P. Hart. Pattern Classification and Scene Analysis. Wiley, B. Fischer. On non-rigid medical image registration B. Fischer and J. Modersitzki. Fast inversion of matrices arising in image processing. Numerical Algorithms, 22:1 11, Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 46 / 47
47 Reference References II B. Fischer and J. Modersitzki. FLIRT: A flexible image registration toolbox. In J. C. Gee, J. B. A. Maintz, and M. W. Vannier, editors, Proc. 2nd Int. Workshop on Biomedical Image Registration (LNCS 2717), pages , J. Modersitzki. Numerical Methods for Image Registration. Oxford University Press, J. P. W. Pluim, J. B. A. Maintz, and M. A. Vierveger. Image registration by maximization of combined mutual information and gradient information. IEEE Trans. on Medical Imaging, 19(8): , Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 47 / 47
48 Reference References III J.-P. Thirion. Image matching as a diffusion process: An analogy with Maxwell s demons. Medical Image Analysis, 2(3), P. Viola and W. M. Wells III. Alignment by maximization of mutual information. Int. Journal of Computer Vision, 24(2): , P. Viola. Alignment by maximization of mutual information. PhD thesis, MIT, Leow Wee Kheng (CS6240) Non-Rigid Image Registration III 48 / 47
Bildverarbeitung für die Medizin 2007
Bildverarbeitung für die Medizin 2007 Image Registration with Local Rigidity Constraints Jan Modersitzki Institute of Mathematics, University of Lübeck, Wallstraße 40, D-23560 Lübeck 1 Summary Registration
More informationLeow Wee Kheng CS4243 Computer Vision and Pattern Recognition. Motion Tracking. CS4243 Motion Tracking 1
Leow Wee Kheng CS4243 Computer Vision and Pattern Recognition Motion Tracking CS4243 Motion Tracking 1 Changes are everywhere! CS4243 Motion Tracking 2 Illumination change CS4243 Motion Tracking 3 Shape
More informationComparison between Optical Flow and Cross-Correlation Methods for Extraction of Velocity Fields from Particle Images
Comparison between Optical Flow and Cross-Correlation Methods for Extraction of Velocity Fields from Particle Images (Optical Flow vs Cross-Correlation) Tianshu Liu, Ali Merat, M. H. M. Makhmalbaf Claudia
More informationNumerical methods for volume preserving image registration
Numerical methods for volume preserving image registration SIAM meeting on imaging science 2004 Eldad Haber with J. Modersitzki haber@mathcs.emory.edu Emory University Volume preserving IR p.1/?? Outline
More informationImage Registration with Local Rigidity Constraints
Image Registration with Local Rigidity Constraints Jan Modersitzki Institute of Mathematics, University of Lübeck, Wallstraße 40, D-23560 Lübeck Email: modersitzki@math.uni-luebeck.de Abstract. Registration
More informationParticle Filtering. CS6240 Multimedia Analysis. Leow Wee Kheng. Department of Computer Science School of Computing National University of Singapore
Particle Filtering CS6240 Multimedia Analysis Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore (CS6240) Particle Filtering 1 / 28 Introduction Introduction
More informationMean Shift Tracking. CS4243 Computer Vision and Pattern Recognition. Leow Wee Kheng
CS4243 Computer Vision and Pattern Recognition Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore (CS4243) Mean Shift Tracking 1 / 28 Mean Shift Mean Shift
More informationImage Segmentation II Advanced Approaches
Image Segmentation II Advanced Approaches Jorge Jara W. 1,2 1 Department of Computer Science DCC, U. of Chile 2 SCIAN-Lab, BNI Outline 1. Segmentation I Digital image processing Segmentation basics 2.
More informationsmooth coefficients H. Köstler, U. Rüde
A robust multigrid solver for the optical flow problem with non- smooth coefficients H. Köstler, U. Rüde Overview Optical Flow Problem Data term and various regularizers A Robust Multigrid Solver Galerkin
More informationCOMPUTER VISION > OPTICAL FLOW UTRECHT UNIVERSITY RONALD POPPE
COMPUTER VISION 2017-2018 > OPTICAL FLOW UTRECHT UNIVERSITY RONALD POPPE OUTLINE Optical flow Lucas-Kanade Horn-Schunck Applications of optical flow Optical flow tracking Histograms of oriented flow Assignment
More informationViscoelastic Registration of Medical Images
Viscoelastic Registration of Medical Images Zhao Yi Justin Wan Abstract Since the physical behavior of many tissues is shown to be viscoelastic, we propose a novel registration technique for medical images
More informationl ealgorithms for Image Registration
FAIR: exib Image Registration l F l ealgorithms for Jan Modersitzki Computing And Software, McMaster University 1280 Main Street West, Hamilton On, L8S 4K1, Canada modersit@cas.mcmaster.ca August 13, 2008
More informationVisual Tracking (1) Tracking of Feature Points and Planar Rigid Objects
Intelligent Control Systems Visual Tracking (1) Tracking of Feature Points and Planar Rigid Objects Shingo Kagami Graduate School of Information Sciences, Tohoku University swk(at)ic.is.tohoku.ac.jp http://www.ic.is.tohoku.ac.jp/ja/swk/
More informationELEC Dr Reji Mathew Electrical Engineering UNSW
ELEC 4622 Dr Reji Mathew Electrical Engineering UNSW Review of Motion Modelling and Estimation Introduction to Motion Modelling & Estimation Forward Motion Backward Motion Block Motion Estimation Motion
More informationRegistration: Rigid vs. Deformable
Lecture 20 Deformable / Non-Rigid Registration ch. 11 of Insight into Images edited by Terry Yoo, et al. Spring 2017 16-725 (CMU RI) : BioE 2630 (Pitt) Dr. John Galeotti The content of these slides by
More informationVisual Tracking (1) Feature Point Tracking and Block Matching
Intelligent Control Systems Visual Tracking (1) Feature Point Tracking and Block Matching Shingo Kagami Graduate School of Information Sciences, Tohoku University swk(at)ic.is.tohoku.ac.jp http://www.ic.is.tohoku.ac.jp/ja/swk/
More informationIntegrated Approaches to Non-Rigid Registration in Medical Images
Work. on Appl. of Comp. Vision, pg 102-108. 1 Integrated Approaches to Non-Rigid Registration in Medical Images Yongmei Wang and Lawrence H. Staib + Departments of Electrical Engineering and Diagnostic
More informationMotion Coherent Image Registration and Demons: Practical Handling of Deformation Boundaries
Motion Coherent Image Registration and Demons: Practical Handling of Deformation Boundaries Nathan D. Cahill Center for Applied and Computational Mathematics School of Mathematical Sciences Rochester Institute
More informationShape-based Diffeomorphic Registration on Hippocampal Surfaces Using Beltrami Holomorphic Flow
Shape-based Diffeomorphic Registration on Hippocampal Surfaces Using Beltrami Holomorphic Flow Abstract. Finding meaningful 1-1 correspondences between hippocampal (HP) surfaces is an important but difficult
More informationA Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields
A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields Lars König, Till Kipshagen and Jan Rühaak Fraunhofer MEVIS Project Group Image Registration,
More informationCurvature guided surface registration using level sets
Curvature guided surface registration using level sets Marcel Lüthi, Thomas Albrecht, Thomas Vetter Department of Computer Science, University of Basel, Switzerland Abstract. We present a new approach
More informationChapter 6 Visualization Techniques for Vector Fields
Chapter 6 Visualization Techniques for Vector Fields 6.1 Introduction 6.2 Vector Glyphs 6.3 Particle Advection 6.4 Streamlines 6.5 Line Integral Convolution 6.6 Vector Topology 6.7 References 2006 Burkhard
More informationThe Level Set Method. Lecture Notes, MIT J / 2.097J / 6.339J Numerical Methods for Partial Differential Equations
The Level Set Method Lecture Notes, MIT 16.920J / 2.097J / 6.339J Numerical Methods for Partial Differential Equations Per-Olof Persson persson@mit.edu March 7, 2005 1 Evolving Curves and Surfaces Evolving
More informationCS 565 Computer Vision. Nazar Khan PUCIT Lectures 15 and 16: Optic Flow
CS 565 Computer Vision Nazar Khan PUCIT Lectures 15 and 16: Optic Flow Introduction Basic Problem given: image sequence f(x, y, z), where (x, y) specifies the location and z denotes time wanted: displacement
More informationRegistration by continuous optimisation. Stefan Klein Erasmus MC, the Netherlands Biomedical Imaging Group Rotterdam (BIGR)
Registration by continuous optimisation Stefan Klein Erasmus MC, the Netherlands Biomedical Imaging Group Rotterdam (BIGR) Registration = optimisation C t x t y 1 Registration = optimisation C t x t y
More informationCS-465 Computer Vision
CS-465 Computer Vision Nazar Khan PUCIT 9. Optic Flow Optic Flow Nazar Khan Computer Vision 2 / 25 Optic Flow Nazar Khan Computer Vision 3 / 25 Optic Flow Where does pixel (x, y) in frame z move to in
More informationImage Warping. Srikumar Ramalingam School of Computing University of Utah. [Slides borrowed from Ross Whitaker] 1
Image Warping Srikumar Ramalingam School of Computing University of Utah [Slides borrowed from Ross Whitaker] 1 Geom Trans: Distortion From Optics Barrel Distortion Pincushion Distortion Straight lines
More informationImage Registration. Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department
Image Registration Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department Introduction Visualize objects inside the human body Advances in CS methods to diagnosis, treatment planning and medical
More informationHybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information
Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information Andreas Biesdorf 1, Stefan Wörz 1, Hans-Jürgen Kaiser 2, Karl Rohr 1 1 University of Heidelberg, BIOQUANT, IPMB,
More informationProjection Technique for Vortex-Free Image Registration
Projection Technique for Vortex-Free Image Registration Patrick Scheibe 1, Ulf-Dietrich Braumann 1,2, Jens-Peer Kuska 2 1 Translational Center for Regenerative Medicine (TRM) 2 Interdisciplinary Center
More informationModel Fitting. CS6240 Multimedia Analysis. Leow Wee Kheng. Department of Computer Science School of Computing National University of Singapore
Model Fitting CS6240 Multimedia Analysis Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore (CS6240) Model Fitting 1 / 34 Introduction Introduction Model
More informationImage registration in intra-oral radiography
Title Image registration in intra-oral radiography Author(s) Leung, CC; Yiu, KL; Zee, KY; Tsui, WK Citation Annual International Conference Of The Ieee Engineering In Medicine And Biology - Proceedings,
More informationVariational Lung Registration With Explicit Boundary Alignment
Variational Lung Registration With Explicit Boundary Alignment Jan Rühaak and Stefan Heldmann Fraunhofer MEVIS, Project Group Image Registration Maria-Goeppert-Str. 1a, 23562 Luebeck, Germany {jan.ruehaak,stefan.heldmann}@mevis.fraunhofer.de
More informationMULTISCALE IMAGE REGISTRATION. Dana Paquin. Doron Levy. Eduard Schreibmann. Lei Xing. (Communicated by Yang Kuang)
MATHEMATICAL BIOSCIENCES http://www.mbejournal.org/ AND ENGINEERING Volume 3, Number 2, April 2006 pp. 389 418 MULTISCALE IMAGE REGISTRATION Dana Paquin Department of Mathematics, Stanford University Stanford,
More informationMotion. 1 Introduction. 2 Optical Flow. Sohaib A Khan. 2.1 Brightness Constancy Equation
Motion Sohaib A Khan 1 Introduction So far, we have dealing with single images of a static scene taken by a fixed camera. Here we will deal with sequence of images taken at different time intervals. Motion
More informationParallel implementation of Total-FETI DDM with application to medical image registration
Parallel implementation of Total-FETI DDM with application to medical image registration Michal Merta 1, Alena Vašatová 1, Václav Hapla 1, and David Horák 1 Key words: Total-FETI, image registration, parallel
More informationweighted minimal surface model for surface reconstruction from scattered points, curves, and/or pieces of surfaces.
weighted minimal surface model for surface reconstruction from scattered points, curves, and/or pieces of surfaces. joint work with (S. Osher, R. Fedkiw and M. Kang) Desired properties for surface reconstruction:
More informationToday. Motivation. Motivation. Image gradient. Image gradient. Computational Photography
Computational Photography Matthias Zwicker University of Bern Fall 009 Today Gradient domain image manipulation Introduction Gradient cut & paste Tone mapping Color-to-gray conversion Motivation Cut &
More informationCombinatorial optimization and its applications in image Processing. Filip Malmberg
Combinatorial optimization and its applications in image Processing Filip Malmberg Part 1: Optimization in image processing Optimization in image processing Many image processing problems can be formulated
More informationLOCAL-GLOBAL OPTICAL FLOW FOR IMAGE REGISTRATION
LOCAL-GLOBAL OPTICAL FLOW FOR IMAGE REGISTRATION Ammar Zayouna Richard Comley Daming Shi Middlesex University School of Engineering and Information Sciences Middlesex University, London NW4 4BT, UK A.Zayouna@mdx.ac.uk
More informationAccurate Reconstruction by Interpolation
Accurate Reconstruction by Interpolation Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore International Conference on Inverse Problems and Related Topics
More informationImage processing in frequency Domain
Image processing in frequency Domain Introduction to Frequency Domain Deal with images in: -Spatial domain -Frequency domain Frequency Domain In the frequency or Fourier domain, the value and location
More informationIntroduction to Computer Graphics. Animation (2) May 26, 2016 Kenshi Takayama
Introduction to Computer Graphics Animation (2) May 26, 2016 Kenshi Takayama Physically-based deformations 2 Simple example: single mass & spring in 1D Mass m, position x, spring coefficient k, rest length
More informationVariational Methods II
Mathematical Foundations of Computer Graphics and Vision Variational Methods II Luca Ballan Institute of Visual Computing Last Lecture If we have a topological vector space with an inner product and functionals
More informationMatching. Compare region of image to region of image. Today, simplest kind of matching. Intensities similar.
Matching Compare region of image to region of image. We talked about this for stereo. Important for motion. Epipolar constraint unknown. But motion small. Recognition Find object in image. Recognize object.
More informationMariya Zhariy. Uttendorf Introduction to Optical Flow. Mariya Zhariy. Introduction. Determining. Optical Flow. Results. Motivation Definition
to Constraint to Uttendorf 2005 Contents to Constraint 1 Contents to Constraint 1 2 Constraint Contents to Constraint 1 2 Constraint 3 Visual cranial reflex(vcr)(?) to Constraint Rapidly changing scene
More informationMotion Estimation and Optical Flow Tracking
Image Matching Image Retrieval Object Recognition Motion Estimation and Optical Flow Tracking Example: Mosiacing (Panorama) M. Brown and D. G. Lowe. Recognising Panoramas. ICCV 2003 Example 3D Reconstruction
More informationFeature Tracking and Optical Flow
Feature Tracking and Optical Flow Prof. D. Stricker Doz. G. Bleser Many slides adapted from James Hays, Derek Hoeim, Lana Lazebnik, Silvio Saverse, who 1 in turn adapted slides from Steve Seitz, Rick Szeliski,
More informationContents. I The Basic Framework for Stationary Problems 1
page v Preface xiii I The Basic Framework for Stationary Problems 1 1 Some model PDEs 3 1.1 Laplace s equation; elliptic BVPs... 3 1.1.1 Physical experiments modeled by Laplace s equation... 5 1.2 Other
More informationCS201: Computer Vision Introduction to Tracking
CS201: Computer Vision Introduction to Tracking John Magee 18 November 2014 Slides courtesy of: Diane H. Theriault Question of the Day How can we represent and use motion in images? 1 What is Motion? Change
More informationUnstructured Mesh Generation for Implicit Moving Geometries and Level Set Applications
Unstructured Mesh Generation for Implicit Moving Geometries and Level Set Applications Per-Olof Persson (persson@mit.edu) Department of Mathematics Massachusetts Institute of Technology http://www.mit.edu/
More informationProcessing 3D Surface Data
Processing 3D Surface Data Computer Animation and Visualisation Lecture 12 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing
More informationDense Image-based Motion Estimation Algorithms & Optical Flow
Dense mage-based Motion Estimation Algorithms & Optical Flow Video A video is a sequence of frames captured at different times The video data is a function of v time (t) v space (x,y) ntroduction to motion
More informationCS 4495 Computer Vision Motion and Optic Flow
CS 4495 Computer Vision Aaron Bobick School of Interactive Computing Administrivia PS4 is out, due Sunday Oct 27 th. All relevant lectures posted Details about Problem Set: You may *not* use built in Harris
More informationCS205b/CME306. Lecture 9
CS205b/CME306 Lecture 9 1 Convection Supplementary Reading: Osher and Fedkiw, Sections 3.3 and 3.5; Leveque, Sections 6.7, 8.3, 10.2, 10.4. For a reference on Newton polynomial interpolation via divided
More informationThe Immersed Interface Method
The Immersed Interface Method Numerical Solutions of PDEs Involving Interfaces and Irregular Domains Zhiiin Li Kazufumi Ito North Carolina State University Raleigh, North Carolina Society for Industrial
More informationOverview of Traditional Surface Tracking Methods
Liquid Simulation With Mesh-Based Surface Tracking Overview of Traditional Surface Tracking Methods Matthias Müller Introduction Research lead of NVIDIA PhysX team PhysX GPU acc. Game physics engine www.nvidia.com\physx
More informationEXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,
School of Computer Science and Communication, KTH Danica Kragic EXAM SOLUTIONS Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006, 14.00 19.00 Grade table 0-25 U 26-35 3 36-45
More informationVisual motion. Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys
Visual motion Man slides adapted from S. Seitz, R. Szeliski, M. Pollefes Motion and perceptual organization Sometimes, motion is the onl cue Motion and perceptual organization Sometimes, motion is the
More informationRIGID IMAGE REGISTRATION
RIGID IMAGE REGISTRATION Duygu Tosun-Turgut, Ph.D. Center for Imaging of Neurodegenerative Diseases Department of Radiology and Biomedical Imaging duygu.tosun@ucsf.edu What is registration? Image registration
More informationCHAPTER 2 TEXTURE CLASSIFICATION METHODS GRAY LEVEL CO-OCCURRENCE MATRIX AND TEXTURE UNIT
CHAPTER 2 TEXTURE CLASSIFICATION METHODS GRAY LEVEL CO-OCCURRENCE MATRIX AND TEXTURE UNIT 2.1 BRIEF OUTLINE The classification of digital imagery is to extract useful thematic information which is one
More information1. Two double lectures about deformable contours. 4. The transparencies define the exam requirements. 1. Matlab demonstration
Practical information INF 5300 Deformable contours, I An introduction 1. Two double lectures about deformable contours. 2. The lectures are based on articles, references will be given during the course.
More informationCloth Simulation. COMP 768 Presentation Zhen Wei
Cloth Simulation COMP 768 Presentation Zhen Wei Outline Motivation and Application Cloth Simulation Methods Physically-based Cloth Simulation Overview Development References 2 Motivation Movies Games VR
More informationFundamentals of Digital Image Processing
\L\.6 Gw.i Fundamentals of Digital Image Processing A Practical Approach with Examples in Matlab Chris Solomon School of Physical Sciences, University of Kent, Canterbury, UK Toby Breckon School of Engineering,
More informationSIFT - scale-invariant feature transform Konrad Schindler
SIFT - scale-invariant feature transform Konrad Schindler Institute of Geodesy and Photogrammetry Invariant interest points Goal match points between images with very different scale, orientation, projective
More informationA Toolbox of Level Set Methods
A Toolbox of Level Set Methods Ian Mitchell Department of Computer Science University of British Columbia http://www.cs.ubc.ca/~mitchell mitchell@cs.ubc.ca research supported by the Natural Science and
More informationWhole Body MRI Intensity Standardization
Whole Body MRI Intensity Standardization Florian Jäger 1, László Nyúl 1, Bernd Frericks 2, Frank Wacker 2 and Joachim Hornegger 1 1 Institute of Pattern Recognition, University of Erlangen, {jaeger,nyul,hornegger}@informatik.uni-erlangen.de
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 14 130307 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Stereo Dense Motion Estimation Translational
More informationAn explicit feature control approach in structural topology optimization
th World Congress on Structural and Multidisciplinary Optimisation 07 th -2 th, June 205, Sydney Australia An explicit feature control approach in structural topology optimization Weisheng Zhang, Xu Guo
More informationOutline 7/2/201011/6/
Outline Pattern recognition in computer vision Background on the development of SIFT SIFT algorithm and some of its variations Computational considerations (SURF) Potential improvement Summary 01 2 Pattern
More informationCourse Review. Computer Animation and Visualisation. Taku Komura
Course Review Computer Animation and Visualisation Taku Komura Characters include Human models Virtual characters Animal models Representation of postures The body has a hierarchical structure Many types
More informationFeature Extraction and Image Processing, 2 nd Edition. Contents. Preface
, 2 nd Edition Preface ix 1 Introduction 1 1.1 Overview 1 1.2 Human and Computer Vision 1 1.3 The Human Vision System 3 1.3.1 The Eye 4 1.3.2 The Neural System 7 1.3.3 Processing 7 1.4 Computer Vision
More informationApplication of Finite Volume Method for Structural Analysis
Application of Finite Volume Method for Structural Analysis Saeed-Reza Sabbagh-Yazdi and Milad Bayatlou Associate Professor, Civil Engineering Department of KNToosi University of Technology, PostGraduate
More information3D Models and Matching
3D Models and Matching representations for 3D object models particular matching techniques alignment-based systems appearance-based systems GC model of a screwdriver 1 3D Models Many different representations
More informationA Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation
, pp.162-167 http://dx.doi.org/10.14257/astl.2016.138.33 A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation Liqiang Hu, Chaofeng He Shijiazhuang Tiedao University,
More informationImage Processing. Filtering. Slide 1
Image Processing Filtering Slide 1 Preliminary Image generation Original Noise Image restoration Result Slide 2 Preliminary Classic application: denoising However: Denoising is much more than a simple
More informationNon-rigid Image Registration using Electric Current Flow
Non-rigid Image Registration using Electric Current Flow Shu Liao, Max W. K. Law and Albert C. S. Chung Lo Kwee-Seong Medical Image Analysis Laboratory, Department of Computer Science and Engineering,
More informationRobert Collins CSE598G. Robert Collins CSE598G
Recall: Kernel Density Estimation Given a set of data samples x i ; i=1...n Convolve with a kernel function H to generate a smooth function f(x) Equivalent to superposition of multiple kernels centered
More informationComputer Vision. Recap: Smoothing with a Gaussian. Recap: Effect of σ on derivatives. Computer Science Tripos Part II. Dr Christopher Town
Recap: Smoothing with a Gaussian Computer Vision Computer Science Tripos Part II Dr Christopher Town Recall: parameter σ is the scale / width / spread of the Gaussian kernel, and controls the amount of
More informationMarcel Worring Intelligent Sensory Information Systems
Marcel Worring worring@science.uva.nl Intelligent Sensory Information Systems University of Amsterdam Information and Communication Technology archives of documentaries, film, or training material, video
More informationShape analysis through geometric distributions
Shape analysis through geometric distributions Nicolas Charon (CIS, Johns Hopkins University) joint work with B. Charlier (Université de Montpellier), I. Kaltenmark (CMLA), A. Trouvé, Hsi-Wei Hsieh (JHU)...
More informationThe 3D DSC in Fluid Simulation
The 3D DSC in Fluid Simulation Marek K. Misztal Informatics and Mathematical Modelling, Technical University of Denmark mkm@imm.dtu.dk DSC 2011 Workshop Kgs. Lyngby, 26th August 2011 Governing Equations
More informationNonrigid Surface Modelling. and Fast Recovery. Department of Computer Science and Engineering. Committee: Prof. Leo J. Jia and Prof. K. H.
Nonrigid Surface Modelling and Fast Recovery Zhu Jianke Supervisor: Prof. Michael R. Lyu Committee: Prof. Leo J. Jia and Prof. K. H. Wong Department of Computer Science and Engineering May 11, 2007 1 2
More informationCSE 554 Lecture 7: Deformation II
CSE 554 Lecture 7: Deformation II Fall 2011 CSE554 Deformation II Slide 1 Review Rigid-body alignment Non-rigid deformation Intrinsic methods: deforming the boundary points An optimization problem Minimize
More informationThe Insight Toolkit. Image Registration Algorithms & Frameworks
The Insight Toolkit Image Registration Algorithms & Frameworks Registration in ITK Image Registration Framework Multi Resolution Registration Framework Components PDE Based Registration FEM Based Registration
More informationMass-Spring Systems. Last Time?
Mass-Spring Systems Last Time? Implicit Surfaces & Marching Cubes/Tetras Collision Detection & Conservative Bounding Regions Spatial Acceleration Data Structures Octree, k-d tree, BSF tree 1 Today Particle
More informationAdarsh Krishnamurthy (cs184-bb) Bela Stepanova (cs184-bs)
OBJECTIVE FLUID SIMULATIONS Adarsh Krishnamurthy (cs184-bb) Bela Stepanova (cs184-bs) The basic objective of the project is the implementation of the paper Stable Fluids (Jos Stam, SIGGRAPH 99). The final
More information1 Introduction Motivation and Aims Functional Imaging Computational Neuroanatomy... 12
Contents 1 Introduction 10 1.1 Motivation and Aims....... 10 1.1.1 Functional Imaging.... 10 1.1.2 Computational Neuroanatomy... 12 1.2 Overview of Chapters... 14 2 Rigid Body Registration 18 2.1 Introduction.....
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 WRI C225 Lecture 04 130131 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Histogram Equalization Image Filtering Linear
More informationAugmented Reality VU. Computer Vision 3D Registration (2) Prof. Vincent Lepetit
Augmented Reality VU Computer Vision 3D Registration (2) Prof. Vincent Lepetit Feature Point-Based 3D Tracking Feature Points for 3D Tracking Much less ambiguous than edges; Point-to-point reprojection
More informationLearning-based Neuroimage Registration
Learning-based Neuroimage Registration Leonid Teverovskiy and Yanxi Liu 1 October 2004 CMU-CALD-04-108, CMU-RI-TR-04-59 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 Abstract
More information(x, y, z) m 2. (x, y, z) ...] T. m 2. m = [m 1. m 3. Φ = r T V 1 r + λ 1. m T Wm. m T L T Lm + λ 2. m T Hm + λ 3. t(x, y, z) = m 1
Class 1: Joint Geophysical Inversions Wed, December 1, 29 Invert multiple types of data residuals simultaneously Apply soft mutual constraints: empirical, physical, statistical Deal with data in the same
More informationCoarse-to-fine image registration
Today we will look at a few important topics in scale space in computer vision, in particular, coarseto-fine approaches, and the SIFT feature descriptor. I will present only the main ideas here to give
More informationEdge detection. Convert a 2D image into a set of curves. Extracts salient features of the scene More compact than pixels
Edge Detection Edge detection Convert a 2D image into a set of curves Extracts salient features of the scene More compact than pixels Origin of Edges surface normal discontinuity depth discontinuity surface
More informationVisual Tracking (1) Pixel-intensity-based methods
Intelligent Control Systems Visual Tracking (1) Pixel-intensity-based methods Shingo Kagami Graduate School of Information Sciences, Tohoku University swk(at)ic.is.tohoku.ac.jp http://www.ic.is.tohoku.ac.jp/ja/swk/
More informationIntensity gradient based registration and fusion of multi-modal images
Intensity gradient based registration and fusion of multi-modal images Eldad Haber 1 and Jan Modersitzki 2 1 Mathematics and Computer Science, Emory University, Atlanta, GA, USA, haber@mathcs.emory,edu
More informationImaging of flow in porous media - from optimal transport to prediction
Imaging of flow in porous media - from optimal transport to prediction Eldad Haber Dept of EOS and Mathematics, UBC October 15, 2013 With Rowan Lars Jenn Cocket Ruthotto Fohring Outline Prediction is very
More informationIMAGE FUSION WITH SIMULTANEOUS CARTOON AND TEXTURE DECOMPOSITION MAHDI DODANGEH, ISABEL NARRA FIGUEIREDO AND GIL GONÇALVES
Pré-Publicações do Departamento de Matemática Universidade de Coimbra Preprint Number 15 14 IMAGE FUSION WITH SIMULTANEOUS CARTOON AND TEXTURE DECOMPOSITION MAHDI DODANGEH, ISABEL NARRA FIGUEIREDO AND
More informationDigital Image Processing. Image Enhancement - Filtering
Digital Image Processing Image Enhancement - Filtering Derivative Derivative is defined as a rate of change. Discrete Derivative Finite Distance Example Derivatives in 2-dimension Derivatives of Images
More informationRegistration-Based Segmentation of Medical Images
School of Computing National University of Singapore Graduate Research Paper Registration-Based Segmentation of Medical Images by Li Hao under guidance of A/Prof. Leow Wee Kheng July, 2006 Abstract Medical
More information