DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency weighting

Size: px
Start display at page:

Download "DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency weighting"

Transcription

1 DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency weighting Yangming Ou, Christos Davatzikos Section of Biomedical Image Analysis (SBIA) University of Pennsylvania

2 Outline 1. Background 2. Motivations 3. Framework 4. Methods 5. Results 6. Discussions 2

3 1. Background Definition of Registration Image Registration is the process of finding the optimal transformation that aligns different imaging data into spatial correspondence. [Maintz & Viergever 98, Lester & Arridge 99, Hill 01, Zitova 03, Pluim 03, Crum 04, Holden 08] Source (Subject) Target (Template) S2T (overlaid on T) Transformation (Deformation Field) 3

4 1. Background Registration Literature Division of Most Registration Methods: Category 1 Landmark/feature-based Category 2 voxel-wise (intensity-based) DRAMMS 4

5 1. Background Registration Literature (1) Expected: General-purpose registration methods! brain A brain B heart A heart B breast A breast B prostate A prostate B brain heart breast prostate Category 1: Landmark/feature-based methods [Davatzikos 96, Thompson 98, Rohr 01, Johnson 02, Shen 02, Joshi 00, Chui 03,...] Pros: 1) Intuitive; 2) Fast; Not suitable for general-purpose [Figure from Rohl 03]. Cons: 1) Errors in landmark detection & matching; 2) Task-specific: different registration tasks need different landmark detection methods. 5

6 1. Background Registration Literature (2) Category 2: (Intensity-based) Voxel-wise methods [Christensen'94, Collins'94, Thirion'98, Rueckert'99, Vercauteren'07, Glocker'08,...] Images Under Registration Joint Histogram After Reg. A B A2B white Assumption: A [figure from Rueckert 99] B black black A2B white white B Consistent relationship between intensity distributions black black white B [figures from Papademetris] Pro: General-purpose registration methods (only rely on intensities). Con: 1) 2) => motivations for DRAMMS 6

7 Outline 1. Background 2. Motivations 3. Framework 4. Methods 5. Results 6. Discussions 7

8 2. Motivations (1): Why? Challenge 1: No consistent relationship in intensity distributions Histological Image (Prostate) MR Image (Same Prostate) white black black black intensity-based voxel-wise methods (e.g. MI) fail. Matching Ambiguity Black White Black Reason: Matching ambiguity <= characterizing voxels only by intensities. Not Distinctive! 8

9 2. Motivations (1): How? Proposed Solution to Challenge 1: - To reduce matching ambiguity, 1-dim image intensity => high-dim attribute vector Similarity map (by attributes) High similarity Low similarity Attribute Matching DRAMMS 9

10 2. Motivations (2) Challenge 2: Partial loss of correspondence Histological Image (Prostate) MR Image (Prostate) Normal Brain Brain w/ lesion Inspiration 2: A continuous weighting mechanism for all voxels: -Weight high for voxels able to establish reliable correspondence; => let them drive the registration -Weight low for voxels not able to establish reliable correspondence. => reduce their negative impact to the registration Mutual-Saliency weighting DRAMMS 10

11 Outline 1. Background 2. Motivations 3. Framework 4. Methods 5. Results 6. Discussions 11

12 Framework 2. Mutual-Saliency 1. Attribute-Matching Deformable Registration via A T? B 1. Attribute Matching u T(u) To reduce matching ambiguities 2. Mutual-Saliency weighting To account for loss of correspondence DRAMMS 12

13 Outline 1. Background 2. Motivations 3. Framework 4. Methods 4.1. Attribute Extraction and Selection 4.2. Mutual-Saliency Weighting 4.3. Implementation 5. Results 6. Discussions 13

14 Attribute Extraction Ideal Attributes 1) Generally Applicable: to diverse registration tasks; 2) Discriminative: voxels similar iff true correspondence. Recent work [Shen and Davatzikos 01, Liu 02, Xue 04, Verma 04, Wu 07, etc] - Intensity attributes - Edge attributes - Tissue membership attributes (based on segmentation) - Geometric moment invariant attributes - Wavelet attributes - Local histogram attributes 14

15 4.1.1 Attribute Extraction Gabor Attributes A(x) A (0) (x) x A (1) (x) A (2) (x) A (3) (x) Gabor filter bank (multiscale, multi-orientation) 15

16 Why Gabor Attributes? Reason 0: Sometimes, maybe one reason is enough Dennis Gabor ( ) Nobel Prize in Physics (1971) 16

17 Why Gabor Attributes? Reason 1/3: General Applicability brain heart breast prostate Success in Texture segmentation [e.g., Jain 91]; Cancer detection [e.g., Zhang 04]; Prostate tissue differentiation [e.g., Zhan 06]; Brain registration tasks [e.g., Liu 02, Verma 04, Elbacary 06]; 17

18 Why Gabor Attributes? Reason 2/3: Multi-scale and Multi-orientation. characterize voxels distinctively Original Image scale scale Gabor Attributes orientation 18 orientation

19 Why Gabor Attributes? Reason 3/3: Suitable for Registration Original Image High Freq. Gabor Attributes Edge maps => relatively independent of intensity distributions Low Freq. Gabor Attributes Smoothed (coarse) version => reduce local minimum in reg.. 19

20 Gabor Attributes characterize voxels distinctively Special Points Ordinary Points 20

21 Select Optimal Gabor Attributes Why? 1) Non-orthogonality among Gabor filters redundancy; 2) Attribute vector A( ) being too long computational expensive. How? Step 1: Select training voxel pairs: Mutual- Saliency Step 2: Select attribute on training voxel pairs: Training voxel pairs Mutual- Saliency by iterative backward elimination and forward inclusion. 21

22 Role of Gabor Attributes and Optimal Gabor Attributes distinctiveness 22

23 Role of Gabor Attributes and Optimal Gabor Attributes distinctiveness 23

24 Outline 1. Background 2. Motivations 3. Framework 4. Methods 4.1. Attribute Extraction and Selection 4.2. Mutual-Saliency Weighting 4.3. Implementation 5. Results 6. Discussions 24

25 Framework 2. Mutual-Saliency 1. Attribute-Matching Deformable Registration via A T? B 1. Attribute Matching u T(u) To reduce matching ambiguities 2. Mutual-Saliency weighting To account for loss of correspondence DRAMMS 25

26 4.2. Mutual-Saliency weighting Recent work [Bond 05, Wu 07, Mahapha 08] Their approach: Higher weights for more salient regions Their assumption: Salient regions more likely to establish reliable correspondence. Saliency in one image => Matching reliability between two images? A counterexample Our work: saliency in one image => mutual-saliency b/w two images [Anandan 89, McEache 97] Directly measure matching reliability 26

27 4.2. Mutual Saliency (MS) weighting Idea: True correspondence should similar to each other; not similar to anything else. similarity Delta fun. u Calculation of MS: T(u) Reliable matching High MS value where 27

28 Role of Mutual-Saliency Map Account for partial loss of correspondence Registration without MS map Source image Target image MS map Registration with MS map 28

29 Outline 1. Background 2. Motivations 3. Framework 4. Methods 4.1. Attribute Extraction and Selection 4.2. Mutual-Saliency Weighting 4.3. Implementation 5. Results 6. Discussions 29

30 4.3. Implementation Optimized and regularized by Free Form Deformation (FFD) model [Rueckert 99] Diffeomorphism FFD [Rueckert 06] Multi-resolution to reduce local minima Gradient descent optimization Implemented in C Run on 2.8G CPU, Unix OS 30

31 Outline 1. Background 2. Motivations 3. Framework 4. Methods 5. Results 5.1. Cross-subject registration; 5.2. Multi-modality registration; 5.3. Longitudinal registration; 5.4. Atlas construction. 6. Discussions 31

32 5.1. Cross-subject Registrations A2B deformation Brain A (Subject) B (Template) A2B deformation Cardiac Evaluate registration accuracy by mean sq. diff. (MSD) and corr. coef. (CC) between registered image and target image. 32

33 5.1. Cross-subject Registrations Observations: 1) In images that intensity-based method can register, attribute matching increased registration accuracy considerably; 2) Each of DRAMMS components provides additive improvement for registration accuracy. 33

34 5.2. Multi-modality Registrations Human Prostate Histology MR Histology2MR Mutual-saliency Histological Joint histogram after registration MR 34

35 5.2. Multi-modality Registrations Mouse Brain Histology MR Histology2MR Mutual-saliency Joint histogram after registration 35

36 5.3. Longitudinal Registration 36

37 5.4. Atlas Construction Images from 30 training subjects template 37

38 5.4 Atlas Construction (cont.) By intensity-based FFD (mutual-information) By DRAMMS 38

39 5.4. Atlas Construction (cont.) Lesion Low MS weight 39

40 5.4. Atlas Construction (cont.) Mean Mutual-Saliency Map in 3D 40

41 Outline 1. Background 2. Motivations 3. Framework 4. Methods 5. Results 6. Discussions 41

42 Discussions DRAMMS: a general-purpose registration method; Diffeomorphism Improves MI-based methods, especially when 1) no consistent relationship between intensity distributions; 2) loss of correspondence 42

43 DRAMMS A bridge between two categories of methods Category 1 Landmark/feature-based Category 2 voxel-wise (intensity-based) DRAMMS 43

44 DRAMMS bridge 1 DRAMMS Attribute Matching Category 1 Landmark-based Category 2 voxel-wise Every voxel will become a landmark to some extent. Still using all voxels 44

45 DRAMMS bridge 2 DRAMMS Mutual-Saliency weighting Category 1 Landmark-based Category 2 voxel-wise Weight = 1 for landmarks 0 otherwise Weight = 1 for all voxels 45

46 Take-home message Deformable Registration via 1. (optimal) Attribute Matching To reduce matching ambiguities 2. Mutual-Saliency weighting To account for loss of correspondence DRAMMS 46

47 Thank you! Code to be available: (Lab) (Personal) 47

DRAMMS: deformable registration via attribute matching and mutual-saliency weighting

DRAMMS: deformable registration via attribute matching and mutual-saliency weighting University of Pennsylvania ScholarlyCommons Departmental Papers (BE) Department of Bioengineering 7-2009 DRAMMS: deformable registration via attribute matching and mutual-saliency weighting Yangming Ou

More information

Attribute Similarity and Mutual-Saliency Weighting for Registration and Label Fusion

Attribute Similarity and Mutual-Saliency Weighting for Registration and Label Fusion Attribute Similarity and Mutual-Saliency Weighting for Registration and Label Fusion Yangming Ou, Jimit Doshi, Guray Erus, and Christos Davatzikos Section of Biomedical Image Analysis (SBIA) Department

More information

Medical Image Analysis

Medical Image Analysis Medical Image Analysis 15 (2011) 622 639 Contents lists available at ScienceDirect Medical Image Analysis journal homepage: www.elsevier.com/locate/media DRAMMS: Deformable registration via attribute matching

More information

Multi-Atlas Segmentation of the Cardiac MR Right Ventricle

Multi-Atlas Segmentation of the Cardiac MR Right Ventricle Multi-Atlas Segmentation of the Cardiac MR Right Ventricle Yangming Ou, Jimit Doshi, Guray Erus, and Christos Davatzikos Section of Biomedical Image Analysis (SBIA) Department of Radiology, University

More information

Non-rigid Image Registration using Electric Current Flow

Non-rigid Image Registration using Electric Current Flow Non-rigid Image Registration using Electric Current Flow Shu Liao, Max W. K. Law and Albert C. S. Chung Lo Kwee-Seong Medical Image Analysis Laboratory, Department of Computer Science and Engineering,

More information

Correspondence Detection Using Wavelet-Based Attribute Vectors

Correspondence Detection Using Wavelet-Based Attribute Vectors Correspondence Detection Using Wavelet-Based Attribute Vectors Zhong Xue, Dinggang Shen, and Christos Davatzikos Section of Biomedical Image Analysis, Department of Radiology University of Pennsylvania,

More information

The Anatomical Equivalence Class Formulation and its Application to Shape-based Computational Neuroanatomy

The Anatomical Equivalence Class Formulation and its Application to Shape-based Computational Neuroanatomy The Anatomical Equivalence Class Formulation and its Application to Shape-based Computational Neuroanatomy Sokratis K. Makrogiannis, PhD From post-doctoral research at SBIA lab, Department of Radiology,

More information

Automatic Registration-Based Segmentation for Neonatal Brains Using ANTs and Atropos

Automatic Registration-Based Segmentation for Neonatal Brains Using ANTs and Atropos Automatic Registration-Based Segmentation for Neonatal Brains Using ANTs and Atropos Jue Wu and Brian Avants Penn Image Computing and Science Lab, University of Pennsylvania, Philadelphia, USA Abstract.

More information

Registration by continuous optimisation. Stefan Klein Erasmus MC, the Netherlands Biomedical Imaging Group Rotterdam (BIGR)

Registration by continuous optimisation. Stefan Klein Erasmus MC, the Netherlands Biomedical Imaging Group Rotterdam (BIGR) Registration by continuous optimisation Stefan Klein Erasmus MC, the Netherlands Biomedical Imaging Group Rotterdam (BIGR) Registration = optimisation C t x t y 1 Registration = optimisation C t x t y

More information

MARS: Multiple Atlases Robust Segmentation

MARS: Multiple Atlases Robust Segmentation Software Release (1.0.1) Last updated: April 30, 2014. MARS: Multiple Atlases Robust Segmentation Guorong Wu, Minjeong Kim, Gerard Sanroma, and Dinggang Shen {grwu, mjkim, gerard_sanroma, dgshen}@med.unc.edu

More information

Learning-based Neuroimage Registration

Learning-based Neuroimage Registration Learning-based Neuroimage Registration Leonid Teverovskiy and Yanxi Liu 1 October 2004 CMU-CALD-04-108, CMU-RI-TR-04-59 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 Abstract

More information

RIGID IMAGE REGISTRATION

RIGID IMAGE REGISTRATION RIGID IMAGE REGISTRATION Duygu Tosun-Turgut, Ph.D. Center for Imaging of Neurodegenerative Diseases Department of Radiology and Biomedical Imaging duygu.tosun@ucsf.edu What is registration? Image registration

More information

Graph-based Deformable Image Registration

Graph-based Deformable Image Registration Graph-based Deformable Image Registration Aristeidis Sotiras, Yangming Ou, Nikos Paragios and Christos Davatzikos Abstract Deformable image registration is a field that has received considerable attention

More information

Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion

Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion Mattias P. Heinrich Julia A. Schnabel, Mark Jenkinson, Sir Michael Brady 2 Clinical

More information

Nonrigid Registration using Free-Form Deformations

Nonrigid Registration using Free-Form Deformations Nonrigid Registration using Free-Form Deformations Hongchang Peng April 20th Paper Presented: Rueckert et al., TMI 1999: Nonrigid registration using freeform deformations: Application to breast MR images

More information

Fast Image Registration via Joint Gradient Maximization: Application to Multi-Modal Data

Fast Image Registration via Joint Gradient Maximization: Application to Multi-Modal Data MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Fast Image Registration via Joint Gradient Maximization: Application to Multi-Modal Data Xue Mei, Fatih Porikli TR-19 September Abstract We

More information

Image Registration. Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department

Image Registration. Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department Image Registration Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department Introduction Visualize objects inside the human body Advances in CS methods to diagnosis, treatment planning and medical

More information

Measuring longitudinal brain changes in humans and small animal models. Christos Davatzikos

Measuring longitudinal brain changes in humans and small animal models. Christos Davatzikos Measuring longitudinal brain changes in humans and small animal models Christos Davatzikos Section of Biomedical Image Analysis University of Pennsylvania (Radiology) http://www.rad.upenn.edu/sbia Computational

More information

Introduction to Medical Image Registration

Introduction to Medical Image Registration Introduction to Medical Image Registration Sailesh Conjeti Computer Aided Medical Procedures (CAMP), Technische Universität München, Germany sailesh.conjeti@tum.de Partially adapted from slides by: 1.

More information

Non-rigid Image Registration

Non-rigid Image Registration Overview Non-rigid Image Registration Introduction to image registration - he goal of image registration - Motivation for medical image registration - Classification of image registration - Nonrigid registration

More information

GLIRT: Groupwise and Longitudinal Image Registration Toolbox

GLIRT: Groupwise and Longitudinal Image Registration Toolbox Software Release (1.0.1) Last updated: March. 30, 2011. GLIRT: Groupwise and Longitudinal Image Registration Toolbox Guorong Wu 1, Qian Wang 1,2, Hongjun Jia 1, and Dinggang Shen 1 1 Image Display, Enhancement,

More information

Robust Linear Registration of CT images using Random Regression Forests

Robust Linear Registration of CT images using Random Regression Forests Robust Linear Registration of CT images using Random Regression Forests Ender Konukoglu a Antonio Criminisi a Sayan Pathak b Duncan Robertson a Steve White b David Haynor c Khan Siddiqui b a Microsoft

More information

Deformable MRI-Ultrasound Registration via Attribute Matching and Mutual-Saliency Weighting for Image-Guided Neurosurgery

Deformable MRI-Ultrasound Registration via Attribute Matching and Mutual-Saliency Weighting for Image-Guided Neurosurgery Deformable MRI-Ultrasound Registration via Attribute Matching and Mutual-Saliency Weighting for Image-Guided Neurosurgery Inês Machado 1,2(&), Matthew Toews 3, Jie Luo 1,4, Prashin Unadkat 5, Walid Essayed

More information

White Matter Lesion Segmentation (WMLS) Manual

White Matter Lesion Segmentation (WMLS) Manual White Matter Lesion Segmentation (WMLS) Manual 1. Introduction White matter lesions (WMLs) are brain abnormalities that appear in different brain diseases, such as multiple sclerosis (MS), head injury,

More information

Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information

Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information Andreas Biesdorf 1, Stefan Wörz 1, Hans-Jürgen Kaiser 2, Karl Rohr 1 1 University of Heidelberg, BIOQUANT, IPMB,

More information

Non-Rigid Registration of Medical Images: Theory, Methods and Applications

Non-Rigid Registration of Medical Images: Theory, Methods and Applications Non-Rigid Registration of Medical Images: Theory, Methods and Applications Daniel Rueckert Paul Aljabar Medical mage registration [1] plays an increasingly important role in many clinical applications

More information

Non-Rigid Multimodal Medical Image Registration using Optical Flow and Gradient Orientation

Non-Rigid Multimodal Medical Image Registration using Optical Flow and Gradient Orientation M. HEINRICH et al.: MULTIMODAL REGISTRATION USING GRADIENT ORIENTATION 1 Non-Rigid Multimodal Medical Image Registration using Optical Flow and Gradient Orientation Mattias P. Heinrich 1 mattias.heinrich@eng.ox.ac.uk

More information

Image Segmentation and Registration

Image Segmentation and Registration Image Segmentation and Registration Dr. Christine Tanner (tanner@vision.ee.ethz.ch) Computer Vision Laboratory, ETH Zürich Dr. Verena Kaynig, Machine Learning Laboratory, ETH Zürich Outline Segmentation

More information

Free-Form B-spline Deformation Model for Groupwise Registration

Free-Form B-spline Deformation Model for Groupwise Registration Free-Form B-spline Deformation Model for Groupwise Registration Serdar K. Balci 1, Polina Golland 1, Martha Shenton 2, and William M. Wells 2 1 CSAIL, MIT, Cambridge, MA, USA, 2 Brigham & Women s Hospital,

More information

2. LITERATURE REVIEW

2. LITERATURE REVIEW 2. LITERATURE REVIEW CBIR has come long way before 1990 and very little papers have been published at that time, however the number of papers published since 1997 is increasing. There are many CBIR algorithms

More information

Free-Form B-spline Deformation Model for Groupwise Registration

Free-Form B-spline Deformation Model for Groupwise Registration Free-Form B-spline Deformation Model for Groupwise Registration The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters Citation Balci

More information

A Generic Framework for Non-rigid Registration Based on Non-uniform Multi-level Free-Form Deformations

A Generic Framework for Non-rigid Registration Based on Non-uniform Multi-level Free-Form Deformations A Generic Framework for Non-rigid Registration Based on Non-uniform Multi-level Free-Form Deformations Julia A. Schnabel 1, Daniel Rueckert 2, Marcel Quist 3, Jane M. Blackall 1, Andy D. Castellano-Smith

More information

Lung registration using the NiftyReg package

Lung registration using the NiftyReg package Lung registration using the NiftyReg package Marc Modat, Jamie McClelland and Sébastien Ourselin Centre for Medical Image Computing, University College London, UK Abstract. The EMPIRE 2010 grand challenge

More information

Medical Image Registration by Maximization of Mutual Information

Medical Image Registration by Maximization of Mutual Information Medical Image Registration by Maximization of Mutual Information EE 591 Introduction to Information Theory Instructor Dr. Donald Adjeroh Submitted by Senthil.P.Ramamurthy Damodaraswamy, Umamaheswari Introduction

More information

Non-Rigid Registration of Medical Images: Theory, Methods and Applications

Non-Rigid Registration of Medical Images: Theory, Methods and Applications Non-Rigid Registration of Medical Images: Theory, Methods and Applications Daniel Rueckert Paul Aljabar Medical image registration [1] plays an increasingly important role in many clinical applications

More information

HST.582J / 6.555J / J Biomedical Signal and Image Processing Spring 2007

HST.582J / 6.555J / J Biomedical Signal and Image Processing Spring 2007 MIT OpenCourseWare http://ocw.mit.edu HST.582J / 6.555J / 16.456J Biomedical Signal and Image Processing Spring 2007 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

Snakes, level sets and graphcuts. (Deformable models)

Snakes, level sets and graphcuts. (Deformable models) INSTITUTE OF INFORMATION AND COMMUNICATION TECHNOLOGIES BULGARIAN ACADEMY OF SCIENCE Snakes, level sets and graphcuts (Deformable models) Centro de Visión por Computador, Departament de Matemàtica Aplicada

More information

Probabilistic Registration of 3-D Medical Images

Probabilistic Registration of 3-D Medical Images Probabilistic Registration of 3-D Medical Images Mei Chen, Takeo Kanade, Dean Pomerleau, Jeff Schneider CMU-RI-TR-99-16 The Robotics Institute Carnegie Mellon University Pittsburgh, Pennsylvania 1513 July,

More information

Adaptive Local Multi-Atlas Segmentation: Application to Heart Segmentation in Chest CT Scans

Adaptive Local Multi-Atlas Segmentation: Application to Heart Segmentation in Chest CT Scans Adaptive Local Multi-Atlas Segmentation: Application to Heart Segmentation in Chest CT Scans Eva M. van Rikxoort, Ivana Isgum, Marius Staring, Stefan Klein and Bram van Ginneken Image Sciences Institute,

More information

An Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014

An Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014 An Introduction To Automatic Tissue Classification Of Brain MRI Colm Elliott Mar 2014 Tissue Classification Tissue classification is part of many processing pipelines. We often want to classify each voxel

More information

Available Online through

Available Online through Available Online through www.ijptonline.com ISSN: 0975-766X CODEN: IJPTFI Research Article ANALYSIS OF CT LIVER IMAGES FOR TUMOUR DIAGNOSIS BASED ON CLUSTERING TECHNIQUE AND TEXTURE FEATURES M.Krithika

More information

Image Registration Lecture 4: First Examples

Image Registration Lecture 4: First Examples Image Registration Lecture 4: First Examples Prof. Charlene Tsai Outline Example Intensity-based registration SSD error function Image mapping Function minimization: Gradient descent Derivative calculation

More information

Distance Transforms in Multi Channel MR Image Registration

Distance Transforms in Multi Channel MR Image Registration Distance Transforms in Multi Channel MR Image Registration Min Chen 1, Aaron Carass 1, John Bogovic 1, Pierre-Louis Bazin 2 and Jerry L. Prince 1 1 Image Analysis and Communications Laboratory, 2 The Laboratory

More information

Where are we now? Structural MRI processing and analysis

Where are we now? Structural MRI processing and analysis Where are we now? Structural MRI processing and analysis Pierre-Louis Bazin bazin@cbs.mpg.de Leipzig, Germany Structural MRI processing: why bother? Just use the standards? SPM FreeSurfer FSL However:

More information

Efficient population registration of 3D data

Efficient population registration of 3D data Efficient population registration of 3D data Lilla Zöllei 1, Erik Learned-Miller 2, Eric Grimson 1, William Wells 1,3 1 Computer Science and Artificial Intelligence Lab, MIT; 2 Dept. of Computer Science,

More information

Atlas Based Segmentation of the prostate in MR images

Atlas Based Segmentation of the prostate in MR images Atlas Based Segmentation of the prostate in MR images Albert Gubern-Merida and Robert Marti Universitat de Girona, Computer Vision and Robotics Group, Girona, Spain {agubern,marly}@eia.udg.edu Abstract.

More information

Deformable Registration Using Scale Space Keypoints

Deformable Registration Using Scale Space Keypoints Deformable Registration Using Scale Space Keypoints Mehdi Moradi a, Purang Abolmaesoumi a,b and Parvin Mousavi a a School of Computing, Queen s University, Kingston, Ontario, Canada K7L 3N6; b Department

More information

Whole Body MRI Intensity Standardization

Whole Body MRI Intensity Standardization Whole Body MRI Intensity Standardization Florian Jäger 1, László Nyúl 1, Bernd Frericks 2, Frank Wacker 2 and Joachim Hornegger 1 1 Institute of Pattern Recognition, University of Erlangen, {jaeger,nyul,hornegger}@informatik.uni-erlangen.de

More information

3D Registration based on Normalized Mutual Information

3D Registration based on Normalized Mutual Information 3D Registration based on Normalized Mutual Information Performance of CPU vs. GPU Implementation Florian Jung, Stefan Wesarg Interactive Graphics Systems Group (GRIS), TU Darmstadt, Germany stefan.wesarg@gris.tu-darmstadt.de

More information

Non-Rigid Image Registration III

Non-Rigid Image Registration III Non-Rigid Image Registration III CS6240 Multimedia Analysis Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore Leow Wee Kheng (CS6240) Non-Rigid Image Registration

More information

Preprocessing II: Between Subjects John Ashburner

Preprocessing II: Between Subjects John Ashburner Preprocessing II: Between Subjects John Ashburner Pre-processing Overview Statistics or whatever fmri time-series Anatomical MRI Template Smoothed Estimate Spatial Norm Motion Correct Smooth Coregister

More information

Good Morning! Thank you for joining us

Good Morning! Thank you for joining us Good Morning! Thank you for joining us Deformable Registration, Contour Propagation and Dose Mapping: 101 and 201 Marc Kessler, PhD, FAAPM The University of Michigan Conflict of Interest I receive direct

More information

Introduction to Medical Image Processing

Introduction to Medical Image Processing Introduction to Medical Image Processing Δ Essential environments of a medical imaging system Subject Image Analysis Energy Imaging System Images Image Processing Feature Images Image processing may be

More information

3D Voxel-Based Volumetric Image Registration with Volume-View Guidance

3D Voxel-Based Volumetric Image Registration with Volume-View Guidance 3D Voxel-Based Volumetric Image Registration with Volume-View Guidance Guang Li*, Huchen Xie, Holly Ning, Deborah Citrin, Jacek Copala, Barbara Arora, Norman Coleman, Kevin Camphausen, and Robert Miller

More information

Multichannel Image Registration using Gabor Wavelet Transform

Multichannel Image Registration using Gabor Wavelet Transform IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 8, Issue 3 (Nov. - Dec. 2013), PP 31-36 Multichannel Image Registration using Gabor Wavelet

More information

EMSegmenter Tutorial (Advanced Mode)

EMSegmenter Tutorial (Advanced Mode) EMSegmenter Tutorial (Advanced Mode) Dominique Belhachemi Section of Biomedical Image Analysis Department of Radiology University of Pennsylvania 1/65 Overview The goal of this tutorial is to apply the

More information

Transitive and Symmetric Nonrigid Image Registration. Yi-Yu Chou

Transitive and Symmetric Nonrigid Image Registration. Yi-Yu Chou Transitive and Symmetric Nonrigid Image Registration A Thesis Presented to The Academic Faculty by Yi-Yu Chou In Partial Fulfillment of the Requirements for the Degree Master of Science School of Biomedical

More information

Medical Image Synthesis Methods and Applications

Medical Image Synthesis Methods and Applications MR Intensity Scale is Arbitrary This causes problems in most postprocessing methods Inconsistency or algorithm failure 11/5/2015 2 Joint Histogram 1.5 T GE SPGR 3 T Philips MPRAGE 11/5/2015 3 Problem With

More information

Lilla Zöllei A.A. Martinos Center, MGH; Boston, MA

Lilla Zöllei A.A. Martinos Center, MGH; Boston, MA Lilla Zöllei lzollei@nmr.mgh.harvard.edu A.A. Martinos Center, MGH; Boston, MA Bruce Fischl Gheorghe Postelnicu Jean Augustinack Anastasia Yendiki Allison Stevens Kristen Huber Sita Kakonoori + the FreeSurfer

More information

William Yang Group 14 Mentor: Dr. Rogerio Richa Visual Tracking of Surgical Tools in Retinal Surgery using Particle Filtering

William Yang Group 14 Mentor: Dr. Rogerio Richa Visual Tracking of Surgical Tools in Retinal Surgery using Particle Filtering Mutual Information Computation and Maximization Using GPU Yuping Lin and Gérard Medioni Computer Vision and Pattern Recognition Workshops (CVPR) Anchorage, AK, pp. 1-6, June 2008 Project Summary and Paper

More information

Norbert Schuff VA Medical Center and UCSF

Norbert Schuff VA Medical Center and UCSF Norbert Schuff Medical Center and UCSF Norbert.schuff@ucsf.edu Medical Imaging Informatics N.Schuff Course # 170.03 Slide 1/67 Objective Learn the principle segmentation techniques Understand the role

More information

Image Registration I

Image Registration I Image Registration I Comp 254 Spring 2002 Guido Gerig Image Registration: Motivation Motivation for Image Registration Combine images from different modalities (multi-modality registration), e.g. CT&MRI,

More information

Fast Free-Form Deformation using the Normalised Mutual Information gradient and Graphics Processing Units

Fast Free-Form Deformation using the Normalised Mutual Information gradient and Graphics Processing Units Fast Free-Form Deformation using the Normalised Mutual Information gradient and Graphics Processing Units Marc Modat 1, Zeike A. Taylor 1, Josephine Barnes 2, David J. Hawkes 1, Nick C. Fox 2, and Sébastien

More information

Regional Manifold Learning for Deformable Registration of Brain MR Images

Regional Manifold Learning for Deformable Registration of Brain MR Images Regional Manifold Learning for Deformable Registration of Brain MR Images Dong Hye Ye, Jihun Hamm, Dongjin Kwon, Christos Davatzikos, and Kilian M. Pohl Department of Radiology, University of Pennsylvania,

More information

Low-Rank to the Rescue Atlas-based Analyses in the Presence of Pathologies

Low-Rank to the Rescue Atlas-based Analyses in the Presence of Pathologies Low-Rank to the Rescue Atlas-based Analyses in the Presence of Pathologies Xiaoxiao Liu 1, Marc Niethammer 2, Roland Kwitt 3, Matthew McCormick 1, and Stephen Aylward 1 1 Kitware Inc., USA 2 University

More information

Modeling 4D Changes in Pathological Anatomy Using Domain Adaptation: Analysis of TBI Imaging Using a Tumor Database

Modeling 4D Changes in Pathological Anatomy Using Domain Adaptation: Analysis of TBI Imaging Using a Tumor Database Modeling 4D Changes in Pathological Anatomy Using Domain Adaptation: Analysis of TBI Imaging Using a Tumor Database Bo Wang 1,2,, Marcel Prastawa 1,2, Avishek Saha 1,2, Suyash P. Awate 1,2, Andrei Irimia

More information

Learning Based Coarse-to-fine Image Registration

Learning Based Coarse-to-fine Image Registration Learning Based Coarse-to-fine Image Registration Jiayan Jiang LONI, UCLA jet.jiang@loni.ucla.edu Songfeng Zheng Dept. of Statistics, UCLA sfzheng@stat.ucla.edu Arthur W. Toga LONI, UCLA toga@loni.ucla.edu

More information

A Model-Independent, Multi-Image Approach to MR Inhomogeneity Correction

A Model-Independent, Multi-Image Approach to MR Inhomogeneity Correction Tina Memo No. 2007-003 Published in Proc. MIUA 2007 A Model-Independent, Multi-Image Approach to MR Inhomogeneity Correction P. A. Bromiley and N.A. Thacker Last updated 13 / 4 / 2007 Imaging Science and

More information

MARS: Multiple Atlases Robust Segmentation

MARS: Multiple Atlases Robust Segmentation Software Release (1.0.1) Last updated: April 30, 2014. MARS: Multiple Atlases Robust Segmentation Guorong Wu, Minjeong Kim, Gerard Sanroma, and Dinggang Shen {grwu, mjkim, gerard_sanroma, dgshen}@med.unc.edu

More information

K-Means Clustering Using Localized Histogram Analysis

K-Means Clustering Using Localized Histogram Analysis K-Means Clustering Using Localized Histogram Analysis Michael Bryson University of South Carolina, Department of Computer Science Columbia, SC brysonm@cse.sc.edu Abstract. The first step required for many

More information

Segmentation of Prostate Boundaries From Ultrasound Images Using Statistical Shape Model

Segmentation of Prostate Boundaries From Ultrasound Images Using Statistical Shape Model IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 22, NO. 4, APRIL 2003 539 Segmentation of Prostate Boundaries From Ultrasound Images Using Statistical Shape Model Dinggang Shen 3, Yiqiang Zhan, and Christos

More information

Prototype of Silver Corpus Merging Framework

Prototype of Silver Corpus Merging Framework www.visceral.eu Prototype of Silver Corpus Merging Framework Deliverable number D3.3 Dissemination level Public Delivery data 30.4.2014 Status Authors Final Markus Krenn, Allan Hanbury, Georg Langs This

More information

Using K-means Clustering and MI for Non-rigid Registration of MRI and CT

Using K-means Clustering and MI for Non-rigid Registration of MRI and CT Using K-means Clustering and MI for Non-rigid Registration of MRI and CT Yixun Liu 1,2 and Nikos Chrisochoides 2 1 Department of Computer Science, College of William and Mary, enjoywm@cs.wm.edu 2 Department

More information

Methods for data preprocessing

Methods for data preprocessing Methods for data preprocessing John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK. Overview Voxel-Based Morphometry Morphometry in general Volumetrics VBM preprocessing

More information

Subvoxel Segmentation and Representation of Brain Cortex Using Fuzzy Clustering and Gradient Vector Diffusion

Subvoxel Segmentation and Representation of Brain Cortex Using Fuzzy Clustering and Gradient Vector Diffusion Subvoxel Segmentation and Representation of Brain Cortex Using Fuzzy Clustering and Gradient Vector Diffusion Ming-Ching Chang Xiaodong Tao GE Global Research Center {changm, taox} @ research.ge.com SPIE

More information

UNC 4D Infant Cortical Surface Atlases, from Neonate to 6 Years of Age

UNC 4D Infant Cortical Surface Atlases, from Neonate to 6 Years of Age UNC 4D Infant Cortical Surface Atlases, from Neonate to 6 Years of Age Version 1.0 UNC 4D infant cortical surface atlases from neonate to 6 years of age contain 11 time points, including 1, 3, 6, 9, 12,

More information

A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images

A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images Jianhua Yao 1, Russell Taylor 2 1. Diagnostic Radiology Department, Clinical Center,

More information

Large-Deformation Image Registration using Fluid Landmarks

Large-Deformation Image Registration using Fluid Landmarks Large-Deformation Image Registration using Fluid Landmarks G.E. Christensen 1,P.Yin 1,.W. Vannier 2, K.S.C. Chao 3, J.F. Dempsey 3, and J.F. Williamson 3 1 Department of Electrical and Computer Engineering

More information

Volumetry of hypothalamic substructures by multimodal morphological image registration

Volumetry of hypothalamic substructures by multimodal morphological image registration Volumetry of hypothalamic substructures by multimodal morphological image registration Dominik Löchel 14.09.2011 Institute for Applied and Numerical Mathematics KIT University of the State of Baden-Württemberg

More information

ENTROPY CORRELATION COEFFICIENT TECHNIQUE FOR VISUAL DATA IN MULTIMEDIA SENSOR NETWORK

ENTROPY CORRELATION COEFFICIENT TECHNIQUE FOR VISUAL DATA IN MULTIMEDIA SENSOR NETWORK ENTROPY CORRELATION COEFFICIENT TECHNIQUE FOR VISUAL DATA IN MULTIMEDIA SENSOR NETWORK SUBHASH S PG Student, Dept of CSE, MCE, HASSAN, INDIA subhashsgowda@gmail.com GURURAJ H L Asst. Professor, CSE, MCE,

More information

Biomedical Image Processing

Biomedical Image Processing Biomedical Image Processing Jason Thong Gabriel Grant 1 2 Motivation from the Medical Perspective MRI, CT and other biomedical imaging devices were designed to assist doctors in their diagnosis and treatment

More information

The Insight Toolkit. Image Registration Algorithms & Frameworks

The Insight Toolkit. Image Registration Algorithms & Frameworks The Insight Toolkit Image Registration Algorithms & Frameworks Registration in ITK Image Registration Framework Multi Resolution Registration Framework Components PDE Based Registration FEM Based Registration

More information

Ensemble registration: Combining groupwise registration and segmentation

Ensemble registration: Combining groupwise registration and segmentation PURWANI, COOTES, TWINING: ENSEMBLE REGISTRATION 1 Ensemble registration: Combining groupwise registration and segmentation Sri Purwani 1,2 sri.purwani@postgrad.manchester.ac.uk Tim Cootes 1 t.cootes@manchester.ac.uk

More information

for Images A Bayesian Deformation Model

for Images A Bayesian Deformation Model Statistics in Imaging Workshop July 8, 2004 A Bayesian Deformation Model for Images Sining Chen Postdoctoral Fellow Biostatistics Division, Dept. of Oncology, School of Medicine Outline 1. Introducing

More information

Is deformable image registration a solved problem?

Is deformable image registration a solved problem? Is deformable image registration a solved problem? Marcel van Herk On behalf of the imaging group of the RT department of NKI/AVL Amsterdam, the Netherlands DIR 1 Image registration Find translation.deformation

More information

Nonrigid Registration with Adaptive, Content-Based Filtering of the Deformation Field

Nonrigid Registration with Adaptive, Content-Based Filtering of the Deformation Field Nonrigid Registration with Adaptive, Content-Based Filtering of the Deformation Field Marius Staring*, Stefan Klein and Josien P.W. Pluim Image Sciences Institute, University Medical Center Utrecht, P.O.

More information

Interactive Deformable Registration Visualization and Analysis of 4D Computed Tomography

Interactive Deformable Registration Visualization and Analysis of 4D Computed Tomography Interactive Deformable Registration Visualization and Analysis of 4D Computed Tomography Burak Erem 1, Gregory C. Sharp 2, Ziji Wu 2, and David Kaeli 1 1 Department of Electrical and Computer Engineering,

More information

Neuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry

Neuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry Neuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry Nivedita Agarwal, MD Nivedita.agarwal@apss.tn.it Nivedita.agarwal@unitn.it Volume and surface morphometry Brain volume White matter

More information

Rigid and Deformable Vasculature-to-Image Registration : a Hierarchical Approach

Rigid and Deformable Vasculature-to-Image Registration : a Hierarchical Approach Rigid and Deformable Vasculature-to-Image Registration : a Hierarchical Approach Julien Jomier and Stephen R. Aylward Computer-Aided Diagnosis and Display Lab The University of North Carolina at Chapel

More information

Deformable Medical Image Registration: Methods

Deformable Medical Image Registration: Methods Deformable Medical Image Registration 1 Deformable Medical Image Registration: Setting The State Of The Art With Discrete Methods Ben Glocker Microsoft Research, Cambridge, UK Aristeidis Sotiras Ecole

More information

Cluster of Workstation based Nonrigid Image Registration Using Free-Form Deformation

Cluster of Workstation based Nonrigid Image Registration Using Free-Form Deformation Cluster of Workstation based Nonrigid Image Registration Using Free-Form Deformation Xiaofen Zheng, Jayaram K. Udupa, and Xinjian Chen Medical Image Processing Group, Department of Radiology 423 Guardian

More information

Auto-contouring the Prostate for Online Adaptive Radiotherapy

Auto-contouring the Prostate for Online Adaptive Radiotherapy Auto-contouring the Prostate for Online Adaptive Radiotherapy Yan Zhou 1 and Xiao Han 1 Elekta Inc., Maryland Heights, MO, USA yan.zhou@elekta.com, xiao.han@elekta.com, Abstract. Among all the organs under

More information

Heeyoul (Henry) Choi. Dept. of Computer Science Texas A&M University

Heeyoul (Henry) Choi. Dept. of Computer Science Texas A&M University Heeyoul (Henry) Choi Dept. of Computer Science Texas A&M University hchoi@cs.tamu.edu Facial Action Coding System Overview Optic Flow Analysis Local Velocity Extraction Local Smoothing Holistic Analysis

More information

Fast CT-CT Fluoroscopy Registration with Respiratory Motion Compensation for Image-Guided Lung Intervention

Fast CT-CT Fluoroscopy Registration with Respiratory Motion Compensation for Image-Guided Lung Intervention Fast CT-CT Fluoroscopy Registration with Respiratory Motion Compensation for Image-Guided Lung Intervention Po Su a,b, Zhong Xue b*, Kongkuo Lu c, Jianhua Yang a, Stephen T. Wong b a School of Automation,

More information

Fmri Spatial Processing

Fmri Spatial Processing Educational Course: Fmri Spatial Processing Ray Razlighi Jun. 8, 2014 Spatial Processing Spatial Re-alignment Geometric distortion correction Spatial Normalization Smoothing Why, When, How, Which Why is

More information

Non-rigid image registration: theory and practice

Non-rigid image registration: theory and practice The British Journal of Radiology, 77 (2004), S140 S153 DOI: 10.1259/bjr/25329214 E 2004 The British Institute of Radiology Non-rigid image registration: theory and practice W R CRUM, DPhil, T HARTKENS,

More information

Utilizing Salient Region Features for 3D Multi-Modality Medical Image Registration

Utilizing Salient Region Features for 3D Multi-Modality Medical Image Registration Utilizing Salient Region Features for 3D Multi-Modality Medical Image Registration Dieter Hahn 1, Gabriele Wolz 2, Yiyong Sun 3, Frank Sauer 3, Joachim Hornegger 1, Torsten Kuwert 2 and Chenyang Xu 3 1

More information

Schools of thoughts on texture

Schools of thoughts on texture Cameras Images Images Edges Talked about images being continuous (if you blur them, then you can compute derivatives and such). Two paths: Edges something useful Or Images something besides edges. Images

More information

Image segmentation. Václav Hlaváč. Czech Technical University in Prague

Image segmentation. Václav Hlaváč. Czech Technical University in Prague Image segmentation Václav Hlaváč Czech Technical University in Prague Center for Machine Perception (bridging groups of the) Czech Institute of Informatics, Robotics and Cybernetics and Faculty of Electrical

More information

MR IMAGE SEGMENTATION

MR IMAGE SEGMENTATION MR IMAGE SEGMENTATION Prepared by : Monil Shah What is Segmentation? Partitioning a region or regions of interest in images such that each region corresponds to one or more anatomic structures Classification

More information