MRI Segmentation. MRI Bootcamp, 14 th of January J. Miguel Valverde

Size: px
Start display at page:

Download "MRI Segmentation. MRI Bootcamp, 14 th of January J. Miguel Valverde"

Transcription

1 MRI Segmentation MRI Bootcamp, 14 th of January 2019

2 Segmentation

3 Segmentation

4 Information Segmentation Algorithms Approach

5 Types of Information Local

6 Types of Information Local Contextual.

7 Types of Information Local Contextual. Spatial Y axis X axis

8 Approaches classification Atlas registration based Hand-crafted features (Machine Learning) Learnt features (Deep Learning) Chen H. et al. NeuroImage 2018.

9 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Overview Image Graph Cuts Level Sets Non-linear Registration min E(s) Segmentation

10 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Overview Image Atlases Graph Cuts Level Sets Non-linear Registration T1, T2, PD min E(s) Segmentation

11 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Overview Image Atlases Graph Cuts Level Sets Non-linear Registration Initial Estimation T1, T2, PD min E(s) Segmentation

12 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Single-atlas approach Average Most similar

13 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Single-atlas approach Average Most similar Not realistic Sensitive to outliers

14 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Single-atlas approach Average Most similar Biased

15 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Single-atlas approach Average Most similar Multi-atlas approach N most similar Use many as single-atlas

16 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Single-atlas approach Average Most similar Majority voting. Multi-atlas approach N most similar Use many as single-atlas Majority voting (Artaechevarria X. et al. Trans. Med. Im ) Y v = arg max f(a i v, y) i=0 y where f A i v, y = 1 if Ai v = y i 0 if A v y N Y v final label at voxel v, A v i atlas A i at voxel v, N number of atlases y label

17 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Single-atlas approach Average Most similar Multi-atlas approach N most similar Use many as single-atlas Bayesian statistics P Y X = where X voxel Y label P X Y P(Y) P(X) Majority voting (Artaechevarria X. et al. Trans. Med. Im ) Bayes (Ali AA. et al. NeuroImage 2005.)

18 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Single-atlas approach Average Most similar Multi-atlas approach N most similar Use many as single-atlas Markov Random Field P y v y S v = P(y v y Nv ) where v voxel S set of all voxels N v neighbor voxels of v Majority voting (Artaechevarria X. et al. Trans. Med. Im ) Bayes (Ali AA. et al. NeuroImage 2005.) MRF (Bae MH. et al. NeuroImage 2009.)

19 Approaches: Atlas registration based Hand-crafted features Learnt features Atlas registration based Disadvantages: Registration is needed (affine and/or non-linear). Computationally expensive. Very sensitive to registration.

20 Approaches: Atlas registration based Hand-crafted features Learnt features Hand-crafted features (Machine Learning) # 1. Generate a feature collection for voxel in allvoxels: f = generatefeaturevector(voxel) allfeatures.append(f)

21 Approaches: Atlas registration based Hand-crafted features Learnt features Hand-crafted features (Machine Learning) # 1. Generate a feature collection for voxel in allvoxels: f = generatefeaturevector(voxel) allfeatures.append(f) # 2. Train a model model = SVM(parameters) model.fit(allfeatures)

22 Approaches: Atlas registration based Hand-crafted features Learnt features Hand-crafted features (Machine Learning) Vector of features: Local intensities (Wu T. et al. NeuroImage 2012.).

23 Approaches: Atlas registration based Hand-crafted features Learnt features Hand-crafted features (Machine Learning) Vector of features: Local intensities (Wu T. et al. NeuroImage 2012.) Neighbour intensities, gradients (Pereira S. et al. Journal of Neuroscience Methods 2016).

24 Approaches: Atlas registration based Hand-crafted features Learnt features Hand-crafted features (Machine Learning) Vector of features: Local intensities (Wu T. et al. NeuroImage 2012.) Neighbour intensities, gradients (Pereira S. et al. Journal of Neuroscience Methods 2016) Multi-scale (Bae MH. et al. NeuroImage 2009.)..

25 Approaches: Atlas registration based Hand-crafted features Learnt features Hand-crafted features (Machine Learning) Vector of features: Local intensities (Wu T. et al. NeuroImage 2012.) Neighbour intensities, gradients (Pereira S. et al. Journal of Neuroscience Methods 2016) Multi-scale (Bae MH. et al. NeuroImage 2009.). Coordinates (Wachinger C. et al. IEEE Trans. Biomed. Eng ) Requires Registration! x, y, z

26 Approaches: Atlas registration based Hand-crafted features Learnt features Hand-crafted features (Machine Learning) Advantages No registration needed (in principle). Rotational invariant Understanding of the features. Can easily try different ML algorithms.

27 Approaches: Atlas registration based Hand-crafted features Learnt features Learnt features (Deep Learning) Feature Vector ML 0 1 GM WM T1 intensity 0 CSF T2 intensity Neighbor gradients

28 Approaches: Atlas registration based Hand-crafted features Learnt features Learnt features (Deep Learning) Feature Vector ML 0 1 GM WM T1 intensity 0 CSF T2 intensity Neighbor gradients Neural Network GM WM CSF

29 Approaches: Atlas registration based Hand-crafted features Learnt features Learnt features (Deep Learning) Convolutions NxN Image Kernel (N-2)x(N-2) =

30 GM WM CSF Approaches: Atlas registration based Hand-crafted features Learnt features Learnt features (Deep Learning) Neural Network 3x3 3x3 5x5 3x3 = = 1x softmax Output ( y) Labels (y)

31 GM WM CSF Approaches: Atlas registration based Hand-crafted features Learnt features Learnt features (Deep Learning) Neural Network 3x3 3x3 5x5 3x3 = = e 1x softmax Output ( y) H( y, y) Cross Entropy Labels (y)

32 Learnt features (Deep Learning) Types of information/data Convolutions (region) Local + Contextual

33 Learnt features (Deep Learning) Types of information/data Convolutions (region) Convolutions (full) Local + Contextual + Spatial

34 Learnt features (Deep Learning) Types of information/data Spatial Convolutions (region) Convolutions (full) Other information Distance to centroids (de Brebisson A. and Montana G. IEEE CVPR Workshop 2015.)

35 Learnt features (Deep Learning) Types of information/data Convolutions (region) Convolutions (full) Other information Spatial Distance to centroids (de Brebisson A. and Montana G. IEEE CVPR Workshop 2015.) Encoded spatial information (Rachmadi MF. et al. Compu. Med. Imaging Graph 2018.)

36 Approaches: Atlas registration based Hand-crafted features Learnt features Learnt features (Deep Learning) Advantages No feature engineering needed. Extrapolate to other tasks. Parallel processing capabilities. Disadvantages Black box

37 Pre-processing operations Denoising

38 Pre-processing operations Denoising Inhomogeneity correction Intensity inhomogeneity in MR brain image. (Vovk U. et al. IEEE Trans. Med. Imag. 2007)

39 Pre-processing operations Denoising Inhomogeneity correction 0 mean, 1 variance

40 Pre-processing operations Denoising Inhomogeneity correction 0 mean, 1 variance Data augmentation Rotation

41 Pre-processing operations Denoising Inhomogeneity correction 0 mean, 1 variance Data augmentation Rotation Non-linear transformations

42 Conclusion / Take home message Important to understand what we have and what we want. Check the data. Then, check the data again.

An Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014

An Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014 An Introduction To Automatic Tissue Classification Of Brain MRI Colm Elliott Mar 2014 Tissue Classification Tissue classification is part of many processing pipelines. We often want to classify each voxel

More information

Atlas of Classifiers for Brain MRI Segmentation

Atlas of Classifiers for Brain MRI Segmentation Atlas of Classifiers for Brain MRI Segmentation B. Kodner 1,2, S. H. Gordon 1,2, J. Goldberger 3 and T. Riklin Raviv 1,2 1 Department of Electrical and Computer Engineering, 2 The Zlotowski Center for

More information

Norbert Schuff VA Medical Center and UCSF

Norbert Schuff VA Medical Center and UCSF Norbert Schuff Medical Center and UCSF Norbert.schuff@ucsf.edu Medical Imaging Informatics N.Schuff Course # 170.03 Slide 1/67 Objective Learn the principle segmentation techniques Understand the role

More information

mritc: A Package for MRI Tissue Classification

mritc: A Package for MRI Tissue Classification mritc: A Package for MRI Tissue Classification Dai Feng 1 Luke Tierney 2 1 Merck Research Labratories 2 University of Iowa July 2010 Feng & Tierney (Merck & U of Iowa) MRI Tissue Classification July 2010

More information

Norbert Schuff Professor of Radiology VA Medical Center and UCSF

Norbert Schuff Professor of Radiology VA Medical Center and UCSF Norbert Schuff Professor of Radiology Medical Center and UCSF Norbert.schuff@ucsf.edu 2010, N.Schuff Slide 1/67 Overview Definitions Role of Segmentation Segmentation methods Intensity based Shape based

More information

ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION

ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION Abstract: MIP Project Report Spring 2013 Gaurav Mittal 201232644 This is a detailed report about the course project, which was to implement

More information

Computational Neuroanatomy

Computational Neuroanatomy Computational Neuroanatomy John Ashburner john@fil.ion.ucl.ac.uk Smoothing Motion Correction Between Modality Co-registration Spatial Normalisation Segmentation Morphometry Overview fmri time-series kernel

More information

Norbert Schuff Professor of Radiology VA Medical Center and UCSF

Norbert Schuff Professor of Radiology VA Medical Center and UCSF Norbert Schuff Professor of Radiology Medical Center and UCSF Norbert.schuff@ucsf.edu Slide 1/67 Overview Definitions Role of Segmentation Segmentation methods Intensity based Shape based Texture based

More information

Automatic Registration-Based Segmentation for Neonatal Brains Using ANTs and Atropos

Automatic Registration-Based Segmentation for Neonatal Brains Using ANTs and Atropos Automatic Registration-Based Segmentation for Neonatal Brains Using ANTs and Atropos Jue Wu and Brian Avants Penn Image Computing and Science Lab, University of Pennsylvania, Philadelphia, USA Abstract.

More information

Image Registration + Other Stuff

Image Registration + Other Stuff Image Registration + Other Stuff John Ashburner Pre-processing Overview fmri time-series Motion Correct Anatomical MRI Coregister m11 m 21 m 31 m12 m13 m14 m 22 m 23 m 24 m 32 m 33 m 34 1 Template Estimate

More information

Markov Random Fields and Gibbs Sampling for Image Denoising

Markov Random Fields and Gibbs Sampling for Image Denoising Markov Random Fields and Gibbs Sampling for Image Denoising Chang Yue Electrical Engineering Stanford University changyue@stanfoed.edu Abstract This project applies Gibbs Sampling based on different Markov

More information

Segmenting Glioma in Multi-Modal Images using a Generative Model for Brain Lesion Segmentation

Segmenting Glioma in Multi-Modal Images using a Generative Model for Brain Lesion Segmentation Segmenting Glioma in Multi-Modal Images using a Generative Model for Brain Lesion Segmentation Bjoern H. Menze 1,2, Koen Van Leemput 3, Danial Lashkari 4 Marc-André Weber 5, Nicholas Ayache 2, and Polina

More information

MR IMAGE SEGMENTATION

MR IMAGE SEGMENTATION MR IMAGE SEGMENTATION Prepared by : Monil Shah What is Segmentation? Partitioning a region or regions of interest in images such that each region corresponds to one or more anatomic structures Classification

More information

Functional MRI in Clinical Research and Practice Preprocessing

Functional MRI in Clinical Research and Practice Preprocessing Functional MRI in Clinical Research and Practice Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization

More information

ABSTRACT 1. INTRODUCTION 2. METHODS

ABSTRACT 1. INTRODUCTION 2. METHODS Finding Seeds for Segmentation Using Statistical Fusion Fangxu Xing *a, Andrew J. Asman b, Jerry L. Prince a,c, Bennett A. Landman b,c,d a Department of Electrical and Computer Engineering, Johns Hopkins

More information

Modified Expectation Maximization Method for Automatic Segmentation of MR Brain Images

Modified Expectation Maximization Method for Automatic Segmentation of MR Brain Images Modified Expectation Maximization Method for Automatic Segmentation of MR Brain Images R.Meena Prakash, R.Shantha Selva Kumari 1 P.S.R.Engineering College, Sivakasi, Tamil Nadu, India 2 Mepco Schlenk Engineering

More information

SPM8 for Basic and Clinical Investigators. Preprocessing

SPM8 for Basic and Clinical Investigators. Preprocessing SPM8 for Basic and Clinical Investigators Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization Spatial

More information

SPM8 for Basic and Clinical Investigators. Preprocessing. fmri Preprocessing

SPM8 for Basic and Clinical Investigators. Preprocessing. fmri Preprocessing SPM8 for Basic and Clinical Investigators Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization Spatial

More information

MRI Tumor Segmentation with Densely Connected 3D CNN. Lele Chen, Yue Wu, Adora M. DSouze, Anas Z. Abidin, Axel Wismüller, and Chenliang Xu

MRI Tumor Segmentation with Densely Connected 3D CNN. Lele Chen, Yue Wu, Adora M. DSouze, Anas Z. Abidin, Axel Wismüller, and Chenliang Xu 1 MRI Tumor Segmentation with Densely Connected 3D CNN Lele Chen, Yue Wu, Adora M. DSouze, Anas Z. Abidin, Axel Wismüller, and MRI Brain Tumor Segmentation 2 Image source: https://github.com/naldeborgh7575/brain_segmentation

More information

Sparsity Based Spectral Embedding: Application to Multi-Atlas Echocardiography Segmentation!

Sparsity Based Spectral Embedding: Application to Multi-Atlas Echocardiography Segmentation! Sparsity Based Spectral Embedding: Application to Multi-Atlas Echocardiography Segmentation Ozan Oktay, Wenzhe Shi, Jose Caballero, Kevin Keraudren, and Daniel Rueckert Department of Compu.ng Imperial

More information

Preprocessing II: Between Subjects John Ashburner

Preprocessing II: Between Subjects John Ashburner Preprocessing II: Between Subjects John Ashburner Pre-processing Overview Statistics or whatever fmri time-series Anatomical MRI Template Smoothed Estimate Spatial Norm Motion Correct Smooth Coregister

More information

Performance Evaluation of the TINA Medical Image Segmentation Algorithm on Brainweb Simulated Images

Performance Evaluation of the TINA Medical Image Segmentation Algorithm on Brainweb Simulated Images Tina Memo No. 2008-003 Internal Memo Performance Evaluation of the TINA Medical Image Segmentation Algorithm on Brainweb Simulated Images P. A. Bromiley Last updated 20 / 12 / 2007 Imaging Science and

More information

Automatic MS Lesion Segmentation by Outlier Detection and Information Theoretic Region Partitioning Release 0.00

Automatic MS Lesion Segmentation by Outlier Detection and Information Theoretic Region Partitioning Release 0.00 Automatic MS Lesion Segmentation by Outlier Detection and Information Theoretic Region Partitioning Release 0.00 Marcel Prastawa 1 and Guido Gerig 1 Abstract July 17, 2008 1 Scientific Computing and Imaging

More information

Basic fmri Design and Analysis. Preprocessing

Basic fmri Design and Analysis. Preprocessing Basic fmri Design and Analysis Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization Spatial filtering

More information

Automatic Generation of Training Data for Brain Tissue Classification from MRI

Automatic Generation of Training Data for Brain Tissue Classification from MRI Automatic Generation of Training Data for Brain Tissue Classification from MRI Chris A. COCOSCO, Alex P. ZIJDENBOS, and Alan C. EVANS http://www.bic.mni.mcgill.ca/users/crisco/ McConnell Brain Imaging

More information

Deep Learning with Tensorflow AlexNet

Deep Learning with Tensorflow   AlexNet Machine Learning and Computer Vision Group Deep Learning with Tensorflow http://cvml.ist.ac.at/courses/dlwt_w17/ AlexNet Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E. Hinton, "Imagenet classification

More information

EPI Data Are Acquired Serially. EPI Data Are Acquired Serially 10/23/2011. Functional Connectivity Preprocessing. fmri Preprocessing

EPI Data Are Acquired Serially. EPI Data Are Acquired Serially 10/23/2011. Functional Connectivity Preprocessing. fmri Preprocessing Functional Connectivity Preprocessing Geometric distortion Head motion Geometric distortion Head motion EPI Data Are Acquired Serially EPI Data Are Acquired Serially descending 1 EPI Data Are Acquired

More information

LOCUS: LOcal Cooperative Unified Segmentation of MRI Brain Scans

LOCUS: LOcal Cooperative Unified Segmentation of MRI Brain Scans Author manuscript, published in "MICCAI07-10th International Conference on Medical Image Computing and Computer Assisted Intervention, Brisbane : Australia (2007)" DOI : 10.1007/978-3-540-75757-3_27 LOCUS:

More information

Attribute Similarity and Mutual-Saliency Weighting for Registration and Label Fusion

Attribute Similarity and Mutual-Saliency Weighting for Registration and Label Fusion Attribute Similarity and Mutual-Saliency Weighting for Registration and Label Fusion Yangming Ou, Jimit Doshi, Guray Erus, and Christos Davatzikos Section of Biomedical Image Analysis (SBIA) Department

More information

MULTI-LEVEL 3D CONVOLUTIONAL NEURAL NETWORK FOR OBJECT RECOGNITION SAMBIT GHADAI XIAN LEE ADITYA BALU SOUMIK SARKAR ADARSH KRISHNAMURTHY

MULTI-LEVEL 3D CONVOLUTIONAL NEURAL NETWORK FOR OBJECT RECOGNITION SAMBIT GHADAI XIAN LEE ADITYA BALU SOUMIK SARKAR ADARSH KRISHNAMURTHY MULTI-LEVEL 3D CONVOLUTIONAL NEURAL NETWORK FOR OBJECT RECOGNITION SAMBIT GHADAI XIAN LEE ADITYA BALU SOUMIK SARKAR ADARSH KRISHNAMURTHY Outline Object Recognition Multi-Level Volumetric Representations

More information

AN AUTOMATED SEGMENTATION FRAMEWORK FOR BRAIN MRI VOLUMES BASED ON ADAPTIVE MEAN-SHIFT CLUSTERING

AN AUTOMATED SEGMENTATION FRAMEWORK FOR BRAIN MRI VOLUMES BASED ON ADAPTIVE MEAN-SHIFT CLUSTERING AN AUTOMATED SEGMENTATION FRAMEWORK FOR BRAIN MRI VOLUMES BASED ON ADAPTIVE MEAN-SHIFT CLUSTERING Sam Ponnachan 1, Paul Pandi 2,A.Winifred 3,Joselin Jose 4 UG Scholars 1,2,3,4 Department of EIE 1,2 Department

More information

Non-rigid Image Registration using Electric Current Flow

Non-rigid Image Registration using Electric Current Flow Non-rigid Image Registration using Electric Current Flow Shu Liao, Max W. K. Law and Albert C. S. Chung Lo Kwee-Seong Medical Image Analysis Laboratory, Department of Computer Science and Engineering,

More information

Image Processing with Nonparametric Neighborhood Statistics

Image Processing with Nonparametric Neighborhood Statistics Image Processing with Nonparametric Neighborhood Statistics Ross T. Whitaker Scientific Computing and Imaging Institute School of Computing University of Utah PhD Suyash P. Awate University of Pennsylvania,

More information

MARS: Multiple Atlases Robust Segmentation

MARS: Multiple Atlases Robust Segmentation Software Release (1.0.1) Last updated: April 30, 2014. MARS: Multiple Atlases Robust Segmentation Guorong Wu, Minjeong Kim, Gerard Sanroma, and Dinggang Shen {grwu, mjkim, gerard_sanroma, dgshen}@med.unc.edu

More information

Bayesian model ensembling using meta-trained recurrent neural networks

Bayesian model ensembling using meta-trained recurrent neural networks Bayesian model ensembling using meta-trained recurrent neural networks Luca Ambrogioni l.ambrogioni@donders.ru.nl Umut Güçlü u.guclu@donders.ru.nl Yağmur Güçlütürk y.gucluturk@donders.ru.nl Julia Berezutskaya

More information

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 19: Machine Learning in Medical Imaging (A Brief Introduction)

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 19: Machine Learning in Medical Imaging (A Brief Introduction) SPRING 2016 1 MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 19: Machine Learning in Medical Imaging (A Brief Introduction) Dr. Ulas Bagci HEC 221, Center for Research in Computer Vision (CRCV), University

More information

Adaptive Dictionary Learning For Competitive Classification Of Multiple Sclerosis Lesions

Adaptive Dictionary Learning For Competitive Classification Of Multiple Sclerosis Lesions Adaptive Dictionary Learning For Competitive Classification Of Multiple Sclerosis Lesions Hrishikesh Deshpande, Pierre Maurel, Christian Barillot To cite this version: Hrishikesh Deshpande, Pierre Maurel,

More information

Discriminative, Semantic Segmentation of Brain Tissue in MR Images

Discriminative, Semantic Segmentation of Brain Tissue in MR Images Discriminative, Semantic Segmentation of Brain Tissue in MR Images Zhao Yi 1, Antonio Criminisi 2, Jamie Shotton 2, and Andrew Blake 2 1 University of California, Los Angeles, USA. zyi@ucla.edu. 2 Microsoft

More information

A Model-Independent, Multi-Image Approach to MR Inhomogeneity Correction

A Model-Independent, Multi-Image Approach to MR Inhomogeneity Correction Tina Memo No. 2007-003 Published in Proc. MIUA 2007 A Model-Independent, Multi-Image Approach to MR Inhomogeneity Correction P. A. Bromiley and N.A. Thacker Last updated 13 / 4 / 2007 Imaging Science and

More information

Isointense infant brain MRI segmentation with a dilated convolutional neural network Moeskops, P.; Pluim, J.P.W.

Isointense infant brain MRI segmentation with a dilated convolutional neural network Moeskops, P.; Pluim, J.P.W. Isointense infant brain MRI segmentation with a dilated convolutional neural network Moeskops, P.; Pluim, J.P.W. Published: 09/08/2017 Document Version Author s version before peer-review Please check

More information

Algorithms for medical image registration and segmentation

Algorithms for medical image registration and segmentation Algorithms for medical image registration and segmentation Multi-atlas methods ernst.schwartz@meduniwien.ac.at www.cir.meduniwien.ac.at Overview Medical imaging hands-on Data formats: DICOM, NifTI Software:

More information

Introduction to Medical Image Processing

Introduction to Medical Image Processing Introduction to Medical Image Processing Δ Essential environments of a medical imaging system Subject Image Analysis Energy Imaging System Images Image Processing Feature Images Image processing may be

More information

Supervised Learning for Image Segmentation

Supervised Learning for Image Segmentation Supervised Learning for Image Segmentation Raphael Meier 06.10.2016 Raphael Meier MIA 2016 06.10.2016 1 / 52 References A. Ng, Machine Learning lecture, Stanford University. A. Criminisi, J. Shotton, E.

More information

Subject Specific Sparse Dictionary Learning for Atlas Based Brain MRI Segmentation

Subject Specific Sparse Dictionary Learning for Atlas Based Brain MRI Segmentation Subject Specific Sparse Dictionary Learning for Atlas Based Brain MRI Segmentation Snehashis Roy 1,, Aaron Carass 2, Jerry L. Prince 2, and Dzung L. Pham 1 1 Center for Neuroscience and Regenerative Medicine,

More information

Data pre-processing framework in SPM. Bogdan Draganski

Data pre-processing framework in SPM. Bogdan Draganski Data pre-processing fraework in SPM Bogdan Draganski Outline Why do we need pre-processing? Overview Structural MRI pre-processing fmri pre-processing Why do we need pre-processing? What do we want? Reason

More information

U-SEGNET: FULLY CONVOLUTIONAL NEURAL NETWORK BASED AUTOMATED BRAIN TISSUE SEGMENTATION TOOL. Pulkit Kumar Pravin Nagar Chetan Arora Anubha Gupta

U-SEGNET: FULLY CONVOLUTIONAL NEURAL NETWORK BASED AUTOMATED BRAIN TISSUE SEGMENTATION TOOL. Pulkit Kumar Pravin Nagar Chetan Arora Anubha Gupta U-SEGNET: FULLY CONVOLUTIONAL NEURAL NETWORK BASED AUTOMATED BRAIN TISSUE SEGMENTATION TOOL Pulkit Kumar Pravin Nagar Chetan Arora Anubha Gupta Indraprastha Institute of Information Technology-Delhi (IIIT-Delhi),

More information

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem SPRING 06 MEDICAL IMAGE COMPUTING (CAP 97) LECTURE 0: Medical Image Segmentation as an Energy Minimization Problem Dr. Ulas Bagci HEC, Center for Research in Computer Vision (CRCV), University of Central

More information

Deep Learning: Image Registration. Steven Chen and Ty Nguyen

Deep Learning: Image Registration. Steven Chen and Ty Nguyen Deep Learning: Image Registration Steven Chen and Ty Nguyen Lecture Outline 1. Brief Introduction to Deep Learning 2. Case Study 1: Unsupervised Deep Homography 3. Case Study 2: Deep LucasKanade What is

More information

Automatic Segmentation of Multiple Sclerosis Lesions in Brain MR Images

Automatic Segmentation of Multiple Sclerosis Lesions in Brain MR Images JOURNAL OF BIOMEDICAL ENGINEERING AND MEDICAL IMAGING SOCIETY FOR SCIENCE AND EDUCATION UNITED KINGDOM VOLUME 2 ISSUE 5 ISSN: 2055-1266 Automatic Segmentation of Multiple Sclerosis Lesions in Brain MR

More information

Learning-based Neuroimage Registration

Learning-based Neuroimage Registration Learning-based Neuroimage Registration Leonid Teverovskiy and Yanxi Liu 1 October 2004 CMU-CALD-04-108, CMU-RI-TR-04-59 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 Abstract

More information

Segmenting Glioma in Multi-Modal Images using a Generative-Discriminative Model for Brain Lesion Segmentation

Segmenting Glioma in Multi-Modal Images using a Generative-Discriminative Model for Brain Lesion Segmentation Segmenting Glioma in Multi-Modal Images using a Generative-Discriminative Model for Brain Lesion Segmentation Bjoern H. Menze 1,2, Ezequiel Geremia 2, Nicholas Ayache 2, and Gabor Szekely 1 1 Computer

More information

A multi-atlas approach for prostate segmentation in MR images

A multi-atlas approach for prostate segmentation in MR images A multi-atlas approach for prostate segmentation in MR images Geert Litjens, Nico Karssemeijer, and Henkjan Huisman Diagnostic Image Analysis Group, Radboud University Nijmegen Medical Centre, Nijmegen,

More information

An ITK Filter for Bayesian Segmentation: itkbayesianclassifierimagefilter

An ITK Filter for Bayesian Segmentation: itkbayesianclassifierimagefilter An ITK Filter for Bayesian Segmentation: itkbayesianclassifierimagefilter John Melonakos 1, Karthik Krishnan 2 and Allen Tannenbaum 1 1 Georgia Institute of Technology, Atlanta GA 30332, USA {jmelonak,

More information

EMSegmenter Tutorial (Advanced Mode)

EMSegmenter Tutorial (Advanced Mode) EMSegmenter Tutorial (Advanced Mode) Dominique Belhachemi Section of Biomedical Image Analysis Department of Radiology University of Pennsylvania 1/65 Overview The goal of this tutorial is to apply the

More information

averaged) 2. This makes it necessary to employ higher level knowledge about distribution of grey/white matter in the brain and lesion features.

averaged) 2. This makes it necessary to employ higher level knowledge about distribution of grey/white matter in the brain and lesion features. Fusing Markov Random Fields with Anatomical Knowledge and Shape Based Analysis to Segment Multiple Sclerosis White Matter Lesions in Magnetic Resonance Images of the Brain Stephan Al-Zubi a, c, Klaus Toennies

More information

Multi-Atlas Segmentation of the Cardiac MR Right Ventricle

Multi-Atlas Segmentation of the Cardiac MR Right Ventricle Multi-Atlas Segmentation of the Cardiac MR Right Ventricle Yangming Ou, Jimit Doshi, Guray Erus, and Christos Davatzikos Section of Biomedical Image Analysis (SBIA) Department of Radiology, University

More information

MULTIVARIATE ANALYSES WITH fmri DATA

MULTIVARIATE ANALYSES WITH fmri DATA MULTIVARIATE ANALYSES WITH fmri DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering University of Zurich & ETH Zurich Motivation Modelling Concepts Learning

More information

Population Modeling in Neuroscience Using Computer Vision and Machine Learning to learn from Brain Images. Overview. Image Registration

Population Modeling in Neuroscience Using Computer Vision and Machine Learning to learn from Brain Images. Overview. Image Registration Population Modeling in Neuroscience Using Computer Vision and Machine Learning to learn from Brain Images Overview 1. Part 1: Theory 1. 2. Learning 2. Part 2: Applications ernst.schwartz@meduniwien.ac.at

More information

Supplementary methods

Supplementary methods Supplementary methods This section provides additional technical details on the sample, the applied imaging and analysis steps and methods. Structural imaging Trained radiographers placed all participants

More information

Multi-Sectional Views Textural Based SVM for MS Lesion Segmentation in Multi-Channels MRIs

Multi-Sectional Views Textural Based SVM for MS Lesion Segmentation in Multi-Channels MRIs 56 The Open Biomedical Engineering Journal, 2012, 6, 56-72 Open Access Multi-Sectional Views Textural Based SVM for MS Lesion Segmentation in Multi-Channels MRIs Bassem A. Abdullah*, Akmal A. Younis and

More information

Neural Network Architectures for Large-scale 3d Reconstruction. Viren Jain Research & Machine Intelligence, Google Inc.

Neural Network Architectures for Large-scale 3d Reconstruction. Viren Jain Research & Machine Intelligence, Google Inc. Neural Network Architectures for Large-scale 3d Reconstruction Viren Jain Research & Machine Intelligence, Google Inc. reconstructing neural wiring diagrams from 3d, nanoscale images of brain tissue connectomics

More information

Filtering Images in the Spatial Domain Chapter 3b G&W. Ross Whitaker (modified by Guido Gerig) School of Computing University of Utah

Filtering Images in the Spatial Domain Chapter 3b G&W. Ross Whitaker (modified by Guido Gerig) School of Computing University of Utah Filtering Images in the Spatial Domain Chapter 3b G&W Ross Whitaker (modified by Guido Gerig) School of Computing University of Utah 1 Overview Correlation and convolution Linear filtering Smoothing, kernels,

More information

PROCESS > SPATIAL FILTERS

PROCESS > SPATIAL FILTERS 83 Spatial Filters There are 19 different spatial filters that can be applied to a data set. These are described in the table below. A filter can be applied to the entire volume or to selected objects

More information

Where are we now? Structural MRI processing and analysis

Where are we now? Structural MRI processing and analysis Where are we now? Structural MRI processing and analysis Pierre-Louis Bazin bazin@cbs.mpg.de Leipzig, Germany Structural MRI processing: why bother? Just use the standards? SPM FreeSurfer FSL However:

More information

Towards Learning-Based Holistic Brain Image Segmentation

Towards Learning-Based Holistic Brain Image Segmentation Towards Learning-Based Holistic Brain Image Segmentation Zhuowen Tu Lab of Neuro Imaging University of California, Los Angeles in collaboration with (A. Toga, P. Thompson et al.) Supported by (NIH CCB

More information

Cocozza S., et al. : ALTERATIONS OF FUNCTIONAL CONNECTIVITY OF THE MOTOR CORTEX IN FABRY'S DISEASE: AN RS-FMRI STUDY

Cocozza S., et al. : ALTERATIONS OF FUNCTIONAL CONNECTIVITY OF THE MOTOR CORTEX IN FABRY'S DISEASE: AN RS-FMRI STUDY ALTERATIONS OF FUNCTIONAL CONNECTIVITY OF THE MOTOR CORTEX IN FABRY'S DISEASE: AN RS-FMRI STUDY SUPPLEMENTARY MATERIALS Sirio Cocozza, MD 1*, Antonio Pisani, MD, PhD 2, Gaia Olivo, MD 1, Francesco Saccà,

More information

Deep Learning and Its Applications

Deep Learning and Its Applications Convolutional Neural Network and Its Application in Image Recognition Oct 28, 2016 Outline 1 A Motivating Example 2 The Convolutional Neural Network (CNN) Model 3 Training the CNN Model 4 Issues and Recent

More information

Topology Preserving Brain Tissue Segmentation Using Graph Cuts

Topology Preserving Brain Tissue Segmentation Using Graph Cuts Topology Preserving Brain Tissue Segmentation Using Graph Cuts Xinyang Liu 1, Pierre-Louis Bazin 2, Aaron Carass 3, and Jerry Prince 3 1 Brigham and Women s Hospital, Boston, MA 1 xinyang@bwh.harvard.edu

More information

3D Densely Convolutional Networks for Volumetric Segmentation. Toan Duc Bui, Jitae Shin, and Taesup Moon

3D Densely Convolutional Networks for Volumetric Segmentation. Toan Duc Bui, Jitae Shin, and Taesup Moon 3D Densely Convolutional Networks for Volumetric Segmentation Toan Duc Bui, Jitae Shin, and Taesup Moon School of Electronic and Electrical Engineering, Sungkyunkwan University, Republic of Korea arxiv:1709.03199v2

More information

Functional MRI data preprocessing. Cyril Pernet, PhD

Functional MRI data preprocessing. Cyril Pernet, PhD Functional MRI data preprocessing Cyril Pernet, PhD Data have been acquired, what s s next? time No matter the design, multiple volumes (made from multiple slices) have been acquired in time. Before getting

More information

Bayes Risk. Classifiers for Recognition Reading: Chapter 22 (skip 22.3) Discriminative vs Generative Models. Loss functions in classifiers

Bayes Risk. Classifiers for Recognition Reading: Chapter 22 (skip 22.3) Discriminative vs Generative Models. Loss functions in classifiers Classifiers for Recognition Reading: Chapter 22 (skip 22.3) Examine each window of an image Classify object class within each window based on a training set images Example: A Classification Problem Categorize

More information

Methods for data preprocessing

Methods for data preprocessing Methods for data preprocessing John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK. Overview Voxel-Based Morphometry Morphometry in general Volumetrics VBM preprocessing

More information

Fmri Spatial Processing

Fmri Spatial Processing Educational Course: Fmri Spatial Processing Ray Razlighi Jun. 8, 2014 Spatial Processing Spatial Re-alignment Geometric distortion correction Spatial Normalization Smoothing Why, When, How, Which Why is

More information

Atlas-Based Segmentation of Abdominal Organs in 3D Ultrasound, and its Application in Automated Kidney Segmentation

Atlas-Based Segmentation of Abdominal Organs in 3D Ultrasound, and its Application in Automated Kidney Segmentation University of Toronto Atlas-Based Segmentation of Abdominal Organs in 3D Ultrasound, and its Application in Automated Kidney Segmentation Authors: M. Marsousi, K. N. Plataniotis, S. Stergiopoulos Presenter:

More information

Surface-based Analysis: Inter-subject Registration and Smoothing

Surface-based Analysis: Inter-subject Registration and Smoothing Surface-based Analysis: Inter-subject Registration and Smoothing Outline Exploratory Spatial Analysis Coordinate Systems 3D (Volumetric) 2D (Surface-based) Inter-subject registration Volume-based Surface-based

More information

Neural Network and Deep Learning. Donglin Zeng, Department of Biostatistics, University of North Carolina

Neural Network and Deep Learning. Donglin Zeng, Department of Biostatistics, University of North Carolina Neural Network and Deep Learning Early history of deep learning Deep learning dates back to 1940s: known as cybernetics in the 1940s-60s, connectionism in the 1980s-90s, and under the current name starting

More information

Classifiers for Recognition Reading: Chapter 22 (skip 22.3)

Classifiers for Recognition Reading: Chapter 22 (skip 22.3) Classifiers for Recognition Reading: Chapter 22 (skip 22.3) Examine each window of an image Classify object class within each window based on a training set images Slide credits for this chapter: Frank

More information

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition Pattern Recognition Kjell Elenius Speech, Music and Hearing KTH March 29, 2007 Speech recognition 2007 1 Ch 4. Pattern Recognition 1(3) Bayes Decision Theory Minimum-Error-Rate Decision Rules Discriminant

More information

Chapter 3 Set Redundancy in Magnetic Resonance Brain Images

Chapter 3 Set Redundancy in Magnetic Resonance Brain Images 16 Chapter 3 Set Redundancy in Magnetic Resonance Brain Images 3.1 MRI (magnetic resonance imaging) MRI is a technique of measuring physical structure within the human anatomy. Our proposed research focuses

More information

MARS: Multiple Atlases Robust Segmentation

MARS: Multiple Atlases Robust Segmentation Software Release (1.0.1) Last updated: April 30, 2014. MARS: Multiple Atlases Robust Segmentation Guorong Wu, Minjeong Kim, Gerard Sanroma, and Dinggang Shen {grwu, mjkim, gerard_sanroma, dgshen}@med.unc.edu

More information

NIH Public Access Author Manuscript Proc SPIE. Author manuscript; available in PMC 2013 December 30.

NIH Public Access Author Manuscript Proc SPIE. Author manuscript; available in PMC 2013 December 30. NIH Public Access Author Manuscript Published in final edited form as: Proc SPIE. 2013 March 12; 8669:. doi:10.1117/12.2006682. Longitudinal Intensity Normalization of Magnetic Resonance Images using Patches

More information

Slicer3 Training Tutorial Using EM Segmenter with Non- Human Primate Images

Slicer3 Training Tutorial Using EM Segmenter with Non- Human Primate Images Slicer3 Training Compendium Slicer3 Training Tutorial Using EM Segmenter with Non- Human Primate Images Vidya Rajagopalan Christopher Wyatt BioImaging Systems Lab Dept. of Electrical Engineering Virginia

More information

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem SPRING 07 MEDICAL IMAGE COMPUTING (CAP 97) LECTURE 0: Medical Image Segmentation as an Energy Minimization Problem Dr. Ulas Bagci HEC, Center for Research in Computer Vision (CRCV), University of Central

More information

Fuzzy Inference System based Edge Detection in Images

Fuzzy Inference System based Edge Detection in Images Fuzzy Inference System based Edge Detection in Images Anjali Datyal 1 and Satnam Singh 2 1 M.Tech Scholar, ECE Department, SSCET, Badhani, Punjab, India 2 AP, ECE Department, SSCET, Badhani, Punjab, India

More information

arxiv: v1 [cs.cv] 4 Apr 2018

arxiv: v1 [cs.cv] 4 Apr 2018 Semi-Supervised Deep Metrics for Image Registration Alireza Sedghi 1,2, Jie Luo 2,3, Alireza Mehrtash 2,4, Steve Pieper 2, Clare M. Tempany 2, Tina Kapur 2, Parvin Mousavi 1, and William M. Wells III 2

More information

A Registration-Based Atlas Propagation Framework for Automatic Whole Heart Segmentation

A Registration-Based Atlas Propagation Framework for Automatic Whole Heart Segmentation A Registration-Based Atlas Propagation Framework for Automatic Whole Heart Segmentation Xiahai Zhuang (PhD) Centre for Medical Image Computing University College London Fields-MITACS Conference on Mathematics

More information

腦部結構影像 標準化 組織分割 體素型態 本週課程內容. Analysis Softwares. A Course of MRI

腦部結構影像 標準化 組織分割 體素型態 本週課程內容. Analysis Softwares. A Course of MRI 本週課程內容 腦部結構影像 A Course of MRI 盧家鋒助理教授國立陽明大學物理治療暨輔助科技學系 alvin4016@ym.edu.tw 腦部結構影像 空間標準化 (Spatial normalization) 均勻度校正 (Bias correction) 組織分割 (Segmentation) 體素形態學分析 (Voxel-based morphometry, VBM) 影像平滑化

More information

EMSegment Tutorial. How to Define and Fine-Tune Automatic Brain Compartment Segmentation and the Detection of White Matter Hyperintensities

EMSegment Tutorial. How to Define and Fine-Tune Automatic Brain Compartment Segmentation and the Detection of White Matter Hyperintensities EMSegment Tutorial How to Define and Fine-Tune Automatic Brain Compartment Segmentation and the Detection of White Matter Hyperintensities This documentation serves as a tutorial to learn to customize

More information

Ischemic Stroke Lesion Segmentation Proceedings 5th October 2015 Munich, Germany

Ischemic Stroke Lesion Segmentation   Proceedings 5th October 2015 Munich, Germany 0111010001110001101000100101010111100111011100100011011101110101101012 Ischemic Stroke Lesion Segmentation www.isles-challenge.org Proceedings 5th October 2015 Munich, Germany Preface Stroke is the second

More information

M-NET: A Convolutional Neural Network for Deep Brain Structure Segmentation

M-NET: A Convolutional Neural Network for Deep Brain Structure Segmentation M-NET: A Convolutional Neural Network for Deep Brain Structure Segmentation by Raghav Mehta, Jayanthi Sivaswamy in IEEE International Symposium on Biomedical Imaging 2017 (ISBI-2017) Melbourne, Australia

More information

Manual image registration in BrainVoyager QX Table of Contents

Manual image registration in BrainVoyager QX Table of Contents Manual image registration in BrainVoyager QX Table of Contents Manual image registration in BrainVoyager QX......1 Performing manual alignment for functional to anatomical images......2 Step 1: preparation......2

More information

Automatic Optimization of Segmentation Algorithms Through Simultaneous Truth and Performance Level Estimation (STAPLE)

Automatic Optimization of Segmentation Algorithms Through Simultaneous Truth and Performance Level Estimation (STAPLE) Automatic Optimization of Segmentation Algorithms Through Simultaneous Truth and Performance Level Estimation (STAPLE) Mahnaz Maddah, Kelly H. Zou, William M. Wells, Ron Kikinis, and Simon K. Warfield

More information

CRFs for Image Classification

CRFs for Image Classification CRFs for Image Classification Devi Parikh and Dhruv Batra Carnegie Mellon University Pittsburgh, PA 15213 {dparikh,dbatra}@ece.cmu.edu Abstract We use Conditional Random Fields (CRFs) to classify regions

More information

Free-Form B-spline Deformation Model for Groupwise Registration

Free-Form B-spline Deformation Model for Groupwise Registration Free-Form B-spline Deformation Model for Groupwise Registration Serdar K. Balci 1, Polina Golland 1, Martha Shenton 2, and William M. Wells 2 1 CSAIL, MIT, Cambridge, MA, USA, 2 Brigham & Women s Hospital,

More information

Machine Learning. Classification

Machine Learning. Classification 10-701 Machine Learning Classification Inputs Inputs Inputs Where we are Density Estimator Probability Classifier Predict category Today Regressor Predict real no. Later Classification Assume we want to

More information

Multi-atlas labeling with population-specific template and non-local patch-based label fusion

Multi-atlas labeling with population-specific template and non-local patch-based label fusion Multi-atlas labeling with population-specific template and non-local patch-based label fusion Vladimir Fonov, Pierrick Coupé, Simon Eskildsen, Jose Manjon, Louis Collins To cite this version: Vladimir

More information

Knowledge-Based Segmentation of Brain MRI Scans Using the Insight Toolkit

Knowledge-Based Segmentation of Brain MRI Scans Using the Insight Toolkit Knowledge-Based Segmentation of Brain MRI Scans Using the Insight Toolkit John Melonakos 1, Ramsey Al-Hakim 1, James Fallon 2 and Allen Tannenbaum 1 1 Georgia Institute of Technology, Atlanta GA 30332,

More information

Free-Form B-spline Deformation Model for Groupwise Registration

Free-Form B-spline Deformation Model for Groupwise Registration Free-Form B-spline Deformation Model for Groupwise Registration The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters Citation Balci

More information

Manifold Learning: Applications in Neuroimaging

Manifold Learning: Applications in Neuroimaging Your own logo here Manifold Learning: Applications in Neuroimaging Robin Wolz 23/09/2011 Overview Manifold learning for Atlas Propagation Multi-atlas segmentation Challenges LEAP Manifold learning for

More information

Unrolling Inference: The Recurrent Inference Machine

Unrolling Inference: The Recurrent Inference Machine Unrolling Inference: The Recurrent Inference Machine Max Welling University of Amsterdam / Qualcomm Canadian Institute for Advanced Research ML @ UvA (2 fte) (12fte) Machine Learning in Amsterdam (3fte)

More information