Automatic Vascular Tree Formation Using the Mahalanobis Distance

Similar documents
Comparison of Vessel Segmentations Using STAPLE

Comparison of Vessel Segmentations using STAPLE

Rigid and Deformable Vasculature-to-Image Registration : a Hierarchical Approach

3D/2D Model-to-Image Registration Applied to TIPS Surgery

Interactive segmentation of vascular structures in CT images for liver surgery planning

Probabilistic Tracking and Model-based Segmentation of 3D Tubular Structures

Registration of 3D cerebral vessels with 2D digital angiograms: Clinical evaluation

MIXTURE MODELING FOR DIGITAL MAMMOGRAM DISPLAY AND ANALYSIS 1

Generalizing vesselness with respect to dimensionality and shape Release 1.00

Application of level set based method for segmentation of blood vessels in angiography images

Extracting the Geometry of Branching Slabs via Cores

Modeling and preoperative planning for kidney surgery

3D Guide Wire Navigation from Single Plane Fluoroscopic Images in Abdominal Catheterizations

3D/2D Registration Via Skeletal Near Projective Invariance in Tubular Objects

Vessel Centerline Tracking in CTA and MRA Images Using Hough Transform

Landmark-based 3D Elastic Registration of Pre- and Postoperative Liver CT Data

Evaluation of Hessian-based filters to enhance the axis of coronary arteries in CT images

A 3-D Modeling Scheme for Cerebral Vasculature from MRA Datasets

Using Probability Maps for Multi organ Automatic Segmentation

Bioimage Informatics

Augmenting Intraoperative 3D Ultrasound with Preoperative Models for Navigation in Liver Surgery

Efficient 3D-3D Vascular Registration Based on Multiple Orthogonal 2D Projections

Ischemic Stroke Lesion Segmentation Proceedings 5th October 2015 Munich, Germany

DETECTING and extracting blood vessels in magnetic resonance

Lecture 13 Theory of Registration. ch. 10 of Insight into Images edited by Terry Yoo, et al. Spring (CMU RI) : BioE 2630 (Pitt)

VETOT, Volume Estimation and Tracking Over Time: Framework and Validation

Pearling: Medical Image Segmentation with Pearl Strings

4D Motion Modeling of the Coronary Arteries from CT Images for Robotic Assisted Minimally Invasive Surgery

3D Vascular Segmentation using MRA Statistics and Velocity Field Information in PC-MRA

Assessing the Local Credibility of a Medical Image Segmentation

Automatic Cerebral Aneurysm Detection in Multimodal Angiographic Images

GPU Accelerated Segmentation and Centerline Extraction of Tubular Structures from Medical Images

MRA Image Segmentation with Capillary Active Contour

From medical imaging to numerical simulations

Vascular segmentation in hepatic CT images using adaptive threshold fuzzy connectedness method

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 19: Machine Learning in Medical Imaging (A Brief Introduction)

Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information

Model-Based Respiratory Motion Compensation for Image-Guided Cardiac Interventions

3D/2D registration using cores of tubular anatomical structures as a basis. Alan Liu Elizabeth Bullitt Stephen M. Pizer

Guide wire tracking in interventional radiology

Sampling-Based Ensemble Segmentation against Inter-operator Variability

Linköping University Post Print. Phase Based Level Set Segmentation of Blood Vessels

3D Visualization of Vascular Structures

Object Identification in Ultrasound Scans

A Geometric Flow for Segmenting Vasculature in Proton-Density Weighted MRI

A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images

A Novel 2D-3D Registration Algorithm for Aligning Fluoro Images with 3D Pre-op CT/MR Images

Classification. Vladimir Curic. Centre for Image Analysis Swedish University of Agricultural Sciences Uppsala University

Multiple Cortical Surface Correspondence Using Pairwise Shape Similarity

The Insight Toolkit. Image Registration Algorithms & Frameworks

DS Machine Learning and Data Mining I. Alina Oprea Associate Professor, CCIS Northeastern University

Prostate Detection Using Principal Component Analysis

Characterizing Vascular Connectivity from microct Images

Tutorial Syllabus. Surface Visualization. (20 min.) Direct Volume Visualization. (30 min.) Medical Training and Surgical Planning

3D Statistical Shape Model Building using Consistent Parameterization

Model-Based Detection of Tubular Structures in 3D Images

Cerebral Artery Segmentation with Level Set Methods

Advanced Visual Medicine: Techniques for Visual Exploration & Analysis

Reconstruction of Blood Vessels from Neck CT Datasets using Stable 3D Mass-Spring Models

Medicale Image Analysis

Visualizing the Structure of Large Trees

I How does the formulation (5) serve the purpose of the composite parameterization

MARS: Multiple Atlases Robust Segmentation

Visual Medicine: Part Two Advanced Topics in Visual Medicine. Advanced Topics in Visual Medicine

Deformable Segmentation using Sparse Shape Representation. Shaoting Zhang

82 REGISTRATION OF RETINOGRAPHIES

A Level Set Based Predictor-Corrector Algorithm for Vessel Segmentation

Globally-Optimal Anatomical Tree Extraction from 3D Medical Images using Pictorial Structures and Minimal Paths

Accurate Quantification of Small-Diameter Tubular Structures in Isotropic CT Volume Data Based on Multiscale Line Filter Responses

3D Voxel-Based Volumetric Image Registration with Volume-View Guidance

White Matter Lesion Segmentation (WMLS) Manual

GPU-Based Airway Segmentation and Centerline Extraction for Image Guided Bronchoscopy

Image Registration. Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department

Low-Rank to the Rescue Atlas-based Analyses in the Presence of Pathologies

maximum likelihood estimates. The performance of

A View-Based Approach to Registration: Theory and Application to Vascular Image Registration

ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION

Copyright 2009 Society of Photo Optical Instrumentation Engineers. This paper was published in Proceedings of SPIE, vol. 7260, Medical Imaging 2009:

Automatic Subthalamic Nucleus Targeting for Deep Brain Stimulation. A Validation Study

CoWRadar: Visual Quantification of the Circle of Willis in Stroke Patients

BLUT : Fast and Low Memory B-spline Image Interpolation

Medical Image Segmentation

GeoInterp: Contour Interpolation with Geodesic Snakes Release 1.00

Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging

Explorative Building of 3D Vessel Tree Models 1) Technology, Inffeldgasse 16 2.OG, A-8010 Graz, Austria

Multi-Atlas Segmentation of the Cardiac MR Right Ventricle

Robust extraction of tumorous vascular networks in high resolution 3D images

Precise Segmentation of Vessels from MRA Brain Images

SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab

Bioimage Informatics

Blood vessel tracking in retinal images

GLIRT: Groupwise and Longitudinal Image Registration Toolbox

Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion

Simulated Wave Propagation and Traceback in Vascular Extraction

Level Set Evolution with Region Competition: Automatic 3-D Segmentation of Brain Tumors

CS 231A Computer Vision (Winter 2014) Problem Set 3

Dimension Reduction for Big Data Analysis. Dan Shen. Department of Mathematics & Statistics University of South Florida.

Multiscale Blood Vessel Segmentation in Retinal Fundus Images

CPM Specifications Document Healthy Vertebral:

APPLIED MECHANICS 2018

Transcription:

Automatic Vascular Tree Formation Using the Mahalanobis Distance Julien Jomier, Vincent LeDigarcher, and Stephen R. Aylward Computer-Aided Diagnosis and Display Lab, Department of Radiology The University of North Carolina at Chapel Hill 27510 Chapel Hill, USA vincent.ledigarcher@cpe.fr {jomier, aylward}@unc.edu Abstract. We present a novel technique for the automatic formation of vascular trees from segmented tubular structures. Our method combines a minimum spanning tree algorithm with a minimization criterion of the Mahalanobis distance. First, a multivariate class of connected junctions is defined using a set of trained vascular trees and their corresponding image volumes. Second, a minimum spanning tree algorithm forms the tree using the Mahalanobis distance of each connection from the connected class as a cost function. Our technique allows for the best combination of the discrimination criteria between connected and non-connected junctions and is also modality, organ and segmentation specific. 1 Introduction Segmentation of vascular structures from volume images reflects several challenges. Among them, accuracy of centerline extraction as well as complex formation of the vascular trees have led to powerful algorithms. Several segmentation techniques have shown high accuracy and robustness in extracting vascular structures from MR and CT datasets. In fact, the curve evolution algorithm [5] produces accurate vascular segmentations by combining the modified curvature diffusion equation (MCDE) with a level-set based technique. On the other hand, Aylward et al. [1] use a ridge traversal technique with width estimation to extract vascular centerline and estimated radius at each point along blood vessels. Both techniques have shown robustness to noise and high accuracy. However, most of the vascular segmentation algorithms do not form trees at the time of extraction but rather consider each blood vessel independently. Being able to visualize the vascular tree is a real motivation. In fact, neurosurgeons and interventional radiologists must often occlude blood vessels during vascular procedures. The risk of stroke to the patient depends largely upon the collateral flow provided by other parts of the circulation. It is therefore important for the clinician to visualize vascular connections in order to make correct decisions about vessel occlusion. Moreover, in parenchymal organs, the identification of vascular territories is crucial for providing resection proposals as well as

2 Julien Jomier et al. for preoperatively estimating resection volumes and patient outcome [4]. Some recent model-to-image registration methods also relies on a vascular network to perform a hierarchical registration strategy [2]. The most closely related work for tree creation has been done by Bullitt et al. [3]. They have shown that by using a combination of both linear distance and image intensity in suspected regions of connection, a tree can be formed with high accuracy. The combination of the distance and image intensity as a cost function for the minimum spanning tree algorithm is described by the following weighted equation: 4 I + d, where I is the ratio of mean intensities along the centerline µ c of a concentric cylinder (radius larger than that of the child) and on the surface of that same cylinder µ e such that I = µe µ c. Our method differs from the previous technique in that it combines multiple criteria for connection in an optimal way using a linear discriminant strategy. Moreover, by creating training classes, our algorithm can be made specific to a particular modality, organ and even extraction method. 2 Methods Our method relies on the centerline representation of a blood vessel. In fact, each extracted blood vessel is defined as centerline points (x, y, z) with associated radius r. The tangent t and normal plane (n 1, n 2 ) are computed using finite differences. 2.1 Minimum Spanning Tree and Mahalanobis Distance Our technique makes use of the minimum spanning tree algorithm based on Prim s method [6]. The main difficulty in forming such vascular tree lies in defining an effective cost function for the junctions and, even with a set of good criteria, it can be difficult to find an appropriate linear combination of theses values. By definition, in a tree structure, a child can only have one parent. Moreover, a vascular network is usually formed of several trees and if those trees overlaps, i.e portal and hepatic vascular systems in the liver, it is often the case where an automated algorithm has to make the choice between two (or more) parents. Figure 1 shows an example of vascular configuration with two tree. In this case, vessel 5 can be connected to two parents and relies on the cost function to decide the best connection between C 35 and C 45. Our method provides an optimal way to combine the criteria defining junctions using the Mahalanobis distance. The Mahalanobis distance is a statistic value which measures the distance of a single data point from the sample mean or centroid in the space of the independent variables used to fit a multiple regression model. The Mahalanobis can be formulated as: d S (x, y) = (x y) t S 1 (x y) (1) where y is the corresponding mean from the class and S its covariance matrix. We first define a multivariate class of connected junctions using five criteria:

Automatic Vascular Tree Formation Using the Mahalanobis Distance 3 Fig. 1. Example of tree configuration. Vessel 5 should only have one parent. The choice is based on the minimum Mahalanobis distance between C 35 and C 45. 1. Distance from the first point of the child vessel to the closest parent point. 2. Angle between the tangent direction of the parent point and the first point of the selected child. 3. Ratio between the radius of the parent point and the selected child. 4. Difference between the radius of the parent point and the selected child. 5. Ridgeness, defined as the mean of the ridgnesses rn at each point from the parent point and the first point of the selected child. rn is defined as follow: rn = d V 3 λ2 λ 1 (1 λ3 λ 2 ) λ 2, where d is the direction of the vessel at that point; V 3 is the eigen vector corresponding the the minimum eigen value of the Hessian of the image intensities λ 1, λ 2 and λ 3 the corresponding eigen values. For each connected junction in the training set, the five criterion values are computed and define the connected class. A minimum spanning tree algorithm is then performed using the Mahalanobis distance of the selected connection criteria and the previously defined class. One can notice that the criterion values do not have to be especially minimize - they can be maximized - as long as the class definition and the corresponding Mahalanobis distance are computed with the same criteria. Moreover, our algorithm does not rely on the number of criteria or the quality of the criterion used since the linear discrimination will select the best features. One constraint of this approach is that the Mahalanobis assumes a normal distribution of the variables. However, some of our criteria, i.e the ridgeness, does not fulfill this assumption since the ridgeness is linearly proportional to the significance of a connection. In order to approximate a normal distribution we use the exponential value of the ridgeness centered on zero mean. For each ridgeness value we actually define two values: e rn and e rn in the class definition. 2.2 Robust class definition The definition of the connected class requires a set of trained vascular trees and corresponding dataset volumes. Each trained vascular tree is formed manually by an expert. However, the high number of possible connections (100 to 300) and the quality of the segmentation makes this task difficult. Therefore, we

4 Julien Jomier et al. perform a robust algorithm to remove any outliers left in the training set. First the multivariate class is computed using all the possible connections available. Second, the Mahalanobis distance of each connection is checked against the defined class. Outliers are removed if their Mahalanobis distance is more than 2σ from the mean distances. 3 Results We have tested our algorithm on nine brain MR and nine liver CT datasets. CT volumes are contrast enhanced 1 1 3mm 3 voxels and MRA volumes are time-of-flight data with 1 1 1mm 3 voxels. The class of connected junctions for both organs are reported in figure 2. As one can see, the connection criteria may have large differences depending on the modality and the organ concerned, shows the importance of having an organ and modality specific connected class. Moreover, the radius ratio in the brain connected cases is close to one and as a small standard deviation compared to the radius ratio obtained for the liver datasets. In fact the segmentation algorithm used [1] is less robust close to the branching regions. This is especially true for our liver datasets where the blood contrast tends to weaken around branch points. Criterion Mean (σ) brains Mean (σ) livers Distance 0.534 (1.450) 3.441 (2.696) Tangent -0.021 (0.553) 0.038 (0.604) Radius difference 0.216 (0.338) 1.200 (1.063) Radius ratio 1.038 (0.273) 1.701 (0.996) Ridgeness 0.000 (0.274) 0.000 (0.186) Fig.2. Criteria for connected junctions for brain and liver datasets To show that the class definition is reliable across datasets, we perform a leave-one-out analysis. For each organ, the connected class is defined using eight vascular systems and the Mahalanobis distance is computed for each connections in the remaining vasculature. Figure 3 shows the percentile of accurate connections found given a threshold for the Mahalanobis distance. As one can see, (a) the curves are very similar meaning that the class definition and the Mahalanobis distance are reliable; (b) the thresholds to achieve 100% of connections are different for the brains and livers which strengthen the statement that an organ/modality specific class is necessary. In the next paragraph we show that our algorithm is able to select junctions even for difficult cases in the brain and in the liver. 3.1 Difficult cases We found interesting to test the output of our algorithm in the only region of the human body where the vascular system forms a circle: the circle of Willis in

Automatic Vascular Tree Formation Using the Mahalanobis Distance 5 100 100 80 80 % of connections 60 % of connections 60 40 40 20 20 0 0 10 20 30 40 50 60 70 80 90 100 Mahalanobis Distance 0 0 10 20 30 40 50 60 70 80 90 100 Mahalanobis Distance Fig. 3. Percentile of effective connections given a treshold for the Mahalanobis distance for nine brain MRI (left) and nine liver CT (right). the brain. In this particular case we test two junctions, J2 3 and J2 1, were the connection effectively exists as shown on figure 4. We trained our algorithm using the height brain MR datasets previously presented and we computed the Mahalanobis distance for the two junctions. The results are shown in Figure 5. Vessel 3 J2-3 Vessel 1 Vessel 2 J2-1 Fig.4. Circle of Willis in the brain. As expected, the two junctions have similar Mahalanobis distances, therefore we can assume that they should be both connected (or not connected). The distance seems high comparing to the class definition obtained during the training stage and will be in favor of a non connected functions. This is due to the particularity of these junctions in the circle of Willis where the radius ratio and difference values are high comparing to other connections in the brain. To test this hypothesis, we have trained and compared the junctions without the

6 Julien Jomier et al. Criterion J2-3 J2-1 Distance 2.369 1.092 Tangent 0.334-0.819 Radius difference 1.950 1.629 Radius ratio 1.864 2.256 Ridgeness 0.000 0.000 Mahalanobis distance 30.169 34.342 Fig.5. Mahalanobis distance of the two junctions in the circle of Willis. radius ratio and difference criteria and we obtained respectively d J2 3 = 1.99 and d J2 1 = 2.25. We have also tested our method on a difficult case within the liver where the hepatic and portal venous systems overlap. Figure 6 shows the region of interest where the vessel 3 can be connected to either vessel 1 or vessel 2. In fact, due to a bad segmentation of vessel 3, a standard algorithm would make J2 3 the preferred connection over J1 3. However, the computed Mahalanobis distances, show in figure 7, for both junctions are reporting J1 3 to be the selected connection and not J2 3. By looking at the image volume, and also the ridgness values, J1 3 appears to be the real connection in this case as predicted by our algorithm. From the class definition shown in the previous section, one can see that the ratio between the radius of the child and the radius of the parent is not a high significant criterion (µ = 1.701, σ = 0.996), therefore the linear discriminant will be less sensitive to this particular feature. Moreover, as one can notice, the value of the non-connected junction is close to the threshold defined in the previous section. Vessel 1 Vessel 2 J1-3 Vessel 3 J2-3 Fig. 6. Difficult case within the liver where the hepatic and portal venous systems overlap.

Automatic Vascular Tree Formation Using the Mahalanobis Distance 7 Criterion J1-3 J2-3 Distance 2.676 1.236 Tangent -0.320-0.769 Radius difference 1.006 1.692 Radius ratio 2.337 0.475 Ridgeness 0.001 0.316 Mahalanobis distance 1.522 10.329 Fig. 7. Mahalanobis distance of the two junctions in the liver. The distance is inversely proportional to the probability of connection. 4 Discussion and Conclusions We have presented a novel algorithm for automatic vascular tree formation based on the Mahalanobis distance. The main advantages of our algorithm are (a) the optimal combination of discrimination parameters and (b) the fact that the defined class from these criteria can be modality, organ and segmentation specific. We have also shown that the class definition is consistent among datasets based on the Mahalanobis distance measure and that our algorithm can detect real branching with high accuracy. One of the weaknesses of our approach is that it relies on some information regarding the segmentation technique. If the segmentation predicts a radius far from the real radius, our method may fail. However, the other criteria, such as the tangent direction and the ridgeness can help in this case. We are currently working on extending our approach to include direction of the blood flow. This work has been developed using the Insight Toolkit [7]. This work is funded in part by the Whitaker Foundation (TF-04-0008), the NIH-NIBIB (R01 EB000219). References 1. Aylward, S., Bullitt, E.: Initialization, Noise, Singularities, and Scale in Height- Ridge Traversal for Tubular Object Centerline Extraction IEEE Transactions on Medical Imaging, Feb, 2002, Pages 61-75 2. Jomier J., Aylward S.: Rigid and Deformable Vasculature-to-Image Registration: A Hierarchical Approach. MICCAI 2004: 829-836 3. Bullitt, E., Aylward S., Liu A., Stone J., Mukherji S., Coffey C., Gerig G., Pizer SM.: 3D graph description of the intracerebral vasculature from segmented MRA and tests of accuracy by comparison with x-ray angiograms IPMI 99. Lecture Notes in Computer Science 1613:308-321 4. D. Selle, B. Preim, A. Schenk, and H.-O. Peitgen, Analysis of vasculature for liver surgical planning IEEE Trans. Med. Imaging., vol. 21,no. 11, pp. 13441357, Nov 2002.

8 Julien Jomier et al. 5. Lorigo L., Faugeras O.,Grimson W.E.L.,Keriven R.,Kikinis R.,Nabavi A. and Westin C.-F.: Curves: Curve evolution for vessel segmentation. Medical Image Analysis, 5:195-206, 2001. 6. Aho A. V., Hopcroft J. E., Ullman J.: Data Structures and Algorithms. pp 237 Addison-Wesley Publishing Company, Lebanon, Indiana, U.S.A. 1982 7. L. Ibanez, W. Schroeder, L. Ng and J. Cates, The ITK Software Guide, published by Kitware Inc. ISBN: 1-930934-10-6