Multimodal Image Fusion Of The Human Brain
|
|
- Lesley Robertson
- 6 years ago
- Views:
Transcription
1 Multimodal Image Fusion Of The Human Brain Isis Lázaro(1), Jorge Marquez(1), Juan Ortiz(2), Fernando Barrios(2) Centro de Ciencias Aplicadas y Desarrollo Tecnológico, UNAM Circuito Ext. S/N, Cd. Universitaria CP 04510, México, DF, Mexico Instituto Nacional de Neurología, UNAM, Juriquilla, Querétaro, México Abstract We present techniques for visualizing images that combine, in a useful and meaningful way, the information present in 3D volumes of two medical imaging modalities: anatomical, via MRI (Magnetic Resonance Imaging) and functional information, from PET (Positron Emission Tomography) or functional MRI (fmri). Classical visualization of image fusion often use fixed blending or RGB channel combinations of two or three image modalities, assuming the images are in registration. These tools do not consider the anatomical and functional characteristics of the images. We take advantage of the HSV (Hue, Saturation and Value) color space to enhance anatomical and functional features of the human brain in MRI and PET or fmri sets. To this end we tested gradient operators, border filters and spatial-domain filters to enhance low spatial variations in functional information, where contours are highly blurred, compared to anatomical modalities. We describe a choice of the tested methods and show images of current results. I. Introduction For an accurate interpretation of the information in functional images from the brain, physicians need to know the location of specific activations by using anatomical images. Image fusion refers to several techniques that combine intensity, details and complementary features of two or more imaging modalities, to improve the visualization and interpretation, allowing the extraction of information that would not be visible or clear within each separate modality. For these reasons, our objective is to obtain images with as much useful data as possible, preserving the identity of the modalities involved (function and anatomical location, in our case), using perceptually clear and flexible fusion methods to facilitate medical diagnosis. In other kind of problems, image fusion can also be used to combine information partially present in each modality, or from several images of the same modality, or even combining the output of different filters or image processing methods. In these cases, the identity of each component is often lost. In this work we report results obtained by fusing PET (I PET ) and MRI (I MRI ) images of the human brain, for the visualization of neural activations and their exact location. We tested methods such as interactive alpha blending that allows gradual blending of different color channels, grayscale for the anatomical modality and pseudo color for the functional modality. The color space approach, using the HSV (Hue, Saturation and Value) model preserves the information of both images, since the gray-level intensity (Value) is adequate to show well-defined edges from I MRI and the modulating Hue component, defined by I PET, is ideal to display functional features, and does not interfere with the perception of anatomical details. Saturation may be held constant or combine information from either channel, or both. Finally, an overlapping minimization technique was tested, using operators for gradient and contour extraction in I PET and I MRI, in order to enhance the fusion results. II. Materials and Methods We employed MRI brain images of normal children of eight years. Several sets were obtained on a 1
2 General Electric 3.0 Tesla MR750 (Milwaukee, Wisconsin USA). Volumetric images were obtained with the technique of FSPGR with frequency FOV = 24, Phase FOV = 10.75, Slice Thickness = 1.3, Flip Angle = 12, Freq = 320, Phase = 320, NEX = 1, and TR = 8.2 TE = Full min, with a total of 144 axial slices 1.3 thick. Moreover, functional images (fmri) were obtained with a hand movement paradigm and parameters: FOV = 24.6 Freq, Phase FOV = 1.00, Slice Thickness = 3, TR = 3000, TE = 40, Flip Angle = 90, Freq = 64, Phase = 64 and NEX = 1, with a total of 32 images. Image resolution for both sets is The MRI scanner is at the the Neuro-Biology Institute of the UNAM (National Autonomous University of Mexico). We also employed a functional image set from the PET scanner (from Philips), with similar settings, but a lower resolution of , of the School of Medicine of the UNAM. The datasets where registered (that is, geometrically aligned and scaled according to the standard Atlas of Talairach) using Statistical Parametric Mapping (SPM), a MATLAB software package implementing statistical analysis, transformations and some image processing specific for neuroimaging data. [1]. A. Image and Data Fusion Data fusion consists in techniques for combining information originating from several sources in order to improve or obtain additional information [2-4]. Depending on the type of data to be fused, the objectives, methods and terminology, can vary greatly and need to be precisely chosen. In the case of image processing, fusion is the process of combining relevant information of multiple images of a scene, into a single image, more informative than each one of the input images. In medical image, the integration to get extra information is useful for taking advantage of a multimodality approach and help the detection, diagnosis and management of certain diseases. The different medical image modalities can be classified in two main categories: anatomical and functional. The first one shows the morphology, structure location and shape features; such modalities include X-ray, MRI (magnetic resonance image) or CT (computed tomography). The second category of medical-imaging modalities gives information about the metabolism and the locus of physiological responses to stimuli and specific activations. Such category includes PET (positron emission tomography), SPECT (single photon emission computed tomography) or fmri (functional MRI). Nowadays, in a clinical environment it is common to take several images from the same patient; it can be the same type of study or from different modalities, either to enhance the final result or to know the anatomical localization to interpret the functional information correctly; therefore to increase the understanding of the available information it is necessary a method to display simultaneously two or more images, coming often from different medical imaging modalities. Our main objective is to develop visualization techniques of image fusion that combines the complementary and contrasted features of both images into a single one, in order to obtain more medical information and help the physicians to extract characteristics that usually are not visible in each individual studio, or when localization is uncertain, with respect to an anatomical feature. We have noted that the complexity of the data for each modality makes it impossible to implement a unique comprehensive method to combine and exploit all the characteristics of the images; so it is important to have a clear idea about the objectives and applications in mind. We have found different contexts and interpretations that make confusing the meaning of terms associated with image fusion. For that reason, we adopt a division of the objectives of image fusion to facilitate the understanding of the best method, according to specific goals. These objectives are: 1) To combine information of data generally incomplete from different sources (sensors). The identity of each data source is usually lost, since a single restored image is formed (fusion 2
3 output). An example is obtaining an extended depth-of field image, from several images with short depth of field, at different in-focus loci. Another example is to obtain contours of a feature from different modalities or different images under different conditions. 2) Simultaneous display of two or more image components (signals or datasets) without losing the identity of each image component. This is the topic of the present work and is highly related with Scientific Visualization problems, where interpretation is enhanced by several computer-graphics techniques, color and visual cues. 3) Visualization in order to compare two datasets and evaluating a processing method too. Such method can be a registration algorithm, considering deformation, or the output of two segmentations techniques, to be compared against a golden standard. Many papers report registration techniques where validation is performed by simultaneously visualizing both images; a number of fusion techniques ad hoc are employed [2-5]. 4) Combining different models, algorithms, designs, strategies, paradigms, classifiers, interpretations and other abstract information. In this case, data fusion is generalized to other entities and include not only raw or processed data, but representations, methods, descriptions, etc., coming from the lowest to the highest-level stages in any task from Computer Vision and other disciplines. In this work we focus on Objective 2, which represents a timely need in Mexican hospitals: the interpretation, by a neurologist, of the simultaneous display of anatomical and functional information, preserving the identity of brain activity and structural features in order to locate activity in a particular region. B. Image-Fusion Operators. a. Alpha Blending Before any fusion was performed, the images were aligned (registered) and normalized using the software SPM, which uses a standard atlas of the brain, in the Talairach frame of reference [6]. A perceptual combination of two registered images, I MRI and I PET is the alpha blending, with a parameter, ranging from 0 to 1, is the linear interpolation: (1- α) I MRI + α I PET (1) The problem with such combination, for visualization purposes, is that the modality identity was lost. A solution is to show each modality in a different color channel or combination of colors (red and cyan, for example), or one is shown in a conventional gray-scale (all three RGB components have the same gray intensity), while the other occupies only one color channel, usually green. If the MRI information is displayed in gray intensities (all RGB channels)) and the PET in the green chanel, equation (1) is more correctly written, in color space components (R, G, B) as: ( (1- α) I MRI, ( (1- α) I MRI + α I PET ), (1- α) I MRI ) (2) A red-blue display of alpha blending, with red for I MRI and green for I PET, works perceptually as grayscale blending, since color channels still combine. It is written as: ( (1- α) I MRI, 0, α I PET ) (3) A cyan scale implies displaying the same information in the G and B color channels. Figure 1 show a sequence of components, by using fmri images of the same subject, as functional modality. We 3
4 have already reported similar results for MRI and PET in [7]. It is also shown the fusion with alpha blending, using different values of alpha and different color-channel selections. Image 1 Slice: 21 alpha = 0.5 Figure 1. (See the figure caption in the next page for an explanation). Image 2 Slice: 21 alpha = 0 Image 3 Slice: 21 alpha = 0.5 4
5 Image 4 Slice: 21 alpha = 1 Image 5 Slice: 21 alpha = 0.5 Image 6: Slice: 21 sigma = 0.5; Figure 1. Image 1 and image 2 are the MRI and fmri images to be fused, images 3 and 4 show alpha-blending in a gray-green display, image 5 uses red and cyan channels and image 6 shows a Gaussian smoothing. The operators are performed over the entire volume dataset. b. Minimum Overlapping As noted, anatomical features in MRI and CT images present much finer details than functional images (fmri, or PET). The first can be enhanced by using the Laplacian and gradient filters while 5
6 the second, by regional-enhancing operators, which further blur and smooth edges and contours. This combination allows a display where both modalities are relatively separated. A way to properly visualize both images, with a clear identification of each modality is to use color channels not from the RGB color space, but from the Hue, Saturation and Value (HSV) color space. By assigning functional information (I fmri )to the Hue channel and the anatomical image to the Value channel, while holding constant the Saturation channel, at medium gray intensity (an image I 128 with uniform intensity 128, assuming a scale from 0 to 255), a clear distinction is achieved. We further tested other combinations, finding optimal the following: I ( I, I, I ) ( I, I, ( I I )) (4) 1 HSV Hue Sat Val fmri MRI 2 MRI fmri An interpretation improvement of low-to-high activation required to invert the intensity values of I fmri by applying a cold-to-hot hue scale,. A problem is the cycling of the red and purple hues, so, instead of taking the full range of hue, this was further limited to start in blue (zero and low intensities) ending in red for the highest. Furthermore, the color scale begins in black, preserving the original background. Images in figure 2 illustrate the result, for the same slice of the brain. Figure 2. (Left) The sidebar scale shows the hue progression when using I HSV = (I fmri, 256, I MRI ); (center) when the functional modality I fmri is used as Value, low activation is darkened and a changing sidebar should be used for interpretation. (Right) an average of I fmr and I MRI gives a better result, preserving the Hue which modulates anatomical features. When no activity is present, anatomy appears as gray intensities. A final parameter allows to display only an activity range of interest (ARI), coloring a selected window of activation. Small changes can be distinguished by re-scaling the ARI to full color scale. Numbers in proper units should be displayed in the sidebar, to interpret the hue variations. c. Contour displaying Anatomical features such as specific brain lobes and cortex lobules are difficult to identify in a grayscale image, especially when color is added to see simultaneously the functional activation in that area. Region contours can be extracted and overlaid to enhance the overall identification and association of activity with such regions. The set of all contours I MRI may be extracted by simple techniques, such as the gradient operator, as we detail in [7], or they may come from an atlas, in geometric registration with the brain under study, or they may be drawn manually, by an expert. Hue, Saturation and Value channel combinations may incorporate the contour mask as follows, where now we use I PET images as the functional modality: 6
7 I ( I, I ( I )( I I ), ( I I )) (5) 1 1 HSV PET MRI MRI PET 2 MRI PET where I MRI is 1 at the contour pixels, and 0 elsewhere, while I 128 is a constant-value image. Note that contours will appear slightly colored, without interfering with functional information and blending with non-contour pixels. Figure 3 shows an example, using MRI and PET images. FIGURE 3. A functional (mainly hue) PET image combined with an MRI image (shades in saturation and value channels) with overlaid contours, lightly colored by the PET information. II. Discussion and Conclusions We presented current work on designing and visual evaluation of different operators and fusion combinations for displaying together two medical-imaging modalities. The criteria to achieve this has been very simple, in the special case of functional and anatomical information: on one hand, gray-scale intensities were used to mainly display anatomical data, whose edges and contours are either enhanced or extracted to be superposed on the fusion, then, on the other hand, color has been used as modulation, mainly in the hue channel, for the functional information, which has been further blurred, since it does not present edges or features. In this way, both modalities have been displayed simultaneously, achieving a clear distinction of each one, while showing the location of activity in specific, known zones of the brain. The contours may come also from an Atlas, or from 7
8 an expert, traced by hand, and our software is able to adjust the range of activation to be visualized, as well as other parameters, to better control the look-up table color scales, for example, to map the full output dynamic range for a small input range. Evaluation by clinicians is under way and we are also working on the three-dimensional volume rendering and surface rendering of brain images with coloring from the fusion process. Acknowledgment We thank the PET/CT Cyclotron Unit of the School of Medicine of the UNAM for assistance, evaluation and providing PET images, and Dr. Fernando Barrios, Juan Ortiz and Erick Pasaye from the Institute of Neurobiology of the UNAM for assistance and providing MRI and fmri images for this work. IV Bibliography [1] - Statistical Parametric Mapping Software website from the Wellcome Trust Centre for Neuroimaging, UK, [2] M. van Herk, J.C. de Munck, J.V. Lebesque, S. Muller, C. Rasch, and A. Touw, Automatic registration of pelvic computed tomography data and magnetic resonance scans including a full circle method for quantitative accuracy evaluation, Medical Physics 25, (1998). [3] J.B.West and J.M. Fitzpatrick, Point-based Rigid Registration: Clinical Validation of Theory, Medical Imaging 2000: Image Processing, K.M. Hanson, Ed. Proceedings of SPIE 3979, pp (2000). [4] C. Studholme, D.L.G. Hill, D.J. Hawkes, Automated 3D Registration of MR and CT Images of the Head, Medical Image Analysis 1, (1996). [5] J.B.A. Maintz and M.A. Viergever, A Survey of Medical Image Registration, Medical Image Analysis 2, 1-36 (1998). [6] K.J. Friston. Statistical Parametric Mapping and Other Analysis of Functional Imaging Data. In Brain Mapping: The Methods, pages Academic Press, (1996). [7] Márquez Jorge, Gastelum Alfonso and Padilla Miguel Angel, Image-Fusion Operators for 3D Anatomical and Functional Analysis of the Brain, work 1661, 29th International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France, August, 2007, pp
Medical Image Analysis
Computer assisted Image Analysis VT04 29 april 2004 Medical Image Analysis Lecture 10 (part 1) Xavier Tizon Medical Image Processing Medical imaging modalities XRay,, CT Ultrasound MRI PET, SPECT Generic
More informationIntroduction to Neuroimaging Janaina Mourao-Miranda
Introduction to Neuroimaging Janaina Mourao-Miranda Neuroimaging techniques have changed the way neuroscientists address questions about functional anatomy, especially in relation to behavior and clinical
More informationImage Registration. Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department
Image Registration Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department Introduction Visualize objects inside the human body Advances in CS methods to diagnosis, treatment planning and medical
More informationAdvanced Visual Medicine: Techniques for Visual Exploration & Analysis
Advanced Visual Medicine: Techniques for Visual Exploration & Analysis Interactive Visualization of Multimodal Volume Data for Neurosurgical Planning Felix Ritter, MeVis Research Bremen Multimodal Neurosurgical
More informationREGISTRATION AND NORMALIZATION OF MRI/PET IMAGES 1. INTRODUCTION
JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 9/2005, ISSN 1642-6037 Jacek RUMIŃSKI *, Marek SUCHOWIRSKI * image registration, image normalization, PET, MRI, parametric imaging REGISTRATION AND NORMALIZATION
More informationAnnales UMCS Informatica AI 1 (2003) UMCS. Registration of CT and MRI brain images. Karol Kuczyński, Paweł Mikołajczak
Annales Informatica AI 1 (2003) 149-156 Registration of CT and MRI brain images Karol Kuczyński, Paweł Mikołajczak Annales Informatica Lublin-Polonia Sectio AI http://www.annales.umcs.lublin.pl/ Laboratory
More information3D Surface Reconstruction of the Brain based on Level Set Method
3D Surface Reconstruction of the Brain based on Level Set Method Shijun Tang, Bill P. Buckles, and Kamesh Namuduri Department of Computer Science & Engineering Department of Electrical Engineering University
More informationQualitative Comparison of Conventional and Oblique MRI for Detection of Herniated Spinal Discs
Qualitative Comparison of Conventional and Oblique MRI for Detection of Herniated Spinal Discs Doug Dean Final Project Presentation ENGN 2500: Medical Image Analysis May 16, 2011 Outline Review of the
More informationA Study of Medical Image Analysis System
Indian Journal of Science and Technology, Vol 8(25), DOI: 10.17485/ijst/2015/v8i25/80492, October 2015 ISSN (Print) : 0974-6846 ISSN (Online) : 0974-5645 A Study of Medical Image Analysis System Kim Tae-Eun
More informationNeuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry
Neuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry Nivedita Agarwal, MD Nivedita.agarwal@apss.tn.it Nivedita.agarwal@unitn.it Volume and surface morphometry Brain volume White matter
More informationComputational Medical Imaging Analysis
Computational Medical Imaging Analysis Chapter 1: Introduction to Imaging Science Jun Zhang Laboratory for Computational Medical Imaging & Data Analysis Department of Computer Science University of Kentucky
More informationMethods for data preprocessing
Methods for data preprocessing John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK. Overview Voxel-Based Morphometry Morphometry in general Volumetrics VBM preprocessing
More informationWhole Body MRI Intensity Standardization
Whole Body MRI Intensity Standardization Florian Jäger 1, László Nyúl 1, Bernd Frericks 2, Frank Wacker 2 and Joachim Hornegger 1 1 Institute of Pattern Recognition, University of Erlangen, {jaeger,nyul,hornegger}@informatik.uni-erlangen.de
More informationMEDICAL IMAGE ANALYSIS
SECOND EDITION MEDICAL IMAGE ANALYSIS ATAM P. DHAWAN g, A B IEEE Engineering in Medicine and Biology Society, Sponsor IEEE Press Series in Biomedical Engineering Metin Akay, Series Editor +IEEE IEEE PRESS
More informationVisualisation : Lecture 1. So what is visualisation? Visualisation
So what is visualisation? UG4 / M.Sc. Course 2006 toby.breckon@ed.ac.uk Computer Vision Lab. Institute for Perception, Action & Behaviour Introducing 1 Application of interactive 3D computer graphics to
More informationAutomatic segmentation of the cortical grey and white matter in MRI using a Region Growing approach based on anatomical knowledge
Automatic segmentation of the cortical grey and white matter in MRI using a Region Growing approach based on anatomical knowledge Christian Wasserthal 1, Karin Engel 1, Karsten Rink 1 und André Brechmann
More informationMedical Imaging Introduction
Medical Imaging Introduction Jan Kybic February 16, 2010 Medical imaging: a collaborative paradigm picture from Atam P. Dhawan: Medical Imaging From physiology to information processing (what we should
More information3D Voxel-Based Volumetric Image Registration with Volume-View Guidance
3D Voxel-Based Volumetric Image Registration with Volume-View Guidance Guang Li*, Huchen Xie, Holly Ning, Deborah Citrin, Jacek Copala, Barbara Arora, Norman Coleman, Kevin Camphausen, and Robert Miller
More information3D graphics, raster and colors CS312 Fall 2010
Computer Graphics 3D graphics, raster and colors CS312 Fall 2010 Shift in CG Application Markets 1989-2000 2000 1989 3D Graphics Object description 3D graphics model Visualization 2D projection that simulates
More informationThe Anatomical Equivalence Class Formulation and its Application to Shape-based Computational Neuroanatomy
The Anatomical Equivalence Class Formulation and its Application to Shape-based Computational Neuroanatomy Sokratis K. Makrogiannis, PhD From post-doctoral research at SBIA lab, Department of Radiology,
More informationComputational Medical Imaging Analysis Chapter 4: Image Visualization
Computational Medical Imaging Analysis Chapter 4: Image Visualization Jun Zhang Laboratory for Computational Medical Imaging & Data Analysis Department of Computer Science University of Kentucky Lexington,
More informationRADIOMICS: potential role in the clinics and challenges
27 giugno 2018 Dipartimento di Fisica Università degli Studi di Milano RADIOMICS: potential role in the clinics and challenges Dr. Francesca Botta Medical Physicist Istituto Europeo di Oncologia (Milano)
More informationHybrid Approach for MRI Human Head Scans Classification using HTT based SFTA Texture Feature Extraction Technique
Volume 118 No. 17 2018, 691-701 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu Hybrid Approach for MRI Human Head Scans Classification using HTT
More informationMedical Image Registration by Maximization of Mutual Information
Medical Image Registration by Maximization of Mutual Information EE 591 Introduction to Information Theory Instructor Dr. Donald Adjeroh Submitted by Senthil.P.Ramamurthy Damodaraswamy, Umamaheswari Introduction
More informationFmri Spatial Processing
Educational Course: Fmri Spatial Processing Ray Razlighi Jun. 8, 2014 Spatial Processing Spatial Re-alignment Geometric distortion correction Spatial Normalization Smoothing Why, When, How, Which Why is
More informationBiomedical Image Processing
Biomedical Image Processing Jason Thong Gabriel Grant 1 2 Motivation from the Medical Perspective MRI, CT and other biomedical imaging devices were designed to assist doctors in their diagnosis and treatment
More informationNon-Rigid Multimodal Medical Image Registration using Optical Flow and Gradient Orientation
M. HEINRICH et al.: MULTIMODAL REGISTRATION USING GRADIENT ORIENTATION 1 Non-Rigid Multimodal Medical Image Registration using Optical Flow and Gradient Orientation Mattias P. Heinrich 1 mattias.heinrich@eng.ox.ac.uk
More informationPROSTATE CANCER DETECTION USING LABEL IMAGE CONSTRAINED MULTIATLAS SELECTION
PROSTATE CANCER DETECTION USING LABEL IMAGE CONSTRAINED MULTIATLAS SELECTION Ms. Vaibhavi Nandkumar Jagtap 1, Mr. Santosh D. Kale 2 1 PG Scholar, 2 Assistant Professor, Department of Electronics and Telecommunication,
More informationBasic principles of MR image analysis. Basic principles of MR image analysis. Basic principles of MR image analysis
Basic principles of MR image analysis Basic principles of MR image analysis Julien Milles Leiden University Medical Center Terminology of fmri Brain extraction Registration Linear registration Non-linear
More informationAnalysis of Functional MRI Timeseries Data Using Signal Processing Techniques
Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques Sea Chen Department of Biomedical Engineering Advisors: Dr. Charles A. Bouman and Dr. Mark J. Lowe S. Chen Final Exam October
More informationObject Identification in Ultrasound Scans
Object Identification in Ultrasound Scans Wits University Dec 05, 2012 Roadmap Introduction to the problem Motivation Related Work Our approach Expected Results Introduction Nowadays, imaging devices like
More informationClinical Prospects and Technological Challenges for Multimodality Imaging Applications in Radiotherapy Treatment Planning
Clinical Prospects and Technological Challenges for Multimodality Imaging Applications in Radiotherapy Treatment Planning Issam El Naqa, PhD Assistant Professor Department of Radiation Oncology Washington
More informationSPM8 for Basic and Clinical Investigators. Preprocessing. fmri Preprocessing
SPM8 for Basic and Clinical Investigators Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization Spatial
More informationPathology Hinting as the Combination of Automatic Segmentation with a Statistical Shape Model
Pathology Hinting as the Combination of Automatic Segmentation with a Statistical Shape Model Pascal A. Dufour 12,HannanAbdillahi 3, Lala Ceklic 3,Ute Wolf-Schnurrbusch 23,JensKowal 12 1 ARTORG Center
More informationAbstract. 1. Introduction
A New Automated Method for Three- Dimensional Registration of Medical Images* P. Kotsas, M. Strintzis, D.W. Piraino Department of Electrical and Computer Engineering, Aristotelian University, 54006 Thessaloniki,
More informationElastic registration of medical images using finite element meshes
Elastic registration of medical images using finite element meshes Hartwig Grabowski Institute of Real-Time Computer Systems & Robotics, University of Karlsruhe, D-76128 Karlsruhe, Germany. Email: grabow@ira.uka.de
More informationMedical Computer Vision
Vienna Computer Vision Meetup 27.01.2016 sponsored by Medical Computer Vision Markus Holzer markus@radiology-explorer.com www.radiology-explorer.com www.meduniwien.ac.at www.cir.meduniwien.ac.at Overview
More informationA Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images
A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images Jianhua Yao 1, Russell Taylor 2 1. Diagnostic Radiology Department, Clinical Center,
More informationAtlas Based Segmentation of the prostate in MR images
Atlas Based Segmentation of the prostate in MR images Albert Gubern-Merida and Robert Marti Universitat de Girona, Computer Vision and Robotics Group, Girona, Spain {agubern,marly}@eia.udg.edu Abstract.
More informationPET AND MRI BRAIN IMAGE FUSION USING REDUNDANT WAVELET TRANSFORM
International Journal of Latest Engineering and Management Research (IJLEMR) ISSN: 2455-4847 Volume 1 Issue 4 ǁ May 2016 ǁ PP.21-26 PET AND MRI BRAIN IMAGE FUSION USING REDUNDANT WAVELET TRANSFORM Gayathri
More informationBasic fmri Design and Analysis. Preprocessing
Basic fmri Design and Analysis Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization Spatial filtering
More informationNIH Public Access Author Manuscript Proc Soc Photo Opt Instrum Eng. Author manuscript; available in PMC 2014 October 07.
NIH Public Access Author Manuscript Published in final edited form as: Proc Soc Photo Opt Instrum Eng. 2014 March 21; 9034: 903442. doi:10.1117/12.2042915. MRI Brain Tumor Segmentation and Necrosis Detection
More informationMedical Images Analysis and Processing
Medical Images Analysis and Processing - 25642 Emad Course Introduction Course Information: Type: Graduated Credits: 3 Prerequisites: Digital Image Processing Course Introduction Reference(s): Insight
More informationInteractive Boundary Detection for Automatic Definition of 2D Opacity Transfer Function
Interactive Boundary Detection for Automatic Definition of 2D Opacity Transfer Function Martin Rauberger, Heinrich Martin Overhoff Medical Engineering Laboratory, University of Applied Sciences Gelsenkirchen,
More informationHierarchical Multi structure Segmentation Guided by Anatomical Correlations
Hierarchical Multi structure Segmentation Guided by Anatomical Correlations Oscar Alfonso Jiménez del Toro oscar.jimenez@hevs.ch Henning Müller henningmueller@hevs.ch University of Applied Sciences Western
More informationFunctional MRI in Clinical Research and Practice Preprocessing
Functional MRI in Clinical Research and Practice Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization
More informationDeformable Registration Using Scale Space Keypoints
Deformable Registration Using Scale Space Keypoints Mehdi Moradi a, Purang Abolmaesoumi a,b and Parvin Mousavi a a School of Computing, Queen s University, Kingston, Ontario, Canada K7L 3N6; b Department
More informationComputer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks
Computer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks Du-Yih Tsai, Masaru Sekiya and Yongbum Lee Department of Radiological Technology, School of Health Sciences, Faculty of
More informationSupplementary methods
Supplementary methods This section provides additional technical details on the sample, the applied imaging and analysis steps and methods. Structural imaging Trained radiographers placed all participants
More informationLeksell SurgiPlan Overview. Powerful planning for surgical success
Leksell SurgiPlan Overview Powerful planning for surgical success Making a Difference in Surgical Planning Leksell SurgiPlan Leksell SurgiPlan is an advanced image-based neuro surgical planning software,
More informationSTIC AmSud Project. Graph cut based segmentation of cardiac ventricles in MRI: a shape-prior based approach
STIC AmSud Project Graph cut based segmentation of cardiac ventricles in MRI: a shape-prior based approach Caroline Petitjean A joint work with Damien Grosgeorge, Pr Su Ruan, Pr JN Dacher, MD October 22,
More informationReconstruction in CT and relation to other imaging modalities
Reconstruction in CT and relation to other imaging modalities Jørgen Arendt Jensen November 1, 2017 Center for Fast Ultrasound Imaging, Build 349 Department of Electrical Engineering Center for Fast Ultrasound
More informationCHAPTER 2. Morphometry on rodent brains. A.E.H. Scheenstra J. Dijkstra L. van der Weerd
CHAPTER 2 Morphometry on rodent brains A.E.H. Scheenstra J. Dijkstra L. van der Weerd This chapter was adapted from: Volumetry and other quantitative measurements to assess the rodent brain, In vivo NMR
More informationADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION
ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION Abstract: MIP Project Report Spring 2013 Gaurav Mittal 201232644 This is a detailed report about the course project, which was to implement
More informationMedical Image Registration
Medical Image Registration Submitted by NAREN BALRAJ SINGH SB ID# 105299299 Introduction Medical images are increasingly being used within healthcare for diagnosis, planning treatment, guiding treatment
More informationMR IMAGE SEGMENTATION
MR IMAGE SEGMENTATION Prepared by : Monil Shah What is Segmentation? Partitioning a region or regions of interest in images such that each region corresponds to one or more anatomic structures Classification
More informationImage Formation. Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico
Image Formation Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico 1 Objectives Fundamental imaging notions Physical basis for image formation
More informationAutomatic Subthalamic Nucleus Targeting for Deep Brain Stimulation. A Validation Study
Automatic Subthalamic Nucleus Targeting for Deep Brain Stimulation. A Validation Study F. Javier Sánchez Castro a, Claudio Pollo a,b, Jean-Guy Villemure b, Jean-Philippe Thiran a a École Polytechnique
More informationA Generic Lie Group Model for Computer Vision
A Generic Lie Group Model for Computer Vision Within this research track we follow a generic Lie group approach to computer vision based on recent physiological research on how the primary visual cortex
More informationClassification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging
1 CS 9 Final Project Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging Feiyu Chen Department of Electrical Engineering ABSTRACT Subject motion is a significant
More informationCHAPTER-1 INTRODUCTION
CHAPTER-1 INTRODUCTION 1.1 Fuzzy concept, digital image processing and application in medicine With the advancement of digital computers, it has become easy to store large amount of data and carry out
More informationStatistical Analysis of Neuroimaging Data. Phebe Kemmer BIOS 516 Sept 24, 2015
Statistical Analysis of Neuroimaging Data Phebe Kemmer BIOS 516 Sept 24, 2015 Review from last time Structural Imaging modalities MRI, CAT, DTI (diffusion tensor imaging) Functional Imaging modalities
More informationMethodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion
Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion Mattias P. Heinrich Julia A. Schnabel, Mark Jenkinson, Sir Michael Brady 2 Clinical
More informationMachine Learning for Medical Image Analysis. A. Criminisi
Machine Learning for Medical Image Analysis A. Criminisi Overview Introduction to machine learning Decision forests Applications in medical image analysis Anatomy localization in CT Scans Spine Detection
More informationBiomedical Image Analysis based on Computational Registration Methods. João Manuel R. S. Tavares
Biomedical Image Analysis based on Computational Registration Methods João Manuel R. S. Tavares tavares@fe.up.pt, www.fe.up.pt/~tavares Outline 1. Introduction 2. Methods a) Spatial Registration of (2D
More informationAvailable Online through
Available Online through www.ijptonline.com ISSN: 0975-766X CODEN: IJPTFI Research Article ANALYSIS OF CT LIVER IMAGES FOR TUMOUR DIAGNOSIS BASED ON CLUSTERING TECHNIQUE AND TEXTURE FEATURES M.Krithika
More informationInteroperability Issues in Image Registration and ROI Generation
1 DICOM 2005 International Conference, Budapest, Hungary Interoperability Issues in Image Registration and ROI Generation Todd Kantchev PhD, Siemens Molecular Imaging, Oxford, UK 2 Scope The following
More informationFusion of Multi-Modality Volumetric Medical Imagery
To appear in Proc. of the Fifth International oference on Information Fusion, 2002. Fusion of Multi-Modality Volumetric Medical Imagery Mario Aguilar Knowledge Systems Laboratory Mathematical, omputing
More informationEPI Data Are Acquired Serially. EPI Data Are Acquired Serially 10/23/2011. Functional Connectivity Preprocessing. fmri Preprocessing
Functional Connectivity Preprocessing Geometric distortion Head motion Geometric distortion Head motion EPI Data Are Acquired Serially EPI Data Are Acquired Serially descending 1 EPI Data Are Acquired
More informationIntroduction to Medical Image Processing
Introduction to Medical Image Processing Δ Essential environments of a medical imaging system Subject Image Analysis Energy Imaging System Images Image Processing Feature Images Image processing may be
More informationCopyright 2009 Society of Photo Optical Instrumentation Engineers. This paper was published in Proceedings of SPIE, vol. 7260, Medical Imaging 2009:
Copyright 2009 Society of Photo Optical Instrumentation Engineers. This paper was published in Proceedings of SPIE, vol. 7260, Medical Imaging 2009: Computer Aided Diagnosis and is made available as an
More informationPathology Hinting as the Combination of Automatic Segmentation with a Statistical Shape Model
Pathology Hinting as the Combination of Automatic Segmentation with a Statistical Shape Model Pascal A. Dufour 1,2, Hannan Abdillahi 3, Lala Ceklic 3, Ute Wolf-Schnurrbusch 2,3, and Jens Kowal 1,2 1 ARTORG
More informationA NEURAL NETWORK BASED IMAGING SYSTEM FOR fmri ANALYSIS IMPLEMENTING WAVELET METHOD
6th WSEAS International Conference on CIRCUITS, SYSTEMS, ELECTRONICS,CONTROL & SIGNAL PROCESSING, Cairo, Egypt, Dec 29-31, 2007 454 A NEURAL NETWORK BASED IMAGING SYSTEM FOR fmri ANALYSIS IMPLEMENTING
More informationFiltering Images. Contents
Image Processing and Data Visualization with MATLAB Filtering Images Hansrudi Noser June 8-9, 010 UZH, Multimedia and Robotics Summer School Noise Smoothing Filters Sigmoid Filters Gradient Filters Contents
More informationAdaptive Local Multi-Atlas Segmentation: Application to Heart Segmentation in Chest CT Scans
Adaptive Local Multi-Atlas Segmentation: Application to Heart Segmentation in Chest CT Scans Eva M. van Rikxoort, Ivana Isgum, Marius Staring, Stefan Klein and Bram van Ginneken Image Sciences Institute,
More informationFast and effective characterization of 3D Region of Interest in medical image data
Fast and effective characterization of 3D Region of Interest in medical image data Despina Kontos, Vasileios Megalooikonomou Department of Computer and Information Sciences, Temple University, 1805 N.
More informationUsing Probability Maps for Multi organ Automatic Segmentation
Using Probability Maps for Multi organ Automatic Segmentation Ranveer Joyseeree 1,2, Óscar Jiménez del Toro1, and Henning Müller 1,3 1 University of Applied Sciences Western Switzerland (HES SO), Sierre,
More informationUtilizing Salient Region Features for 3D Multi-Modality Medical Image Registration
Utilizing Salient Region Features for 3D Multi-Modality Medical Image Registration Dieter Hahn 1, Gabriele Wolz 2, Yiyong Sun 3, Frank Sauer 3, Joachim Hornegger 1, Torsten Kuwert 2 and Chenyang Xu 3 1
More informationCS 556: Computer Vision. Lecture 18
CS 556: Computer Vision Lecture 18 Prof. Sinisa Todorovic sinisa@eecs.oregonstate.edu 1 Color 2 Perception of Color The sensation of color is caused by the brain Strongly affected by: Other nearby colors
More informationIntroduction to Computer Graphics with WebGL
Introduction to Computer Graphics with WebGL Ed Angel Professor Emeritus of Computer Science Founding Director, Arts, Research, Technology and Science Laboratory University of New Mexico Image Formation
More informationSIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab
SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab Introduction Medical Imaging and Application CGV 3D Organ Modeling Model-based Simulation Model-based Quantification
More informationThe Insight Toolkit. Image Registration Algorithms & Frameworks
The Insight Toolkit Image Registration Algorithms & Frameworks Registration in ITK Image Registration Framework Multi Resolution Registration Framework Components PDE Based Registration FEM Based Registration
More informationA New Application for Displaying and Fusing Multimodal Data Sets
A New Application for Displaying and Fusing Multimodal Data Sets Karl G. Baum* ac, María Helguera a, Andrzej Krol b a Rochester Institute of Technology, 54 Lomb Memorial Drive, Rochester, NY, USA 14623-5604;
More informationTUMOR DETECTION IN MRI IMAGES
TUMOR DETECTION IN MRI IMAGES Prof. Pravin P. Adivarekar, 2 Priyanka P. Khatate, 3 Punam N. Pawar Prof. Pravin P. Adivarekar, 2 Priyanka P. Khatate, 3 Punam N. Pawar Asst. Professor, 2,3 BE Student,,2,3
More informationSpatio-Temporal Registration of Biomedical Images by Computational Methods
Spatio-Temporal Registration of Biomedical Images by Computational Methods Francisco P. M. Oliveira, João Manuel R. S. Tavares tavares@fe.up.pt, www.fe.up.pt/~tavares Outline 1. Introduction 2. Spatial
More informationAutomatic Generation of Training Data for Brain Tissue Classification from MRI
MICCAI-2002 1 Automatic Generation of Training Data for Brain Tissue Classification from MRI Chris A. Cocosco, Alex P. Zijdenbos, and Alan C. Evans McConnell Brain Imaging Centre, Montreal Neurological
More informationMulti-atlas labeling with population-specific template and non-local patch-based label fusion
Multi-atlas labeling with population-specific template and non-local patch-based label fusion Vladimir Fonov, Pierrick Coupé, Simon Eskildsen, Jose Manjon, Louis Collins To cite this version: Vladimir
More informationCS 5630/6630 Scientific Visualization. Volume Rendering I: Overview
CS 5630/6630 Scientific Visualization Volume Rendering I: Overview Motivation Isosurfacing is limited It is binary A hard, distinct boundary is not always appropriate Slice Isosurface Volume Rendering
More informationNormalization for clinical data
Normalization for clinical data Christopher Rorden, Leonardo Bonilha, Julius Fridriksson, Benjamin Bender, Hans-Otto Karnath (2012) Agespecific CT and MRI templates for spatial normalization. NeuroImage
More informationMulti-Atlas Segmentation of the Cardiac MR Right Ventricle
Multi-Atlas Segmentation of the Cardiac MR Right Ventricle Yangming Ou, Jimit Doshi, Guray Erus, and Christos Davatzikos Section of Biomedical Image Analysis (SBIA) Department of Radiology, University
More informationImprovement of contrast using reconstruction of 3D Image by PET /CT combination system
Available online at www.pelagiaresearchlibrary.com Advances in Applied Science Research, 2013, 4(1):285-290 ISSN: 0976-8610 CODEN (USA): AASRFC Improvement of contrast using reconstruction of 3D Image
More informationSPM Introduction. SPM : Overview. SPM: Preprocessing SPM! SPM: Preprocessing. Scott Peltier. FMRI Laboratory University of Michigan
SPM Introduction Scott Peltier FMRI Laboratory University of Michigan! Slides adapted from T. Nichols SPM! SPM : Overview Library of MATLAB and C functions Graphical user interface Four main components:
More informationFusion of Multimodality Medical Images Using Combined Activity Level Measurement and Contourlet Transform
0 International Conference on Image Information Processing (ICIIP 0) Fusion of Multimodality Medical Images Using Combined Activity Level Measurement and Contourlet Transform Sudeb Das and Malay Kumar
More informationMULTIMODAL MEDICAL IMAGE FUSION BASED ON HYBRID FUSION METHOD
MULTIMODAL MEDICAL IMAGE FUSION BASED ON HYBRID FUSION METHOD Sinija.T.S MTECH, Department of computer science Mohandas College of Engineering Karthik.M Assistant professor in CSE Mohandas College of Engineering
More informationGame Programming. Bing-Yu Chen National Taiwan University
Game Programming Bing-Yu Chen National Taiwan University What is Computer Graphics? Definition the pictorial synthesis of real or imaginary objects from their computer-based models descriptions OUTPUT
More information3D VISUALIZATION OF SEGMENTED CRUCIATE LIGAMENTS 1. INTRODUCTION
JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 10/006, ISSN 164-6037 Paweł BADURA * cruciate ligament, segmentation, fuzzy connectedness,3d visualization 3D VISUALIZATION OF SEGMENTED CRUCIATE LIGAMENTS
More informationImage Acquisition Systems
Image Acquisition Systems Goals and Terminology Conventional Radiography Axial Tomography Computer Axial Tomography (CAT) Magnetic Resonance Imaging (MRI) PET, SPECT Ultrasound Microscopy Imaging ITCS
More informationCS/NEUR125 Brains, Minds, and Machines. Due: Wednesday, April 5
CS/NEUR125 Brains, Minds, and Machines Lab 8: Using fmri to Discover Language Areas in the Brain Due: Wednesday, April 5 In this lab, you will analyze fmri data from an experiment that was designed to
More informationNew Technology Allows Multiple Image Contrasts in a Single Scan
These images were acquired with an investigational device. PD T2 T2 FLAIR T1 MAP T1 FLAIR PSIR T1 New Technology Allows Multiple Image Contrasts in a Single Scan MR exams can be time consuming. A typical
More informationMultimodal Elastic Image Matching
Research results based on my diploma thesis supervised by Prof. Witsch 2 and in cooperation with Prof. Mai 3. 1 February 22 nd 2011 1 Karlsruhe Institute of Technology (KIT) 2 Applied Mathematics Department,
More information