Medical Computer Vision

Similar documents
Semantic Context Forests for Learning- Based Knee Cartilage Segmentation in 3D MR Images

MEDICAL IMAGE ANALYSIS

Medical Image Analysis

Medical Images Analysis and Processing

Advanced Visual Medicine: Techniques for Visual Exploration & Analysis

Machine Learning for Medical Image Analysis. A. Criminisi

Computer Assisted Image Analysis TF 3p and MN1 5p Lecture 1, (GW 1, )

Deformable Segmentation using Sparse Shape Representation. Shaoting Zhang

Medical Imaging Introduction

Image Registration. Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department

Multimodal Image Fusion Of The Human Brain

maximum likelihood estimates. The performance of

Lecture 6: Medical imaging and image-guided interventions

Hierarchical Multi structure Segmentation Guided by Anatomical Correlations

SEGMENTATION OF IMAGES USING GRADIENT METHODS AND POLYNOMIAL APPROXIMATION

FIELD PARADIGM FOR 3D MEDICAL IMAGING: Safer, More Accurate, and Faster SPECT/PET, MRI, and MEG

Anatomical landmark and region mapping based on a template surface deformation for foot bone morphology

Definition of the evaluation protocol and goals for competition 2

Skull Segmentation of MR images based on texture features for attenuation correction in PET/MR

Development of 3D Model-based Morphometric Method for Assessment of Human Weight-bearing Joint. Taeho Kim

Tumor Detection and classification of Medical MRI UsingAdvance ROIPropANN Algorithm

SonicDICOM PACS. Install Manual. December 14, JIUN Corporation. All rights reserved.

Prostate Detection Using Principal Component Analysis

11/18/ CPT Preauthorization Groupings Effective January 1, Computerized Tomography (CT) Abdomen 6. CPT Description SEGR CT01

Computed tomography (Item No.: P )

Implementation of Hybrid Model Image Fusion Algorithm

SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem

Detection of Bone Fracture using Image Processing Methods

Whole Body MRI Intensity Standardization

Introduction. Biomedical Image Analysis. Contents. Prof. Dr. Philippe Cattin. MIAC, University of Basel. Feb 22nd, of

3D Surface Reconstruction of the Brain based on Level Set Method

Towards Automatic Bone Age Estimation from MRI: Localization of 3D Anatomical Landmarks

Semantic Analysis of Medical Images Using Fuzzy Inference Systems

A Generic Lie Group Model for Computer Vision

RADIOMICS: potential role in the clinics and challenges

THE DICOM 2013 INTERNATIONAL CONFERENCE & SEMINAR. DICOM Fields of Use. Klaus Neuner. Brainlab AG. Software Project Manager Feldkirchen, Germany

Biomedical Image Processing

Introduction to Medical Image Analysis

Reconstruction in CT and relation to other imaging modalities

Biomedical Imaging and Image Analysis

Detecting Bone Lesions in Multiple Myeloma Patients using Transfer Learning

PACSware Migration Toolkit (MDIG)

Prototype of Silver Corpus Merging Framework

Elastically Deforming a Three-Dimensional Atlas to Match Anatomical Brain Images

An Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014

Automated Segmentation of Brain Parts from MRI Image Slices

Visualisation : Lecture 1. So what is visualisation? Visualisation

Overview of Proposed TG-132 Recommendations

A NEURAL NETWORK BASED IMAGING SYSTEM FOR fmri ANALYSIS IMPLEMENTING WAVELET METHOD

Computer Graphics. - Volume Rendering - Philipp Slusallek

TEMPLATE-BASED AUTOMATIC SEGMENTATION OF MASSETER USING PRIOR KNOWLEDGE

DICOM Conformance Statement RT Elements Document Revision 5 December 14, Copyright Brainlab AG

Thermographic Image Analysis Method in Detection of Canine Bone Cancer (Osteosarcoma)

Computed tomography of simple objects. Related topics. Principle. Equipment TEP Beam hardening, artefacts, and algorithms

Semi-Automatic Detection of Cervical Vertebrae in X-ray Images Using Generalized Hough Transform

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem

Image Registration Lecture 1: Introduction

Computer Aided Diagnosis Based on Medical Image Processing and Artificial Intelligence Methods

CP467 Image Processing and Pattern Recognition

Hybrid Approach for MRI Human Head Scans Classification using HTT based SFTA Texture Feature Extraction Technique

Utilizing Salient Region Features for 3D Multi-Modality Medical Image Registration

PET AND MRI BRAIN IMAGE FUSION USING REDUNDANT WAVELET TRANSFORM

Methods for data preprocessing

Introduction to Neuroimaging Janaina Mourao-Miranda

The Insight Toolkit. Image Registration Algorithms & Frameworks

A SYSTEMATIC WAY OF AFFINE TRANSFORMATION USING IMAGE REGISTRATION

Fully automatic cephalometric evaluation using Random Forest regression-voting

A Reduced-Dimension fmri! Shared Response Model

Abstract. 1. Introduction

Adaptive Local Multi-Atlas Segmentation: Application to Heart Segmentation in Chest CT Scans

Ischemic Stroke Lesion Segmentation Proceedings 5th October 2015 Munich, Germany

Intensity gradient based registration and fusion of multi-modal images

Automated segmentation methods for liver analysis in oncology applications

DICOM Conformance Statement RT Elements Document Revision 3 January 19, Copyright Brainlab AG

Semi-automatic Segmentation of Vertebral Bodies in Volumetric MR Images Using a Statistical Shape+Pose Model

BME I5000: Biomedical Imaging

Segmentation of Bony Structures with Ligament Attachment Sites

Introduction to Medical Image Processing

Predicting Semantic Descriptions from Medical Images with Convolutional Neural Networks

MURDOCH RESEARCH REPOSITORY

AUTOMATION OF LANDMARK SELECTION FOR RODENT BRAIN MRI- HISTOLOGY REGISTRATION USING THIN- PLATE SPLINES

3D Slicer Overview. Andras Lasso, PhD PerkLab, Queen s University

K-Means Segmentation of Alzheimer s Disease In Pet Scan Datasets An Implementation

Normalization for clinical data

Medical Imaging Projects

HST.582J / 6.555J / J Biomedical Signal and Image Processing Spring 2007

Shape Feature Extraction of Brain MRI Using Slope Magnitude Method for Efficient Image Analysis

An Approach for Discretization and Feature Selection Of Continuous-Valued Attributes in Medical Images for Classification Learning.

Medical Image Fusion using Rayleigh Contrast Limited Adaptive Histogram Equalization and Ant Colony Edge Method

Journal of Chemical and Pharmaceutical Research, 2013, 5(12): Research Article. Medical image fusion with adaptive shape feature

Bone Age Classification Using the Discriminative Generalized Hough Transform

A Study of Medical Image Analysis System

Digital Volume Correlation for Materials Characterization

SURFACE RECONSTRUCTION OF EX-VIVO HUMAN V1 THROUGH IDENTIFICATION OF THE STRIA OF GENNARI USING MRI AT 7T

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 9: Medical Image Segmentation (III) (Fuzzy Connected Image Segmentation)

Deep Similarity Learning for Multimodal Medical Images

Alignment and Image Comparison. Erik Learned- Miller University of Massachuse>s, Amherst

Segmentation and Quantification of Brain Tumor

Synapse access by https. Christie Innomed inc. 516 rue Dufour, Saint-Eustache (QC) J7R 0C3. christieinnomed.com

Transcription:

Vienna Computer Vision Meetup 27.01.2016 sponsored by Medical Computer Vision Markus Holzer markus@radiology-explorer.com www.radiology-explorer.com www.meduniwien.ac.at www.cir.meduniwien.ac.at

Overview About Me Medical Images 3 Examples: - A Standard Approach with Example on X-Ray Images Fetal MR: Brain Development CT/MR: 3D Image Search

Medical Images Digital Pathology X-Ray CT - Computed Tomography MRI - Magnetic Resonance Imaging fmri - functional MRI OCT - Optical Coherence Tomography PET - Positron Emission Tomography

Medical Images Digital Pathology X-Ray CT - Computed Tomography MRI - Magnetic Resonance Imaging fmri - functional MRI OCT - Optical Coherence Tomography PET - Positron Emission Tomography Source: http://www.hsc.stonybrook.edu/gyn-atlas/images/dscn3451.jpg

Medical Images Digital Pathology X-Ray CT - Computed Tomography MRI - Magnetic Resonance Imaging fmri - functional MRI OCT - Optical Coherence Tomography PET - Positron Emission Tomography Source: http://www.radiologyinfo.org/gallery-items/images/chest-xray.jpg

Medical Images Digital Pathology X-Ray CT - Computed Tomography MRI - Magnetic Resonance Imaging fmri - functional MRI OCT - Optical Coherence Tomography PET - Positron Emission Tomography Source: http://www.northstarradiology.com/images/lung-mip.jpg

Medical Images Digital Pathology X-Ray CT - Computed Tomography MRI - Magnetic Resonance Imaging fmri - functional MRI OCT - Optical Coherence Tomography PET - Positron Emission Tomography Source: http://www.brainfacts.org/~/media/brainfacts/article% 20Multimedia/About% 20Neuroscience/Technologies/MRI_blackandwhite.ashx

Medical Images Digital Pathology X-Ray CT - Computed Tomography MRI - Magnetic Resonance Imaging fmri - functional MRI OCT - Optical Coherence Tomography PET - Positron Emission Tomography Source: https://upload.wikimedia. org/wikipedia/commons/9/9a/default_mode_network-wrnmmc. jpg

Medical Images Digital Pathology X-Ray CT - Computed Tomography MRI - Magnetic Resonance Imaging fmri - functional MRI OCT - Optical Coherence Tomography PET - Positron Emission Tomography Source: http://www.oct-optovue.com/images/oct-normal.jpg

Medical Images Digital Pathology X-Ray CT - Computed Tomography MRI - Magnetic Resonance Imaging fmri - functional MRI OCT - Optical Coherence Tomography PET - Positron Emission Tomography Source: http://www.rsc.org/images/news-page10-300_tcm18-92717.jpg

Overview About Me Medical Images 3 Examples: - A Standard Approach with Example on X-Ray Images Fetal MR: Brain Development CT/MR: 3D Image Search

A Common Computer Vision approach: Input: Images Annotations Methods Model (e.g. shape of a bone) Classifier (based on extracted features) Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015.

X-Ray Example: Bone Detection Input: X-Ray Images Annotations Methods Shape Model Feature Extraction Classifier Output Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015.

X-Ray Example: Bone Detection Input: Dataset: 50 images (30 for training, 20 for testing) X-Ray Images Annotations Methods Shape Model Feature Extraction Classifier Output Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015.

X-Ray Example: Bone Detection Input: Dataset: 64 annotations per image X-Ray Images Annotations Methods Shape Model Feature Extraction Classifier Output Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015.

X-Ray Example: Bone Detection Input: Shape Variations X-Ray Images Annotations Methods Shape Model Feature Extraction Classifier Output Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015.

X-Ray Example: Bone Detection Input: Shape Variations (first 3) X-Ray Images Annotations Methods Shape Model Feature Extraction Classifier Output 1st dim. (highest variation) Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015. 2nd dim. 3rd dim.

X-Ray Example: Bone Detection Feature Extraction: Examples Input: X-Ray Images Annotations Methods Shape Model Feature Extraction Classifier Output gray values Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015. x-coordinate gradient Haar-like

X-Ray Example: Bone Detection Input: Classifier: Random Forest - training X-Ray Images Annotations Methods Shape Model Feature Extraction Classifier Output Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015. Mask Features

X-Ray Example: Bone Detection Input: Classifier: Random Forest X-Ray Images Annotations Methods Shape Model Feature Extraction Classifier Output gray values gradient Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015. Haar-like #1 x-coordinate

X-Ray Example: Bone Detection Input: Classifier: Random Forest - predict X-Ray Images Annotations Methods Shape Model Feature Extraction Classifier Output Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015.

X-Ray Example: Bone Detection Input: X-Ray Images Annotations Methods Classifier: Random Forest - predict -> = + Shape Model Feature Extraction Classifier Output Classifier Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015. Model Result

X-Ray Example: Bone Detection Results Medizinische Bildverarbeitung UE, Vienna University of Technology, 2013-2015.

X-Ray Example: Bone Quantification Quantification G. Langs, P. Peloschek, H. Bischof and F. Kainberger. Automatic Quantification of Joint Space Narrowing and Erosions in Rheumatoid Arthritis. IEEE TMI, 28(1):151-164, Jan 2009. Example:

Overview About Me Medical Images 3 Examples: - A Standard Approach with Example on X-Ray Images Fetal MR: Brain Development CT/MR: 3D Image Search

Fetal-MR Example: Fetal Brain Development Input: Fetal-MR Volumes Methods Volume Creation Registration / Atlas Segmentation Extract Surface E. Schwartz. Fetal-MR Analysis. www.cir.meduniwien.ac.at/team/schwartz

Fetal-MR Example: Fetal Brain Development Input: Example: Fetal-MR Volumes Methods Volume Creation Registration / Atlas Segmentation Extract Surface E. Schwartz. Fetal-MR Analysis. www.cir.meduniwien.ac.at/team/schwartz

Fetal-MR Example: Fetal Brain Development Input: Example: Fetal-MR Volumes Methods Volume Creation Registration / Atlas Segmentation Extract Surface E. Schwartz. Fetal-MR Analysis. www.cir.meduniwien.ac.at/team/schwartz

Fetal-MR Example: Fetal Brain Development Input: Fetal-MR Volumes Methods Volume Creation Registration / Atlas Segmentation / Surface Ext. Visualization E. Schwartz. Fetal-MR Analysis. www.cir.meduniwien.ac.at/team/schwartz

Fetal-MR Example: Fetal Brain Development Input: Fetal-MR Volumes Methods Volume Creation Registration / Atlas Segmentation / Surface Ext. Visualization E. Schwartz. Fetal-MR Analysis. www.cir.meduniwien.ac.at/team/schwartz

Fetal-MR Example: Fetal Brain Development Input: Fetal-MR Volumes Methods Video Link Volume Creation Registration / Atlas Segmentation / Surface Ext. Visualization E. Schwartz. Fetal-MR Analysis. www.cir.meduniwien.ac.at/team/schwartz

Fetal-MR Example: Region Development Region Map of Adult Brain: How do they develop in the fetus? E. Schwartz. Fetal-MR Analysis. www.cir.meduniwien.ac.at/team/schwartz

Fetal-MR Example: Region Development Region Map of Adult Brain: H. Lombart, L. Grady, JR. Polimeni, F. Cheriet. FOCUSR: feature oriented correspondence using spectral regularization -- a method for precise surface matching. IEEE TPAMI, 35(9):2143-60, Sep 2013.

Fetal-MR Example: Fetal Brain Development Visualization: Video Link E. Schwartz. Fetal-MR Analysis. www.cir.meduniwien.ac.at/team/schwartz

Overview About Me Medical Images 3 Examples: - A Standard Approach with Example on X-Ray Images Fetal MR: Brain Development CT/MR: 3D Image Search

CT Example: 3D Image Search - Khresmoi Input: Lung CT Volumes Methods www.khresmoi.eu Registration/Localization Feature Extraction Retrieval

CT Example: 3D Image Search - Khresmoi Input: CT Volumes Methods www.khresmoi.eu Registration/Localization Feature Extraction Retrieval

CT Example: 3D Image Search - Khresmoi Input: Over-Segmentation: CT Volumes Methods Registration/Localization Feature Extraction Retrieval M. Holzer, R. Donner. Over-Segmentation of 3D Medical Image Volumes based on Monogenic Cues. Proceedings of the 19th CVWW, pp 35-42, 2014.

CT Example: 3D Image Search - Khresmoi

CT Example:

Summary About Me Medical Images 3 Examples: - A Standard Approach with Example on X-Ray Images Fetal MR: Brain Development CT/MR: 3D Image Search

Unlocking the potential of medical image data image analysis machine learning office@radiology-explorer.eu www.radiology-explorer.eu consulting

Vienna Computer Vision Meetup 27.01.2016 sponsored by Medical Computer Vision Markus Holzer markus@radiology-explorer.com www.radiology-explorer.com www.meduniwien.ac.at www.cir.meduniwien.ac.at