Image-based Compensation for Involuntary Motion in Weight-bearing C-arm CBCT Scanning of Knees

Similar documents
Image-based Compensation for Involuntary Motion in Weight-bearing C-arm Cone-beam CT Scanning of Knees

Respiratory Motion Estimation using a 3D Diaphragm Model

Automatic Removal of Externally Attached Fiducial Markers in Cone Beam C-arm CT

Combination of Markerless Surrogates for Motion Estimation in Radiation Therapy

Respiratory Motion Compensation for C-arm CT Liver Imaging

Projection and Reconstruction-Based Noise Filtering Methods in Cone Beam CT

Motion Compensation using Range Imaging in C-arm Cone-Beam CT

Towards full-body X-ray images

Range Imaging for Motion Compensation in C-Arm Cone-Beam CT of Knees under Weight-Bearing Conditions

Evaluation of Spectrum Mismatching using Spectrum Binning Approach for Statistical Polychromatic Reconstruction in CT

Analysis of Vertical and Horizontal Circular C-Arm Trajectories

A new calibration-free beam hardening reduction method for industrial CT

Scaling Calibration in the ATRACT Algorithm

Discrete Estimation of Data Completeness for 3D Scan Trajectories with Detector Offset

Gradient-Based Differential Approach for Patient Motion Compensation in 2D/3D Overlay

Structured light 3D reconstruction

Estimation of Missing Fan-Beam Projections using Frequency Consistency Conditions

Multiview 3D tracking with an Incrementally. Constructed 3D model

Chapter 3 Image Registration. Chapter 3 Image Registration

Motion Compensation for Cone-Beam CT Using Fourier Consistency Conditions

Multidimensional Noise Reduction in C-arm Cone-beam CT via 2D-based Landweber Iteration and 3D-based Deep Neural Networks

Single Breath-hold Abdominal T 1 Mapping using 3-D Cartesian Sampling and Spatiotemporally Constrained Reconstruction

RIGID IMAGE REGISTRATION

Artefakt-resistente Bewegungsschätzung für die bewegungskompensierte CT

Deep Scatter Estimation (DSE): Feasibility of using a Deep Convolutional Neural Network for Real-Time X-Ray Scatter Prediction in Cone-Beam CT

Moving Metal Artifact Reduction for Cone-Beam CT (CBCT) Scans of the Thorax Region

Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences

Portability of TV-Regularized Reconstruction Parameters to Varying Data Sets

Brilliance CT Big Bore.

DUE to beam polychromacity in CT and the energy dependence

Image processing and features

Accurate 3D Face and Body Modeling from a Single Fixed Kinect

3D Imaging from Video and Planar Radiography

Image Quality Assessment and Quality Assurance of Advanced Imaging Systems for IGRT. AAPM Penn-Ohio Chapter Sep 25, 2015 Soyoung Lee, PhD

BSB663 Image Processing Pinar Duygulu. Slides are adapted from Selim Aksoy

Registration concepts for the just-in-time artefact correction by means of virtual computed tomography

Multi-Modal Volume Registration Using Joint Intensity Distributions

Medical Image Segmentation Based on Mutual Information Maximization

AN X-ray system with a large area detector, such as is used

3D Models from Range Sensors. Gianpaolo Palma

SIGMI. ISL & CGV Joint Research Proposal ~Image Fusion~

Reduction of Metal Artifacts in Computed Tomographies for the Planning and Simulation of Radiation Therapy

INTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1. Modifications for P551 Fall 2013 Medical Physics Laboratory

The Near Future in Cardiac CT Image Reconstruction

Mobile Point Fusion. Real-time 3d surface reconstruction out of depth images on a mobile platform

Convolution-Based Truncation Correction for C-Arm CT using Scattered Radiation

Multi-slice CT Image Reconstruction Jiang Hsieh, Ph.D.

8/3/2016. Image Guidance Technologies. Introduction. Outline

Reconstruction Methods for Coplanar Translational Laminography Applications

7/31/2011. Learning Objective. Video Positioning. 3D Surface Imaging by VisionRT

Deep Scatter Estimation (DSE): Accurate Real-Time Scatter Estimation for X-Ray CT using a Deep Convolutional Neural Network

Three-Dimensional Laser Scanner. Field Evaluation Specifications

Empirical cupping correction: A first-order raw data precorrection for cone-beam computed tomography

ToF/RGB Sensor Fusion for Augmented 3-D Endoscopy using a Fully Automatic Calibration Scheme

Quality Guided Image Denoising for Low-Cost Fundus Imaging

XRADIA microxct Manual

PROCEEDINGS OF SPIE. Projection image-to-image translation in hybrid x-ray/mr imaging

Position accuracy analysis of the stereotactic reference defined by the CBCT on Leksell Gamma Knife Icon

Automatic Intrinsic Cardiac and Respiratory Gating from Cone-Beam CT Scans of the Thorax Region

Super-resolution Reconstruction of Fetal Brain MRI

fmri pre-processing Juergen Dukart

Solution: filter the image, then subsample F 1 F 2. subsample blur subsample. blur

Overview of Proposed TG-132 Recommendations

Local Feature Detectors

Motion Compensation from Short-Scan Data in Cardiac CT

Modeling and preoperative planning for kidney surgery

CS664 Lecture #16: Image registration, robust statistics, motion

CSSE463: Image Recognition Day 21

Respiratory Motion Compensation for Simultaneous PET/MR Based on Strongly Undersampled Radial MR Data

Iterative CT Reconstruction Using Curvelet-Based Regularization

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov

Financial disclosure. Onboard imaging modality for IGRT

A Volumetric Method for Building Complex Models from Range Images

Scatter Correction Using a Primary Modulator on a Clinical Angiography C-arm CT System

Midterm Examination CS 534: Computational Photography

Is deformable image registration a solved problem?

Utilizing Salient Region Features for 3D Multi-Modality Medical Image Registration

Acknowledgments. High Performance Cone-Beam CT of Acute Traumatic Brain Injury

Total Variation Regularization Method for 3D Rotational Coronary Angiography

Features Points. Andrea Torsello DAIS Università Ca Foscari via Torino 155, Mestre (VE)

Multi-modal Image Registration Using the Generalized Survival Exponential Entropy

A Simulation Study and Experimental Verification of Hand-Eye-Calibration using Monocular X-Ray

Suitability of a new alignment correction method for industrial CT

BME I5000: Biomedical Imaging

Robotics 2 Iterative Learning for Gravity Compensation

7/31/ D Cone-Beam CT: Developments and Applications. Disclosure. Outline. I have received research funding from NIH and Varian Medical System.

3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.

Segmentation tools and workflows in PerGeos

Human Motion Reconstruction by Direct Control of Marker Trajectories

Real Time Tumor Motion Tracking with CyberKnife

Ulrik Söderström 16 Feb Image Processing. Segmentation

Edge-Preserving Denoising for Segmentation in CT-Images

Learning and Inferring Depth from Monocular Images. Jiyan Pan April 1, 2009

An Evaluation of Volumetric Interest Points

The Insight Toolkit. Image Registration Algorithms & Frameworks

Bioimage Informatics

Comparative Evaluation of Interactive Segmentation Approaches

Nonrigid Registration using Free-Form Deformations

CIVA Computed Tomography Modeling

Fmri Spatial Processing

Transcription:

Image-based Compensation for Involuntary Motion in Weight-bearing C-arm CBCT Scanning of Knees Mathias Unberath, Jang-Hwan Choi, Martin Berger, Andreas Maier, Rebecca Fahrig February, 24. 2015 Pattern Recognition Lab, FAU Erlangen-Nürnberg Radiological Sciences Lab, Stanford University

Context Knee-joint kinematics change under strain In particular: different flexion angles Weight-bearing imaging may be advantageous Enable weight-bearing acquisitions Dedicated CBCT scanners Existing systems C-arm CT scanners Horizontal trajectories Wide volumetric beam coverage February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 2

Context Knee-joint kinematics change under strain In particular: different flexion angles Weight-bearing imaging may be advantageous Enable weight-bearing acquisitions Dedicated CBCT scanners Existing systems C-arm CT scanners Horizontal trajectories Wide volumetric beam coverage February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 2

Context Knee-joint kinematics change under strain In particular: different flexion angles Weight-bearing imaging may be advantageous Enable weight-bearing acquisitions Dedicated CBCT scanners Existing systems C-arm CT scanners Horizontal trajectories Wide volumetric beam coverage February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 2

Context Weight-bearing acquisitions: From standing upright through to deep squats (65 flexion) Involuntary knee motion during scans Severe motion artifacts Previously: Use of fiducial markers Compensation in: Reconstruction space Projection space Image-based compensation possible? February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 3

Context Weight-bearing acquisitions: From standing upright through to deep squats (65 flexion) Involuntary knee motion during scans Severe motion artifacts Previously: Use of fiducial markers Compensation in: Reconstruction space Projection space Image-based compensation possible? February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 3

Context Weight-bearing acquisitions: From standing upright through to deep squats (65 flexion) Involuntary knee motion during scans Severe motion artifacts Previously: Use of fiducial markers Compensation in: Reconstruction space Projection space Image-based compensation possible? February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 3

Context Weight-bearing acquisitions: From standing upright through to deep squats (65 flexion) Involuntary knee motion during scans Severe motion artifacts Previously: Use of fiducial markers Compensation in: Reconstruction space Projection space Image-based compensation possible? February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 3

Outline Review of the marker-based approach Introduction to the image-based approach Results Conclusions February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 4

Outline: Projection Shifting Algorithm 1. Generate projections of the static 3D scene Estimate static (mean) 3D position of features (e.g. markers) Forward project the scene 2. Calculate projection shifts 3. Apply shifts and back-project February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 5

Marker-based Projection Shifting Detect position (u, v) (j) i of marker i = 1,..., N in projection j Calculate mean marker position ( x, ȳ, z) i in 3D space Calculate 2D shift: ( u, v) (j)t = 1 N i ( P (j) x T i ) (u, v) (j)t i February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 6

Marker-based Projection Shifting Detect position (u, v) (j) i of marker i = 1,..., N in projection j Calculate mean marker position ( x, ȳ, z) i in 3D space Calculate 2D shift: ( u, v) (j)t = 1 N i ( P (j) x T i ) (u, v) (j)t i February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 6

Image-based Projection Shifting Use image registration to calculate 2D projection shifts. Estimate of motion-corrected projections 1. FDK-type uncompensated reconstruction 2. Gaussian smoothing 3. Maximum-Intensity-Projections (MIPs) of the volume MIPs dominated by high-intensity structures Calculate projection shifts ( u, v) (j) 1. Registration of MIPs to motion-corrupted projections Mutual information in 4 scale-space levels Shift and reconstruct February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 7

Image-based Projection Shifting Use image registration to calculate 2D projection shifts. Estimate of motion-corrected projections 1. FDK-type uncompensated reconstruction 2. Gaussian smoothing 3. Maximum-Intensity-Projections (MIPs) of the volume MIPs dominated by high-intensity structures Calculate projection shifts ( u, v) (j) 1. Registration of MIPs to motion-corrupted projections Mutual information in 4 scale-space levels Shift and reconstruct February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 7

Image-based Projection Shifting Use image registration to calculate 2D projection shifts. Estimate of motion-corrected projections 1. FDK-type uncompensated reconstruction 2. Gaussian smoothing 3. Maximum-Intensity-Projections (MIPs) of the volume MIPs dominated by high-intensity structures Calculate projection shifts ( u, v) (j) 1. Registration of MIPs to motion-corrupted projections Mutual information in 4 scale-space levels Shift and reconstruct February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 7

Image-based Projection Shifting Use image registration to calculate 2D projection shifts. Estimate of motion-corrected projections 1. FDK-type uncompensated reconstruction 2. Gaussian smoothing 3. Maximum-Intensity-Projections (MIPs) of the volume MIPs dominated by high-intensity structures Calculate projection shifts ( u, v) (j) 1. Registration of MIPs to motion-corrupted projections Mutual information in 4 scale-space levels Shift and reconstruct February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 7

Remarks on Mutual Information How much information about m is contained in f Mutual information MI (m(x), f (T (x))) = H (m(x)) + H(f (T (x))) H (m(x), f (T (x))) Marginal and joint entropy: H(y), H(y, z) Calculated from histograms: Parzen Window approximation No explicit form of dependency needed. But the histograms must be "related". February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 8

Procedure Perform FDK-type reconstruction Modeling clay to avoid detector saturation February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 9

Procedure Calculate MIPs and register to acquisitions Note clay artifact in MIPs February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 9

Experiments: Five healthy volunteers imaged Standing upright, 35 and 65 flexion Two scans with significant motion artifact shown Scan A at 35 and Scan B at 65 flexion Evaluation: Qualitatively: visual inspection Quantitatively: marker-based results (gold standard) February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 10

Results: Scan A Detector u-coordinate Detector v-coordinate Error: 2.89 mm ± 1.24 mm (uncorrected: 3.50 mm ± 1.90 mm) February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 11

Results: Scan A Uncompensated reconstruction Proposed method February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 12

Remarks Both knees "aligned" Boundaries in u-direction pronounced Boundaries in v-direction suppressed (artifact) Structures resulting from overlap not present in MIPs Registration becomes more challenging February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 13

Remarks Both knees "aligned" Boundaries in u-direction pronounced Boundaries in v-direction suppressed (artifact) Structures resulting from overlap not present in MIPs Registration becomes more challenging February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 13

Results: Scan B Detector u-coordinate Detector v-coordinate Error: 2.90 mm ± 1.43 mm (uncorrected: 4.10 mm ± 3.03 mm) February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 14

Results: Scan B Uncompensated reconstruction Proposed method February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 15

Observations Mean error after correction remains significant in both scans. Can we get better with iterative application of the method? Iterative application did not help with the current pipeline. Possible reasons: Using MIPs as reference projections is not optimal Mutual information cannot handle the given problem February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 16

Performance w.r.t. Marker-based Method Figure: Uncompensated, proposed and marked-based reconstructions February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 17

Discussion and Conclusion Motion must be visible in high-intensity structures Biased registration in the presence of artifacts (modeling clay) Stable registration remains challenging MIPs & acquisition: dissimilar intensity range and appearance Best similarity metric? Use iterative reconstruction and integrated projections? 3D motion compensation using 3D/2D registration First step towards automatic image-based motion compensation for weight-bearing knee imaging February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 18

Discussion and Conclusion Motion must be visible in high-intensity structures Biased registration in the presence of artifacts (modeling clay) Stable registration remains challenging MIPs & acquisition: dissimilar intensity range and appearance Best similarity metric? Use iterative reconstruction and integrated projections? 3D motion compensation using 3D/2D registration First step towards automatic image-based motion compensation for weight-bearing knee imaging February, 24. 2015 Unberath FAU Erlangen-Nürnberg, Stanford University Motion Compensation 18