Combination of Markerless Surrogates for Motion Estimation in Radiation Therapy

Similar documents
Gradient-Based Differential Approach for Patient Motion Compensation in 2D/3D Overlay

Artefakt-resistente Bewegungsschätzung für die bewegungskompensierte CT

Image-based Compensation for Involuntary Motion in Weight-bearing C-arm CBCT Scanning of Knees

Sparse Principal Axes Statistical Deformation Models for Respiration Analysis and Classification

Prediction of Respiration-Induced Internal 3-D Deformation Fields From Dense External 3-D Surface Motion

Deformable Segmentation using Sparse Shape Representation. Shaoting Zhang

REAL-TIME ADAPTIVITY IN HEAD-AND-NECK AND LUNG CANCER RADIOTHERAPY IN A GPU ENVIRONMENT

Real Time Tumor Motion Tracking with CyberKnife

Image Guidance and Beam Level Imaging in Digital Linacs

CLARET: A Fast Deformable Registration Method Applied to Lung Radiation Therapy

arxiv: v3 [cs.cv] 5 Nov 2018

Respiratory Motion Compensation for C-arm CT Liver Imaging

Optical Guidance. Sanford L. Meeks. July 22, 2010

Respiratory Motion Estimation using a 3D Diaphragm Model

GPU applications in Cancer Radiation Therapy at UCSD. Steve Jiang, UCSD Radiation Oncology Amit Majumdar, SDSC Dongju (DJ) Choi, SDSC

Automatic DRR Enhancement for Patient Positioning in a Radiotherapy Treatment

Ch. 4 Physical Principles of CT

Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences

Image Quality Assessment and Quality Assurance of Advanced Imaging Systems for IGRT. AAPM Penn-Ohio Chapter Sep 25, 2015 Soyoung Lee, PhD

Convolution-Based Truncation Correction for C-Arm CT using Scattered Radiation

Model-Based Respiratory Motion Compensation for Image-Guided Cardiac Interventions

TomoTherapy Related Projects. An image guidance alternative on Tomo Low dose MVCT reconstruction Patient Quality Assurance using Sinogram

FOREWORD TO THE SPECIAL ISSUE ON MOTION DETECTION AND COMPENSATION

Medicale Image Analysis

Assessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model

Comparison of Default Patient Surface Model Estimation Methods

Automatic Intrinsic Cardiac and Respiratory Gating from Cone-Beam CT Scans of the Thorax Region

SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab

The Near Future in Cardiac CT Image Reconstruction

A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields

Real-time Respiratory Motion Analysis Using Manifold Ray Casting of Volumetrically Fused Multi-View Range Imaging

Machine Learning for Medical Image Analysis. A. Criminisi

Dynamic Image Prediction Using Principal Component and Multi-Channel Singular Spectral Analysis: A Feasibility Study

VALIDATION OF DIR. Raj Varadhan, PhD, DABMP Minneapolis Radiation Oncology

Future Topics. Projection Imaging Dose Reporting, XA 3D Volume Objects. for DICOM WG-02. Presented by Heinz Blendinger, Siemens Medical Solutions

7/31/2011. Learning Objective. Video Positioning. 3D Surface Imaging by VisionRT

7/31/ D Cone-Beam CT: Developments and Applications. Disclosure. Outline. I have received research funding from NIH and Varian Medical System.

Towards full-body X-ray images

Motion Compensation using Range Imaging in C-arm Cone-Beam CT

New Technology in Radiation Oncology. James E. Gaiser, Ph.D. DABR Physics and Computer Planning Charlotte, NC

Discrete Estimation of Data Completeness for 3D Scan Trajectories with Detector Offset

Markerless Real-Time Target Region Tracking: Application to Frameless Stereotactic Radiosurgery

A Radiometry Tolerant Method for Direct 3D/2D Registration of Computed Tomography Data to X-ray Images

Local Metric Learning in 2D/3D Deformable Registration With Application in the Abdomen

Respiratory Motion Compensation for Simultaneous PET/MR Based on Strongly Undersampled Radial MR Data

Digital Tomosynthesis for Target Localization

Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System

Spatial-temporal Total Variation Regularization (STTVR) for 4D-CT Reconstruction

Introduction. Biomedical Image Analysis. Contents. Prof. Dr. Philippe Cattin. MIAC, University of Basel. Feb 22nd, of

Optimization of Image Guided Radiation Therapy Using. Limited Angle Projections

Digital Volume Correlation for Materials Characterization

A Generation Methodology for Numerical Phantoms with Statistically Relevant Variability of Geometric and Physical Properties

Moving Metal Artifact Reduction for Cone-Beam CT (CBCT) Scans of the Thorax Region

Head and Neck Lymph Node Region Delineation with Auto-segmentation and Image Registration

Motion artifact detection in four-dimensional computed tomography images

ADVANCING CANCER TREATMENT

Projection and Reconstruction-Based Noise Filtering Methods in Cone Beam CT

Basic principles of MR image analysis. Basic principles of MR image analysis. Basic principles of MR image analysis

Helical 4D CT pitch management for the Brilliance CT Big Bore in clinical practice

Is deformable image registration a solved problem?

A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images

radiotherapy Andrew Godley, Ergun Ahunbay, Cheng Peng, and X. Allen Li NCAAPM Spring Meeting 2010 Madison, WI

Modeling and preoperative planning for kidney surgery

State-of-the-Art IGRT

3/27/2012 WHY SPECT / CT? SPECT / CT Basic Principles. Advantages of SPECT. Advantages of CT. Dr John C. Dickson, Principal Physicist UCLH

3D Guide Wire Navigation from Single Plane Fluoroscopic Images in Abdominal Catheterizations

Fast CT-CT Fluoroscopy Registration with Respiratory Motion Compensation for Image-Guided Lung Intervention

2D/3D Registration Based on Volume Gradients

Non-rigid Registration of Preprocedural MRI and Intra-procedural CT for CT-guided Cryoablation Therapy of Liver Cancer

ADVANCING CANCER TREATMENT

Estimating 3D Respiratory Motion from Orbiting Views

SCAPE: Shape Completion and Animation of People

Design and performance characteristics of a Cone Beam CT system for Leksell Gamma Knife Icon

Deep Scatter Estimation (DSE): Accurate Real-Time Scatter Estimation for X-Ray CT using a Deep Convolutional Neural Network

Scaling Calibration in the ATRACT Algorithm

Auto-Segmentation Using Deformable Image Registration. Disclosure. Objectives 8/4/2011

Philips SPECT/CT Systems

Mapping of Hierarchical Activation in the Visual Cortex Suman Chakravartula, Denise Jones, Guillaume Leseur CS229 Final Project Report. Autumn 2008.

Reduction of Metal Artifacts in Computed Tomographies for the Planning and Simulation of Radiation Therapy

Image Segmentation and Registration

Volumetric Cine Imaging for On-board Target Localization in Radiation Therapy. Wendy Beth Harris. Graduate Program in Medical Physics Duke University

Computed Tomography. Principles, Design, Artifacts, and Recent Advances. Jiang Hsieh THIRD EDITION. SPIE PRESS Bellingham, Washington USA

A new calibration-free beam hardening reduction method for industrial CT

8/3/2016. Image Guidance Technologies. Introduction. Outline

Computed Tomography & 3D Metrology Application of the VDI/VDE Directive 2630 and Optimization of the CT system

Automatic Generation of Shape Models Using Nonrigid Registration with a Single Segmented Template Mesh

Robust Lung Ventilation Assessment

L1 - Introduction. Contents. Introduction of CAD/CAM system Components of CAD/CAM systems Basic concepts of graphics programming

1. Learn to incorporate QA for surface imaging

O-ARM IMAGING SYSTEM TECHNICAL SPECIFICATION GUIDE

3D Imaging from Video and Planar Radiography

Guide wire tracking in interventional radiology

Geometric Registration for Deformable Shapes 1.1 Introduction

Good Morning! Thank you for joining us

Semi-automatic Segmentation of Vertebral Bodies in Volumetric MR Images Using a Statistical Shape+Pose Model

Preparation Meeting. Recent Advances in the Analysis of 3D Shapes. Emanuele Rodolà Matthias Vestner Thomas Windheuser Daniel Cremers

DETERMINISTIC 3D RADIATION TRANSPORT SIMULATION FOR DOSE DISTRIBUTION AND ORGAN DOSE EVALUATION IN DIAGNOSTIC CT

Non-Stationary CT Image Noise Spectrum Analysis

Sparsity Based Spectral Embedding: Application to Multi-Atlas Echocardiography Segmentation!

RADIOMICS: potential role in the clinics and challenges

Transcription:

Combination of Markerless Surrogates for Motion Estimation in Radiation Therapy CARS 2016 T. Geimer, M. Unberath, O. Taubmann, C. Bert, A. Maier June 24, 2016 Pattern Recognition Lab (CS 5) FAU Erlangen-Nu rnberg

Motivation External Beam Radiation Therapy Planning CT Optimized dose distribution Respiratory motion Target volume displacement! Potential survival of malignant cells c BrainLAB AG June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 2

Motion Estimation Clinical State of the Art Marker Tracking Control points based Only sparse deformation kv tube IR cam kv tube June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 3

Motion Estimation Clinical State of the Art Marker Tracking Control points based Only sparse deformation Novel Approaches Range Imaging Dense surface information Non-intrusive kv tube RI cam kv tube Fluoroscopy Image-based signal Internal motion models Dense internal deformation June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 3

Outline Motion Estimation Motion Models Correlation & Prediction Multi Surrogate Approach Results & Discussion Outlook June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 4

Motion Models Reference Surface extracted from CT 3D + t CT n+1volumes Internal Motion Non-rigid 3D/3D registration w.r.t. reference phase tref 3D/3D Registration Cropping to internal ROI Interpolation of vector fields n internal deformation fields Surface Motion n surface deformation fields PCA PCA Surface extracted from 3-D data set Deformation fields d i interpolated at mesh-vertices Principle Components of Internal Motion Model 2 n feature vectors 1. dim 2. dim 3. dim 1.5 1 0.5 0-1.5-1.5 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 Internal ASM June 24, 2016 T. Geimer 0-1 1 n feature vectors 1. dim 2. dim 3. dim 1 0.5-0.5-1 -2 Principle Components of Surface Motion Model 2 1.5-0.5-2 1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 Surface ASM Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 5

Framework Overview Internal Motion Surface Surrogate Fluoro Surrogate Range Imaging n surface deformation fields X-ray Fluoroscopy n images Active Shape Model Active Shape Model 3D + t CT n+1volumes 3D/3D Registration Individual n internal deformation fields June 24, 2016 T. Geimer Active Shape Model Correlation Multi-linear regression between model weights Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 6

Framework Overview Internal Motion Surface Surrogate Fluoro Surrogate Range Imaging n surface deformation fields X-ray Fluoroscopy n images Active Shape Model Active Shape Model 3D + t CT n+1volumes 3D/3D Registration Individual n internal deformation fields June 24, 2016 T. Geimer Active Shape Model Correlation Multi-linear regression between model weights Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 6

Framework Overview Internal Motion Surface Surrogate Fluoro Surrogate Range Imaging n surface deformation fields X-ray Fluoroscopy n images Active Shape Model Active Shape Model 3D + t CT n+1volumes 3D/3D Registration Combination n internal deformation fields June 24, 2016 T. Geimer Active Shape Model Correlation Multi-linear regression between model weights Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 6

1.5 1 0.5 0-0.5-1 -1.5-2 Principle Components of Fluoro Motion Model 1. dim 2. dim 3. dim -2.5 1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 Fluoroscopy Surrogate Model Preprocessing DRRs from volumetric CT data According to Vero kv beam geometry Breathing Signal Extraction Linearized images 3D + t CT n volumes (no ref) forward projection n DRRs PCA of the change in intensity First few principle component correlate highly with breathing phase PCA n feature vectors June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 7

Multi-surrogate Approach Motivation Combined information from range imaging and fluoroscopy Improve the estimation or compensate for one surrogate failing Combination Concatenated [ ] feature vector σrii σ CB = R (f RI+f FL ) 1 i σ FL i Regression matrix R CB R l (f RI+f FL ) Example: R CB R 3 (2+2) σ φ RI1 1 φ 2 = R CB σ RI2 σ φ FL1 3 σ FL2 June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 8

Evaluation Data Nine 4-D CT patient data sets Ten volumes each (voxel size: 0.97 0.97 2.5 mm 3 ) DRRs: detector with 1024 768 pixels and 0.39 mm pixel spacing Experiments Correlation study on feature weights Leave-one-out-assessment of the estimation error w.r.t. ground-truth June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 9

Results: Correlation Pat3 Pat9 1. PC 2. PC 3. PC June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 10

Results: Estimation Estimation error / mm 1.4 1.2 1 0.8 0.6 0.4 0.2 RI FL CB (1/1) CB (2/2) CB (3/3) CB (4/4) 0 l=1 l=2 l=3 l=4 Internal model dimensionality reference mean: 2.31 ± 0.70 mm June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 11

Discussion Single Surrogate Fluoro outperforms surface surrogate: 0.67 ± 0.33 mm for l = 2 No improvement with higher internal model dimension Combination Approach No consistent improvement f RI, f FL = 1: 1-D respiratory phase Linearly dependent Best overall for l = 2 from (2+2) or higher combined features: 0.62 ± 0.28 mm Surrogate combination useful under certain circumstances June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 12

Outlook Surrogate Extraction DR eliminates non-redundant information Sophisticated ways to extract mutually exclusive information Data Acquisition & Training Training currently only done on 6 of 9 phases (necessity of leave-one-out approach) ASMs do not describe an entire cycle Training on entire cycle Prediction on another of the same patient June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 13

Thank you for your attention. Questions? June 24, 2016 T. Geimer Pattern Recognition Lab (CS 5) Combination of Markerless Surrogates for Motion Estimation 14