Sparse Principal Axes Statistical Deformation Models for Respiration Analysis and Classification

Similar documents
Photometric Estimation of 3-D Surface Motion Fields for Respiration Management

Real-time Respiratory Motion Analysis Using Manifold Ray Casting of Volumetrically Fused Multi-View Range Imaging

Gradient-Based Differential Approach for Patient Motion Compensation in 2D/3D Overlay

Combination of Markerless Surrogates for Motion Estimation in Radiation Therapy

High Performance GPU-Based Preprocessing for Time-of-Flight Imaging in Medical Applications

ToF/RGB Sensor Fusion for Augmented 3-D Endoscopy using a Fully Automatic Calibration Scheme

Quality Guided Image Denoising for Low-Cost Fundus Imaging

Guided Image Super-Resolution: A New Technique for Photogeometric Super-Resolution in Hybrid 3-D Range Imaging

Prediction of Respiration-Induced Internal 3-D Deformation Fields From Dense External 3-D Surface Motion

GPU-Accelerated Time-of-Flight Super-Resolution for Image-Guided Surgery

Marker-less Reconstruction of Dense 4-D Surface Motion Fields using Active Laser Triangulation for Respiratory Motion Management

Real-time Preprocessing for Dense 3-D Range Imaging on the GPU: Defect Interpolation, Bilateral Temporal Averaging and Guided Filtering

Iterative CT Reconstruction Using Curvelet-Based Regularization

2D Vessel Segmentation Using Local Adaptive Contrast Enhancement

Respiratory Motion Compensation for C-arm CT Liver Imaging

Artefakt-resistente Bewegungsschätzung für die bewegungskompensierte CT

Scaling Calibration in the ATRACT Algorithm

Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System

Computer vision: models, learning and inference. Chapter 13 Image preprocessing and feature extraction

Total Variation Regularization Method for 3D Rotational Coronary Angiography

Multi-modal Surface Registration for Markerless Initial Patient Setup in Radiation Therapy using Microsoft s Kinect Sensor

Evaluation of Spectrum Mismatching using Spectrum Binning Approach for Statistical Polychromatic Reconstruction in CT

Human pose estimation using Active Shape Models

Total Variation Regularization Method for 3-D Rotational Coronary Angiography

Comparison of Default Patient Surface Model Estimation Methods

Spatial-temporal Total Variation Regularization (STTVR) for 4D-CT Reconstruction

Model-Based Respiratory Motion Compensation for Image-Guided Cardiac Interventions

Selecting Models from Videos for Appearance-Based Face Recognition

Geometry-Based Optic Disk Tracking in Retinal Fundus Videos

Respiratory Motion Estimation using a 3D Diaphragm Model

Fast Sample Generation with Variational Bayesian for Limited Data Hyperspectral Image Classification

Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences

Facial Expression Recognition Using Non-negative Matrix Factorization

Linear Discriminant Analysis in Ottoman Alphabet Character Recognition

An instrument for generation and control of sub-micron motion

Accelerated C-arm Reconstruction by Out-of-Projection Prediction

ICA vs. PCA Active Appearance Models: Application to Cardiac MR Segmentation

Dynamic Human Shape Description and Characterization

Estimating 3D Respiratory Motion from Orbiting Views

Image Coding with Active Appearance Models

Towards full-body X-ray images

Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma

Intensity-Based 3D-Reconstruction of Non-Rigid Moving Stenosis From Many Angiographies erschienen in

Robust Real-Time 3D Respiratory Motion Detection Using Time-of-Flight Cameras

Real-time RGB-D Mapping and 3-D Modeling on the GPU using the Random Ball Cover

Motion Capture using Body Mounted Cameras in an Unknown Environment

CSE 6242 A / CS 4803 DVA. Feb 12, Dimension Reduction. Guest Lecturer: Jaegul Choo

Discriminate Analysis

PCA Based 3D Shape Reconstruction of Human Foot Using Multiple Viewpoint Cameras

Spectral Classification

Lecture 8 Object Descriptors

Make the Most of Time

Generation of Hulls Encompassing Neuronal Pathways Based on Tetrahedralization and 3D Alpha Shapes

22 October, 2012 MVA ENS Cachan. Lecture 5: Introduction to generative models Iasonas Kokkinos

Improving Segmentation of the Left Ventricle using a Two-Component Statistical Model

Initial Clinical Experience with 3D Surface Image Guidance

Hand Gesture Extraction by Active Shape Models

Visual Tracking (1) Feature Point Tracking and Block Matching

3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.

Face Recognition for Mobile Devices

SCAPE: Shape Completion and Animation of People

Modelling imprints of pharmaceutical tablets for imprint quality visual inspection

ARTICLE IN PRESS. Computerized Medical Imaging and Graphics xxx (2008) xxx xxx. Contents lists available at ScienceDirect

FOREWORD TO THE SPECIAL ISSUE ON MOTION DETECTION AND COMPENSATION

Feature Extraction and Image Processing, 2 nd Edition. Contents. Preface

Multi Focus Image Fusion Using Joint Sparse Representation

Automatic Modelling Image Represented Objects Using a Statistic Based Approach

Module 28.3: nag mv rotation Rotations. Contents

Recognition: Face Recognition. Linda Shapiro EE/CSE 576

Simultaneous Localization and Mapping

Announcements. Recognition I. Gradient Space (p,q) What is the reflectance map?

Retrospective Spiral Respiratory Correlated Imaging with Varian RPM

A finite state model for respiratory motion analysis in image guided radiation therapy

Respiratory Motion Compensation for Simultaneous PET/MR Based on Strongly Undersampled Radial MR Data

Tutorial 1: Welded Frame - Problem Description

Binning Without a Model for Cone-beam CT

Human Activity Recognition Based on Weighted Sum Method and Combination of Feature Extraction Methods

Projection and Reconstruction-Based Noise Filtering Methods in Cone Beam CT

Body Trunk Shape Estimation from Silhouettes by Using Homologous Human Body Model

Inverse C-arm positioning for interventional procedures using real-time body part detection

Automatic Removal of Externally Attached Fiducial Markers in Cone Beam C-arm CT

Evaluation of Fourier Transform Coefficients for The Diagnosis of Rheumatoid Arthritis From Diffuse Optical Tomography Images

Sparse coding for image classification

Event Detection through Differential Pattern Mining in Internet of Things

Discrete Estimation of Data Completeness for 3D Scan Trajectories with Detector Offset

Paper Motivation. Fixed geometric structures of CNN models. CNNs are inherently limited to model geometric transformations

Feature Selection Using Principal Feature Analysis

SIMULATION AND VISUALIZATION IN THE EDUCATION OF COHERENT OPTICS

Vehicle Dimensions Estimation Scheme Using AAM on Stereoscopic Video

An Evaluation of Volumetric Interest Points

Markerless estimation of patient orientation, posture and pose using range and pressure imaging

Walking gait dataset: point clouds, skeletons and silhouettes

Comparison of High-Speed Ray Casting on GPU

Patient surface model and internal anatomical landmarks embedding

Dimension reduction : PCA and Clustering

CSE 481C Imitation Learning in Humanoid Robots Motion capture, inverse kinematics, and dimensionality reduction

Self-Calibration of Cone-Beam CT Using 3D-2D Image Registration

Applications Guide 3WayPack TUCKALS3: Analysis of Chopin Data

Distributed Vision Processing in Smart Camera Networks

DA Progress report 2 Multi-view facial expression. classification Nikolas Hesse

Transcription:

Sparse Principal Axes Statistical Deformation Models for Respiration Analysis and Classification Jakob Wasza 1, Sebastian Bauer 1, Sven Haase 1,2, Joachim Hornegger 1,3 1 Pattern Recognition Lab, University of Erlangen-Nuremberg 2 TUM Graduate School of Information Science in Health (GSISH) 3 Erlangen Graduate School in Advanced Optical Technologies (SAOT) BVM, Berlin, 3/22/2012

Outline Motivation Respiratory Motion Range Imaging based Surrogates Methods Range Imaging Principal Component Analysis Orthomax Rotations Results PCA vs. Varimax Rotations Applications Conclusion and Outlook 2

Motivation Respiratory Motion Range Imaging based Surrogates

Motivation Internal movement due to respiratory motion Tomographic reconstruction Fractionated radiotherapy Gating and beam adjustment based on 1-D respiration surrogates Dedicated sensors attached to the body surface Non-intrusive range imaging (RI) Current RI-based 1-D surrogates Manually selected points and regions Heuristic surface partitioning Global statistical models Figure: Gated radiotherapy using RI techniques. 4

Motivation Drawbacks of conventional statistical models Fail to describe local deformations (e.g. thoracic and abdominal breathing) Hinder an intuitive interpretation of the model s inherent variations Produce invalid shapes w.r.t. the human respiration system Sparse axes models to produce relief Relate local deformations to sparsity of the model s principal axes Orthomax criterion to derive sparse principal modes of variation [1] [1] Stegmann M.B, Sjöstrand K, Larsen R. Sparse Modeling of Landmark and Texture Variability using the Orthomax Criterion. In: Proc SPIE. vol. 6144; 2006. p. 61441G1-61441G.12. 5

Methods Range Imaging Principal Component Analysis Orthomax Rotations

Range Imaging Usually denotes an ROI Sensor domain Range image Linearized range image Training data acquired at different respiration states Figure: Body surface captured by the Microsoft Kinect RI device. 8

Principal Component Analysis (PCA) Configuration matrix Eigendecomposition and principal component basis Linear span of the model Controls the modes Note that PCA maximizes the variance of the input data along the basis vectors. Thus, global modes are obtained! 9

Orthomax Rotations Optimization problem Varimax rotation ( ) Varimax rotations transform the model basis according to, maximizing the squared variable loadings by bringing several loadings close to zero. This favors sparse modes! 10

Results PCA vs. Varimax Rotations Applications

Results Dimension reduction Abdominal and thoracic breathing Two separate and one joint model Mode of variation Abdominal Thoracic Joint #1 98.4 % (98.4%) 92.7 % (92.7%) 75.3 % (75.3%) #2 ~1.0 % (99.4%) ~ 5.9 % (98.6%) 23.2 % (98.5%) #3 < 1.0 % (99.8%) < 1.0 % (99.4%) ~ 1.0 % (99.4%) #4 < 1.0 % (99.9%) < 1.0 % (99.6%) < 1.0 % (99.6%) Total 99.9% 99.6% 99.6% Table: Variance covered by the first four modes of variation. 12

Results PCA vs. varimax rotations Figure: Respiratory motion patterns from statistical analysis. PCA (P) and Varimax rotations (V). Magnitude of variation is color coded from blue (low) to red (high). 13

Results Simulation of respiration states for algorithm benchmarking 14

Results Patient specific respiration analysis and classification PCC > 0.98 PCC > 0.99 15

Conclusion and Outlook

Conclusions and Outlook Sparse principal axes for respiration analysis Varimax rotations to generate sparse modes Local surface deformations Differentiation between thoracic and abdominal breathing Future work Extension to 3-D point clouds Non-linear techniques for model generation Thank you for your attention! 17

Acknowledgements We gratefully acknowledge the support by the European Regional Development Fund and the Bayerisches Stastsministerium für Wirtschaft, Infrastruktur, Verkehr und Technologie in the context of the R&D program IuK Bayern under Grant No. IUK338. We gratefully acknowledge the Support by the Deutsche Forschungsgemeinschaft under Grant No. HO 1791/7-1 and the Graduate School of Information Science in Health (GSISH) and the TUM Graduate School. 18