Towards deformable registration for augmented reality in robotic assisted partial nephrectomy
|
|
- Bathsheba Clarke
- 5 years ago
- Views:
Transcription
1 Towards deformable registration for augmented reality in robotic assisted partial nephrectomy Supervisor: Elena De Momi, PhD Co-supervisor: Dott. Ing. Sara Moccia Author: Anna Morelli, Academic Year
2 Partial nephrectomy 1 Kidney tumor 12 th most common type of cancer with 338,000 new cases worldwide annually diagnosed
3 Partial nephrectomy 1 Open surgery Kidney tumor 12 th most common type of cancer with 338,000 new cases worldwide annually diagnosed
4 Partial nephrectomy 1 Open surgery Kidney tumor 12 th most common type of cancer with 338,000 new cases worldwide annually diagnosed Minimally Invasive Surgery (MIS) Bleeding reduction Scar and pain reduction Lower risk of infection [Fullum et al., 2010][Himal et al., 2012]
5 Partial nephrectomy 1 Open surgery Kidney tumor 12 th most common type of cancer with 338,000 new cases worldwide annually diagnosed Minimally Invasive Surgery (MIS) Bleeding reduction Scar and pain reduction Lower risk of infection [Fullum et al., 2010][Himal et al., 2012] Robotic MIS (RMIS) 3D view Tremor filtering Instruments wide range of motion
6 Augmented Reality in RMIS 2 RMIS limitations: Lack of visibility High surgeon s cognitive load
7 Augmented Reality in RMIS 2 RMIS limitations: Lack of visibility High surgeon s cognitive load Augmented reality (AR) Benefits: Intra-operative guidance Rapid identification of targets Reduction of surgeon s cognitive load Virtual element (patient s anatomy) Intra-operative view
8 Augmented Reality in RMIS 2 RMIS limitations: Lack of visibility High surgeon s cognitive load Augmented reality (AR) Benefits: Intra-operative guidance Rapid identification of targets Reduction of surgeon s cognitive load The AR should deals the intra-operative soft tissues deformation, mainly due to: Changes in pressure and patient's position Clamping of the renal vessels Surgeon's organ manipulation and dissection [Bernhardt et al., 2017] Virtual element (patient s anatomy) Intra-operative view
9 Registration 3 Registration is the process by which the transformation (i.e. the mathematical operator) necessary to superimpose a given point set to another one is found [Sonka et al., 2002]. Reference point set (F) Metric Registration output Moving point set (M) Transformation Optimization
10 Registration 3 Registration is the process by which the transformation (i.e. the mathematical operator) necessary to superimpose a given point set to another one is found [Sonka et al., 2002]. Reference point set (F) Metric Registration output Moving point set (M) Transformation Optimization Rigid Deformable
11 AR systems in partial nephrectomy 4 Rigid registration 1. Pre-operative anatomy and intra-operative view [Benincasa et al., 2008] [Su et al., 2009] [Glisson et al., 2011] [Pratt et al., 2012]. 2. Pre-operative anatomy modified with biomechianical model and intraoperative view [Altamar et al., 2011] [Ong et al., 2008]. 3. Intra-operative anatomy and intra-operative view [Baumhauer et al., 2008] [Teber et al., 2009] [Cheung et al., 2009] [Nakamura et al., 2010][Hughes-Hallett et al., 2014].
12 AR systems in partial nephrectomy 4 Rigid registration 1. Pre-operative anatomy and intra-operative view [Benincasa et al., 2008] [Su et al., 2009] [Glisson et al., 2011] [Pratt et al., 2012]. 2. Pre-operative anatomy modified with biomechianical model and intraoperative view [Altamar et al., 2011] [Ong et al., 2008]. 3. Intra-operative anatomy and intra-operative view [Baumhauer et al., 2008] [Teber et al., 2009] [Cheung et al., 2009] [Nakamura et al., 2010][Hughes-Hallett et al., 2014]. Deformable registration Deformable superimposition between pre-operative anatomy and intraoperative view is computed only for the tumor boundary [Amir-Khalili et al., 2013].
13 Registration: rigid vs deformable 5 Rigid registration Transformation is described by 6 degrees of freedom in 3D (roto-translation). Most used algorithm is Iterative Closest Point (ICP) [Besl et al., 1992] [Zhang et al., 1994].
14 Registration: rigid vs deformable 5 Rigid registration Transformation is described by 6 degrees of freedom in 3D (roto-translation). Most used algorithm is Iterative Closest Point (ICP) [Besl et al., 1992] [Zhang et al., 1994]. Deformable registration Transformation is described by unlimited number of degrees of freedom [Sotiras et al., 2013]. A possible transformation is Vector Field (VF) [Sederberg et al., 1986] [Rueckert et al., 1999]. VF can be computed with: Thin plate spline Free Form Deformation (FFD) based on B-spline i. No one-to-one correspondence ii. Each point is affected by a limited area iii. Smooth deformation
15 Aim of the thesis 6 The aim of this thesis is exploiting deformable registration in order to obtain an accurate superimposition of the pre-operative kidney anatomy (reconstructed from pre-operative images) to the intra-operative endoscopic view. Superimposition
16 Methods: Workflow 7 PRE-OPERATIVE MODEL GENERATION Segmentation 3D reconstruction Patient s CT Model (M) INTRA-OPERATIVE POINT CLOUD RECONSTRUCTION Initial alignment Deformable registration 3D reconstruction Stereoimages Point-cloud (F)
17 Methods: Pre-operative model generation 8 Segmentation 3D reconstruction Patient s CT Model (M) Pre-operative model generation: The segmentation of the pre-operative patient s CT was performed with semiautomatic method exploiting deformable active contours model [Kass et al., 1988] [Gao et al., 2012]. The 3D reconstruction was performed with marching cubes [Lorensen et al., 1987]. The model vertexes are retrieved. Model generation was implemented in 3D Slicer [
18 Methods: Intra-operative point cloud reconstruction 9 3D reconstruction Stereoimages Point-cloud (F) Intra-operative point cloud reconstruction: The reconstruction was performed with dense soft-tissue 3D reconstruction [Penza et al., 2016]. 3D reconstruction was implemented in C++.
19 Methods: Initial alignment 10 Manual The rotation angles and the translation values were set manually. It was performed with 3D Slicer.
20 Methods: Initial alignment 10 Manual The rotation angles and the translation values were set manually. It was performed with 3D Slicer. Pair-point matching The rigid transformation was retrieved minimizing a cost function based on the Euclidean distance between the corresponding markers. It was implemented in C++ using the Visualization Toolkit (VTK) [ Pre-operative point cloud Intra-operative point cloud Corresponding markers Initial situation Alignment
21 Methods: Deformable registration 11 The deformable registration was computed with Free Form Deformation (FFD) algorithm. 3 3 T x, y = B l u B m v φ i+l,j+m l=0 m=0 B 0 u = (1 u) 3 /6 B 1 u = (3u 3 6u 2 + 4)/6 B 2 u = ( 3u 3 + 3u 2 + 3u + 1)/6 B 3 (u) = u 3 /6 and φ i+l,j+m, are the mesh control points: i = x/n x 1 j = y/n y 1 u = x/n x x/n x v = y/n y y/n y The FFD registration algorithm was implemented in C++ using the Insight Segmentation and Registration Toolkit (ITK) [
22 Methods: Phantom development 12 In order to retrieve intra-operative point cloud. Moulding process [Condino et al., 2011]: 1. From the pre-operative model, the 3D virtual negative molds were modeled with Blender. 2. The mold were printed in acrylonite butadine styrene (ABS) 3. Phantoms were built in bi-component silicon elastomer (Pro-lastix); silicon oil was added to make the phantoms deformable and color was chosen to mimic the real texture
23 Materials: Pre-operative point cloud 13 M1: from Ircad dataset [ Abdominal CT, 512x512x167 slices and 0.916x0.196x1.8 mm voxel size
24 Materials: Pre-operative point cloud 13 M1: from Ircad dataset [ Abdominal CT, 512x512x167 slices and 0.916x0.196x1.8 mm voxel size. M2: from CT given by Istituto Europeo di Oncologia Abdominal CT, 512x512x716 slices and 0.703x0.703x0.625 mm voxel size.
25 Materials: Intra-operative point cloud 14 F1: manually deforming M1 with Blender [
26 Materials: Intra-operative point cloud 14 F1: manually deforming M1 with Blender [ F2: from images acquired on kidney phantom
27 Evaluation protocol 15 To test the registration performance, the Root Mean Square Error (RMSE) reduction before the registration (RMSE initial ) and after (RMSE final ) were compared: Δ RMSE = RMSE initial RMSE final RMSE initial where the RMSE= d(m, F) and d(m, F) = σ m M min Ԧf P Ԧf m.
28 Evaluation protocol 15 To test the registration performance, the Root Mean Square Error (RMSE) reduction before the registration (RMSE initial ) and after (RMSE final ) were compared: Δ RMSE = RMSE initial RMSE final RMSE initial where the RMSE= d(m, F) and d(m, F) = σ m M min Ԧf m. Ԧf P The Wilcoxon test (significance level = 0.05) was used to investigate the presence of statistically significative difference.
29 Evaluation protocol 15 To test the registration performance, the Root Mean Square Error (RMSE) reduction before the registration (RMSE initial ) and after (RMSE final ) were compared: Δ RMSE = RMSE initial RMSE final RMSE initial where the RMSE= d(m, F) and d(m, F) = σ m M min Ԧf m. Ԧf P The Wilcoxon test (significance level = 0.05) was used to investigate the presence of statistically significative difference. A multicomparison on the means was performed to investigate the presence of differences in the registration results [Hochberg, 1984].
30 Evaluation protocol 15 To test the registration performance, the Root Mean Square Error (RMSE) reduction before the registration (RMSE initial ) and after (RMSE final ) were compared: Δ RMSE = RMSE initial RMSE final RMSE initial where the RMSE= d(m, F) and d(m, F) = σ m M min Ԧf m. Ԧf P The Wilcoxon test (significance level = 0.05) was used to investigate the presence of statistically significative difference. A multicomparison on the means was performed to investigate the presence of differences in the registration results [Hochberg, 1984]. The used PC had AMD Ryzen 7 processor and 32 GB of RAM.
31 Evaluation protocol 16 Objective n x, n y and iter max FFD vs ICP and deformation levels Entire workflow Description In 2D, the model M1 was registered to the manually deformed F1. In 2D and 3D, the deformable registration was performed between M1 and the manually deformed F1. The models M1 and M2 were registered to F2 (the intra-operative point cloud acquired on phantom).
32 Results: n x, n y and iter max 17 n x, n y Δ RMSE dim x /5, dim y / dim x /15, dim y / dim x /20, dim y /
33 Results: n x, n y and iter max 17 n x, n y Δ RMSE dim x /5, dim y / dim x /15, dim y / dim x /20, dim y /
34 Results: FFD, ICP and deformation level in 2D 18 Intra-operative point cloud Pre-operative point cloud Initial situation Δ RMSE,ICP = 0.02 Δ RMSE,FFD = 0.51
35 Results: FFD, ICP and deformation level in 2D 18
36 Results: FFD, ICP and deformation level in 3D 19 Intra-operative point cloud Pre-operative point cloud Initial situation Δ RMSE,ICP = 0.01 Δ RMSE,FFD = 0.12
37 Results: FFD, ICP and deformation level in 3D 19
38 Results: Entire workflow 20 Initial situation Alignment Registration Initial manual alignment: Mean Δ RMSE,workflow : 0.74 Best Δ RMSE,workflow : 0.91 Pre-operative point cloud Intra-operative point cloud Point-based alignment: Mean Δ RMSE,workflow : 0.78 Best Δ RMSE,workflow : 0.87 Corresponding marker 000
39 Conclusions 21 The workflow is able to treat in quasi-real time the deformable superimposition of the 3D kidney model to the intra-operative point cloud Maintain the superimposition: tracking [Bernhardt et al., 2017] [Yip et al., 2012] Deal with the amount of visible surface
40 Conclusions 21 The workflow is able to treat in quasi-real time the deformable superimposition of the 3D kidney model to the intra-operative point cloud Maintain the superimposition: tracking [Bernhardt et al., 2017] [Yip et al., 2012] Deal with the amount of visible surface The manual intervention in necessary in three phases: 1. Pre-operative CT segmentation Automatic CT segmentation [Lee et al., 2003] [Lin et al., 2006] [Yan et al., 2010] 2. Manual initial alignment 3. Markers selection
41 Conclusions 21 The workflow is able to treat in quasi-real time the deformable superimposition of the 3D kidney model to the intra-operative point cloud Maintain the superimposition: tracking [Bernhardt et al., 2017] [Yip et al., 2012] Deal with the amount of visible surface The manual intervention in necessary in three phases: 1. Pre-operative CT segmentation Automatic CT segmentation [Lee et al., 2003] [Lin et al., 2006] [Yan et al., 2010] 2. Manual initial alignment 3. Markers selection Implementation of Active-Constraints
42 Thank you for your attention!
43 Appendix The deformable registration was computed with Free Form Deformation (FFD) algorithm T x, y, z = B l u B m v B n w φ i+l,j+m,k+n l=0 m=0 n=0 B 0 u = (1 u) 3 /6 B 1 u = (3u 3 6u 2 + 4)/6 B 2 u = ( 3u 3 + 3u 2 + 3u + 1)/6 B 3 (u) = u 3 /6 and φ i+l,j+m,k+n are the mesh control points: i = x/n x 1 j = y/n y 1 k =[z/ n z ] 1 u = x/n x x/n x v = y/n y y/n y w = z/n z z/n z
MR-Guided Mixed Reality for Breast Conserving Surgical Planning
MR-Guided Mixed Reality for Breast Conserving Surgical Planning Suba Srinivasan (subashini7@gmail.com) March 30 th 2017 Mentors: Prof. Brian A. Hargreaves, Prof. Bruce L. Daniel MEDICINE MRI Guided Mixed
More informationModeling and preoperative planning for kidney surgery
Modeling and preoperative planning for kidney surgery Refael Vivanti Computer Aided Surgery and Medical Image Processing Lab Hebrew University of Jerusalem, Israel Advisor: Prof. Leo Joskowicz Clinical
More informationAUTOMATIC DETECTION OF ENDOSCOPE IN INTRAOPERATIVE CT IMAGE: APPLICATION TO AUGMENTED REALITY GUIDANCE IN LAPAROSCOPIC SURGERY
AUTOMATIC DETECTION OF ENDOSCOPE IN INTRAOPERATIVE CT IMAGE: APPLICATION TO AUGMENTED REALITY GUIDANCE IN LAPAROSCOPIC SURGERY Summary of thesis by S. Bernhardt Thesis director: Christophe Doignon Thesis
More informationTowards Multi-Modal Image-Guided Tumour Identification in Robot-Assisted Partial Nephrectomy
Towards Multi-Modal Image-Guided Tumour Identification in Robot-Assisted Partial Nephrectomy Ghassan Hamarneh 1, Alborz Amir-Khalili 2, Masoud Nosrati 1, Ivan Figueroa 2, Jeremy Kawahara 1, Osama Al-Alao
More informationA Navigation System for Minimally Invasive Abdominal Intervention Surgery Robot
A Navigation System for Minimally Invasive Abdominal Intervention Surgery Robot Weiming ZHAI, Yannan ZHAO and Peifa JIA State Key Laboratory of Intelligent Technology and Systems Tsinghua National Laboratory
More informationVALIDATION OF DIR. Raj Varadhan, PhD, DABMP Minneapolis Radiation Oncology
VALIDATION OF DIR Raj Varadhan, PhD, DABMP Minneapolis Radiation Oncology Overview Basics: Registration Framework, Theory Discuss Validation techniques Using Synthetic CT data & Phantoms What metrics to
More informationREAL-TIME ADAPTIVITY IN HEAD-AND-NECK AND LUNG CANCER RADIOTHERAPY IN A GPU ENVIRONMENT
REAL-TIME ADAPTIVITY IN HEAD-AND-NECK AND LUNG CANCER RADIOTHERAPY IN A GPU ENVIRONMENT Anand P Santhanam Assistant Professor, Department of Radiation Oncology OUTLINE Adaptive radiotherapy for head and
More informationWeakly supervised segmentation and
Weakly supervised segmentation and Firma convenzione Politecnico recognition di Milano of surgical e Veneranda gestures Fabbrica del Duomo di Milano Tutor: Elena De Momi, PhD Co-tutor: Danail Stoyanov,
More information3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery
3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery Masahiko Nakamoto 1, Yoshinobu Sato 1, Masaki Miyamoto 1, Yoshikazu Nakamjima
More informationImproved Navigated Spine Surgery Utilizing Augmented Reality Visualization
Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization Zein Salah 1,2, Bernhard Preim 1, Erck Elolf 3, Jörg Franke 4, Georg Rose 2 1Department of Simulation and Graphics, University
More informationVideo to CT Registration for Image Overlay on Solid Organs
Video to CT Registration for Image Overlay on Solid Organs Balazs Vagvolgyi, Li-Ming Su, Russell Taylor, and Gregory D. Hager Center for Computer-Integrated Surgical Systems and Technology Johns Hopkins
More informationNavigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images
Navigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images Mamoru Kuga a*, Kazunori Yasuda b, Nobuhiko Hata a, Takeyoshi Dohi a a Graduate School of
More informationVolumetric Deformable Models for Simulation of Laparoscopic Surgery
Volumetric Deformable Models for Simulation of Laparoscopic Surgery S. Cotin y, H. Delingette y, J.M. Clément z V. Tassetti z, J. Marescaux z, N. Ayache y y INRIA, Epidaure Project 2004, route des Lucioles,
More informationA kidney deformation model for use in non-rigid registration during image-guided surgery
A kidney deformation model for use in non-rigid registration during image-guided surgery Rowena E. Ong 1, S. Duke Herrell 2, Michael I. Miga 1, Robert L. Galloway 1 1 Vanderbilt University, Dept. of Biomedical
More informationThin Plate Spline Feature Point Matching for Organ Surfaces in Minimally Invasive Surgery Imaging
Thin Plate Spline Feature Point Matching for Organ Surfaces in Minimally Invasive Surgery Imaging Bingxiong Lin, Yu Sun and Xiaoning Qian University of South Florida, Tampa, FL., U.S.A. ABSTRACT Robust
More information2 Michael E. Leventon and Sarah F. F. Gibson a b c d Fig. 1. (a, b) Two MR scans of a person's knee. Both images have high resolution in-plane, but ha
Model Generation from Multiple Volumes using Constrained Elastic SurfaceNets Michael E. Leventon and Sarah F. F. Gibson 1 MIT Artificial Intelligence Laboratory, Cambridge, MA 02139, USA leventon@ai.mit.edu
More informationAction recognition in robot-assisted minimally invasive surgery
Action recognition in robot-assisted minimally invasive surgery Candidate: Laura Erica Pescatori Co-Tutor: Hirenkumar Chandrakant Nakawala Tutor: Elena De Momi 1 Project Objective da Vinci Robot: Console
More informationTowards Projector-based Visualization for Computer-assisted CABG at the Open Heart
Towards Projector-based Visualization for Computer-assisted CABG at the Open Heart Christine Hartung 1, Claudia Gnahm 1, Stefan Sailer 1, Marcel Schenderlein 1, Reinhard Friedl 2, Martin Hoffmann 3, Klaus
More informationUncertainty-Encoded Augmented Reality for Robot-Assisted Partial Nephrectomy: A Phantom Study
Uncertainty-Encoded Augmented Reality for Robot-Assisted Partial Nephrectomy: A Phantom Study Alborz Amir-Khalili 1, Masoud S. Nosrati 2, Jean-Marc Peyrat 3, Ghassan Hamarneh 2, and Rafeef Abugharbieh
More information3D Surface Reconstruction of Organs using Patient-Specific Shape Priors in Robot-Assisted Laparoscopic Surgery
3D Surface Reconstruction of Organs using Patient-Specific Shape Priors in Robot-Assisted Laparoscopic Surgery Alborz Amir-Khalili 1, Jean-Marc Peyrat 2, Ghassan Hamarneh 3, and Rafeef Abugharbieh 1 1
More informationFree Form Deformations Guided by Gradient Vector Flow: a Surface Registration Method in Thoracic and Abdominal PET-CT Applications
Free Form Deformations Guided by Gradient Vector Flow: a Surface Registration Method in Thoracic and Abdominal PET-CT Applications Oscar Camara, Gaspar Delso, and Isabelle Bloch Ecole Nationale Supérieure
More informationReconstruction of complete 3D object model from multi-view range images.
Header for SPIE use Reconstruction of complete 3D object model from multi-view range images. Yi-Ping Hung *, Chu-Song Chen, Ing-Bor Hsieh, Chiou-Shann Fuh Institute of Information Science, Academia Sinica,
More informationIterative Estimation of 3D Transformations for Object Alignment
Iterative Estimation of 3D Transformations for Object Alignment Tao Wang and Anup Basu Department of Computing Science, Univ. of Alberta, Edmonton, AB T6G 2E8, Canada Abstract. An Iterative Estimation
More informationNon-rigid 2D-3D image registration for use in Endovascular repair of Abdominal Aortic Aneurysms.
RAHEEM ET AL.: IMAGE REGISTRATION FOR EVAR IN AAA. 1 Non-rigid 2D-3D image registration for use in Endovascular repair of Abdominal Aortic Aneurysms. Ali Raheem 1 ali.raheem@kcl.ac.uk Tom Carrell 2 tom.carrell@gstt.nhs.uk
More informationNonrigid Liver Registration for Image-Guided Surgery using Partial Surface Data: A Novel Iterative Approach
Nonrigid Liver Registration for Image-Guided Surgery using Partial Surface Data: A Novel Iterative Approach D. Caleb Rucker a, Yifei Wu a, Janet E. Ondrake a, Thomas S. Pheiffer a, Amber L. Simpson a,
More informationIs deformable image registration a solved problem?
Is deformable image registration a solved problem? Marcel van Herk On behalf of the imaging group of the RT department of NKI/AVL Amsterdam, the Netherlands DIR 1 Image registration Find translation.deformation
More informationMech. Engineering, Comp. Science, and Rad. Oncology Departments. Schools of Engineering and Medicine, Bio-X Program, Stanford University
Mech. Engineering, Comp. Science, and Rad. Oncology Departments Schools of Engineering and Medicine, Bio-X Program, Stanford University 1 Conflict of Interest Nothing to disclose 2 Imaging During Beam
More informationApplication of level set based method for segmentation of blood vessels in angiography images
Lodz University of Technology Faculty of Electrical, Electronic, Computer and Control Engineering Institute of Electronics PhD Thesis Application of level set based method for segmentation of blood vessels
More informationImage Quality Assessment and Quality Assurance of Advanced Imaging Systems for IGRT. AAPM Penn-Ohio Chapter Sep 25, 2015 Soyoung Lee, PhD
Image Quality Assessment and Quality Assurance of Advanced Imaging Systems for IGRT AAPM Penn-Ohio Chapter Sep 25, 2015 Soyoung Lee, PhD 1 Outline q Introduction q Imaging performances in 4D-CBCT Image
More informationGeometric Modeling and Processing
Geometric Modeling and Processing Tutorial of 3DIM&PVT 2011 (Hangzhou, China) May 16, 2011 4. Geometric Registration 4.1 Rigid Registration Range Scanning: Reconstruction Set of raw scans Reconstructed
More informationThe Insight Toolkit. Image Registration Algorithms & Frameworks
The Insight Toolkit Image Registration Algorithms & Frameworks Registration in ITK Image Registration Framework Multi Resolution Registration Framework Components PDE Based Registration FEM Based Registration
More informationFeasibility study for image guided kidney surgery: assessment of required intraoperative surface for accurate image to physical space registrations
Feasibility study for image guided kidney surgery: assessment of required intraoperative surface for accurate image to physical space registrations Anne B. Benincasa a, Logan W. Clements a, S. Duke Herrell
More informationIntroduction to Digitization Techniques for Surgical Guidance
Introduction to Digitization Techniques for Surgical Guidance Rebekah H. Conley, MS and Logan W. Clements, PhD Department of Biomedical Engineering Biomedical Modeling Laboratory Outline Overview of Tracking
More informationAssessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model
Assessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model Jianhua Yao National Institute of Health Bethesda, MD USA jyao@cc.nih.gov Russell Taylor The Johns
More information2D-3D Registration using Gradient-based MI for Image Guided Surgery Systems
2D-3D Registration using Gradient-based MI for Image Guided Surgery Systems Yeny Yim 1*, Xuanyi Chen 1, Mike Wakid 1, Steve Bielamowicz 2, James Hahn 1 1 Department of Computer Science, The George Washington
More informationCVPR 2014 Visual SLAM Tutorial Kintinuous
CVPR 2014 Visual SLAM Tutorial Kintinuous kaess@cmu.edu The Robotics Institute Carnegie Mellon University Recap: KinectFusion [Newcombe et al., ISMAR 2011] RGB-D camera GPU 3D/color model RGB TSDF (volumetric
More informationOverview of Proposed TG-132 Recommendations
Overview of Proposed TG-132 Recommendations Kristy K Brock, Ph.D., DABR Associate Professor Department of Radiation Oncology, University of Michigan Chair, AAPM TG 132: Image Registration and Fusion Conflict
More informationEndoscopic Reconstruction with Robust Feature Matching
Endoscopic Reconstruction with Robust Feature Matching Students: Xiang Xiang Mentors: Dr. Daniel Mirota, Dr. Gregory Hager and Dr. Russell Taylor Abstract Feature matching based 3D reconstruction is a
More informationLecture 8: Registration
ME 328: Medical Robotics Winter 2019 Lecture 8: Registration Allison Okamura Stanford University Updates Assignment 4 Sign up for teams/ultrasound by noon today at: https://tinyurl.com/me328-uslab Main
More informationAdvances in Forensic Anthropology
Advances in Forensic Anthropology Technology Transition Workshop Improving Forensic Facial Reproduction Using Empirical Modeling During this session, attendees will learn of an approach for forensic facial
More informationData Fusion Virtual Surgery Medical Virtual Reality Team. Endo-Robot. Database Functional. Database
2017 29 6 16 GITI 3D From 3D to 4D imaging Data Fusion Virtual Surgery Medical Virtual Reality Team Morphological Database Functional Database Endo-Robot High Dimensional Database Team Tele-surgery Robotic
More informationLandmark-based 3D Elastic Registration of Pre- and Postoperative Liver CT Data
Landmark-based 3D Elastic Registration of Pre- and Postoperative Liver CT Data An Experimental Comparison Thomas Lange 1, Stefan Wörz 2, Karl Rohr 2, Peter M. Schlag 3 1 Experimental and Clinical Research
More informationInverse Kinematics II and Motion Capture
Mathematical Foundations of Computer Graphics and Vision Inverse Kinematics II and Motion Capture Luca Ballan Institute of Visual Computing Comparison 0 1 A B 2 C 3 Fake exponential map Real exponential
More informationSurgery Simulation and Planning
Surgery Simulation and Planning S. H. Martin Roth Dr. Rolf M. Koch Daniel Bielser Prof. Dr. Markus Gross Facial surgery project in collaboration with Prof. Dr. Dr. H. Sailer, University Hospital Zurich,
More informationNonrigid Registration using Free-Form Deformations
Nonrigid Registration using Free-Form Deformations Hongchang Peng April 20th Paper Presented: Rueckert et al., TMI 1999: Nonrigid registration using freeform deformations: Application to breast MR images
More informationIntroduction. Biomedical Image Analysis. Contents. Prof. Dr. Philippe Cattin. MIAC, University of Basel. Feb 22nd, of
Introduction Prof. Dr. Philippe Cattin MIAC, University of Basel Contents Abstract 1 Varia About Me About these Slides 2 My Research 2.1 Segmentation Segmentation of Facial Soft Tissues Segmentation of
More information3D Slicer Overview. Andras Lasso, PhD PerkLab, Queen s University
3D Slicer Overview Andras Lasso, PhD PerkLab, Queen s University Right tool for the job Technological prototype Research tool Clinical tool Can it be done? Jalopnik.com Innovative, not robust, usually
More informationCoronary Artery Tracking from Dynamic Cardiac CT Sequences
Coronary Artery Tracking from Dynamic Cardiac CT Sequences Dong Ping Zhang a, Ose Pedro a, Kensaku Mori b, Philip Edwards a,c and Daniel Rueckert a a Department of Computing, Imperial College London, UK
More informationRange Image Registration with Edge Detection in Spherical Coordinates
Range Image Registration with Edge Detection in Spherical Coordinates Olcay Sertel 1 and Cem Ünsalan2 Computer Vision Research Laboratory 1 Department of Computer Engineering 2 Department of Electrical
More informationNonrigid Surface Modelling. and Fast Recovery. Department of Computer Science and Engineering. Committee: Prof. Leo J. Jia and Prof. K. H.
Nonrigid Surface Modelling and Fast Recovery Zhu Jianke Supervisor: Prof. Michael R. Lyu Committee: Prof. Leo J. Jia and Prof. K. H. Wong Department of Computer Science and Engineering May 11, 2007 1 2
More informationImage Registration. Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department
Image Registration Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department Introduction Visualize objects inside the human body Advances in CS methods to diagnosis, treatment planning and medical
More informationABSTRACT 1. INTRODUCTION
Image to physical space registration of supine breast MRI for image guided breast surgery Rebekah H. Conley a, Ingrid M. Meszoely b,thomas S. Pheiffer a, Jared A. Weis c, Thomas E. Yankeelov a,c,d,e, Michael
More informationPhysiological Motion Compensation in Minimally Invasive Robotic Surgery Part I
Physiological Motion Compensation in Minimally Invasive Robotic Surgery Part I Tobias Ortmaier Laboratoire de Robotique de Paris 18, route du Panorama - BP 61 92265 Fontenay-aux-Roses Cedex France Tobias.Ortmaier@alumni.tum.de
More informationShape-Based Kidney Detection and Segmentation in Three-Dimensional Abdominal Ultrasound Images
University of Toronto Shape-Based Kidney Detection and Segmentation in Three-Dimensional Abdominal Ultrasound Images Authors: M. Marsousi, K. N. Plataniotis, S. Stergiopoulos Presenter: M. Marsousi, M.
More informationHYBRID MULTISCALE LANDMARK AND DEFORMABLE IMAGE REGISTRATION. Dana Paquin. Doron Levy. Lei Xing. (Communicated by Yang Kuang)
MATHEMATICAL BIOSCIENCES http://www.mbejournal.org/ AND ENGINEERING Volume 4, Number 4, October 2007 pp. 711 737 HYBRID MULTISCALE LANDMARK AND DEFORMABLE IMAGE REGISTRATION Dana Paquin Department of Mathematics,
More information4D Motion Modeling of the Coronary Arteries from CT Images for Robotic Assisted Minimally Invasive Surgery
4D Motion Modeling of the Coronary Arteries from CT Images for Robotic Assisted Minimally Invasive Surgery Dong Ping Zhang 1, Eddie Edwards 1,2, Lin Mei 1,2, Daniel Rueckert 1 1 Department of Computing,
More informationA Method of Automated Landmark Generation for Automated 3D PDM Construction
A Method of Automated Landmark Generation for Automated 3D PDM Construction A. D. Brett and C. J. Taylor Department of Medical Biophysics University of Manchester Manchester M13 9PT, Uk adb@sv1.smb.man.ac.uk
More informationGeneration of Triangle Meshes from Time-of-Flight Data for Surface Registration
Generation of Triangle Meshes from Time-of-Flight Data for Surface Registration Thomas Kilgus, Thiago R. dos Santos, Alexander Seitel, Kwong Yung, Alfred M. Franz, Anja Groch, Ivo Wolf, Hans-Peter Meinzer,
More informationDeformation-based Augmented Reality for Hepatic Surgery
Deformation-based Augmented Reality for Hepatic Surgery Nazim Haouchine, Jérémie Dequidt, Marie-Odile Berger, Stéphane Cotin To cite this version: Nazim Haouchine, Jérémie Dequidt, Marie-Odile Berger,
More informationRapidMind. Accelerating Medical Imaging. May 13, 2009
RapidMind Accelerating Medical Imaging May 13, 2009 Outline Medical imaging software challenges Case studies Elastography, registration, breast cancer screening Platform System overview Detailed example:
More informationNon-rigid Registration of Preprocedural MRI and Intra-procedural CT for CT-guided Cryoablation Therapy of Liver Cancer
NA-MIC Non-rigid Registration of Preprocedural MRI and Intra-procedural CT for CT-guided Cryoablation Therapy of Liver Cancer Atsushi Yamada, Dominik S. Meier and Nobuhiko Hata Brigham and Women s Hospital
More informationInteractive Deformable Registration Visualization and Analysis of 4D Computed Tomography
Interactive Deformable Registration Visualization and Analysis of 4D Computed Tomography Burak Erem 1, Gregory C. Sharp 2, Ziji Wu 2, and David Kaeli 1 1 Department of Electrical and Computer Engineering,
More informationUsing Augmented Measurements to Improve the Convergence of ICP. Jacopo Serafin and Giorgio Grisetti
Jacopo Serafin and Giorgio Grisetti Point Cloud Registration We want to find the rotation and the translation that maximize the overlap between two point clouds Page 2 Point Cloud Registration We want
More informationSigned Distance Function Representation, Tracking, and Mapping. Tanner Schmidt
Signed Distance Function Representation, Tracking, and Mapping Tanner Schmidt Overview - Explicit and implicit surface representations SDF fusion SDF tracking Related research - KinectFusion Patch Volumes
More informationTEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA
TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA Tomoki Hayashi 1, Francois de Sorbier 1 and Hideo Saito 1 1 Graduate School of Science and Technology, Keio University, 3-14-1 Hiyoshi,
More informationA comparison of three methods of ultrasound to computed tomography registration
A comparison of three methods of ultrasound to computed tomography registration by Neilson Mackay A thesis submitted to the School of Computing in conformity with the requirements for the degree of Master
More informationAutomated segmentation methods for liver analysis in oncology applications
University of Szeged Department of Image Processing and Computer Graphics Automated segmentation methods for liver analysis in oncology applications Ph. D. Thesis László Ruskó Thesis Advisor Dr. Antal
More informationComputer Vision/Graphics -- Dr. Chandra Kambhamettu for SIGNEWGRAD 11/24/04
Computer Vision/Graphics -- Dr. Chandra Kambhamettu for SIGNEWGRAD 11/24/04 Computer Vision : Understanding of images Computer Graphics : Creation of images Courses offered: CISC4/640, CISC4/689, CISC849,
More informationGood Morning! Thank you for joining us
Good Morning! Thank you for joining us Deformable Registration, Contour Propagation and Dose Mapping: 101 and 201 Marc Kessler, PhD, FAAPM The University of Michigan Conflict of Interest I receive direct
More information108 6 Automatic 3-D statistical shape model construction aims at automating the landmarking procedure while still relying on the existence of a segmen
For we must not misunderstand ourselves; we are as much automatic as intellectual; and hence it comes that the instrument by which conviction is attained is not demonstrated alone. How few things are demonstrated!
More informationPhantom-based evaluation of a semi-automatic segmentation algorithm for cerebral vascular structures in 3D ultrasound angiography (3D USA)
Phantom-based evaluation of a semi-automatic segmentation algorithm for cerebral vascular structures in 3D ultrasound angiography (3D USA) C. Chalopin¹, K. Krissian², A. Müns 3, F. Arlt 3, J. Meixensberger³,
More informationComputer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks
Computer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks Du-Yih Tsai, Masaru Sekiya and Yongbum Lee Department of Radiological Technology, School of Health Sciences, Faculty of
More information3D Voxel-Based Volumetric Image Registration with Volume-View Guidance
3D Voxel-Based Volumetric Image Registration with Volume-View Guidance Guang Li*, Huchen Xie, Holly Ning, Deborah Citrin, Jacek Copala, Barbara Arora, Norman Coleman, Kevin Camphausen, and Robert Miller
More informationVolumetric Analysis of the Heart from Tagged-MRI. Introduction & Background
Volumetric Analysis of the Heart from Tagged-MRI Dimitris Metaxas Center for Computational Biomedicine, Imaging and Modeling (CBIM) Rutgers University, New Brunswick, NJ Collaboration with Dr. Leon Axel,
More informationLecture 6: Medical imaging and image-guided interventions
ME 328: Medical Robotics Winter 2019 Lecture 6: Medical imaging and image-guided interventions Allison Okamura Stanford University Updates Assignment 3 Due this Thursday, Jan. 31 Note that this assignment
More informationImage Overlay Support with 3DCG Organ Model for Robot-Assisted Laparoscopic Partial Nephrectomy
Image Overlay Support with 3DCG Organ Model for Robot-Assisted Laparoscopic Partial Nephrectomy Masanao KOEDA 1, Kiminori MIZUSHINO 2, Katsuhiko ONISHI 3, Hiroshi NOBORIO 1, Takahiro KUNII 3, Masatoshi
More informationUser-assisted Segmentation and 3D Motion Tracking. Michael Fleder Sudeep Pillai Jeremy Scott
User-assisted Segmentation and 3D Motion Tracking Michael Fleder Sudeep Pillai Jeremy Scott 3D Object Tracking Virtual reality and animation Imitation in robotics Autonomous driving Augmented reality Motivation
More informationAtlas-Based Segmentation of Abdominal Organs in 3D Ultrasound, and its Application in Automated Kidney Segmentation
University of Toronto Atlas-Based Segmentation of Abdominal Organs in 3D Ultrasound, and its Application in Automated Kidney Segmentation Authors: M. Marsousi, K. N. Plataniotis, S. Stergiopoulos Presenter:
More informationMonocular Tracking and Reconstruction in Non-Rigid Environments
Monocular Tracking and Reconstruction in Non-Rigid Environments Kick-Off Presentation, M.Sc. Thesis Supervisors: Federico Tombari, Ph.D; Benjamin Busam, M.Sc. Patrick Ruhkamp 13.01.2017 Introduction Motivation:
More informationComputed Photography - Final Project Endoscope Exploration on Knee Surface
15-862 Computed Photography - Final Project Endoscope Exploration on Knee Surface Chenyu Wu Robotics Institute, Nov. 2005 Abstract Endoscope is widely used in the minimally invasive surgery. However the
More informationScene-Based Segmentation of Multiple Muscles from MRI in MITK
Scene-Based Segmentation of Multiple Muscles from MRI in MITK Yan Geng 1, Sebastian Ullrich 2, Oliver Grottke 3, Rolf Rossaint 3, Torsten Kuhlen 2, Thomas M. Deserno 1 1 Department of Medical Informatics,
More informationThe Effect of Segmentation Method on the Performance of Point Based Registration of Intra-Ultrasound with Pre-MR Images
The Effect of Segmentation Method on the Performance of Point Based Registration of Intra-Ultrasound with Pre-MR Images P.Farnia, A. Ahmadian,*, A. Khoshnevisan Tehran University of Medical Sciences, Biomedical
More informationA model-based approach for tool tracking in laparoscopy
A model-based approach for tool tracking in laparoscopy Potential applications and evaluation challenges Sandrine Voros (INSERM), TIMC-IMAG laboratory Computer Assisted Medical Interventions (CAMI) team
More informationAdvanced Targeting Using Image Deformation. Justin Keister, MS DABR Aurora Health Care Kenosha, WI
Advanced Targeting Using Image Deformation Justin Keister, MS DABR Aurora Health Care Kenosha, WI History of Targeting The advance of IMRT and CT simulation has changed how targets are identified in radiation
More informationIterative Closest Point Algorithm in the Presence of Anisotropic Noise
Iterative Closest Point Algorithm in the Presence of Anisotropic Noise L. Maier-Hein, T. R. dos Santos, A. M. Franz, H.-P. Meinzer German Cancer Research Center, Div. of Medical and Biological Informatics
More informationPHOTOGRAMMETRIC TECHNIQUE FOR TEETH OCCLUSION ANALYSIS IN DENTISTRY
PHOTOGRAMMETRIC TECHNIQUE FOR TEETH OCCLUSION ANALYSIS IN DENTISTRY V. A. Knyaz a, *, S. Yu. Zheltov a, a State Research Institute of Aviation System (GosNIIAS), 539 Moscow, Russia (knyaz,zhl)@gosniias.ru
More informationUltrasound Based Navigation and Control for Orthopaedic Robot Surgery. Pedro Miguel Baptista Torres. Curso de Doutoramento em Engª.
Ultrasound Based Navigation and Control for Orthopaedic Robot Surgery Pedro Miguel Baptista Torres Curso de Doutoramento em Engª. Mecânica Seminário PhD Universidade de Lisboa - Instituto Superior Técnico
More informationTrackerless Surgical Image-guided System Design Using an Interactive Extension of 3D Slicer
Trackerless Surgical Image-guided System Design Using an Interactive Extension of 3D Slicer Xiaochen Yang 1, Rohan Vijayan 2, Ma Luo 2, Logan W. Clements 2,5, Reid C. Thompson 3,5, Benoit M. Dawant 1,2,4,5,
More informationA 3D-Elastography-Guided System for Laparoscopic Partial Nephrectomies
A 3D-Elastography-Guided System for Laparoscopic Partial Nephrectomies Philipp J Stolka*(1), Matthias Keil(2), Georgios Sakas(2), Eliott McVeigh(1), Mohamad E Allaf (3), Russell H Taylor(1), Emad M Boctor(3)
More informationA New Approach to Ultrasound Guided Radio-Frequency Needle Placement
A New Approach to Ultrasound Guided Radio-Frequency Needle Placement Claudio Alcérreca 1,2, Jakob Vogel 2, Marco Feuerstein 2, and Nassir Navab 2 1 Image Analysis and Visualization Lab., CCADET UNAM, 04510
More informationDynamic Geometry Processing
Dynamic Geometry Processing EG 2012 Tutorial Will Chang, Hao Li, Niloy Mitra, Mark Pauly, Michael Wand Tutorial: Dynamic Geometry Processing 1 Articulated Global Registration Introduction and Overview
More informationUSING AUGMENTED REALITY FOR REAL-TIME VISUALIZATION OF TACTILE HEALTH EXAMINATION
USING AUGMENTED REALITY FOR REAL-TIME VISUALIZATION OF TACTILE HEALTH EXAMINATION Gennadiy Nikishkov and Tomokazu Tsuchimoto University of Aizu, Aizu-Wakamatsu 965-8580, Japan niki@u-aizu.ac.jp, m5091110@u-aizu.ac.jp
More informationImplementation of Advanced Image Guided Radiation Therapy
Image Acquisition Course Outline Principles, characteristics& applications of the available modalities Image Processing in the T x room Image guided treatment delivery What can / can t we do in the room
More informationImage Co-Registration II: TG132 Quality Assurance for Image Registration. Image Co-Registration II: TG132 Quality Assurance for Image Registration
Image Co-Registration II: TG132 Quality Assurance for Image Registration Preliminary Recommendations from TG 132* Kristy Brock, Sasa Mutic, Todd McNutt, Hua Li, and Marc Kessler *Recommendations are NOT
More informationAtlas Based Segmentation of the prostate in MR images
Atlas Based Segmentation of the prostate in MR images Albert Gubern-Merida and Robert Marti Universitat de Girona, Computer Vision and Robotics Group, Girona, Spain {agubern,marly}@eia.udg.edu Abstract.
More informationA Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images
A Multiple-Layer Flexible Mesh Template Matching Method for Nonrigid Registration between a Pelvis Model and CT Images Jianhua Yao 1, Russell Taylor 2 1. Diagnostic Radiology Department, Clinical Center,
More informationScanning Real World Objects without Worries 3D Reconstruction
Scanning Real World Objects without Worries 3D Reconstruction 1. Overview Feng Li 308262 Kuan Tian 308263 This document is written for the 3D reconstruction part in the course Scanning real world objects
More informationUniversities of Leeds, Sheffield and York
promoting access to White Rose research papers Universities of Leeds, Sheffield and York http://eprints.whiterose.ac.uk/ This is an author produced version of a paper published in Lecture Notes in Computer
More informationToward a generic real-time compression correction framework for tracked ultrasound
DOI 10.1007/s11548-015-1210-5 ORIGINAL ARTICLE Toward a generic real-time compression correction framework for tracked ultrasound Thomas S. Pheiffer 1,2 Michael I. Miga 1,3,4 Received: 19 December 2014
More informationReal-time self-calibration of a tracked augmented reality display
Real-time self-calibration of a tracked augmented reality display Zachary Baum, Andras Lasso, Tamas Ungi, Gabor Fichtinger Laboratory for Percutaneous Surgery, Queen s University, Kingston, Canada ABSTRACT
More information