Navigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images

Similar documents
3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery

Data Fusion Virtual Surgery Medical Virtual Reality Team. Endo-Robot. Database Functional. Database

Sensor-aided Milling with a Surgical Robot System

Assessing 3D tunnel position in ACL reconstruction using a novel single image 3D-2D registration

Augmented Reality System for Oral Surgery Using 3D Auto Stereoscopic Visualization

Intraoperative Fast 3D Shape Recovery of Abdominal Organs in Laparoscopy

Tracked surgical drill calibration

On the Design and Experiments of a Fluoro-Robotic Navigation System for Closed Intramedullary Nailing of Femur

An Iterative Framework for Improving the Accuracy of Intraoperative Intensity-Based 2D/3D Registration for Image-Guided Orthopedic Surgery

Fully Automatic Endoscope Calibration for Intraoperative Use

CT Protocol Clinical Graphics Move Forward 3D motion analysis service

CHomework Assignment /655 Fall 2017 (Circle One)

Endoscopic Reconstruction with Robust Feature Matching

Image Thickness Correction for Navigation with 3D Intra-cardiac Ultrasound Catheter

2D-3D Registration using Gradient-based MI for Image Guided Surgery Systems

Orthopedic Devices The Future is Powered by Embedded Technology Axiomtek Co. Ltd., All Rights Reserved.

An Improved Tracking Technique for Assessment of High Resolution Dynamic Radiography Kinematics

A Novel Laser Guidance System for Alignment of Linear Surgical Tools: Its Principles and Performance Evaluation as a Man Machine System

SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab

Assessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model

Computed Photography - Final Project Endoscope Exploration on Knee Surface

Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization

Bone registration with 3D CT and ultrasound data sets

Intramedullary Nail Distal Hole Axis Estimation using Blob Analysis and Hough Transform

Towards Projector-based Visualization for Computer-assisted CABG at the Open Heart

A model-based approach for tool tracking in laparoscopy

Computed tomography (Item No.: P )

Intraoperative Prostate Tracking with Slice-to-Volume Registration in MR

The Implant of Choice for Extracortical, Soft Tissue Fixation in Cruciate Reconstructions.

Robot Calibration for Precise Ultrasound Image Acquisition

Virtual Endoscopy: Modeling the Navigation in 3D Brain Volumes

Computer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks

A New Method for CT to Fluoroscope Registration Based on Unscented Kalman Filter

Medical Images Analysis and Processing

Lecture 6: Medical imaging and image-guided interventions

Response to Reviewers

ToF/RGB Sensor Fusion for Augmented 3-D Endoscopy using a Fully Automatic Calibration Scheme

New 4-D Imaging for Real-Time Intraoperative MRI: Adaptive 4-D Scan

On the Accuracy of a Video-Based Drill-Guidance Solution for Orthopedic and Trauma Surgery: Preliminary Results

FOREWORD TO THE SPECIAL ISSUE ON MOTION DETECTION AND COMPENSATION

Non-rigid 2D-3D image registration for use in Endovascular repair of Abdominal Aortic Aneurysms.

Calibration Method for Determining the Physical Location of the Ultrasound Image Plane

Optimum Robot Control for 3D Virtual Fixture in Constrained ENT Surgery

A Navigation System for Minimally Invasive Abdominal Intervention Surgery Robot

AUTOMATIC DETECTION OF ENDOSCOPE IN INTRAOPERATIVE CT IMAGE: APPLICATION TO AUGMENTED REALITY GUIDANCE IN LAPAROSCOPIC SURGERY

3D Corner Detection from Room Environment Using the Handy Video Camera

Iterative Estimation of 3D Transformations for Object Alignment

Robot Control for Medical Applications and Hair Transplantation

A Study of Medical Image Analysis System

Real-time self-calibration of a tracked augmented reality display

2D Rigid Registration of MR Scans using the 1d Binary Projections

2 Michael E. Leventon and Sarah F. F. Gibson a b c d Fig. 1. (a, b) Two MR scans of a person's knee. Both images have high resolution in-plane, but ha

3D VISUALIZATION OF SEGMENTED CRUCIATE LIGAMENTS 1. INTRODUCTION

MODELLING OF PROSTHETIC HIP JOINT GENERATED FROM CT SCAN DATA Mahender Koduri 1, G Krishna Teja 2, O Rajender 3 1,2,3

Endoscopic Navigation for Minimally Invasive Suturing

Fluoroscopic X-ray image guidance for manual and robotic orthopedic surgery. Thesis submitted for the degree of Doctor of Philosophy by Ziv R.

Design and Implementation of a Laparoscope Calibration Method for Augmented Reality Navigation

4D Shape Registration for Dynamic Electrophysiological Cardiac Mapping

A SYSTEM FOR COMPUTER-ASSISTED SURGERY WITH INTRAOPERATIVE CT IMAGING

DESIGN AND MANUFACTURING OF CUSTOMIZED ANATOMICAL IMPLANTS BY USING RAPID PROTOTYPING TECHNIQUE

3D Ultrasound Reconstruction By The 3 Cons: Michael Golden Khayriyyah Munir Omid Nasser Bigdeli

Development of 3D Model-based Morphometric Method for Assessment of Human Weight-bearing Joint. Taeho Kim

MORPHOLOGY ANALYSIS OF HUMAN KNEE USING MR IMAGERY

Recovery of 3D Pose of Bones in Single 2D X-ray Images

Segmentation and Modeling of the Spinal Cord for Reality-based Surgical Simulator

An Integrated Investigation of CAD/CAM for the Development of Custom-made Femoral Stem

Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences

AUTOMATED AND COMPUTATIONALLY EFFICIENT JOINT MOTION ANALYSIS USING LOW QUALITY FLUOROSCOPY IMAGES

A Multi-view Active Contour Method for Bone Cement Reconstruction from C-Arm X-Ray Images

Compact Forceps Manipulator Using Friction Wheel Mechanism and Gimbals Mechanism for Laparoscopic Surgery

Gradient-Based Differential Approach for Patient Motion Compensation in 2D/3D Overlay

Ray tracing based fast refraction method for an object seen through a cylindrical glass

Geometric Hand-Eye Calibration for an Endoscopic Neurosurgery System

Computed tomography of simple objects. Related topics. Principle. Equipment TEP Beam hardening, artefacts, and algorithms

Segmentation of Bony Structures with Ligament Attachment Sites

Precise Evaluation of Positioning Repeatability of MR-Compatible Manipulator Inside MRI

An Accuracy Approach to Robotic Microsurgery in the Ear

3D RECONSTRUCTION AND VISUALIZATION OF FEMUR BONE STRUCTURES

Towards deformable registration for augmented reality in robotic assisted partial nephrectomy

Shape Modeling of A String And Recognition Using Distance Sensor

Medical Image Registration by Maximization of Mutual Information

Optimal Planning of Robotically Assisted Heart Surgery: Transfer Precision in the Operating Room

Calculating the Distance Map for Binary Sampled Data

"In Vivo" Pose Estimation of Artificial Knee Implants Using Computer Vision

Generation of Hulls Encompassing Neuronal Pathways Based on Tetrahedralization and 3D Alpha Shapes

Ultrasound Probe Tracking for Real-Time Ultrasound/MRI Overlay and Visualization of Brain Shift

FEMORAL STEM SHAPE DESIGN OF ARTIFICIAL HIP JOINT USING A VOXEL BASED FINITE ELEMENT METHOD

Real-Time Data Acquisition for Cardiovascular Research

Geometric Feature Extraction for Precise Measurements in Intramedullary Nail images

Kinematic Analysis of Lumbar Spine Undergoing Extension and Dynamic Neural Foramina Cross Section Measurement

Physiological Motion Compensation in Minimally Invasive Robotic Surgery Part I

Robot-assisted MRI-guided prostate biopsy using 3D Slicer

Coordinate Transformations, Tracking, Camera and Tool Calibration

Wide area tracking method for augmented reality supporting nuclear power plant maintenance work

3D Guide Wire Navigation from Single Plane Fluoroscopic Images in Abdominal Catheterizations

3D/4D Ultrasound Registration of Bone

Digital Volume Correlation for Materials Characterization

Creating a Vision Channel for Observing Deep-Seated Anatomy in Medical Augmented Reality

Research on Laser Positioning Technology of CMOS Triangulation for Precision Surgery

ANATOMIA Tutorial. Fig. 1 Obtaining CT scan data

Transcription:

Navigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images Mamoru Kuga a*, Kazunori Yasuda b, Nobuhiko Hata a, Takeyoshi Dohi a a Graduate School of Information Science, The Univ of Tokyo b Dept of Medical Bioengineering and Sports Medicine, Hokkaido Univ Abstract. A high-precision navigation system for Anterior Cruciate Ligament(ACL) reconstruction surgery is presented. In this system, 3D CT data is used to visualize the structure of bones and optical localizer is used to detect the position of femur, tibia and surgical tools. Since CT images are acquired preoperatively and markers are fixed to bones intraoperatively, their relative position has to be initialized. To achieve this initialization, 2D/3D registration method between CT model and X-ray images was developed. The registration is performed by minimizing the difference between contour lines. As ACL reconstruction requires precision, three X-ray images taken from different viewpoints are used for the registration. Experimental registration shows the Fiducial Registration Error(FRE) error to be 1.2mm. Keywords: image-guided surgery; navigation; 2D/3D registration; X-ray fluoroscopy; CT image 1. Introduction Anterior Cruciate Ligament (ACL) reconstruction is performed for a person whose ACL is damaged and causes knee instability, pain and recurrent swelling. In this surgery, surgeon makes tunnels on femur and tibia, fixing ACL graft to them. The positional precision of the graft insertion tunnel is important (less than 1mm is required), since it directly contribute to the patient's rehabilitation after the surgery [1]. However, for minimally invasive surgery, this surgery is commonly performed under endoscope, which requires expert skills for surgeons to grasp the internal structure of knee joint. Although X-ray fluoroscopy can be used to assist surgeons intraoperatively, limited number of images due to radiational exposure and restriction to 2D images are the problems. Therefore, the objective of this study is to develop a navigation system which can display the real-time positions of femur, tibia and surgical tool in 3D view. * Corresponding author. E-mail address: mkuga@atre.t.u-tokyo.ac.jp (M.Kuga).

The clinical significance of this paper is that the navigation system can achieve accurate and designed positioning of the graft insertion tunnel thus enabling the best possible surgical outcome. The engineering contribution of this paper is that, to the authors' best knowledge, this is the first proposal to integrate navigation and 2D/3D registration in ACL reconstruction surgery. The navigation system utilizes CT data set for obtaining 3D models preoperatively and optical localizer for tracking bones. Since CT images are acquired preoperatively and optical markers are fixed to bones intraoperatively, their relative position has to be initialized. For this initialization, registration based on Iterative Closest Point algorithm [2], 2D/3D registration with endoscopic image [3] or X-ray image, are the candidate methods. We selected to use X-ray image based 2D/3D registration, because of its high resolution and accessibility of images from various viewpoint. 2. Method In this navigation system, 3D CT data set is used to visualize the structure of bones and optical marker (POLARIS, NDI) is used to detect the position of femur, tibia and surgical tools. We used 3D Slicer [4] for displaying these bones and tools on computer screen. For initializing the relative position between the marker and bone, 2D/3D registration method between CT model and X-ray images was developed. In the registration, we used similarity measure which sum up the length of perpendicular lines between contour lines in X-ray image and 2D image of CT model because of the highcontrast nature of X-ray image [5]. Simplex method was used in the optimization procedure. The optical markers has to be detected also in X-ray images. We designed the marker to be observed as a set of eight disconnected spots in X-ray images by creating it from a combination of resin (PEEK) and metal (brass); Fig.1 shows a photo of the marker. The positions of these spots are sensitive along any rotational movement, which enables us to calculate accurate position and orientation of the marker in each image. A Fig. 1. A: Photo of designed marker both for registration and localization, B: same marker in X-ray image. Since ACL reconstruction requires precision, three X-ray images taken from different viewpoint (front, side and top) are used in the registration. We used three images B

because a registration only with a single image causes low-sensitive similarity measure along some axes such as depth variation. Considering the difficulty in accurate positioning of X-ray camera and collision between X-ray camera and other devices, we designed the registration algorithm so that these three images need not be taken from exact perpendicular view directions. Relative positions of these X-ray images are computed from markers in X-ray image. Using the markers in each image, registration takes following procedures: 1. Perform registration in front image from marker to X-ray image and from bone to X-ray image (Fig.2 A). 2. In top image, perform registration from marker to X-ray image and place the bone according to the result of procedure 1 (Fig.2 B). 3. Also in top image, optimize the position along depth variation of first image and the orientation whose similarity measure is sensitive in side image. Front-view coordinates is used in this optimisation. By doing so, this procedure does not affect the registration result in the front image (Fig.2 C). 4. Repeat procedure 2. and 3. in top image. This time, the optimization is performed only around one axis (Fig.2 D). A B C Fig. 2. Multi-viewpoint registration method. Black arrow refers to the registration along all six axes and white arrow along one axis. 3. Experimental Results D

Experimental registrations with a sheep's femur and tibia were conducted. We reconstructed 3D models of these bones from CT slice data with a thickness of 0.6 mm, image resolution of 512x512. After fixing the marker to the tibia with 3mm diameter fixation screw, we took sets of three X-ray images from roughly perpendicular view direction considering the limitation of camera viewpoint in surgery. 3D model of the marker from CAD data and bone models were superimposed to X-ray images in these three different views as shown in Fig.3. Whole registration process was automatic except for the setting of approximate initial positions. Using 512x512 X-ray images, registration was performed in less than two minutes with standard PC (Intel Pentium4 2.6GHz, main memory 512MB). We measured the registration errors as Fiducial Registration Error (FRE, the root mean distance between corresponding points) and it was 1.2mm, regardless of view direction. A B C D E F Fig. 3. X-ray images taken from three different viewpoint (A, B, C) and the 3D models of tibia and marker superimposed on each X-ray image (D, E, F). 4. Discussion As a result of multi-viewpoint X-ray registration method, high precision registration was achieved and there was no variation in error between X-ray images and 3D models according to the view direction. Due to the simple and round shape of femur and tibia, the third image also contributed to the precision. No improvement in precision was observed even when we used more than three X-ray images, because with three images, similarity measure is sharp and sensitive enough along all six axes. In terms of usability, semi-automatic process of this registration can be performed without professional skill. Although the manual setting of approximate initial position

was required currently, we can omit this process by taking the X-ray images from roughly the same viewpoints each time. Also, the position of camera in three images does not need to be measured, enabling operators to take X-ray images easily. After acquiring the position and orientation of femur, tibia and surgical tool, this information can be used not only for displaying internal structure to surgeons but also for robot control. For future work, we are planning to develop drilling robot based on this navigation system for making accurate ACL graft tunnels. The navigation system together with this drilling robot, error variation of insertion tunnel will be minimized and surgeons will be able to expect successful surgical outcome regardless of their skills. Since we are aiming the overall system error (including robot and navigation error) to be less than 1mm, the 1.2mm error only with registration is not small enough. In order to achieve higher precision, 1) accurate modeling of X-ray camera parameters such as focal length and view angle, 2) registration with higher resolution images by using pixel interpolation, are necessary. Also as a future task, we have to determine the optimal position and size of the optical marker since there is a tradeoff between precision and workspace: while higher precision can be expected as the marker is larger and closer to graft insertion point, the workspace for surgeon becomes smaller. In conclusion, we have proposed a high-precision registration algorithm for ACL reconstruction navigation using multi-view point X-ray images and confirmed the accuracy to be 1.2mm with experiments. References [1] K.Yasuda, J.Tsujino, Y.Tanabe, K.Kaneda, Effects of initial graft tension on clinical outcome after anterior cruciate ligament reconstruction, American Journal of Sports Medicine, vol.25, No.1, pp.99-106, 1997. [2] P.J.Besel, N.D.McKay, A method for registration of 3-D shapes, IEEE Trans. Pattern Anal. Machine Intell, vol.14, pp.239-256, 1992. [3] H. Fuchs, et al., Augmented reality visualization for laparoscopic surgery, MICCAI 98, pp.934-943, 1998. [4] D. Gering, A. Nabavi, R. Kikinis, N. Hata, L. Odonnell, W. Eric L. et al., An integrated visualization system for surgical planning and guidance using image fusion and an open MR, Journal of Magnetic Resonance Imaging, vol. 13, pp. 967-975, June, 2001. [5] A.Liu, E.Bullitt, S.M.Pizer, 3D/2D registration via skeletal near projective invariance in tubular objects, MICCAI 98 pp.952-963, 1998.