Sensor-aided Milling with a Surgical Robot System

Similar documents
Increasing the accuracy with a rich sensor system for robotic laser osteotomy

Navigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images

Interactive Simulation of Teeth Cleaning

An Accuracy Approach to Robotic Microsurgery in the Ear

Data Fusion Virtual Surgery Medical Virtual Reality Team. Endo-Robot. Database Functional. Database

Advanced Visual Medicine: Techniques for Visual Exploration & Analysis

Tracked surgical drill calibration

Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization

The Role of DICOM for Modular Perioperative Surgical Assist Systems Design

3D Ultrasound Reconstruction By The 3 Cons: Michael Golden Khayriyyah Munir Omid Nasser Bigdeli

Registration concepts for the just-in-time artefact correction by means of virtual computed tomography

Medical Robotics. Control Modalities

Intramedullary Nail Distal Hole Axis Estimation using Blob Analysis and Hough Transform

SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab

Guidelines for proper use of Plate elements

Fluoroscopy-Based X-Ray Navigation in Orthopedics Using Electromagnetic Tracking: A Practical Study

Elastic registration of medical images using finite element meshes

Advanced Computed Tomography System for the Inspection of Large Aluminium Car Bodies

3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery

Positioning and Synchronization of Industrial Robots

Intraoperative Prostate Tracking with Slice-to-Volume Registration in MR

AUTOMATIC DETECTION OF ENDOSCOPE IN INTRAOPERATIVE CT IMAGE: APPLICATION TO AUGMENTED REALITY GUIDANCE IN LAPAROSCOPIC SURGERY

Robot Control for Medical Applications and Hair Transplantation

A SYSTEM FOR COMPUTER-ASSISTED SURGERY WITH INTRAOPERATIVE CT IMAGING

Lecture 8: Registration

Fully Automatic Endoscope Calibration for Intraoperative Use

CHomework Assignment /655 Fall 2017 (Circle One)

Ultrasound Probe Tracking for Real-Time Ultrasound/MRI Overlay and Visualization of Brain Shift

Virtual Interaction System Based on Optical Capture

A Miniature Instrument Tip Force Sensor for Robot/Human Cooperative Microsurgical Manipulation with Enhanced Force Feedback

Surgery Simulation and Planning

Accuracy Validation in Image-Guided Orthopaedic Surgery

Calibration Method for Determining the Physical Location of the Ultrasound Image Plane

An approach to calculate and visualize intraoperative scattered radiation exposure

ALL SINGULARITIES OF THE 9-DOF DLR MEDICAL ROBOT SETUP FOR MINIMALLY INVASIVE APPLICATIONS

ULTRASONOGRAPHY is an appealing technology to

A Study of Medical Image Analysis System

A Novel 3D Camera Based Supervision System for Safe Human-Robot Interaction in the Operating Room

Time-of-flight-assisted Kinect camera-based people detection for intuitive human robot cooperation in the surgical operating room

Fluoroscopic X-ray image guidance for manual and robotic orthopedic surgery. Thesis submitted for the degree of Doctor of Philosophy by Ziv R.

On the Design and Experiments of a Fluoro-Robotic Navigation System for Closed Intramedullary Nailing of Femur

Comparison of Probing Error in Dimensional Measurement by Means of 3D Computed Tomography with Circular and Helical Sampling

A Navigation System for Minimally Invasive Abdominal Intervention Surgery Robot

SUBDIVISION ALGORITHMS FOR MOTION DESIGN BASED ON HOMOLOGOUS POINTS

Assessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model

Scaling Calibration in the ATRACT Algorithm

INTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1. Modifications for P551 Fall 2013 Medical Physics Laboratory

Vectric Cut 3D (Frogmill)

Endoscopic Reconstruction with Robust Feature Matching

3D-2D Laser Range Finder calibration using a conic based geometry shape

Real-time self-calibration of a tracked augmented reality display

Intelligent Cutting of the Bird Shoulder Joint

Abstract. Introduction

Robot Calibration for Precise Ultrasound Image Acquisition

Improving Vision-Based Distance Measurements using Reference Objects

Reduction of Metal Artifacts in Computed Tomographies for the Planning and Simulation of Radiation Therapy

ABSTRACT 1. INTRODUCTION

3D Point Cloud Processing

3D RECONSTRUCTION AND VISUALIZATION OF FEMUR BONE STRUCTURES

Measurement of Head-to-Trunk Orientation Using Handheld 3D Optical Apparatus

Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences

Introduction to Digitization Techniques for Surgical Guidance

LEAD LOCALIZATION. Version 1.0. Software User Guide Revision 1.1. Copyright 2018, Brainlab AG Germany. All rights reserved.

SIMULATION OF CARBON-ROVING-STRUCTURES EXTREME LIGHT AND STRONG BY FILAMENT WOUND REINFORCEMENT

User Guide. Customized Patient Instrumentation Web Based Surgical Planning and Tracking Software Guide

Depth Camera Calibration and Knife Tip Position Estimation for Liver Surgery Support System

Design and Implementation of a Laparoscope Calibration Method for Augmented Reality Navigation

The team. Disclosures. Ultrasound Guidance During Radiation Delivery: Confronting the Treatment Interference Challenge.

2D Rigid Registration of MR Scans using the 1d Binary Projections

Optimal Planning of Robotically Assisted Heart Surgery: Transfer Precision in the Operating Room

Precise Ultrasound Bone Registration with Learning-based Segmentation and Speed of Sound Calibration

Calibration and setup of a tool probe

Unit #13 : Integration to Find Areas and Volumes, Volumes of Revolution

TOLERANCE ALLOCATION IN FLEXIBLE ASSEMBLIES: A PRACTICAL CASE

Developing Algorithms for Robotics and Autonomous Systems

Measurements using three-dimensional product imaging

Catalog Numbers: CMB022, CMB022-AA, CMB022-UP, CMB033, CMB033-AA, CMB033-UP, CMB-CW, CMB-LK

DELTA TAU Data Systems, Inc.

Manipulator Path Control : Path Planning, Dynamic Trajectory and Control Analysis

Bone registration with 3D CT and ultrasound data sets

Trajectory Planning of Redundant Planar Mechanisms for Reducing Task Completion Duration

BENEFITS OF JMT PRESS BRAKES

Imaging protocols for navigated procedures

TopMill TopTurn. Jobshop Programming & Simulation for Multi-Side & Complete Mill-Turn Machining for every CNC Control

Design of an open hardware architecture for the humanoid robot ARMAR

Computed tomography (Item No.: P )

Frequency split metal artifact reduction (FSMAR) in computed tomography

Suitability of a new alignment correction method for industrial CT

Calibration and setup of part probe

4D Shape Registration for Dynamic Electrophysiological Cardiac Mapping

A Haptic VR Milling Surgery Simulator Using High-Resolution CT-Data.

Robotics kinematics and Dynamics


Introducing Computer-Assisted Surgery into combined PET/CT image based Biopsy

Towards Projector-based Visualization for Computer-assisted CABG at the Open Heart

Incorporating Target Registration Error Into Robotic Bone Milling

SUPPORTING LINEAR MOTION: A COMPLETE GUIDE TO IMPLEMENTING DYNAMIC LOAD SUPPORT FOR LINEAR MOTION SYSTEMS

Reconstructing Images of Bar Codes for Construction Site Object Recognition 1

Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System

Scale-Invariant Registration of Monocular Endoscopic Images to CT-Scans for Sinus Surgery

Transcription:

1 Sensor-aided Milling with a Surgical Robot System Dirk Engel, Joerg Raczkowsky, Heinz Woern Institute for Process Control and Robotics (IPR), Universität Karlsruhe (TH) Engler-Bunte-Ring 8, 76131 Karlsruhe dengel@ira.uka.de, rkowsky@ira.uka.de, woern@ira.uka.de Abstract In this paper sources of errors are pointed out that occur using a robot system in order to cut bones. It is shown that the deflection of the robot tool must not be neglected if an accuracy in the range of one millimeter (from planning to execution) is required, since the tool deflection is up to 1.5 millimeters depending on the affecting torques. Therefore, special focus is set on methods which cope with this problem. A calibration approach considering the deflection of the robot tool is presented. After this calibration, it is possible to consider the tool deflection during the registration procedure (ball-in-cone strategy) as well as during the intervention. Furthermore, a discrete feed control algorithm is outlined. Keywords: robot-assisted surgery, sensor control 1. Introduction The main purposes of a surgical robot system are on the one hand the support for the surgeon and on the other hand the improvement of the surgical result. Thereby, the safety of the patient, the surgeon, and the medical staff are presumed [1, 2]. Unlike the surgeon, the robot controller has direct access to the planning data. Further, the robot arm provides high repeat accuracy and high precision independent of the progress of operation time. Hence, the greatest benefit of a robot system in the operating theater is the gain in quality. The presented methods and implementations are part of the surgical robot system RobaCKa for craniofacial surgery, which has been developed at our institute. The robot assistance in craniofacial surgery is reasonable because of the vicinity to vital parts and the great impact of bone repositionings at the human skull to the later appearance of the patient. In the following sections, sources of errors, which have to be considered developing an accurate surgical robot system as well as our methods of solution are discussed. For the measurement of process data and for system surveillance the robot system is equipped with several sensors (Fig. 1). The robot tool consists of: pneumatic collision protection (CP), force-/torque sensor (FTS), rigid body equipped with infrared LEDs to be tracked by an optical navigation system, and surgical milling cutter. The CP is a fail safe electrical/mechanical system without any data measurement. Additionally, the FTS acquires the exact forces and torques which are transmitted to a sensor data processing computer. This serial arrangement, CP followed by FTS, and the resulting elasticity are the main sources of the occurring tool deflection. A CP with a trigger sensibility of 0.2

2 causes an excursion of up to 1 mm at the tool tip (given tool length 300 mm), for example. Since the patient position is determined during the registration procedure using the robot as measuring device, the deflection error impairs not only the quality of the trajectory execution, but also the quality of registration. Fig.1: RobaCKa system set-up, robot and sensors 2. Determination of tool deflection The determination of the tool deflection is performed at the same time when the physical tool dimension is calibrated. In order to compute the tool length, the robot has to be guided above a calibration body (e.g. a metal cube), from where the robot moves down until a contact state was reached. This procedure is conducted in three steps: 1. Tool is in perpendicular configuration 2. Tool is -45 angled around x-axis 3. Tool is +45 angled around x-axis The tool length can be computed as: l = ( + ) h h = h90 05. h 45 + h. h is + 45 the difference of height in the different contact states, measured along the robot z-axis (Fig. 2, left). The moment of contact of the perpendicular configuration is detected by the increase of the total force. To avoid a bending of the tool in the angled configurations the contact state is assumed when the torque around the x-axis is equal zero, T x = 0. 2 2, ( ) For the calibration of the tool tip offset along the x- and y-axis, the robot tool is guided to the left side of the calibration body (Fig. 2, right). In the following, the robot moves its tool to contact the calibration body with the tip, detaches after contact and turns its tool 90 around the z-axis. This procedure is repeated four times until the calibration body was contacted in positive and negative x-/y-direction. Afterwards, the physical tool dimension is known. For the determination of the tool deflection d x and d y, the robot continues moving its tool after a detected x-/y-contact in the same direction until a previously adjusted maximal torque is reached. In this way, to each measured torque a corresponding deflection can be assigned. The change of the tool length d z can be neglected because of d x,y << l. Fig. 3 depicts the correlation of the measured torques T x,y and the corresponding

3 tool deflection d y,x. The graph shows also that the correlation can be linear approximated by d x = c xy T y and d y = c yx T x (c xy, c yx : constant factors). Fig.2: Calibration of tool dimension and simultaneous determination of tool deflection. First step: calculation of tool length (left). Second step: determination of x-/y-offset and tool deflection (right) Fig. 3: Correlation of affecting torque and tool deflection. The correlation can be linear approximated by d x = c y T y and d y = c x T x (c x,y : constant factors) 3. Registration The role of registration is to establish the spatial relationship (via a transformation matrix) registration) between the planning data and the real patient [3]. Therefore, four titanium screws are implanted preopratively into the patient skull before the CT scans are taken. The positions of these four fiducial landmarks are preoperatively determined in the 3Dpatient-model based on CT slices; and also intraoperatively by guiding the robot tool to the screw positions (ball-in-cone strategy) [4]. The calculation of the transformation matrix is done by Least-Squares Fitting [5]. After the registration, the intraoperative robot pathways of the planned cut trajectories are known, because the planning was performed in relation to the same coordinate system which was used for the preoperative screw position determination.

4 As aforementioned, the position of the landmarks are determined intraoperatively by guiding the robot force-controlled to the screw positions. However, the robot follows the user who pushes and pulls the robot tool - in order to be safe against tremor and unintended hitches - very slowly and only if the forces exceed lower limits. Because of this matter of fact, a remaining bending stress is possible between the FTS and the tool tip placed in the screw cone. Such a stress causes an error while measuring the landmark position using the internal robot resolvers. In order to compensate this error, an offset vector d = (d x, d y, 0) T corresponding to the remaining torques is added to the measured landmark position. An example for the compensation of a registration error caused by the tool deflection is depicted in Fig. 4. Fig. 4: Correction distances to compensate the tool deflection during registration procedure (light grey) and additional compensation of tool deflection caused by tool weight (dark grey). Data refer to cut trajectory depicted in Fig. 5 Fig. 5: 3D-model of a human skull (point cloud), a cut trajectory, and the positions of the titanium screws (spheres)

5 4. Execution of a cut trajectory After the registration, when the patient position in relation to the robot base is known, the robot tool orientation can be calculated in every point of the planned trajectory. Hence, it is possible to consider the deflection caused by the weight of the tool before the actual execution of the cut trajectory starts (Fig. 4, Fig. 5). During the cutting process the feed of the robot tool is controlled with a discrete controlling algorithm. The forces are kept in a controlling window with a lower and an upper limit. This controlling algorithm knows three states: 1. Torques less than lower limit, speed is increased. 2. Torques within the controlling window, speed is kept 3. Torques exceed upper limit, speed is set to minimum speed value Furthermore, the tool acceleration and the cutting depth has been investigated. An acceleration too high causes a sidewise tool deflection into the direction of the milling cutter rotation. The successive increasing speed takes this behavior into account. In order to reduce the maximal forces, a cut can be performed in several steps, whereby the milling cutter is lead along the planned trajectory in different depths. 6. Conclusions and Future Work In this paper sources of errors which occur using a surgical robot system in order to cut bones were explained as well as methods of solution were discussed. It was shown, that the deflection of the robot tool must not be neglected if an accuracy of about one millimeter (from planning to execution) is required. To cope with this problem the calibration of the robot tool, a discrete feed control and a method which takes the deflection of the robot tool into account were presented. The consideration of the tool deflection increases the accuracy of the registration as well as the execution of the planned trajectory. Additionally, the feed control of the milling cutter is an important factor to reduce the tool deflection and to act with consideration for the patient fixation. In a next step of development, a real-time compensation of the tool deflection is intended. Therefore, the robot pathway should be adapted respectively to the occurring torques by an online control mechanism. Furthermore, it is planned to counterbalance micromovements of the patient by simultaneous consideration of the tracking data yielded by the optical navigation system. The overall system was tested with dummies, in animal experiments, and also in a preliminary test with a human test subject using a pen instead of the milling cutter. This subject test took place in an operating theater of our research partner, the Department of Oral and Maxillofacial Surgery - University of Heidelberg, and proved the applicability of the robot system. First surgical interventions will be performed later this year.

6 Acknowledgements This research has been performed at the Institute for Process Control and Robotics headed by Prof. Dr.-Ing. H. Woern at the University of Karlsruhe, Germany. The work has been funded by the German Research Foundation (Deutsche Forschungsgemeinschaft), as it is part of the collaborative research center SFB 414: Information Technology in Medicine Computer and Sensor Aided Surgery. References 1. Davies, B. L.: "A Discussion of Safety Issues for Medical Robots", Computer-Integrated Surgery Technology and Clinical Applications, pp. 287-296, The MIT Press, 1996. 2. Engel, D., Raczkowsky, J., Woern, H.: A Safe Robot System for Craniofacial Surgery, IEEE International Conference on Robotics and Automation, pp. 2020-2024, Seoul, Korea, 2001. 3. Simon, D.: What is Registration and Why is it so Important in CAOS?, Proceedings of the First Joint CVRMed / MRCAS Conference, pp. 57-60, June, 1997. 4. Kazanzides, P., Zuhars, J., Mittelstadt, B., Taylor, R. H.: "Force Sensing and Control for a Surgical Robot, IEEE International Conference on Robotics and Automation, pp. 612-617, Nice, France, 1992. 5. Arun, K. S., Huang, T. S., Blostein, S. D.: Least-Squares Fitting of Two 3-D Point Sets, IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 698-670, Vol. PAMI-9, No. 5, 1997.