Sensor-aided Milling with a Surgical Robot System

Size: px
Start display at page:

Download "Sensor-aided Milling with a Surgical Robot System"

Transcription

1 1 Sensor-aided Milling with a Surgical Robot System Dirk Engel, Joerg Raczkowsky, Heinz Woern Institute for Process Control and Robotics (IPR), Universität Karlsruhe (TH) Engler-Bunte-Ring 8, Karlsruhe dengel@ira.uka.de, rkowsky@ira.uka.de, woern@ira.uka.de Abstract In this paper sources of errors are pointed out that occur using a robot system in order to cut bones. It is shown that the deflection of the robot tool must not be neglected if an accuracy in the range of one millimeter (from planning to execution) is required, since the tool deflection is up to 1.5 millimeters depending on the affecting torques. Therefore, special focus is set on methods which cope with this problem. A calibration approach considering the deflection of the robot tool is presented. After this calibration, it is possible to consider the tool deflection during the registration procedure (ball-in-cone strategy) as well as during the intervention. Furthermore, a discrete feed control algorithm is outlined. Keywords: robot-assisted surgery, sensor control 1. Introduction The main purposes of a surgical robot system are on the one hand the support for the surgeon and on the other hand the improvement of the surgical result. Thereby, the safety of the patient, the surgeon, and the medical staff are presumed [1, 2]. Unlike the surgeon, the robot controller has direct access to the planning data. Further, the robot arm provides high repeat accuracy and high precision independent of the progress of operation time. Hence, the greatest benefit of a robot system in the operating theater is the gain in quality. The presented methods and implementations are part of the surgical robot system RobaCKa for craniofacial surgery, which has been developed at our institute. The robot assistance in craniofacial surgery is reasonable because of the vicinity to vital parts and the great impact of bone repositionings at the human skull to the later appearance of the patient. In the following sections, sources of errors, which have to be considered developing an accurate surgical robot system as well as our methods of solution are discussed. For the measurement of process data and for system surveillance the robot system is equipped with several sensors (Fig. 1). The robot tool consists of: pneumatic collision protection (CP), force-/torque sensor (FTS), rigid body equipped with infrared LEDs to be tracked by an optical navigation system, and surgical milling cutter. The CP is a fail safe electrical/mechanical system without any data measurement. Additionally, the FTS acquires the exact forces and torques which are transmitted to a sensor data processing computer. This serial arrangement, CP followed by FTS, and the resulting elasticity are the main sources of the occurring tool deflection. A CP with a trigger sensibility of 0.2

2 2 causes an excursion of up to 1 mm at the tool tip (given tool length 300 mm), for example. Since the patient position is determined during the registration procedure using the robot as measuring device, the deflection error impairs not only the quality of the trajectory execution, but also the quality of registration. Fig.1: RobaCKa system set-up, robot and sensors 2. Determination of tool deflection The determination of the tool deflection is performed at the same time when the physical tool dimension is calibrated. In order to compute the tool length, the robot has to be guided above a calibration body (e.g. a metal cube), from where the robot moves down until a contact state was reached. This procedure is conducted in three steps: 1. Tool is in perpendicular configuration 2. Tool is -45 angled around x-axis 3. Tool is +45 angled around x-axis The tool length can be computed as: l = ( + ) h h = h h 45 + h. h is + 45 the difference of height in the different contact states, measured along the robot z-axis (Fig. 2, left). The moment of contact of the perpendicular configuration is detected by the increase of the total force. To avoid a bending of the tool in the angled configurations the contact state is assumed when the torque around the x-axis is equal zero, T x = , ( ) For the calibration of the tool tip offset along the x- and y-axis, the robot tool is guided to the left side of the calibration body (Fig. 2, right). In the following, the robot moves its tool to contact the calibration body with the tip, detaches after contact and turns its tool 90 around the z-axis. This procedure is repeated four times until the calibration body was contacted in positive and negative x-/y-direction. Afterwards, the physical tool dimension is known. For the determination of the tool deflection d x and d y, the robot continues moving its tool after a detected x-/y-contact in the same direction until a previously adjusted maximal torque is reached. In this way, to each measured torque a corresponding deflection can be assigned. The change of the tool length d z can be neglected because of d x,y << l. Fig. 3 depicts the correlation of the measured torques T x,y and the corresponding

3 3 tool deflection d y,x. The graph shows also that the correlation can be linear approximated by d x = c xy T y and d y = c yx T x (c xy, c yx : constant factors). Fig.2: Calibration of tool dimension and simultaneous determination of tool deflection. First step: calculation of tool length (left). Second step: determination of x-/y-offset and tool deflection (right) Fig. 3: Correlation of affecting torque and tool deflection. The correlation can be linear approximated by d x = c y T y and d y = c x T x (c x,y : constant factors) 3. Registration The role of registration is to establish the spatial relationship (via a transformation matrix) registration) between the planning data and the real patient [3]. Therefore, four titanium screws are implanted preopratively into the patient skull before the CT scans are taken. The positions of these four fiducial landmarks are preoperatively determined in the 3Dpatient-model based on CT slices; and also intraoperatively by guiding the robot tool to the screw positions (ball-in-cone strategy) [4]. The calculation of the transformation matrix is done by Least-Squares Fitting [5]. After the registration, the intraoperative robot pathways of the planned cut trajectories are known, because the planning was performed in relation to the same coordinate system which was used for the preoperative screw position determination.

4 4 As aforementioned, the position of the landmarks are determined intraoperatively by guiding the robot force-controlled to the screw positions. However, the robot follows the user who pushes and pulls the robot tool - in order to be safe against tremor and unintended hitches - very slowly and only if the forces exceed lower limits. Because of this matter of fact, a remaining bending stress is possible between the FTS and the tool tip placed in the screw cone. Such a stress causes an error while measuring the landmark position using the internal robot resolvers. In order to compensate this error, an offset vector d = (d x, d y, 0) T corresponding to the remaining torques is added to the measured landmark position. An example for the compensation of a registration error caused by the tool deflection is depicted in Fig. 4. Fig. 4: Correction distances to compensate the tool deflection during registration procedure (light grey) and additional compensation of tool deflection caused by tool weight (dark grey). Data refer to cut trajectory depicted in Fig. 5 Fig. 5: 3D-model of a human skull (point cloud), a cut trajectory, and the positions of the titanium screws (spheres)

5 5 4. Execution of a cut trajectory After the registration, when the patient position in relation to the robot base is known, the robot tool orientation can be calculated in every point of the planned trajectory. Hence, it is possible to consider the deflection caused by the weight of the tool before the actual execution of the cut trajectory starts (Fig. 4, Fig. 5). During the cutting process the feed of the robot tool is controlled with a discrete controlling algorithm. The forces are kept in a controlling window with a lower and an upper limit. This controlling algorithm knows three states: 1. Torques less than lower limit, speed is increased. 2. Torques within the controlling window, speed is kept 3. Torques exceed upper limit, speed is set to minimum speed value Furthermore, the tool acceleration and the cutting depth has been investigated. An acceleration too high causes a sidewise tool deflection into the direction of the milling cutter rotation. The successive increasing speed takes this behavior into account. In order to reduce the maximal forces, a cut can be performed in several steps, whereby the milling cutter is lead along the planned trajectory in different depths. 6. Conclusions and Future Work In this paper sources of errors which occur using a surgical robot system in order to cut bones were explained as well as methods of solution were discussed. It was shown, that the deflection of the robot tool must not be neglected if an accuracy of about one millimeter (from planning to execution) is required. To cope with this problem the calibration of the robot tool, a discrete feed control and a method which takes the deflection of the robot tool into account were presented. The consideration of the tool deflection increases the accuracy of the registration as well as the execution of the planned trajectory. Additionally, the feed control of the milling cutter is an important factor to reduce the tool deflection and to act with consideration for the patient fixation. In a next step of development, a real-time compensation of the tool deflection is intended. Therefore, the robot pathway should be adapted respectively to the occurring torques by an online control mechanism. Furthermore, it is planned to counterbalance micromovements of the patient by simultaneous consideration of the tracking data yielded by the optical navigation system. The overall system was tested with dummies, in animal experiments, and also in a preliminary test with a human test subject using a pen instead of the milling cutter. This subject test took place in an operating theater of our research partner, the Department of Oral and Maxillofacial Surgery - University of Heidelberg, and proved the applicability of the robot system. First surgical interventions will be performed later this year.

6 6 Acknowledgements This research has been performed at the Institute for Process Control and Robotics headed by Prof. Dr.-Ing. H. Woern at the University of Karlsruhe, Germany. The work has been funded by the German Research Foundation (Deutsche Forschungsgemeinschaft), as it is part of the collaborative research center SFB 414: Information Technology in Medicine Computer and Sensor Aided Surgery. References 1. Davies, B. L.: "A Discussion of Safety Issues for Medical Robots", Computer-Integrated Surgery Technology and Clinical Applications, pp , The MIT Press, Engel, D., Raczkowsky, J., Woern, H.: A Safe Robot System for Craniofacial Surgery, IEEE International Conference on Robotics and Automation, pp , Seoul, Korea, Simon, D.: What is Registration and Why is it so Important in CAOS?, Proceedings of the First Joint CVRMed / MRCAS Conference, pp , June, Kazanzides, P., Zuhars, J., Mittelstadt, B., Taylor, R. H.: "Force Sensing and Control for a Surgical Robot, IEEE International Conference on Robotics and Automation, pp , Nice, France, Arun, K. S., Huang, T. S., Blostein, S. D.: Least-Squares Fitting of Two 3-D Point Sets, IEEE Transactions on Pattern Analysis and Machine Intelligence, pp , Vol. PAMI-9, No. 5, 1997.

Increasing the accuracy with a rich sensor system for robotic laser osteotomy

Increasing the accuracy with a rich sensor system for robotic laser osteotomy Increasing the accuracy with a rich sensor system for robotic laser osteotomy Holger Mönnich moennich@ira.uka.de Daniel Stein dstein@ira.uka.de Jörg Raczkowsky rkowsky@ira.uka.de Heinz Wörn woern@ira.uka.de

More information

Navigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images

Navigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images Navigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images Mamoru Kuga a*, Kazunori Yasuda b, Nobuhiko Hata a, Takeyoshi Dohi a a Graduate School of

More information

Interactive Simulation of Teeth Cleaning

Interactive Simulation of Teeth Cleaning Gockel, Tilo 1 /6 Interactive Simulation of Teeth Cleaning T. Gockel, T. Salb, T. Weyrich, O. Burgert, R. Dillmann Institute for Process Control and Robotics Universität Karlsruhe (TH), Department for

More information

An Accuracy Approach to Robotic Microsurgery in the Ear

An Accuracy Approach to Robotic Microsurgery in the Ear An Accuracy Approach to Robotic Microsurgery in the Ear B. Bell¹,J.Salzmann 1, E.Nielsen 3, N.Gerber 1, G.Zheng 1, L.Nolte 1, C.Stieger 4, M.Caversaccio², S. Weber 1 ¹ Institute for Surgical Technologies

More information

Data Fusion Virtual Surgery Medical Virtual Reality Team. Endo-Robot. Database Functional. Database

Data Fusion Virtual Surgery Medical Virtual Reality Team. Endo-Robot. Database Functional. Database 2017 29 6 16 GITI 3D From 3D to 4D imaging Data Fusion Virtual Surgery Medical Virtual Reality Team Morphological Database Functional Database Endo-Robot High Dimensional Database Team Tele-surgery Robotic

More information

Advanced Visual Medicine: Techniques for Visual Exploration & Analysis

Advanced Visual Medicine: Techniques for Visual Exploration & Analysis Advanced Visual Medicine: Techniques for Visual Exploration & Analysis Interactive Visualization of Multimodal Volume Data for Neurosurgical Planning Felix Ritter, MeVis Research Bremen Multimodal Neurosurgical

More information

Tracked surgical drill calibration

Tracked surgical drill calibration Tracked surgical drill calibration An acetabular fracture is a break in the socket portion of the "ball-and-socket" hip joint. The majority of acetabular fractures are caused by some type of highenergy

More information

Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization

Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization Zein Salah 1,2, Bernhard Preim 1, Erck Elolf 3, Jörg Franke 4, Georg Rose 2 1Department of Simulation and Graphics, University

More information

The Role of DICOM for Modular Perioperative Surgical Assist Systems Design

The Role of DICOM for Modular Perioperative Surgical Assist Systems Design The Role of DICOM for Modular Perioperative Surgical Assist Systems Design Release 1.00 Oliver Burgert 1, Thomas Treichel 1 and Michael Gessat 1 July 12, 2009 1 Innovation Center Computer Assisted Surgery

More information

3D Ultrasound Reconstruction By The 3 Cons: Michael Golden Khayriyyah Munir Omid Nasser Bigdeli

3D Ultrasound Reconstruction By The 3 Cons: Michael Golden Khayriyyah Munir Omid Nasser Bigdeli 3D Ultrasound Reconstruction By The 3 Cons: Michael Golden Khayriyyah Munir Omid Nasser Bigdeli Client Contact: Dr. Joseph McIsaac Hartford Hospital 80 Seymour St. PO Box 5037 Hartford, CT 06102 (860)

More information

Registration concepts for the just-in-time artefact correction by means of virtual computed tomography

Registration concepts for the just-in-time artefact correction by means of virtual computed tomography DIR 2007 - International Symposium on Digital industrial Radiology and Computed Tomography, June 25-27, 2007, Lyon, France Registration concepts for the just-in-time artefact correction by means of virtual

More information

Medical Robotics. Control Modalities

Medical Robotics. Control Modalities Università di Roma La Sapienza Medical Robotics Control Modalities Marilena Vendittelli differ for the the way human input is mapped to the motions of surgical instruments strictly related to the degree

More information

Intramedullary Nail Distal Hole Axis Estimation using Blob Analysis and Hough Transform

Intramedullary Nail Distal Hole Axis Estimation using Blob Analysis and Hough Transform Intramedullary Nail Distal Hole Axis Estimation using Blob Analysis and Hough Transform Chatchai Neatpisarnvanit Department of Electrical Engineering Mahidol University Nakorn Pathom, Thailand egcnp@mahidol.ac.th

More information

SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab

SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab Introduction Medical Imaging and Application CGV 3D Organ Modeling Model-based Simulation Model-based Quantification

More information

Guidelines for proper use of Plate elements

Guidelines for proper use of Plate elements Guidelines for proper use of Plate elements In structural analysis using finite element method, the analysis model is created by dividing the entire structure into finite elements. This procedure is known

More information

Fluoroscopy-Based X-Ray Navigation in Orthopedics Using Electromagnetic Tracking: A Practical Study

Fluoroscopy-Based X-Ray Navigation in Orthopedics Using Electromagnetic Tracking: A Practical Study Fluoroscopy-Based X-Ray Navigation in Orthopedics Using Electromagnetic Tracking: A Practical Study A thesis submitted in fulfillment of the requirements for the degree of Master of Science by Yair Yarom

More information

Elastic registration of medical images using finite element meshes

Elastic registration of medical images using finite element meshes Elastic registration of medical images using finite element meshes Hartwig Grabowski Institute of Real-Time Computer Systems & Robotics, University of Karlsruhe, D-76128 Karlsruhe, Germany. Email: grabow@ira.uka.de

More information

Advanced Computed Tomography System for the Inspection of Large Aluminium Car Bodies

Advanced Computed Tomography System for the Inspection of Large Aluminium Car Bodies ECNDT 2006 - Th.3.4.2 Advanced Computed Tomography System for the Inspection of Large Aluminium Car Bodies M. SIMON, I. TISEANU, C. SAUERWEIN Hans WÄLISCHMILLER, Meersburg, Germany M. SINDEL, M. BRODMANN,

More information

3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery

3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery 3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery Masahiko Nakamoto 1, Yoshinobu Sato 1, Masaki Miyamoto 1, Yoshikazu Nakamjima

More information

Positioning and Synchronization of Industrial Robots

Positioning and Synchronization of Industrial Robots First published in: 2 International Conference on Indoor Positioning and Indoor Navigation (IPIN), 5-7 September 2, Zürich, Switzerland Positioning and Synchronization of Industrial Robots Christoph Herrmann

More information

Intraoperative Prostate Tracking with Slice-to-Volume Registration in MR

Intraoperative Prostate Tracking with Slice-to-Volume Registration in MR Intraoperative Prostate Tracking with Slice-to-Volume Registration in MR Sean Gill a, Purang Abolmaesumi a,b, Siddharth Vikal a, Parvin Mousavi a and Gabor Fichtinger a,b,* (a) School of Computing, Queen

More information

AUTOMATIC DETECTION OF ENDOSCOPE IN INTRAOPERATIVE CT IMAGE: APPLICATION TO AUGMENTED REALITY GUIDANCE IN LAPAROSCOPIC SURGERY

AUTOMATIC DETECTION OF ENDOSCOPE IN INTRAOPERATIVE CT IMAGE: APPLICATION TO AUGMENTED REALITY GUIDANCE IN LAPAROSCOPIC SURGERY AUTOMATIC DETECTION OF ENDOSCOPE IN INTRAOPERATIVE CT IMAGE: APPLICATION TO AUGMENTED REALITY GUIDANCE IN LAPAROSCOPIC SURGERY Summary of thesis by S. Bernhardt Thesis director: Christophe Doignon Thesis

More information

Robot Control for Medical Applications and Hair Transplantation

Robot Control for Medical Applications and Hair Transplantation Dr. John Tenney Director of Research Restoration Robotics, Inc. Robot Control for Medical Applications and Hair Transplantation Presented to the IEEE Control Systems Society, Santa Clara Valley 18 November

More information

A SYSTEM FOR COMPUTER-ASSISTED SURGERY WITH INTRAOPERATIVE CT IMAGING

A SYSTEM FOR COMPUTER-ASSISTED SURGERY WITH INTRAOPERATIVE CT IMAGING A SYSTEM FOR COMPUTER-ASSISTED SURGERY WITH INTRAOPERATIVE CT IMAGING by ANTON OENTORO A thesis submitted to the School of Computing in conformity with the requirements for the degree of Master of Science

More information

Lecture 8: Registration

Lecture 8: Registration ME 328: Medical Robotics Winter 2019 Lecture 8: Registration Allison Okamura Stanford University Updates Assignment 4 Sign up for teams/ultrasound by noon today at: https://tinyurl.com/me328-uslab Main

More information

Fully Automatic Endoscope Calibration for Intraoperative Use

Fully Automatic Endoscope Calibration for Intraoperative Use Fully Automatic Endoscope Calibration for Intraoperative Use Christian Wengert, Mireille Reeff, Philippe C. Cattin, Gábor Székely Computer Vision Laboratory, ETH Zurich, 8092 Zurich, Switzerland {wengert,

More information

CHomework Assignment /655 Fall 2017 (Circle One)

CHomework Assignment /655 Fall 2017 (Circle One) CHomework Assignment 2 600.455/655 Fall 2017 (Circle One) Instructions and Score Sheet (hand in with answers) Name Email Other contact information (optional) Signature (required) I/We have followed the

More information

Ultrasound Probe Tracking for Real-Time Ultrasound/MRI Overlay and Visualization of Brain Shift

Ultrasound Probe Tracking for Real-Time Ultrasound/MRI Overlay and Visualization of Brain Shift Ultrasound Probe Tracking for Real-Time Ultrasound/MRI Overlay and Visualization of Brain Shift David G. Gobbi 1, Roch M. Comeau 2, and Terry M. Peters 1,2 1 Imaging Research Laboratories, John P. Robarts

More information

Virtual Interaction System Based on Optical Capture

Virtual Interaction System Based on Optical Capture Sensors & Transducers 203 by IFSA http://www.sensorsportal.com Virtual Interaction System Based on Optical Capture Peng CHEN, 2 Xiaoyang ZHOU, 3 Jianguang LI, Peijun WANG School of Mechanical Engineering,

More information

A Miniature Instrument Tip Force Sensor for Robot/Human Cooperative Microsurgical Manipulation with Enhanced Force Feedback

A Miniature Instrument Tip Force Sensor for Robot/Human Cooperative Microsurgical Manipulation with Enhanced Force Feedback A Miniature Instrument Tip Force Sensor for Robot/Human Cooperative Microsurgical Manipulation with Enhanced Force Feedback Peter J. Berkelman, Louis L. Whitcomb, Russell H. Taylor, and Patrick Jensen

More information

Surgery Simulation and Planning

Surgery Simulation and Planning Surgery Simulation and Planning S. H. Martin Roth Dr. Rolf M. Koch Daniel Bielser Prof. Dr. Markus Gross Facial surgery project in collaboration with Prof. Dr. Dr. H. Sailer, University Hospital Zurich,

More information

Accuracy Validation in Image-Guided Orthopaedic Surgery

Accuracy Validation in Image-Guided Orthopaedic Surgery Accuracy Validation in Image-Guided Orthopaedic Surgery D.A. Simon 1, R.V. O Toole 2,1, M. Blackwell 1, F. Morgan 1, A.M. DiGioia 2,1, T. Kanade 1 das@ri.cmu.edu, rvo@ri.cmu.edu, mkb@ri.cmu.edu, fxm@ri.cmu.edu,

More information

Calibration Method for Determining the Physical Location of the Ultrasound Image Plane

Calibration Method for Determining the Physical Location of the Ultrasound Image Plane Calibration Method for Determining the Physical Location of the Ultrasound Image Plane Devin V. Amin, Ph.D. 1, Takeo Kanade, Ph.D 1., Branislav Jaramaz, Ph.D. 2, Anthony M. DiGioia III, MD 2, Constantinos

More information

An approach to calculate and visualize intraoperative scattered radiation exposure

An approach to calculate and visualize intraoperative scattered radiation exposure Peter L. Reicertz Institut für Medizinische Informatik An approach to calculate and visualize intraoperative scattered radiation exposure Markus Wagner University of Braunschweig Institute of Technology

More information

ALL SINGULARITIES OF THE 9-DOF DLR MEDICAL ROBOT SETUP FOR MINIMALLY INVASIVE APPLICATIONS

ALL SINGULARITIES OF THE 9-DOF DLR MEDICAL ROBOT SETUP FOR MINIMALLY INVASIVE APPLICATIONS ALL SINGULARITIES OF THE 9-DOF DLR MEDICAL ROBOT SETUP FOR MINIMALLY INVASIVE APPLICATIONS Rainer Konietschke, Gerd Hirzinger German Aerospace Center, Institute of Robotics and Mechatronics P.O. Box 6,

More information

ULTRASONOGRAPHY is an appealing technology to

ULTRASONOGRAPHY is an appealing technology to IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 28, NO. 6, JUNE 2009 951 Magneto-Optical Tracking of Flexible Laparoscopic Ultrasound: Model-Based Online Detection and Correction of Magnetic Tracking Errors

More information

A Study of Medical Image Analysis System

A Study of Medical Image Analysis System Indian Journal of Science and Technology, Vol 8(25), DOI: 10.17485/ijst/2015/v8i25/80492, October 2015 ISSN (Print) : 0974-6846 ISSN (Online) : 0974-5645 A Study of Medical Image Analysis System Kim Tae-Eun

More information

A Novel 3D Camera Based Supervision System for Safe Human-Robot Interaction in the Operating Room

A Novel 3D Camera Based Supervision System for Safe Human-Robot Interaction in the Operating Room A Novel 3D Camera Based Supervision System for Safe Human-Robot Interaction in the Operating Room P. Nicolai, J. Raczkowsky, and H. Wörn Karlsruhe Institute of Technology, Karlsruhe, Germany Email: philip.nicolai@kit.edu

More information

Time-of-flight-assisted Kinect camera-based people detection for intuitive human robot cooperation in the surgical operating room

Time-of-flight-assisted Kinect camera-based people detection for intuitive human robot cooperation in the surgical operating room DOI 10.1007/s11548-015-1318-7 ORIGINAL ARTICLE Time-of-flight-assisted Kinect camera-based people detection for intuitive human robot cooperation in the surgical operating room Tim Beyl 1 Philip Nicolai

More information

Fluoroscopic X-ray image guidance for manual and robotic orthopedic surgery. Thesis submitted for the degree of Doctor of Philosophy by Ziv R.

Fluoroscopic X-ray image guidance for manual and robotic orthopedic surgery. Thesis submitted for the degree of Doctor of Philosophy by Ziv R. Fluoroscopic X-ray image guidance for manual and robotic orthopedic surgery Thesis submitted for the degree of Doctor of Philosophy by Ziv R. Yaniv Submitted to the Senate of the Hebrew University April

More information

On the Design and Experiments of a Fluoro-Robotic Navigation System for Closed Intramedullary Nailing of Femur

On the Design and Experiments of a Fluoro-Robotic Navigation System for Closed Intramedullary Nailing of Femur On the Design and Experiments of a Fluoro-Robotic Navigation System for Closed Intramedullary Nailing of Femur Sakol Nakdhamabhorn and Jackrit Suthakorn 1* Abstract. Closed Intramedullary Nailing of Femur

More information

Comparison of Probing Error in Dimensional Measurement by Means of 3D Computed Tomography with Circular and Helical Sampling

Comparison of Probing Error in Dimensional Measurement by Means of 3D Computed Tomography with Circular and Helical Sampling nd International Symposium on NDT in Aerospace - We..A. Comparison of Probing Error in Dimensional Measurement by Means of D Computed Tomography with Circular and Helical Sampling Jochen HILLER, Stefan

More information

A Navigation System for Minimally Invasive Abdominal Intervention Surgery Robot

A Navigation System for Minimally Invasive Abdominal Intervention Surgery Robot A Navigation System for Minimally Invasive Abdominal Intervention Surgery Robot Weiming ZHAI, Yannan ZHAO and Peifa JIA State Key Laboratory of Intelligent Technology and Systems Tsinghua National Laboratory

More information

SUBDIVISION ALGORITHMS FOR MOTION DESIGN BASED ON HOMOLOGOUS POINTS

SUBDIVISION ALGORITHMS FOR MOTION DESIGN BASED ON HOMOLOGOUS POINTS SUBDIVISION ALGORITHMS FOR MOTION DESIGN BASED ON HOMOLOGOUS POINTS M. Hofer and H. Pottmann Institute of Geometry Vienna University of Technology, Vienna, Austria hofer@geometrie.tuwien.ac.at, pottmann@geometrie.tuwien.ac.at

More information

Assessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model

Assessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model Assessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model Jianhua Yao National Institute of Health Bethesda, MD USA jyao@cc.nih.gov Russell Taylor The Johns

More information

Scaling Calibration in the ATRACT Algorithm

Scaling Calibration in the ATRACT Algorithm Scaling Calibration in the ATRACT Algorithm Yan Xia 1, Andreas Maier 1, Frank Dennerlein 2, Hannes G. Hofmann 1, Joachim Hornegger 1,3 1 Pattern Recognition Lab (LME), Friedrich-Alexander-University Erlangen-Nuremberg,

More information

INTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1. Modifications for P551 Fall 2013 Medical Physics Laboratory

INTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1. Modifications for P551 Fall 2013 Medical Physics Laboratory INTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1 Modifications for P551 Fall 2013 Medical Physics Laboratory Introduction Following the introductory lab 0, this lab exercise the student through

More information

Vectric Cut 3D (Frogmill)

Vectric Cut 3D (Frogmill) II. Subtractive Rapid Prototyping / VECTRIC CUT 3D (Frogmill) SUBTRACTIVE RAPID PROTOTYPING Vectric Cut 3D (Frogmill) INTERFACE: VECTRIC CUT 3D Model: Frogmill Size: W3050 x D1828 X H419 Material: EPS

More information

Endoscopic Reconstruction with Robust Feature Matching

Endoscopic Reconstruction with Robust Feature Matching Endoscopic Reconstruction with Robust Feature Matching Students: Xiang Xiang Mentors: Dr. Daniel Mirota, Dr. Gregory Hager and Dr. Russell Taylor Abstract Feature matching based 3D reconstruction is a

More information

3D-2D Laser Range Finder calibration using a conic based geometry shape

3D-2D Laser Range Finder calibration using a conic based geometry shape 3D-2D Laser Range Finder calibration using a conic based geometry shape Miguel Almeida 1, Paulo Dias 1, Miguel Oliveira 2, Vítor Santos 2 1 Dept. of Electronics, Telecom. and Informatics, IEETA, University

More information

Real-time self-calibration of a tracked augmented reality display

Real-time self-calibration of a tracked augmented reality display Real-time self-calibration of a tracked augmented reality display Zachary Baum, Andras Lasso, Tamas Ungi, Gabor Fichtinger Laboratory for Percutaneous Surgery, Queen s University, Kingston, Canada ABSTRACT

More information

Intelligent Cutting of the Bird Shoulder Joint

Intelligent Cutting of the Bird Shoulder Joint Intelligent Cutting of the Bird Shoulder Joint Ai-Ping Hu, Sergio Grullon, Debao Zhou, Jonathan Holmes, Wiley Holcombe, Wayne Daley and Gary McMurray Food Processing Technology Division, ATAS Laboratory,

More information

Abstract. Introduction

Abstract. Introduction The efficient calculation of the Cartesian geometry of non-cartesian structures J.M. Freeman and D.G. Ford Engineering Control and Metrology Research Group, The School of Engineering, University of Huddersfield.

More information

Robot Calibration for Precise Ultrasound Image Acquisition

Robot Calibration for Precise Ultrasound Image Acquisition Abstract Robot Calibration for Precise Ultrasound Image Acquisition Pedro M. B. Torres 1,2, Paulo J. S. Gonçalves 1,2, Jorge M. M. Martins 2 1 Polytechnic Institute of CasteloBranco, School of Technology,

More information

Improving Vision-Based Distance Measurements using Reference Objects

Improving Vision-Based Distance Measurements using Reference Objects Improving Vision-Based Distance Measurements using Reference Objects Matthias Jüngel, Heinrich Mellmann, and Michael Spranger Humboldt-Universität zu Berlin, Künstliche Intelligenz Unter den Linden 6,

More information

Reduction of Metal Artifacts in Computed Tomographies for the Planning and Simulation of Radiation Therapy

Reduction of Metal Artifacts in Computed Tomographies for the Planning and Simulation of Radiation Therapy Reduction of Metal Artifacts in Computed Tomographies for the Planning and Simulation of Radiation Therapy T. Rohlfing a, D. Zerfowski b, J. Beier a, P. Wust a, N. Hosten a, R. Felix a a Department of

More information

ABSTRACT 1. INTRODUCTION

ABSTRACT 1. INTRODUCTION Tracked ultrasound calibration studies with a phantom made of LEGO bricks Marie Soehl, Ryan Walsh, Adam Rankin, Andras Lasso, Gabor Fichtinger Queen s University, Kingston ON, Canada ABSTRACT PURPOSE:

More information

3D Point Cloud Processing

3D Point Cloud Processing 3D Point Cloud Processing The image depicts how our robot Irma3D sees itself in a mirror. The laser looking into itself creates distortions as well as changes in intensity that give the robot a single

More information

3D RECONSTRUCTION AND VISUALIZATION OF FEMUR BONE STRUCTURES

3D RECONSTRUCTION AND VISUALIZATION OF FEMUR BONE STRUCTURES 3D RECONSTRUCTION AND VISUALIZATION OF FEMUR BONE STRUCTURES Pedro M. B. Torres 1,2, Paulo J. S. Gonçalves 1,2, Jorge M. M. Martins 2 1 Polytechnic Institute of Castelo Branco, School of Technology, Av.

More information

Measurement of Head-to-Trunk Orientation Using Handheld 3D Optical Apparatus

Measurement of Head-to-Trunk Orientation Using Handheld 3D Optical Apparatus Measurement of Head-to-Trunk Orientation Using Handheld 3D Optical Apparatus Urban PAVLOVČIČ*, Janez DIACI, Janez MOŽINA, Matija JEZERŠEK Faculty of Mechanical Engineering, University of Ljubljana, Ljubljana,

More information

Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences

Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences Jian Wang 1,2, Anja Borsdorf 2, Joachim Hornegger 1,3 1 Pattern Recognition Lab, Friedrich-Alexander-Universität

More information

Introduction to Digitization Techniques for Surgical Guidance

Introduction to Digitization Techniques for Surgical Guidance Introduction to Digitization Techniques for Surgical Guidance Rebekah H. Conley, MS and Logan W. Clements, PhD Department of Biomedical Engineering Biomedical Modeling Laboratory Outline Overview of Tracking

More information

LEAD LOCALIZATION. Version 1.0. Software User Guide Revision 1.1. Copyright 2018, Brainlab AG Germany. All rights reserved.

LEAD LOCALIZATION. Version 1.0. Software User Guide Revision 1.1. Copyright 2018, Brainlab AG Germany. All rights reserved. LEAD LOCALIZATION Version 1.0 Software User Guide Revision 1.1 Copyright 2018, Brainlab AG Germany. All rights reserved. TABLE OF CONTENTS TABLE OF CONTENTS 1 GENERAL INFORMATION...5 1.1 Contact Data...5

More information

SIMULATION OF CARBON-ROVING-STRUCTURES EXTREME LIGHT AND STRONG BY FILAMENT WOUND REINFORCEMENT

SIMULATION OF CARBON-ROVING-STRUCTURES EXTREME LIGHT AND STRONG BY FILAMENT WOUND REINFORCEMENT SIMULATION OF CARBON-ROVING-STRUCTURES EXTREME LIGHT AND STRONG BY FILAMENT WOUND REINFORCEMENT 1 Dirk Dreißig *, 2 Peter Faßbänder, 1 Ulrich Hindenlang 1 Lasso Ingenieurgesellschaft mbh, Germany, 2 FS

More information

User Guide. Customized Patient Instrumentation Web Based Surgical Planning and Tracking Software Guide

User Guide. Customized Patient Instrumentation Web Based Surgical Planning and Tracking Software Guide User Guide Customized Patient Instrumentation Web Based Surgical Planning and Tracking Software Guide DePuy Orthopaedics TruMatch Personalized Solutions Ordering and Web Portal User Guide This User Guide

More information

Depth Camera Calibration and Knife Tip Position Estimation for Liver Surgery Support System

Depth Camera Calibration and Knife Tip Position Estimation for Liver Surgery Support System Depth Camera Calibration and Knife Tip Position Estimation for Liver Surgery Support System Masanao Koeda 1, Akio Tsukushi 1, Hiroshi Noborio 1, Katsuhiko Onishi 1, Kiminori Mizushino 2, Takahiro Kunii

More information

Design and Implementation of a Laparoscope Calibration Method for Augmented Reality Navigation

Design and Implementation of a Laparoscope Calibration Method for Augmented Reality Navigation Design and Implementation of a Laparoscope Calibration Method for Augmented Reality Navigation M. Schwalbe 1, M. Fusaglia 1, P. Tinguely 2, H. Lu 1, S. Weber 1 1 ARTORG Center for Biomedical Engineering,

More information

The team. Disclosures. Ultrasound Guidance During Radiation Delivery: Confronting the Treatment Interference Challenge.

The team. Disclosures. Ultrasound Guidance During Radiation Delivery: Confronting the Treatment Interference Challenge. Ultrasound Guidance During Radiation Delivery: Confronting the Treatment Interference Challenge Dimitre Hristov Radiation Oncology Stanford University The team Renhui Gong 1 Magdalena Bazalova-Carter 1

More information

2D Rigid Registration of MR Scans using the 1d Binary Projections

2D Rigid Registration of MR Scans using the 1d Binary Projections 2D Rigid Registration of MR Scans using the 1d Binary Projections Panos D. Kotsas Abstract This paper presents the application of a signal intensity independent registration criterion for 2D rigid body

More information

Optimal Planning of Robotically Assisted Heart Surgery: Transfer Precision in the Operating Room

Optimal Planning of Robotically Assisted Heart Surgery: Transfer Precision in the Operating Room Optimal Planning of Robotically Assisted Heart Surgery: Transfer Precision in the Operating Room Ève Coste-Manière 1, Louaï Adhami 1, Fabien Mourgues 1, Olivier Bantiche 1, David Le 2, David Hunt 2, Nick

More information

Precise Ultrasound Bone Registration with Learning-based Segmentation and Speed of Sound Calibration

Precise Ultrasound Bone Registration with Learning-based Segmentation and Speed of Sound Calibration Precise Ultrasound Bone Registration with Learning-based Segmentation and Speed of Sound Calibration Mehrdad Salehi 1,2, Raphael Prevost 1, José-Luis Moctezuma 3, Nassir Navab 2, and Wolfgang Wein 1 1

More information

Calibration and setup of a tool probe

Calibration and setup of a tool probe Calibration and setup of a tool probe Fundamentals Tool-setting is the process of determining geometric information length, radius and / or diameter of a cutting tool using a tool-setting device. Some

More information

Unit #13 : Integration to Find Areas and Volumes, Volumes of Revolution

Unit #13 : Integration to Find Areas and Volumes, Volumes of Revolution Unit #13 : Integration to Find Areas and Volumes, Volumes of Revolution Goals: Beabletoapplyaslicingapproachtoconstructintegralsforareasandvolumes. Be able to visualize surfaces generated by rotating functions

More information

TOLERANCE ALLOCATION IN FLEXIBLE ASSEMBLIES: A PRACTICAL CASE

TOLERANCE ALLOCATION IN FLEXIBLE ASSEMBLIES: A PRACTICAL CASE TOLERANCE ALLOCATION IN FLEXIBLE ASSEMBLIES: A PRACTICAL CASE Pezzuti E., Piscopo G., Ubertini A., Valentini P.P. 1, Department of Mechanical Engineering University of Rome Tor Vergata via del Politecnico

More information

Developing Algorithms for Robotics and Autonomous Systems

Developing Algorithms for Robotics and Autonomous Systems Developing Algorithms for Robotics and Autonomous Systems Jorik Caljouw 2015 The MathWorks, Inc. 1 Key Takeaway of this Talk Success in developing an autonomous robotics system requires: 1. Multi-domain

More information

Measurements using three-dimensional product imaging

Measurements using three-dimensional product imaging ARCHIVES of FOUNDRY ENGINEERING Published quarterly as the organ of the Foundry Commission of the Polish Academy of Sciences ISSN (1897-3310) Volume 10 Special Issue 3/2010 41 46 7/3 Measurements using

More information

Catalog Numbers: CMB022, CMB022-AA, CMB022-UP, CMB033, CMB033-AA, CMB033-UP, CMB-CW, CMB-LK

Catalog Numbers: CMB022, CMB022-AA, CMB022-UP, CMB033, CMB033-AA, CMB033-UP, CMB-CW, CMB-LK Page 1 MONTERIS AXIIIS-CMB & ACCESSORIES Catalog Numbers: CMB022, CMB022-AA, CMB022-UP, CMB033, CMB033-AA, CMB033-UP, CMB-CW, CMB-LK INSTRUCTIONS FOR USE CAUTION Federal (U.S.A.) law restricts this device

More information

DELTA TAU Data Systems, Inc.

DELTA TAU Data Systems, Inc. DELTA TAU Data Systems, Inc. Last revision: 12/5/01 Why PMAC Controllers Are Easy To Use Delta Tau s PMAC and Turbo PMAC families of controllers justly have the reputation as being the most powerful and

More information

Manipulator Path Control : Path Planning, Dynamic Trajectory and Control Analysis

Manipulator Path Control : Path Planning, Dynamic Trajectory and Control Analysis Manipulator Path Control : Path Planning, Dynamic Trajectory and Control Analysis Motion planning for industrial manipulators is a challenging task when obstacles are present in the workspace so that collision-free

More information

Bone registration with 3D CT and ultrasound data sets

Bone registration with 3D CT and ultrasound data sets International Congress Series 1256 (2003) 426 432 Bone registration with 3D CT and ultrasound data sets B. Brendel a, *,1, S. Winter b,1, A. Rick c,1, M. Stockheim d,1, H. Ermert a,1 a Institute of High

More information

Trajectory Planning of Redundant Planar Mechanisms for Reducing Task Completion Duration

Trajectory Planning of Redundant Planar Mechanisms for Reducing Task Completion Duration Trajectory Planning of Redundant Planar Mechanisms for Reducing Task Completion Duration Emre Uzunoğlu 1, Mehmet İsmet Can Dede 1, Gökhan Kiper 1, Ercan Mastar 2, Tayfun Sığırtmaç 2 1 Department of Mechanical

More information

BENEFITS OF JMT PRESS BRAKES

BENEFITS OF JMT PRESS BRAKES BENEFITS OF JMT PRESS BRAKES JMT press brakes benefit your bottom line with higher quality parts, faster cycle times, lower operating and maintenance costs. Whether your application requires bending simple

More information

Imaging protocols for navigated procedures

Imaging protocols for navigated procedures 9732379 G02 Rev. 1 2015-11 Imaging protocols for navigated procedures How to use this document This document contains imaging protocols for navigated cranial, DBS and stereotactic, ENT, and spine procedures

More information

TopMill TopTurn. Jobshop Programming & Simulation for Multi-Side & Complete Mill-Turn Machining for every CNC Control

TopMill TopTurn. Jobshop Programming & Simulation for Multi-Side & Complete Mill-Turn Machining for every CNC Control MEKAMS MillTurnSim TopCAM TopCAT Jobshop Programming & Simulation for Multi-Side & Complete Mill-Turn Machining for every CNC Control 2 Jobshop Programming for Multi-Side and Complete Mill-Turn Machining

More information

Design of an open hardware architecture for the humanoid robot ARMAR

Design of an open hardware architecture for the humanoid robot ARMAR Design of an open hardware architecture for the humanoid robot ARMAR Kristian Regenstein 1 and Rüdiger Dillmann 1,2 1 FZI Forschungszentrum Informatik, Haid und Neustraße 10-14, 76131 Karlsruhe, Germany

More information

Computed tomography (Item No.: P )

Computed tomography (Item No.: P ) Computed tomography (Item No.: P2550100) Curricular Relevance Area of Expertise: Biology Education Level: University Topic: Modern Imaging Methods Subtopic: X-ray Imaging Experiment: Computed tomography

More information

Frequency split metal artifact reduction (FSMAR) in computed tomography

Frequency split metal artifact reduction (FSMAR) in computed tomography The Johns Hopkins University Advanced Computer Integrated Surgery Group 4 Metal Artifact Removal in C-arm Cone-Beam CT Paper Seminar Critical Review of Frequency split metal artifact reduction (FSMAR)

More information

Suitability of a new alignment correction method for industrial CT

Suitability of a new alignment correction method for industrial CT Suitability of a new alignment correction method for industrial CT Matthias Elter 1, Nicole Maass 1, Peter Koch 2 1 Siemens AG, Healthcare Sector, Erlangen, Germany, e-mail: matthias.elter@siemens.com,

More information

Calibration and setup of part probe

Calibration and setup of part probe Calibration and setup of part probe Fundamentals To measure workpiece dimensions, an electronic touchtrigger probe is required that provides a signal change (edge) when deflected with the required repeat

More information

4D Shape Registration for Dynamic Electrophysiological Cardiac Mapping

4D Shape Registration for Dynamic Electrophysiological Cardiac Mapping 4D Shape Registration for Dynamic Electrophysiological Cardiac Mapping Kevin Wilson 1,5, Gerard Guiraudon 4,5, Doug Jones 3,4, and Terry M. Peters 1,2,5 1 Biomedical Engineering Program 2 Department of

More information

A Haptic VR Milling Surgery Simulator Using High-Resolution CT-Data.

A Haptic VR Milling Surgery Simulator Using High-Resolution CT-Data. A Haptic VR Milling Surgery Simulator Using High-Resolution CT-Data. Magnus ERIKSSON a, Mark DIXON b and Jan WIKANDER a. a The Mechatronics Lab/Machine Design, KTH, Stockholm, Sweden b SenseGraphics AB,

More information

Robotics kinematics and Dynamics

Robotics kinematics and Dynamics Robotics kinematics and Dynamics C. Sivakumar Assistant Professor Department of Mechanical Engineering BSA Crescent Institute of Science and Technology 1 Robot kinematics KINEMATICS the analytical study

More information

SIMULATION OF POSTOPERATIVE 3D FACIAL MORPHOLOGY USING PHYSICS-BASED HEAD MODEL Yoshimitsu AOKI*, Shuji Hashimoto*, Masahiko Terajima**, Akihiko Nakasima** * Waseda University, Japan Department of Applied

More information

Introducing Computer-Assisted Surgery into combined PET/CT image based Biopsy

Introducing Computer-Assisted Surgery into combined PET/CT image based Biopsy Introducing Computer-Assisted Surgery into combined PET/CT image based Biopsy Santos TO(1), Weitzel T(2), Klaeser B(2), Reyes M(1), Weber S(1) 1 - Artorg Center, University of Bern, Bern, Switzerland 2

More information

Towards Projector-based Visualization for Computer-assisted CABG at the Open Heart

Towards Projector-based Visualization for Computer-assisted CABG at the Open Heart Towards Projector-based Visualization for Computer-assisted CABG at the Open Heart Christine Hartung 1, Claudia Gnahm 1, Stefan Sailer 1, Marcel Schenderlein 1, Reinhard Friedl 2, Martin Hoffmann 3, Klaus

More information

Incorporating Target Registration Error Into Robotic Bone Milling

Incorporating Target Registration Error Into Robotic Bone Milling Incorporating Target Registration Error Into Robotic Bone Milling Michael A. Siebold *a, Neal P. Dillon b, Robert J. Webster III a,b, and J. Michael Fitzpatrick a a Electrical Engineering and Computer

More information

SUPPORTING LINEAR MOTION: A COMPLETE GUIDE TO IMPLEMENTING DYNAMIC LOAD SUPPORT FOR LINEAR MOTION SYSTEMS

SUPPORTING LINEAR MOTION: A COMPLETE GUIDE TO IMPLEMENTING DYNAMIC LOAD SUPPORT FOR LINEAR MOTION SYSTEMS SUPPORTING LINEAR MOTION: A COMPLETE GUIDE TO IMPLEMENTING DYNAMIC LOAD SUPPORT FOR LINEAR MOTION SYSTEMS Released by: Keith Knight Catalyst Motion Group Engineering Team Members info@catalystmotiongroup.com

More information

Reconstructing Images of Bar Codes for Construction Site Object Recognition 1

Reconstructing Images of Bar Codes for Construction Site Object Recognition 1 Reconstructing Images of Bar Codes for Construction Site Object Recognition 1 by David E. Gilsinn 2, Geraldine S. Cheok 3, Dianne P. O Leary 4 ABSTRACT: This paper discusses a general approach to reconstructing

More information

Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System

Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System Simon Placht, Christian Schaller, Michael Balda, André Adelt, Christian Ulrich, Joachim Hornegger Pattern Recognition Lab,

More information

Scale-Invariant Registration of Monocular Endoscopic Images to CT-Scans for Sinus Surgery

Scale-Invariant Registration of Monocular Endoscopic Images to CT-Scans for Sinus Surgery Scale-Invariant Registration of Monocular Endoscopic Images to CT-Scans for Sinus Surgery Darius Burschka 1, Ming Li 2, Russell Taylor 2, and Gregory D. Hager 1 1 Computational Interaction and Robotics

More information