Interactive Simulation of Teeth Cleaning

Similar documents
Sensor-aided Milling with a Surgical Robot System

A Study of Medical Image Analysis System

Reverse Engineering: Mechanical. Dr. Tarek A. Tutunji

Volumetric Deformable Models for Simulation of Laparoscopic Surgery

A Haptic VR Milling Surgery Simulator Using High-Resolution CT-Data.

Virtual Cutting in Medical Data. Institute for Real-time Computer Systems and Robotics. University of Karlsruhe, Department for Computer Science

INTERACTIVE CUTTING OF THE SKULL FOR CRANIOFACIAL SURGICAL PLANNING

2 Michael E. Leventon and Sarah F. F. Gibson a b c d Fig. 1. (a, b) Two MR scans of a person's knee. Both images have high resolution in-plane, but ha

Surgical Cutting on a Multimodal Object Representation

Providing Haptic Hints to Automatic Motion Planners

The team. Disclosures. Ultrasound Guidance During Radiation Delivery: Confronting the Treatment Interference Challenge.

Elastic registration of medical images using finite element meshes

Anatomic Growth Modelling of Cleft Palate Shape. S.K. Chua*, S.H. Ong*, K.W.C. Foong**

Modifying Soft Tissue Models: Progressive Cutting with Minimal New Element Creation

Real-time Soft Tissue Modelling for Webbased Surgical Simulation: SurfaceChainMail

Surgery Simulation and Planning

Fast. Affordable. Complete. Desktop Scanning System from Great Lakes

PHOTOGRAMMETRIC TECHNIQUE FOR TEETH OCCLUSION ANALYSIS IN DENTISTRY

Computer Simulation of Prostate Surgery

Computational Geometry. Definition, Application Areas, and Course Overview

CREATION AND VISUALIZATION OF ANATOMICAL MODELS WITH AMIRA CREATION ET VISUALISATION DES MODELES ANATOMIQUES AVEC AMIRA

3D Volume Mesh Generation of Human Organs Using Surface Geometries Created from the Visible Human Data Set

From Image Data to Three-Dimensional Geometric Models Case Studies on the Impact of 3D Patient Models

ScienceDirect. The use of Optical Methods for Leak Testing Dampers

Artery Soft-Tissue Modelling for Stent Implant Training System

Advanced Image Reconstruction Methods for Photoacoustic Tomography

3D Ultrasound Reconstruction By The 3 Cons: Michael Golden Khayriyyah Munir Omid Nasser Bigdeli

An approach to calculate and visualize intraoperative scattered radiation exposure

TomoTherapy Related Projects. An image guidance alternative on Tomo Low dose MVCT reconstruction Patient Quality Assurance using Sinogram

Non-Linear Analysis of Bolted Flush End-Plate Steel Beam-to-Column Connection Nur Ashikin Latip, Redzuan Abdulla

INDUSTRIAL SYSTEM DEVELOPMENT FOR VOLUMETRIC INTEGRITY

3D Modeling of Objects Using Laser Scanning

Design and Validation of XY Flexure Mechanism

GPU Ultrasound Simulation and Volume Reconstruction

MAE Advanced Computer Aided Design. 01. Introduction Doc 02. Introduction to the FINITE ELEMENT METHOD

3D Modeling: Surfaces

Reduction of Metal Artifacts in Computed Tomographies for the Planning and Simulation of Radiation Therapy

Abstract. Introduction

RealWorks Software. A Powerful 3D Laser Scanning Office Software Suite

Study on Gear Chamfering Method based on Vision Measurement

Basics of treatment planning II

Some Open Problems in Graph Theory and Computational Geometry

Fracture & Tetrahedral Models

Response to Reviewers

LASer Cavity Analysis and Design

Comparison of Probing Error in Dimensional Measurement by Means of 3D Computed Tomography with Circular and Helical Sampling

Biomet PMI. Patient-Matched Implants. CT Protocols

Loma Linda University Medical Center Dept. of Radiation Medicine

Realworks Software. A Powerful 3D Laser Scanning Office Software Suite

5 member consortium o University of Strathclyde o Wideblue o National Nuclear Laboratory o Sellafield Ltd o Inspectahire

Registration concepts for the just-in-time artefact correction by means of virtual computed tomography

FAST FINITE ELEMENTS FOR SURGERY SIMULATION

Increasing the accuracy with a rich sensor system for robotic laser osteotomy

A DICOM-based streaming service for the Digital Operating Room

A Fast and Stable Approach for Restoration of Warped Document Images

Measurements using three-dimensional product imaging

MEDICAL IMAGING 2nd Part Computed Tomography

CS 231. Deformation simulation (and faces)


(Refer Slide Time: 00:01:27 min)

Unwrapping of Urban Surface Models

Shadow casting. What is the problem? Cone Beam Computed Tomography THE OBJECTIVES OF DIAGNOSTIC IMAGING IDEAL DIAGNOSTIC IMAGING STUDY LIMITATIONS

Animating cuts with on-the-fly re-meshing

Discrete Estimation of Data Completeness for 3D Scan Trajectories with Detector Offset

A Control Technique for a 6-DOF Master-Slave Robot Manipulator System for Miniature Tasks

(12) Patent Application Publication (10) Pub. No.: US 2011/ A1

Texture Mapping using Surface Flattening via Multi-Dimensional Scaling

technical notes trimble realworks software

HIGH PRECISION SURVEY AND ALIGNMENT OF LARGE LINEAR COLLIDERS - HORIZONTAL ALIGNMENT -

MODERN DIMENSIONAL MEASURING TECHNIQUES BASED ON OPTICAL PRINCIPLES

THE USE OF OPTICAL METHODS FOR LEAK TESTING DAMPERS

Trimble Realworks Software

3D SPATIAL DATA ACQUISITION AND MODELING OF ANGHEL SALIGNY MONUMENT USING TERRESTRIAL LASER SCANNING

Neue Verfahren der Bildverarbeitung auch zur Erfassung von Schäden in Abwasserkanälen?

An Acquisition Geometry-Independent Calibration Tool for Industrial Computed Tomography

Basic principles of MR image analysis. Basic principles of MR image analysis. Basic principles of MR image analysis

[PDR03] RECOMMENDED CT-SCAN PROTOCOLS

ANALYTICAL MODEL OF THE CUTTING PROCESS WITH SCISSORS-ROBOT FOR HAPTIC SIMULATION

SURROUND 3-DIMENSIONAL SCANNER

coding of various parts showing different features, the possibility of rotation or of hiding covering parts of the object's surface to gain an insight

DESIGN AND ANALYSIS OF ORTHOGONALLY COMPLIANT FEATURES FOR DURAFORM/SLS MANUFACTURED PLATES

GPU Supported Haptic Device Integrated Dental Simulation Environment

IJCSI International Journal of Computer Science Issues, Vol. 9, Issue 5, No 2, September 2012 ISSN (Online):

Virtual Interaction System Based on Optical Capture

Model-based segmentation and recognition from range data

Introduction. Biomedical Image Analysis. Contents. Prof. Dr. Philippe Cattin. MIAC, University of Basel. Feb 22nd, of

Translational Computed Tomography: A New Data Acquisition Scheme

Modeling the Virtual World

LASER ADDITIVE MANUFACTURING PROCESS PLANNING AND AUTOMATION

Operation Trajectory Control of Industrial Robots Based on Motion Simulation

Ch. 4 Physical Principles of CT

THREE DIMENSIONAL DYNAMIC STRESS ANALYSES FOR A GEAR TEETH USING FINITE ELEMENT METHOD

SEOUL NATIONAL UNIVERSITY

RADIOMICS: potential role in the clinics and challenges

Fracture & Tetrahedral Models

On an empirical investigation of the structural behaviour of robots

SIMULATION OF ELASTIC SOFT TISSUE DEFORMATION IN ORTHODONTICS BY MASS-SPRING SYSTEM

Interactive Collision Detection for Engineering Plants based on Large-Scale Point-Clouds

Physics-based Deformation for Haptic Simulation with

Investigating the influence of local fiber architecture in textile composites by the help of a mapping tool

Transcription:

Gockel, Tilo 1 /6 Interactive Simulation of Teeth Cleaning T. Gockel, T. Salb, T. Weyrich, O. Burgert, R. Dillmann Institute for Process Control and Robotics Universität Karlsruhe (TH), Department for Computer Science 76128 Karlsruhe, Germany Tel.: ++49 721 608 7132, Fax: ++49 721 608 8270 gockel@ira.uka.de, http://wwwiaim.ira.uka.de In this paper an interactive simulation system for teeth cleaning is presented. This simulation system offers assistance for optimizing design and manufacturing of new toothbrushes. Data acquisition and pre-processing techniques for the model generation are shown, an editor for modelling of the elastic behaviour of the toothbrushes parts is presented and the mathematical method for modelling of flexible parts of the toothbrush is explained. After the introduction of the PHANToM haptoid and the explanation of a new approach to collision detection, first results of the project are shown. 1 Introduction Dentists consider proper teeth brushing as the most important contribution to caries prophylaxis and plaque extinction. The efficiency of the process of teeth cleaning depends on various parameters, such as the geometry of the toothbrush, the arrangement of the bristles on the toothbrush s head and the right cleaning strategy. In this paper we present an interactive simulation system for teeth cleaning. This simulation offers valuable assistance for optimizing the design and manufacturing of new toothbrushes. Benefit is also granted to researchers in oral health care. The simulation system allows early tests of the functionality of future brush generations and enables the engineers to estimate the effects of design changes in an early state of the manufacturing process. Furthermore, the simulation system offers a cost-efficient way to experiment with different designs and functional properties in the development process of toothbrushes. It also allows the validation of the efficiency of certain brush types and bristle configurations. First in this paper, data acquisition for jaw and brush models and pre-processing techniques for the model generation are shown. Then, an editor for modelling of the elastic behaviour of the toothbrush handle and the toothbrushes bristles is presented. Afterwards, we explain the mathematical method for modelling of flexible parts of the toothbrush. In the next paragraph we describe the integration of the PHANToM haptoid in the simulation system and we explain the occurring difficulties and constraints using the PHANToMs GHOST library,

Gockel, Tilo 2 /6 leading to a new approach to collision detection. The paper finishes with the presentation of the results and with a view on further work to be done in future. 2 Methods 2.1 Data acquisition and conversion For a realistic simulation of the teeth-brushing process three-dimensional models of the toothbrush and the jaws are needed. CAD models of different toothbrush handles were provided by our industrial partner, CT scans of plaster casts from individual probands were used as jaw data sets. The generation of Open Inventor models (i.e. surface models) out of the CT slice images required several data conversion tools. Nevertheless the quality of the resulting jaw data is limited through the thickness of the CT slices of about 1.4 mm. Figure 1: Textured jaw, derived from pattern scanner data through triangulation Lateron we used different 3D-surface scanners, obtaining the best results with a pattern scanner that was developed exactly for this application (Figure 1). 2.2 Interactive cutting of the toothbrush datasets Modelling of the elastic behaviour of the toothbrush required a tool for cutting the data sets of the toothbrush handle at desired joint points (figure 2). Cutting a part out of a surface data set is not trivial: if the cutting plane does not lie across the edge of a triangle one has to calculate new triangles with new edges. Furthermore we decided to insert spheres at the joint points to keep the gaps that emerge when moving the segments invisible. The cut segments are the Finite Elements for the next step: Modelling of the flexible behaviour of the toothbrush with the Finite Elements Method.

Gockel, Tilo 3 /6 Figure 2: IV Cut tool in interactive mode with opened script file editor 2.3 Modelling of flexible areas and bristles For modelling the flexible behaviour of the toothbrush s handle and bristles, a basic Finite Element model is used. First, the flexible area is divided into individual segments. Then each of these elements is modelled as a bending beam. The analytical solution of the differential equation for one single bending beam is given by a polynomial function. Taking this polynom as an approach for the solution of the problem within the Finite Element Method, we can provide precise functional values for the contact points between the different equidistant elements. A single bristle is currently modelled by five equidistant bending beams. Taking forces and torques as input values and positions and angles as output values, a 10-dimensional equation system describes the relationship between these mathematical entities. Due to the dependencies between adjacent segments, a 10x10-matrix A, containing the single polynomial equations, represents the Finite Element model for a bristle. Considering additional conditions to be fulfilled by these equations, the resulting matrix A is a sparse matrix. The equation Α*x = b represents the solution of the Finite Element calculation for a bristle whereby b is a 10-dimensional vector that specifies the forces and torques on each segment and x determines the new position and angle values of the segment after application of the forces and torques. The emerging system of equations is solved using the L/Udecomposition. 2.4 Haptic user interface A fairly realistic behaviour of a simulation system can be achieved using an adequate user interface. For our work, we integrated a PHANToM haptic feedback device in our simulation system. Force-feedback can easily be simulated by programming a force field using the GHOST library delivered with the device. The force-feedback device plays the role of a virtual toothbrush. Calibration and tracking of a toothbrush using the PHANToM have been implemented.

Gockel, Tilo 4 /6 For the tracking feature a mode called Multitrack allows to switch between the view of the toothbrush, the view of a simulated PHANToM with the brush or the view of the trajectory reached by the toothbrush. Furthermore, a simulation of the PHANToM s overall functionality is available. 2.5 Collision detection between toothbrush and teeth The detection and visualization of collisions between the toothbrush and the teeth in the simulation system is of high importance for the whole project. As we want to simulate plaque extinction in a later period of the project we need the possibility to simulate contact of a toothbrush with certain surfaces, independent of the type of these structures which may represent teeth, plaque or some kind of soft tissue which is situated in the oral area. With the delivered software library of the PHANToM, the GHOST library, it is impossible to handle more than one collision point (i.e. one bristle), so we had to implement a new voxel-based algorithm for collision detection which is quite complex but nevertheless quite elegant: Given a (binary) voxel representation of the teeth, one can, using the Euclidian Distance Transformation, substitute the 1 or 0 in the representation of the object (inside or outside the object) with the length of the vector pointing directly to the surface of the object. This is the force vector, describing the reverse force effecting the colliding object, in our case the toothbrush. Furthermore given a surface model-based representation of the toothbrush and letting it literally dive inside the teeth, one can sum up all the force vectors that point backwards and one can calculate the resulting force vector for the PHANToM user. This diving process has to be simulated via the FEM analysis as a bending of the bristles at the surface of the teeth. Figure 3 shows one result of this implementation; for reasons of simplicity and to speed up the application, a sphere is chosen as simple volumetric object. Figure 3: Bristle deformation and collision detection on simple volumetric object (sphere)

Gockel, Tilo 5 /6 Despite of the elegance of this algorithm, it requires a lot of computing time, but these calculations can be done offline, before the simulation starts. 3 Results A first prototype of our system has been established, using a two-processor SGI Octane SSI (400MHz, V8 graphics), together with a 1.5A PHANToM device of SensAble Technologies Inc. The software modules described above have been implemented and form a powerful simulation application. By now it is possible to simulate the movements of the toothbrush s handle and of bristle bundles on the toothbrush s head considering the material properties specified by the user. Furthermore the system is capable of recording the trajectories of the toothbrush s head and thus recording the brushing behaviour of different users. Soon we will do test runs with probands at our university to compare different teethbrushing methods. Figure 4: Test person using the simulation environment The described algorithm for multi-point collision detection is implemented and is working well with simple models. Due to hardware limitations the system is in this state not capable of handling the original datasets, containing about 200.000 triangles for visualization and about 2..5 million voxels for the haptic model. A hardware upgrade is ordered already and different mechanisms for reducing the data sets and smoothing the resulting data are already implemented with good results. Multi-point collision detection in the original model dataset will be the next milestone on the way towards simulation of single bristles instead of bristle bundles. 4 Discussion In this paper a 3D graphical simulation system for visualization and analysis of teeth brushing has been presented. The system is based on the Open Inventor Object Library. With the given import filters, standard jaw data sets may be used as well as patient individual data. Toothbrush datasets are modelled using original CAD data and specific bristle models.

Gockel, Tilo 6 /6 Behaviour of flexible elements of the brushes like the bristles and parts of the handle are modelled using the Finite-Element Method. The human machine interface of the system combines a haptic feedback device with a graphical user interface. First results are promising and the system will be refined. Future work will concentrate on collision detection and contact analysis for the toothbrush and the teeth leading over towards the modeling and simulation of single toothbrush fibers and their interaction. Moreover, we will implement a reachability analysis for the brush and especially the bristles in order to control which points in the oral space are touched by the brush. Possible enhancements of the project include also the integration of this work into a pre-operative planning system for cranio-facial surgery and the combination of this work with an experimental setup for intraoperative support of surgeons. Acknowledgement This research was performed at the Institute for Process Control and Robotics, in the group of Prof. Dr.-Ing. R. Dillmann, Universität Karlsruhe (TH), Germany. The work was initiated and funded by an industrial partner of our institute. References [1] E. de Arantes e Oliveira. Theoretical Foundations of the Finite Element Method. International Journal of Solids and Structures, Vol. 4, 1968. [2] R. Schwarz. Methode der finiten Elemente. Teubner, 1994. (German) [3] M. Alcañiz, V. Grau, C. Monserrat, C. Juan and S. Albalat. A system for simulation and planning of orthodontic treatment using a low cost 3D laser scanner for dental anatomy capturing. In Medicine Meets Virtual Reality 7, pages 8-14, San Diego, CA, Jan 1999. IOS Press and Ohmsha. [4] H. Schaude et al. Dokumentation für KaVis. Technical report, Universität Karlsruhe (TH), Institute for Process Control and Robotics, Germany, 1997. (German) [1] SensAble Technologies Inc. PHANToM Haptic Interface Hardware Installation and Technical Manual. Technical report, Cambridge, MA, 1997. [6] SensAble Technologies Inc. GHOST SDK Programmer s Guide Version 2.1. Technical report, Cambridge, MA, 1999. [7] T. Weingärtner, S. Hassfeld and R. Dillmann. Virtual Jaw: A 3D Simulation for Computer Assisted Surgery and Education. In Medicine Meets Virtual Reality 6, San Diego, CA, Jan. 1998. IOS Press and Ohmsha. [8] T. Salb, J. Brief, O. Burgert, S. Hassfeld, J. Mühling and R. Dillmann. An augmented reality system for intraoperative presentation of planning and simulation results. In 2nd EUREL Worskhop on Medical Robotics, Pisa, Italy, September 1999. [9] Fa. Girrbach-Dental. Product Description DIGIDENT - Teeth-Scanning and Milling of Replacements. http://www.girrbach.de/d/ds/index.html. (German) [10] T. Weyrich. Kollision volumetrischer Körper mit einer als binäres Voxelbild gegebenen Umgebung. Universität Karlsruhe, IPR Institute für Process Control and Robotics, Technical Report, IPR, 13. April 2000. (German)