A New Method for CT to Fluoroscope Registration Based on Unscented Kalman Filter
|
|
- Peregrine Poole
- 5 years ago
- Views:
Transcription
1 A New Method for CT to Fluoroscope Registration Based on Unscented Kalman Filter Ren Hui Gong, A. James Stewart, and Purang Abolmaesumi School of Computing, Queen s University, Kingston, ON K7L 3N6, Canada purang@cs.queensu.ca Abstract. We propose a new method for CT to fluoroscope registration which is very robust and has a wide capture range. The method relies on the Unscented Kalman Filter to search for an optimal registration solution and on modern commodity graphics cards for fast generation of digitally reconstructed radiographs. We extensively test our method using three different anatomical data sets and compare it with an implementation of the commonly used simplex-based method. The experimental results firmly support that, under the same testing conditions, our proposed technique outperforms the simplex-based method in capture range while providing comparable accuracy and computation time. 1 Introduction Registration of CT to fluoroscope images is a fundamental task in Computer- Assisted Orthopaedic Surgery (CAOS) and Radiotherapy (CART). In the case of CAOS, registration of preoperative CT to a set of intraoperative fluoroscope images can be used to map the virtual patient (i.e. the preoperative CT) displayed on a screen to the physical patient in the operating room (OR). The registration precisely links the points in CT with the corresponding points in OR so that the CT can be used to guide the intervention. In the case of CART, registration of CT to portal images allows precise configuration of treatment beams so that the radiations are focused on tumors/lesions thus the damage to healthy tissues remains minimal. The CT to fluoroscope registration problem can be briefly described as finding a geometric transform that brings CT, denoted moving data, to the patient s coordinate frame, in which fluoroscope images, denoted fixed data, are captured on the fly during the surgery or treatment. It involves determining the type of the transform as well as an initial guess of its parameters, defining a similarity measure between CT and fluoroscope images, and selecting an optimization method that updates the parameters iteratively until an optimal similarity value is achieved. A clinically usable CAOS or CART system requires accurate, fast and robust registration between the fixed and the moving data. A number of methods have been proposed to address the CT to fluoroscope registration problem in the past decade. Based on what type of information is used in registration, these methods can be roughly classified into three categories [1]: R. Larsen, M. Nielsen, and J. Sporring (Eds.): MICCAI 26, LNCS 419, pp , 26. c Springer-Verlag Berlin Heidelberg 26
2 892 R.H. Gong, A.J. Stewart, and P. Abolmaesumi feature-based, intensity-based and hybrid methods. Feature-based methods extract geometric features, such as landmarks, curves and surfaces, from both CT and fluoroscope images and use them in the subsequent registration. This class of methods is often more efficient because reduced amount of data are involved. However, the errors in feature extraction propagate to errors in registration. Intensitybased methods directly use all or partial intensity values in the original images and no feature extraction is required. This group of methods tends to be more accurate and robust, but at the same time, their computation costs are usually more expensive. The hybrid methods have both advantages and aim to provide accurate and fast registrations. CT to fluoroscope registration is a 2D-3D registration problem, in which one key challenge is to find an appropriate way to compare 3D CT with 2D fluoroscope. One solution is to generate intermediate simulated fluoroscope images, called digitally reconstructed radiographs (DRRs), from CT and compare them with the corresponding real fluoroscope images. Alternatively, one can reconstruct a 3D volume from the fluoroscope images and compare it with the 3D CT [1]. Majority of current methods fall into the first category, and have focused on fast DRR generation methods [2, 3, 4, ] or robust similarity measures [6, 7, 8, 4] between DRR and fluoroscope, and have relied on simplex or gradient descent [8] to search for an optimal registration. In this paper, we propose to use the Unscented Kalman Filter (UKF) as the optimization method. UKF has some features that could potentially benefit the CT to fluoroscope registration problem, e.g. no derivatives calculation is required, dealing with multiple observations simultaneously, estimating the variance along with the state, etc. To validate [9] our approach, we extensively test our method on various phantom data sets and compare the results with those of a simplex-based approach. The remaining of this paper is organized as follows: We explain our method in details in Section 2; Section 3 describes the testing scenarios and presents the experimental results; and Section 4 concludes the paper. 2 Methods In this section we discuss the major constituents of our method, i.e. the spatial transform, the similarity measure, the UKF-based optimization algorithm, and a hardware-based DRR generation technique. 2.1 Transform For CT to fluoroscope registration, a rigid transform is a natural choice in order to bring CT points into the patient s coordinate frame. The transform has six parameters: three Euler angles in degrees for rotation and three scalars in millimeters for translation. This representation was chosen because 1) it has fewer parameters compared with the cases that rotation is represented using quarternion or angle-axis, and 2) the rotation and translation components have same or similar dynamic ranges. The number of parameters and the scales
3 A New Method for CT to Fluoroscope Registration 893 between parameters are important factors that may have significant impact on the performance and robustness of a registration algorithm. An initial guess of the transform parameters is required to start the registration. This is done by manually selecting a few landmarks from CT, e.g. 3-4 points on the bone surface, and identifying their correspondences in the fluoroscope images, then the initial value is computed by solving an absolute orientation problem using singular value decomposition [1]. The chosen landmarks should be visible in both CT and fluoroscope images. If they are carefully selected and identified, the computed initial transform can yield an initial mean target registration error (mtre) within 3cm, which is often enough to start our registration method. 2.2 Similarity Measure Similarity measure is a metric that judges how similar the two compared data sets are. It is a function of the transform parameters and is computed from either the intensities or the extracted features of the two data sets being registered. The function can be linear or nonliner, and can have a single value or multiple values. For some similarity measures, the derivatives w.r.t. transform parameters can be computed at low cost, while for some other similarity measures, direct calculation of derivatives is not possible. A variety of similarity measures [6, 7, 8, 4] have been suggested for comparing DRR with fluoroscope. The commonly used ones are normalized correlation (NC), variance-weighted correlation (VWC), mutual information (MI), pattern intensity (PI), gradient difference (GD), and gradient correlation (GC). These are highly nonlinear functions and, except for MI [8], explicit calculation of derivatives is not possible. Each function is suitable for a different situation and has different computation cost. Thus our method was designed in a way that all current measures can be used. Due to the loss of depth information during fluoroscope acquisition, one single fluoroscope is often not enough to reach an accurate registration, thus multiple fluoroscope images from different viewpoints are used in our approach, which means our similarity measure is multiple valued and each value corresponds to a DRR, fluoroscope pair. Most current methods for CT to fluoroscope registration combine the values during the optimization process, in which information is lost. 2.3 Optimization As most current similarity measures for CT to fluoroscope registration are nonlinear, no direct derivatives and multi-valued, we adopted UKF [11] as the optimization method in our approach. UKF is a sequential least squares optimization technique employed for solving nonlinear systems. It estimates both the state and the state variance, and deals with multiple observations simultaneously during the estimation process. It requires no derivatives, Jacobian or Hessian calculations. Instead, UKF uses the Unscented Transform (UT) [11] to carefully select a minimal set of sample points to learn about the behaviors of a nonlinear system.
4 894 R.H. Gong, A.J. Stewart, and P. Abolmaesumi The sample points completely capture the true mean and variance of the state and, when propagating through the true nonlinear system, capture the posterior mean and variance accurately up to at least the second order Taylor series approximation. We use UKF to estimate the transform parameters in a chosen similarity measure. The system models (state and observation) have the following forms: x i = x i 1 + N(,s 2 x ) (1) y i = SM(x i )+N(,s 2 y) where x is the transform parameters to be estimated, SM is the nonlinear similarity measure between the DRRs and the corresponding fluoroscope images, σ x and σ y are the variances of the process and measurement noises intrinsic to the system. As multiple fluoroscope images are used in our method, y is a multidimensional measurement vector. The UKF algorithm recursively estimates the state and its variance. Figure 1 outlines the algorithm. Input: Initial state and its variance A sequence of observations (constant in our problem) UKF parameters Initialize UKF with the provided UKF parameters Until a satisfying SM value is achieved, do Generate sample points from the current state and variance using UT Propagate the points through the state and observation models sequentially Compute the gain using the results from the previous step Update the state and variance using the computed gain and current observations Fig. 1. The Unscented Kalman Filter (UKF) algorithm The UKF parameters have great impact on the convergence speed, and were determined empirically by try and fail. The observations are the target value of the chosen similarity measure, which are constant and known in our problem, e.g. 1. for normalized correlation. 2.4 DRR Generation We use an improved hardware-based technique, i.e. the Adaptive Slice Geometry Volume Rendering Algorithm [2], to speed up the DRR generation process. The algorithm improves the common view-aligned 3D texture-mapping based method by adaptively slicing the volume based on image content. Firstly, the CT is partitioned into a set of axis-aligned bounding boxes (AABBs) based on a user-defined transfer function that removes the empty voxels. Then the AABBs are sliced perpendicular to the viewing direction (i.e. the focal axis of the C-arm) in order back to front. Finally, the powerful OpenGL features of consumer-grade graphics cards, including 3D texture mapping, multi-texturing, and fragment programs, are employed to render and blend the slices into a final
5 A New Method for CT to Fluoroscope Registration 89 DRR. We tested our implementation on an ATI Radeon X8 card with 26MB video memory by rendering CT volumes of size 12x12x26 into DRRs of size 473x473, and have achieved the speed of 2- frames per second, depending on the image content in CT. 3 Experiments and Results We evaluate our method using images of three different phantoms: a small scaphoid bone, a large pelvis, and a long and thin femur, all with embedded fiducial markers for gold-standard validations. A general simplex-based method was implemented along with the UKF approach for the purpose of comparison. For all the experiments, normalized correlation was used as the similarity measure, and the same set of observation and measurement noise assumptions were made for all UKF experiments. We first ran experiments using synthetic fluoroscope images, i.e. DRRs, in which case the gold-standard is known. For each bone, a set of DRRs from three orthogonal views were generated with the CT positioned at the origin of patient s coordinate frame. To find whether viewing angle of fluoroscope affect the method or not, a second set of DRRs was also generated for the scaphoid bone by rotating the CT about axis (1,1,1) for 4 degrees. Next we did experiments using real fluoroscope images and used the embedded fiducials for validation. Four metal markers were attached to the femur surface and visible on both CT and fluoroscope images. We reconstructed 3D markers from the fluoroscope images by back-projection, which were then registered to the CT markers using a fiducial registration [1]. The registration result was used as the gold-standard. For each experiment, the corresponding method ran 1 times with the initial transforms generated by adding random rotations (±12 ) and translations (±12mm) to the gold-standard. We then recorded the initial and s. The mtre was computed as the average difference between the positions of a point set mapped by the evaluated transform and the gold-standard transform. 2 randomly selected points from the region bounding the bone were used when calculating the mtres. Figure 2 shows the initial and s for each experiment. Obviously, the UKF-based method consistently worked well for the full range (-2mm) of initial errors, while the simplex-based method worked well only for the range (-mm). A registration is said failed if the is larger than 2mm for synthetic fluoroscope experiments, or 3mm for real fluoroscope experiments. We define accuracy as the mean of the s of all successful registrations, and capture range as the that at least 9% of registrations succeed if they are within the range. Figure 3 shows the distributions of the s for selected experiments. It is obvious that the two methods achieved similar accuracies. Table 1 shows the capture range for each experiment. Again the UKF-based method obtained larger capture ranges for all experiments. Because the time spent in DRR generation is dominant in both methods, we use the average number of DRR generations as the measure to evaluate the
6 896 R.H. Gong, A.J. Stewart, and P. Abolmaesumi Scaphoid CT to DRRs pose 1 UKF-based Method Simplex-based Method Scaphoid CT to DRRs pose Pelvis CT to DRRs Femur CT to DRRs Femur CT to fluoroscopes Fig. 2. Initial and s for each experiment. Left column: results of UKFbased method. Right column: results of simplex-based method. The first four rows show results for the CT to DRRs registration experiments, and the last row shows the results for the CT to fluoroscope registration experiments. All units are millimeters. Final mtres above 2mm are removed from the graphs (approximately 3% of the total points for the UKF-based experiments of scaphoid and pelvis). computation time. We have observed that, if initialized properly, the UKF-based method required slightly more DRR generations than the simplex-based method to reach a successful registration. But the differences were very small (within
7 A New Method for CT to Fluoroscope Registration 897 Scaphoid CT to DRRs pose 1 Pelvis CT to DRRs Femur CT to fluoroscopes Fig. 3. Distributions of s for selected experiments. The first row shows the results for the UKF-based method, and the second row shows the results for the simplex-based method. The units of s are millimeters. Table 1. Capture ranges for all experiments Scaphoid pose 1 Scaphoid pose 2 Pelvis Femur CT to DRRs Femur CT to fluoros UKF 12mm 12mm 2mm 2mm 11mm Simplex.8mm.mm 9.6mm 9.2mm 8mm rotx roty rotz 6 transx transy transz variance 4 variance iteration number iteration number Fig. 4. The variance curves of one experiment (CT to DRRs registration, femur data). Left: the variance curves for rotation parameters. Right: the variance curves for translation parameters. DRR generations, which takes less than seconds for a graphics card producing DRRs at rate 3fps). We also observed that, if the initial position was far away from the gold-standard, at some point the UKF-based method required less DRR generations than the simplex-based method, which indicates that the UKF-based method has faster convergence speed. The variance provided along with the state by UKF gives additional information about the confidence on transform parameters. If the variance of a parameter is small enough, we say that the estimated parameter value is accurate. The variance curves will tell whether the registration converges or diverges. Figure 4 shows
8 898 R.H. Gong, A.J. Stewart, and P. Abolmaesumi in one experiment how the variance of each parameter changes as the registration converges to the gold-standard. 4 Conclusions We presented a new method for CT to fluoroscope registration that uses UKF to search for an optimal solution and a hardware-based volume rendering technique for fast DRR generation. The experimental results showed that our method outperformed the simplex-based method by having a larger capture range while providing comparable accuracy and computation time. In addition, the new method provides the variance of the resulting parameters as a by-product, which can be used as an additional metric to judge the confidence about the registration. We can conclude that, in the situations that simplex-based method could not perform consistently well, UKF is a preferable alternative choice for the 2D-3D registration problems. Future work will include the extension of the method to register multi-fragment bone fractures simultaneously to a set of intra-operative fluoroscope images. Finding the UKF parameters in a systematic way is also an area deserving further research. References 1. Tomazevic, D., Likar, B., Permus, F.: 3-d/2-d registration by integrating 2-d information in 3-d. IEEE Trans. Med. Imag. 2(1) (26) Bethune, C., Stewart, J.: Adaptive slice geometry for hardware-assisted volume rendering. Journal of Graphics Tools 1(1) (2) 7 3. Russakoff, D., Rohlfing, T., Rueckert, D., Shahidi, R., Kim, D., Maurer, C.: Fast calculation of digitally reconstructed radiographs using light fields. In: Medical Imaging. (23) 4. J.Bayouth, D.L., Kanade, T.: Transgraph: Interactive intensity-based 2-d/3-d registration of x-ray and ct data. SPIE Medical Imaging 3979 (2) Lacroute, P., Levoy, M.: Fast volume rendering using a shear-warp factorization of the viewing transformation. Computer Graphics 28 (1994) Penney, G., Weese, J., Little, J., Desmedt, P., Hill, D., Hawkes, D.: A comparison of similarity measures for use in 2-d/3-d medical image registration. IEEE Trans. Med. Imag. 17(4) (1998) Livyatan, H., Yaniv, Z., Joskowicz, L.: Gradient-based 2-d/3-d rigid registration of fluoroscopic x-ray to ct. IEEE Trans. Med. Imag. 22(11) (23) Zollei, L., Grimson, E., Norbash, A., Wells, W.: 2d-3d rigid registration of x- ray fluoroscopy and ct images using mutual information and sparsely sampled histogram estimators. CVPR 2 (21) van de Kraats, E., Penney, G., Tomazevic, D., van Walsum, T., Niessen, W.: Standardized evaluation of 2d-3d registration. In: MICCAI. (24) Tang, T., Ellis, R., Fichtinger, G.: Fiducial registration from a single x-ray image: A new technique for fluoroscopic guidance and radiotherapy. In: MICCAI. (2) Wan, E., van der Merwe, R.: The unscented kalman filter for nonlinear estimation. In: IEEE Symposium 2 (AS-SPCC). (2)
Recovery of 3D Pose of Bones in Single 2D X-ray Images
Recovery of 3D Pose of Bones in Single 2D X-ray Images Piyush Kanti Bhunre Wee Kheng Leow Dept. of Computer Science National University of Singapore 3 Science Drive 2, Singapore 117543 {piyushka, leowwk}@comp.nus.edu.sg
More informationAssessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model
Assessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model Jianhua Yao National Institute of Health Bethesda, MD USA jyao@cc.nih.gov Russell Taylor The Johns
More informationAn Iterative Framework for Improving the Accuracy of Intraoperative Intensity-Based 2D/3D Registration for Image-Guided Orthopedic Surgery
An Iterative Framework for Improving the Accuracy of Intraoperative Intensity-Based 2D/3D Registration for Image-Guided Orthopedic Surgery Yoshito Otake 1, Mehran Armand 2, Ofri Sadowsky 1, Robert S. Armiger
More informationIntraoperative Prostate Tracking with Slice-to-Volume Registration in MR
Intraoperative Prostate Tracking with Slice-to-Volume Registration in MR Sean Gill a, Purang Abolmaesumi a,b, Siddharth Vikal a, Parvin Mousavi a and Gabor Fichtinger a,b,* (a) School of Computing, Queen
More informationA Novel 2D-3D Registration Algorithm for Aligning Fluoro Images with 3D Pre-op CT/MR Images
A Novel 2D-3D Registration Algorithm for Aligning Fluoro Images with 3D Pre-op CT/MR Images Hari Sundar* 1, 2, Ali Khamene 1, Chenyang Xu 1, Frank Sauer 1, Christos Davatzikos 2 1 Siemens Corporate Research,
More informationDepth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences
Depth-Layer-Based Patient Motion Compensation for the Overlay of 3D Volumes onto X-Ray Sequences Jian Wang 1,2, Anja Borsdorf 2, Joachim Hornegger 1,3 1 Pattern Recognition Lab, Friedrich-Alexander-Universität
More information2D/3D Registration Based on Volume Gradients
2D/3D Registration Based on Volume Gradients Wolfgang Wein, Barbara Röper 2 and Nassir Navab Computer Aided Medical Procedures (CAMP) Group, TU Munich Boltzmannstr. 3, 85748 Garching, Germany 2 Clinic
More informationGPU-ACCELERATED DIGITALLY RECONSTRUCTED RADIOGRAPHS
GPU-ACCELERATED DIGITALLY RECONSTRUCTED RADIOGRAPHS Daniel Ruijters X-Ray Predevelopment Philips Medical Systems Best, the Netherlands email: danny.ruijters@philips.com Bart M. ter Haar Romeny Biomedical
More informationA Radiometry Tolerant Method for Direct 3D/2D Registration of Computed Tomography Data to X-ray Images
A Radiometry Tolerant Method for Direct 3D/2D Registration of Computed Tomography Data to X-ray Images Transfer Function Independent Registration Boris Peter Selby 1, Georgios Sakas 2, Stefan Walter 1,
More informationRegistration of 2D to 3D Joint Images Using Phase-Based Mutual Information
Registration of 2D to 3D Joint Images Using Phase-Based Mutual Information Rupin Dalvi a1, Rafeef Abugharbieh a, Mark Pickering b, Jennie Scarvell c, Paul Smith d a Biomedical Signal and Image Computing
More informationNavigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images
Navigation System for ACL Reconstruction Using Registration between Multi-Viewpoint X-ray Images and CT Images Mamoru Kuga a*, Kazunori Yasuda b, Nobuhiko Hata a, Takeyoshi Dohi a a Graduate School of
More informationBone tracking from X-Ray sequences
Bone tracking from X-Ray sequences Laura Sevilla Lara May 15, 2009 1 Introduction 1.1 Definition of the problem Bone tracking from X-Ray sequences is important for biological and evolutionary applications
More informationGradient-Based Differential Approach for Patient Motion Compensation in 2D/3D Overlay
Gradient-Based Differential Approach for Patient Motion Compensation in 2D/3D Overlay Jian Wang, Anja Borsdorf, Benno Heigl, Thomas Köhler, Joachim Hornegger Pattern Recognition Lab, Friedrich-Alexander-University
More informationA global optimization strategy for 3D-2D registration of vascular images
1 A global optimization strategy for 3D-2D registration of vascular images K. K. Lau and Albert C. S. Chung Lo Kwee-Seong Medical Image Analysis Laboratory, Department of Computer Science and Engineering,
More informationMarkov Random Field Optimization for Intensity-based 2D-3D Registration
Markov Random Field Optimization for Intensity-based 2D-3D Registration Darko Zikic, Ben Glocker, Oliver Kutter, Martin Groher, Nikos Komodakis 2, Ali Khamene 3, Nikos Paragios 4,5, and Nassir Navab Computer
More information2D-3D Registration using Gradient-based MI for Image Guided Surgery Systems
2D-3D Registration using Gradient-based MI for Image Guided Surgery Systems Yeny Yim 1*, Xuanyi Chen 1, Mike Wakid 1, Steve Bielamowicz 2, James Hahn 1 1 Department of Computer Science, The George Washington
More informationOn the Design and Experiments of a Fluoro-Robotic Navigation System for Closed Intramedullary Nailing of Femur
On the Design and Experiments of a Fluoro-Robotic Navigation System for Closed Intramedullary Nailing of Femur Sakol Nakdhamabhorn and Jackrit Suthakorn 1* Abstract. Closed Intramedullary Nailing of Femur
More informationSupport Vector Machine Density Estimator as a Generalized Parzen Windows Estimator for Mutual Information Based Image Registration
Support Vector Machine Density Estimator as a Generalized Parzen Windows Estimator for Mutual Information Based Image Registration Sudhakar Chelikani 1, Kailasnath Purushothaman 1, and James S. Duncan
More informationCalibration Method for Determining the Physical Location of the Ultrasound Image Plane
Calibration Method for Determining the Physical Location of the Ultrasound Image Plane Devin V. Amin, Ph.D. 1, Takeo Kanade, Ph.D 1., Branislav Jaramaz, Ph.D. 2, Anthony M. DiGioia III, MD 2, Constantinos
More informationMulti-Slice to Volume Registration of Ultrasound Data to a Statistical Atlas of Human Pelvis
Multi-Slice to Volume Registration of Ultrasound Data to a Statistical Atlas of Human Pelvis Sahar Ghanavati a, Parvin Mousavi a,b, Gabor Fichtinger a,b,c,d, Pezhman Foroughi c and Purang Abolmaesumi a,b,d,e
More informationResponse to Reviewers
Response to Reviewers We thank the reviewers for their feedback and have modified the manuscript and expanded results accordingly. There have been several major revisions to the manuscript. First, we have
More informationNon-rigid 2D-3D image registration for use in Endovascular repair of Abdominal Aortic Aneurysms.
RAHEEM ET AL.: IMAGE REGISTRATION FOR EVAR IN AAA. 1 Non-rigid 2D-3D image registration for use in Endovascular repair of Abdominal Aortic Aneurysms. Ali Raheem 1 ali.raheem@kcl.ac.uk Tom Carrell 2 tom.carrell@gstt.nhs.uk
More informationPatch-Based Image Similarity for Intraoperative 2D/3D Pelvis Registration During Periacetabular Osteotomy
Patch-Based Image Similarity for Intraoperative 2D/3D Pelvis Registration During Periacetabular Osteotomy Robert B. Grupp 1(B), Mehran Armand 2,3, and Russell H. Taylor 1 1 Department of Computer Science,
More informationA 2D-3D Image Registration Algorithm using Log-Polar Transforms for Knee Kinematic Analysis
A D-D Image Registration Algorithm using Log-Polar Transforms for Knee Kinematic Analysis Masuma Akter 1, Andrew J. Lambert 1, Mark R. Pickering 1, Jennie M. Scarvell and Paul N. Smith 1 School of Engineering
More informationFOREWORD TO THE SPECIAL ISSUE ON MOTION DETECTION AND COMPENSATION
Philips J. Res. 51 (1998) 197-201 FOREWORD TO THE SPECIAL ISSUE ON MOTION DETECTION AND COMPENSATION This special issue of Philips Journalof Research includes a number of papers presented at a Philips
More information3D/2D Model-to-Image Registration Applied to TIPS Surgery
3D/2D Model-to-Image Registration Applied to TIPS Surgery Julien Jomier 1, Elizabeth Bullitt 2, Mark Van Horn 2, Chetna Pathak 2, and Stephen R. Aylward 1 1 Kitware Inc. 28 Corporate Drive Clifton Park,
More informationA Multi-view Active Contour Method for Bone Cement Reconstruction from C-Arm X-Ray Images
A Multi-view Active Contour Method for Bone Cement Reconstruction from C-Arm X-Ray Images Blake C. Lucas 1,2, Yoshito Otake 1, Mehran Armand 2, Russell H. Taylor 1 1 Dept. of Computer Science, Johns Hopkins
More informationHybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information
Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information Andreas Biesdorf 1, Stefan Wörz 1, Hans-Jürgen Kaiser 2, Karl Rohr 1 1 University of Heidelberg, BIOQUANT, IPMB,
More informationMarkerless Real-Time Target Region Tracking: Application to Frameless Stereotactic Radiosurgery
Markerless Real-Time Target Region Tracking: Application to Frameless Stereotactic Radiosurgery T. Rohlfing,, J. Denzler 3, D.B. Russakoff, Ch. Gräßl 4, and C.R. Maurer, Jr. Neuroscience Program, SRI International,
More informationRegistration concepts for the just-in-time artefact correction by means of virtual computed tomography
DIR 2007 - International Symposium on Digital industrial Radiology and Computed Tomography, June 25-27, 2007, Lyon, France Registration concepts for the just-in-time artefact correction by means of virtual
More informationA Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields
A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields Lars König, Till Kipshagen and Jan Rühaak Fraunhofer MEVIS Project Group Image Registration,
More information2 Michael E. Leventon and Sarah F. F. Gibson a b c d Fig. 1. (a, b) Two MR scans of a person's knee. Both images have high resolution in-plane, but ha
Model Generation from Multiple Volumes using Constrained Elastic SurfaceNets Michael E. Leventon and Sarah F. F. Gibson 1 MIT Artificial Intelligence Laboratory, Cambridge, MA 02139, USA leventon@ai.mit.edu
More information3D Statistical Shape Model Building using Consistent Parameterization
3D Statistical Shape Model Building using Consistent Parameterization Matthias Kirschner, Stefan Wesarg Graphisch Interaktive Systeme, TU Darmstadt matthias.kirschner@gris.tu-darmstadt.de Abstract. We
More informationLearning-based Neuroimage Registration
Learning-based Neuroimage Registration Leonid Teverovskiy and Yanxi Liu 1 October 2004 CMU-CALD-04-108, CMU-RI-TR-04-59 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 Abstract
More information8/3/2016. Image Guidance Technologies. Introduction. Outline
8/3/26 Session: Image Guidance Technologies and Management Strategies Image Guidance Technologies Jenghwa Chang, Ph.D.,2 Department of Radiation Medicine, Northwell Health 2 Hofstra Northwell School of
More informationStructured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov
Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter
More informationImage Guidance and Beam Level Imaging in Digital Linacs
Image Guidance and Beam Level Imaging in Digital Linacs Ruijiang Li, Ph.D. Department of Radiation Oncology Stanford University School of Medicine 2014 AAPM Therapy Educational Course Disclosure Research
More informationOverview of Proposed TG-132 Recommendations
Overview of Proposed TG-132 Recommendations Kristy K Brock, Ph.D., DABR Associate Professor Department of Radiation Oncology, University of Michigan Chair, AAPM TG 132: Image Registration and Fusion Conflict
More informationFast calculation of digitally reconstructed radiographs using light fields
Fast calculation of digitally reconstructed radiographs using light fields Daniel B. Russakoff a, Torsten Rohlfing a, Daniel Rueckert b, Ramin Shahidi a, Daniel Kim a, Calvin R. Maurer, Jr. a a Image Guidance
More informationREAL-TIME ADAPTIVITY IN HEAD-AND-NECK AND LUNG CANCER RADIOTHERAPY IN A GPU ENVIRONMENT
REAL-TIME ADAPTIVITY IN HEAD-AND-NECK AND LUNG CANCER RADIOTHERAPY IN A GPU ENVIRONMENT Anand P Santhanam Assistant Professor, Department of Radiation Oncology OUTLINE Adaptive radiotherapy for head and
More informationAutomatic 3D-to-2D registration for CT and dual-energy digital radiography for calcification detection
Automatic 3D-to-2D registration for CT and dual-energy digital radiography for calcification detection Xiang Chen Department of Radiology, Case Western Reserve University, Cleveland, Ohio 44106 and Key
More informationGood Morning! Thank you for joining us
Good Morning! Thank you for joining us Deformable Registration, Contour Propagation and Dose Mapping: 101 and 201 Marc Kessler, PhD, FAAPM The University of Michigan Conflict of Interest I receive direct
More informationMulti-modal Image Registration Using the Generalized Survival Exponential Entropy
Multi-modal Image Registration Using the Generalized Survival Exponential Entropy Shu Liao and Albert C.S. Chung Lo Kwee-Seong Medical Image Analysis Laboratory, Department of Computer Science and Engineering,
More information2D Rigid Registration of MR Scans using the 1d Binary Projections
2D Rigid Registration of MR Scans using the 1d Binary Projections Panos D. Kotsas Abstract This paper presents the application of a signal intensity independent registration criterion for 2D rigid body
More informationRIGID IMAGE REGISTRATION
RIGID IMAGE REGISTRATION Duygu Tosun-Turgut, Ph.D. Center for Imaging of Neurodegenerative Diseases Department of Radiology and Biomedical Imaging duygu.tosun@ucsf.edu What is registration? Image registration
More informationHartley - Zisserman reading club. Part I: Hartley and Zisserman Appendix 6: Part II: Zhengyou Zhang: Presented by Daniel Fontijne
Hartley - Zisserman reading club Part I: Hartley and Zisserman Appendix 6: Iterative estimation methods Part II: Zhengyou Zhang: A Flexible New Technique for Camera Calibration Presented by Daniel Fontijne
More information3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.
3D Computer Vision Structured Light II Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de 1 Introduction
More informationA Fast DRR Generation Scheme for 3D-2D Image Registration Based on the Block Projection Method
A Fast DRR Generation Scheme for 3D-2D Image Registration Based on the Block Projection Method Zhiping Mu Perspective Pixel Technologies 16192 Coastal Highway, Lewes, DE 19958 mzp@ieee.org Abstract In
More informationA SYSTEM FOR COMPUTER-ASSISTED SURGERY WITH INTRAOPERATIVE CT IMAGING
A SYSTEM FOR COMPUTER-ASSISTED SURGERY WITH INTRAOPERATIVE CT IMAGING by ANTON OENTORO A thesis submitted to the School of Computing in conformity with the requirements for the degree of Master of Science
More informationEnsemble registration: Combining groupwise registration and segmentation
PURWANI, COOTES, TWINING: ENSEMBLE REGISTRATION 1 Ensemble registration: Combining groupwise registration and segmentation Sri Purwani 1,2 sri.purwani@postgrad.manchester.ac.uk Tim Cootes 1 t.cootes@manchester.ac.uk
More informationIs deformable image registration a solved problem?
Is deformable image registration a solved problem? Marcel van Herk On behalf of the imaging group of the RT department of NKI/AVL Amsterdam, the Netherlands DIR 1 Image registration Find translation.deformation
More informationProbabilistic Tracking and Model-based Segmentation of 3D Tubular Structures
Probabilistic Tracking and Model-based Segmentation of 3D Tubular Structures Stefan Wörz, William J. Godinez, Karl Rohr University of Heidelberg, BIOQUANT, IPMB, and DKFZ Heidelberg, Dept. Bioinformatics
More informationReal-time self-calibration of a tracked augmented reality display
Real-time self-calibration of a tracked augmented reality display Zachary Baum, Andras Lasso, Tamas Ungi, Gabor Fichtinger Laboratory for Percutaneous Surgery, Queen s University, Kingston, Canada ABSTRACT
More informationLecture 8: Registration
ME 328: Medical Robotics Winter 2019 Lecture 8: Registration Allison Okamura Stanford University Updates Assignment 4 Sign up for teams/ultrasound by noon today at: https://tinyurl.com/me328-uslab Main
More informationProstate Brachytherapy Seed Reconstruction Using C-Arm Rotation Measurement and Motion Compensation
Prostate Brachytherapy Seed Reconstruction Using C-Arm Rotation Measurement and Motion Compensation Ehsan Dehghan 1, Junghoon Lee 2, Mehdi Moradi 3,XuWen 3, Gabor Fichtinger 1, and Septimiu E. Salcudean
More informationRegistration of 3D angiographic and X-ray images using Sequential Monte Carlo sampling
Registration of 3D angiographic and X-ray images using Sequential Monte Carlo sampling Charles Florin 2, James Williams 2, Ali Khamene 2, and Nikos Paragios 1 1 Ecole Nationale des Ponts et Chaussees,
More informationMethodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion
Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion Mattias P. Heinrich Julia A. Schnabel, Mark Jenkinson, Sir Michael Brady 2 Clinical
More informationSegmentation and Tracking of Partial Planar Templates
Segmentation and Tracking of Partial Planar Templates Abdelsalam Masoud William Hoff Colorado School of Mines Colorado School of Mines Golden, CO 800 Golden, CO 800 amasoud@mines.edu whoff@mines.edu Abstract
More informationModeling and preoperative planning for kidney surgery
Modeling and preoperative planning for kidney surgery Refael Vivanti Computer Aided Surgery and Medical Image Processing Lab Hebrew University of Jerusalem, Israel Advisor: Prof. Leo Joskowicz Clinical
More informationImage Registration. Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department
Image Registration Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department Introduction Visualize objects inside the human body Advances in CS methods to diagnosis, treatment planning and medical
More informationHST.582J / 6.555J / J Biomedical Signal and Image Processing Spring 2007
MIT OpenCourseWare http://ocw.mit.edu HST.582J / 6.555J / 16.456J Biomedical Signal and Image Processing Spring 2007 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.
More informationIterative CT Reconstruction Using Curvelet-Based Regularization
Iterative CT Reconstruction Using Curvelet-Based Regularization Haibo Wu 1,2, Andreas Maier 1, Joachim Hornegger 1,2 1 Pattern Recognition Lab (LME), Department of Computer Science, 2 Graduate School in
More informationHierarchical Shape Statistical Model for Segmentation of Lung Fields in Chest Radiographs
Hierarchical Shape Statistical Model for Segmentation of Lung Fields in Chest Radiographs Yonghong Shi 1 and Dinggang Shen 2,*1 1 Digital Medical Research Center, Fudan University, Shanghai, 232, China
More informationINTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1. Modifications for P551 Fall 2013 Medical Physics Laboratory
INTRODUCTION TO MEDICAL IMAGING- 3D LOCALIZATION LAB MANUAL 1 Modifications for P551 Fall 2013 Medical Physics Laboratory Introduction Following the introductory lab 0, this lab exercise the student through
More informationConfidence Weighted Local Phase Features for Robust Bone Surface Segmentation in Ultrasound
Confidence Weighted Local Phase Features for Robust Bone Surface Segmentation in Ultrasound Niamul Quader 1, Antony Hodgson 2, and Rafeef Abugharbieh 1 1 Department of Electrical and Computer Engineering
More information2D-3D Rigid-Body Registration of X-Ray Fluoroscopy and CT Images by. Lilla Zöllei
2D-3D Rigid-Body Registration of X-Ray Fluoroscopy and CT Images by Lilla Zöllei Submitted to the Department of Electrical Engineering and Computer Science in partial fulfillment of the requirements for
More informationModel-Based Validation of a Graphics Processing Unit Algorithm to Track Foot Bone Kinematics Using Fluoroscopy
Model-Based Validation of a Graphics Processing Unit Algorithm to Track Foot Bone Kinematics Using Fluoroscopy Matthew Kindig, MS 1, Grant Marchelli, PhD 2, Joseph M. Iaquinto, PhD 1,2, Duane Storti, PhD
More informationRigid and Deformable Vasculature-to-Image Registration : a Hierarchical Approach
Rigid and Deformable Vasculature-to-Image Registration : a Hierarchical Approach Julien Jomier and Stephen R. Aylward Computer-Aided Diagnosis and Display Lab The University of North Carolina at Chapel
More informationAn Automated Image-based Method for Multi-Leaf Collimator Positioning Verification in Intensity Modulated Radiation Therapy
An Automated Image-based Method for Multi-Leaf Collimator Positioning Verification in Intensity Modulated Radiation Therapy Chenyang Xu 1, Siemens Corporate Research, Inc., Princeton, NJ, USA Xiaolei Huang,
More informationIncorporation of Prior Knowledge for Region of Change Imaging from Sparse Scan Data in Image-Guided Surgery
Incorporation of Prior Knowledge for Region of Change Imaging from Sparse Scan Data in Image-Guided Surgery J. Lee a, J. W. Stayman b, Y. Otake c, S. Schafer b, W. Zbijewski b, A. J. Khanna b,d, J. L.
More information2D/3D Image Registration on the GPU
2D/3D Image Registration on the GPU Alexander Kubias 1, Frank Deinzer 2, Tobias Feldmann 1, Stefan Paulus 1, Dietrich Paulus 1, Bernd Schreiber 2, and Thomas Brunner 2 1 University of Koblenz-Landau, Koblenz,
More informationcalibrated coordinates Linear transformation pixel coordinates
1 calibrated coordinates Linear transformation pixel coordinates 2 Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration with partial
More informationComparison of Different Metrics for Appearance-model-based 2D/3D-registration with X-ray Images
Comparison of Different Metrics for Appearance-model-based 2D/3D-registration with X-ray Images Philipp Steininger 1, Karl D. Fritscher 1, Gregor Kofler 1, Benedikt Schuler 1, Markus Hänni 2, Karsten Schwieger
More informationFirst Steps in Hardware Two-Level Volume Rendering
First Steps in Hardware Two-Level Volume Rendering Markus Hadwiger, Helwig Hauser Abstract We describe first steps toward implementing two-level volume rendering (abbreviated as 2lVR) on consumer PC graphics
More informationImage Thickness Correction for Navigation with 3D Intra-cardiac Ultrasound Catheter
Image Thickness Correction for Navigation with 3D Intra-cardiac Ultrasound Catheter Hua Zhong 1, Takeo Kanade 1,andDavidSchwartzman 2 1 Computer Science Department, Carnegie Mellon University, USA 2 University
More informationGroupwise Rigid Registration of Wrist Bones
Groupwise Rigid Registration of Wrist Bones Martijn van de Giessen 1,2,3,4,FransM.Vos 1,5, Cornelis A. Grimbergen 4, Lucas J. van Vliet 1, and Geert J. Streekstra 4 1 Quantitative Imaging Group, Delft
More informationRegistration of Video Images to Tomographic Images by Optimising Mutual Information Using Texture Mapping
Registration of Video Images to Tomographic Images by Optimising Mutual Information Using Texture Mapping M. J. Clarkson, D. Rueckert, A. P. King, P. J. Edwards, D. L. G. Hill, and D. J. Hawkes Division
More informationThin Plate Spline Feature Point Matching for Organ Surfaces in Minimally Invasive Surgery Imaging
Thin Plate Spline Feature Point Matching for Organ Surfaces in Minimally Invasive Surgery Imaging Bingxiong Lin, Yu Sun and Xiaoning Qian University of South Florida, Tampa, FL., U.S.A. ABSTRACT Robust
More informationSensor-aided Milling with a Surgical Robot System
1 Sensor-aided Milling with a Surgical Robot System Dirk Engel, Joerg Raczkowsky, Heinz Woern Institute for Process Control and Robotics (IPR), Universität Karlsruhe (TH) Engler-Bunte-Ring 8, 76131 Karlsruhe
More informationImage Co-Registration II: TG132 Quality Assurance for Image Registration. Image Co-Registration II: TG132 Quality Assurance for Image Registration
Image Co-Registration II: TG132 Quality Assurance for Image Registration Preliminary Recommendations from TG 132* Kristy Brock, Sasa Mutic, Todd McNutt, Hua Li, and Marc Kessler *Recommendations are NOT
More informationAUTOMATED AND COMPUTATIONALLY EFFICIENT JOINT MOTION ANALYSIS USING LOW QUALITY FLUOROSCOPY IMAGES
AUTOMATED AND COMPUTATIONALLY EFFICIENT JOINT MOTION ANALYSIS USING LOW QUALITY FLUOROSCOPY IMAGES BY SOHEIL GHAFURIAN A dissertation submitted to the Graduate School New Brunswick Rutgers, The State University
More informationTomoTherapy Related Projects. An image guidance alternative on Tomo Low dose MVCT reconstruction Patient Quality Assurance using Sinogram
TomoTherapy Related Projects An image guidance alternative on Tomo Low dose MVCT reconstruction Patient Quality Assurance using Sinogram Development of A Novel Image Guidance Alternative for Patient Localization
More informationDetermination of rotations in three dimensions using two-dimensional portal image registration
Determination of rotations in three dimensions using two-dimensional portal image registration Anthony E. Lujan, a) James M. Balter, and Randall K. Ten Haken Department of Nuclear Engineering and Radiological
More informationFiducial localization in C-arm based Cone-Beam CT
Copyright 2009 Society of Photo-Optical Instrumentation Engineers. This paper was published in Proc. of SPIE Medical Imaging 2009: Visualization and Image-Guided Procedures, and is made available as an
More information@ Lilla Z611ei, MMI. All rights reserved. The author hereby grants to MIT permission to reproduce and
2D-3D Rigid-Body Registration of X-Ray Flouroscopy and CT Images by Lilla Z6llei Submitted to the Department of Electrical Engineering and Computer Science in partial fulfillment of the requirements for
More informationComparison of Vessel Segmentations Using STAPLE
Comparison of Vessel Segmentations Using STAPLE Julien Jomier, Vincent LeDigarcher, and Stephen R. Aylward Computer-Aided Diagnosis and Display Lab, The University of North Carolina at Chapel Hill, Department
More informationProjection-Based Needle Segmentation in 3D Ultrasound Images
Projection-Based Needle Segmentation in 3D Ultrasound Images Mingyue Ding and Aaron Fenster Imaging Research Laboratories, Robarts Research Institute, 100 Perth Drive, London, ON, Canada, N6A 5K8 ^PGLQJDIHQVWHU`#LPDJLQJUREDUWVFD
More informationImage Segmentation and Registration
Image Segmentation and Registration Dr. Christine Tanner (tanner@vision.ee.ethz.ch) Computer Vision Laboratory, ETH Zürich Dr. Verena Kaynig, Machine Learning Laboratory, ETH Zürich Outline Segmentation
More information8/2/2016. Measures the degradation/distortion of the acquired image (relative to an ideal image) using a quantitative figure-of-merit
Ke Li Assistant Professor Department of Medical Physics and Department of Radiology School of Medicine and Public Health, University of Wisconsin-Madison This work is partially supported by an NIH Grant
More informationDeformable Registration Using Scale Space Keypoints
Deformable Registration Using Scale Space Keypoints Mehdi Moradi a, Purang Abolmaesoumi a,b and Parvin Mousavi a a School of Computing, Queen s University, Kingston, Ontario, Canada K7L 3N6; b Department
More informationIndex. 3D reconstruction, point algorithm, point algorithm, point algorithm, point algorithm, 263
Index 3D reconstruction, 125 5+1-point algorithm, 284 5-point algorithm, 270 7-point algorithm, 265 8-point algorithm, 263 affine point, 45 affine transformation, 57 affine transformation group, 57 affine
More informationK-Means Clustering Using Localized Histogram Analysis
K-Means Clustering Using Localized Histogram Analysis Michael Bryson University of South Carolina, Department of Computer Science Columbia, SC brysonm@cse.sc.edu Abstract. The first step required for many
More informationNonrigid Registration using Free-Form Deformations
Nonrigid Registration using Free-Form Deformations Hongchang Peng April 20th Paper Presented: Rueckert et al., TMI 1999: Nonrigid registration using freeform deformations: Application to breast MR images
More informationCombination of Markerless Surrogates for Motion Estimation in Radiation Therapy
Combination of Markerless Surrogates for Motion Estimation in Radiation Therapy CARS 2016 T. Geimer, M. Unberath, O. Taubmann, C. Bert, A. Maier June 24, 2016 Pattern Recognition Lab (CS 5) FAU Erlangen-Nu
More informationarxiv: v1 [cs.cv] 28 Sep 2018
Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,
More informationReduction of Metal Artifacts in Computed Tomographies for the Planning and Simulation of Radiation Therapy
Reduction of Metal Artifacts in Computed Tomographies for the Planning and Simulation of Radiation Therapy T. Rohlfing a, D. Zerfowski b, J. Beier a, P. Wust a, N. Hosten a, R. Felix a a Department of
More informationBone registration with 3D CT and ultrasound data sets
International Congress Series 1256 (2003) 426 432 Bone registration with 3D CT and ultrasound data sets B. Brendel a, *,1, S. Winter b,1, A. Rick c,1, M. Stockheim d,1, H. Ermert a,1 a Institute of High
More informationScalar Data. Visualization Torsten Möller. Weiskopf/Machiraju/Möller
Scalar Data Visualization Torsten Möller Weiskopf/Machiraju/Möller Overview Basic strategies Function plots and height fields Isolines Color coding Volume visualization (overview) Classification Segmentation
More information3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery
3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery Masahiko Nakamoto 1, Yoshinobu Sato 1, Masaki Miyamoto 1, Yoshikazu Nakamjima
More informationSIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab
SIGMI Meeting ~Image Fusion~ Computer Graphics and Visualization Lab Image System Lab Introduction Medical Imaging and Application CGV 3D Organ Modeling Model-based Simulation Model-based Quantification
More information