An Automated Image-based Method for Multi-Leaf Collimator Positioning Verification in Intensity Modulated Radiation Therapy

Similar documents
Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System

HOUGH TRANSFORM CS 6350 C V

The MSKCC Approach to IMRT. Outline

Data. ModuLeaf Mini Multileaf Collimator Precision Beam Shaping for Advanced Radiotherapy

Iterative regularization in intensity-modulated radiation therapy optimization. Carlsson, F. and Forsgren, A. Med. Phys. 33 (1), January 2006.

Types of Edges. Why Edge Detection? Types of Edges. Edge Detection. Gradient. Edge Detection

Scaling Calibration in the ATRACT Algorithm

Lecture 15: Segmentation (Edge Based, Hough Transform)

Digital phantoms for the evaluation of a software used for an automatic analysis of the Winston-Lutz test in image guided radiation therapy

An Investigation of a Model of Percentage Depth Dose for Irregularly Shaped Fields

EE795: Computer Vision and Intelligent Systems

ADVANCING CANCER TREATMENT

Comparative Study of ROI Extraction of Palmprint

EE795: Computer Vision and Intelligent Systems

Robust and Accurate Detection of Object Orientation and ID without Color Segmentation

Schedule for Rest of Semester

Biomedical Image Analysis. Point, Edge and Line Detection

A Simple Automated Void Defect Detection for Poor Contrast X-ray Images of BGA

Finding 2D Shapes and the Hough Transform

Computational Algorithm for Estimating the Gradient Isocenter of an MRI Scanner

Matching. Compare region of image to region of image. Today, simplest kind of matching. Intensities similar.

Basics of treatment planning II

Iterative CT Reconstruction Using Curvelet-Based Regularization

CS4733 Class Notes, Computer Vision

APPLICATION OF RADON TRANSFORM IN CT IMAGE MATCHING Yufang Cai, Kuan Shen, Jue Wang ICT Research Center of Chongqing University, Chongqing, P.R.

2D rendering takes a photo of the 2D scene with a virtual camera that selects an axis aligned rectangle from the scene. The photograph is placed into

ADVANCING CANCER TREATMENT

Fitting: The Hough transform

Fitting: The Hough transform

A MORPHOLOGY-BASED FILTER STRUCTURE FOR EDGE-ENHANCING SMOOTHING

CHAPTER 3 DISPARITY AND DEPTH MAP COMPUTATION

SIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014

C E N T E R A T H O U S T O N S C H O O L of H E A L T H I N F O R M A T I O N S C I E N C E S. Image Operations II

Lecture 8: Fitting. Tuesday, Sept 25

Image Segmentation and Registration

An Acquisition Geometry-Independent Calibration Tool for Industrial Computed Tomography

IRIS SEGMENTATION OF NON-IDEAL IMAGES

EE 584 MACHINE VISION

Automatic segmentation of the cortical grey and white matter in MRI using a Region Growing approach based on anatomical knowledge

Image Processing Fundamentals. Nicolas Vazquez Principal Software Engineer National Instruments

Constructing System Matrices for SPECT Simulations and Reconstructions

Disclosure. Outline. Acknowledgments. Ping Xia, Ph.D., Page 1. LINAC and MLC QA for IMRT. Received research support from Siemens Medical Solutions

TomoTherapy Related Projects. An image guidance alternative on Tomo Low dose MVCT reconstruction Patient Quality Assurance using Sinogram

Automatic Image Alignment (feature-based)

Fitting: The Hough transform

Position accuracy analysis of the stereotactic reference defined by the CBCT on Leksell Gamma Knife Icon

Ultrasonic Multi-Skip Tomography for Pipe Inspection

HOUGH TRANSFORM. Plan for today. Introduction to HT. An image with linear structures. INF 4300 Digital Image Analysis

CS 231A Computer Vision (Winter 2014) Problem Set 3

Using Edge Detection in Machine Vision Gauging Applications

Computer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG.

Automatic Lung Surface Registration Using Selective Distance Measure in Temporal CT Scans

Subpixel Corner Detection Using Spatial Moment 1)

Anno accademico 2006/2007. Davide Migliore

Registration concepts for the just-in-time artefact correction by means of virtual computed tomography

MEDICAL IMAGE NOISE REDUCTION AND REGION CONTRAST ENHANCEMENT USING PARTIAL DIFFERENTIAL EQUATIONS

3D Guide Wire Navigation from Single Plane Fluoroscopic Images in Abdominal Catheterizations

Calibration of Video Cameras to the Coordinate System of a Radiation Therapy Treatment Machine

Announcements. Edges. Last Lecture. Gradients: Numerical Derivatives f(x) Edge Detection, Lines. Intro Computer Vision. CSE 152 Lecture 10

Human pose estimation using Active Shape Models

Automatic DRR Enhancement for Patient Positioning in a Radiotherapy Treatment

A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields

EN1610 Image Understanding Lab # 4: Corners, Interest Points, Hough Transform

K Means Clustering Using Localized Histogram Analysis and Multiple Assignment. Michael Bryson 4/18/2007

TEPZZ Z754_7A_T EP A1 (19) (11) EP A1 (12) EUROPEAN PATENT APPLICATION. (51) Int Cl.: A61N 5/10 ( )

Rectification of distorted elemental image array using four markers in three-dimensional integral imaging

Model Based Perspective Inversion

EE368 Project: Visual Code Marker Detection

Segmentation and Modeling of the Spinal Cord for Reality-based Surgical Simulator

CHAPTER 4 RAY COMPUTATION. 4.1 Normal Computation

SEGMENTATION OF IMAGES USING GRADIENT METHODS AND POLYNOMIAL APPROXIMATION

Facility Questionnaire PART I (General Information for 3DCRT and IMRT)

Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC

Advanced Image Reconstruction Methods for Photoacoustic Tomography

GEOG 4110/5100 Advanced Remote Sensing Lecture 4

Study on Gear Chamfering Method based on Vision Measurement

EXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,

Computer vision: models, learning and inference. Chapter 13 Image preprocessing and feature extraction

Binary Shape Characterization using Morphological Boundary Class Distribution Functions

EECS490: Digital Image Processing. Lecture #17

FAST, precise. qa software

3DVH : SUN NUCLEAR On The Accuracy Of The corporation Planned Dose Perturbation Algorithm Your Most Valuable QA and Dosimetry Tools *Patent Pending

Tomotherapy Physics. Machine Twinning and Quality Assurance. Emilie Soisson, MS

EE795: Computer Vision and Intelligent Systems

Face Recognition At-a-Distance Based on Sparse-Stereo Reconstruction

Chapter 4. Clustering Core Atoms by Location

CHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS

Texture Mapping using Surface Flattening via Multi-Dimensional Scaling

Cover Page. Abstract ID Paper Title. Automated extraction of linear features from vehicle-borne laser data

Broad field that includes low-level operations as well as complex high-level algorithms

Computer Vision I. Announcement. Corners. Edges. Numerical Derivatives f(x) Edge and Corner Detection. CSE252A Lecture 11

Chapter 18. Geometric Operations

8/4/2016. Emerging Linac based SRS/SBRT Technologies with Modulated Arc Delivery. Disclosure. Introduction: Treatment delivery techniques

Experiments with Edge Detection using One-dimensional Surface Fitting

Image Quality Assessment and Quality Assurance of Advanced Imaging Systems for IGRT. AAPM Penn-Ohio Chapter Sep 25, 2015 Soyoung Lee, PhD

Image Processing and Computer Vision

Lecture 7: Most Common Edge Detectors

Face Tracking : An implementation of the Kanade-Lucas-Tomasi Tracking algorithm

SUPPLEMENTARY INFORMATION

Feature Detectors and Descriptors: Corners, Lines, etc.

Transcription:

An Automated Image-based Method for Multi-Leaf Collimator Positioning Verification in Intensity Modulated Radiation Therapy Chenyang Xu 1, Siemens Corporate Research, Inc., Princeton, NJ, USA Xiaolei Huang, Rutgers University, Piscataway, NJ, USA Arun Krishnan, Siemens Medical Systems, Malvern, PA, USA Sanjiv Samant, St. Jude Children s Research Hospital, Memphis, TN, USA ABSTRACT Intensity Modulated Radiation Therapy (IMRT) is an innovative, three-dimensional conformal radiation treatment that can deliver highly focused and precisely shaped radiation to a tumor site through the use of the Multi-Leaf Collimators (MLC). A crucial step in IMRT procedure is the verification of MLC positioning to assure the accuracy of radiation treatment delivery. In this paper, we have developed an automated image based method for MLC positioning verification using images acquired from an Electronic Portable Imaging Device. The method consists of three major steps: 1) non-linear geometric distortion correction, ) isocenter estimation, and 3) MLC leaf boundary recovery. Preliminary experiment on real image data shows that the proposed method is both fast and robust to image artifacts such as intensity inhomogeneity and noise, making it a promising approach for replacing manual verification of MLC in the IMRT treatment. Keywords: distortion correction, template matching, circle detection, IMRT, MLC verification. 1. Introduction Intensity Modulated Radiation Therapy (IMRT) is an innovative, three-dimensional conformal radiation treatment that delivers highly focused radiation to a tumor site with minimal impact to surrounding healthy tissues. The delivery of radiation that precisely conforms to the tumor site is made possible by the use of the Multi-Leaf Collimators (MLC). Under computer control, MLC can be arranged dynamically to adjust the shape and intensity of the beam that passes through. A crucial step in IMRT procedure is the MLC positioning verification before the procedure to assure that the treatment is delivered to the target accurately. The current practice for MLC positioning verification, however, is time consuming and requires laborious manual inspection of MLC radiation field through trials and errors by service technicians. In recent years, there has been an increasing interest in automated geometric distortion correction [1] and MLC radiation field verification []. Both are important steps for MLC positioning verification. In [1], geometric distortion is corrected along the scan direction based on the physics of EPID imaging. In [], a moment-based method is used to match two radiation fields. In this paper, we have developed an automated image based method for MLC positioning verification using images acquired from an Electronic Portable Imaging Device (EPID). The method first corrects the non-linear geometric distortion that presents in the EPID images by analyzing the grid pattern reconstructed from the EPID image of a calibration phantom. The method then employs an active template matching algorithm to match 1 Please address correspondence to chenyang.xu@scr.siemens.com.

precisely a template with the corresponding radiation field. The matching results can be used to estimate both the isocenter location and the MLC leaf positions. The detected leaf positions are then used to verify the accuracy of MLC positioning.. Method.1 EPID Image Distortion Correction Because EPID image suffers from nonlinear geometric distortion due to its imaging process, we need to correct the distortion before detecting the MLC leaf positions. To estimate the distortion field, we use a phantom consisting of bearing balls placed on a regular rectangular grid. Fig. 1a shows the EPID image of the phantom. The image clearly shows the nonlinear distortion of the rectangular grid pattern. In addition, it is apparent to see that the image also suffers from imaging artifacts such as intensity inhomogeneity and spurious structures near the bottom of the image. To deal with the imaging artifacts, we propose using a circle-enhancement filter to preprocess the image before applying the algorithm to compute the distortion field. Circle-enhancement filter: Given an image I(i,j), i [0, K-1], j [0, L-1], a circle template T of radius R is given by 1/ Q r R T( m, n) = 1/ P r > R where m [0, M-1], n [0, N-1], r = [ m ( M 1) / ] + [ n ( N 1) / ) ], and M and N are both odd numbers. Q is the number of pixels in the template that has r R, and P is the number of pixels in the template that has r > R. Such defined template has the property of yielding zero response at regions with homogeneous intensity. A straightforward template matching method will filter an image with the given template for matching circles. However, due to intensity inhomogeneity, circles at different region of image can have very different intensity characteristics, which can significantly degrade the algorithm detection performance. Here, we implement the circle-enhancement filter using a normalized correlation filter that can handle intensity inhomogeneity and yield satisfactory detection results. The normalized correlation filter is defined as follows: F ( i, j) = M 1 N 1 I ( i + m, j + n) T( m, n) I ( i + m, j + n) m= 0 n= 0 M 1 N 1 m= 0 n= 0 where M 1 M 1 i, K + ] and j [ N 1, L N + 1]. [ M 1 N 1 T ( m, n) m= 0 n= 0 Distortion Correction: Since the EPID image is usually quite large, to speed up the algorithm, we first apply the circle filter at a coarse image subsampled from the original one. Circle centers can be easily detected by finding the local maximums from the filtered image. An initial grid position and orientation can then be estimated based on the detected circle centers. For each circle center detected at the coarse image, we apply a circle filter to its local neighborhood at the original image to refine the detection of the circle center and the grid reconstruction. Finally a distortion field is computed by interpolating displacement vectors with bilinear interpolation between each grid point and

the corresponding circle center. Applying its inverse transform to the subsequent EPID images corrects the geometric distortion.. Active Template Matching Algorithm For both isocenter estimation and MLC leaf position estimation, we would like to recover the radiation field boundary shaped by the MLC leaves (see Figs. a and 3a). Due to the blurring caused by the EPID imaging, sharp corners are rounded out in the image and make it problematic to apply non-model based method that fails to incorporate the constraint that the radiation field is formed by rectangular MLC leaves. In this paper, we propose to use the active template matching method, a model based method that iteratively fits the model to the radiation field, and a local leaf position refinement to solve the boundary recovery problem. The matching algorithm used here can be regarded as a rigid matching version of the well-known active shape models [3]. The local refinement, described in.4, is only performed in MLC leaf position estimation. For isocenter estimation, this step is unnecessary since the radiation field has the shape of a square. Detecting edge pixels of MLC field: Given the MLC field image, we apply a sequence of mathematical morphological filters to process the image and extract the edge pixels. First a binary image is computed by thresholding the original image with the mean image intensity. The binary image is then filtered through an area-closing algorithm that closes all the holes in the image. Then the largest object in the image is selected through a size filter implemented through region growing to remove the isolated small objects. Finally, the edge pixels are detected by finding all the boundary pixels of the extracted object. Template construction: Since shapes of the radiation fields used for the verification of MLC leaf positions are known a priori, for each radiation field image, we can construct a template T which can be represented by T = [(x 1, y 1 ), (x, y ),, (x n, y n )]. The shape of the template is given by connecting each node (x i, y i ) with the next node (x i+1,y i+1 ). Note that even though the shape is specified by a list of discrete points, the shape they represent is really a continuous shape. Finding the closest points on the template: Since the template consists of a list of line segments, the closest point of an edge pixel to the template can be computed straightforwardly by finding the closest point to each line segment and then choose the one that gives the minimum distance among all line segments. Here, because the template for MLC radiation field consists of a small number of line segments, finding the closest point directly is actually faster than using the general closest point finding algorithm such as either k-d tree or geometric bucketing technique. Aligning two shapes: The set of closest points and the set of edge pixels represent two shapes with unique one-to-one correspondence. Matching two similar shapes represented by point sets is a well-studied problem and in our work we use the aligning algorithm described in [3]. Given two similar shapes, x 1 = (x 11, y 11,, x 1n, y 1n ) T and x = (x 1, y 1,, x n, y n ) T, we would like to choose a rotation, θ, a scale s, and a translation, (t x, t y ), mapping x onto M(x ) + t so as to minimize the weighted sum T E = ( x1 M ( s, θ )[ x ] t) W( x1 M ( s, θ )[ x ] t), (1) where x jk ( s cosθ ) x jk ( s sinθ ) y jk T M ( s, θ ), ( t x, t y,, t x, t y ), y = = jk ( s sin ) x jk ( s cos ) y t θ + θ jk

and W is a diagonal matrix of weights for each point. In this application, the weight for each pair of points is chosen to be w = ( D + ε ) 1 i, i = 1,, n, where D is the distance of each closest point to the nearby corner node point on the template, and ε is an arbitrary small constant. The idea is to give points that are close to corners higher weights, resulting in a more robust aligning algorithm. If we write a x = s cosθ, a y = s sinθ, the optimal aligning parameters (a x, a y, t x, t y ) to Equation (1) can be solved uniquely by a least-square minimization approach. The actual aligning algorithm is outlined below: 1. Construct a template based on the shape of the MLC radiation field.. Detect edge pixels of the radiation field 3. Find closest points on the template 4. Align the closest points with the edge pixels 5. Transform the template using the computed aligning parameters 6. Go to step 3, until the change to the transformation falls below a given threshold..3 Isocenter estimation In order to report the MLC leaf positions in the IEC (International Engineering Consortium) coordinate system, the isocenter of the IMRT system has to be located. Given two square-shaped MLC radiation field images with rotation angle 0 and 180 (Fig. a shows one of the distortion corrected images), respectively, we apply the active template matching algorithm to find the best-fitting rectangle to match the radiation field boundary in each image. By matching the same corners from both images, we obtain 4 pairs of corner points. The position of the isocenter can then be estimated as the average of the midpoints between each pair of corner points..4 MLC leaf position estimation In the last phase, the MLC shape, i.e., MLC leaf positions will be detected using a diamond-shaped radiation field EPID image (Fig. 3a). Apply the same active template matching algorithm but a diamond-shaped template, we can find the best-fitting diamond shape to the radiation field image. Since the thickness of visible leaves is identical, the leaves given by the fitted template have the correct y coordinates. However, because of the possible leaf positioning error, the x coordinates of the leaves are only near to the actual leaf boundary. By using the x coordinate of each leaf from the fitted template as an initial starting point, we search horizontally for the local 50% intensity drop off near the maximum gradient to obtain the final x coordinate of the leaf. Using the physical value of the phantom grid spacing and the estimated isocenter as the origin, we can report the final MLC leaf positions in IEC coordinates for MLC positioning verification. 3. Results The proposed method has been tested successfully to verify the MLC leaf positions of Siemens Mevatron IMRT system. The software is written in Microsoft Visual C++ and the entire process takes 1.4 seconds on a 1.5 GHz Pentium 4 PC. Fig. 1 shows the result of correcting the nonlinear geometric distortion. In particular, note that in Fig. 1b, the circle filter not only completely removes the intensity inhomogeneity apparent in the original image but also has the desired property of producing peaks at the circle centers. Figs. and 3 show the active template matching results for radiation field boundary recovery. Fig. 4 shows the final detected and labeled MLC leaf positions. The coordinates are reported in millimeters.

4. Conclusion In summary, we have developed a fast and robust method for MLC positioning verification based on EPID images and demonstrated its effectiveness through experiment on real images. This method can be used as a tool for the service technicians to perform the MLC calibration with less time. Moreover, the method can provide a basis for automatic MLC calibration and on-line MLC positioning verification. ACKNOWLEDGEMENT We thank Patrick Liu, Ali Bani-Hashemi, and Bill Collins at Siemens OCS for their support and discussions regarding this work. REFERENCE 1. S. S. Samant, et. al., A new calibration technique for KCD-based megavoltage imaging, Proc SPIE 3659:779-79, 1999.. L. Dong and A. L. Boyer, A portal image alignment and patient setup verification procedure using moments and correlation techniques, Phys. Med. Biol., 41:697-73, 1996. 3. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, Active shape models --- their training and application, Computer Vision and Image Understanding, 61(1): 38-59, 1995. (a) (b) (c) Figure 1: Distortion correction: (a) EPID image of the calibration phantom, (b) result after circle filtering, (c) detected circle center and reconstructed grid, and (d) distortion corrected image. (d)

(a) (b) (c) (d) Figure. Matching a template to a rectangle radiation field: (a) distortion corrected EPID image, (b) edge map, (c) initial template position, and (d) final template position. (a) (b) Figure 3. Matching a template to a diamond-shaped MLC field: (a) initial template position, (b) intermediate template position, and (c) final template position. (c) Figure 4. Labeling and detected MLC leaf positions