Log-Demons with Driving Force for Large Deformation Image Registration

Similar documents
Visual Tracking (1) Tracking of Feature Points and Planar Rigid Objects

A Novel Extreme Point Selection Algorithm in SIFT

ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION

Chapter 3 Image Registration. Chapter 3 Image Registration

Adaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision

Non-rigid Image Registration using Electric Current Flow

Fast Image Registration via Joint Gradient Maximization: Application to Multi-Modal Data

Learning-based Neuroimage Registration

Shape-based Diffeomorphic Registration on Hippocampal Surfaces Using Beltrami Holomorphic Flow

A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation

Video annotation based on adaptive annular spatial partition scheme

Subpixel Corner Detection Using Spatial Moment 1)

Image Segmentation and Registration

Motion Estimation. There are three main types (or applications) of motion estimation:

Thin Plate Spline Feature Point Matching for Organ Surfaces in Minimally Invasive Surgery Imaging

FAST REGISTRATION OF TERRESTRIAL LIDAR POINT CLOUD AND SEQUENCE IMAGES

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov

3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.

EE795: Computer Vision and Intelligent Systems

Visual Tracking (1) Pixel-intensity-based methods

Fully Automatic Multi-organ Segmentation based on Multi-boost Learning and Statistical Shape Model Search

SUMMARY: DISTINCTIVE IMAGE FEATURES FROM SCALE- INVARIANT KEYPOINTS

CS 231A Computer Vision (Fall 2012) Problem Set 3

An Algorithm for Medical Image Registration using Local Feature Modal Mapping

Face Tracking. Synonyms. Definition. Main Body Text. Amit K. Roy-Chowdhury and Yilei Xu. Facial Motion Estimation

Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion

Regional Manifold Learning for Deformable Registration of Brain MR Images

Feature Detection. Raul Queiroz Feitosa. 3/30/2017 Feature Detection 1

Peripheral drift illusion

Curvature guided surface registration using level sets

ELEC Dr Reji Mathew Electrical Engineering UNSW

CHAPTER 6 MODIFIED FUZZY TECHNIQUES BASED IMAGE SEGMENTATION

Segmentation and Tracking of Partial Planar Templates

ABSTRACT 1. INTRODUCTION 2. METHODS

Non-Rigid Image Registration III

The Anatomical Equivalence Class Formulation and its Application to Shape-based Computational Neuroanatomy

IMAGE RETRIEVAL USING VLAD WITH MULTIPLE FEATURES

Nonrigid Surface Modelling. and Fast Recovery. Department of Computer Science and Engineering. Committee: Prof. Leo J. Jia and Prof. K. H.

Feature Tracking and Optical Flow

Traffic Signs Recognition using HP and HOG Descriptors Combined to MLP and SVM Classifiers

Improving Latent Fingerprint Matching Performance by Orientation Field Estimation using Localized Dictionaries

Object Tracking using HOG and SVM

Algorithm research of 3D point cloud registration based on iterative closest point 1

Occluded Facial Expression Tracking

3D Surface Matching and Registration through Shape Images

EECS150 - Digital Design Lecture 14 FIFO 2 and SIFT. Recap and Outline

Visual Tracking (1) Feature Point Tracking and Block Matching

Correspondence Detection Using Wavelet-Based Attribute Vectors

Rotation Invariant Image Registration using Robust Shape Matching

Epithelial rosette detection in microscopic images

CS 4495 Computer Vision Motion and Optic Flow

Deformable Registration Using Scale Space Keypoints

EXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,

arxiv: v1 [cs.cv] 28 Sep 2018

Integrated Approaches to Non-Rigid Registration in Medical Images

VALIDATION OF DIR. Raj Varadhan, PhD, DABMP Minneapolis Radiation Oncology

MULTIPLE REGION OF INTEREST TRACKING OF NON-RIGID OBJECTS USING DEMON'S ALGORITHM

An Adaptive Eigenshape Model

Translation Symmetry Detection: A Repetitive Pattern Analysis Approach

Sea Turtle Identification by Matching Their Scale Patterns

Comparative Study of ROI Extraction of Palmprint

Improvement of SURF Feature Image Registration Algorithm Based on Cluster Analysis

Image Registration. Prof. Dr. Lucas Ferrari de Oliveira UFPR Informatics Department

Non-rigid Image Registration

CS 223B Computer Vision Problem Set 3

Matching. Compare region of image to region of image. Today, simplest kind of matching. Intensities similar.

SIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014

Image Coding with Active Appearance Models

Research on Evaluation Method of Video Stabilization

arxiv: v1 [cs.cv] 2 May 2016

Liver Image Mosaicing System Based on Scale Invariant Feature Transform and Point Set Matching Method

Feature descriptors and matching

Hybrid Spline-based Multimodal Registration using a Local Measure for Mutual Information

Face Hallucination Based on Eigentransformation Learning

Advanced Image Reconstruction Methods for Photoacoustic Tomography

Open Access Moving Target Tracking Algorithm Based on Improved Optical Flow Technology

Sketchable Histograms of Oriented Gradients for Object Detection

EE795: Computer Vision and Intelligent Systems

Object detection using non-redundant local Binary Patterns

The organization of the human cerebral cortex estimated by intrinsic functional connectivity

EE795: Computer Vision and Intelligent Systems

Semantic Context Forests for Learning- Based Knee Cartilage Segmentation in 3D MR Images

Nonrigid Registration with Adaptive, Content-Based Filtering of the Deformation Field

Spectral Log-Demons Diffeomorphic Image Registration with Very Large Deformations

EE368 Project Report CD Cover Recognition Using Modified SIFT Algorithm

Motion Estimation for Video Coding Standards

Face Alignment Under Various Poses and Expressions

A New Technique of Extraction of Edge Detection Using Digital Image Processing

Fast Image Matching Using Multi-level Texture Descriptor

Correspondence. CS 468 Geometry Processing Algorithms. Maks Ovsjanikov

An Angle Estimation to Landmarks for Autonomous Satellite Navigation

Car Detecting Method using high Resolution images

HOUGH TRANSFORM CS 6350 C V

Illumination-Robust Face Recognition based on Gabor Feature Face Intrinsic Identity PCA Model

Spectral Log-Demons: Diffeomorphic Image Registration with Very Large Deformations

Object Recognition Algorithms for Computer Vision System: A Survey

Ensemble registration: Combining groupwise registration and segmentation

Image Segmentation Based on Watershed and Edge Detection Techniques

A NEW ROBUST IMAGE WATERMARKING SCHEME BASED ON DWT WITH SVD

Moving Object Segmentation Method Based on Motion Information Classification by X-means and Spatial Region Segmentation

Transcription:

Log-Demons with Driving Force for Large Deformation Image Registration Le Zhang and Ying Wen* Shanghai Key Laboratory of Multidimensional Information Processing, Department of Computer Science and Technology, East China Normal University, Shanghai, China, 200062 *Email: ywen@cs.ecnu.edu.cn Abstract Capturing large diffeomorphic deformations is d- ifficult for many non-rigid registration methods. In this paper, we propose Log-Demons with driving force for large deformation image registration. The driving force obtained by boundary points correspondence exerts influence on continuous optimization of Log-Demons to improve the motion direction of points. We utilize MROGH descriptor matching to obtain points correspondence as driving force, then the driving force is added to the optimization of Log-Demons. We integrate the driving force in an exponentially decreasing form with velocity field of Log-Demons to drive the points moving globally and to speed up the convergence. Experiments performed on synthetic images, real scene images and brain images demonstrate that the proposed method can not only capture large deformations but also preserve details and register images at a higher accuracy. I. INTRODUCTION Non-rigid image registration technique is a significant field of image processing research, which is widely used in military, remote sensing and medicine. Among them, large deformation image registration is a big challenge. Up to now, much work has been done and a large family of algorithms have been put forward[1]-[4]. A predominant way for non-rigid registration is based on Demons algorithm as introduced in the seminal work by Thirion, where he considered image registration as a diffusion process. Thirion considered one image as a deformable model grid, diffusing through the boundaries of the other image which are considered as semi-permeable membranes[2]. The original Demons algorithm is based on gradient information, when the gradient information is low or missing, Demons may lead to wrong registration results. So several kinds of improved Demons algorithms have been proposed[3][4][9]. Vercauteren[16] demonstrated that the above different Demons variants are related to the use of different optimizers. And to improve the search direction of Gauss-Newton-like method, Vercauteren introduced Efficient Second-order Minimization(ESM)[12] into Demons, showing that symmetric forces can speed up convergence rate. However, a widely acknowledged issue with Demons algorithm is that the estimated transformation is not diffeomorphic and may destroy the topological structure which is vital in some practical applications such as computational anatomy. An approach to solve this issue is to compose deformations as a sequence of diffeomorphic free-form deformations modelled by B-splines[6], but the spline transformations become difficult to obtain diffeomorphisms under very large deformation conditions. The large deformation diffeomorphic metric mapping(lddmm)[7][8] was proposed by Beg et al., which seeks a time-dependent velocity field representation of a diffeomorphism and can achieve a high registration accuracy. Since gradient optimization is over the entire space of diffeomorphisms, LDDMM is time consumption and high memory intensive. LDDMM s limitation can be tackled using stationary velocity fields, so Log-Demons[14][15] was proposed by Vercauteren, which is an efficient non-parametric diffeomorphic image registration framework based on Thirion s Demons algorithm. Log-Demons algorithm is appealing as it not only ensures diffeomorphic mappings but also its computation is in linear complexity. Log-Demons achieves diffeomorphism by performing optimization procedure on a Lie group. But for some algorithms based on Log-Demons[5][31][30], it is still difficult to acquire very large and complex deformations. Conventional methods to deal with large deformations are to adopt coarse-to-fine warping framework, but it may still lead gradient-based methods to a local optimal solution, even in coarse resolutions[29]. To solve this problem, many methods based on regional descriptor matching are proposed. Brox[10] and Liu[11] proposed to integrate descriptors such as HOG[22] and dense SIFT[19] into the variational optical flow to preserve details for large displacement. But due to the mismatching of corresponding points, many motion details are still missed and the transformations are not diffeomorphic. Cifor[26] proposed hybrid feature-based Log-Demons registration which combined block-matching scheme with Log-Demons for tumour tracking. The blocks matching affects the motion direction of points in blocks, but it is hard to process images with complex scenario. Lombaert[28][29] also introduced spectral representation of shapes into Log-Demons, using the properties of spectral global matching to capture very large deformations between images, but the computation of spectral coordinates is time-consuming. The above methods, either do not preserve details, or are not diffeomorphic, or time-consuming, so it is not satisfactory for these methods to deal with very large deformation image registration. In order to overcome above mentioned problems, we propose Log-Demons with driving force for large deformation image registration. We first extract images boundaries using Canny algorithm as driving points, and then employ MROGH descriptor to describe each driving point. MROGH descriptor[21] is intrinsic rotation invariant and performs well in points matching and object recognition etc. Hence, the 978-1-5090-0620-5/16/$31.00 c 2016 IEEE 3052

characteristics of boundary can be well described by the MROGH descriptor. By descriptor matching, we can obtain corresponding relations which are defined as driving force in this paper. After that, we cast driving force into Log- Demons. Rather than directly replace the displacement vectors with matching results, we add driving force to the velocity field in each iteration to promote the registration. The main contribution of our work is that we employ boundary points correspondence as driving force to affect the update of Log- Demons in a global scope. And we integrate the driving force in an exponentially decreasing form with velocity field of Log- Demons to drive the movements of points and to speed up the convergence. Extensive experiments performed on synthetic images, real scene images and brain images show that our method has an excellent performance, especially for large deformation registration. The rest of the paper is organized as follows: Section II gives a detailed introduction of our method. The experimental results are presented in Section III. Finally, we draw a conclusion in Section IV. II. METHODOLOGY Before we present our method, we give a brief introduction of Log-Demons, since our method derives from Log-Demons. A. Log-Demons Given a fixed image F and a moving image M, Log- Demons estimates a dense diffeomorphic spatial transformation s that aligns M to F best: E(s, c) = 1 λ 2 Sim(F, M c)+ 1 i λ 2 dist(s, c) 2 + 1 x λ 2 Reg(s) (1) T where λ i stands for the noise, λ T controls the degree of regularization and λ x stands for a spatial uncertainty on the correspondences. The variable c is exact spatial transformation that allows error for s[3], leading Demons algorithm to a well-posed problem. The similarity term Sim measures the resemblance between fixed image and warped image, and dist describes the distance between two transformations and ensures that s is close to c, and Reg term is used as a priori knowledge and keeps spatial transformation smooth. The transformation s is parameterized by the stationary velocity field v through exponential map s = exp(v). The velocities v is in the space of log-domain. As v is stationary, exp(v) is efficiently computed using the scaling-and-squaring algorithm[14]. The energy of the Log-Demons can be written in log domain: E(u) = 1 λ 2 isim(f, M s exp(u)) + 1 λ 2 dist(s, s exp(u)) 2 + 1 x λ 2 Reg(s) T The optimization of energy equation can be decoupled into two steps. The first step is optimizing 1 Sim(F, M λ 2 i s exp(u)) + 1 λ dist(s, s exp(u)) 2 to obtain update field u 2 x with s being given. The update field u is calculated in the Lie algebra and then is mapped in the space of diffeomorphisms via exponential mapping. Thus transformation s is updated in (2) Fig. 1. The sketch of driving force of two corresponding boundary points. (a) Fixed image. (b) Moving image. (c) The correspondence of p and p. (d) The registration result of Log-Demons. the form of s = s exp(u). It should be noted that different optimization strategies lead to different expressions of Demons force[14]. By adapting Gauss-Newton-like approaches, we can get update field in each iteration as: F (x) M s(x) u(x) = J(x) (3) J(x) 2 + λ2 i (x) λ 2 x where J(x) is the gradient, defined as J(x) = M s(x). The second step is usually smooth the update u, using Gaussian kernels K fluid and K diffusion with standard deviations λ fluid and λ diffusion respectively. B. The Proposed Log-Demons with Driving Force 1) Motivation: Capturing very large deformations is a difficult task for many non-rigid image registration since the gradient computation may fall into local optimum. A popular solution is to establish accurate pointwise correspondence by feature matching technique[29] to push points moving in global scope forcibly. Log-Demons is unable to deal with images with very large deformations such as severe image distortion, whose boundaries are hard to match precisely. Considering that the image boundaries are rich in details and critical to diffusing models of Demons, we establish the correspondence between boundary points of two images and take the correspondence as driving force. In our method, We utilize Canny detector to extract boundary points as driving points. The correspondence between driving points of two images can be viewed as the driving force, which is integrated into the Demons force to push the points moving together. To the end, integration of Log-Demons and driving force can lead to a more precise registration. As shown in Fig.1, Fig.1(a) and Fig.1(b) are a fixed image and a moving image, respectively. Fig.1(c) shows the sketch of driving force of two corresponding boundary points. If the registration method can make the point p move to the position of the point p, the result is satisfactory. However, Log-Demons is unable to obtain the exact result shown in Fig.1(d), so we hope the driving force can be added into Demons force to guide the point rightly moving as indicated by the red arrows. In our method, there are two techniques need to be considered: how to integrate the driving force into Log-Demons algorithm and how to get the driving force. We will describe the two techniques in detail in the following sections. 2) Function of Log-Demons with Driving Force: Given a moving image M and a fixed image F, we can obtain the driving force u c of driving points. The u c can be calculated independent of Log-Demons and then integrated into the 2016 International Joint Conference on Neural Networks (IJCNN) 3053

continuous optimization of Log-Demons as the driving force. The objective function of our method is as follows: E(u) = 1 1 2 Sim(F, M s exp(u) exp( 2 λ i λ uc )) k + 1 λ 2 dist(s, s exp(u) exp( 1 2 x λ uc )) 2 + 1 (4) k λ 2 Reg(s) T It is noted that driving force u c is added to the Demons force. u c can be viewed as a constant variable. λ k controls the influence of driving force on update field u and is set as λ k =2 (k 1)/2, where k is the iteration number in Log- Demons. This leads to a high influence at the beginning and decreases rapidly along with iteration, thus the ill effects of inaccurate descriptor matching can be avoided especially when warped image is close to fixed image. Assuming that descriptor matching in global scope has high accuracy, the driving force u c enables global optimization of Log-Demons and pushes points moving towards right direction rapidly and accurately. According to the Baker-Campbell-Hausdorff(BCH) formula[15], the update should be exp(u(u, u c )) exp(u) exp(( 1 λ 2 k u c ), in order to compute simply, we replace it as U(u, u c ) u + 1 λ 2 k u c. Through first order expansion of intensity difference on the first step of Log- Demons[14]: F (x) M s exp(u)(x) F (x) M s(x)+j(x).u(x) (5) and approximation of distance between two diffeomorphisms: dist(s, s exp(u)) u (6) The energy function of first step of Log-Demons can be rewritten as: Algorithm 1 Log-Demons with Driving Force for Large Deformation Image Registration Input: Fixed image F, moving image M and initial velocity field v Output: Transformation s = exp(v) from M to F 1: Use Canny detector on F and M to obtain two boundary point sets as driving points 2: Compute MROGH descriptor M(x p ) for each driving point 3: Obtain correspondence u c between driving points through descriptor matching using Euclidean distance 4: repeat 5: Add u c to the update u mapping M exp(v) to F using Eq.8 6: Smooth the update u K fluid u for fluid-like regularization 7: Update velocity field:v log(exp(v) exp(u)) 8: Smooth velocity field v K diffusion v for diffusionlike regularization 9: until convergence (MROGH)[21] due to its excellent performance in finding corresponding points which have large orientation change. MROGH is intrinsic rotation invariant and do not need to assign a reference orientation for each driving point which may be a major error source for most of the existing methods[21], such as SIFT[19], HOG[22] and DAISY[20], etc. E(u) 1 [ ] F (x) M s(x) 2 Ω x + 0 x Ω x [ J(x) λ i(x) λ x I ] U(u, u c ) (7) where Ω x is the overlap between F and M s. By minimizing the equation Eq.7, at each pixel x, we can get 2 F (x) M s(x) u(x) = J(x) 1 J(x) 2 + λ2 i (x) λ 2 u c (8) λ 2 k x thus, u(x) is our update rule in each iteration. The proposed Log-Demons with driving force for large deformation image registration is summarized in Algorithm 1. 3) Driving Force: In this section, we present the method how to obtain the driving force. We take boundary points obtained by Canny detector as driving points. The information of driving points can be described by the feature descriptor. And then, the points correspondence can be obtained by descriptor matching. In our method, the driving force u c is defined as the correspondence of boundary points. The driving force can adjust points direction of gradient descent in the process of continuously calculating update field u. When describing a point information and performing descriptors matching in large deformation images, we select the Multisupport Region Order Based Gradient Histogram Fig. 2. Description of MROGH descriptor. (a) Construction of local coordinate system. (b) Multisupport Regions. For each driving point, we use a circular region as the support region with n points denoted by R = {x 1,x 2,..., x n }, I(x i ) is the intensity of sample point x i. Intensities of sample points are sorted in nondescending order and then these points are approximate equally divided into g partitions. Then we construct a rotation invariant coordinate system for each sample point when computing descriptors. As shown in Fig.2(a), suppose x p is a driving point and x i is one of the sample points in its support region. Then, we construct local coordinate system by setting x p x i as the positive y-axis and the corresponding vertical line as x-axis for the sample point x i. Local features are calculated in this local coordinate system to obtain rotation invariant. For each sample point x i, we compute gradient in its local 3054 2016 International Joint Conference on Neural Networks (IJCNN)

Fig. 3. The synthetic images registration results of different methods. From top to bottom, the names and size of images are Heart(120 120), Lena(85 85), Hand(95 140), Tennis(185 135), Shoes(200 110) and Marble(164 125). And from left to right, images of each row are (a) fixed image, (b) moving image, registration results of (c) Log-Demons, (d) LDDMM, (e) Spectral Log-Demons and (f) Our method respectively. coordinate system: D x (x i )=I(x 1 i ) I(x 5 i ) (9) D y (x i )=I(x 3 i ) I(x 7 i ) (10) where x j i,j =1, 3, 5, 7, are x i s neighboring points along the x-axis and y-axis in the local x-coordinate system. The gradient magnitude m(x i ) and orientation θ(x i ) can be computed as m(x i )= D x (x i ) 2 + D y (x i ) 2 (11) θ(x i )=tan 1 (D y (x i )/D x (x i )) (12) Then the gradient is transformed to a d-dimensional vector, denoted by F G (x i )=(f1 G,f2 G,..., fd G), fj G = m(x i ) (2π/d α(θ(x i), dir j )) (13) 2π/d where dir j =(2π/d) (i 1),i=1, 2,...d, and α(θ(x i ), dir j ) is the angle between θ(x i ) and dir j. In order to reduce the number of incorrect matches, we choose support regions as the N nested regions centered at the driving point with an equal increment of radius as Fig.2(b) shows. In each support region, the local features of all the sample points are then pooled by their intensity orders to form a vector, then we accumulate vectors of different partitions of each support region to represent this support region, defined as D(R) = (F (R 1 ),F(R 2 ),..., F (R g )). F (R i ) is the accumulated vector of partition R i, i.e., F (R i )= F G (x), (14) x R i Finally, all support regions are pooled together to form final descriptor: M(x p )={D 1 D 2...D N }. We use the default parameter as d =8, g =6, N =4, thus the dimensionality of MROGH descriptor is 192. 2016 International Joint Conference on Neural Networks (IJCNN) 3055

After constructing descriptor for every driving point, for point x i in moving image, we try to find its corresponding point x j in fixed image by MROGH descriptor matching. The point in the fixed image has a corresponding point in the moving image followed by that x i is the optimal correspondence for x j and x j is also the optimal correspondence to the other. If x i and x j are mutually optimal corresponding points, the displacement vector of point x i is obtained by u c i = x j x i, otherwise u c i =0. III. EXPERIMENTS In this section, we perform experiments on three types of images, i.e., synthetic images, real scene images and brain images to investigate the performance of our proposed method. We compare the proposed method with some popular registration algorithms, such as Log-Demons, Spectral Log-Demons and LDDMM. In the following, we use the default parameters of LDDMM, and all experiments are carried on the following empirical parameters: λ i =1, λ fluid =1, λ diffusion =1. We utilize Mean Square Error(MSE) to evaluate the intensity difference between the fixed image and the warped image. A. Experiments on Synthetic Images In this experiment, we focus on image registration with very large deformations. The moving images are all synthetic images. The max step λ x is set as λ x =2. After performing 100 iterations, the methods have been reached convergence, so we compare them within the same level of resolution. We select six fixed images and warp them with randomly large deformations, and the final registration results are shown in Fig.3. The first image of each row is a fixed image and the second is a deformed moving image, and the followings are registration results of Log-Demons, LDDMM, Spectral Log- Demons, and ours respectively. From Fig.3, it can be seen that in example of Heart, the moving image has some severely distorted parts marked by red arrows. Log-Demons, LDDMM and Spectral Log-Demons register unsuccessfully in these regions, while our method outperforms the other three methods and pushes all boundaries aligned. For the images of Hand, ring finger in the moving image and middle finger in the fixed image are overlapped. LDDMM and Spectral Log-Demons are not capable of moving fingers back to original position. Log-Demons wrongly aligns ring finger to middle finger, resulting in overlap and discontinuous of fingers, since the optimization may be limited in local scope. Due to the correspondence of boundary points, driving force of our method can push the finger back to the right position. The final MSE result of LDDMM is 425.64, Log- Demons is 147.68, Spectral Log-Demons is 141.61 and ours is 59.58. The intensity difference between fixed and warped images of our method is reduced by 59.66% compared with Log-Demons, 57.93% compared with Spectral Log-Demons and 86% compared with LDDMM. As for Lena, Log-Demons, Spectral Log-Demons and LDDMM can not align face or hair, while our method registers all correctly. For Tennis and Marble, twisted lines are hard task for registration methods. For example, the railings in Tennis are moved to wrong places by the other three methods since the lack of external force pulls them aligned with corresponding distant lines. While our method restores the lines successfully, demonstrating that Fig. 5. The colormaps of intensity difference for Hand. Blue means no difference and red means that intensity difference is biggest. From top to bottom, colormaps are obtained by Log-Demons, LDDMM, Spectral Log- Demons and ours respectively when iteration numbers are 1, 5, 10, 20, 100. driving force obtained by boundary points correspondence can restrain the movement of points and is crucial to keep complete object outline and details in the process of registration. In order to show more details in the process of registration, we take Hand as example to show intensity differences in refine iterations. For the sake of visual observation, we transform the intensity differences of Hand into colormap. Fig.5 shows the colormap of warped images when iteration numbers are 1, 5, 10, 20, 100. In the first 10 iterations, the fingers are nearly correctly restored by our method while others fail. It is noted that the driving force should have a great impact on Log-Demons at the beginning, and declines with the decrease of the intensity difference. The MSE curves of registration of Fig.3 are shown in Fig.4, in which the blue, black, green and red curves stand for Spectral Log-Demons, Log-Demons, LDDMM and our method respectively. For six experiments, our MSE curve drops fastest to approach convergence and is nearly always bellow the other methods, indicating that our method registers effectively and accurately. B. Experiments on Real Scene Images In this experiment, we investigate the performance of our proposed method on real scene images. We randomly choose 30 images from MIT[35] database and 20 images from Brox datasets[10] to evaluate. This experiment is conducted in four levels scheme. Due to the limitation of paper length, we present some sample images and registration results in Fig.6. The first image of each row is a fixed image and the second image is a moving image, and the followings are registration results of Log-Demons, LDDMM, Spectral Log-Demons, and ours respectively. As shown in Fig.6, all final registration results are very close in vision, but MSE of ours is superior to that of Log- Demons and Spectral Log-Demons, and LDDMM performs unstably. Table I presents the mean and standard deviation of MSE. It can be seen that the performance of our method on 3056 2016 International Joint Conference on Neural Networks (IJCNN)

Fig. 4. MSE curves of different registration methods, the blue, black, green and red curves stand for Spectral Log-Demons, Log-Demons, LDDMM and our method, respectively. real scene images still has advantages, while LDDMM has large fluctuations. We can conclude that the performance of our method is superior to Log-Demons based methods on real scene images, and the driving force integrated into Log- Demons can lead to a more precise result. Mean MSE TABLE I. EXPERIMENTS ON REAL SCENE IMAGES Log-Demons LDDMM Spectral Log-Demons Ours Hand 33.95(±16.80) 21.65(±6.08) 36.20(±20.84) 32.27(±14.54) Table 123.04(±8.66) 84.35(±7.82) 125.09(±6.88) 123.32(±6.08) Toys 146.85(±41.97) 356.59(±80.11) 150.11(±40.02) 146.52(±38.28) Tennis 125.78(±9.22) 210.79(±14.65) 126.13(±8.54) 122.55(±10.61) Shoes 250.87(±12.66) 117.80(±85.53) 247.86(±11.17) 242.21(±15.49) C. Experiments on MR Images Demons algorithm is widely used in brain image registration, so we experimentally evaluate the performance of proposed scheme on MR brain images. The brains present complex structures across individuals, so we focus on the warping accuracy of the tissue structure in this experiments. We apply the proposed method to MR brain images registration and 35 T1 images[33] are randomly selected for evaluation. These brains vary significantly in morphology. We also conduct the experiment in four levels scheme and the maximal step is adjusted to 1.5. Fig.7 shows the registration results, the first image of each row is a fixed image and second is a moving image, and the followings are final results of Log-Demons, LDDMM, Spectral Log-Demons and ours respectively. The registration results of all methods have similar observations. In order to evaluate the registration accuracy, the brain image is segmented into three tissues: white matter(wm), gray matter(gm), and cerebrospinal fluid(csf) by the method of FSL[36]. Then, we measured MSE and Dice coefficient[34] to estimate the accuracy, and the Dice coefficient is defined as: ρ =2 O 1 O 2 /( O 1 + O 2 ) (15) where O1 and O2 denote region of interest (ROI) in the fixed and warped images. The MSE and dice coefficient of the four methods are listed in Table II. Our method has a slightly advantage over Log-Demons and Spectral Log- Demons in GM and CSF, while LDDMM performs the worst. The experimental results show that our method is comparable to other state of the art registration methods. IV. CONCLUSION In this paper, we propose Log-Demons with driving force for large deformation image registration. The correspondence of boundary points obtained by MROGH descriptor matching is defined as the driving force which is integrated into Log- Demons to improve the update way of Log-Demons. Thus the proposed method can not only capture large deformations but also preserve details and register images at a higher accuracy. Experiments on synthetic images, real scene images and brain images demonstrate that our method has a good performance for image registration. In particular, our method is superior to other methods for large deformation image registration. ACKNOWLEDGMENT The authors would like to thank Herve Lombaert, Laurent Risser and Bin Fan for sharing their code. This work was supported by The National Natural Science Foundation of China (No.61273261), Shanghai Collaborative Innovation Center of Trustworthy Software for Internet of Things (ZF1213), Open Project of the Key Laboratory of Embedded System and Service Computing Ministry of Education (Tongji University) 2016 International Joint Conference on Neural Networks (IJCNN) 3057

Fig. 6. Experiments on real scene images. The first image of each row is a fixed image, and the second is a moving image. The followings are registration results of Log-Demons, LDDMM, Spectral Log-Demons, and Ours respectively. MSE is below images. Fig. 7. Experiments on MR brain images. The first image of each row is a fixed image, and the second is a moving image. The followings are registration results of Log-Demons, LDDMM, Spectral Log-Demons, and Ours respectively. 3058 2016 International Joint Conference on Neural Networks (IJCNN)

TABLE II. EXPERIMENTS ON BRAIN IMAGE REGISTRATION Dice Log-Demons LDDMM Spectral Log-Demons Ours coefficient WM 0.4481(±0.0656) 0.4288(±0.0778) 0.4484(±0.0662) 0.4478(±0.0655) GM 0.7875(±0.0153) 0.7203(±0.0170) 0.7874(±0.0159) 0.7880(±0.0155) CSF 0.8944(±0.0242) 0.8176(±0.0286) 0.8945(±0.0235) 0.8949(±0.0235) MSE 461.7068(±91.5668) 884.7609(±98.6717) 462.7764(±90.2911) 460.0363(±94.2751) and the Science and Technology Commission of Shanghai Municipality under research grant no.14dz2260800. REFERENCES [1] G. E. Christensen, P. Yin, M. W. Vannier, et al, Large-deformation image registration using fluid landmarks, Image Analysis and Interpretation, 2000. Proceedings. 4th IEEE Southwest Symposium. pp. 269-273, 2000. [2] J. P. Thirion, Image matching as a diffusion process: an analogy with Maxwell s demons, Medical Image Analysis, vol. 2, pp. 243-260, 1998. [3] P. Cachier, E. Bardinet, D. Dormont, et al, Iconic Feature Based Nonrigid Registration: The PASHA Algorithm, Computer Vision and Image Understanding, vol. 89, pp. 272-298, 2003. [4] X. Pennec, P. Cachier, N. Ayache, Understanding the Demons Algorithm: 3D Non-rigid Registration by Gradient Descent, Medical Image Computing and Computer-Assisted Intervention-MICCAI99, pp. 597-605, 1999. [5] T. Mansi, X. Pennec, M. Sermesant, et al, ilogdemons: A Demons- Based Registration Algorithm for Tracking Incompressible Elastic Biological Tissues, International Journal of Computer Vision, vol. 92, pp. 92-111, 2011. [6] D. Rueckert, P. Aljabar, R. A. Heckemann, et al, Diffeomorphic registration using B-splines, 9th International Conference on Medical Image Computing and Computer-Assisted Intervention: MICCAI, pp. 702-709, 2006. [7] M. F. Beg, M. I. Miller, A. Trouve, and L. Younes, Computing large deformation metric mappings via geodesic flows of diffeomorphisms, International journal of computer vision, pp. 139-157, 2005. [8] X. Yang, Y. Li, D. Reutens0, et al, Diffeomorphic Metric Landmark Mapping Using Stationary Velocity Field Parameterization, International Journal of Computer Vision, pp. 1-18, 2015. [9] H. Wang, L. Dong, J. O Daniel, et al, Validation of an accelerated demons algorithm for deformable image registration in radiation therapy, Physics in Medicine and Biology, vol. 50, pp. 2887-2906, 2005. [10] T. Brox, J. Malik, Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, pp. 500-513, 2011. [11] C. Liu, J. Yuen, A. Torralba, J. Sivic, and W. T. Freeman, SIFT Flow: Dense Correspondence across Different Scenes, Proc. European Conf. Computer Vision, pp. 28-42, 2008. [12] S. Benhimane, E. Malis, Real-time image-based tracking of planes using efficient second-order minimization, Proceedings of the International Conference on Intelligent Robots and Systems, vol. 1, pp. 943-948, 2004. [13] J. Ashburner, A fast diffeomorphic image registration algorithm, Neuroimage, vol. 38, pp. 95-113, 2007. [14] T. Vercauteren, P. Xavier, P. Aymeric, et al, Diffeomorphic demons: efficient non-parametric image registration, Neuroimage, vol. 45, pp. 61-72, 2009. [15] T. Vercauteren, X. Pennec, A. Perchant, N. Ayache, Symmetric Log- Domain diffeomorphic registration: A Demons-Based approach, MIC- CAI, pp. 754-761, 2008. [16] T. Vercauteren, X. Pennec, E. Malis, A. Perchant, N. Ayache, Insight into efficient image registration techniques and the demons algorithm, In Information Processing in Medical Imaging, pp. 495-506, 2007. [17] D. Florence, T. Vercauteren, An ITK Implementation of the Symmetric Log-Domain Diffeomorphic Demons Algorithm, Insight Journal, 2009. [18] B. T. Yeo, M. R. Sabuncu, T. Vercauteren, et al, Spherical demons: fast diffeomorphic landmark-free surface registration, IEEE Transactions on Medical Imaging, vol. 29, pp. 650-668, 2010. [19] D. G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, vol. 60, pp, 91-110, 2004. [20] E. Tola, V. Lepetit, P. Fua, A fast local descriptor for dense matching, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1-8, 2008. [21] B. Fan, F. Wu, Z. Hu, Rotationally Invariant Descriptors Using Intensity Order Pooling, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, pp. 2031-2045, 2012. [22] N. Dalal, B. Triggs, Histograms of Oriented Gradients for Human Detection, Computer Vision and Pattern Recognition, vol. 1, pp. 886-893, 2005. [23] J. Ma, W. Qiu, J. Zhao, et al, Robust Estimation of Transformation for Non-Rigid Registration, IEEE Transactions on Signal Processing, vol. 63, pp. 1115-1129, 2015. [24] A. Myronenko, X. Song, Point Set Registration: Coherent Point Drift, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, pp. 2262-2275, 2010. [25] H. Chui, A. Rangarajan, A new point matching algorithm for nonrigid registration, Computer Vision and Image Understanding, vol. 89, pp. 114-141, 2003. [26] A. Cifor, L. Risser L, D. Chung, et al, Hybrid feature-based Log- Demons registration for tumour tracking in 2-D liver ultrasound images, IEEE International Symposium on Biomedical Imaging, pp. 724-727, 2012. [27] M. FreimanS. D. VossS. K. Warfield, Demons registration with local affine adaptive regularization: application to registration of abdominal structures, Proceedings of the 8th IEEE International Symposium on Biomedical Imaging, pp. 1219-1222, 2011. [28] H. Lombaert, L. Grady, X. Pennec, et al, Spectral Demons-Image Registration via Global Spectral Correspondence, Computer Vision- ECCV 2012, pp. 30-44, 2012. [29] H. Lombaert, L. Grady, X. Pennec, et al, Spectral Log-Demons: Diffeomorphic Image Registration with Very Large Deformations, International Journal of Computer Vision, vol. 107, pp. 254-271, 2014. [30] C. Seiler, X. Pennec, M. Reyes, Geometry-Aware Multiscale Image Registration Via OBBTree-Based Polyaffine Log-Demons, Lecture Notes in Computer Science, pp. 631-638, 2011. [31] V. Siless, J. Glauns, P. Guevara, et al, Joint T1 and Brain Fiber Log-Demons Registration Using Currents to Model Geometry, Medical Image Computing and Computer-Assisted Intervention-MICCAI 2012, pp. 57-65, 2012. [32] L. Risser, F. Vialard, R. Wolz, et al, Simultaneous multi-scale registration using large deformation diffeomorphic metric mapping, IEEE Transactions on Medical Imaging, vol. 30, pp. 1746-1759, 2011. [33] http://www.bic.mni.mcgill.ca/brainweb/ [34] H. H. Chang, A. H. Zhuang, D. J. Valentino, and W. C. Chu, Performance measure characterization for evaluating neuroimage segmentation algorithms, Neuroimage, vol. 47, pp. 122-135, 2009. [35] http://people.csail.mit.edu/celiu/motionannotation/. [36] M. Jenkinson, C. F. Beckmann, T. E. J. Behrens, et al, FSL, Neuroimage, vol. 62, pp. 782-790, 2012. 2016 International Joint Conference on Neural Networks (IJCNN) 3059