Automatic Mitral Leaflet Tracking in Echocardiography by Outlier Detection in the Low-rank Representation

Size: px
Start display at page:

Download "Automatic Mitral Leaflet Tracking in Echocardiography by Outlier Detection in the Low-rank Representation"

Transcription

1 Automatic Mitral Leaflet Tracking in Echocardiography by Outlier Detection in the Low-rank Representation Xiaowei Zhou, Can Yang, Weichuan Yu Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong Abstract Tracking the mitral valve leaflet in an ultrasound sequence is a challenging task because of the poor image quality and fast and irregular leaflet motion. Previous algorithms usually applied standard segmentation methods based on edges, object intensity and anatomical information to segment the mitral leaflet in static frames. However, they are limited in practical applications due to the requirement of manual input for initialization or large annotated datasets for training. In this paper we present a completely automatic and unsupervised algorithm for mitral leaflet detection and tracking. We demonstrate that the image sequence of a cardiac cycle can be well approximated with a low-rank matrix, except for the mitral leaflet region with fast motion and tissue deformation. Based on this difference, we propose to track the mitral leaflet by detecting contiguous outliers in the low-rank representation. With this formulation, the leaflet is tracked using the motion cue, but the complicated motion computation is avoided. To the best of our knowledge, the proposed algorithm is the first unsupervised method for mitral leaflet tracking. The algorithm was tested on both 2D and 3D echocardiography, which achieved accurate segmentation with an average distance of 0.87±0.42mm compared to the manual tracing.. Introduction The mitral valve is a thin leaflet structure that lies between the left atrium and the left ventricle to control the direction of blood flow. Mitral valve related disease such as mitral regurgitation is the most common valvular heart disease [4]. Acquiring patient-specific information about the geometry and motion of the mitral valve from medical images is important to better understand the valvular disease and assist the surgical intervention for valve repair. Among various modalities, real-time 3D (RT3D) echocardiography provides an economic and noninvasive way to model the 3D geometry of the mitral valve and capture its fast motion [8]. In order to generate a comprehensive mitral valve model, the mitral leaflet surface needs to be segmented from ultrasound images and tracked throughout the sequence. Manual delineation of the mitral leaflet surface is both laborconsuming and prone to large variance, especially for 3D images when only 2D projection or a slice of the volumetric data can be displayed and processed by the operator at each time. Thus, developing an algorithm that can automatically detect and track the mitral leaflet is critical in clinic applications. While object tracking has been well studied in natural image processing [25], tracking the mitral leaflet from an ultrasound sequence is extremely difficult. Generally, the challenges arise from the following two aspects: Lack of reliable features: Selecting good features that easily distinguish an object of interest from others is critical in designing object tracking algorithms [25]. Common features in images include color (or intensity), edges and texture. However, in ultrasound images the mitral leaflet shares the identical intensity and texture with other tissues such as myocardium. Moreover, the feature quality (e.g. edges) is prone to be influenced by various factors including probe orientation, acoustic speckle, signal dropout, acoustic shadows, etc. [5]. Fast and irregular valve motion: Object tracking usually relies on the computation of optical flow to find feature-point correspondence between frames []. However, motion analysis in ultrasound sequences is extremely difficult and unreliable due to the featuremotion decorrelation problem [2]. Especially, it is more challenging under the conditions of fast motion, large deformation and low frame rate, which is the case in 3D imaging of the mitral valve. The literatures on mitral leaflet tracking are very limited. Most of the previous works tried to segment the mitral leaflet from each frame using active contours [2]. The ac /2/$ IEEE 972

2 (a) Cumulative energy distribution Valve region Reference region Whole image k 0 5 (b) (c) Figure. Matrix spectral analysis. In matrix spectral analysis, we convert the image/sub-image sequence into a matrix with the column index corresponding to the frame index in the sequence. Each column is a vectorized image/sub-image. (a) Manual selected regions for local analysis. The valve region (inside green ellipse) is centered around the valve leaflet, while the reference region covers part of the myocardium and part of the blood pool. (b) The cumulative distribution functions (cdf s) of spectral energy of the matrices corresponding to the valve region, the reference region and the whole image, respectively. The cdf is computed using Eq. (). (c) Results of valve region positioning based on matrix spectral analysis. The first frames of four tested sequences are shown from left to right. The sliding window that gives a matrix with the largest residue of rank-k fitting is displayed. The window is a rectangle, whose size is /7 of the image size. The detail of the procedure is described in Algorithm. tive contour was guided by various features such as edges [3], region statistics [9], optical flow [3] and geometry of the leaflet [4]. These methods required intensive user interaction to either initialize the active contour or correct the biased intermediate results during the segmentation [3]. Graph cuts combined with a thin tissue detector has also been used to find the mitral leaflet surface [7, 8]. While this approach proved to be robust and accurate in practice, it still requires user input to select particular frames and a point that indicates the location of the mitral valve before automatic segmentation. Recently, a learning-based system was proposed for automatic modeling the mitral valve from CT and ultrasound data [9]. In this method, a statistical shape model of the mitral valve was fitted to several anatomical landmarks to find the right position of the mitral valve in the image. Then, the model was refined to match the object boundary, which is defined by the learned boundary detector. Appealing results were obtained with fast speed. However, a large amount of expert-annotated data was needed to learn the shape model and detectors, which is unavailable to public and expensive to collect. In this paper, we aim to develop an unsupervised algorithm to detect and track the mitral leaflet throughout an ultrasound sequence automatically without additional user interaction or datasets for offline training. Instead of focusing on static frames, we would like to make use of the dynamic information throughout the entire sequence, i.e. the difference in motion patterns between the mitral leaflet and myocardium. Existing methods for motion segmentation on natural images tried to solve the problem by either partitioning the motion field [23, 7, 6] or classifying the trajectories of feature points that are extracted from the sequence [22]. Both of them relied on accurate motion estimation and parametric motion models. However, as mentioned previously, the optical flow computed from ultrasound images is very unreliable, especially for the mitral leaflet. Also, most of the cardiac tissues are moving in a complex way, which is difficult to be described by parametric models. Thus, it is hard 973

3 to achieve satisfactory results by simply applying the existing motion segmentation methods on mitral leaflet tracking. To address above challenges, we propose a novel framework for motion-based tracking of the mitral leaflet. Instead of local motion analysis, we explore the global correlation between image frames and try to segment the mitral leaflet by the faithfulness of fitting the image sequence with a lowrank representation [24]. The main contribution of this paper can be summarized as follows: Through matrix spectral analysis, we showed that more bases are needed to describe the mitral leaflet motion compared with the myocardium motion, which provides a promising feature for the mitral leaflet detection. To further illustrate this, we developed a simple algorithm that could locate the mitral valve region in ultrasound images robustly and efficiently. We formulated the mitral leaflet tracking problem as contiguous outlier detection in the low-rank representation. This formulation allows us to segment the object unsupervisedly based on the motion cue while avoiding complicated motion computation. To the best of our knowledge, our algorithm is the first unsupervised algorithm for automatic tracking of the mitral leaflet without any user interaction or training data. The rest of this paper is organized as follows: Section 2 explains the feature used in this paper for mitral leaflet detection. Section 3 introduces the formulation and the algorithm for mitral leaflet tracking. Section 4 reports the experiment results on real sequences. Finally, Section 5 concludes our paper with discussions. 2. Matrix Spectral Analysis Suppose there is an echocardiographic sequence composed of n images. Let D R m n represent a matrix whose columns are vectorized images, i.e. D = [vec(i ) vec(i n )], where m equals to the number of pixels in each image andnis the number of images. If no motion exists in the sequence, all images are identical and rank(d) = by ignoring the noise in images. S- ince cardiac motion exists, the images are changing within a cardiac cycle, which givesrank(d) >. However, due to the correlation among frames, the energy distribution in the matrix spectrum ofd will concentrate on a limited number of principle components. Define the cumulative distribution function (cdf ) of the spectral energy ofd as follows: cdf(k) = k i= σ2 i r i= σ2 i, () Matrix spectrum means the set of eigenvalues of the matrix. Algorithm Locating the valve region. Input: an image sequence{i,,i n }, a set of spatial windows {W l }, constantk. 2. for each l do 3. compute the singular values σ,,σ r for M = [vec(i W l ) vec(i n W l )], where I j W l means the sub-image ofi j insidew l. 4. ǫ 2 l = r i=k+ σ2 i. 5. end for 6. l = argmax l ǫ 2 l 7. Output: W l where r = min(m,n) and σ,,σ r are singular values of D in descending order. As shown in Figure (b), the cdf of the echocardiography sequence has exceeded95% when k > 2. Interestingly, when analyzing different regions locally we find that the corresponding cdf s are different. To demonstrate this, we choose two regions as shown in Figure (a): the valve region including the mitral leaflet; a reference region covering part of myocardium and part of the blood pool. Then, we compute the cdf of each sub-matrix formed by the sub-image sequence of each region. Figure (b) shows that the cdf curve of the valve region lies much lower than that of the reference region, which means that the spectral distribution of the valve region is more spread-out. This is attributed to the fact that the mitral leaflet moves much faster with larger tissue deformation compared with myocardium that moves smoothly across a cardiac cycle. Thus, more principle components are needed to describe the image variation caused by motion of the mitral leaflet. In practice, it is easy to show that 2 : r i=k+ σ 2 i = min D rank(b)=k B 2 F, (2) where B is any rank-k matrix. This means that, given a fixed K, the residue of fitting the valve region with a rank- K matrix will be much larger compared to the residue of fitting other regions. This provides a good feature to detect the mitral leaflet. To illustrate the feasibility of using this feature for mitral leaflet detection, we developed a simple algorithm for valve region positioning as described in Algorithm, with experimental results on real sequences given in Figure (c). In short, a rectangular window is used to define a region, and the sub-image sequence of this region is converted into a matrix with columns being the vectorized subimages. Then, the residue of rank-k fitting r i=k+ σ2 i is computed for the matrix. Next, the window is moved to 2 Three norms of a matrix X are used in this paper. X = ij X ij denotes the l -norm. X F = ij X2 ij is the Frobenius norm. X means the nuclear norm, i.e. sum of singular values. 974

4 cover another region and the residue is computed again, and so on and so forth. Finally, the window that gives a matrix with the largest residue of rank-k fitting is output and displayed. Here, we choosek = 5 for all examples. As shown in Figure (c), all of the output windows roughly cover the mitral leaflet in all examples, which demonstrates the effectiveness of using the proposed feature for mitral leaflet detection. 3. Mitral Leaflet Tracking While Algorithm can roughly locate the valve region, a more sophisticated algorithm is needed to track the leaflet more accurately. In this section, we propose an algorithm to track the mitral leaflet based on leaflet detection over the entire sequence. 3.. Formulation From the discussion in Section 2, we can see that the echocardiographic sequence can be well approximated by a low-rank matrix except for the mitral leaflet. Moreover, the mitral leaflet occupies a relatively small and connected region in the images. Thus, we formulate the problem of mitral leaflet segmentation as contiguous outlier detection in the low-rank representation. Let ij denote the i-th pixel in the j-th frame of the sequence 3 and S {0,} m n denote the outlier support, i.e. S ij = if ij is the mitral leaflet pixel and S ij = 0 otherwise. Thus, the task is to give an optimal estimate to S which labels the outliers of the low-rank model B. Since both B and S are unknown, it is required to estimate them simultaneously to acquire an accurate low-rank model and labeling of outliers. Let P S (X) represent the orthogonal projection of a matrixx onto the linear space of matrices supported bys: { 0, if Sij = 0 P S (X)(i,j) = (3) X ij, if S ij = andp S (X) be its complementary projection, i.e.p S (X)+ P S (X) = X. Then, we propose to minimize the following energy to estimateb ands: min B,S ij {0,} 2 P S (D B) 2 F +β S, s.t. rank(b) K, (4) where K is a predefined constant. The first term penalizes the fitting residue for the non-valvular region, while the second term regularizes the sparsity of the mitral leaflet pixels. Since the leaflet pixels should be contiguous both spatially and temporally, we introduce a smoothness regularizer on S. Consider a graph G = (V,E), where V is the 3 We didn t distinguish between pixel and voxel in this paper because our method is applicable to both 2D and 3D image sequences. set of vertices denoting all m n pixels in the sequence and E is the set of edges connecting spatially and temporally neighboring pixels. Based on the first order Markov Random Fields (MRFs), we adopt the following energy to impose continuity ons: Avec(S) = ω ij,kl S ij S kl, (5) (ij,kl) E where A is the weighted node-edge incidence matrix of G, and the weightω ij,kl is defined as follows: { G ω ij,kl = e D ij DG kl 2 2µ 2, ifij andkl are spatial neighbors, ω t, ifij andkl are temporal neighbors. Here, D G is the Gaussian smoothed image sequence, µ is the standard deviation of Dij G DG kl for spatial neighbors, andω t is the weight for temporal links. We simply fixedω t to be 0. in the implementation. Introducing the spatiallyvaryingω ij,kl makes use of the edge information to improve segmentation. To make the energy minimization tractable, we relax the rank operator onb with the nuclear norm, which has proven to be an effective convex surrogate of the rank operator [6]. Adding the smoothness regularizer and writing (4) in its d- ual form, we obtain the final form of the energy function: min B,S 2 P S (D B) 2 F +α B +β S +γ Avec(S). (6) Here, α, β and γ are all positive parameters, which will be discussed in detail in Section Optimization The objective function defined in (6) is non-convex and it includes both continuous and discrete variables. Joint optimization over B and S is extremely difficult. Hence, we adopt an alternating algorithm that separates the energy minimization over B and S into two steps. B-step is a convex optimization problem and S-step is a combinatorial optimization problem. It turns out that the optimal solutions of B-step and S-step can be computed efficiently. Given an estimate of the support matrixŝ, the minimization in (6) over B turns out to be the matrix completion problem []: min B 2 P Ŝ (D B) 2 F +α B. (7) The original problem is to learn a low-rank matrix from partial observations. The optimal B in (7) can be computed efficiently by the SOFT-IMPUTE algorithm [], which iteratively updates the estimate ˆB using: ˆB Θ α (PŜ (D)+PŜ(ˆB)), (8) 975

5 whereθ α is the singular value thresholding operator: Θ α (X) UΣ α V, Σ α = diag[(d α) +,,(d r α) + ]. (9) HereUΣV is the SVD ofx,d,,d r are singular values of X, and t + = max(t,0). Please refer to [] for more detailed explanations of SOFT-IMPUTE. Next, we minimize the energy in (6) over S given the low-rank matrix ˆB. Noticing that S ij {0,}, the energy can be rewritten as follows: 2 P S (D ˆB) 2 F +β S +γ Avec(S) = (D ij 2 ˆB ij) 2 ( S ij)+β S ij +γ Avec(S) ij ij = (β 2 (Dij ˆB ij) 2 )S ij +γ Avec(S) +C, (0) ij where C = 2 ij (D ij ˆB ij ) 2 is a constant when ˆB is fixed. Above energy is in the standard form of the firstorder MRFs with binary labels, which can be solved exactly in polynomial time using graph cuts [3, 0] Parameter tuning The parameter α in (6) controls rank(ˆb), i.e. K in (4). The low-rank model with an appropriate K should include the myocardium, but exclude the mitral leaflet. According to Figure (b), we choose K = 5 for all experiments. In implementation, we start from a large α. After each run of SOFT-IMPUTE, if rank(ˆb) K, we reduce α by a factor η = 0.9 and repeat SOFT-IMPUTE again until rank(ˆb) > K. Using warm start, this sequential optimization is efficient []. In practice, we find that the result is relatively insensitive to K when K is reasonably large (K 3). This is attributed to the shrinkage effect of the nuclear norm regularization []. The parameter β in (6) controls the sparsity of S. From (0) we can see that Ŝij is more likely to be if 2 (D ij ˆB ij ) 2 > β. Thus the choice of β should depend on the noise level in images and a proper value can be estimated online. Typically we set β = 4.5ˆσ 2, where ˆσ 2 is the variance ofd ij ˆB ij. Since the estimation of ˆB and ˆσ is biased at the beginning iterations, we propose to start our algorithm with a relatively large β, and then reduce β by a factor η 2 = 0.5 after each iteration untilβ reaches4.5ˆσ 2. In other words, we tolerate more error in model fitting at the beginning, since the model itself is not accurate enough. With the model estimation getting better and better, we decrease the threshold and declare more and more outliers. The parameter γ in (6) controls the strength of mutual dependency between neighboring pixels. A larger γ gives more penalty to isolated outliers in order to smooth Ŝ. In all our experiments, we simply chooseγ = β. Algorithm 2 Contiguous Outlier Detection. Input:D = [I,,I n] R m n 2. Initialize: ˆB D,Ŝ 0,α,β. 3. repeat 4. repeat 5. ˆB Θα(PŜ (D)+PŜ(ˆB)); 6. until convergence 7. if rank(ˆb) K then 8. α η α; 9. go to Step 4; 0. end if. estimate ˆσ; 2. β max(η 2β,4.5ˆσ 2 ); 3. Ŝ argmin (β 2 (Dij ˆB ij) 2 )S ij +γ Avec(S) S ij 4. until convergence 5. Output: ˆB,Ŝ Thus, we used the same parameter setting for all experiments. All steps of the algorithm with adaptive parameter tuning are summarized in Algorithm 2. Since we are always minimizing a single function in each step and the parameters (α, β, γ) keep decreasing in adaptive tuning, the energy in (6) decreases monotonically. Furthermore, we can manually set lower bounds for both α and β to stop the iteration. Thus, the convergence of the algorithm is guaranteed. Empirically, Algorithm 2 will terminate in about 0 iterations for a convergence precision of Results To the best of our knowledge, there is no automatic algorithm that can detect the mitral leaflet in previous literatures except for [9], while the method in [9] requires large manually annotated datasets for training feature detectors, which is unavailable to public. Thus, in this paper we mainly focus on the verification of the new algorithm. We evaluated the mitral leaflet tracking method using s- tandard transthoracic echocardiographic (TTE) data 4. All sequences were acquired during a cardiac cycle, using a Philips ie33 Ultrasound System with a S5- probe for 2D imaging and an X3- probe for 3D imaging. We cropped the acquired sequences to remove irrelevant parts and focus on the left chambers. The cropped sequences were fed into Algorithm 2 without other preprocessing. To improve the accuracy of detection, a simple postprocessing was applied to the estimated outlier support of Algorithm 2. We used morphological operations to extract the largest connected component in the mask for each frame, and removed the false detections caused by other tissues with fast motion such as the papillary muscles. 4 While the transesophageal echocardiogram (TEE) is better to image the mitral valve, it is not easy to access. 976

6 (a) (b) (c) (d) Figure 2. Results on 2D echocardiographic sequences. Each sub-figure corresponds to a sequence. Three selected frames during valve opening are displayed from top to bottom. The three columns from left to right show the original images, the segmentation results and the corresponding low-rank components, respectively. 977

7 Firstly, we present the results on four 2D sequences. The sequences were acquired from the apex view. Each sequence has about 30 frames recording a cardiac cycle, with an image size of pixels. The first frames are displayed in Figure (c). The images were cropped to pixels as input to Algorithm 2. To display the results, we selected three frames during valve opening for each sequence. The segmentation results Ŝ and low-rank components ˆB are shown in Figure 2. The mitral leaflet was detected accurately as outliers and excluded from the lowrank component. Moreover, the low-rank model captured the global motion of myocardium. Interestingly, the ultrasound speckles were also depressed in the low-rank components, while the edges of the endocardium border were almost preserved. This also shows the potential of applying the low-rank representation on ultrasound despeckling [2]. Next, we give a quantitative analysis for the segmentation results in Figure 2. The ground truth was provided by manual tracing. Three metrics were used: precision, recall and the mean absolute distance (MAD) between contours, which are defined as follows: precision = Ω Ĉ Ω C, recall = Ω Ĉ Ω C, ΩĈ Ω C MAD(Ĉ,C ) = 2 0 [ d(ĉ(s),c )+d(c (s),ĉ) ] ds. Here,Ĉ means the algorithm-generated contour andc denotes the manual-delineated contour. Ω C means the region enclosed by contourc and Ω is the number of pixels inside regionω. C(s) is a parameterization of contourc with constant velocity C (s). d(p,c) = min s p C(s ) 2 is the minimum distance from point p to contour C. The results are summarized in Table. The MAD has the same order of magnitude with the resolution of the imaging system ( 0.5 mm) and the precision is high. However, the recall is relatively low compared with the resulted precision, which shows that there is a systematic bias of under-segmentation. There are two possible reasons: () The leaflet tissue near the mitral annulus moves similarly with the myocardium. Thus, the method may fail to detect this part. (2) The shrinkage effect of the smoothness constraint (or named small cut behavior) causes under-segmentation. This bias can be corrected by using other information like shape priors. Finally, we demonstrate the applicability of our algorithm to RT3D echocardiography. Due to the lack of highquality TEE data, here we only give some qualitative results on an ECG-gated TTE sequence. The sequence was composed of 7 volumes with voxels per volume. Irrelevant parts were removed and voxels were left for each volume. Since the MRF of the entire sequence ( nodes existed) can t be solved by graph cuts due to the memory limit, the temporal links in the MRF were removed here. Then, graph cuts Table. Quantitative evaluation of the tracking results displayed in Figure 2. The ground truth is provided by manual tracing. Each cell shows the mean value and the standard deviation. precision recall MAD(mm) Sequence (a) 0.93± ± ±0.7 Sequence (b) 0.95± ± ±0.8 Sequence (c) 0.92± ± ±0.63 Sequence (d) 0.9± ± ±0.5 Overall 0.93± ± ±0.42 could be performed volume by volume. The segmentation results on a sample volume are displayed in Figure 3. The algorithm was implemented in MATLAB. All experiments were run on a PC with a 3.4 GHz Intel i7 CPU and 8 GB RAM. It costs around 30 seconds to analyze a 2D sequence and 24.4 minutes to analyze a 3D sequence. The efficiency of the algorithm can be improved by C implementation or GPU computing. 5. Discussion In this paper, we proposed a new feature for mitral leaflet detection and a novel algorithm for leaflet tracking. The algorithm is completely automatic without manual initialization and annotated training data. According to our knowledge, this is the first unsupervised algorithm for mitral leaflet tracking. Our formulation is similar to the sparse and low-rank decomposition or Principle Component Pursuit (PCP) [5], which becomes popular recently. There are several key differences between our algorithm and PCP: PCP uses a convex relaxation by replacing the penalty on the cardinality of outliers with the l -norm. This relaxation requires outliers to be randomly distributed [5]. In our formulation, we directly optimize the nonconvex penalty (notice that S in (6) equals to the cardinality of outliers) to make use of the robustness of the nonconvex penalty in outlier detection [20]. PCP does not use the contiguous property of outliers. In our formulation, the MRF is integrated to model the contiguity prior to further improve the outlier detection accuracy. PCP makes the sparse and low-rank decomposition while ignoring the noise part. In our method, the noise is also considered, which is more general in practice. In future, we plan to conduct a more comprehensive e- valuation of the algorithm on more RT3D data, including high-quality TEE sequences. Also, we would like to integrate more features such as the geometry of the mitral valve into our framework. 978

8 X-Z (two-chamber) Y-Z (four-chamber) X-Y (short-axis) 3-D Figure 3. Segmentation results on a RT3D echocardiographic sequence. Only the result on a sample frame is displayed. From left to right are three orthogonal 2D slices across the mitral leaflet and a 3D model of the mitral leaflet generated by surface rendering. References [] S. Beauchemin and J. Barron. The computation of optical flow. ACM Computing Surveys, 27(3): , 995. [2] A. Blake and M. Isard. Active contours. Springer, 998. [3] Y. Boykov, O. Veksler, and R. Zabih. Fast approximate energy minimization via graph cuts. PAMI, 23(): , [4] P. Burlina, C. Sprouse, D. DeMenthon, A. Jorstad, R. Juang, F. Contijoch, T. Abraham, D. Yuh, and E. McVeigh. Patientspecific modeling and analysis of the mitral valve using 3D- TEE. Information Processing in Computer-Assisted Interventions, pages 35 46, [5] E. Candes, X. Li, Y. Ma, and J. Wright. Robust Principal Component Analysis? Journal of ACM, 58(): 37, [6] A. Chan and N. Vasconcelos. Layered dynamic textures. PA- MI, 3(0): , [7] D. Cremers and S. Soatto. Motion competition: A variational approach to piecewise parametric motion segmentation. IJCV, 62(3): , [8] J. Hung, R. Lang, F. Flachskampf, S. Shernan, M. McCulloch, D. Adams, J. Thomas, M. Vannan, and T. Ryan. 3d echocardiography: a review of the current status and future directions. Journal of the American Society of Echocardiography, 20(3):23 233, [9] R. Ionasec, I. Voigt, B. Georgescu, Y. Wang, H. Houle, F. Vega-Higuera, N. Navab, and D. Comaniciu. Patientspecific modeling and quantification of the aortic and mitral valves from 4-D cardiac CT and TEE. IEEE Trans. Medical Imaging, 29(9):636 65, , 5 [0] V. Kolmogorov and R. Zabih. What Energy Functions Can Be Minimizedvia Graph Cuts? PAMI, 26(2):47 59, [] R. Mazumder, T. Hastie, and R. Tibshirani. Spectral Regularization Algorithms for Learning Large Incomplete Matrices. JMLR, : , , 5 [2] J. Meunier and M. Bertrand. Ultrasonic texture motion analysis: theory and simulation. IEEE Trans. Medical Imaging, 4(2): , 995. [3] I. Mikic, S. Krucinski, and J. Thomas. Segmentation and tracking in echocardiographic sequences: Active contours guided by optical flow estimates. IEEE Trans. Medical Imaging, 7(2): , [4] V. Nkomo, J. Gardin, T. Skelton, J. Gottdiener, C. Scott, and M. Enriquez-Sarano. Burden of valvular heart diseases: a population-based study. The Lancet, 368(9540):005 0, [5] J. Noble and D. Boukerroui. Ultrasound image segmentation: A survey. IEEE Trans. Medical Imaging, 25(8):987 00, [6] B. Recht, M. Fazel, and P. Parrilo. Guaranteed Minimum- Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization. SIAM Review, 52(3):47 50, [7] R. Schneider, D. Perrin, N. Vasilyev, G. Marx, P. del Nido, and R. Howe. Mitral annulus segmentation from 3D ultrasound using graph cuts. IEEE Trans. Medical Imaging, 29(9): , [8] R. Schneider, N. Tenenholtz, D. Perrin, G. Marx, P. del Nido, and R. Howe. Patient-specific mitral leaflet segmentation from 4D ultrasound. In MICCAI, [9] Y. Shang, X. Yang, L. Zhu, R. Deklerck, and E. Nyssen. Region competition based active contour for medical object extraction. Computerized Medical Imaging and Graphics, 32(2):09 7, [20] Y. She and A. Owen. Outlier detection using nonconvex penalized regression. Journal of the American Statistical Association, 06(494): , [2] P. Tay, C. Garson, S. Acton, and J. Hossack. Ultrasound despeckling for contrast enhancement. IEEE Transactions on Image Processing, 9(7): , [22] R. Vidal and Y. Ma. A unified algebraic approach to 2-d and 3-d motion segmentation. In ECCV, [23] Y. Weiss. Smoothness in layers: Motion segmentation using nonparametric mixture estimation. In CVPR, [24] J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, and S. Yan. Sparse representation for computer vision and pattern recognition. Proceedings of the IEEE, 98(6):03 044, [25] A. Yilmaz, O. Javed, and M. Shah. Object tracking: A survey. ACM computing surveys, 38(4): 45,

Modeling Mitral Valve Leaflets from Three-Dimensional Ultrasound

Modeling Mitral Valve Leaflets from Three-Dimensional Ultrasound Modeling Mitral Valve Leaflets from Three-Dimensional Ultrasound Robert J. Schneider 1, William C. Burke 1, Gerald R. Marx 3, Pedro J. del Nido 2, and Robert D. Howe 1 1 Harvard School of Engineering and

More information

Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference

Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference Minh Dao 1, Xiang Xiang 1, Bulent Ayhan 2, Chiman Kwan 2, Trac D. Tran 1 Johns Hopkins Univeristy, 3400

More information

Chapter 9 Conclusions

Chapter 9 Conclusions Chapter 9 Conclusions This dissertation has described a new method for using local medial properties of shape to identify and measure anatomical structures. A bottom up approach based on image properties

More information

Direct Matrix Factorization and Alignment Refinement: Application to Defect Detection

Direct Matrix Factorization and Alignment Refinement: Application to Defect Detection Direct Matrix Factorization and Alignment Refinement: Application to Defect Detection Zhen Qin (University of California, Riverside) Peter van Beek & Xu Chen (SHARP Labs of America, Camas, WA) 2015/8/30

More information

Tracking the Left Ventricle through Collaborative Trackers and Sparse Shape Model

Tracking the Left Ventricle through Collaborative Trackers and Sparse Shape Model Tracking the Left Ventricle through Collaborative Trackers and Sparse Shape Model Yan Zhou IMPAC Medical Systems, Elekta Inc., Maryland Heights, MO, USA Abstract. Tracking the left ventricle plays an important

More information

A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields

A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields Lars König, Till Kipshagen and Jan Rühaak Fraunhofer MEVIS Project Group Image Registration,

More information

Robust boundary detection and tracking of left ventricles on ultrasound images using active shape model and ant colony optimization

Robust boundary detection and tracking of left ventricles on ultrasound images using active shape model and ant colony optimization Bio-Medical Materials and Engineering 4 (04) 893 899 DOI 0.333/BME-408 IOS Press 893 Robust boundary detection and tracking of left ventricles on ultrasound images using active shape model and ant colony

More information

Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging

Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging 1 CS 9 Final Project Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging Feiyu Chen Department of Electrical Engineering ABSTRACT Subject motion is a significant

More information

Segmentation in Noisy Medical Images Using PCA Model Based Particle Filtering

Segmentation in Noisy Medical Images Using PCA Model Based Particle Filtering Segmentation in Noisy Medical Images Using PCA Model Based Particle Filtering Wei Qu a, Xiaolei Huang b, and Yuanyuan Jia c a Siemens Medical Solutions USA Inc., AX Division, Hoffman Estates, IL 60192;

More information

Segmentation of MR Images of a Beating Heart

Segmentation of MR Images of a Beating Heart Segmentation of MR Images of a Beating Heart Avinash Ravichandran Abstract Heart Arrhythmia is currently treated using invasive procedures. In order use to non invasive procedures accurate imaging modalities

More information

The Usage of Optical Flow Algorithm to the Problem of Recovery Contour of the Left Ventricle of the Human Heart on the Ultrasound Image Data

The Usage of Optical Flow Algorithm to the Problem of Recovery Contour of the Left Ventricle of the Human Heart on the Ultrasound Image Data The Usage of Optical Flow Algorithm to the Problem of Recovery Contour of the Left Ventricle of the Human Heart on the Ultrasound Image Data Andrey A. Mukhtarov 1, Sergey V. Porshnev 1, Vasiliy V. Zyuzin

More information

Segmentation with non-linear constraints on appearance, complexity, and geometry

Segmentation with non-linear constraints on appearance, complexity, and geometry IPAM February 2013 Western Univesity Segmentation with non-linear constraints on appearance, complexity, and geometry Yuri Boykov Andrew Delong Lena Gorelick Hossam Isack Anton Osokin Frank Schmidt Olga

More information

Improving Image Segmentation Quality Via Graph Theory

Improving Image Segmentation Quality Via Graph Theory International Symposium on Computers & Informatics (ISCI 05) Improving Image Segmentation Quality Via Graph Theory Xiangxiang Li, Songhao Zhu School of Automatic, Nanjing University of Post and Telecommunications,

More information

ADAPTIVE LOW RANK AND SPARSE DECOMPOSITION OF VIDEO USING COMPRESSIVE SENSING

ADAPTIVE LOW RANK AND SPARSE DECOMPOSITION OF VIDEO USING COMPRESSIVE SENSING ADAPTIVE LOW RANK AND SPARSE DECOMPOSITION OF VIDEO USING COMPRESSIVE SENSING Fei Yang 1 Hong Jiang 2 Zuowei Shen 3 Wei Deng 4 Dimitris Metaxas 1 1 Rutgers University 2 Bell Labs 3 National University

More information

Cellular Learning Automata-Based Color Image Segmentation using Adaptive Chains

Cellular Learning Automata-Based Color Image Segmentation using Adaptive Chains Cellular Learning Automata-Based Color Image Segmentation using Adaptive Chains Ahmad Ali Abin, Mehran Fotouhi, Shohreh Kasaei, Senior Member, IEEE Sharif University of Technology, Tehran, Iran abin@ce.sharif.edu,

More information

I How does the formulation (5) serve the purpose of the composite parameterization

I How does the formulation (5) serve the purpose of the composite parameterization Supplemental Material to Identifying Alzheimer s Disease-Related Brain Regions from Multi-Modality Neuroimaging Data using Sparse Composite Linear Discrimination Analysis I How does the formulation (5)

More information

ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION

ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION Abstract: MIP Project Report Spring 2013 Gaurav Mittal 201232644 This is a detailed report about the course project, which was to implement

More information

Learning and Inferring Depth from Monocular Images. Jiyan Pan April 1, 2009

Learning and Inferring Depth from Monocular Images. Jiyan Pan April 1, 2009 Learning and Inferring Depth from Monocular Images Jiyan Pan April 1, 2009 Traditional ways of inferring depth Binocular disparity Structure from motion Defocus Given a single monocular image, how to infer

More information

Left Ventricle Endocardium Segmentation for Cardiac CT Volumes Using an Optimal Smooth Surface

Left Ventricle Endocardium Segmentation for Cardiac CT Volumes Using an Optimal Smooth Surface Left Ventricle Endocardium Segmentation for Cardiac CT Volumes Using an Optimal Smooth Surface Yefeng Zheng a, Bogdan Georgescu a, Fernando Vega-Higuera b, and Dorin Comaniciu a a Integrated Data Systems

More information

Robust Live Tracking of Mitral Valve Annulus for Minimally-Invasive Intervention Guidance

Robust Live Tracking of Mitral Valve Annulus for Minimally-Invasive Intervention Guidance Robust Live Tracking of Mitral Valve Annulus for Minimally-Invasive Intervention Guidance Ingmar Voigt 1, Mihai Scutaru 2, Tommaso Mansi 3, Bogdan Georgescu 3, Noha El-Zehiry 3, Helene Houle 4, and Dorin

More information

MR IMAGE SEGMENTATION

MR IMAGE SEGMENTATION MR IMAGE SEGMENTATION Prepared by : Monil Shah What is Segmentation? Partitioning a region or regions of interest in images such that each region corresponds to one or more anatomic structures Classification

More information

Short Survey on Static Hand Gesture Recognition

Short Survey on Static Hand Gesture Recognition Short Survey on Static Hand Gesture Recognition Huu-Hung Huynh University of Science and Technology The University of Danang, Vietnam Duc-Hoang Vo University of Science and Technology The University of

More information

Supplementary Material : Partial Sum Minimization of Singular Values in RPCA for Low-Level Vision

Supplementary Material : Partial Sum Minimization of Singular Values in RPCA for Low-Level Vision Supplementary Material : Partial Sum Minimization of Singular Values in RPCA for Low-Level Vision Due to space limitation in the main paper, we present additional experimental results in this supplementary

More information

intro, applications MRF, labeling... how it can be computed at all? Applications in segmentation: GraphCut, GrabCut, demos

intro, applications MRF, labeling... how it can be computed at all? Applications in segmentation: GraphCut, GrabCut, demos Image as Markov Random Field and Applications 1 Tomáš Svoboda, svoboda@cmp.felk.cvut.cz Czech Technical University in Prague, Center for Machine Perception http://cmp.felk.cvut.cz Talk Outline Last update:

More information

Interactive Differential Segmentation of the Prostate using Graph-Cuts with a Feature Detector-based Boundary Term

Interactive Differential Segmentation of the Prostate using Graph-Cuts with a Feature Detector-based Boundary Term MOSCHIDIS, GRAHAM: GRAPH-CUTS WITH FEATURE DETECTORS 1 Interactive Differential Segmentation of the Prostate using Graph-Cuts with a Feature Detector-based Boundary Term Emmanouil Moschidis emmanouil.moschidis@postgrad.manchester.ac.uk

More information

An efficient algorithm for sparse PCA

An efficient algorithm for sparse PCA An efficient algorithm for sparse PCA Yunlong He Georgia Institute of Technology School of Mathematics heyunlong@gatech.edu Renato D.C. Monteiro Georgia Institute of Technology School of Industrial & System

More information

Supervised texture detection in images

Supervised texture detection in images Supervised texture detection in images Branislav Mičušík and Allan Hanbury Pattern Recognition and Image Processing Group, Institute of Computer Aided Automation, Vienna University of Technology Favoritenstraße

More information

Edge and local feature detection - 2. Importance of edge detection in computer vision

Edge and local feature detection - 2. Importance of edge detection in computer vision Edge and local feature detection Gradient based edge detection Edge detection by function fitting Second derivative edge detectors Edge linking and the construction of the chain graph Edge and local feature

More information

Occluded Facial Expression Tracking

Occluded Facial Expression Tracking Occluded Facial Expression Tracking Hugo Mercier 1, Julien Peyras 2, and Patrice Dalle 1 1 Institut de Recherche en Informatique de Toulouse 118, route de Narbonne, F-31062 Toulouse Cedex 9 2 Dipartimento

More information

Image Segmentation Via Iterative Geodesic Averaging

Image Segmentation Via Iterative Geodesic Averaging Image Segmentation Via Iterative Geodesic Averaging Asmaa Hosni, Michael Bleyer and Margrit Gelautz Institute for Software Technology and Interactive Systems, Vienna University of Technology Favoritenstr.

More information

Unsupervised Learning

Unsupervised Learning Unsupervised Learning Learning without Class Labels (or correct outputs) Density Estimation Learn P(X) given training data for X Clustering Partition data into clusters Dimensionality Reduction Discover

More information

CHAPTER 6 MODIFIED FUZZY TECHNIQUES BASED IMAGE SEGMENTATION

CHAPTER 6 MODIFIED FUZZY TECHNIQUES BASED IMAGE SEGMENTATION CHAPTER 6 MODIFIED FUZZY TECHNIQUES BASED IMAGE SEGMENTATION 6.1 INTRODUCTION Fuzzy logic based computational techniques are becoming increasingly important in the medical image analysis arena. The significant

More information

CHAPTER 6 PERCEPTUAL ORGANIZATION BASED ON TEMPORAL DYNAMICS

CHAPTER 6 PERCEPTUAL ORGANIZATION BASED ON TEMPORAL DYNAMICS CHAPTER 6 PERCEPTUAL ORGANIZATION BASED ON TEMPORAL DYNAMICS This chapter presents a computational model for perceptual organization. A figure-ground segregation network is proposed based on a novel boundary

More information

Mitral Annulus Segmentation From 3D Ultrasound Using Graph Cuts

Mitral Annulus Segmentation From 3D Ultrasound Using Graph Cuts Mitral Annulus Segmentation From 3D Ultrasound Using Graph Cuts The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published

More information

Boosting and Nonparametric Based Tracking of Tagged MRI Cardiac Boundaries

Boosting and Nonparametric Based Tracking of Tagged MRI Cardiac Boundaries Boosting and Nonparametric Based Tracking of Tagged MRI Cardiac Boundaries Zhen Qian 1, Dimitris N. Metaxas 1,andLeonAxel 2 1 Center for Computational Biomedicine Imaging and Modeling, Rutgers University,

More information

Semantic Context Forests for Learning- Based Knee Cartilage Segmentation in 3D MR Images

Semantic Context Forests for Learning- Based Knee Cartilage Segmentation in 3D MR Images Semantic Context Forests for Learning- Based Knee Cartilage Segmentation in 3D MR Images MICCAI 2013: Workshop on Medical Computer Vision Authors: Quan Wang, Dijia Wu, Le Lu, Meizhu Liu, Kim L. Boyer,

More information

COSC160: Detection and Classification. Jeremy Bolton, PhD Assistant Teaching Professor

COSC160: Detection and Classification. Jeremy Bolton, PhD Assistant Teaching Professor COSC160: Detection and Classification Jeremy Bolton, PhD Assistant Teaching Professor Outline I. Problem I. Strategies II. Features for training III. Using spatial information? IV. Reducing dimensionality

More information

Nonrigid Surface Modelling. and Fast Recovery. Department of Computer Science and Engineering. Committee: Prof. Leo J. Jia and Prof. K. H.

Nonrigid Surface Modelling. and Fast Recovery. Department of Computer Science and Engineering. Committee: Prof. Leo J. Jia and Prof. K. H. Nonrigid Surface Modelling and Fast Recovery Zhu Jianke Supervisor: Prof. Michael R. Lyu Committee: Prof. Leo J. Jia and Prof. K. H. Wong Department of Computer Science and Engineering May 11, 2007 1 2

More information

MOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK

MOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK MOVING OBJECT DETECTION USING BACKGROUND SUBTRACTION ALGORITHM USING SIMULINK Mahamuni P. D 1, R. P. Patil 2, H.S. Thakar 3 1 PG Student, E & TC Department, SKNCOE, Vadgaon Bk, Pune, India 2 Asst. Professor,

More information

Continuous and Discrete Optimization Methods in Computer Vision. Daniel Cremers Department of Computer Science University of Bonn

Continuous and Discrete Optimization Methods in Computer Vision. Daniel Cremers Department of Computer Science University of Bonn Continuous and Discrete Optimization Methods in Computer Vision Daniel Cremers Department of Computer Science University of Bonn Oxford, August 16 2007 Segmentation by Energy Minimization Given an image,

More information

Lesion Segmentation and Bias Correction in Breast Ultrasound B-mode Images Including Elastography Information

Lesion Segmentation and Bias Correction in Breast Ultrasound B-mode Images Including Elastography Information Lesion Segmentation and Bias Correction in Breast Ultrasound B-mode Images Including Elastography Information Gerard Pons a, Joan Martí a, Robert Martí a, Mariano Cabezas a, Andrew di Battista b, and J.

More information

Limitations of Matrix Completion via Trace Norm Minimization

Limitations of Matrix Completion via Trace Norm Minimization Limitations of Matrix Completion via Trace Norm Minimization ABSTRACT Xiaoxiao Shi Computer Science Department University of Illinois at Chicago xiaoxiao@cs.uic.edu In recent years, compressive sensing

More information

CHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS

CHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS 130 CHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS A mass is defined as a space-occupying lesion seen in more than one projection and it is described by its shapes and margin

More information

An Approach for Reduction of Rain Streaks from a Single Image

An Approach for Reduction of Rain Streaks from a Single Image An Approach for Reduction of Rain Streaks from a Single Image Vijayakumar Majjagi 1, Netravati U M 2 1 4 th Semester, M. Tech, Digital Electronics, Department of Electronics and Communication G M Institute

More information

Texture Image Segmentation using FCM

Texture Image Segmentation using FCM Proceedings of 2012 4th International Conference on Machine Learning and Computing IPCSIT vol. 25 (2012) (2012) IACSIT Press, Singapore Texture Image Segmentation using FCM Kanchan S. Deshmukh + M.G.M

More information

Analysis of CMR images within an integrated healthcare framework for remote monitoring

Analysis of CMR images within an integrated healthcare framework for remote monitoring Analysis of CMR images within an integrated healthcare framework for remote monitoring Abstract. We present a software for analyzing Cardiac Magnetic Resonance (CMR) images. This tool has been developed

More information

Probabilistic Facial Feature Extraction Using Joint Distribution of Location and Texture Information

Probabilistic Facial Feature Extraction Using Joint Distribution of Location and Texture Information Probabilistic Facial Feature Extraction Using Joint Distribution of Location and Texture Information Mustafa Berkay Yilmaz, Hakan Erdogan, Mustafa Unel Sabanci University, Faculty of Engineering and Natural

More information

Colour Segmentation-based Computation of Dense Optical Flow with Application to Video Object Segmentation

Colour Segmentation-based Computation of Dense Optical Flow with Application to Video Object Segmentation ÖGAI Journal 24/1 11 Colour Segmentation-based Computation of Dense Optical Flow with Application to Video Object Segmentation Michael Bleyer, Margrit Gelautz, Christoph Rhemann Vienna University of Technology

More information

Accelerating Pattern Matching or HowMuchCanYouSlide?

Accelerating Pattern Matching or HowMuchCanYouSlide? Accelerating Pattern Matching or HowMuchCanYouSlide? Ofir Pele and Michael Werman School of Computer Science and Engineering The Hebrew University of Jerusalem {ofirpele,werman}@cs.huji.ac.il Abstract.

More information

An R Package flare for High Dimensional Linear Regression and Precision Matrix Estimation

An R Package flare for High Dimensional Linear Regression and Precision Matrix Estimation An R Package flare for High Dimensional Linear Regression and Precision Matrix Estimation Xingguo Li Tuo Zhao Xiaoming Yuan Han Liu Abstract This paper describes an R package named flare, which implements

More information

Sparsity Based Spectral Embedding: Application to Multi-Atlas Echocardiography Segmentation!

Sparsity Based Spectral Embedding: Application to Multi-Atlas Echocardiography Segmentation! Sparsity Based Spectral Embedding: Application to Multi-Atlas Echocardiography Segmentation Ozan Oktay, Wenzhe Shi, Jose Caballero, Kevin Keraudren, and Daniel Rueckert Department of Compu.ng Imperial

More information

Normalized cuts and image segmentation

Normalized cuts and image segmentation Normalized cuts and image segmentation Department of EE University of Washington Yeping Su Xiaodan Song Normalized Cuts and Image Segmentation, IEEE Trans. PAMI, August 2000 5/20/2003 1 Outline 1. Image

More information

Unsupervised learning in Vision

Unsupervised learning in Vision Chapter 7 Unsupervised learning in Vision The fields of Computer Vision and Machine Learning complement each other in a very natural way: the aim of the former is to extract useful information from visual

More information

Image Segmentation and Registration

Image Segmentation and Registration Image Segmentation and Registration Dr. Christine Tanner (tanner@vision.ee.ethz.ch) Computer Vision Laboratory, ETH Zürich Dr. Verena Kaynig, Machine Learning Laboratory, ETH Zürich Outline Segmentation

More information

Markov Networks in Computer Vision

Markov Networks in Computer Vision Markov Networks in Computer Vision Sargur Srihari srihari@cedar.buffalo.edu 1 Markov Networks for Computer Vision Some applications: 1. Image segmentation 2. Removal of blur/noise 3. Stereo reconstruction

More information

Color-Texture Segmentation of Medical Images Based on Local Contrast Information

Color-Texture Segmentation of Medical Images Based on Local Contrast Information Color-Texture Segmentation of Medical Images Based on Local Contrast Information Yu-Chou Chang Department of ECEn, Brigham Young University, Provo, Utah, 84602 USA ycchang@et.byu.edu Dah-Jye Lee Department

More information

SEMI-BLIND IMAGE RESTORATION USING A LOCAL NEURAL APPROACH

SEMI-BLIND IMAGE RESTORATION USING A LOCAL NEURAL APPROACH SEMI-BLIND IMAGE RESTORATION USING A LOCAL NEURAL APPROACH Ignazio Gallo, Elisabetta Binaghi and Mario Raspanti Universitá degli Studi dell Insubria Varese, Italy email: ignazio.gallo@uninsubria.it ABSTRACT

More information

Convex Optimization / Homework 2, due Oct 3

Convex Optimization / Homework 2, due Oct 3 Convex Optimization 0-725/36-725 Homework 2, due Oct 3 Instructions: You must complete Problems 3 and either Problem 4 or Problem 5 (your choice between the two) When you submit the homework, upload a

More information

Linear Methods for Regression and Shrinkage Methods

Linear Methods for Regression and Shrinkage Methods Linear Methods for Regression and Shrinkage Methods Reference: The Elements of Statistical Learning, by T. Hastie, R. Tibshirani, J. Friedman, Springer 1 Linear Regression Models Least Squares Input vectors

More information

A Geometric Analysis of Subspace Clustering with Outliers

A Geometric Analysis of Subspace Clustering with Outliers A Geometric Analysis of Subspace Clustering with Outliers Mahdi Soltanolkotabi and Emmanuel Candés Stanford University Fundamental Tool in Data Mining : PCA Fundamental Tool in Data Mining : PCA Subspace

More information

STIC AmSud Project. Graph cut based segmentation of cardiac ventricles in MRI: a shape-prior based approach

STIC AmSud Project. Graph cut based segmentation of cardiac ventricles in MRI: a shape-prior based approach STIC AmSud Project Graph cut based segmentation of cardiac ventricles in MRI: a shape-prior based approach Caroline Petitjean A joint work with Damien Grosgeorge, Pr Su Ruan, Pr JN Dacher, MD October 22,

More information

Markov Networks in Computer Vision. Sargur Srihari

Markov Networks in Computer Vision. Sargur Srihari Markov Networks in Computer Vision Sargur srihari@cedar.buffalo.edu 1 Markov Networks for Computer Vision Important application area for MNs 1. Image segmentation 2. Removal of blur/noise 3. Stereo reconstruction

More information

Iterative MAP and ML Estimations for Image Segmentation

Iterative MAP and ML Estimations for Image Segmentation Iterative MAP and ML Estimations for Image Segmentation Shifeng Chen 1, Liangliang Cao 2, Jianzhuang Liu 1, and Xiaoou Tang 1,3 1 Dept. of IE, The Chinese University of Hong Kong {sfchen5, jzliu}@ie.cuhk.edu.hk

More information

AUTOMATED video analysis is important for many vision

AUTOMATED video analysis is important for many vision IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 35, NO. 3, MARCH 203 597 Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation Xiaowei Zhou, Student

More information

Compressed Sensing Algorithm for Real-Time Doppler Ultrasound Image Reconstruction

Compressed Sensing Algorithm for Real-Time Doppler Ultrasound Image Reconstruction Mathematical Modelling and Applications 2017; 2(6): 75-80 http://www.sciencepublishinggroup.com/j/mma doi: 10.11648/j.mma.20170206.14 ISSN: 2575-1786 (Print); ISSN: 2575-1794 (Online) Compressed Sensing

More information

Database-Guided Segmentation of Anatomical Structures with Complex Appearance

Database-Guided Segmentation of Anatomical Structures with Complex Appearance Database-Guided Segmentation of Anatomical Structures with Complex Appearance B. Georgescu X. S. Zhou D. Comaniciu A. Gupta Integrated Data Systems Department Computer Aided Diagnosis Siemens Corporate

More information

Computer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks

Computer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks Computer-Aided Diagnosis in Abdominal and Cardiac Radiology Using Neural Networks Du-Yih Tsai, Masaru Sekiya and Yongbum Lee Department of Radiological Technology, School of Health Sciences, Faculty of

More information

Fully-Automatic Landmark detection in Skull X-Ray images

Fully-Automatic Landmark detection in Skull X-Ray images Fully-Automatic Landmark detection in Skull X-Ray images Cheng Chen 1, Ching-Wei Wang 2,3, Cheng-Ta Huang 2, Chung-Hsing Li 3,4, and Guoyan Zheng 1 1 Institute for Surgical Technology and Biomechanics,

More information

An R Package flare for High Dimensional Linear Regression and Precision Matrix Estimation

An R Package flare for High Dimensional Linear Regression and Precision Matrix Estimation An R Package flare for High Dimensional Linear Regression and Precision Matrix Estimation Xingguo Li Tuo Zhao Xiaoming Yuan Han Liu Abstract This paper describes an R package named flare, which implements

More information

EE795: Computer Vision and Intelligent Systems

EE795: Computer Vision and Intelligent Systems EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 WRI C225 Lecture 04 130131 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Histogram Equalization Image Filtering Linear

More information

Human Motion Detection and Tracking for Video Surveillance

Human Motion Detection and Tracking for Video Surveillance Human Motion Detection and Tracking for Video Surveillance Prithviraj Banerjee and Somnath Sengupta Department of Electronics and Electrical Communication Engineering Indian Institute of Technology, Kharagpur,

More information

An ICA based Approach for Complex Color Scene Text Binarization

An ICA based Approach for Complex Color Scene Text Binarization An ICA based Approach for Complex Color Scene Text Binarization Siddharth Kherada IIIT-Hyderabad, India siddharth.kherada@research.iiit.ac.in Anoop M. Namboodiri IIIT-Hyderabad, India anoop@iiit.ac.in

More information

NIH Public Access Author Manuscript Proc Soc Photo Opt Instrum Eng. Author manuscript; available in PMC 2014 October 07.

NIH Public Access Author Manuscript Proc Soc Photo Opt Instrum Eng. Author manuscript; available in PMC 2014 October 07. NIH Public Access Author Manuscript Published in final edited form as: Proc Soc Photo Opt Instrum Eng. 2014 March 21; 9034: 903442. doi:10.1117/12.2042915. MRI Brain Tumor Segmentation and Necrosis Detection

More information

Color Image Segmentation

Color Image Segmentation Color Image Segmentation Yining Deng, B. S. Manjunath and Hyundoo Shin* Department of Electrical and Computer Engineering University of California, Santa Barbara, CA 93106-9560 *Samsung Electronics Inc.

More information

Deformable Segmentation using Sparse Shape Representation. Shaoting Zhang

Deformable Segmentation using Sparse Shape Representation. Shaoting Zhang Deformable Segmentation using Sparse Shape Representation Shaoting Zhang Introduction Outline Our methods Segmentation framework Sparse shape representation Applications 2D lung localization in X-ray 3D

More information

Interpreter aided salt boundary segmentation using SVM regression shape deformation technique

Interpreter aided salt boundary segmentation using SVM regression shape deformation technique Interpreter aided salt boundary segmentation using SVM regression shape deformation technique Problem Introduction For the seismic imaging project in offshore oil and gas exploration, a good velocity model

More information

Shape-based Diffeomorphic Registration on Hippocampal Surfaces Using Beltrami Holomorphic Flow

Shape-based Diffeomorphic Registration on Hippocampal Surfaces Using Beltrami Holomorphic Flow Shape-based Diffeomorphic Registration on Hippocampal Surfaces Using Beltrami Holomorphic Flow Abstract. Finding meaningful 1-1 correspondences between hippocampal (HP) surfaces is an important but difficult

More information

Image Segmentation Using Iterated Graph Cuts Based on Multi-scale Smoothing

Image Segmentation Using Iterated Graph Cuts Based on Multi-scale Smoothing Image Segmentation Using Iterated Graph Cuts Based on Multi-scale Smoothing Tomoyuki Nagahashi 1, Hironobu Fujiyoshi 1, and Takeo Kanade 2 1 Dept. of Computer Science, Chubu University. Matsumoto 1200,

More information

doi: /

doi: / Yiting Xie ; Anthony P. Reeves; Single 3D cell segmentation from optical CT microscope images. Proc. SPIE 934, Medical Imaging 214: Image Processing, 9343B (March 21, 214); doi:1.1117/12.243852. (214)

More information

3D Echocardiography Development Timeline

3D Echocardiography Development Timeline 3D Acquisition Strategies and Display Lissa Sugeng, MD, MPH Associate Professor of Medicine Director of the Yale Echo Lab and Echo Core Lab (YCRG) And Peter Flueckiger, MD Advanced Imaging Cardiology Fellow

More information

Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion

Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion Methodological progress in image registration for ventilation estimation, segmentation propagation and multi-modal fusion Mattias P. Heinrich Julia A. Schnabel, Mark Jenkinson, Sir Michael Brady 2 Clinical

More information

Fast trajectory matching using small binary images

Fast trajectory matching using small binary images Title Fast trajectory matching using small binary images Author(s) Zhuo, W; Schnieders, D; Wong, KKY Citation The 3rd International Conference on Multimedia Technology (ICMT 2013), Guangzhou, China, 29

More information

Region-based Segmentation

Region-based Segmentation Region-based Segmentation Image Segmentation Group similar components (such as, pixels in an image, image frames in a video) to obtain a compact representation. Applications: Finding tumors, veins, etc.

More information

Applying the Q n Estimator Online

Applying the Q n Estimator Online Applying the Q n Estimator Online Robin Nunkesser 1, Karen Schettlinger 2, and Roland Fried 2 1 Department of Computer Science, Univ. Dortmund, 44221 Dortmund Robin.Nunkesser@udo.edu 2 Department of Statistics,

More information

Multimodality Imaging for Tumor Volume Definition in Radiation Oncology

Multimodality Imaging for Tumor Volume Definition in Radiation Oncology 81 There are several commercial and academic software tools that support different segmentation algorithms. In general, commercial software packages have better implementation (with a user-friendly interface

More information

Perturbation Estimation of the Subspaces for Structure from Motion with Noisy and Missing Data. Abstract. 1. Introduction

Perturbation Estimation of the Subspaces for Structure from Motion with Noisy and Missing Data. Abstract. 1. Introduction Perturbation Estimation of the Subspaces for Structure from Motion with Noisy and Missing Data Hongjun Jia, Jeff Fortuna and Aleix M. Martinez Department of Electrical and Computer Engineering The Ohio

More information

Basic relations between pixels (Chapter 2)

Basic relations between pixels (Chapter 2) Basic relations between pixels (Chapter 2) Lecture 3 Basic Relationships Between Pixels Definitions: f(x,y): digital image Pixels: q, p (p,q f) A subset of pixels of f(x,y): S A typology of relations:

More information

4D Cardiac Reconstruction Using High Resolution CT Images

4D Cardiac Reconstruction Using High Resolution CT Images 4D Cardiac Reconstruction Using High Resolution CT Images Mingchen Gao 1, Junzhou Huang 1, Shaoting Zhang 1, Zhen Qian 2, Szilard Voros 2, Dimitris Metaxas 1, and Leon Axel 3 1 CBIM Center, Rutgers University,

More information

Method of Background Subtraction for Medical Image Segmentation

Method of Background Subtraction for Medical Image Segmentation Method of Background Subtraction for Medical Image Segmentation Seongjai Kim Department of Mathematics and Statistics, Mississippi State University Mississippi State, MS 39762, USA and Hyeona Lim Department

More information

Estimating Human Pose in Images. Navraj Singh December 11, 2009

Estimating Human Pose in Images. Navraj Singh December 11, 2009 Estimating Human Pose in Images Navraj Singh December 11, 2009 Introduction This project attempts to improve the performance of an existing method of estimating the pose of humans in still images. Tasks

More information

DYNAMIC BACKGROUND SUBTRACTION BASED ON SPATIAL EXTENDED CENTER-SYMMETRIC LOCAL BINARY PATTERN. Gengjian Xue, Jun Sun, Li Song

DYNAMIC BACKGROUND SUBTRACTION BASED ON SPATIAL EXTENDED CENTER-SYMMETRIC LOCAL BINARY PATTERN. Gengjian Xue, Jun Sun, Li Song DYNAMIC BACKGROUND SUBTRACTION BASED ON SPATIAL EXTENDED CENTER-SYMMETRIC LOCAL BINARY PATTERN Gengjian Xue, Jun Sun, Li Song Institute of Image Communication and Information Processing, Shanghai Jiao

More information

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem

MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem SPRING 06 MEDICAL IMAGE COMPUTING (CAP 97) LECTURE 0: Medical Image Segmentation as an Energy Minimization Problem Dr. Ulas Bagci HEC, Center for Research in Computer Vision (CRCV), University of Central

More information

Logical Templates for Feature Extraction in Fingerprint Images

Logical Templates for Feature Extraction in Fingerprint Images Logical Templates for Feature Extraction in Fingerprint Images Bir Bhanu, Michael Boshra and Xuejun Tan Center for Research in Intelligent Systems University of Califomia, Riverside, CA 9252 1, USA Email:

More information

An Improved Images Watermarking Scheme Using FABEMD Decomposition and DCT

An Improved Images Watermarking Scheme Using FABEMD Decomposition and DCT An Improved Images Watermarking Scheme Using FABEMD Decomposition and DCT Noura Aherrahrou and Hamid Tairi University Sidi Mohamed Ben Abdellah, Faculty of Sciences, Dhar El mahraz, LIIAN, Department of

More information

Salient Region Detection and Segmentation in Images using Dynamic Mode Decomposition

Salient Region Detection and Segmentation in Images using Dynamic Mode Decomposition Salient Region Detection and Segmentation in Images using Dynamic Mode Decomposition Sikha O K 1, Sachin Kumar S 2, K P Soman 2 1 Department of Computer Science 2 Centre for Computational Engineering and

More information

Fast Approximate Energy Minimization via Graph Cuts

Fast Approximate Energy Minimization via Graph Cuts IEEE Transactions on PAMI, vol. 23, no. 11, pp. 1222-1239 p.1 Fast Approximate Energy Minimization via Graph Cuts Yuri Boykov, Olga Veksler and Ramin Zabih Abstract Many tasks in computer vision involve

More information

Chapter 3 Image Registration. Chapter 3 Image Registration

Chapter 3 Image Registration. Chapter 3 Image Registration Chapter 3 Image Registration Distributed Algorithms for Introduction (1) Definition: Image Registration Input: 2 images of the same scene but taken from different perspectives Goal: Identify transformation

More information

Lecture 8 Object Descriptors

Lecture 8 Object Descriptors Lecture 8 Object Descriptors Azadeh Fakhrzadeh Centre for Image Analysis Swedish University of Agricultural Sciences Uppsala University 2 Reading instructions Chapter 11.1 11.4 in G-W Azadeh Fakhrzadeh

More information

Towards the completion of assignment 1

Towards the completion of assignment 1 Towards the completion of assignment 1 What to do for calibration What to do for point matching What to do for tracking What to do for GUI COMPSCI 773 Feature Point Detection Why study feature point detection?

More information

Moving Object Tracking in Video Using MATLAB

Moving Object Tracking in Video Using MATLAB Moving Object Tracking in Video Using MATLAB Bhavana C. Bendale, Prof. Anil R. Karwankar Abstract In this paper a method is described for tracking moving objects from a sequence of video frame. This method

More information