MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem
|
|
- Ashley Mason
- 5 years ago
- Views:
Transcription
1 SPRING 06 MEDICAL IMAGE COMPUTING (CAP 97) LECTURE 0: Medical Image Segmentation as an Energy Minimization Problem Dr. Ulas Bagci HEC, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL 84. or
2 Energy functional Outline Data and Smoothness terms Graph Cut Min cut Max Flow Applications in Radiology Images
3 Labeling & Segmentation Labeling is a common way for modeling various computer vision problems (e.g. optical flow, image segmentation, stereo matching, etc)
4 4 Labeling & Segmentation Labeling is a common way for modeling various computer vision problems (e.g. optical flow, image segmentation, stereo matching, etc) The set of labels can be discrete (as in image segmentation) L = {l,...,l m } with L = m
5 Labeling & Segmentation Labeling is a common way for modeling various computer vision problems (e.g. optical flow, image segmentation, stereo matching, etc) The set of labels can be discrete (as in image segmentation) L = {l,...,l m } with L = m Or continuous (tracking, etc.) L R n for n
6 6 Labeling is a function Labels are assigned to sites (pixel locations)
7 7 Labeling is a function Labels are assigned to sites (pixel locations) For a given image, we have = N cols.n rows
8 8 Labeling is a function Labels are assigned to sites (pixel locations) For a given image, we have = N cols.n rows Identifying a labeling function (with segmentation) is f :! L
9 9 Labeling is a function Labels are assigned to sites (pixel locations) For a given image, we have Identifying a labeling function (with segmentation) is f :! L = N cols.n rows We aim at calculating a labeling function that minimizes a given (total) error or energy
10 0 Labeling is a function Labels are assigned to sites (pixel locations) For a given image, we have Identifying a labeling function (with segmentation) is f :! L = N cols.n rows We aim at calculating a labeling function that minimizes a given (total) error or energy E(f) = X p [E data (p, f p )+ X qa(p) E smooth (f p,f q )] *A is an adjacency relation between pixel locations
11 Example of Energy Minimization Methods Credit: Zhao et al., IJNMBE
12 Energy Function? Penalizing results which are not compatible with the observed images/volumes
13 Energy Function? Penalizing results which are not compatible with the observed images/volumes Unary (data) cost (inverted)
14 4 Energy Function? Penalizing results which are not compatible with the observed images/volumes Enforcing spatial coherence. Pairwise (boundary) cost (inverted)
15 Energy Function? Penalizing results which are not compatible with the observed images/volumes Enforcing spatial coherence. Pairwise (boundary) cost (inverted) p q
16 6 Segmentation as an Energy Minimization Problem E data assigns non-negative penalties to a pixel location p when assigning a label to this location. 0//
17 7 Segmentation as an Energy Minimization Problem E data assigns non-negative penalties to a pixel location p when assigning a label to this location. E smooth assigns non-negative penalties by comparing the assigned labels f p and f q at adjacent positions p and q.
18 8 Segmentation as an Energy Minimization Problem E data assigns non-negative penalties to a pixel location p when assigning a label to this location. E smooth assigns non-negative penalties by comparing the assigned labels f p and f q at adjacent positions p and q. pixel p Edge q Node/vertex Image as a graph representation
19 9 Segmentation as an Energy Minimization Problem E data assigns non-negative penalties to a pixel location p when assigning a label to this location. E smooth assigns non-negative penalties by comparing the assigned labels f p and f q at adjacent positions p and q. This optimization model is characterized by local interactions along edges between adjacent pixels, and often called MRF (Markov Random Field) model.
20 0 E(f) = X p Energy Function-Details [E data (p, f p )+ X qa(p) E smooth (f p,f q )]
21 E(f) = X p Example Data Term: Energy Function-Details [E data (p, f p )+ X qa(p) E smooth (f p,f q )] E data (p, f p )= (p) (p = 0) = logp(p BG) (p = ) = logp(p FG)
22 E(f) = X p Example Data Term: Energy Function-Details Example Smoothness Term: [E data (p, f p )+ X qa(p) E smooth (f p,f q )] E data (p, f p )= (p) (p = 0) = logp(p BG) (p = ) = logp(p FG) (p, q) =K pq (p 6= q) where K pq = exp( (I p I q ) /( )) p, q
23 E(f) = X p Energy Function-Details [E data (p, f p )+ X qa(p) E smooth (f p,f q )] E(p) = X p p(p)+ X p X pq(p, q) qa(p) p = argmin pl E(p)
24 4 E(f) = X p Energy Function-Details [E data (p, f p )+ X qa(p) E smooth (f p,f q )] E(p) = X p p(p)+ X p X pq(p, q) qa(p) p = argmin pl E(p) To solve this problem, transform the energy functional into mincut/max-flow problem and solve it!
25 Graph Cuts for Optimal Boundary Detection (Boykov ICCV 00) Binary label: foreground vs. background User labels some pixels Exploit Statistics of known Fg & Bg Smoothness of label Turn into discrete graph optimization Graph cut (min cut / max flow) F F F F F F B B B B B
26 6 Graph Cut Each pixel is connected to its neighbors in an undirected graph Goal: split nodes into two sets A and B based on pixel values, and try to classify Neighbors in the same way too!
27 7 Graph Cut Each pixel is connected to its neighbors in an undirected graph Goal: split nodes into two sets A and B based on pixel values, and try to classify Neighbors in the same way too!
28 8 Each pixel = node Add two nodes F & B Graph-Cut Labeling: link each pixel to either F or B F Desired result F F F F F B B B B B
29 9 Cost Function: Data term Put one edge between each pixel and both F & G Weight of edge = minus data term F B
30 0 Cost Function: Smoothness term Add an edge between each neighbor pair Weight = smoothness term F B
31 Min-Cut Energy optimization equivalent to graph min cut Cut: remove edges to disconnect F from B Minimum: minimize sum of cut edge weight F cut B
32 Min-Cut Source 9 v v 4 Graph (V, E, C) Vertices V = {v, v... v n } Edges E = {(v, v )...} Costs C = {c (, )...} Sink
33 Min-Cut What is a st-cut? Source An st-cut (S,T) divides the nodes between source and sink. 9 v v 4 What is the cost of a st-cut? Sum of cost of all edges going from S to T Sink = 6
34 4 Min-Cut What is a st-cut? Source v v 9 Sink = 7 An st-cut (S,T) divides the nodes between source and sink. What is the cost of a st-cut? Sum of cost of all edges going from S to T What is the st-mincut? st-cut with the minimum cost
35 How to compute min-cut? Source 9 v v Sink 4 Solve the dual maximum flow problem Compute the maximum flow between Source and Sink Constraints Edges: Flow < Capacity Nodes: Flow in & Flow out Min-cut\Max-flow Theorem In every network, the maximum flow equals the cost of the st-mincut
36 6 Flow = 0 Source Max-Flow Algorithms Augmenting Path Based Algorithms v v 9 Sink 4. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
37 7 Flow = 0 Source Max-Flow Algorithms Augmenting Path Based Algorithms v v 9 Sink 4. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
38 8 Flow = 0 + Source Max-Flow Algorithms Augmenting Path Based Algorithms - 9 v v - Sink 4. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
39 9 Flow = Source Max-Flow Algorithms Augmenting Path Based Algorithms v v 0 9 Sink 4. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
40 40 Flow = Source Max-Flow Algorithms Augmenting Path Based Algorithms v v 0 9 Sink 4. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
41 4 Flow = Source Max-Flow Algorithms Augmenting Path Based Algorithms v v 0 9 Sink 4. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
42 4 Flow = + 4 Source Max-Flow Algorithms Augmenting Path Based Algorithms v v 0 Sink 0. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
43 4 Flow = 6 Source Max-Flow Algorithms Augmenting Path Based Algorithms v v 0 Sink 0. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
44 44 Flow = 6 Source Max-Flow Algorithms Augmenting Path Based Algorithms v v 0 Sink 0. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
45 4 Flow = 6 + Source Max-Flow Algorithms Augmenting Path Based Algorithms v v Sink 0. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
46 46 Flow = 7 Source Max-Flow Algorithms Augmenting Path Based Algorithms v v Sink 0. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
47 47 Flow = 7 Source Max-Flow Algorithms Augmenting Path Based Algorithms v v Sink 0. Find path from source to sink with positive capacity. Push maximum possible flow through this path. Repeat until no path can be found Algorithms assume non-negative capacity
48 48 Another Example-Max Flow source 9 Ford & Fulkerson algorithm (96) 6 4 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 8 Find the path in the residual graph sink End
49 49 Another Example-Max Flow source 9 Ford & Fulkerson algorithm (96) 6 4 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 8 Find the path in the residual graph sink End
50 0 Another Example-Max Flow source 9 Ford & Fulkerson algorithm (96) 6 4 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 8 Find the path in the residual graph sink End flow =
51 Another Example-Max Flow source sink 9 + Ford & Fulkerson algorithm (96) Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) End Find the path in the residual graph flow =
52 Another Example-Max Flow source 9 Ford & Fulkerson algorithm (96) 4 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 Find the path in the residual graph sink End flow =
53 Another Example-Max Flow source 9 Ford & Fulkerson algorithm (96) 4 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 Find the path in the residual graph sink End flow =
54 4 Another Example-Max Flow source 9 Ford & Fulkerson algorithm (96) 4 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 Find the path in the residual graph sink End flow = 6
55 6 Another Example-Max Flow source sink Ford & Fulkerson algorithm (96) Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) End Find the path in the residual graph flow = 6
56 6 Another Example-Max Flow source 6 Ford & Fulkerson algorithm (96) 4 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 Find the path in the residual graph sink End flow = 6
57 7 Another Example-Max Flow source 6 Ford & Fulkerson algorithm (96) 4 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 Find the path in the residual graph sink End flow = 6
58 8 Another Example-Max Flow source 6 Ford & Fulkerson algorithm (96) 4 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 Find the path in the residual graph sink End flow =
59 9 6 Another Example-Max Flow source sink Ford & Fulkerson algorithm (96) Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) End Find the path in the residual graph flow =
60 60 6 Another Example-Max Flow source 4 sink 7 6 Ford & Fulkerson algorithm (96) Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) End Find the path in the residual graph flow =
61 6 6 Another Example-Max Flow source 4 sink 7 6 Ford & Fulkerson algorithm (96) Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) End Find the path in the residual graph flow =
62 6 6 Another Example-Max Flow source 4 sink 7 6 Ford & Fulkerson algorithm (96) Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) End Find the path in the residual graph flow =
63 6 Another Example-Max Flow - source Ford & Fulkerson algorithm (96) 4 7 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) 6 - Find the path in the residual graph sink End flow =
64 64 Another Example-Max Flow source Ford & Fulkerson algorithm (96) 4 7 Find the path from source to sink 6 6 While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) Find the path in the residual graph sink End flow =
65 6 Another Example-Max Flow source Ford & Fulkerson algorithm (96) 4 7 Find the path from source to sink 6 6 While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) Find the path in the residual graph sink End flow =
66 66 Another Example-Max Flow source Ford & Fulkerson algorithm (96) 4 7 Find the path from source to sink 6 6 While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) Find the path in the residual graph sink End flow =
67 67 Another Example-Max Flow source Ford & Fulkerson algorithm (96) 4-7 Find the path from source to sink While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) Find the path in the residual graph sink End flow =
68 68 Another Example-Max Flow source Ford & Fulkerson algorithm (96) 7 Find the path from source to sink 4 6 While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) Find the path in the residual graph sink End flow =
69 69 Another Example-Max Flow source Ford & Fulkerson algorithm (96) 7 Find the path from source to sink 4 6 While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) Find the path in the residual graph sink End flow =
70 70 Another Example-Max Flow source Ford & Fulkerson algorithm (96) 7 Find the path from source to sink 4 6 While (path exists) flow += maximum capacity in the path Build the residual graph ( subtract the flow) Find the path in the residual graph sink End flow =
71 7 Another Example-Max Flow source Ford & Fulkerson algorithm (96) 7 Why is the solution globally optimal? 6 4 sink flow =
72 7 S Another Example-Max Flow source Ford & Fulkerson algorithm (96) 7 Why is the solution globally optimal? 6. Let S be the set of reachable nodes in the residual graph 4 sink flow =
73 7 Another Example-Max Flow S source 9 Ford & Fulkerson algorithm (96) 6 4 Why is the solution globally optimal?. Let S be the set of reachable nodes in the 6 8 residual graph. The flow from S to V - S equals to the sum of capacities from S to V S sink
74 74 / / / 0/ /6 0/ 0/ Another Example-Max Flow source /6 8/8 sink /4 0/ flow = 8/9 / 0/ / / / / Individual flows obtained by summing up all paths Ford & Fulkerson algorithm (96) Why is the solution globally optimal?. Let S be the set of reachable nodes in the residual graph. The flow from S to V - S equals to the sum of capacities from S to V S. The flow from any A to V - A is upper bounded by the sum of capacities from A to V A 4. The solution is globally optimal
75 Another Example-Max Flow 7 source sink S T cost = 8 source sink S T
76 76 Another Example-Max Flow S source cost = 6 8 sink T
77 77 Another Example-Max Flow source 9 x 4 x x x 4 6 x 6 x C(x) = x + 9x + 4x + x (-x ) + x (-x ) + x (-x ) + x (-x ) + x (-x ) + x 4 (-x ) + x (-x ) + 6x (-x ) + x 6 (-x ) + x (-x 6 ) + x 6 (-x ) + x 4 (-x ) + x 6 (-x ) + 6(-x 4 ) + 8(-x ) + (-x 6 ) 6 8 sink
78 78 Another Example-Max Flow source 9 x 4 x x x 4 6 x 6 x C(x) = x + 9x + 4x + x (-x ) + x (-x ) + x (-x ) + x (-x ) + x 4 (-x ) + x (-x ) + x (-x ) + x 6 (-x ) + x (-x 6 ) + x 6 (-x ) + x 4 (-x ) + x 6 (-x ) + 6(-x 4 ) + (-x ) + (-x 6 ) + x + x (-x ) + x (-x ) + (-x ) 6 8 sink
79 79 Another Example-Max Flow source 9 x 4 x x x 4 6 x 6 x 6 8 sink C(x) = x + 9x + 4x + x (-x ) + x (-x ) + x (-x ) + x (-x ) + x 4 (-x ) + x (-x ) + x (-x ) + x 6 (-x ) + x (-x 6 ) + x 6 (-x ) + x 4 (-x ) + x 6 (-x ) + 6(-x 4 ) + (-x ) + (-x 6 ) + x + x (-x ) + x (-x ) + (-x ) x + x (-x ) + x (-x ) + (-x ) = + x (-x ) + x (-x )
80 80 Another Example-Max Flow source 9 x 4 x x x 4 x 6 x 6 sink C(x) = + x + 6x + 4x + x (-x ) + x (-x ) + x (-x ) + x (-x ) + x 4 (-x ) + x (-x ) + x (-x ) + x 6 (-x ) + x (-x 6 ) + x (-x 4 ) + 6(-x 4 ) + (-x ) + (-x 6 ) + x (-x ) + x + x 6 (-x ) + x (-x 6 ) + (-x ) x + x 6 (-x ) + x (-x 6 ) + (-x ) = + x (-x 6 ) + x 6 (-x )
81 8 Another Example-Max Flow source 6 x 4 x x x 4 x 6 x C(x) = 6 + x + 6x + 4x + x (-x ) + x (-x ) + x (-x ) + x (-x ) + x 4 (-x ) + x (-x ) + x (-x ) + x 6 (-x ) + x (-x 6 ) + x (-x 4 ) + 6(-x 4 ) + x (-x 6 ) + x 6 (-x ) + (-x ) + (-x 6 ) + x (-x ) 6 sink
82 Another Example-Max Flow 8 S source x x 7 x 4 x x 4 sink min cut C(x) = + x + 4x + x (-x ) + x (-x ) + 7x (-x ) + x (-x 4 ) + x (-x ) + 6x (-x 6 ) + 6x (-x ) + x (-x 4 ) + 4(-x 4 ) + x (-x 6 ) + x 6 (-x ) 6 cost = 0 x 6 cost = 0 T S set of reachable nodes from s All coefficients positive Must be global minimum
83 8 History of Max-Flow Algorithms Augmenting Path and Push-Relabel n: #nodes m: #edges U: maximum edge weight Algorithms assume nonnegative edge weights
84 Software Packages for Optimization 84
85 Applications Used in Energy Minimization Based Segmentation Methods 8
86 Applications 86
87 87 Interactive Organ Segmentation (Boykov and Jolly, MICCAI 000) Segmentation of multiple objects. (a-c): Cardiac MRI. (d): Kidney CE- MR angiography
88 88 Interactive Organ Segmentation (Boykov and Jolly, MICCAI 000) Segmentation of the right lung in CT. (a): representative D slice of original D data. (b): segmentation results on the slice in (a). (c-d) D visualization of segmentation results.
89 89 AUTOMATIC HEART ISOLATION FOR CT CORONARY VISUALIZATION USING GRAPH-CUTS (Funka-Lea et al, ISBI 006) Isolating the entire heart allows the coronary vessels on the surface of the heart to be easily visualized despite the proximity of surrounding organs such as the ribs and pulmonary blood vessels.
90 90 AUTOMATIC HEART ISOLATION FOR CT CORONARY VISUALIZATION USING GRAPH-CUTS (Funka-Lea et al, ISBI 006) Isolating the entire heart allows the coronary vessels on the surface of the heart to be easily visualized despite the proximity of surrounding organs such as the ribs and pulmonary blood vessels. Numerous techniques have been described for segmenting the left ventricle of the heart in images from various types of medical scanners but rarely has the entire heart been segmented.
91 9 AUTOMATIC HEART ISOLATION FOR CT CORONARY VISUALIZATION USING GRAPH-CUTS (Funka-Lea et al, ISBI 006) Isolating the entire heart allows the coronary vessels on the surface of the heart to be easily visualized despite the proximity of surrounding organs such as the ribs and pulmonary blood vessels. Numerous techniques have been described for segmenting the left ventricle of the heart in images from various types of medical scanners but rarely has the entire heart been segmented. Graph-cut formation:
92 9 AUTOMATIC HEART ISOLATION FOR CT CORONARY VISUALIZATION USING GRAPH-CUTS (Funka-Lea et al, ISBI 006) Isolating the entire heart allows the coronary vessels on the surface of the heart to be easily visualized despite the proximity of surrounding organs such as the ribs and pulmonary blood vessels. Numerous techniques have been described for segmenting the left ventricle of the heart in images from various types of medical scanners but rarely has the entire heart been segmented. Graph-cut formation:
93 9 AUTOMATIC HEART ISOLATION FOR CT CORONARY VISUALIZATION USING GRAPH-CUTS (Funka-Lea et al, ISBI 006) Isolating the entire heart allows the coronary vessels on the surface of the heart to be easily visualized despite the proximity of surrounding organs such as the ribs and pulmonary blood vessels. Numerous techniques have been described for segmenting the left ventricle of the heart in images from various types of medical scanners but rarely has the entire heart been segmented. Graph-cut formation: (C is center)
94 94 AUTOMATIC HEART ISOLATION FOR CT CORONARY VISUALIZATION USING GRAPH-CUTS (Funka-Lea et al, ISBI 006) Isolating the entire heart allows the coronary vessels on the surface of the heart to be easily visualized despite the proximity of surrounding organs such as the ribs and pulmonary blood vessels. Numerous techniques have been described for segmenting the left ventricle of the heart in images from various types of medical scanners but rarely has the entire heart been segmented. Graph-cut formation: (C is center) If cos(.) <0, (0 otherwise.)
95 9 AUTOMATIC HEART ISOLATION FOR CT CORONARY VISUALIZATION USING GRAPH-CUTS (Funka-Lea et al, ISBI 006) Top Left: A balloon is expanded within the heart. The heart wall pushes the balloon toward the heart center as the balloon grows. Top right: volume rendering of original heart volume. Bottom left: heart cropped based on segmentation mask. Bottom right: volume rendering after automatic heart isolation algorithm.
96 96 Measurement of hippocampal atrophy using 4D graph-cut segmentation: Application to ADNI (Wolz, et al. NeuroImage 0) Proposed a method for simultaneously segmenting longitudinal magnetic resonance (MR) images
97 97 Measurement of hippocampal atrophy using 4D graph-cut segmentation: Application to ADNI (Wolz, et al. NeuroImage 0) Proposed a method for simultaneously segmenting longitudinal magnetic resonance (MR) images D MRI + time component (longitudinal)
98 98 Measurement of hippocampal atrophy using 4D graph-cut segmentation: Application to ADNI (Wolz, et al. NeuroImage 0) Proposed a method for simultaneously segmenting longitudinal magnetic resonance (MR) images D MRI + time component (longitudinal) A 4D graph is used to represent the longitudinal data: edges are weighted based on spatial and intensity priors and connect spatially and temporally neighboring voxels represented by vertices in the graph.
99 99 Measurement of hippocampal atrophy using 4D graph-cut segmentation: Application to ADNI (Wolz, et al. NeuroImage 0) Proposed a method for simultaneously segmenting longitudinal magnetic resonance (MR) images D MRI + time component (longitudinal) A 4D graph is used to represent the longitudinal data: edges are weighted based on spatial and intensity priors and connect spatially and temporally neighboring voxels represented by vertices in the graph. Solving the min-cut/max-flow problem on this graph yields the segmentation for all time-points in a single step
100 00 Measurement of hippocampal atrophy using 4D graph-cut segmentation: Application to ADNI (Wolz, et al. NeuroImage 0) Proposed a method for simultaneously segmenting longitudinal magnetic resonance (MR) images D MRI + time component (longitudinal) A 4D graph is used to represent the longitudinal data: edges are weighted based on spatial and intensity priors and connect spatially and temporally neighboring voxels represented by vertices in the graph. Solving the min-cut/max-flow problem on this graph yields the segmentation for all time-points in a single step Time-series image can be considered as a single (4D) image, with the following dimensions: x,y,z and t
101 0 Measurement of hippocampal atrophy using 4D graph-cut segmentation: Application to ADNI (Wolz, et al. NeuroImage 0) Proposed a method for simultaneously segmenting longitudinal magnetic resonance (MR) images D MRI + time component (longitudinal) A 4D graph is used to represent the longitudinal data: edges are weighted based on spatial and intensity priors and connect spatially and temporally neighboring voxels represented by vertices in the graph. Solving the min-cut/max-flow problem on this graph yields the segmentation for all time-points in a single step Time-series image can be considered as a single (4D) image, with the following dimensions: x,y,z and t 6 spatial neighbors in D And temporal neighbors and
102 0 Measurement of hippocampal atrophy using 4D graph-cut segmentation: Application to ADNI (Wolz, et al. NeuroImage 0) a. Right hippocampus segmentation (baseline), b. follow up segmentation ( months)
103 0 Integrated Graph Cuts for Brain Image Segmentation (Song et al, MICCAI 006) In addition to image intensity, tissue priors and local boundary information are integrated into the edge weight metrics in the graph.
104 04 Integrated Graph Cuts for Brain Image Segmentation (Song et al, MICCAI 006) In addition to image intensity, tissue priors and local boundary information are integrated into the edge weight metrics in the graph. Example of the graph with three terminals for brain MRI tissue segmentation of gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF). The set of nodes V includes all voxels and terminals. The set of edges E includes all n-links and t-links. n-links: voxel-to-voxel edges t-links: voxel-to-terminal edges
105 Integrated Graph Cuts for Brain Image Segmentation (Song et al, MICCAI 006) 0
106 06 Integrated Graph Cuts for Brain Image Segmentation (Song et al, MICCAI 006) Regularization term Data term Atlas term Pairwise term
107 07 Integrated Graph Cuts for Brain Image Segmentation (Song et al, MICCAI 006) Regularization term Data term Atlas term (T, segmentation results)
108 08 Summary Data and Smoothness Terms -> Graph based segmentation methods Additional terms can(should) be added into segmentation formulation based observation/need and problem definition Problems formulated as a MRF task can be solved by max-flow/mincut
109 09 Slide Credits and References Fredo Durand M. Tappen R. Szelisky J.Malcolm, Graph Cut in Tensor Scale Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D images. Yuri Boykov and Marie-Pierre Jolly. In International Conference on Computer Vision, (ICCV), vol. I, A Comparative Study of Energy Minimization Methods for Markov Random Fields. Rick Szeliski, Ramin Zabih, Daniel Scharstein, Olga Veksler, Vladimir Kolmogorov, Aseem Agarwala, Marshall Tappen, Carsten Rother. ECCV P. Kumar, Oxford University.
MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 10: Medical Image Segmentation as an Energy Minimization Problem
SPRING 07 MEDICAL IMAGE COMPUTING (CAP 97) LECTURE 0: Medical Image Segmentation as an Energy Minimization Problem Dr. Ulas Bagci HEC, Center for Research in Computer Vision (CRCV), University of Central
More informationCAP5415-Computer Vision Lecture 13-Image/Video Segmentation Part II. Dr. Ulas Bagci
CAP-Computer Vision Lecture -Image/Video Segmentation Part II Dr. Ulas Bagci bagci@ucf.edu Labeling & Segmentation Labeling is a common way for modeling various computer vision problems (e.g. optical flow,
More informationDr. Ulas Bagci
CAP- Computer Vision Lecture - Image Segmenta;on as an Op;miza;on Problem Dr. Ulas Bagci bagci@ucf.edu Reminders Oct Guest Lecture: SVM by Dr. Gong Oct 8 Guest Lecture: Camera Models by Dr. Shah PA# October
More informationADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION
ADAPTIVE GRAPH CUTS WITH TISSUE PRIORS FOR BRAIN MRI SEGMENTATION Abstract: MIP Project Report Spring 2013 Gaurav Mittal 201232644 This is a detailed report about the course project, which was to implement
More informationProf. Feng Liu. Spring /17/2017. With slides by F. Durand, Y.Y. Chuang, R. Raskar, and C.
Prof. Feng Liu Spring 2017 http://www.cs.pdx.edu/~fliu/courses/cs510/ 05/17/2017 With slides by F. Durand, Y.Y. Chuang, R. Raskar, and C. Rother Last Time Image segmentation Normalized cut and segmentation
More informationMarkov/Conditional Random Fields, Graph Cut, and applications in Computer Vision
Markov/Conditional Random Fields, Graph Cut, and applications in Computer Vision Fuxin Li Slides and materials from Le Song, Tucker Hermans, Pawan Kumar, Carsten Rother, Peter Orchard, and others Recap:
More informationCS4670 / 5670: Computer Vision Noah Snavely
{ { 11/26/2013 CS4670 / 5670: Computer Vision Noah Snavely Graph-Based Image Segmentation Stereo as a minimization problem match cost Want each pixel to find a good match in the other image smoothness
More informationintro, applications MRF, labeling... how it can be computed at all? Applications in segmentation: GraphCut, GrabCut, demos
Image as Markov Random Field and Applications 1 Tomáš Svoboda, svoboda@cmp.felk.cvut.cz Czech Technical University in Prague, Center for Machine Perception http://cmp.felk.cvut.cz Talk Outline Last update:
More informationMULTI-REGION SEGMENTATION
MULTI-REGION SEGMENTATION USING GRAPH-CUTS Johannes Ulén Abstract This project deals with multi-region segmenation using graph-cuts and is mainly based on a paper by Delong and Boykov [1]. The difference
More informationMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 9: Medical Image Segmentation (III) (Fuzzy Connected Image Segmentation)
SPRING 2017 1 MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 9: Medical Image Segmentation (III) (Fuzzy Connected Image Segmentation) Dr. Ulas Bagci HEC 221, Center for Research in Computer Vision (CRCV),
More informationTopology Preserving Brain Tissue Segmentation Using Graph Cuts
Topology Preserving Brain Tissue Segmentation Using Graph Cuts Xinyang Liu 1, Pierre-Louis Bazin 2, Aaron Carass 3, and Jerry Prince 3 1 Brigham and Women s Hospital, Boston, MA 1 xinyang@bwh.harvard.edu
More informationGraph Cuts vs. Level Sets. part I Basics of Graph Cuts
ECCV 2006 tutorial on Graph Cuts vs. Level Sets part I Basics of Graph Cuts Yuri Boykov University of Western Ontario Daniel Cremers University of Bonn Vladimir Kolmogorov University College London Graph
More informationDiscrete Optimization Methods in Computer Vision CSE 6389 Slides by: Boykov Modified and Presented by: Mostafa Parchami Basic overview of graph cuts
Discrete Optimization Methods in Computer Vision CSE 6389 Slides by: Boykov Modified and Presented by: Mostafa Parchami Basic overview of graph cuts [Yuri Boykov, Olga Veksler, Ramin Zabih, Fast Approximation
More informationCS6670: Computer Vision
CS6670: Computer Vision Noah Snavely Lecture 19: Graph Cuts source S sink T Readings Szeliski, Chapter 11.2 11.5 Stereo results with window search problems in areas of uniform texture Window-based matching
More informationSegmentation. Separate image into coherent regions
Segmentation II Segmentation Separate image into coherent regions Berkeley segmentation database: http://www.eecs.berkeley.edu/research/projects/cs/vision/grouping/segbench/ Slide by L. Lazebnik Interactive
More informationInteractive Brain Tumor Segmentation with Inclusion Constraints
Western University Scholarship@Western Electronic Thesis and Dissertation Repository April 2016 Interactive Brain Tumor Segmentation with Inclusion Constraints Danfeng Chen The University of Western Ontario
More informationA Multilevel Banded Graph Cuts Method for Fast Image Segmentation
Proceedings of the Tenth IEEE International Conference on Computer Vision, ICCV 2005 Volume 1, pp. 259 A Multilevel Banded Graph Cuts Method for Fast Image Segmentation Herve Lombaert Yiyong Sun Leo Grady
More informationMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 19: Machine Learning in Medical Imaging (A Brief Introduction)
SPRING 2016 1 MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 19: Machine Learning in Medical Imaging (A Brief Introduction) Dr. Ulas Bagci HEC 221, Center for Research in Computer Vision (CRCV), University
More informationMaximum flows and minimal cuts. Filip Malmberg
Maximum flows and minimal cuts Filip Malmberg MSF cuts I A Minimum Spanning Forest with respect to a set of seed-points divides a graph into a number of connected components. Thus, it defines a cut on
More informationSegmentation with non-linear constraints on appearance, complexity, and geometry
IPAM February 2013 Western Univesity Segmentation with non-linear constraints on appearance, complexity, and geometry Yuri Boykov Andrew Delong Lena Gorelick Hossam Isack Anton Osokin Frank Schmidt Olga
More informationMR IMAGE SEGMENTATION
MR IMAGE SEGMENTATION Prepared by : Monil Shah What is Segmentation? Partitioning a region or regions of interest in images such that each region corresponds to one or more anatomic structures Classification
More informationGRAPH BASED SEGMENTATION WITH MINIMAL USER INTERACTION. Huaizhong Zhang, Ehab Essa, and Xianghua Xie
GRAPH BASED SEGMENTATION WITH MINIMAL USER INTERACTION Huaizhong Zhang, Ehab Essa, and Xianghua Xie Computer Science Department, Swansea University, Swansea SA2 8PP, United Kingdom *http://csvision.swan.ac.uk/
More informationCS4670: Computer Vision
CS4670: Computer Vision Noah Snavely Lecture 34: Segmentation From Sandlot Science Announcements In-class exam this Friday, December 3 Review session in class on Wednesday Final projects: Slides due: Sunday,
More informationCS 5540 Spring 2013 Assignment 3, v1.0 Due: Apr. 24th 11:59PM
1 Introduction In this programming project, we are going to do a simple image segmentation task. Given a grayscale image with a bright object against a dark background and we are going to do a binary decision
More informationMRI Brain image segmentation using graph cuts
MRI Brain image segmentation using graph cuts Master of Science Thesis in Communication Engineering Mohammad Shajib Khadem Signal Processing Group Department of Signals and Systems CHALMERS UNIVERSITY
More informationComputer Vision : Exercise 4 Labelling Problems
Computer Vision Exercise 4 Labelling Problems 13/01/2014 Computer Vision : Exercise 4 Labelling Problems Outline 1. Energy Minimization (example segmentation) 2. Iterated Conditional Modes 3. Dynamic Programming
More informationmritc: A Package for MRI Tissue Classification
mritc: A Package for MRI Tissue Classification Dai Feng 1 Luke Tierney 2 1 Merck Research Labratories 2 University of Iowa July 2010 Feng & Tierney (Merck & U of Iowa) MRI Tissue Classification July 2010
More informationMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 20: Machine Learning in Medical Imaging II (deep learning and decision forests)
SPRING 2016 1 MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 20: Machine Learning in Medical Imaging II (deep learning and decision forests) Dr. Ulas Bagci HEC 221, Center for Research in Computer Vision (CRCV),
More informationSupplementary Material: Adaptive and Move Making Auxiliary Cuts for Binary Pairwise Energies
Supplementary Material: Adaptive and Move Making Auxiliary Cuts for Binary Pairwise Energies Lena Gorelick Yuri Boykov Olga Veksler Computer Science Department University of Western Ontario Abstract Below
More informationManifold Learning: Applications in Neuroimaging
Your own logo here Manifold Learning: Applications in Neuroimaging Robin Wolz 23/09/2011 Overview Manifold learning for Atlas Propagation Multi-atlas segmentation Challenges LEAP Manifold learning for
More informationCSE 417 Network Flows (pt 3) Modeling with Min Cuts
CSE 417 Network Flows (pt 3) Modeling with Min Cuts Reminders > HW6 is due on Friday start early bug fixed on line 33 of OptimalLineup.java: > change true to false Review of last two lectures > Defined
More informationNorbert Schuff VA Medical Center and UCSF
Norbert Schuff Medical Center and UCSF Norbert.schuff@ucsf.edu Medical Imaging Informatics N.Schuff Course # 170.03 Slide 1/67 Objective Learn the principle segmentation techniques Understand the role
More informationInteractive Differential Segmentation of the Prostate using Graph-Cuts with a Feature Detector-based Boundary Term
MOSCHIDIS, GRAHAM: GRAPH-CUTS WITH FEATURE DETECTORS 1 Interactive Differential Segmentation of the Prostate using Graph-Cuts with a Feature Detector-based Boundary Term Emmanouil Moschidis emmanouil.moschidis@postgrad.manchester.ac.uk
More informationAn Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014
An Introduction To Automatic Tissue Classification Of Brain MRI Colm Elliott Mar 2014 Tissue Classification Tissue classification is part of many processing pipelines. We often want to classify each voxel
More informationMeasuring Uncertainty in Graph Cut Solutions - Efficiently Computing Min-marginal Energies using Dynamic Graph Cuts
Measuring Uncertainty in Graph Cut Solutions - Efficiently Computing Min-marginal Energies using Dynamic Graph Cuts Pushmeet Kohli Philip H.S. Torr Department of Computing, Oxford Brookes University, Oxford.
More informationBrain tumor segmentation with minimal user assistance
Western University Scholarship@Western Electronic Thesis and Dissertation Repository January 2014 Brain tumor segmentation with minimal user assistance Liqun Liu The University of Western Ontario Supervisor
More informationLecture 16 Segmentation and Scene understanding
Lecture 16 Segmentation and Scene understanding Introduction! Mean-shift! Graph-based segmentation! Top-down segmentation! Silvio Savarese Lecture 15 -! 3-Mar-14 Segmentation Silvio Savarese Lecture 15
More informationSemantic Context Forests for Learning- Based Knee Cartilage Segmentation in 3D MR Images
Semantic Context Forests for Learning- Based Knee Cartilage Segmentation in 3D MR Images MICCAI 2013: Workshop on Medical Computer Vision Authors: Quan Wang, Dijia Wu, Le Lu, Meizhu Liu, Kim L. Boyer,
More informationSTIC AmSud Project. Graph cut based segmentation of cardiac ventricles in MRI: a shape-prior based approach
STIC AmSud Project Graph cut based segmentation of cardiac ventricles in MRI: a shape-prior based approach Caroline Petitjean A joint work with Damien Grosgeorge, Pr Su Ruan, Pr JN Dacher, MD October 22,
More informationMathematics in Image Processing
Mathematics in Image Processing Michal Šorel Department of Image Processing Institute of Information Theory and Automation (ÚTIA) Academy of Sciences of the Czech Republic http://zoi.utia.cas.cz/ Mathematics
More informationNon-rigid Image Registration using Electric Current Flow
Non-rigid Image Registration using Electric Current Flow Shu Liao, Max W. K. Law and Albert C. S. Chung Lo Kwee-Seong Medical Image Analysis Laboratory, Department of Computer Science and Engineering,
More informationChapter 8 of Bishop's Book: Graphical Models
Chapter 8 of Bishop's Book: Graphical Models Review of Probability Probability density over possible values of x Used to find probability of x falling in some range For continuous variables, the probability
More informationImage Segmentation Using Iterated Graph Cuts Based on Multi-scale Smoothing
Image Segmentation Using Iterated Graph Cuts Based on Multi-scale Smoothing Tomoyuki Nagahashi 1, Hironobu Fujiyoshi 1, and Takeo Kanade 2 1 Dept. of Computer Science, Chubu University. Matsumoto 1200,
More informationComputational Radiology Lab, Children s Hospital, Harvard Medical School, Boston, MA.
Shape prior integration in discrete optimization segmentation algorithms M. Freiman Computational Radiology Lab, Children s Hospital, Harvard Medical School, Boston, MA. Email: moti.freiman@childrens.harvard.edu
More informationAutomatic Lung Segmentation of Volumetric Low-Dose CT Scans Using Graph Cuts
Automatic Lung Segmentation of Volumetric Low-Dose CT Scans Using Graph Cuts Asem M. Ali and Aly A. Farag Computer Vision and Image Processing Laboratory (CVIP Lab) University of Louisville, Louisville,
More informationModels for grids. Computer vision: models, learning and inference. Multi label Denoising. Binary Denoising. Denoising Goal.
Models for grids Computer vision: models, learning and inference Chapter 9 Graphical Models Consider models where one unknown world state at each pixel in the image takes the form of a grid. Loops in the
More informationSegmentation in electron microscopy images
Segmentation in electron microscopy images Aurelien Lucchi, Kevin Smith, Yunpeng Li Bohumil Maco, Graham Knott, Pascal Fua. http://cvlab.epfl.ch/research/medical/neurons/ Outline Automated Approach to
More informationAnnouncements. Image Segmentation. From images to objects. Extracting objects. Status reports next Thursday ~5min presentations in class
Image Segmentation Announcements Status reports next Thursday ~5min presentations in class Project voting From Sandlot Science Today s Readings Forsyth & Ponce, Chapter 1 (plus lots of optional references
More informationNorbert Schuff Professor of Radiology VA Medical Center and UCSF
Norbert Schuff Professor of Radiology Medical Center and UCSF Norbert.schuff@ucsf.edu 2010, N.Schuff Slide 1/67 Overview Definitions Role of Segmentation Segmentation methods Intensity based Shape based
More informationFast Approximate Energy Minimization via Graph Cuts
IEEE Transactions on PAMI, vol. 23, no. 11, pp. 1222-1239 p.1 Fast Approximate Energy Minimization via Graph Cuts Yuri Boykov, Olga Veksler and Ramin Zabih Abstract Many tasks in computer vision involve
More informationNorbert Schuff Professor of Radiology VA Medical Center and UCSF
Norbert Schuff Professor of Radiology Medical Center and UCSF Norbert.schuff@ucsf.edu Slide 1/67 Overview Definitions Role of Segmentation Segmentation methods Intensity based Shape based Texture based
More informationCity, University of London Institutional Repository
City Research Online City, University of London Institutional Repository Citation: Doan, H., Slabaugh, G.G., Unal, G.B. & Fang, T. (2006). Semi-Automatic 3-D Segmentation of Anatomical Structures of Brain
More informationSIMULTANEOUS IMAGE DE-NOISING AND REGISTRATION USING GRAPH CUTS: APPLICATION TO CORRUPTED MEDICAL IMAGES. Herve Lombaert, Farida Cheriet
SIMULTANEOUS IMAGE DE-NOISING AND REGISTRATION USING GRAPH CUTS: APPLICATION TO CORRUPTED MEDICAL IMAGES Herve Lombaert, Farida Cheriet École Polytechnique de Montréal, Montréal Québec, Canada ABSTRACT
More informationMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 4: Pre-Processing Medical Images (II)
SPRING 2016 1 MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 4: Pre-Processing Medical Images (II) Dr. Ulas Bagci HEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF),
More informationCapacity Scaling for Graph Cuts in Vision
Capacity Scaling for Graph Cuts in Vision Olivier Juan and Yuri Boykov Computer Science Department University of Western Ontario, London, ON, Canada juan@csd.uwo.ca, yuri@csd.uwo.ca Abstract Capacity scaling
More informationMulti-view object segmentation in space and time. Abdelaziz Djelouah, Jean Sebastien Franco, Edmond Boyer
Multi-view object segmentation in space and time Abdelaziz Djelouah, Jean Sebastien Franco, Edmond Boyer Outline Addressed problem Method Results and Conclusion Outline Addressed problem Method Results
More informationMulti-Object Tracking Through Clutter Using Graph Cuts
Multi-Object Tracking Through Clutter Using Graph Cuts James Malcolm Yogesh Rathi Allen Tannenbaum School of Electrical and Computer Engineering Georgia Institute of Technology, Atlanta, Georgia 30332-0250
More informationEnergy Minimization for Segmentation in Computer Vision
S * = arg S min E(S) Energy Minimization for Segmentation in Computer Vision Meng Tang, Dmitrii Marin, Ismail Ben Ayed, Yuri Boykov Outline Clustering/segmentation methods K-means, GrabCut, Normalized
More informationNeuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry
Neuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry Nivedita Agarwal, MD Nivedita.agarwal@apss.tn.it Nivedita.agarwal@unitn.it Volume and surface morphometry Brain volume White matter
More informationSupervised texture detection in images
Supervised texture detection in images Branislav Mičušík and Allan Hanbury Pattern Recognition and Image Processing Group, Institute of Computer Aided Automation, Vienna University of Technology Favoritenstraße
More informationEnforcing Monotonic Temporal Evolution in Dry Eye Images
Enforcing Monotonic Temporal Evolution in Dry Eye Images Tamir Yedidya 1, Peter Carr 1, Richard Hartley 1, and Jean-Pierre Guillon 2 1 The Australian National University, and National ICT Australia 2 Faculty
More informationMarkov Random Fields and Segmentation with Graph Cuts
Markov Random Fields and Segmentation with Graph Cuts Computer Vision Jia-Bin Huang, Virginia Tech Many slides from D. Hoiem Administrative stuffs Final project Proposal due Oct 27 (Thursday) HW 4 is out
More informationarxiv: v1 [cs.cv] 30 Mar 2017
Efficient optimization for Hierarchically-structured Interacting Segments (HINTS) Hossam Isack 1 Olga Veksler 1 Ipek Oguz 2 Milan Sonka 3 Yuri Boykov 1 1 Computer Science, University of Western Ontario,
More informationGraph Cuts in Vision and Graphics: Theories and Applications
In Handbook of Mathematical Models in Computer Vision, Springer, 2006 p.1 Graph Cuts in Vision and Graphics: Theories and Applications Yuri Boykov and Olga Veksler Computer Science, The University of Western
More informationMRFs and Segmentation with Graph Cuts
02/24/10 MRFs and Segmentation with Graph Cuts Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem Today s class Finish up EM MRFs w ij i Segmentation with Graph Cuts j EM Algorithm: Recap
More informationComparison of Graph Cuts with Belief Propagation for Stereo, using Identical MRF Parameters
Comparison of Graph Cuts with Belief Propagation for Stereo, using Identical MRF Parameters Marshall F. Tappen William T. Freeman Computer Science and Artificial Intelligence Laboratory Massachusetts Institute
More informationLearning CRFs using Graph Cuts
Appears in European Conference on Computer Vision (ECCV) 2008 Learning CRFs using Graph Cuts Martin Szummer 1, Pushmeet Kohli 1, and Derek Hoiem 2 1 Microsoft Research, Cambridge CB3 0FB, United Kingdom
More informationQuantitative MRI of the Brain: Investigation of Cerebral Gray and White Matter Diseases
Quantities Measured by MR - Quantitative MRI of the Brain: Investigation of Cerebral Gray and White Matter Diseases Static parameters (influenced by molecular environment): T, T* (transverse relaxation)
More informationEfficient Parallel Optimization for Potts Energy with Hierarchical Fusion
Efficient Parallel Optimization for Potts Energy with Hierarchical Fusion Olga Veksler University of Western Ontario London, Canada olga@csd.uwo.ca Abstract Potts frequently occurs in computer vision applications.
More informationMulti-Label Moves for Multi-Label Energies
Multi-Label Moves for Multi-Label Energies Olga Veksler University of Western Ontario some work is joint with Olivier Juan, Xiaoqing Liu, Yu Liu Outline Review multi-label optimization with graph cuts
More informationImage Segmentation. Marc Pollefeys. ETH Zurich. Slide credits: V. Ferrari, K. Grauman, B. Leibe, S. Lazebnik, S. Seitz,Y Boykov, W. Freeman, P.
Image Segmentation Perceptual and Sensory Augmented Computing Computer Vision WS 0/09 Marc Pollefeys ETH Zurich Slide credits: V. Ferrari, K. Grauman, B. Leibe, S. Lazebnik, S. Seitz,Y Boykov, W. Freeman,
More informationImage Segmentation Using Iterated Graph Cuts BasedonMulti-scaleSmoothing
Image Segmentation Using Iterated Graph Cuts BasedonMulti-scaleSmoothing Tomoyuki Nagahashi 1, Hironobu Fujiyoshi 1, and Takeo Kanade 2 1 Dept. of Computer Science, Chubu University. Matsumoto 1200, Kasugai,
More informationHuman Heart Coronary Arteries Segmentation
Human Heart Coronary Arteries Segmentation Qian Huang Wright State University, Computer Science Department Abstract The volume information extracted from computed tomography angiogram (CTA) datasets makes
More informationWhat have we leaned so far?
What have we leaned so far? Camera structure Eye structure Project 1: High Dynamic Range Imaging What have we learned so far? Image Filtering Image Warping Camera Projection Model Project 2: Panoramic
More informationSegmenting Lesions in Multiple Sclerosis Patients James Chen, Jason Su
Segmenting Lesions in Multiple Sclerosis Patients James Chen, Jason Su Radiologists and researchers spend countless hours tediously segmenting white matter lesions to diagnose and study brain diseases.
More informationMachine Learning for Medical Image Analysis. A. Criminisi
Machine Learning for Medical Image Analysis A. Criminisi Overview Introduction to machine learning Decision forests Applications in medical image analysis Anatomy localization in CT Scans Spine Detection
More informationSegmentation. Bottom up Segmentation Semantic Segmentation
Segmentation Bottom up Segmentation Semantic Segmentation Semantic Labeling of Street Scenes Ground Truth Labels 11 classes, almost all occur simultaneously, large changes in viewpoint, scale sky, road,
More informationA Simple Topology Preserving Max-Flow Algorithm for Graph Cut Based Image Segmentation
A Simple Topology Preserving Max-Flow Algorithm for Graph Cut Based Image Segmentation Ondřej Daněk and Martin Maška Centre for Biomedical Image Analysis, Faculty of Informatics Masaryk University, Brno,
More informationRegistration Techniques
EMBO Practical Course on Light Sheet Microscopy Junior-Prof. Dr. Olaf Ronneberger Computer Science Department and BIOSS Centre for Biological Signalling Studies University of Freiburg Germany O. Ronneberger,
More informationIntroduction à la vision artificielle X
Introduction à la vision artificielle X Jean Ponce Email: ponce@di.ens.fr Web: http://www.di.ens.fr/~ponce Planches après les cours sur : http://www.di.ens.fr/~ponce/introvis/lect10.pptx http://www.di.ens.fr/~ponce/introvis/lect10.pdf
More informationMulti-Atlas Brain MRI Segmentation with Multiway Cut
Multi-Atlas Brain MRI Segmentation with Multiway Cut Duygu Sarikaya, Liang Zhao, and Jason J. Corso SUNY Buffalo, Computer Science and Engineering Department, 338 Davis Hall- Buffalo, New York, USA 14260-2500
More informationApplication of fuzzy set theory in image analysis. Nataša Sladoje Centre for Image Analysis
Application of fuzzy set theory in image analysis Nataša Sladoje Centre for Image Analysis Our topics for today Crisp vs fuzzy Fuzzy sets and fuzzy membership functions Fuzzy set operators Approximate
More informationImage Segmentation and Registration
Image Segmentation and Registration Dr. Christine Tanner (tanner@vision.ee.ethz.ch) Computer Vision Laboratory, ETH Zürich Dr. Verena Kaynig, Machine Learning Laboratory, ETH Zürich Outline Segmentation
More informationImage Segmentation continued Graph Based Methods. Some slides: courtesy of O. Capms, Penn State, J.Ponce and D. Fortsyth, Computer Vision Book
Image Segmentation continued Graph Based Methods Some slides: courtesy of O. Capms, Penn State, J.Ponce and D. Fortsyth, Computer Vision Book Previously Binary segmentation Segmentation by thresholding
More informationGraph Cut based Continuous Stereo Matching using Locally Shared Labels
Graph Cut based Continuous Stereo Matching using Locally Shared Labels Tatsunori Taniai University of Tokyo, Japan taniai@iis.u-tokyo.ac.jp Yasuyuki Matsushita Microsoft Research Asia, China yasumat@microsoft.com
More informationGraphs and Network Flows IE411. Lecture 13. Dr. Ted Ralphs
Graphs and Network Flows IE411 Lecture 13 Dr. Ted Ralphs IE411 Lecture 13 1 References for Today s Lecture IE411 Lecture 13 2 References for Today s Lecture Required reading Sections 21.1 21.2 References
More informationShape-Aware Multi-Atlas Segmentation
Shape-Aware Multi-Atlas Segmentation Jennifer Alvén, Fredrik Kahl, Matilda Landgren, Viktor Larsson and Johannes Ulén Department of Signals and Systems, Chalmers University of Technology, Sweden Email:
More informationPerformance of Stereo Methods in Cluttered Scenes
Performance of Stereo Methods in Cluttered Scenes Fahim Mannan and Michael S. Langer School of Computer Science McGill University Montreal, Quebec H3A 2A7, Canada { fmannan, langer}@cim.mcgill.ca Abstract
More informationPBSI: A symmetric probabilistic extension of the Boundary Shift Integral
PBSI: A symmetric probabilistic extension of the Boundary Shift Integral Christian Ledig 1, Robin Wolz 1, Paul Aljabar 1,2, Jyrki Lötjönen 3, Daniel Rueckert 1 1 Department of Computing, Imperial College
More informationIn IEEE conference on Computer Vision and Pattern Recognition (CVPR), New York, June 2006, vol. I, p Active Graph Cuts
In IEEE conference on Computer Vision and Pattern Recognition (CVPR), New York, June 2006, vol. I, p.1023 Active Graph Cuts Olivier Juan CERTIS, Ecole Nationale des Ponts et Chaussees Champs-sur-Marne,
More informationUncertainty Driven Multi-Scale Optimization
Uncertainty Driven Multi-Scale Optimization Pushmeet Kohli 1 Victor Lempitsky 2 Carsten Rother 1 1 Microsoft Research Cambridge 2 University of Oxford Abstract. This paper proposes a new multi-scale energy
More informationGraphs, graph algorithms (for image segmentation),... in progress
Graphs, graph algorithms (for image segmentation),... in progress Václav Hlaváč Czech Technical University in Prague Czech Institute of Informatics, Robotics and Cybernetics 66 36 Prague 6, Jugoslávských
More informationAn Evaluation of Parallelization Techniques for MRF Image Segmentation
An Evaluation of Parallelization Techniques for MRF Image Segmentation Shane Mottishaw, Sergey Zhuravlev, Lisa Tang, Alexandra Fedorova, and Ghassan Hamarneh Simon Fraser University Abstract. Markov Random
More informationNetwork Design and Optimization course
Effective maximum flow algorithms Modeling with flows Network Design and Optimization course Lecture 5 Alberto Ceselli alberto.ceselli@unimi.it Dipartimento di Tecnologie dell Informazione Università degli
More informationGraph Based Image Segmentation
AUTOMATYKA 2011 Tom 15 Zeszyt 3 Anna Fabijañska* Graph Based Image Segmentation 1. Introduction Image segmentation is one of the fundamental problems in machine vision. In general it aims at extracting
More informationEMSegmenter Tutorial (Advanced Mode)
EMSegmenter Tutorial (Advanced Mode) Dominique Belhachemi Section of Biomedical Image Analysis Department of Radiology University of Pennsylvania 1/65 Overview The goal of this tutorial is to apply the
More informationAutomatic segmentation of the cortical grey and white matter in MRI using a Region Growing approach based on anatomical knowledge
Automatic segmentation of the cortical grey and white matter in MRI using a Region Growing approach based on anatomical knowledge Christian Wasserthal 1, Karin Engel 1, Karsten Rink 1 und André Brechmann
More informationStereo Correspondence with Occlusions using Graph Cuts
Stereo Correspondence with Occlusions using Graph Cuts EE368 Final Project Matt Stevens mslf@stanford.edu Zuozhen Liu zliu2@stanford.edu I. INTRODUCTION AND MOTIVATION Given two stereo images of a scene,
More informationHigh Accuracy Region Growing Segmentation Technique for Magnetic Resonance and Computed Tomography Images with Weak Boundaries
High Accuracy Region Growing Segmentation Technique for Magnetic Resonance and Computed Tomography Images with Weak Boundaries Ahmed Ayman * Takuya Funatomi Michihiko Minoh Academic Center for Computing
More informationCSE 417 Network Flows (pt 4) Min Cost Flows
CSE 417 Network Flows (pt 4) Min Cost Flows Reminders > HW6 is due Monday Review of last three lectures > Defined the maximum flow problem find the feasible flow of maximum value flow is feasible if it
More information