Image deblurring by multigrid methods. Department of Physics and Mathematics University of Insubria

Size: px
Start display at page:

Download "Image deblurring by multigrid methods. Department of Physics and Mathematics University of Insubria"

Transcription

1 Image deblurring by multigrid methods Marco Donatelli Stefano Serra-Capizzano Department of Physics and Mathematics University of Insubria

2 Outline 1 Restoration of blurred and noisy images The model problem Properties of the PSF Iterative regularization methods 2 Multigrid regularization Multigrid methods Iterative Multigrid regularization Computational Cost 3 Numerical experiments An airplane Direct multigrid regularization 4 Conclusions Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 2 / 27

3 Outline Restoration of blurred and noisy images 1 Restoration of blurred and noisy images The model problem Properties of the PSF Iterative regularization methods 2 Multigrid regularization Multigrid methods Iterative Multigrid regularization Computational Cost 3 Numerical experiments An airplane Direct multigrid regularization 4 Conclusions Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 3 / 27

4 Restoration of blurred and noisy images The model problem Image restoration with Boundary Conditions Using Boundary Conditions (BCs), the restored image f is obtained solving: (in some way...) Af = g + ξ g = blurred image, ξ = noise (random vector), A = two-level matrix depending on the point spread function (PSF) and the BCs. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 4 / 27

5 Restoration of blurred and noisy images The model problem Image restoration with Boundary Conditions Using Boundary Conditions (BCs), the restored image f is obtained solving: (in some way...) Af = g + ξ g = blurred image, ξ = noise (random vector), A = two-level matrix depending on the point spread function (PSF) and the BCs. The PSF is the observation of a single point (e.g., a star in astronomy). Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 4 / 27

6 Restoration of blurred and noisy images Coefficient matrix structure The model problem The matrix-vector product computed in O(n 2 log(n)) ops for n n images while the inversion costs O(n 2 log(n)) ops only in the periodic case. BCs Dirichlet periodic Neumann (reflective) anti-reflective A Toeplitz circulant Toeplitz + Hankel Toeplitz + Hankel Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 5 / 27

7 Restoration of blurred and noisy images Coefficient matrix structure The model problem The matrix-vector product computed in O(n 2 log(n)) ops for n n images while the inversion costs O(n 2 log(n)) ops only in the periodic case. BCs Dirichlet periodic Neumann (reflective) anti-reflective A Toeplitz circulant Toeplitz + Hankel Toeplitz + Hankel If the PSF is symmetric with respect to each direction: BCs Neumann (reflective) anti-reflective A DCT III DST I + low-rank Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 5 / 27

8 Restoration of blurred and noisy images Generating function of PSF Properties of the PSF The eigenvalues of A(z) are about a uniform sampling of z. PSF Generating function z(x) Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 6 / 27

9 Restoration of blurred and noisy images Generating function of PSF Properties of the PSF The eigenvalues of A(z) are about a uniform sampling of z. PSF Generating function z(x) The ill-conditioned subspace is mainly constituted by the middle/high frequencies. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 6 / 27

10 Restoration of blurred and noisy images Iterative regularization methods Iterative regularization methods Semi-convergence behavior Some iterative methods (Landweber, CGNE,...) have regularization properties: the restoration error firstly decreases and then increases. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 7 / 27

11 Restoration of blurred and noisy images Iterative regularization methods Iterative regularization methods Semi-convergence behavior Some iterative methods (Landweber, CGNE,...) have regularization properties: the restoration error firstly decreases and then increases. Reason They firstly reduce the algebraic error in the low frequencies (well-conditioned subspace). When they arrive to reduce the algebraic error in the high frequencies then the restoration error increases because of the noise. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 7 / 27

12 Outline Multigrid regularization 1 Restoration of blurred and noisy images The model problem Properties of the PSF Iterative regularization methods 2 Multigrid regularization Multigrid methods Iterative Multigrid regularization Computational Cost 3 Numerical experiments An airplane Direct multigrid regularization 4 Conclusions Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 8 / 27

13 The algorithm Multigrid regularization Multigrid methods The choices 1 We apply only the pre-smoother simply called smoother. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 9 / 27

14 The algorithm Multigrid regularization Multigrid methods The choices 1 We apply only the pre-smoother simply called smoother. 2 Let R i and P i be the restriction and the prolongation operators at the level i, respectively. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 9 / 27

15 Multigrid regularization Multigrid methods The algorithm The choices 1 We apply only the pre-smoother simply called smoother. 2 Let R i and P i be the restriction and the prolongation operators at the level i, respectively. 3 We use the Galerkin approach P i = R T i A i+1 = RA i R T i Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 9 / 27

16 The algorithm Multigrid regularization Multigrid methods The choices 1 We apply only the pre-smoother simply called smoother. 2 Let R i and P i be the restriction and the prolongation operators at the level i, respectively. 3 We use the Galerkin approach P i = R T i A i+1 = RA i R T i 4 Coarser grid of size 8 8 independent of the size of the finer grid. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 9 / 27

17 Multigrid regularization The Algebraic Multigrid (AMG) Multigrid methods The AMG uses only information on the coefficient matrix. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 10 / 27

18 Multigrid regularization Multigrid methods The Algebraic Multigrid (AMG) The AMG uses only information on the coefficient matrix. Different classic smoothers have similar behavior: in the initial iterations they are not able to reduce effectively the error in the subspace generated by the eigenvectors associated to small eigenvalues (ill-conditioned subspace) Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 10 / 27

19 Multigrid regularization Multigrid methods The Algebraic Multigrid (AMG) The AMG uses only information on the coefficient matrix. Different classic smoothers have similar behavior: in the initial iterations they are not able to reduce effectively the error in the subspace generated by the eigenvectors associated to small eigenvalues (ill-conditioned subspace) To obtain a fast solver, the restriction is chosen in order to project the error equation in such subspace. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 10 / 27

20 Multigrid regularization Multigrid methods The Algebraic Multigrid (AMG) The AMG uses only information on the coefficient matrix. Different classic smoothers have similar behavior: in the initial iterations they are not able to reduce effectively the error in the subspace generated by the eigenvectors associated to small eigenvalues (ill-conditioned subspace) To obtain a fast solver, the restriction is chosen in order to project the error equation in such subspace. For Toeplitz matrices there are two talks: Fischer on Wednesday and Aricò on Friday. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 10 / 27

21 Multigrid regularization Multigrid methods Algebraic analysis of the Geometric Multigrid For elliptic PDEs the ill-conditioned subspace is made by low frequencies (complementary with respect to the gaussian blur). Poisson s problem π 3.5 Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 11 / 27

22 Multigrid regularization Multigrid methods Algebraic analysis of the Geometric Multigrid For elliptic PDEs the ill-conditioned subspace is made by low frequencies (complementary with respect to the gaussian blur). Poisson s problem π 3.5 Projector operator R = Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 11 / 27

23 Multigrid regularization Multigrid for structured matrices Multigrid methods Preserve the structure In order to apply recursively the MGM, it is necessary to keep the same structure at each level (Toeplitz,...). Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 12 / 27

24 Multigrid regularization Multigrid for structured matrices Multigrid methods Preserve the structure In order to apply recursively the MGM, it is necessary to keep the same structure at each level (Toeplitz,...). For every structure arising from the proposed BCs, there exist projectors that preserve the same structure. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 12 / 27

25 Multigrid regularization Multigrid for structured matrices Multigrid methods Preserve the structure In order to apply recursively the MGM, it is necessary to keep the same structure at each level (Toeplitz,...). For every structure arising from the proposed BCs, there exist projectors that preserve the same structure. R i = K Ni A Ni (p), where Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 12 / 27

26 Multigrid regularization Multigrid for structured matrices Multigrid methods Preserve the structure In order to apply recursively the MGM, it is necessary to keep the same structure at each level (Toeplitz,...). For every structure arising from the proposed BCs, there exist projectors that preserve the same structure. R i = K Ni A Ni (p), where K Ni R N i 4 N i is the cutting matrix that preserves the structure at the lower level. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 12 / 27

27 Multigrid regularization Multigrid for structured matrices Multigrid methods Preserve the structure In order to apply recursively the MGM, it is necessary to keep the same structure at each level (Toeplitz,...). For every structure arising from the proposed BCs, there exist projectors that preserve the same structure. R i = K Ni A Ni (p), where K Ni R N i 4 N i is the cutting matrix that preserves the structure at the lower level. p(x, y) is the generating function of the projector, which selects the subspace where to project the linear system. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 12 / 27

28 Multigrid regularization Multigrid methods Multigrid, structured matrices, and images The cutting matrix K ni in 1D circulant Toeplitz&DST I DCT III [ ] [ ] [ ] Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 13 / 27

29 Multigrid regularization Multigrid methods Multigrid, structured matrices, and images The cutting matrix K ni in 1D circulant Toeplitz&DST I DCT III [ ] [ ] [ ] Low-pass filter: Low frequencies projection noise reduction 2D p(x, y) = (1 + cos(x))(1 + cos(y)) ց Full weighting ր Bilinear interpolation Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 13 / 27

30 Multigrid regularization Image deblurring and Multigrid Iterative Multigrid regularization In the image deblurring the ill-conditioned subspace is related to high frequencies, while the well-conditioned subspace is generated by low frequencies. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 14 / 27

31 Multigrid regularization Image deblurring and Multigrid Iterative Multigrid regularization In the image deblurring the ill-conditioned subspace is related to high frequencies, while the well-conditioned subspace is generated by low frequencies. In order to obtain a fast convergence the algebraic multigrid projects in the high frequencies where the noise lives = noise explosion already at the first iteration (it requires Tikhonov regularization [Donatelli, NLAA in press]). Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 14 / 27

32 Multigrid regularization Image deblurring and Multigrid Iterative Multigrid regularization In the image deblurring the ill-conditioned subspace is related to high frequencies, while the well-conditioned subspace is generated by low frequencies. In order to obtain a fast convergence the algebraic multigrid projects in the high frequencies where the noise lives = noise explosion already at the first iteration (it requires Tikhonov regularization [Donatelli, NLAA in press]). In this case the low-pass filter projects in the well-conditioned subspace (low frequencies) = it is slowly convergent but it can be a good iterative regularizer. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 14 / 27

33 Multigrid regularization Iterative multigrid regularization Iterative Multigrid regularization The Multigrid as an iterative regularization method If we have an iterative regularization method we can improve its regularizing properties and/or accelerate its convergence using it as smoother in a Multigrid algorithm. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 15 / 27

34 Multigrid regularization Iterative multigrid regularization Iterative Multigrid regularization The Multigrid as an iterative regularization method If we have an iterative regularization method we can improve its regularizing properties and/or accelerate its convergence using it as smoother in a Multigrid algorithm. Regularization The regularization properties of the smoother are preserved since it is combined with a low-pass filter. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 15 / 27

35 Multigrid regularization Two-Level (TL) regularization Iterative Multigrid regularization Idea: project into the low frequencies and then apply an iterative regularization method. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 16 / 27

36 Multigrid regularization Iterative Multigrid regularization Two-Level (TL) regularization Idea: project into the low frequencies and then apply an iterative regularization method. TL as a specialization of TGM Smoother: iterative regularization method Projector: low-pass filter Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 16 / 27

37 Multigrid regularization Iterative Multigrid regularization Two-Level (TL) regularization Idea: project into the low frequencies and then apply an iterative regularization method. TL as a specialization of TGM Smoother: iterative regularization method Projector: low-pass filter TL Algorithm 1 No smoothing at the finer level 2 At the coarser level to apply one step of the smoother instead of to solve directly the linear system Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 16 / 27

38 Multigrid regularization Iterative Multigrid regularization Multigrid regularization (applying recursively the TL) V-cycle Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 17 / 27

39 Multigrid regularization Iterative Multigrid regularization Multigrid regularization (applying recursively the TL) V-cycle Using a larger number of recursive calls (e.g. W-cycle), the algorithm works more in the well-conditioned subspace, but it is more difficult to define an early stopping criterium. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 17 / 27

40 Computational Cost Multigrid regularization Computational Cost Assumptions: n n images and m m PSFs with m n. Let S(n) be the computational cost of one smoother iteration. The computational cost of one iteration of our multigrid regularization method with γ recursive calls is 1 3 S(n), γ = 1 C(γ,n) S(n), γ = 2 3S(n), γ = 3 C(γ,n) = { O(n 2 log(n)), γ = 4 O(n 2log 4 (γ) ), γ > 4 if m n then S(n) = O(n 2 log(n)). Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 18 / 27

41 Outline Numerical experiments 1 Restoration of blurred and noisy images The model problem Properties of the PSF Iterative regularization methods 2 Multigrid regularization Multigrid methods Iterative Multigrid regularization Computational Cost 3 Numerical experiments An airplane Direct multigrid regularization 4 Conclusions Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 19 / 27

42 An airplane Numerical experiments An airplane Periodic BCs Gaussian PSF (A spd) noise = 1% Original Image Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 20 / 27

43 An airplane Numerical experiments An airplane Periodic BCs Gaussian PSF (A spd) noise = 1% Original Image Inner part Observed image Restored with MGM Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 20 / 27

44 Numerical experiments Restoration error: noise = 1% An airplane e j = f f (j) 2 / f 2 restoration error at the j-th iteration. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 21 / 27

45 Numerical experiments Restoration error: noise = 1% An airplane e j = f f (j) 2 / f 2 restoration error at the j-th iteration. Minimum restoration error Method min j) j=1,... arg min j) j=1,... CG Richardson TL(CG) TL(Rich) MGM(Rich, 1) MGM(Rich, 2) CGNE RichNE Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 21 / 27

46 Numerical experiments Restoration error: noise = 1% An airplane e j = f f (j) 2 / f 2 restoration error at the j-th iteration. Relative error vs. number of iterations CG Richardson TL(CG) TL(Richardson) MGM(Ric,1) MGM(Ric,2) Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 21 / 27

47 Noise = 10% Numerical experiments An airplane For CG and Richardson it is better to resort to normal equations. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 22 / 27

48 Noise = 10% Numerical experiments An airplane For CG and Richardson it is better to resort to normal equations. Minimum restoration error Method min j) j=1,... arg min j) j=1,... CGNE RichNE TL(CGNE) TL(RichNE) MGM(RichNE,1) MGM(RichNE,2) MGM(Rich,1) MGM(Rich,2) Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 22 / 27

49 Noise = 10% Numerical experiments An airplane For CG and Richardson it is better to resort to normal equations. Relative error vs. number of iterations CGN RichN TL(CGN) TL(RichN) MGM(RichN,1) MGM(RichN,2) Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 22 / 27

50 The γ regularization Numerical experiments Direct multigrid regularization Varying γ, the proposed multigrid is a direct (one step) regularization method with regularization parameter γ. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 23 / 27

51 The γ regularization Numerical experiments Direct multigrid regularization Varying γ, the proposed multigrid is a direct (one step) regularization method with regularization parameter γ. The airplane example with noise = 1% e 1 = restoration error after one iteration of MGM(Rich,γ). The CGNE reaches a minimum error equal to after 2500 iterations! γ e Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 23 / 27

52 Numerical experiments Direct multigrid regularization The γ regularization (the airplane with noise = 1%) MGM(Rich,1) MGM(Rich,2) MGM(Rich,4) MGM(Rich,6) Restoration error norm vs. number of iterations Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 24 / 27

53 Numerical experiments Direct multigrid regularization The γ regularization (the airplane with noise = 1%) MGM(Rich,1) MGM(Rich,2) MGM(Rich,4) MGM(Rich,6) Restoration error norm vs. number of iterations The computational cost increases with γ but not so much (e.g. γ = 8 O(N 1.5 ) where N = n 2 ). Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 24 / 27

54 Outline Conclusions 1 Restoration of blurred and noisy images The model problem Properties of the PSF Iterative regularization methods 2 Multigrid regularization Multigrid methods Iterative Multigrid regularization Computational Cost 3 Numerical experiments An airplane Direct multigrid regularization 4 Conclusions Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 25 / 27

55 Conclusions Summarizing... multigrid regularization method It is a general framework which can be used to improve the regularization properties of an iterative regularizing method. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 26 / 27

56 Conclusions Summarizing... multigrid regularization method It is a general framework which can be used to improve the regularization properties of an iterative regularizing method. It leads to a smaller relative error and a flatter error curve with respect to the smoother applied alone. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 26 / 27

57 Conclusions Summarizing... multigrid regularization method It is a general framework which can be used to improve the regularization properties of an iterative regularizing method. It leads to a smaller relative error and a flatter error curve with respect to the smoother applied alone. It is fast and it obtains a good restored image without resorting to normal equations. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 26 / 27

58 Conclusions Summarizing... multigrid regularization method It is a general framework which can be used to improve the regularization properties of an iterative regularizing method. It leads to a smaller relative error and a flatter error curve with respect to the smoother applied alone. It is fast and it obtains a good restored image without resorting to normal equations. It can be combined with other techniques (e.g., nonnegativity constraints) and it can lead to several generalizations (e.g., γ regularization). Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 26 / 27

59 Conclusions Summarizing... multigrid regularization method It is a general framework which can be used to improve the regularization properties of an iterative regularizing method. It leads to a smaller relative error and a flatter error curve with respect to the smoother applied alone. It is fast and it obtains a good restored image without resorting to normal equations. It can be combined with other techniques (e.g., nonnegativity constraints) and it can lead to several generalizations (e.g., γ regularization). Reference M. Donatelli and S. Serra Capizzano, On the regularizing power of multigrid-type algorithms, SIAM J. Sci. Comput., in press. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 26 / 27

60 Future work Conclusions Theoretical analysis of the regularization properties. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 27 / 27

61 Future work Conclusions Theoretical analysis of the regularization properties. Applications: strictly nonsymmetric PSFs. Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 27 / 27

62 Future work Conclusions Theoretical analysis of the regularization properties. Applications: strictly nonsymmetric PSFs. Combination with techniques for edge enhancing (Wavelet, Total Variation,...). Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 27 / 27

63 Future work Conclusions Theoretical analysis of the regularization properties. Applications: strictly nonsymmetric PSFs. Combination with techniques for edge enhancing (Wavelet, Total Variation,...). Numerics/Simulations: A complete experimentation with all the proposed BCs (multigrid methods already exist for the arising matrices, see Aricò and Donatelli, Num. Math., to appear). Marco Donatelli (University of Insubria) Image deblurring by multigrid methods 27 / 27

On the regularizing power of multigrid-type algorithms

On the regularizing power of multigrid-type algorithms On the regularizing power of multigrid-type algorithms Marco Donatelli Dipartimento di Fisica e Matematica Università dell Insubria www.mat.unimi.it/user/donatel Outline 1 Restoration of blurred and noisy

More information

Regularization by multigrid-type algorithms

Regularization by multigrid-type algorithms Regularization by multigrid-type algorithms Marco Donatelli Department of Physics and Mathematics University of Insubria Joint work with S. Serra-Capizzano Outline 1 Restoration of blurred and noisy images

More information

On the regularizing power of multigrid-type algorithms. Marco Donatelli. Stefano Serra Capizzano

On the regularizing power of multigrid-type algorithms. Marco Donatelli. Stefano Serra Capizzano On the regularizing power of multigrid-type algorithms Marco Donatelli Stefano Serra Capizzano Università dell Insubria, Dip. Fisica e Matematica - Sede di Como Via Valleggio 11-22100 Como, Italy (donatelli@uninsubria.it)

More information

Contents. I The Basic Framework for Stationary Problems 1

Contents. I The Basic Framework for Stationary Problems 1 page v Preface xiii I The Basic Framework for Stationary Problems 1 1 Some model PDEs 3 1.1 Laplace s equation; elliptic BVPs... 3 1.1.1 Physical experiments modeled by Laplace s equation... 5 1.2 Other

More information

Introduction to Multigrid and its Parallelization

Introduction to Multigrid and its Parallelization Introduction to Multigrid and its Parallelization! Thomas D. Economon Lecture 14a May 28, 2014 Announcements 2 HW 1 & 2 have been returned. Any questions? Final projects are due June 11, 5 pm. If you are

More information

SELECTIVE ALGEBRAIC MULTIGRID IN FOAM-EXTEND

SELECTIVE ALGEBRAIC MULTIGRID IN FOAM-EXTEND Student Submission for the 5 th OpenFOAM User Conference 2017, Wiesbaden - Germany: SELECTIVE ALGEBRAIC MULTIGRID IN FOAM-EXTEND TESSA UROIĆ Faculty of Mechanical Engineering and Naval Architecture, Ivana

More information

AMS526: Numerical Analysis I (Numerical Linear Algebra)

AMS526: Numerical Analysis I (Numerical Linear Algebra) AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 20: Sparse Linear Systems; Direct Methods vs. Iterative Methods Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao Numerical Analysis I 1 / 26

More information

Multigrid Methods for Markov Chains

Multigrid Methods for Markov Chains Multigrid Methods for Markov Chains Hans De Sterck Department of Applied Mathematics, University of Waterloo collaborators Killian Miller Department of Applied Mathematics, University of Waterloo, Canada

More information

smooth coefficients H. Köstler, U. Rüde

smooth coefficients H. Köstler, U. Rüde A robust multigrid solver for the optical flow problem with non- smooth coefficients H. Köstler, U. Rüde Overview Optical Flow Problem Data term and various regularizers A Robust Multigrid Solver Galerkin

More information

The Immersed Interface Method

The Immersed Interface Method The Immersed Interface Method Numerical Solutions of PDEs Involving Interfaces and Irregular Domains Zhiiin Li Kazufumi Ito North Carolina State University Raleigh, North Carolina Society for Industrial

More information

An edge-preserving multilevel method for deblurring, denoising, and segmentation

An edge-preserving multilevel method for deblurring, denoising, and segmentation An edge-preserving multilevel method for deblurring, denoising, and segmentation S. Morigi 1, L. Reichel 2, and F. Sgallari 1 1 Dept. of Mathematics-CIRAM, University of Bologna, Bologna, Italy {morigi,sgallari}@dm.unibo.it

More information

PROJECT REPORT. Symbol based Multigrid method. Hreinn Juliusson, Johanna Brodin, Tianhao Zhang Project in Computational Science: Report

PROJECT REPORT. Symbol based Multigrid method. Hreinn Juliusson, Johanna Brodin, Tianhao Zhang Project in Computational Science: Report Symbol based Multigrid method Hreinn Juliusson, Johanna Brodin, Tianhao Zhang Project in Computational Science: Report February 20, 2018 PROJECT REPORT Department of Information Technology Abstract Discretization

More information

An Interface-fitted Mesh Generator and Polytopal Element Methods for Elliptic Interface Problems

An Interface-fitted Mesh Generator and Polytopal Element Methods for Elliptic Interface Problems An Interface-fitted Mesh Generator and Polytopal Element Methods for Elliptic Interface Problems Long Chen University of California, Irvine chenlong@math.uci.edu Joint work with: Huayi Wei (Xiangtan University),

More information

What is Multigrid? They have been extended to solve a wide variety of other problems, linear and nonlinear.

What is Multigrid? They have been extended to solve a wide variety of other problems, linear and nonlinear. AMSC 600/CMSC 760 Fall 2007 Solution of Sparse Linear Systems Multigrid, Part 1 Dianne P. O Leary c 2006, 2007 What is Multigrid? Originally, multigrid algorithms were proposed as an iterative method to

More information

A Hybrid Geometric+Algebraic Multigrid Method with Semi-Iterative Smoothers

A Hybrid Geometric+Algebraic Multigrid Method with Semi-Iterative Smoothers NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS Numer. Linear Algebra Appl. 013; 00:1 18 Published online in Wiley InterScience www.interscience.wiley.com). A Hybrid Geometric+Algebraic Multigrid Method with

More information

A hybrid GMRES and TV-norm based method for image restoration

A hybrid GMRES and TV-norm based method for image restoration A hybrid GMRES and TV-norm based method for image restoration D. Calvetti a, B. Lewis b and L. Reichel c a Department of Mathematics, Case Western Reserve University, Cleveland, OH 44106 b Rocketcalc,

More information

Smoothers. < interactive example > Partial Differential Equations Numerical Methods for PDEs Sparse Linear Systems

Smoothers. < interactive example > Partial Differential Equations Numerical Methods for PDEs Sparse Linear Systems Smoothers Partial Differential Equations Disappointing convergence rates observed for stationary iterative methods are asymptotic Much better progress may be made initially before eventually settling into

More information

Highly Parallel Multigrid Solvers for Multicore and Manycore Processors

Highly Parallel Multigrid Solvers for Multicore and Manycore Processors Highly Parallel Multigrid Solvers for Multicore and Manycore Processors Oleg Bessonov (B) Institute for Problems in Mechanics of the Russian Academy of Sciences, 101, Vernadsky Avenue, 119526 Moscow, Russia

More information

Index. C m (Ω), 141 L 2 (Ω) space, 143 p-th order, 17

Index. C m (Ω), 141 L 2 (Ω) space, 143 p-th order, 17 Bibliography [1] J. Adams, P. Swarztrauber, and R. Sweet. Fishpack: Efficient Fortran subprograms for the solution of separable elliptic partial differential equations. http://www.netlib.org/fishpack/.

More information

Multigrid solvers M. M. Sussman sussmanm@math.pitt.edu Office Hours: 11:10AM-12:10PM, Thack 622 May 12 June 19, 2014 1 / 43 Multigrid Geometrical multigrid Introduction Details of GMG Summary Algebraic

More information

Some Blind Deconvolution Techniques in Image Processing

Some Blind Deconvolution Techniques in Image Processing Some Blind Deconvolution Techniques in Image Processing Tony Chan Math Dept., UCLA Joint work with Frederick Park and Andy M. Yip IPAM Workshop on Mathematical Challenges in Astronomical Imaging July 26-30,

More information

PARALLEL METHODS FOR SOLVING PARTIAL DIFFERENTIAL EQUATIONS. Ioana Chiorean

PARALLEL METHODS FOR SOLVING PARTIAL DIFFERENTIAL EQUATIONS. Ioana Chiorean 5 Kragujevac J. Math. 25 (2003) 5 18. PARALLEL METHODS FOR SOLVING PARTIAL DIFFERENTIAL EQUATIONS Ioana Chiorean Babeş-Bolyai University, Department of Mathematics, Cluj-Napoca, Romania (Received May 28,

More information

Image Deconvolution.

Image Deconvolution. Image Deconvolution. Mathematics of Imaging. HW3 Jihwan Kim Abstract This homework is to implement image deconvolution methods, especially focused on a ExpectationMaximization(EM) algorithm. Most of this

More information

.. Lecture 2. learning and regularization. from interpolation to approximation.

.. Lecture 2. learning and regularization. from interpolation to approximation. .. Lecture. learning and regularization. from interpolation to approximation. Stéphane Canu and Cheng Soon Ong stephane.canu@insarouen.fr asi.insarouen.fr~scanu. RSISE ANU NICTA, Canberra INSA, Rouen RSISE,

More information

Suppression of Missing Data Artifacts. for Deblurring Images Corrupted by

Suppression of Missing Data Artifacts. for Deblurring Images Corrupted by Suppression of Missing Data Artifacts for Deblurring Images Corrupted by Random Valued Noise Nam-Yong Lee Department of Applied Mathematics Institute of Basic Sciences, Inje University Gimhae, Gyeongnam

More information

PRECONDITIONED CONJUGATE GRADIENT METHOD FOR BOUNDARY ARTIFACT-FREE IMAGE DEBLURRING. Nam-Yong Lee. Bradley J. Lucier. (Communicated by Hao-Min Zhou)

PRECONDITIONED CONJUGATE GRADIENT METHOD FOR BOUNDARY ARTIFACT-FREE IMAGE DEBLURRING. Nam-Yong Lee. Bradley J. Lucier. (Communicated by Hao-Min Zhou) Inverse Problems and Imaging Volume 10, No. 1, 2016, 195 225 doi:10.3934/ipi.2016.10.195 PRECONDITIONED CONJUGATE GRADIENT METHOD FOR BOUNDARY ARTIFACT-FREE IMAGE DEBLURRING Nam-Yong Lee Department of

More information

PRECONDITIONED CONJUGATE GRADIENT METHOD FOR BOUNDARY ARTIFACT-FREE IMAGE DEBLURRING. Nam-Yong Lee. and Bradley J. Lucier

PRECONDITIONED CONJUGATE GRADIENT METHOD FOR BOUNDARY ARTIFACT-FREE IMAGE DEBLURRING. Nam-Yong Lee. and Bradley J. Lucier Manuscript submitted to AIMS Journals Volume X, Number 0X, XX 200X doi:10.3934/xx.xx.xx.xx pp. X XX PRECONDITIONED CONJUGATE GRADIENT METHOD FOR BOUNDARY ARTIFACT-FREE IMAGE DEBLURRING Nam-Yong Lee Department

More information

A Comparison of Algebraic Multigrid Preconditioners using Graphics Processing Units and Multi-Core Central Processing Units

A Comparison of Algebraic Multigrid Preconditioners using Graphics Processing Units and Multi-Core Central Processing Units A Comparison of Algebraic Multigrid Preconditioners using Graphics Processing Units and Multi-Core Central Processing Units Markus Wagner, Karl Rupp,2, Josef Weinbub Institute for Microelectronics, TU

More information

ADVANCED IMAGE PROCESSING METHODS FOR ULTRASONIC NDE RESEARCH C. H. Chen, University of Massachusetts Dartmouth, N.

ADVANCED IMAGE PROCESSING METHODS FOR ULTRASONIC NDE RESEARCH C. H. Chen, University of Massachusetts Dartmouth, N. ADVANCED IMAGE PROCESSING METHODS FOR ULTRASONIC NDE RESEARCH C. H. Chen, University of Massachusetts Dartmouth, N. Dartmouth, MA USA Abstract: The significant progress in ultrasonic NDE systems has now

More information

Adaptive Smoothed Aggregation (αsa) Multigrid

Adaptive Smoothed Aggregation (αsa) Multigrid SIAM REVIEW Vol. 47,No. 2,pp. 317 346 c 2005 Society for Industrial and Applied Mathematics Adaptive Smoothed Aggregation (αsa) Multigrid M. Brezina R. Falgout S. MacLachlan T. Manteuffel S. McCormick

More information

parameter. Systems with this structure arise, for example, in image deblurring. Blurred, noisy image data is modeled by d ij = Z Z k(x i? x; y j? y)u(

parameter. Systems with this structure arise, for example, in image deblurring. Blurred, noisy image data is modeled by d ij = Z Z k(x i? x; y j? y)u( Two-Level Preconditioners for Ill-Conditioned Linear Systems with Semidenite Regularization Kyle L. Riley a Curtis R. Vogel b a Department of Mathematical Sciences, Montana State University, Bozeman, MT

More information

x' = c 1 x + c 2 y + c 3 xy + c 4 y' = c 5 x + c 6 y + c 7 xy + c 8

x' = c 1 x + c 2 y + c 3 xy + c 4 y' = c 5 x + c 6 y + c 7 xy + c 8 1. Explain about gray level interpolation. The distortion correction equations yield non integer values for x' and y'. Because the distorted image g is digital, its pixel values are defined only at integer

More information

Contents. Implementing the QR factorization The algebraic eigenvalue problem. Applied Linear Algebra in Geoscience Using MATLAB

Contents. Implementing the QR factorization The algebraic eigenvalue problem. Applied Linear Algebra in Geoscience Using MATLAB Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in

More information

Efficient Imaging Algorithms on Many-Core Platforms

Efficient Imaging Algorithms on Many-Core Platforms Efficient Imaging Algorithms on Many-Core Platforms H. Köstler Dagstuhl, 22.11.2011 Contents Imaging Applications HDR Compression performance of PDE-based models Image Denoising performance of patch-based

More information

Solution of Ambrosio-Tortorelli Model for Image Segmentation by Generalized Relaxation Method

Solution of Ambrosio-Tortorelli Model for Image Segmentation by Generalized Relaxation Method Solution of Ambrosio-Tortorelli Model for Image Segmentation by Generalized Relaxation Method Pasqua D Ambra, Gaetano Tartaglione Institute for High-Performance Computing and Networking (ICAR), CNR, Via

More information

Data-driven modeling: A low-rank approximation problem

Data-driven modeling: A low-rank approximation problem 1 / 34 Data-driven modeling: A low-rank approximation problem Ivan Markovsky Vrije Universiteit Brussel 2 / 34 Outline Setup: data-driven modeling Problems: system identification, machine learning,...

More information

A Lagrange method based L-curve for image restoration

A Lagrange method based L-curve for image restoration Journal of Physics: Conference Series OPEN ACCESS A Lagrange method based L-curve for image restoration To cite this article: G Landi 2013 J. Phys.: Conf. Ser. 464 012011 View the article online for updates

More information

CME 345: MODEL REDUCTION

CME 345: MODEL REDUCTION CME 345: MODEL REDUCTION Parameterized Partial Differential Equations Charbel Farhat Stanford University cfarhat@stanford.edu 1 / 19 Outline 1 Initial Boundary Value Problems 2 Typical Parameters of Interest

More information

Algebraic Iterative Methods for Computed Tomography

Algebraic Iterative Methods for Computed Tomography Algebraic Iterative Methods for Computed Tomography Per Christian Hansen DTU Compute Department of Applied Mathematics and Computer Science Technical University of Denmark Per Christian Hansen Algebraic

More information

Outline. Level Set Methods. For Inverse Obstacle Problems 4. Introduction. Introduction. Martin Burger

Outline. Level Set Methods. For Inverse Obstacle Problems 4. Introduction. Introduction. Martin Burger For Inverse Obstacle Problems Martin Burger Outline Introduction Optimal Geometries Inverse Obstacle Problems & Shape Optimization Sensitivity Analysis based on Gradient Flows Numerical Methods University

More information

Efficient O(N log N) algorithms for scattered data interpolation

Efficient O(N log N) algorithms for scattered data interpolation Efficient O(N log N) algorithms for scattered data interpolation Nail Gumerov University of Maryland Institute for Advanced Computer Studies Joint work with Ramani Duraiswami February Fourier Talks 2007

More information

Fast Iterative Solvers for Markov Chains, with Application to Google's PageRank. Hans De Sterck

Fast Iterative Solvers for Markov Chains, with Application to Google's PageRank. Hans De Sterck Fast Iterative Solvers for Markov Chains, with Application to Google's PageRank Hans De Sterck Department of Applied Mathematics University of Waterloo, Ontario, Canada joint work with Steve McCormick,

More information

Adaptive Multiple-Frame Image Super- Resolution Based on U-Curve

Adaptive Multiple-Frame Image Super- Resolution Based on U-Curve Adaptive Multiple-Frame Image Super- Resolution Based on U-Curve IEEE Transaction on Image Processing, Vol. 19, No. 12, 2010 Qiangqiang Yuan, Liangpei Zhang, Huanfeng Shen, and Pingxiang Li Presented by

More information

Clustering: Classic Methods and Modern Views

Clustering: Classic Methods and Modern Views Clustering: Classic Methods and Modern Views Marina Meilă University of Washington mmp@stat.washington.edu June 22, 2015 Lorentz Center Workshop on Clusters, Games and Axioms Outline Paradigms for clustering

More information

Algebraic Iterative Methods for Computed Tomography

Algebraic Iterative Methods for Computed Tomography Algebraic Iterative Methods for Computed Tomography Per Christian Hansen DTU Compute Department of Applied Mathematics and Computer Science Technical University of Denmark Per Christian Hansen Algebraic

More information

Numerical Methods for PDEs : Video 11: 1D FiniteFebruary Difference 15, Mappings Theory / 15

Numerical Methods for PDEs : Video 11: 1D FiniteFebruary Difference 15, Mappings Theory / 15 22.520 Numerical Methods for PDEs : Video 11: 1D Finite Difference Mappings Theory and Matlab February 15, 2015 22.520 Numerical Methods for PDEs : Video 11: 1D FiniteFebruary Difference 15, Mappings 2015

More information

PROGRAMMING OF MULTIGRID METHODS

PROGRAMMING OF MULTIGRID METHODS PROGRAMMING OF MULTIGRID METHODS LONG CHEN In this note, we explain the implementation detail of multigrid methods. We will use the approach by space decomposition and subspace correction method; see Chapter:

More information

Resilient geometric finite-element multigrid algorithms using minimised checkpointing

Resilient geometric finite-element multigrid algorithms using minimised checkpointing Resilient geometric finite-element multigrid algorithms using minimised checkpointing Dominik Göddeke, Mirco Altenbernd, Dirk Ribbrock Institut für Angewandte Mathematik (LS3) Fakultät für Mathematik TU

More information

ADAPTIVE SMOOTHED AGGREGATION (αsa)

ADAPTIVE SMOOTHED AGGREGATION (αsa) ADAPTIVE SMOOTHED AGGREGATION (αsa) M. BREZINA, R. FALGOUT, S. MACLACHLAN, T. MANTEUFFEL, S. MCCORMICK, AND J. RUGE Abstract. Substantial effort has been focused over the last two decades on developing

More information

An Investigation into Iterative Methods for Solving Elliptic PDE s Andrew M Brown Computer Science/Maths Session (2000/2001)

An Investigation into Iterative Methods for Solving Elliptic PDE s Andrew M Brown Computer Science/Maths Session (2000/2001) An Investigation into Iterative Methods for Solving Elliptic PDE s Andrew M Brown Computer Science/Maths Session (000/001) Summary The objectives of this project were as follows: 1) Investigate iterative

More information

SOLVING PARTIAL DIFFERENTIAL EQUATIONS ON POINT CLOUDS

SOLVING PARTIAL DIFFERENTIAL EQUATIONS ON POINT CLOUDS SOLVING PARTIAL DIFFERENTIAL EQUATIONS ON POINT CLOUDS JIAN LIANG AND HONGKAI ZHAO Abstract. In this paper we present a general framework for solving partial differential equations on manifolds represented

More information

A Study of Prolongation Operators Between Non-nested Meshes

A Study of Prolongation Operators Between Non-nested Meshes A Study of Prolongation Operators Between Non-nested Meshes Thomas Dickopf 1 and Rolf Krause 2 1 Institute for Numerical Simulation, University of Bonn, 53115 Bonn, Germany, dickopf@ins.uni-bonn.de 2 Institute

More information

Lecture 15: More Iterative Ideas

Lecture 15: More Iterative Ideas Lecture 15: More Iterative Ideas David Bindel 15 Mar 2010 Logistics HW 2 due! Some notes on HW 2. Where we are / where we re going More iterative ideas. Intro to HW 3. More HW 2 notes See solution code!

More information

Locally Weighted Least Squares Regression for Image Denoising, Reconstruction and Up-sampling

Locally Weighted Least Squares Regression for Image Denoising, Reconstruction and Up-sampling Locally Weighted Least Squares Regression for Image Denoising, Reconstruction and Up-sampling Moritz Baecher May 15, 29 1 Introduction Edge-preserving smoothing and super-resolution are classic and important

More information

Efficient Finite Element Geometric Multigrid Solvers for Unstructured Grids on GPUs

Efficient Finite Element Geometric Multigrid Solvers for Unstructured Grids on GPUs Efficient Finite Element Geometric Multigrid Solvers for Unstructured Grids on GPUs Markus Geveler, Dirk Ribbrock, Dominik Göddeke, Peter Zajac, Stefan Turek Institut für Angewandte Mathematik TU Dortmund,

More information

Journal of Engineering Research and Studies E-ISSN

Journal of Engineering Research and Studies E-ISSN Journal of Engineering Research and Studies E-ISS 0976-79 Research Article SPECTRAL SOLUTIO OF STEADY STATE CODUCTIO I ARBITRARY QUADRILATERAL DOMAIS Alavani Chitra R 1*, Joshi Pallavi A 1, S Pavitran

More information

GRID WARPING IN TOTAL VARIATION IMAGE ENHANCEMENT METHODS. Andrey Nasonov, and Andrey Krylov

GRID WARPING IN TOTAL VARIATION IMAGE ENHANCEMENT METHODS. Andrey Nasonov, and Andrey Krylov GRID WARPING IN TOTAL VARIATION IMAGE ENHANCEMENT METHODS Andrey Nasonov, and Andrey Krylov Lomonosov Moscow State University, Moscow, Department of Computational Mathematics and Cybernetics, e-mail: nasonov@cs.msu.ru,

More information

Accelerating the Hessian-free Gauss-Newton Full-waveform Inversion via Preconditioned Conjugate Gradient Method

Accelerating the Hessian-free Gauss-Newton Full-waveform Inversion via Preconditioned Conjugate Gradient Method Accelerating the Hessian-free Gauss-Newton Full-waveform Inversion via Preconditioned Conjugate Gradient Method Wenyong Pan 1, Kris Innanen 1 and Wenyuan Liao 2 1. CREWES Project, Department of Geoscience,

More information

THE DEVELOPMENT OF THE POTENTIAL AND ACADMIC PROGRAMMES OF WROCLAW UNIVERISTY OF TECH- NOLOGY ITERATIVE LINEAR SOLVERS

THE DEVELOPMENT OF THE POTENTIAL AND ACADMIC PROGRAMMES OF WROCLAW UNIVERISTY OF TECH- NOLOGY ITERATIVE LINEAR SOLVERS ITERATIVE LIEAR SOLVERS. Objectives The goals of the laboratory workshop are as follows: to learn basic properties of iterative methods for solving linear least squares problems, to study the properties

More information

1.2 Numerical Solutions of Flow Problems

1.2 Numerical Solutions of Flow Problems 1.2 Numerical Solutions of Flow Problems DIFFERENTIAL EQUATIONS OF MOTION FOR A SIMPLIFIED FLOW PROBLEM Continuity equation for incompressible flow: 0 Momentum (Navier-Stokes) equations for a Newtonian

More information

Chemnitz Scientific Computing Preprints

Chemnitz Scientific Computing Preprints Roman Unger Obstacle Description with Radial Basis Functions for Contact Problems in Elasticity CSC/09-01 Chemnitz Scientific Computing Preprints Impressum: Chemnitz Scientific Computing Preprints ISSN

More information

Towards a complete FEM-based simulation toolkit on GPUs: Geometric Multigrid solvers

Towards a complete FEM-based simulation toolkit on GPUs: Geometric Multigrid solvers Towards a complete FEM-based simulation toolkit on GPUs: Geometric Multigrid solvers Markus Geveler, Dirk Ribbrock, Dominik Göddeke, Peter Zajac, Stefan Turek Institut für Angewandte Mathematik TU Dortmund,

More information

Data-driven modeling: A low-rank approximation problem

Data-driven modeling: A low-rank approximation problem 1 / 31 Data-driven modeling: A low-rank approximation problem Ivan Markovsky Vrije Universiteit Brussel 2 / 31 Outline Setup: data-driven modeling Problems: system identification, machine learning,...

More information

Efficient Multigrid based solvers for Isogeometric Analysis

Efficient Multigrid based solvers for Isogeometric Analysis Efficient Multigrid based solvers for Isogeometric Analysis R. Tielen, M. Möller and C. Vuik Delft Institute of Applied Mathematics (DIAM) Numerical Analysis / 22 Isogeometric Analysis (IgA) Extension

More information

Contents. Implementing the QR factorization The algebraic eigenvalue problem. Applied Linear Algebra in Geoscience Using MATLAB

Contents. Implementing the QR factorization The algebraic eigenvalue problem. Applied Linear Algebra in Geoscience Using MATLAB Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in

More information

An introduction to mesh generation Part IV : elliptic meshing

An introduction to mesh generation Part IV : elliptic meshing Elliptic An introduction to mesh generation Part IV : elliptic meshing Department of Civil Engineering, Université catholique de Louvain, Belgium Elliptic Curvilinear Meshes Basic concept A curvilinear

More information

Multigrid Algorithms for Three-Dimensional RANS Calculations - The SUmb Solver

Multigrid Algorithms for Three-Dimensional RANS Calculations - The SUmb Solver Multigrid Algorithms for Three-Dimensional RANS Calculations - The SUmb Solver Juan J. Alonso Department of Aeronautics & Astronautics Stanford University CME342 Lecture 14 May 26, 2014 Outline Non-linear

More information

Subdivision Curves and Surfaces

Subdivision Curves and Surfaces Subdivision Surfaces or How to Generate a Smooth Mesh?? Subdivision Curves and Surfaces Subdivision given polyline(2d)/mesh(3d) recursively modify & add vertices to achieve smooth curve/surface Each iteration

More information

Control Volume Finite Difference On Adaptive Meshes

Control Volume Finite Difference On Adaptive Meshes Control Volume Finite Difference On Adaptive Meshes Sanjay Kumar Khattri, Gunnar E. Fladmark, Helge K. Dahle Department of Mathematics, University Bergen, Norway. sanjay@mi.uib.no Summary. In this work

More information

Blur Space Iterative De-blurring

Blur Space Iterative De-blurring Blur Space Iterative De-blurring RADU CIPRIAN BILCU 1, MEJDI TRIMECHE 2, SAKARI ALENIUS 3, MARKKU VEHVILAINEN 4 1,2,3,4 Multimedia Technologies Laboratory, Nokia Research Center Visiokatu 1, FIN-33720,

More information

Accelerating Double Precision FEM Simulations with GPUs

Accelerating Double Precision FEM Simulations with GPUs Accelerating Double Precision FEM Simulations with GPUs Dominik Göddeke 1 3 Robert Strzodka 2 Stefan Turek 1 dominik.goeddeke@math.uni-dortmund.de 1 Mathematics III: Applied Mathematics and Numerics, University

More information

Superresolution Using Preconditioned Conjugate Gradient Method

Superresolution Using Preconditioned Conjugate Gradient Method Superresolution Using Preconditioned Conjugate Gradient Method Changjiang Yang, Ramani Duraiswami and Larry Davis Computer Vision Laboratory University of Maryland, College Park, MD 20742 E-mail: {yangcj,ramani,lsd}@umiacs.umd.edu

More information

Total variation tomographic inversion via the Alternating Direction Method of Multipliers

Total variation tomographic inversion via the Alternating Direction Method of Multipliers Total variation tomographic inversion via the Alternating Direction Method of Multipliers Landon Safron and Mauricio D. Sacchi Department of Physics, University of Alberta Summary Geophysical inverse problems

More information

AMS527: Numerical Analysis II

AMS527: Numerical Analysis II AMS527: Numerical Analysis II A Brief Overview of Finite Element Methods Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao SUNY Stony Brook AMS527: Numerical Analysis II 1 / 25 Overview Basic concepts Mathematical

More information

CS 6210 Fall 2016 Bei Wang. Review Lecture What have we learnt in Scientific Computing?

CS 6210 Fall 2016 Bei Wang. Review Lecture What have we learnt in Scientific Computing? CS 6210 Fall 2016 Bei Wang Review Lecture What have we learnt in Scientific Computing? Let s recall the scientific computing pipeline observed phenomenon mathematical model discretization solution algorithm

More information

NIA CFD Seminar, October 4, 2011 Hyperbolic Seminar, NASA Langley, October 17, 2011

NIA CFD Seminar, October 4, 2011 Hyperbolic Seminar, NASA Langley, October 17, 2011 NIA CFD Seminar, October 4, 2011 Hyperbolic Seminar, NASA Langley, October 17, 2011 First-Order Hyperbolic System Method If you have a CFD book for hyperbolic problems, you have a CFD book for all problems.

More information

Janne Martikainen 1. Introduction

Janne Martikainen 1. Introduction Mathematical Modelling and Numerical Analysis ESAIM: M2AN Modélisation Mathématique et Analyse Numérique M2AN, Vol. 37, N o 1, 2003, pp. 133 142 DOI: 10.1051/m2an:2003016 NUMERICAL STUDY OF TWO SPARSE

More information

REDUCING COMPLEXITY IN PARALLEL ALGEBRAIC MULTIGRID PRECONDITIONERS

REDUCING COMPLEXITY IN PARALLEL ALGEBRAIC MULTIGRID PRECONDITIONERS SUBMITTED TO SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, SEPTEMBER 2004 REDUCING COMPLEXITY IN PARALLEL ALGEBRAIC MULTIGRID PRECONDITIONERS HANS DE STERCK, ULRIKE MEIER YANG, AND JEFFREY J. HEYS

More information

Survey of the Mathematics of Big Data

Survey of the Mathematics of Big Data Survey of the Mathematics of Big Data Issues with Big Data, Mathematics to the Rescue Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) Math & Big Data Fall 2015 1 / 28 Introduction We survey some

More information

1 Exercise: 1-D heat conduction with finite elements

1 Exercise: 1-D heat conduction with finite elements 1 Exercise: 1-D heat conduction with finite elements Reading This finite element example is based on Hughes (2000, sec. 1.1-1.15. 1.1 Implementation of the 1-D heat equation example In the previous two

More information

Image Deblurring Using Adaptive Sparse Domain Selection and Adaptive Regularization

Image Deblurring Using Adaptive Sparse Domain Selection and Adaptive Regularization Volume 3, No. 3, May-June 2012 International Journal of Advanced Research in Computer Science RESEARCH PAPER Available Online at www.ijarcs.info ISSN No. 0976-5697 Image Deblurring Using Adaptive Sparse

More information

Outline Introduction Problem Formulation Proposed Solution Applications Conclusion. Compressed Sensing. David L Donoho Presented by: Nitesh Shroff

Outline Introduction Problem Formulation Proposed Solution Applications Conclusion. Compressed Sensing. David L Donoho Presented by: Nitesh Shroff Compressed Sensing David L Donoho Presented by: Nitesh Shroff University of Maryland Outline 1 Introduction Compressed Sensing 2 Problem Formulation Sparse Signal Problem Statement 3 Proposed Solution

More information

Optimum Array Processing

Optimum Array Processing Optimum Array Processing Part IV of Detection, Estimation, and Modulation Theory Harry L. Van Trees WILEY- INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION Preface xix 1 Introduction 1 1.1 Array Processing

More information

Dendro: Parallel algorithms for multigrid and AMR methods on 2:1 balanced octrees

Dendro: Parallel algorithms for multigrid and AMR methods on 2:1 balanced octrees Dendro: Parallel algorithms for multigrid and AMR methods on 2:1 balanced octrees Rahul S. Sampath, Santi S. Adavani, Hari Sundar, Ilya Lashuk, and George Biros University of Pennsylvania Abstract In this

More information

ACCELERATING CFD AND RESERVOIR SIMULATIONS WITH ALGEBRAIC MULTI GRID Chris Gottbrath, Nov 2016

ACCELERATING CFD AND RESERVOIR SIMULATIONS WITH ALGEBRAIC MULTI GRID Chris Gottbrath, Nov 2016 ACCELERATING CFD AND RESERVOIR SIMULATIONS WITH ALGEBRAIC MULTI GRID Chris Gottbrath, Nov 2016 Challenges What is Algebraic Multi-Grid (AMG)? AGENDA Why use AMG? When to use AMG? NVIDIA AmgX Results 2

More information

Multigrid Pattern. I. Problem. II. Driving Forces. III. Solution

Multigrid Pattern. I. Problem. II. Driving Forces. III. Solution Multigrid Pattern I. Problem Problem domain is decomposed into a set of geometric grids, where each element participates in a local computation followed by data exchanges with adjacent neighbors. The grids

More information

MATH 498 Brief Description of Some Possible Topics for the Senior Assignment Fall 2007

MATH 498 Brief Description of Some Possible Topics for the Senior Assignment Fall 2007 MATH 498 Brief Description of Some Possible Topics for the Senior Assignment Fall 2007 Dr. Marcus Agustin email: magusti@siue.edu Office: SL 1325 1. Simulation Study of Software Reliability Models Prerequisites:

More information

Multigrid Solvers in CFD. David Emerson. Scientific Computing Department STFC Daresbury Laboratory Daresbury, Warrington, WA4 4AD, UK

Multigrid Solvers in CFD. David Emerson. Scientific Computing Department STFC Daresbury Laboratory Daresbury, Warrington, WA4 4AD, UK Multigrid Solvers in CFD David Emerson Scientific Computing Department STFC Daresbury Laboratory Daresbury, Warrington, WA4 4AD, UK david.emerson@stfc.ac.uk 1 Outline Multigrid: general comments Incompressible

More information

Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma

Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma Presented by Hu Han Jan. 30 2014 For CSE 902 by Prof. Anil K. Jain: Selected

More information

Segmentation of MR Images of a Beating Heart

Segmentation of MR Images of a Beating Heart Segmentation of MR Images of a Beating Heart Avinash Ravichandran Abstract Heart Arrhythmia is currently treated using invasive procedures. In order use to non invasive procedures accurate imaging modalities

More information

Advanced Topics in Digital Communications Spezielle Methoden der digitalen Datenübertragung

Advanced Topics in Digital Communications Spezielle Methoden der digitalen Datenübertragung Advanced Topics in Digital Communications Spezielle Methoden der digitalen Datenübertragung Dr.-Ing. Carsten Bockelmann Institute for Telecommunications and High-Frequency Techniques Department of Communications

More information

Example 24 Spring-back

Example 24 Spring-back Example 24 Spring-back Summary The spring-back simulation of sheet metal bent into a hat-shape is studied. The problem is one of the famous tests from the Numisheet 93. As spring-back is generally a quasi-static

More information

Numerical Methods on the Image Processing Problems

Numerical Methods on the Image Processing Problems Numerical Methods on the Image Processing Problems Department of Mathematics and Statistics Mississippi State University December 13, 2006 Objective Develop efficient PDE (partial differential equations)

More information

Distributed NVAMG. Design and Implementation of a Scalable Algebraic Multigrid Framework for a Cluster of GPUs

Distributed NVAMG. Design and Implementation of a Scalable Algebraic Multigrid Framework for a Cluster of GPUs Distributed NVAMG Design and Implementation of a Scalable Algebraic Multigrid Framework for a Cluster of GPUs Istvan Reguly (istvan.reguly at oerc.ox.ac.uk) Oxford e-research Centre NVIDIA Summer Internship

More information

Auto-tuning Multigrid with PetaBricks

Auto-tuning Multigrid with PetaBricks Auto-tuning with PetaBricks Cy Chan Joint Work with: Jason Ansel Yee Lok Wong Saman Amarasinghe Alan Edelman Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology

More information

AN ALGORITHM FOR BLIND RESTORATION OF BLURRED AND NOISY IMAGES

AN ALGORITHM FOR BLIND RESTORATION OF BLURRED AND NOISY IMAGES AN ALGORITHM FOR BLIND RESTORATION OF BLURRED AND NOISY IMAGES Nader Moayeri and Konstantinos Konstantinides Hewlett-Packard Laboratories 1501 Page Mill Road Palo Alto, CA 94304-1120 moayeri,konstant@hpl.hp.com

More information

SDLS: a Matlab package for solving conic least-squares problems

SDLS: a Matlab package for solving conic least-squares problems SDLS: a Matlab package for solving conic least-squares problems Didier Henrion 1,2 Jérôme Malick 3 June 28, 2007 Abstract This document is an introduction to the Matlab package SDLS (Semi-Definite Least-Squares)

More information

A Comparative Study & Analysis of Image Restoration by Non Blind Technique

A Comparative Study & Analysis of Image Restoration by Non Blind Technique A Comparative Study & Analysis of Image Restoration by Non Blind Technique Saurav Rawat 1, S.N.Tazi 2 M.Tech Student, Assistant Professor, CSE Department, Government Engineering College, Ajmer Abstract:

More information

Performance and accuracy of hardware-oriented native-, solvers in FEM simulations

Performance and accuracy of hardware-oriented native-, solvers in FEM simulations Performance and accuracy of hardware-oriented native-, emulated- and mixed-precision solvers in FEM simulations Dominik Göddeke Angewandte Mathematik und Numerik, Universität Dortmund Acknowledgments Joint

More information

An algebraic multigrid method for isotropic linear elasticity problems on anisotropic meshes

An algebraic multigrid method for isotropic linear elasticity problems on anisotropic meshes INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING Int. J. Numer. Meth. Biomed. Engng. 2010; 26:534 553 Published online 10 July 2008 in Wiley InterScience (www.interscience.wiley.com)..1140

More information