Synthesis and Analysis Sparse Representation Models for Image Restoration. Shuhang Gu 顾舒航. Dept. of Computing The Hong Kong Polytechnic University
|
|
- Bertina Anderson
- 5 years ago
- Views:
Transcription
1 Synthesis and Analysis Sparse Representation Models for Image Restoration Shuhang Gu 顾舒航 Dept. of Computing The Hong Kong Polytechnic University
2 Outline Sparse representation models for image modeling Synthesis based representation model Analysis based representation model Synthesis & analysis models for image modeling Weighted nuclear norm and its applications in low level vision Low rank models Weighted nuclear norm minimization (WNNM) WNNM for image denoising WNNM-RPCA and WNNM-MC and their applications Convolutional sparse coding for single image super-resolution Convolutional sparse coding (CSC) CSC for single image super resolution 2
3 Synthesis and analysis sparse representation models 3
4 Synthesis based sparse representation model Synthesis based sparse representation model assumes that a signal x can be represented as a linear combination of a small number of atoms chosen out of a dictionary D: x = Dα, s.t. α 0 <ε??...?? A dense solution A sparse solution Elad, M., Milanfar, P., Rubinstein, R. Analysis versus synthesis in signal priors. Inverse problems
5 Analysis based sparse representation model Analysis model generate representation coefficients by a simple multiplication operation, and assumes the coefficients are sparse: Px 0 <ε??...?? Elad, M., Milanfar, P., Rubinstein, R. Analysis versus synthesis in signal priors. Inverse problems
6 S&A representation models for image modeling A geometry perspective Synthesis model x = Dα, where α is sparse Analysis model β = Px, where β is sparse synthesis model emphasis the non-zero values in the sparse coefficient vector α, because these non-zero values select vectors in the dictionary to span the space of input signal A hyperplane Analysis model emphasis the zero values in the sparse coefficient vector Px, because these zero values select vectors in the projection matrix to span the complementary space of input signal Elad, M., Milanfar, P., Rubinstein, R. Analysis versus synthesis in signal priors. Inverse problems
7 S&A representation models for image modeling Image restoration/enhancement problems Image Denoising Image Super-resolution y = x + n Image Deconvolution y = D(k x) + n Image Inpainting y = k x + n y = M x + n 7
8 S&A representation models for image modeling Priors for image restoration Sparsity priors Non-local similarity priors Color line priors Buades A, Coll B, Morel JM. A non-local algorithm for image denoising. In CVPR
9 S&A representation models for image modeling Sparsity prior argmax x p x y = p y x p(x) Minimize the log(p x y ): x = argmin X 1 Transformation domain Gaussian likelihood dist. assumption Data prior modeling 2 x y F log(p(x)) Long-tail dist. leads to sparse solution Analysis model φ(px) p(x) Prior modeling Original signal domain Dist. Is not discriminative enough Decomposition domain Long-tail dist. leads to sparse solution Synthesis model ψ(α) 9
10 S&A representation models for image modeling Synthesis model min α 1 2 y Dα F + ψ α x = Dα Representative methods KSVD, BM3D, LSSC, NCSR, et. al. Pros - Synthesis model can be more sparse - Easier to embed non-local prior Cons - Patch prior modeling needs aggregation - Time consuming Analysis model min x 1 2 y x F + φ(px) Representative methods TV, wavelet methods, FRAME, FOE, CSF, TRD et. al. Pros - Patch divide free - Efficient in the inference phase - Easier to learn task specific prior Cons - Hard to embed non-local prior - Not as sparse as synthesis model 10
11 S&A representation models for image modeling Patch based Filter based Synthesis model Methods: KSVD, BM3D, LSSC, NCSR, etc. Pros - Synthesis model can be more sparse - Easier to embed non-local prior Cons - Patch prior modeling needs aggregation - Time consuming Analysis model methods: TV, wavelet methods, FOE, CSF, TRD etc. Pros - Patch divide free - Efficient in the inference phase - Easier to learn task specific prior Cons - Hard to embed non-local prior - Not as sparse as synthesis model 11
12 S&A representation models for image modeling Patch based Filter based Synthesis model Methods: KSVD, BM3D, LSSC, NCSR, etc. Pros - Synthesis model can be more sparse - Easier to embed non-local prior Cons - Patch prior modeling needs aggregation - Time consuming? Analysis model Methods: Analysis-KSVD et al. methods: TV, wavelet methods, FOE, CSF, TRD etc. Pros - Patch divide free - Efficient in the inference phase - Easier to learn task specific prior Cons - Hard to embed non-local prior - Not as sparse as synthesis model 12
13 S&A representation models for image modeling Synthesis model Analysis model Patch based Embed non-local prior Modeling texture/details better Embed non-local prior Modeling structure better Filter based Aggregation free Modeling texture/details better Aggregation free Modeling structure better Notes: Aggregation: Overlap aggregation method may smooth image or generate ringing artifacts Non-local prior: Non-local prior helps to generate visual plausible results on highly noisy situation 13
14 S&A representation models for image modeling Synthesis model Analysis model Patch based Embed non-local prior Modeling texture/details better Embed non-local prior Modeling structure better Filter based Aggregation free Modeling texture/details better Different applications may be better solved via different models! Aggregation free Modeling structure better Notes: Aggregation: Overlap aggregation method may smooth image or generate ringing artifacts Non-local prior: Non-local prior helps to generate visual plausible results on highly noisy situation 14
15 S&A representation models for image modeling Weighted nuclear norm minimization denoisning model A analysis model with patch based implementation Non-local prior Analysis model is good at structure modeling Denoising Convolutional sparse coding super resolution A synthesis model with filter based implementation Aggregation free Synthesis model is good at texture modeling SR 15
16 Weighted nuclear norm minimization and its applications in low level vision 16
17 Low rank models Matrix factorization methods min U,V loss Y X s. t. X = UV Loss functions are determined by different noise models: Gaussian noise model: PCA, Probabilistic PCA Sparse noise model: Robust PCAs Partial observations: Matrix completion Complex noise model: MoG etc. 17
18 Low rank models Regularization methods min X loss Y X + R(X) A common used regularization term is the nuclear norm of matrix X X = σ i (X) 1 Pros: - exact recovery property (theoretically proved) - nuclear norm proximal problem has closed-form solution Character: - Regularization method balance fidelity and low-rankness via parameter - Factorization method set upper bound. Candès, Emmanuel J., et al. "Robust principal component analysis?." Journal of the ACM, Candès, Emmanuel J., and Benjamin Recht. "Exact matrix completion via convex optimization." Foundations of Computational mathematics Cai, J. F., Candès, E. J., & Shen, Z. A singular value thresholding algorithm for matrix completion. SIAM Journal on Optimization,
19 Low rank models Regularization methods: a 2D analysis sparse perspective Analysis sparse model min x 1 2 y x F + φ(px) Nuclear norm regularization model min X 1 2 Y X F + U T XV 1 Nuclear norm regularization model can be interpreted as a 2D analysis sparse model! 19
20 Weighted nuclear norm minimization Nuclear norm proximal Pros min X 1 2 Y X F + λ X X = US λ σ Y V T Tightest convex envelope of rank minimization. Closed form solution. Cons Treat equally all the singular values. Ignore the different significances of matrix singular values. Cai, J. F., Candès, E. J., & Shen, Z. A singular value thresholding algorithm for matrix completion. SIAM Journal on Optimization,
21 Weighted nuclear norm minimization Weighted nuclear norm X w, = w i σ i (X) 1 Weighted nuclear norm proximal (WNNP) Difficulties X = argmin X X Y F + X w, The WNNM is not convex for general weight vectors The sub-gradient method cannot be used to analyze its optimization 21
22 Weighted nuclear norm minimization Theorem 1. Y R m n, let Y = UΣV T be its SVD. The optimal solution of the WNNP problem: is X = argmin X X Y F + X w, X = UDV T where D is a diagonal matrix with diagonal entries d=[d 1, d 2,, d r ] (r=min(m,n)) and d is determined by: r min d1, d 2 d n i=1 (d i σ i ) 2 + w i d i s. t. d 1 d 2 d r 0. 22
23 Weighted nuclear norm minimization Corollary 1. If the weights satisfy 0 w 1 w 2 w n, the non-convex WNNP problem has a closed form optimal solution: X = US w (Σ)V T where Y = UΣV T is the SVD of Y, and S w (Σ) ii = max Σ ii w i, 0. 23
24 WNNM for image denosing 1. For each noisy patch, search in the image for its nonlocal similar patches to form matrix Y. 2. Solve the WNNM problem to estimate the clean patches X from Y. 3. Put the clean patch back to the image. 4. Repeat the above procedures several times to obtain the denoised image. X = argmin X X Y F + X w, WNNM 24
25 WNNM for image denosing Weights setting Reweighting strategy to promote sparsity w i = C σ i X + ε Still only has one parameter Will not introduce much further computation burden 25
26 WNNM for image denosing Denoising experimental results 26
27 WNNM-RPCA min X,E E 1 + X w, s. t. Y = X + E Synthetic experiment: X, Y R m m, Rank X = P r m, E 0 = P e m 2 27
28 WNNM-RPCA 28
29 WNNM-MC min X X w, s. t. Y = X + E, P Ω E = 0 Synthetic experiment: X, Y R m m, Rank X = P r m, E 0 = P e m 2 29
30 WNNM-MC 30
31 WNNM summary We analyzed the weighted nuclear norm proximal (WNNP) problem. Based on WNNP, we proposed a new image denoising algorithm, and achieved state-of-the-art performance. We then extend weighted nuclear norm to WNNM-RPCA and WNNM-MC. WNNM achieved superior performance than NNM on both the two applications. 31
32 Convolutional sparse coding for single image super-resolution 32
33 Convolutional sparse coding Consistency constraint 33
34 Convolutional sparse coding Aggregation method in patch based algorithms Noisy Non Overlapping Center Pixel Overlapping EPLL min X X Y 2 + R i X Z i 2 + P(Z i ) Zoran D, Weiss Y. From learning models of natural image patches to whole image restoration. In: ICCV
35 Convolutional sparse coding Sparse coding min α y Dα F 2 +φ(α) Convolutional sparse coding min Z Y f i z i F 2 + φ(z i ) Matrix Form M. D. Zeiler, D. Krishnan, G. W. Taylor, and R. Fergus. Deconvolutional networks. In CVPR,
36 Convolutional sparse coding for image SR LR Filter Learning N LR feature maps The Training Phase Joint HR Filter and Mapping Function Learning M HR feature maps CSC LR Filter Learning Mapp. Func. Learning HR Filter Learning N LR filters Mapp. Func. The Testing Phase M HR filters HR Feature Map Estimation Convolution 36
37 Convolutional sparse coding for image SR LR Filter Learning N LR feature maps The Training Phase Joint HR Filter and Mapping Function Learning M HR feature maps CSC LR Filter Learning Mapp. Func. Learning HR Filter Learning Pre-processing 37
38 Convolutional sparse coding for image SR LR Filter Learning N LR feature maps The Training Phase Joint HR Filter and Mapping Function Learning M HR feature maps CSC LR Filter Learning Mapp. Func. Learning HR Filter Learning LR filter training B. Wohlberg. Efficient convolutional sparse coding. In ICASSP,
39 Convolutional sparse coding for image SR LR Filter Learning N LR feature maps The Training Phase Joint HR Filter and Mapping Function Learning M HR feature maps CSC LR Filter Learning Mapp. Func. Learning HR Filter Learning Joint HR filter and mapping function learning 39
40 Convolutional sparse coding for image SR The Training Phase N LR filters Mapp. Func. The Testing Phase M HR filters HR Feature Map Estimation Convolution 40
41 Convolutional sparse coding for image SR Optimization: SA-ADMM The original problem can be write as: L. W. Zhong and J. T. Kwok. Fast stochastic alternating direction method of multipliers. In ICML,
42 Convolutional sparse coding for image SR Optimization: SA-ADMM SA-ADMM 42
43 Convolutional sparse coding for image SR 43
44 Convolutional sparse coding for image SR 44
45 Convolutional sparse coding for image SR 45
46 Convolutional sparse coding for image SR 46
47 CSC-SR: summary and future work Summary To avoid patch aggregation in super-resolution, we utilize convolutional sparse coding to deal with SR problem. SA-ADMM algorithm is used to train CSC-SR model for large scale training data. State-of-the-art SR results with high PSNR and visual quality. Future work End to end training strategy may be better. Is there any optimization algorithm which is more suitable for CSC training. 47
48 Related Publications and References Related Publication S. Gu, L. Zhang, W. Zuo, and X. Feng, Weighted Nuclear Norm Minimization with Application to Image Denoising, In CVPR Q. Xie, D. Meng, S. Gu, L. Zhang, W. Zuo, X. Feng and Z. Xu, On the Optimal Solution of Weighted Nuclear Norm Minimization Technical Report. S. Gu, Q. Xie, D. Meng, W. Zuo, X. Feng, L. Zhang. Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision. Submitted to IJCV (Minor revision). S. Gu, W. Zuo, Q. Xie, D. Meng, X. Feng, L. Zhang. "Convolutional Sparse Coding for Image Super-resolution," In ICCV References Elad, M., Milanfar, P., Rubinstein, R. Analysis versus synthesis in signal priors. Inverse problems Buades A, Coll B, Morel JM. A non-local algorithm for image denoising. In CVPR M. Aharon, M. Elad, A. Bruckstein. K-svd: An algorithm for designing overcomplete dictionaries for sparse representation. TSP K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian. Image denoising by sparse 3-d transformdomain collaborative filtering. TIP,
49 Related Publications and References References J. Marial, F. Bach, J. P once, G. Sapiro, and A. Zisserman. Non-local sparse models for image restoration. In ICCV W. Dong, L. Zhang, and G. Shi, Centralized Sparse Representation for Image Restoration, In ICCV Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena Zhu, S.C., Wu, Y., Mumford, D.: Filters, random fields and maximum entropy (frame): Towards a unified theory for texture modeling. IJCV Roth, S., Black, M.J.: Fields of experts. IJCV Schmidt, U., Roth, S.: Shrinkage fields for effective image restoration. In: CVPR. (2014) Chen, Y., Yu, W., Pock, T.: On learning optimized reaction diffusion processes for effective image restoration. In: CVPR. (2015) Rubinstein, Ron, Tomer Peleg, and Michael Elad. "Analysis K-SVD: A dictionary-learning algorithm for the analysis sparse model." TSP Tipping, Michael E., and Christopher M. Bishop. "Probabilistic principal component analysis." Journal of the Royal Statistical Society: Series B (Statistical Methodology) 61.3 (1999):
50 Related Publications and References References Ke Q, Kanade T. Robust l1 norm factorization in the presence of outliers and missing data by alternative convex programming. In: CVPR Meng D, Torre FDL. Robust matrix factorization with unknown noise. In: ICCV Candès, Emmanuel J., et al. "Robust principal component analysis?." Journal of the ACM, Candès, Emmanuel J., and Benjamin Recht. "Exact matrix completion via convex optimization." Foundations of Computational mathematics Cai, J. F., Candès, E. J., & Shen, Z. A singular value thresholding algorithm for matrix completion. SIAM Journal on Optimization, Zoran D, Weiss Y. From learning models of natural image patches to whole image restoration. In: ICCV M. D. Zeiler, D. Krishnan, G. W. Taylor, and R. Fergus. Deconvolutional networks. In CVPR, B. Wohlberg. Efficient convolutional sparse coding. In ICASSP, L. W. Zhong and J. T. Kwok. Fast stochastic alternating direction method of multipliers. In ICML, Note: References of comparison methods in the tables are omitted, all of these references can be found in my corresponding publications. 50
51 THANKS! 51
Single Image Interpolation via Adaptive Non-Local Sparsity-Based Modeling
Single Image Interpolation via Adaptive Non-Local Sparsity-Based Modeling Yaniv Romano The Electrical Engineering Department Matan Protter The Computer Science Department Michael Elad The Computer Science
More informationTHE goal of image denoising is to restore the clean image
1 Non-Convex Weighted l p Minimization based Group Sparse Representation Framework for Image Denoising Qiong Wang, Xinggan Zhang, Yu Wu, Lan Tang and Zhiyuan Zha model favors the piecewise constant image
More informationDenoising an Image by Denoising its Components in a Moving Frame
Denoising an Image by Denoising its Components in a Moving Frame Gabriela Ghimpețeanu 1, Thomas Batard 1, Marcelo Bertalmío 1, and Stacey Levine 2 1 Universitat Pompeu Fabra, Spain 2 Duquesne University,
More informationIMAGE DENOISING USING NL-MEANS VIA SMOOTH PATCH ORDERING
IMAGE DENOISING USING NL-MEANS VIA SMOOTH PATCH ORDERING Idan Ram, Michael Elad and Israel Cohen Department of Electrical Engineering Department of Computer Science Technion - Israel Institute of Technology
More informationPatch-Based Color Image Denoising using efficient Pixel-Wise Weighting Techniques
Patch-Based Color Image Denoising using efficient Pixel-Wise Weighting Techniques Syed Gilani Pasha Assistant Professor, Dept. of ECE, School of Engineering, Central University of Karnataka, Gulbarga,
More informationExternal Patch Prior Guided Internal Clustering for Image Denoising
External Patch Prior Guided Internal Clustering for Image Denoising Fei Chen 1, Lei Zhang 2, and Huimin Yu 3 1 College of Mathematics and Computer Science, Fuzhou University, Fuzhou, China 2 Dept. of Computing,
More informationAn Optimized Pixel-Wise Weighting Approach For Patch-Based Image Denoising
An Optimized Pixel-Wise Weighting Approach For Patch-Based Image Denoising Dr. B. R.VIKRAM M.E.,Ph.D.,MIEEE.,LMISTE, Principal of Vijay Rural Engineering College, NIZAMABAD ( Dt.) G. Chaitanya M.Tech,
More informationPatch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising
Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising Jun Xu 1, Lei Zhang 1,, Wangmeng Zuo 2, David Zhang 1, and Xiangchu Feng 3 1 Dept. of Computing, The Hong Kong Polytechnic
More informationImage Restoration Using DNN
Image Restoration Using DNN Hila Levi & Eran Amar Images were taken from: http://people.tuebingen.mpg.de/burger/neural_denoising/ Agenda Domain Expertise vs. End-to-End optimization Image Denoising and
More informationImage Denoising via Group Sparse Eigenvectors of Graph Laplacian
Image Denoising via Group Sparse Eigenvectors of Graph Laplacian Yibin Tang, Ying Chen, Ning Xu, Aimin Jiang, Lin Zhou College of IOT Engineering, Hohai University, Changzhou, China School of Information
More informationExpected Patch Log Likelihood with a Sparse Prior
Expected Patch Log Likelihood with a Sparse Prior Jeremias Sulam and Michael Elad Computer Science Department, Technion, Israel {jsulam,elad}@cs.technion.ac.il Abstract. Image priors are of great importance
More informationSUPPLEMENTARY MATERIAL
SUPPLEMENTARY MATERIAL Zhiyuan Zha 1,3, Xin Liu 2, Ziheng Zhou 2, Xiaohua Huang 2, Jingang Shi 2, Zhenhong Shang 3, Lan Tang 1, Yechao Bai 1, Qiong Wang 1, Xinggan Zhang 1 1 School of Electronic Science
More informationImage Restoration: From Sparse and Low-rank Priors to Deep Priors
Image Restoration: From Sparse and Low-rank Priors to Deep Priors Lei Zhang 1, Wangmeng Zuo 2 1 Dept. of computing, The Hong Kong Polytechnic University, 2 School of Computer Science and Technology, Harbin
More informationIMAGE RESTORATION VIA EFFICIENT GAUSSIAN MIXTURE MODEL LEARNING
IMAGE RESTORATION VIA EFFICIENT GAUSSIAN MIXTURE MODEL LEARNING Jianzhou Feng Li Song Xiaog Huo Xiaokang Yang Wenjun Zhang Shanghai Digital Media Processing Transmission Key Lab, Shanghai Jiaotong University
More informationLearning how to combine internal and external denoising methods
Learning how to combine internal and external denoising methods Harold Christopher Burger, Christian Schuler, and Stefan Harmeling Max Planck Institute for Intelligent Systems, Tübingen, Germany Abstract.
More informationCentralized Sparse Representation for Image Restoration
Centralized Sparse Representation for Image Restoration Weisheng Dong Sch. of Elec. Engineering Xidian University, China wsdong@mail.xidian.edu.cn Lei Zhang Dept. of Computing The Hong Kong Polytechnic
More informationPATCH-DISAGREEMENT AS A WAY TO IMPROVE K-SVD DENOISING
PATCH-DISAGREEMENT AS A WAY TO IMPROVE K-SVD DENOISING Yaniv Romano Department of Electrical Engineering Technion, Haifa 32000, Israel yromano@tx.technion.ac.il Michael Elad Department of Computer Science
More informationDiscriminative Transfer Learning for General Image Restoration
IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Discriminative Transfer Learning for General Image Restoration Lei Xiao, Felix Heide, Wolfgang Heidrich, Bernhard Schölkopf, Michael Hirsch Abstract Recently, several
More informationIMAGE DENOISING TO ESTIMATE THE GRADIENT HISTOGRAM PRESERVATION USING VARIOUS ALGORITHMS
IMAGE DENOISING TO ESTIMATE THE GRADIENT HISTOGRAM PRESERVATION USING VARIOUS ALGORITHMS P.Mahalakshmi 1, J.Muthulakshmi 2, S.Kannadhasan 3 1,2 U.G Student, 3 Assistant Professor, Department of Electronics
More informationStructure-adaptive Image Denoising with 3D Collaborative Filtering
, pp.42-47 http://dx.doi.org/10.14257/astl.2015.80.09 Structure-adaptive Image Denoising with 3D Collaborative Filtering Xuemei Wang 1, Dengyin Zhang 2, Min Zhu 2,3, Yingtian Ji 2, Jin Wang 4 1 College
More informationNonlocal Spectral Prior Model for Low-level Vision
Nonlocal Spectral Prior Model for Low-level Vision Shenlong Wang, Lei Zhang, Yan Liang Northwestern Polytechnical University, The Hong Kong Polytechnic University Abstract. Image nonlocal self-similarity
More informationLearning Data Terms for Non-blind Deblurring Supplemental Material
Learning Data Terms for Non-blind Deblurring Supplemental Material Jiangxin Dong 1, Jinshan Pan 2, Deqing Sun 3, Zhixun Su 1,4, and Ming-Hsuan Yang 5 1 Dalian University of Technology dongjxjx@gmail.com,
More informationIMAGE DENOISING BY TARGETED EXTERNAL DATABASES
IMAGE DENOISING BY TARGETED EXTERNAL DATABASES Enming Luo 1, Stanley H. Chan, and Truong Q. Nguyen 1 1 University of California, San Diego, Dept of ECE, 9500 Gilman Drive, La Jolla, CA 9093. Harvard School
More informationLocally Adaptive Regression Kernels with (many) Applications
Locally Adaptive Regression Kernels with (many) Applications Peyman Milanfar EE Department University of California, Santa Cruz Joint work with Hiro Takeda, Hae Jong Seo, Xiang Zhu Outline Introduction/Motivation
More informationarxiv: v1 [cs.cv] 16 Feb 2018
FAST, TRAINABLE, MULTISCALE DENOISING Sungoon Choi, John Isidoro, Pascal Getreuer, Peyman Milanfar Google Research {sungoonc, isidoro, getreuer, milanfar}@google.com arxiv:1802.06130v1 [cs.cv] 16 Feb 2018
More informationMarkov Random Fields and Gibbs Sampling for Image Denoising
Markov Random Fields and Gibbs Sampling for Image Denoising Chang Yue Electrical Engineering Stanford University changyue@stanfoed.edu Abstract This project applies Gibbs Sampling based on different Markov
More informationINCOHERENT DICTIONARY LEARNING FOR SPARSE REPRESENTATION BASED IMAGE DENOISING
INCOHERENT DICTIONARY LEARNING FOR SPARSE REPRESENTATION BASED IMAGE DENOISING Jin Wang 1, Jian-Feng Cai 2, Yunhui Shi 1 and Baocai Yin 1 1 Beijing Key Laboratory of Multimedia and Intelligent Software
More informationIMAGE DENOISING BY TARGETED EXTERNAL DATABASES
014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) IMAGE DENOISING BY TARGETED EXTERNAL DATABASES Enming Luo 1, Stanley H. Chan, and Truong Q. Nguyen 1 1 University of
More informationTotal Variation Denoising with Overlapping Group Sparsity
1 Total Variation Denoising with Overlapping Group Sparsity Ivan W. Selesnick and Po-Yu Chen Polytechnic Institute of New York University Brooklyn, New York selesi@poly.edu 2 Abstract This paper describes
More informationarxiv: v1 [cs.cv] 18 Jan 2019
Good Similar Patches for Image Denoising Si Lu Portland State University lusi@pdx.edu arxiv:1901.06046v1 [cs.cv] 18 Jan 2019 Abstract Patch-based denoising algorithms like BM3D have achieved outstanding
More informationJoint Convolutional Analysis and Synthesis Sparse Representation for Single Image Layer Separation
Joint Convolutional Analysis and Synthesis Sparse Representation for Single Image Layer Separation Shuhang Gu 1, Deyu Meng 2, Wangmeng Zuo 3, Lei Zhang 1, 1 The Hong Kong Polytechnic University, 2 Xi an
More informationOptimal Denoising of Natural Images and their Multiscale Geometry and Density
Optimal Denoising of Natural Images and their Multiscale Geometry and Density Department of Computer Science and Applied Mathematics Weizmann Institute of Science, Israel. Joint work with Anat Levin (WIS),
More informationImage Deblurring Using Adaptive Sparse Domain Selection and Adaptive Regularization
Volume 3, No. 3, May-June 2012 International Journal of Advanced Research in Computer Science RESEARCH PAPER Available Online at www.ijarcs.info ISSN No. 0976-5697 Image Deblurring Using Adaptive Sparse
More informationSparsity and image processing
Sparsity and image processing Aurélie Boisbunon INRIA-SAM, AYIN March 6, Why sparsity? Main advantages Dimensionality reduction Fast computation Better interpretability Image processing pattern recognition
More informationSparse Representation and Low Rank Methods for Image Restoration and Classification. Lei Zhang
Sparse Representation and Low Rank Methods for Image Restoration and Classification Lei Zhang Dept. of Computing The Hong Kong Polytechnic University http://www.comp.polyu.edu.hk/~cslzhang/ My recent research
More informationImage Restoration and Background Separation Using Sparse Representation Framework
Image Restoration and Background Separation Using Sparse Representation Framework Liu, Shikun Abstract In this paper, we introduce patch-based PCA denoising and k-svd dictionary learning method for the
More informationIMAGE SUPER-RESOLUTION BASED ON DICTIONARY LEARNING AND ANCHORED NEIGHBORHOOD REGRESSION WITH MUTUAL INCOHERENCE
IMAGE SUPER-RESOLUTION BASED ON DICTIONARY LEARNING AND ANCHORED NEIGHBORHOOD REGRESSION WITH MUTUAL INCOHERENCE Yulun Zhang 1, Kaiyu Gu 2, Yongbing Zhang 1, Jian Zhang 3, and Qionghai Dai 1,4 1 Shenzhen
More informationRobust Principal Component Analysis (RPCA)
Robust Principal Component Analysis (RPCA) & Matrix decomposition: into low-rank and sparse components Zhenfang Hu 2010.4.1 reference [1] Chandrasekharan, V., Sanghavi, S., Parillo, P., Wilsky, A.: Ranksparsity
More informationarxiv: v1 [cs.cv] 30 Oct 2018
Image Restoration using Total Variation Regularized Deep Image Prior Jiaming Liu 1, Yu Sun 2, Xiaojian Xu 2 and Ulugbek S. Kamilov 1,2 1 Department of Electrical and Systems Engineering, Washington University
More informationSingle-patch low-rank prior for non-pointwise impulse noise removal
Single-patch low-rank prior for non-pointwise impulse noise removal Ruixuan Wang Emanuele Trucco School of Computing, University of Dundee, UK {ruixuanwang, manueltrucco}@computing.dundee.ac.uk Abstract
More informationTransformed Low-rank Model for Line Pattern Noise Removal
Transformed Low-rank Model for Line Pattern Noise Removal Yi Chang, Luxin Yan*, Sheng Zhong National Key Laboratory of Science and Technology on Multispectral Information Processing School of Automation,
More informationarxiv: v1 [eess.sp] 1 Nov 2017
LEARNED CONVOLUTIONAL SPARSE CODING Hillel Sreter Raja Giryes School of Electrical Engineering, Tel Aviv University, Tel Aviv, Israel, {hillelsr@mail., raja@}tau.ac.il arxiv:7.00328v [eess.sp] Nov 207
More informationarxiv: v2 [cs.cv] 1 Sep 2016
Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections arxiv:1603.09056v2 [cs.cv] 1 Sep 2016 Xiao-Jiao Mao, Chunhua Shen, Yu-Bin Yang State Key Laboratory
More informationSupplementary Material : Partial Sum Minimization of Singular Values in RPCA for Low-Level Vision
Supplementary Material : Partial Sum Minimization of Singular Values in RPCA for Low-Level Vision Due to space limitation in the main paper, we present additional experimental results in this supplementary
More informationMATCHING PURSUIT BASED CONVOLUTIONAL SPARSE CODING. Elad Plaut and Raja Giryes
MATCHING PURSUIT BASED CONVOLUTIONAL SPARSE CODING Elad Plaut and Raa Giryes School of Electrical Engineering, Tel Aviv University, Tel Aviv, Israel ABSTRACT Convolutional sparse coding using the l 0,
More informationPatch Group based Bayesian Learning for Blind Image Denoising
Patch Group based Bayesian Learning for Blind Image Denoising Jun Xu 1, Dongwei Ren 1,2, Lei Zhang 1, David Zhang 1 1 Dept. of Computing, The Hong Kong Polytechnic University, Hong Kong, China 2 School
More informationA DEEP DICTIONARY MODEL FOR IMAGE SUPER-RESOLUTION. Jun-Jie Huang and Pier Luigi Dragotti
A DEEP DICTIONARY MODEL FOR IMAGE SUPER-RESOLUTION Jun-Jie Huang and Pier Luigi Dragotti Communications and Signal Processing Group CSP), Imperial College London, UK ABSTRACT Inspired by the recent success
More informationDetecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference
Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference Minh Dao 1, Xiang Xiang 1, Bulent Ayhan 2, Chiman Kwan 2, Trac D. Tran 1 Johns Hopkins Univeristy, 3400
More informationarxiv: v2 [cs.cv] 1 Mar 2016
Image denoising based on improved data-driven sparse representation Dai-Qiang Chen,a a Department of Mathematics, College of Biomedical Engineering, Third Military Medical University, Chongqing 400038,
More informationImage Denoising based on Adaptive BM3D and Singular Value
Image Denoising based on Adaptive BM3D and Singular Value Decomposition YouSai hang, ShuJin hu, YuanJiang Li Institute of Electronic and Information, Jiangsu University of Science and Technology, henjiang,
More informationDeep Boosting for Image Denoising
Deep Boosting for Image Denoising Chang Chen, Zhiwei Xiong ( ), Xinmei Tian, and Feng Wu University of Science and Technology of China changc@mail.ustc.edu.cn, {zwxiong,xinmei,fengwu}@ustc.edu.cn Abstract.
More informationImage denoising with patch based PCA: local versus global
DELEDALLE, SALMON, DALALYAN: PATCH BASED PCA 1 Image denoising with patch based PCA: local versus global Charles-Alban Deledalle http://perso.telecom-paristech.fr/~deledall/ Joseph Salmon http://www.math.jussieu.fr/~salmon/
More informationImage Denoising using Locally Learned Dictionaries
Image Denoising using Locally Learned Dictionaries Priyam Chatterjee and Peyman Milanfar Department of Electrical Engineering, University of California, Santa Cruz, CA 95064, USA. ABSTRACT In this paper
More informationOne of the most successful approaches to solve inverse
IEEE TRANSACTION ON IMAGE PROCESSING, VOL. XX, NO. XX, 20XX 1 Insights into analysis operator learning: From patch-based sparse models to higher-order MRFs Yunjin Chen, René Ranftl and Thomas Pock arxiv:1401.2804v1
More informationLearning Fully Convolutional Networks for Iterative Non-blind Deconvolution
Learning Fully Convolutional Networks for Iterative Non-blind Deconvolution Jiawei Zhang 13 Jinshan Pan 2 Wei-Sheng Lai 3 Rynson W.H. Lau 1 Ming-Hsuan Yang 3 Department of Computer Science, City University
More informationI. INTRODUCTION II. RELATED WORK. International Journal of Computer Science Trends and Technology (IJCST) Volume 5 Issue 5, Sep Oct 2017
RESEARCH ARTICLE OPEN ACCESS Gradient Histogram Estimation and Preservation for texture Enhanced Image Denoising Guntupalli Sravan Chand [1], Shaik Rahamtula [2] P.G. Student [1], Associate Professor [2]
More informationImage Processing using Smooth Ordering of its Patches
1 Image Processing using Smooth Ordering of its Patches Idan Ram, Michael Elad, Fellow, IEEE, and Israel Cohen, Senior Member, IEEE arxiv:12.3832v1 [cs.cv] 14 Oct 212 Abstract We propose an image processing
More informationPatch-based Image Denoising: Probability Distribution Estimation vs. Sparsity Prior
017 5th European Signal Processing Conference (EUSIPCO) Patch-based Image Denoising: Probability Distribution Estimation vs. Sparsity Prior Dai-Viet Tran 1, Sébastien Li-Thiao-Té 1, Marie Luong, Thuong
More informationA Robust Texture Enhanced Image Denoising Using Gradient Histogram Preservation with Iterative Histogram Specification
A Robust Texture Enhanced Image Denoising Using Gradient Histogram Preservation with Iterative Histogram Specification Nukathoti Kejiya Kumari M.Tech in CESP, RVR & JC College of Engineering, Chandramoulipuram,
More informationSingle Image Super-Resolution via Sparse Representation over Directionally Structured Dictionaries Based on the Patch Gradient Phase Angle
2014 UKSim-AMSS 8th European Modelling Symposium Single Image Super-Resolution via Sparse Representation over Directionally Structured Dictionaries Based on the Patch Gradient Phase Angle Mahmoud Nazzal,
More informationCollaborative Sparsity and Compressive MRI
Modeling and Computation Seminar February 14, 2013 Table of Contents 1 T2 Estimation 2 Undersampling in MRI 3 Compressed Sensing 4 Model-Based Approach 5 From L1 to L0 6 Spatially Adaptive Sparsity MRI
More informationADAPTIVE LOW RANK AND SPARSE DECOMPOSITION OF VIDEO USING COMPRESSIVE SENSING
ADAPTIVE LOW RANK AND SPARSE DECOMPOSITION OF VIDEO USING COMPRESSIVE SENSING Fei Yang 1 Hong Jiang 2 Zuowei Shen 3 Wei Deng 4 Dimitris Metaxas 1 1 Rutgers University 2 Bell Labs 3 National University
More informationImage Denoising Using Sparse Representations
Image Denoising Using Sparse Representations SeyyedMajid Valiollahzadeh 1,,HamedFirouzi 1, Massoud Babaie-Zadeh 1, and Christian Jutten 2 1 Department of Electrical Engineering, Sharif University of Technology,
More informationRobust video denoising using Low rank matrix completion
Robust video denoising using Low rank matrix completion Hui Ji, Chaoqiang Liu, Zuowei Shen and Yuhong Xu National University of Singapore, Singapore 117542 Department of Mathematics and Center for Wavelets,
More informationWhen Sparsity Meets Low-Rankness: Transform Learning With Non-Local Low-Rank Constraint For Image Restoration
When Sparsity Meets Low-Rankness: Transform Learning With Non-Local Low-Rank Constraint For Image Restoration Bihan Wen, Yanjun Li and Yoram Bresler Department of Electrical and Computer Engineering Coordinated
More informationMULTIVIEW 3D VIDEO DENOISING IN SLIDING 3D DCT DOMAIN
20th European Signal Processing Conference (EUSIPCO 2012) Bucharest, Romania, August 27-31, 2012 MULTIVIEW 3D VIDEO DENOISING IN SLIDING 3D DCT DOMAIN 1 Michal Joachimiak, 2 Dmytro Rusanovskyy 1 Dept.
More informationInvestigating Image Inpainting via the Alternating Direction Method of Multipliers
Investigating Image Inpainting via the Alternating Direction Method of Multipliers Jonathan Tuck Stanford University jonathantuck@stanford.edu Abstract In many imaging applications, there exists potential
More informationRobust l p -norm Singular Value Decomposition
Robust l p -norm Singular Value Decomposition Kha Gia Quach 1, Khoa Luu 2, Chi Nhan Duong 1, Tien D. Bui 1 1 Concordia University, Computer Science and Software Engineering, Montréal, Québec, Canada 2
More informationReal-time Background Subtraction via L1 Norm Tensor Decomposition
Real-time Background Subtraction via L1 Norm Tensor Decomposition Taehyeon Kim and Yoonsik Choe Yonsei University, Seoul, Korea E-mail: pyomu@yonsei.ac.kr Tel/Fax: +82-10-2702-7671 Yonsei University, Seoul,
More informationSparse & Redundant Representations and Their Applications in Signal and Image Processing
Sparse & Redundant Representations and Their Applications in Signal and Image Processing Sparseland: An Estimation Point of View Michael Elad The Computer Science Department The Technion Israel Institute
More informationNon-Parametric Bayesian Dictionary Learning for Sparse Image Representations
Non-Parametric Bayesian Dictionary Learning for Sparse Image Representations Mingyuan Zhou, Haojun Chen, John Paisley, Lu Ren, 1 Guillermo Sapiro and Lawrence Carin Department of Electrical and Computer
More informationCOMPRESSED SENSING MRI WITH BAYESIAN DICTIONARY LEARNING.
COMPRESSED SENSING MRI WITH BAYESIAN DICTIONARY LEARNING Xinghao Ding 1, John Paisley 2, Yue Huang 1, Xianbo Chen 1, Feng Huang 3 and Xiao-ping Zhang 1,4 1 Department of Communications Engineering, Xiamen
More informationCentralized Sparse Representation Non-locally For Image Restoration
Centralized Sparse Representation Non-locally For Image Restoration More Manisha Sarjerao, Prof. Shivale Nitin 1 M.E.II, Department of COE, Jspm s BSIOTR, Wagholi, Pune, Maharashtra, India 2 Assistant
More informationImage Restoration via Multi-Prior Collaboration
Image Restoration via Multi-Prior Collaboration Feng Jiang 1, 2, Shengping Zhang 1, Debin Zhao 1 and S.Y. Kung 2 1 School of Computer Science, Harbin Institute of Technology 2 School of Electrical engineering,
More informationLocally Adaptive Learning for Translation-Variant MRF Image Priors
Locally Adaptive Learning for Translation-Variant MRF Image Priors Masayuki Tanaka and Masatoshi Okutomi Tokyo Institute of Technology 2-12-1 O-okayama, Meguro-ku, Tokyo, JAPAN mtanaka@ok.ctrl.titech.ac.p,
More informationSPARSE RECONSTRUCTION FOR DISPARITY MAPS USING COMBINED WAVELET AND CONTOURLET TRANSFORMS. Lee-kang Liu and Truong Nguyen
SPARSE RECONSTRUCTION FOR DISPARITY MAPS USING COMBINED WAVELET AND CONTOURLET TRANSFORMS Lee-kang Liu and Truong Nguyen University of California, San Diego Electrical and Computer Engineering http://videoprocessing.ucsd.edu
More informationarxiv: v1 [cs.cv] 11 Jul 2018
arxiv:1807.04364v1 [cs.cv] 11 Jul 2018 A Trilateral Weighted Sparse Coding Scheme for Real-World Image Denoising Jun Xu 1, Lei Zhang 1, David Zhang 1,2 1 The Hong Kong Polytechnic University, Hong Kong
More informationAdaptive Reconstruction Methods for Low-Dose Computed Tomography
Adaptive Reconstruction Methods for Low-Dose Computed Tomography Joseph Shtok Ph.D. supervisors: Prof. Michael Elad, Dr. Michael Zibulevsky. Technion IIT, Israel, 011 Ph.D. Talk, Apr. 01 Contents of this
More informationarxiv: v2 [cs.cv] 27 Jun 2017
Non-Convex Weighted l p Nuclear Norm based ADMM Framework for Image Restoration arxiv:1704.07056v2 [cs.cv] 27 Jun 2017 Zhiyuan Zha a, Xinggan Zhang a, Yu Wu a, Qiong Wang a, Lan Tang a,b a School of Electronic
More informationSurvey Paper on Different Approaches for Noise Level Estimation and Denoising of an Image
Survey Paper on Different Approaches for Noise Level Estimation and Denoising of an Image Bheem Prasad Ram 1, Sachi Choudhary 2 1 M. Tech. Scholar 1, Department of Computer Science and Engineering, School
More informationRecovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transform. Xintao Wang Ke Yu Chao Dong Chen Change Loy
Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transform Xintao Wang Ke Yu Chao Dong Chen Change Loy Problem enlarge 4 times Low-resolution image High-resolution image Previous
More informationAdaptive Reciprocal Cell based Sparse Representation for Satellite Image Restoration
Vol.49 (SoftTech 04),.8-85 htt://dx.doi.org/0.457/astl.04.49.50 Adative Recirocal Cell based Sarse Reresentation for Satellite Image Restoration Yanfei He and Shunfeng Wang Deartment of Math and Statistic,
More informationA Two-Step Image Inpainting Algorithm Using Tensor SVD
A Two-Step Image Inpainting Algorithm Using Tensor SVD Mrinmoy Ghorai 1, Bhabatosh Chanda 1 and Sekhar Mandal 2 1 Indian Statistical Institute, Kolkata 2 Indian Institute of Engineering Science and Technology,
More informationDepartment of Electronics and Communication KMP College of Engineering, Perumbavoor, Kerala, India 1 2
Vol.3, Issue 3, 2015, Page.1115-1021 Effect of Anti-Forensics and Dic.TV Method for Reducing Artifact in JPEG Decompression 1 Deepthy Mohan, 2 Sreejith.H 1 PG Scholar, 2 Assistant Professor Department
More informationNon-local Means for Stereo Image Denoising Using Structural Similarity
Non-local Means for Stereo Image Denoising Using Structural Similarity Monagi H. Alkinani and Mahmoud R. El-Sakka (B) Computer Science Department, University of Western Ontario, London, ON N6A 5B7, Canada
More informationGRID WARPING IN TOTAL VARIATION IMAGE ENHANCEMENT METHODS. Andrey Nasonov, and Andrey Krylov
GRID WARPING IN TOTAL VARIATION IMAGE ENHANCEMENT METHODS Andrey Nasonov, and Andrey Krylov Lomonosov Moscow State University, Moscow, Department of Computational Mathematics and Cybernetics, e-mail: nasonov@cs.msu.ru,
More informationThe Return of the Gating Network: Combining Generative Models and Discriminative Training in Natural Image Priors
The Return of the Gating Network: Combining Generative Models and Discriminative Training in Natural Image Priors Dan Rosenbaum School of Computer Science and Engineering Hebrew University of Jerusalem
More informationComputational Photography Denoising
Computational Photography Denoising Jongmin Baek CS 478 Lecture Feb 13, 2012 Announcements Term project proposal Due Wednesday Proposal presentation Next Wednesday Send us your slides (Keynote, PowerPoint,
More informationLimitations of Matrix Completion via Trace Norm Minimization
Limitations of Matrix Completion via Trace Norm Minimization ABSTRACT Xiaoxiao Shi Computer Science Department University of Illinois at Chicago xiaoxiao@cs.uic.edu In recent years, compressive sensing
More informationLearning Data Terms for Non-blind Deblurring
Learning Data Terms for Non-blind Deblurring Jiangxin Dong 1, Jinshan Pan 2, Deqing Sun 3, Zhixun Su 1,4, and Ming-Hsuan Yang 5 1 Dalian University of Technology dongjxjx@gmail.com, zxsu@dlut.edu.com 2
More informationColorization by Patch-Based Local Low-Rank Matrix Completion
Colorization by Patch-Based Local Low-Rank Matrix Completion Quang Yao James T. Kwok Department of Computer Science and Engineering Hong Kong University of Science and Technology Hong Kong {qyaoaa, jamesk}@cse.ust.hk
More informationImage Interpolation using Collaborative Filtering
Image Interpolation using Collaborative Filtering 1,2 Qiang Guo, 1,2,3 Caiming Zhang *1 School of Computer Science and Technology, Shandong Economic University, Jinan, 250014, China, qguo2010@gmail.com
More informationTRADITIONAL patch-based sparse coding has been
Bridge the Gap Between Group Sparse Coding and Rank Minimization via Adaptive Dictionary Learning Zhiyuan Zha, Xin Yuan, Senior Member, IEEE arxiv:709.03979v2 [cs.cv] 8 Nov 207 Abstract Both sparse coding
More informationImplementation of the Non-Local Bayes (NL-Bayes) Image Denoising Algorithm
2014/07/01 v0.5 IPOL article class Published in Image Processing On Line on 2013 06 17. Submitted on 2012 05 22, accepted on 2013 02 14. ISSN 2105 1232 c 2013 IPOL & the authors CC BY NC SA This article
More informationDeep Gaussian Conditional Random Field Network: A Model-based Deep Network for Discriminative Denoising
Deep Gaussian Conditional Random Field Network: A Model-based Deep Network for Discriminative Denoising Raviteja Vemulapalli Center for Automation Research, UMIACS University of Maryland, College Park
More informationExtended Dictionary Learning : Convolutional and Multiple Feature Spaces
Extended Dictionary Learning : Convolutional and Multiple Feature Spaces Konstantina Fotiadou, Greg Tsagkatakis & Panagiotis Tsakalides kfot@ics.forth.gr, greg@ics.forth.gr, tsakalid@ics.forth.gr ICS-
More informationThe Trainable Alternating Gradient Shrinkage method
The Trainable Alternating Gradient Shrinkage method Carlos Malanche, supervised by Ha Nguyen April 24, 2018 LIB (prof. Michael Unser), EPFL Quick example 1 The reconstruction problem Challenges in image
More informationBlock Matching and 3D Filtering for Image Denoising
www.ijemr.net ISSN (ONLINE): 50-0758, ISSN (PRINT): 394-696 Volume-5, Issue-, February-05 International Journal of Engineering and Management Research Page Number: 308-33 Block Matching and Filtering for
More informationIMA Preprint Series # 2281
DICTIONARY LEARNING AND SPARSE CODING FOR UNSUPERVISED CLUSTERING By Pablo Sprechmann and Guillermo Sapiro IMA Preprint Series # 2281 ( September 2009 ) INSTITUTE FOR MATHEMATICS AND ITS APPLICATIONS UNIVERSITY
More informationConnecting Image Denoising and High-Level Vision Tasks via Deep Learning
1 Connecting Image Denoising and High-Level Vision Tasks via Deep Learning Ding Liu, Student Member, IEEE, Bihan Wen, Student Member, IEEE, Jianbo Jiao, Student Member, IEEE, Xianming Liu, Zhangyang Wang,
More information