Thomas Abraham, PhD

Size: px
Start display at page:

Download "Thomas Abraham, PhD"

Transcription

1 Thomas Abraham, PhD

2 What is Deconvolution? Deconvolution, also termed as Restoration or Deblurring is an image processing technique used in a wide variety of fields from 1D spectroscopy to 3D biomedical imaging. It has been rigorously applied in the field of astronomy, because so much expense and time are spent in acquiring astronomical images. Raw Image Deconvolved

3 What makes an image? An image is produced by an instrument. It is not the same as the object but is some photocopy of the object. In mathematical terms, the image is the object convolved by the point spread function (PSF). Image = Object PSF Convolution The PSF describes what the instrument does to the object to produce an image.

4 Point Spread Function {PSF} Every lens element in the optical path alters the object (specimen) in some way. We call this the point spread function (PSF). The PSF of the system is a convolution of all of the PSF s of all the lens elements and apertures in the optical path.

5 Point Spread Function {PSF} For instance, an image of point source is not a point but a point spread in 3D space. Likewise, a macromolecular object can be considered as a large number of points arranged in 3D space. The image of that macromolecular object can be considered as the superposition of large number of points convolved with the PSF. Point Source Image

6 In mathematical terms, for each point, take the object and multiply it by the entire PSF centered at that point in the image and sum the results of the multiplication. Image(x,y,z) = Object(x,y,z )psf(xx,y-y,z-z )dx dy dz Convolution Theorem

7 Convolution Theorem Image = Object PSF Image(x,y,z) = Object(x,y,z )psf(xx,y-y,z-z )dx dy dz Whatever we record as the image intensity is the convoluted product of the PSF and the object intensity. Restoring the object intensity from the smear of PSF by some mathematical operations Deconvolution

8 The Fourier Transform From spatial domain to Frequency Domain Any image can be decomposed into a series of sine and cosine wave functions. i I(x) a i (cosk i x) ib i (sink i x) Amplitudes Phase

9 Fourier Transform of the elastin collagen fiber bundle in lung alveoli PSD FT Low frequency (Coarse structural details) High frequency (Fine structural details) Spatial Domain Frequency Domain Closely related to the diffraction pattern of the object

10 Fourier Transform, Examples Bad looking Vs Good Looking FT Dude (Big Labowski) FT Spatial Domain Frequency Domain

11 Fourier Transform, Examples Unidirectional Objects Vs Randomly Oriented Objects FT Frequency distribution is orthogonal FT Spatial Domain Frequency Domain

12 Fourier Transform, Examples Fine Vs Fuzzy Objects FFT FFT Spatial Domain Frequency Domain

13 Inverse Fourier Transform of the Fourier Transform Returns the original Image F -1 = A powerful mathematical tool for image processing

14 Deconvolution using Fourier Transformation F {Image} = F {Object PSF} It has been proved that the Fourier transform of the image is just the Fourier transform of object times the Fourier transform of the PSF in frequency domain F {Image} = F {Object} X F {PSF} So, to obtain the object, we simply divide Fourier transform of Image by the Fourier transform of the PSF F {Object} = F {Image} / F {PSF} This is known as Optical Transfer Function or OTF or CTF

15 By applying an inverse Fourier transform, We can restore object (specimen) Object (or sample) = F {Object} -1 Transforms back to spatial domain

16 Steps in Deconvolution Step 1: Acquire the image and obtain its Fourier transform Convoluted Image {Object PSF} Fourier Transform of Image

17 Steps in Deconvolution Step 2: Generate PSF and obtain its Fourier transform Point spread function Fourier transform of PSF

18 Steps in Deconvolution Step 3: Divide and inverse Fourier transform F -1 Object

19 Raw Image FT Deconvolved Image ( Restored Object) FT

20 F {Object} = F{Image} / F{PSF} OTF or CTF Object (or sample) = F.T. {Object} -1 Works perfectly if there is no noise in the image. But there is always noise

21 Various Sources of NOISE Photon (or shot) noise: Photon detection is a quantum mechanical event. So, it is subjected to random fluctuations (or random noise) which is governed by Poisson statistics. Electronic (thermal) noise: The light is detected electronically and all detectors have thermal noise. Bit noise: Digital images have noise due to the number of bits (~8-14) used during A/D conversion. Processing noise: The computer is operating on digital data with limited precision.

22 Relatively Noise Free Effect of noise in data Less Noise More Noise Each spatial frequency has an associated noise component resulting from various sources of the noise, and at high spatial frequencies (corresponds fine structural details) this can be very large.

23 Non-iterative Deconvolution F {Object} = F{Image} / F{PSF} OTF or CTF So simply dividing F{Image} by OTF will magnify noise components - this obscures real structural details. Alternate approach is to modify OTF (or CTF) on the basis of local signal levels Wiener filter.

24 Deconvolution using Wiener filter Here an extra noise dependent factor (K) is added to the OTF values, so that in noisy regions the divisor is larger, and the noisy components are not boosted. One major drawback here is that we don t actually know what is real signal and what is noise. This often results in rejecting genuinely real spatial information. Consequently the reconstructed image can be of lower resolution.

25

26

27

28 Deconvolution by Iteration 1) Take a guess at the object 2) Convolve guess (object) with the PSF. If PSF is unknown, guess the PSF too. 3) If blurred guess = image then stop iteration, otherwise refine guess. Richardson-Lucy algorithm (which includes Poisson Noise model) : This is also known as maximum likelihood approach.

29 xz plane A xy plane B C D E F Abraham et al. (2010) Micron

30 xz plane xy plane A B C Abraham et al. (2010) Micron

31 A B C D Abraham et al. (2010) Micron

32 Summary Imaging is a convolution of the object by the microscope s PSF and an image is a convoluted product of the object and PSF. Deconvolution attempts to restore the various spatial frequency components to something nearer what they were in the original object before being attenuated by the optical path.

33 Recommended Readings: Cannell, et al. (2006) Image Enhancement by Deconvolution, In Handbook of Biological Confocal Microscopy, Third Edition, Pawley, J. B, Ed., Springer Science + Business Media, LLC, New York Shaw, P. (1994) Deconvolution in 3-D optical microscopy, Histochemical Journal 26, Agard, D. A and Sedat, J. W. (1983) Three-dimensional architecture of a polythene nucleus. Nature 302, Sindelar, C.V and Grigorieff,N. (2011) An adaptation of the Wiener filter suitable for analyzing images of isolated single particles, J. Struct. Biol. 176, Sigworth, et al., (2010) An Introduction to Maximum-Likelihood Methods in Cryo-EM, Methods in Enzymology, Volume 482,

3. Image formation, Fourier analysis and CTF theory. Paula da Fonseca

3. Image formation, Fourier analysis and CTF theory. Paula da Fonseca 3. Image formation, Fourier analysis and CTF theory Paula da Fonseca EM course 2017 - Agenda - Overview of: Introduction to Fourier analysis o o o o Sine waves Fourier transform (simple examples of 1D

More information

Image restoration by deconvolution

Image restoration by deconvolution Image restoration by deconvolution chong.zhang@bioquant.uni-heidelberg.de 17/12/2014 (part) Slides courtesy: Sébastien Tosi (IRB Barcelona) A few concepts related to the topic Convolution Deconvolution

More information

Michael Moody School of Pharmacy University of London 29/39 Brunswick Square London WC1N 1AX, U.K.

Michael Moody School of Pharmacy University of London 29/39 Brunswick Square London WC1N 1AX, U.K. This material is provided for educational use only. The information in these slides including all data, images and related materials are the property of : Michael Moody School of Pharmacy University of

More information

Synthesis Imaging. Claire Chandler, Sanjay Bhatnagar NRAO/Socorro

Synthesis Imaging. Claire Chandler, Sanjay Bhatnagar NRAO/Socorro Synthesis Imaging Claire Chandler, Sanjay Bhatnagar NRAO/Socorro Michelson Summer Workshop Caltech, July 24-28, 2006 Synthesis Imaging 2 Based on the van Cittert-Zernike theorem: The complex visibility

More information

California at San Francisco, San Francisco, CA Howard Hughes Medical Institute. University, Princeton, NJ

California at San Francisco, San Francisco, CA Howard Hughes Medical Institute. University, Princeton, NJ A Parallel Product-Convolution approach for representing the depth Point Spread Function in 3D widefield microscopy based on principal component analysis Muthuvel Arigovindan 1, Joshua Shaevitz 2, John

More information

What should I know about the 3D Restoration module? Improvision Technical Note No. 142 Last updated: 28 June, 2000

What should I know about the 3D Restoration module? Improvision Technical Note No. 142 Last updated: 28 June, 2000 What should I know about the 3D Restoration module? Improvision Technical Note No. 142 Last updated: 28 June, 2000 Topic This technical note discusses some aspects of iterative deconvolution and how to

More information

University, Princeton, NJ-08544, USA.

University, Princeton, NJ-08544, USA. A Parallel Product-Convolution approach for representing depth varying Point Spread Functions in 3D widefield microscopy based on principal component analysis Muthuvel Arigovindan 1 *, Joshua Shaevitz

More information

Non-Blind Deblurring Using Partial Differential Equation Method

Non-Blind Deblurring Using Partial Differential Equation Method Volume Issue 3, 3-36, 013, ISSN: 319 8656 Non-Blind Deblurring Using Partial Differential Equation Method Devender Sharma CSE Department HCE,Sonepat, Puneet Sharma CSE Department HCE,Sonepat, Ritu Sharma

More information

Confocal vs. Deconvolution

Confocal vs. Deconvolution Confocal vs. Deconvolution Cesare Covino ALEMBIC Advanced Light and Electron Bio-Imaging Center Istituto Scientifico San Raffaele (Milano) www.hsr.it/research/alembic Fluorescence high contrast high sensibility

More information

Application of Proximal Algorithms to Three Dimensional Deconvolution Microscopy

Application of Proximal Algorithms to Three Dimensional Deconvolution Microscopy Application of Proximal Algorithms to Three Dimensional Deconvolution Microscopy Paroma Varma Stanford University paroma@stanford.edu Abstract In microscopy, shot noise dominates image formation, which

More information

BME I5000: Biomedical Imaging

BME I5000: Biomedical Imaging 1 Lucas Parra, CCNY BME I5000: Biomedical Imaging Lecture 11 Point Spread Function, Inverse Filtering, Wiener Filtering, Sharpening,... Lucas C. Parra, parra@ccny.cuny.edu Blackboard: http://cityonline.ccny.cuny.edu/

More information

Image Deconvolution.

Image Deconvolution. Image Deconvolution. Mathematics of Imaging. HW3 Jihwan Kim Abstract This homework is to implement image deconvolution methods, especially focused on a ExpectationMaximization(EM) algorithm. Most of this

More information

Conversion of evanescent waves into propagating waves by vibrating knife edge

Conversion of evanescent waves into propagating waves by vibrating knife edge 1 Conversion of evanescent waves into propagating waves by vibrating knife edge S. Samson, A. Korpel and H.S. Snyder Department of Electrical and Computer Engineering, 44 Engineering Bldg., The University

More information

CFIM MICROSCOPY COURSE TIMETABLE PRINCIPLES OF MICROSCOPY MONDAY 6 TH OF JANUARY 2014 FRIDAY 10 TH OF JANUARY 2014

CFIM MICROSCOPY COURSE TIMETABLE PRINCIPLES OF MICROSCOPY MONDAY 6 TH OF JANUARY 2014 FRIDAY 10 TH OF JANUARY 2014 MICROSCOPY COURSE TIMETABLE PRINCIPLES OF MICROSCOPY MONDAY 6 TH OF JANUARY 2014 FRIDAY 10 TH OF JANUARY 2014 CONFOCAL AND FLUORESCENCE MICROSCOPY MONDAY 20 TH OF JANUARY 2014 FRIDAY 24 TH OF JANUARY 2014

More information

A Wiener Filter Version of Blind Iterative Deconvolution

A Wiener Filter Version of Blind Iterative Deconvolution A Wiener Filter Version of Blind Iterative Deconvolution P. Nisenson, C.Standley, and D. Gay Harvard-Smithsonian Center for Astrophysics I. Introduction Over the last decade, great progress has been made

More information

Image restoration. Lecture 14. Milan Gavrilovic Centre for Image Analysis Uppsala University

Image restoration. Lecture 14. Milan Gavrilovic Centre for Image Analysis Uppsala University Image restoration Lecture 14 Milan Gavrilovic milan@cb.uu.se Centre for Image Analysis Uppsala University Computer Assisted Image Analysis 2009-05-08 M. Gavrilovic (Uppsala University) L14 Image restoration

More information

THREE-DIMENSIONA L ELECTRON MICROSCOP Y OF MACROMOLECULAR ASSEMBLIE S. Visualization of Biological Molecules in Their Native Stat e.

THREE-DIMENSIONA L ELECTRON MICROSCOP Y OF MACROMOLECULAR ASSEMBLIE S. Visualization of Biological Molecules in Their Native Stat e. THREE-DIMENSIONA L ELECTRON MICROSCOP Y OF MACROMOLECULAR ASSEMBLIE S Visualization of Biological Molecules in Their Native Stat e Joachim Frank CHAPTER 1 Introduction 1 1 The Electron Microscope and

More information

Evaluation of Deconvolution Methods for PRISM images

Evaluation of Deconvolution Methods for PRISM images Evaluation of Deconvolution Methods for PRISM images Peter Schwind, Gintautas Palubinskas, Tobias Storch, Rupert Müller Remote Sensing Technology Inst. (IMF) German Aerospace Center (DLR) November 2008,

More information

Computer Vision. Fourier Transform. 20 January Copyright by NHL Hogeschool and Van de Loosdrecht Machine Vision BV All rights reserved

Computer Vision. Fourier Transform. 20 January Copyright by NHL Hogeschool and Van de Loosdrecht Machine Vision BV All rights reserved Van de Loosdrecht Machine Vision Computer Vision Fourier Transform 20 January 2017 Copyright 2001 2017 by NHL Hogeschool and Van de Loosdrecht Machine Vision BV All rights reserved j.van.de.loosdrecht@nhl.nl,

More information

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror 1 Last month s Nobel Prize in Chemistry Awarded to Jacques Dubochet, Joachim Frank

More information

WHITE PAPER LIGHTNING IMAGE INFORMATION EXTRACTION BY ADAPTIVE DECONVOLUTION. LIGHTNING White Paper, September

WHITE PAPER LIGHTNING IMAGE INFORMATION EXTRACTION BY ADAPTIVE DECONVOLUTION. LIGHTNING White Paper, September WHITE PAPER LIGHTNING IMAGE INFORMATION EXTRACTION BY ADAPTIVE DECONVOLUTION LIGHTNING White Paper, September 2018 1 LIGHTNING Image Information Extraction Seeing more than just the Image Author: Jürgen

More information

Look Ahead to Get Ahead

Look Ahead to Get Ahead Microscopy from Carl Zeiss Archive 3D Deconvolution Z-stack 3D Deconvolution Look Ahead to Get Ahead Mark & Find Multichannel Timelapse Greater brilliance and resolution More convenient and precise than

More information

ALBERT-LUDWIG UNIVERSITY FREIBURG Institute of Computer Science Chair for Pattern Recognition and Image Processing

ALBERT-LUDWIG UNIVERSITY FREIBURG Institute of Computer Science Chair for Pattern Recognition and Image Processing ALBERT-LUDWIG UNIVERSITY FREIBURG Institute of Computer Science Chair for Pattern Recognition and Image Processing Multiview Deblurring for 3-D Images from Light Sheet based Fluorescence Microscopy - Supporting

More information

Bioimage Informatics

Bioimage Informatics Bioimage Informatics Lecture 10, Spring 2012 Bioimage Data Analysis (II): Applications of Point Feature Detection Techniques: Super Resolution Fluorescence Microscopy Bioimage Data Analysis (III): Edge

More information

Depth-variant blind restoration with pupil-phase constraints for 3D confocal microscopy

Depth-variant blind restoration with pupil-phase constraints for 3D confocal microscopy Journal of Physics: Conference Series OPEN ACCESS Depth-variant blind restoration with pupil-phase constraints for 3D confocal microscopy To cite this article: Saima Ben Hadj et al 2013 J. Phys.: Conf.

More information

3D image deconvolution in light microscopy: theory and practice.

3D image deconvolution in light microscopy: theory and practice. 3D image deconvolution in light microscopy: theory and practice. by Johan Philip and Kjell Carlsson Royal Institute of Technology, 10044 Stockholm, Sweden. Abstract: The objective of this study is to investigate

More information

f(x,y) is the original image H is the degradation process (or function) n(x,y) represents noise g(x,y) is the obtained degraded image p q

f(x,y) is the original image H is the degradation process (or function) n(x,y) represents noise g(x,y) is the obtained degraded image p q Image Restoration Image Restoration G&W Chapter 5 5.1 The Degradation Model 5.2 5.105.10 browse through the contents 5.11 Geometric Transformations Goal: Reconstruct an image that has been degraded in

More information

Deconvolution of 3D Fluorescence Microscopy Images by Combining the Filtered Gerchberg-Papoulis and Richardson-Lucy Algorithms

Deconvolution of 3D Fluorescence Microscopy Images by Combining the Filtered Gerchberg-Papoulis and Richardson-Lucy Algorithms Deconvolution of 3D Fluorescence Microscopy Images by Combining the Filtered Gerchberg-Papoulis and Richardson-Lucy Algorithms Moacir P. Ponti-Junior Nelson D.A. Mascarenhas Marcelo R. Zorzan Claudio A.T.

More information

Multi-frame blind deconvolution: Compact and multi-channel versions. Douglas A. Hope and Stuart M. Jefferies

Multi-frame blind deconvolution: Compact and multi-channel versions. Douglas A. Hope and Stuart M. Jefferies Multi-frame blind deconvolution: Compact and multi-channel versions Douglas A. Hope and Stuart M. Jefferies Institute for Astronomy, University of Hawaii, 34 Ohia Ku Street, Pualani, HI 96768, USA ABSTRACT

More information

Coding and Modulation in Cameras

Coding and Modulation in Cameras Mitsubishi Electric Research Laboratories Raskar 2007 Coding and Modulation in Cameras Ramesh Raskar with Ashok Veeraraghavan, Amit Agrawal, Jack Tumblin, Ankit Mohan Mitsubishi Electric Research Labs

More information

Fundamentals of Digital Image Processing

Fundamentals of Digital Image Processing \L\.6 Gw.i Fundamentals of Digital Image Processing A Practical Approach with Examples in Matlab Chris Solomon School of Physical Sciences, University of Kent, Canterbury, UK Toby Breckon School of Engineering,

More information

Cover Page. The handle holds various files of this Leiden University dissertation

Cover Page. The handle   holds various files of this Leiden University dissertation Cover Page The handle http://hdl.handle.net/1887/48877 holds various files of this Leiden University dissertation Author: Li, Y. Title: A new method to reconstruct the structure from crystal images Issue

More information

Biophysical Techniques (BPHS 4090/PHYS 5800)

Biophysical Techniques (BPHS 4090/PHYS 5800) Biophysical Techniques (BPHS 4090/PHYS 5800) Instructors: Prof. Christopher Bergevin (cberge@yorku.ca) Schedule: MWF 1:30-2:30 (CB 122) Website: http://www.yorku.ca/cberge/4090w2017.html York University

More information

High-resolution imaging by multiple-image deconvolution

High-resolution imaging by multiple-image deconvolution High-resolution imaging by multiple-image deconvolution M. Bertero, P.Boccacci, G. Desiderà, and G. Vicidomini DISI, Università di Genova, Via Dodecaneso 35, I-16146, Genova, Italy Abstract. Image deconvolution

More information

Blind deconvolution in optical diffusion tomography

Blind deconvolution in optical diffusion tomography Blind deconvolution in optical diffusion tomography Stuart M. Jefferies Maui Scientific Research Center, University of New Mexico, 590 Lipoa Parkway, Kihei, HI 96753 stuartj@ahpcc.unm.edu Kathy J. Schulze

More information

Imaging and Deconvolution

Imaging and Deconvolution Imaging and Deconvolution Urvashi Rau National Radio Astronomy Observatory, Socorro, NM, USA The van-cittert Zernike theorem Ei E V ij u, v = I l, m e sky j 2 i ul vm dldm 2D Fourier transform : Image

More information

TN425: A study of fluorescence standards confirms that OptiGrid confocal images are suitable for quantitative microscopy

TN425: A study of fluorescence standards confirms that OptiGrid confocal images are suitable for quantitative microscopy TN425: A study of fluorescence standards confirms that OptiGrid confocal images are suitable for quantitative microscopy Introduction The OptiGrid converts the illumination system of a conventional wide

More information

STREAMING ALGORITHMS. Tamás Budavári / Johns Hopkins University ANALYSIS OF ASTRONOMY IMAGES & CATALOGS 10/26/2015

STREAMING ALGORITHMS. Tamás Budavári / Johns Hopkins University ANALYSIS OF ASTRONOMY IMAGES & CATALOGS 10/26/2015 STREAMING ALGORITHMS ANALYSIS OF ASTRONOMY IMAGES & CATALOGS 10/26/2015 / Johns Hopkins University Astronomy Changed! Always been data-driven But we used to know the sources by heart! Today large collections

More information

Image Restoration. Diffusion Denoising Deconvolution Super-resolution Tomographic Reconstruction

Image Restoration. Diffusion Denoising Deconvolution Super-resolution Tomographic Reconstruction Image Restoration Image Restoration Diffusion Denoising Deconvolution Super-resolution Tomographic Reconstruction Diffusion Term Consider only the regularization term E-L equation: (Laplace equation) Steepest

More information

Introductory Guide to Light Microscopy - Biomedical Confocal Microscopy

Introductory Guide to Light Microscopy - Biomedical Confocal Microscopy Introductory Guide to Light Microscopy - Biomedical Confocal Microscopy 7 May 2007 Michael Hooker Microscopy Facility Michael Chua microscopy@unc.edu 843-3268 6007 Thurston Bowles Wendy Salmon wendy_salmon@med.unc.edu

More information

Fourier, Fresnel and Image CGHs of three-dimensional objects observed from many different projections

Fourier, Fresnel and Image CGHs of three-dimensional objects observed from many different projections Fourier, Fresnel and Image CGHs of three-dimensional objects observed from many different projections David Abookasis and Joseph Rosen Ben-Gurion University of the Negev Department of Electrical and Computer

More information

Principles of Light Microscopy

Principles of Light Microscopy Monday 8 August 2011 Principles of Light Microscopy 09:00 09:30 Introduction 09:30 10:15 The story of the microscope / 10:15 Coffee 10:30 12:45 Limitations of the eye. Resolution, contrast, magnification.

More information

Presentation and analysis of multidimensional data sets

Presentation and analysis of multidimensional data sets Presentation and analysis of multidimensional data sets Overview 1. 3D data visualisation Multidimensional images Data pre-processing Visualisation methods Multidimensional images wavelength time 3D image

More information

3-D. Here red spheres show the location of gold nanoparticles inside/around a cell nucleus.

3-D. Here red spheres show the location of gold nanoparticles inside/around a cell nucleus. 3-D The CytoViva 3-D System allows the user can locate objects of interest in a 3-D space. It does this by acquiring multiple Z planes and performing our custom software routines to locate and observe

More information

Supporting Information for Azimuthal Polarization Filtering for Accurate, Precise, and Robust Single-Molecule Localization Microscopy

Supporting Information for Azimuthal Polarization Filtering for Accurate, Precise, and Robust Single-Molecule Localization Microscopy Nano Letters Supporting Information for Azimuthal Polarization Filtering for Accurate, Precise, and Robust Single-Molecule Localization Microscopy Matthew D. Lew, and W. E. Moerner *, Departments of Chemistry

More information

Introduction to Cryo Electron Microscopy/Tomography

Introduction to Cryo Electron Microscopy/Tomography Introduction to Cryo Electron Microscopy/Tomography Ricardo Miguel Sánchez Loayza Max Planck Institute for Biophysics - Kudryashev Group Goethe Universität - Visual Sensorics and Information Processing

More information

x' = c 1 x + c 2 y + c 3 xy + c 4 y' = c 5 x + c 6 y + c 7 xy + c 8

x' = c 1 x + c 2 y + c 3 xy + c 4 y' = c 5 x + c 6 y + c 7 xy + c 8 1. Explain about gray level interpolation. The distortion correction equations yield non integer values for x' and y'. Because the distorted image g is digital, its pixel values are defined only at integer

More information

Computer Vision and Graphics (ee2031) Digital Image Processing I

Computer Vision and Graphics (ee2031) Digital Image Processing I Computer Vision and Graphics (ee203) Digital Image Processing I Dr John Collomosse J.Collomosse@surrey.ac.uk Centre for Vision, Speech and Signal Processing University of Surrey Learning Outcomes After

More information

Lens Design I. Lecture 11: Imaging Herbert Gross. Summer term

Lens Design I. Lecture 11: Imaging Herbert Gross. Summer term Lens Design I Lecture 11: Imaging 2015-06-29 Herbert Gross Summer term 2015 www.iap.uni-jena.de 2 Preliminary Schedule 1 13.04. Basics 2 20.04. Properties of optical systrems I 3 27.05. 4 04.05. Properties

More information

Wavelet-Based Superresolution in Astronomy

Wavelet-Based Superresolution in Astronomy Wavelet-Based Superresolution in Astronomy Rebecca Willet, Ian Jermyn, Robert Nowak, and Josiana Zerubia March 18, 2004 Abstract High-resolution astronomical images can be reconstructed from several blurred

More information

Fourier transforms and convolution

Fourier transforms and convolution Fourier transforms and convolution (without the agonizing pain) CS/CME/BioE/Biophys/BMI 279 Oct. 26, 2017 Ron Dror 1 Why do we care? Fourier transforms Outline Writing functions as sums of sinusoids The

More information

Wavelet-Based Superresolution in Astronomy

Wavelet-Based Superresolution in Astronomy ADASS XIII ASP Conference Series, Vol. XXX, 2004 F. Ochsenbein, M. Allen and D. Egret eds. Wavelet-Based Superresolution in Astronomy Rebecca Willett, Robert Nowak Rice University Department of Electrical

More information

Motion Blur Image Fusion Using Discrete Wavelate Transformation

Motion Blur Image Fusion Using Discrete Wavelate Transformation Motion Blur Image Fusion Using Discrete Wavelate Transformation Er. Shabina Sayed Department Of Information Technology, MHSS COE, Mumbai, India Abstract The methodology for implementing a fusion system

More information

Theoretically Perfect Sensor

Theoretically Perfect Sensor Sampling 1/67 Sampling The ray tracer samples the geometry, only gathering information from the parts of the world that interact with a finite number of rays In contrast, a scanline renderer can push all

More information

3D Reconstruction in EM

3D Reconstruction in EM 3D Reconstruction in EM C.O.S. Sorzano Biocomputing Unit, CNB-CSIC Instruct Image Processing Center Contents Initial volume Angular assignment 3D Reconstruction 3D Classification Resolution Amplitude correction

More information

University of Lübeck, Medical Laser Center Lübeck GmbH Optical Coherence Tomography

University of Lübeck, Medical Laser Center Lübeck GmbH Optical Coherence Tomography University of Lübeck, Medical Laser Center Lübeck GmbH Optical Coherence Tomography. Theory Dr. Gereon Hüttmann / 009 What is OCT? ( for the MD ) Lichtquelle Probe Detektor Display OCT is Ultrasound with

More information

Physics I : Oscillations and Waves Prof. S Bharadwaj Department of Physics & Meteorology Indian Institute of Technology, Kharagpur

Physics I : Oscillations and Waves Prof. S Bharadwaj Department of Physics & Meteorology Indian Institute of Technology, Kharagpur Physics I : Oscillations and Waves Prof. S Bharadwaj Department of Physics & Meteorology Indian Institute of Technology, Kharagpur Lecture - 20 Diffraction - I We have been discussing interference, the

More information

Iterative procedure for in-situ EUV optical testing with an incoherent source

Iterative procedure for in-situ EUV optical testing with an incoherent source APS/123-QED Iterative procedure for in-situ EUV optical testing with an incoherent source Ryan Miyakawa and Patrick Naulleau Lawrence Berkeley National Laboratory, Berkeley, CA 94720 Avideh Zakhor Dept.

More information

Central Slice Theorem

Central Slice Theorem Central Slice Theorem Incident X-rays y f(x,y) R x r x Detected p(, x ) The thick line is described by xcos +ysin =R Properties of Fourier Transform F [ f ( x a)] F [ f ( x)] e j 2 a Spatial Domain Spatial

More information

From cryo-em images of protein complexes to high-resolution 3D structures

From cryo-em images of protein complexes to high-resolution 3D structures From cryo-em images of protein complexes to high-resolution 3D structures Rouslan Efremov www.cryo-em.be 2018/01/23 Gent What you should do in order for us to make more rapid progress is to make the electron

More information

Theoretically Perfect Sensor

Theoretically Perfect Sensor Sampling 1/60 Sampling The ray tracer samples the geometry, only gathering information from the parts of the world that interact with a finite number of rays In contrast, a scanline renderer can push all

More information

OSKAR: Simulating data from the SKA

OSKAR: Simulating data from the SKA OSKAR: Simulating data from the SKA Oxford e-research Centre, 4 June 2014 Fred Dulwich, Ben Mort, Stef Salvini 1 Overview Simulating interferometer data for SKA: Radio interferometry basics. Measurement

More information

STUDY ON THE METHODS OF SUPER-RESOLUTION IMAGE RECONSTRUCTION

STUDY ON THE METHODS OF SUPER-RESOLUTION IMAGE RECONSTRUCTION STUDY ON THE METHODS OF SUPER-RESOLUTION IMAGE RECONSTRUCTION H.Y.LIU, Y.S.ZHANG, Song JI Zhengzhou Institute of Surveying and Mapping, 66 Longhai Road, Zhengzhou 450052, China - lhy2007lx@yahoo.com.cn

More information

Optical Ptychography Imaging

Optical Ptychography Imaging Optical Ptychography Imaging Summer Project Annafee Azad Supervisors: Dr Fucai Zhang Prof Ian Robinson Summer 2014 23 October 2014 Optical Ptychography Imaging P a g e 2 Abstract This report details a

More information

MICROTUBULE FILAMENT TRACING AND ESTIMATION. Rohan Chabukswar. Department of Electrical and Computer Engineering Carnegie Mellon University

MICROTUBULE FILAMENT TRACING AND ESTIMATION. Rohan Chabukswar. Department of Electrical and Computer Engineering Carnegie Mellon University MICROTUBULE FILAMENT TRACING AND ESTIMATION Rohan Chabukswar Department of Electrical and Computer Engineering Carnegie Mellon University ABSTRACT The project explores preprocessing of images to facilitate

More information

284 IEEE TRANSACTIONS ON NANOBIOSCIENCE, VOL. 7, NO. 4, DECEMBER An antigen is a substance that stimulates an immune response, especially the

284 IEEE TRANSACTIONS ON NANOBIOSCIENCE, VOL. 7, NO. 4, DECEMBER An antigen is a substance that stimulates an immune response, especially the 284 IEEE TRANSACTIONS ON NANOBIOSCIENCE, VOL. 7, NO. 4, DECEMBER 2008 Estimating Locations of Quantum-Dot-Encoded Microparticles From Ultra-High Density 3-D Microarrays Pinaki Sarder*, Student Member,

More information

Implementing Efficient iterative 3D Deconvolution for Microscopy

Implementing Efficient iterative 3D Deconvolution for Microscopy Thesis no. MEE09:40 Implementing Efficient iterative 3D Deconvolution for Microscopy Ahmed Shah Mehadi This thesis is presented as part of Degree of Master of Science in Electrical Engineering Blekinge

More information

Deconvolution algorithms of 2D Transmission - Electron Microscopy images YATING YU TING MENG

Deconvolution algorithms of 2D Transmission - Electron Microscopy images YATING YU TING MENG Deconvolution algorithms of 2D Transmission - Electron Microscopy images YATING YU TING MENG Master of Science Thesis Stockholm, Sweden 2012 Deconvolution algorithms of 2D Transmission Electron Microscopy

More information

29. Diffraction of waves

29. Diffraction of waves 29. Diffraction of waves Light bends! Diffraction assumptions The Kirchhoff diffraction integral Fresnel Diffraction diffraction from a slit Diffraction Light does not always travel in a straight line.

More information

Single Particle Reconstruction Techniques

Single Particle Reconstruction Techniques T H E U N I V E R S I T Y of T E X A S S C H O O L O F H E A L T H I N F O R M A T I O N S C I E N C E S A T H O U S T O N Single Particle Reconstruction Techniques For students of HI 6001-125 Computational

More information

ADVANCED IMAGE PROCESSING METHODS FOR ULTRASONIC NDE RESEARCH C. H. Chen, University of Massachusetts Dartmouth, N.

ADVANCED IMAGE PROCESSING METHODS FOR ULTRASONIC NDE RESEARCH C. H. Chen, University of Massachusetts Dartmouth, N. ADVANCED IMAGE PROCESSING METHODS FOR ULTRASONIC NDE RESEARCH C. H. Chen, University of Massachusetts Dartmouth, N. Dartmouth, MA USA Abstract: The significant progress in ultrasonic NDE systems has now

More information

Extracting Wavefront Error From Shack-Hartmann Images Using Spatial Demodulation

Extracting Wavefront Error From Shack-Hartmann Images Using Spatial Demodulation Etracting Wavefront Error From Shack-Hartmann Images Using Spatial Demodulation Edwin J. Sarver, PhD; Jim Schwiegerling, PhD; Raymond A. Applegate, OD, PhD ABSTRACT PURPOSE: To determine whether the spatial

More information

3DEM > GENERAL METHODS. SINGLE PARTICLE RECONSTRUCTION (SPA): Introduction

3DEM > GENERAL METHODS. SINGLE PARTICLE RECONSTRUCTION (SPA): Introduction 3DEM > GENERAL METHODS SINGLE PARTICLE RECONSTRUCTION (SPA): Introduction SINGLE PARTICLE RECONSTRUCTION > INTRODUCTION General principle of single particle reconstruction o 2D projection images of a 3D

More information

Chapter 4 Microscopy

Chapter 4 Microscopy Chapter 4 Microscopy Gabriel Popescu University of Illinois at Urbana Champaign Beckman Institute Quantitative Light Imaging Laboratory http://light.ece.uiuc.edu Principles of Optical Imaging Electrical

More information

Some Blind Deconvolution Techniques in Image Processing

Some Blind Deconvolution Techniques in Image Processing Some Blind Deconvolution Techniques in Image Processing Tony Chan Math Dept., UCLA Joint work with Frederick Park and Andy M. Yip IPAM Workshop on Mathematical Challenges in Astronomical Imaging July 26-30,

More information

Image Restoration by Revised Bayesian-Based Iterative Method

Image Restoration by Revised Bayesian-Based Iterative Method ADVCOMP 2011 : The Fifth International Conference on Advanced Engineering Computing and Applications in Sciences Image Restoration by Revised Bayesian-Based Iterative Method Sigeru Omatu, Hideo Araki Osaka

More information

II: Single particle cryoem - an averaging technique

II: Single particle cryoem - an averaging technique II: Single particle cryoem - an averaging technique Radiation damage limits the total electron dose that can be used to image biological sample. Thus, images of frozen hydrated macromolecules are very

More information

PROJECTED BARZILAI-BORWEIN METHOD WITH INFEASIBLE ITERATES FOR NONNEGATIVE IMAGE DECONVOLUTION

PROJECTED BARZILAI-BORWEIN METHOD WITH INFEASIBLE ITERATES FOR NONNEGATIVE IMAGE DECONVOLUTION PROJECTED BARZILAI-BORWEIN METHOD WITH INFEASIBLE ITERATES FOR NONNEGATIVE IMAGE DECONVOLUTION by Kathleen Fraser Submitted in partial fulfillment of the requirements for the degree of Master of Computer

More information

OPTI-521 Graduate Report 2 Matthew Risi Tutorial: Introduction to imaging, and estimate of image quality degradation from optical surfaces

OPTI-521 Graduate Report 2 Matthew Risi Tutorial: Introduction to imaging, and estimate of image quality degradation from optical surfaces OPTI-521 Graduate Report 2 Matthew Risi Tutorial: Introduction to imaging, and estimate of image quality degradation from optical surfaces Abstract The purpose of this tutorial is to introduce the concept

More information

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror 1 Last month s Nobel Prize in Chemistry Awarded to Jacques Dubochet, Joachim Frank

More information

LAGRANGIAN PARTICLE TRACKING IN ISOTROPIC TURBULENT FLOW VIA HOLOGRAPHIC AND INTENSITY BASED STEREOSCOPY. By Kamran Arjomand

LAGRANGIAN PARTICLE TRACKING IN ISOTROPIC TURBULENT FLOW VIA HOLOGRAPHIC AND INTENSITY BASED STEREOSCOPY. By Kamran Arjomand LAGRANGIAN PARTICLE TRACKING IN ISOTROPIC TURBULENT FLOW VIA HOLOGRAPHIC AND INTENSITY BASED STEREOSCOPY By Kamran Arjomand I. Background A. Holographic Imaging 1. Acquire Hologram 3. Numerical Reconstruction

More information

You, too, can make useful and beautiful astronomical images at Mees: Lesson 4

You, too, can make useful and beautiful astronomical images at Mees: Lesson 4 You, too, can make useful and beautiful astronomical images at Mees: Lesson 4 Sharpening, stretching, scaling and color-combining Useful references, besides Lessons 1-3: Rob Gendler (ed.) 2013, Lessons

More information

Unfolding Methods. Alberto Rotondi Università di Pavia

Unfolding Methods. Alberto Rotondi Università di Pavia Unfolding Methods Alberto Rotondi Università di Pavia 1 Folding is a common process in physics signal Apparatus response Observed signal x f ( x) ( x, y) g( y) f ( x) ( x, y) dx 2 Convolution is a linear

More information

ACCELERATION OF IMAGE RESTORATION ALGORITHMS FOR DYNAMIC MEASUREMENTS IN COORDINATE METROLOGY BY USING OPENCV GPU FRAMEWORK

ACCELERATION OF IMAGE RESTORATION ALGORITHMS FOR DYNAMIC MEASUREMENTS IN COORDINATE METROLOGY BY USING OPENCV GPU FRAMEWORK URN (Paper): urn:nbn:de:gbv:ilm1-2014iwk-140:6 58 th ILMENAU SCIENTIFIC COLLOQUIUM Technische Universität Ilmenau, 08 12 September 2014 URN: urn:nbn:de:gbv:ilm1-2014iwk:3 ACCELERATION OF IMAGE RESTORATION

More information

Fourier Transforms. Laboratory & Computational Physics 2

Fourier Transforms. Laboratory & Computational Physics 2 Fourier Transforms Laboratory & Computational Physics 2 Last compiled August 8, 2017 1 Contents 1 Introduction 3 1.1 Prelab questions................................ 3 2 Background theory 5 2.1 Physical

More information

Basic optics. Geometrical optics and images Interference Diffraction Diffraction integral. we use simple models that say a lot! more rigorous approach

Basic optics. Geometrical optics and images Interference Diffraction Diffraction integral. we use simple models that say a lot! more rigorous approach Basic optics Geometrical optics and images Interference Diffraction Diffraction integral we use simple models that say a lot! more rigorous approach Basic optics Geometrical optics and images Interference

More information

Image Alignment and Application of 2D Fast Rotational Matching in Single Particle cryo-electron Microscopy. Yao Cong. Baylor College of Medicine

Image Alignment and Application of 2D Fast Rotational Matching in Single Particle cryo-electron Microscopy. Yao Cong. Baylor College of Medicine Image Alignment and Application of 2D Fast Rotational Matching in Single Particle cryo-electron Microscopy Yao Cong Baylor College of Medicine cryo-em & single particle analysis Single-particle electron

More information

Image Processing. Traitement d images. Yuliya Tarabalka Tel.

Image Processing. Traitement d images. Yuliya Tarabalka  Tel. Traitement d images Yuliya Tarabalka yuliya.tarabalka@hyperinet.eu yuliya.tarabalka@gipsa-lab.grenoble-inp.fr Tel. 04 76 82 62 68 Noise reduction Image restoration Restoration attempts to reconstruct an

More information

Lecture Notes on Wave Optics (04/23/14) 2.71/2.710 Introduction to Optics Nick Fang

Lecture Notes on Wave Optics (04/23/14) 2.71/2.710 Introduction to Optics Nick Fang .7/.70 Introduction to Optics Nic Fang Outline: Fresnel Diffraction The Depth of Focus and Depth of Field(DOF) Fresnel Zones and Zone Plates Holography A. Fresnel Diffraction For the general diffraction

More information

Biomedical Image Analysis. Homomorphic Filtering and applications to PET

Biomedical Image Analysis. Homomorphic Filtering and applications to PET Biomedical Image Analysis Homomorphic Filtering and applications to PET Contents: Image enhancement and correction Brightness normalization and contrast enhancement Applications to SPECT BMIA 15 V. Roth

More information

Image Processing. Filtering. Slide 1

Image Processing. Filtering. Slide 1 Image Processing Filtering Slide 1 Preliminary Image generation Original Noise Image restoration Result Slide 2 Preliminary Classic application: denoising However: Denoising is much more than a simple

More information

Digital Image Processing. Image Enhancement in the Frequency Domain

Digital Image Processing. Image Enhancement in the Frequency Domain Digital Image Processing Image Enhancement in the Frequency Domain Topics Frequency Domain Enhancements Fourier Transform Convolution High Pass Filtering in Frequency Domain Low Pass Filtering in Frequency

More information

Image Sampling & Quantisation

Image Sampling & Quantisation Image Sampling & Quantisation Biomedical Image Analysis Prof. Dr. Philippe Cattin MIAC, University of Basel Contents 1 Motivation 2 Sampling Introduction and Motivation Sampling Example Quantisation Example

More information

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier Computer Vision 2 SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung Computer Vision 2 Dr. Benjamin Guthier 1. IMAGE PROCESSING Computer Vision 2 Dr. Benjamin Guthier Content of this Chapter Non-linear

More information

Introduction to Inverse Problems

Introduction to Inverse Problems Introduction to Inverse Problems What is an image? Attributes and Representations Forward vs Inverse Optical Imaging as Inverse Problem Incoherent and Coherent limits Dimensional mismatch: continuous vs

More information

WEINER FILTER AND SUB-BLOCK DECOMPOSITION BASED IMAGE RESTORATION FOR MEDICAL APPLICATIONS

WEINER FILTER AND SUB-BLOCK DECOMPOSITION BASED IMAGE RESTORATION FOR MEDICAL APPLICATIONS WEINER FILTER AND SUB-BLOCK DECOMPOSITION BASED IMAGE RESTORATION FOR MEDICAL APPLICATIONS ARIFA SULTANA 1 & KANDARPA KUMAR SARMA 2 1,2 Department of Electronics and Communication Engineering, Gauhati

More information

Blind Deconvolution of Widefield Fluorescence Microscopic Data by Regularization of the Optical Transfer Function (OTF)

Blind Deconvolution of Widefield Fluorescence Microscopic Data by Regularization of the Optical Transfer Function (OTF) Blind Deconvolution of Widefield Fluorescence Microscopic Data by Regularization of the Optical Transfer Function OTF Margret Keuper 1, Thorsten Schmidt 1, Maja Temerinac-Ott 1, Jan Padeken 2, Patrick

More information

Advanced phase retrieval: maximum likelihood technique with sparse regularization of phase and amplitude

Advanced phase retrieval: maximum likelihood technique with sparse regularization of phase and amplitude Advanced phase retrieval: maximum likelihood technique with sparse regularization of phase and amplitude A. Migukin *, V. atkovnik and J. Astola Department of Signal Processing, Tampere University of Technology,

More information

Fourier analysis and sampling theory

Fourier analysis and sampling theory Reading Required: Shirley, Ch. 9 Recommended: Fourier analysis and sampling theory Ron Bracewell, The Fourier Transform and Its Applications, McGraw-Hill. Don P. Mitchell and Arun N. Netravali, Reconstruction

More information

Preparatory School to the Winter College on Optics in Imaging Science January Selected Topics of Fourier Optics Tutorial

Preparatory School to the Winter College on Optics in Imaging Science January Selected Topics of Fourier Optics Tutorial 2222-11 Preparatory School to the Winter College on Optics in Imaging Science 24-28 January 2011 Selected Topics of Fourier Optics Tutorial William T. Rhodes Florida Atlantic University Boca Raton USA

More information