Effect of OTF attenuation on single-slice SR-SIM reconstruction

Similar documents
DeltaVision OMX SR super-resolution microscope. Super-resolution doesn t need to be complicated

COLOCALISATION. Alexia Loynton-Ferrand. Imaging Core Facility Biozentrum Basel

COLOCALISATION. Alexia Ferrand. Imaging Core Facility Biozentrum Basel

Supplementary Figure 1

Optical Sectioning. Bo Huang. Pharmaceutical Chemistry

A SUPER-RESOLUTION MICROSCOPY WITH STANDING EVANESCENT LIGHT AND IMAGE RECONSTRUCTION METHOD

Transmitted light Illuminator VIS-LED, color temperature. Epifluorescence lamp module X-Cite 120PC Q (Excelitas

Faster STORM using compressed sensing. Supplementary Software. Nature Methods. Nature Methods: doi: /nmeth.1978

SUPPLEMENTARY INFORMATION

Super-Resolved Spatial Light Interference Microscopy

Swammerdam Institute for Life Sciences (Universiteit van Amsterdam), 1098 XH Amsterdam, The Netherland

An Intuitive Explanation of Fourier Theory

9 Super-Resolution Microscopy: Interference and Pattern Techniques

3. Image formation, Fourier analysis and CTF theory. Paula da Fonseca

45 µm polystyrene bead embedded in scattering tissue phantom. (a,b) raw images under oblique

BME I5000: Biomedical Imaging

A method and algorithm for Tomographic Imaging of highly porous specimen using Low Frequency Acoustic/Ultrasonic signals

PH880 Topics in Physics

BME I5000: Biomedical Imaging

Hyperspectral Remote Sensing

Advanced phase retrieval: maximum likelihood technique with sparse regularization of phase and amplitude

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror

SUPPLEMENTARY INFORMATION

Hyperspectral interferometry for single-shot absolute measurement of 3-D shape and displacement fields

APPROACHES IN QUANTITATIVE, MULTI-DIMENSIONAL MICROSCOPY

Limits of computational white-light holography

Biological Image Information I: A Description of the Modalities

Image Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi

Central Slice Theorem

Zeiss Universal SIM. A structured illumination system based on a Zeiss Universal microscope stand. by Nidhogg

Plane Wave Imaging Using Phased Array Arno Volker 1

SPATIAL DENSITY ESTIMATION BASED SEGMENTATION OF SUPER-RESOLUTION LOCALIZATION MICROSCOPY IMAGES

Reduction of reconstructed particle elongation using iterative min-max filtering in holographic particle image velocimetry

Computer Graphics. Sampling Theory & Anti-Aliasing. Philipp Slusallek

Digital correlation hologram implemented on optical correlator

Live-cell 3D super-resolution imaging in thick biological samples

Lateral superresolution using a posteriori phase shift estimation for a moving object: experimental results

Supplementary Materials for

Supplementary Information

P recise Eye. High resolution, diffraction-limited f/4.5 optical quality for high precision measurement and inspection.

SUPPLEMENTARY INFORMATION

Chuang, Chin-Jung (2011) Proximity projection grating structured illumination microscopy. PhD thesis, University of Nottingham.

FMA901F: Machine Learning Lecture 3: Linear Models for Regression. Cristian Sminchisescu

Reconstruction of Images Distorted by Water Waves

Leica TCS STED CW. The Fast Track to Superresolution. Leica TCS STED CW

Vutara 350. Innovation with Integrity. The Fastest, Super-Resolution Microscope Deep 3D Imaging on Live Cells, Quickly and Easily

Edge detection. Convert a 2D image into a set of curves. Extracts salient features of the scene More compact than pixels

Adaptive Waveform Inversion: Theory Mike Warner*, Imperial College London, and Lluís Guasch, Sub Salt Solutions Limited

X-ray tomography. X-ray tomography. Applications in Science. X-Rays. Notes. Notes. Notes. Notes

Computer Vision. Fourier Transform. 20 January Copyright by NHL Hogeschool and Van de Loosdrecht Machine Vision BV All rights reserved

Bioimage Informatics. Lecture 8, Spring Bioimage Data Analysis (II): Point Feature Detection

Confocal vs. Deconvolution

Multi-frame blind deconvolution: Compact and multi-channel versions. Douglas A. Hope and Stuart M. Jefferies

MetaMorph Super-Resolution Software. Localization-based super-resolution microscopy

Convolution Product. Change of wave shape as a result of passing through a linear filter

HOLOEYE Photonics. HOLOEYE Photonics AG. HOLOEYE Corporation

LSM 5 MP, LSM 510 and LSM 510 META Laser Scanning Microscopes

3-D. Here red spheres show the location of gold nanoparticles inside/around a cell nucleus.

Cluster Analysis of Super Resolution Fluorescence Images Ki Woong Sung

Supporting Information. Super Resolution Imaging of Nanoparticles Cellular Uptake and Trafficking

Regularization parameter estimation for non-negative hyperspectral image deconvolution:supplementary material

Michael Moody School of Pharmacy University of London 29/39 Brunswick Square London WC1N 1AX, U.K.

MetroPro Surface Texture Parameters

BioImaging facility update: from multi-photon in vivo imaging to highcontent high-throughput image-based screening. Alex Laude The BioImaging Unit

OPTI-521 Graduate Report 2 Matthew Risi Tutorial: Introduction to imaging, and estimate of image quality degradation from optical surfaces

ALBERT-LUDWIG UNIVERSITY FREIBURG Institute of Computer Science Chair for Pattern Recognition and Image Processing

Module 4. K-Space Symmetry. Review. K-Space Review. K-Space Symmetry. Partial or Fractional Echo. Half or Partial Fourier HASTE

University of Huddersfield Repository

High Resolution BSI Scientific CMOS

Neurophysical Model by Barten and Its Development

Development of automated ultraviolet laser beam profiling system using fluorometric technique

Comparison of Digital Image Watermarking Algorithms. Xu Zhou Colorado School of Mines December 1, 2014

Image Restoration. Diffusion Denoising Deconvolution Super-resolution Tomographic Reconstruction

Coherent Gradient Sensing Microscopy: Microinterferometric Technique. for Quantitative Cell Detection

White-light interference microscopy: minimization of spurious diffraction effects by geometric phase-shifting

Fourier, Fresnel and Image CGHs of three-dimensional objects observed from many different projections

APPLICATION OF RADON TRANSFORM IN CT IMAGE MATCHING Yufang Cai, Kuan Shen, Jue Wang ICT Research Center of Chongqing University, Chongqing, P.R.

Introductory Guide to Light Microscopy - Biomedical Confocal Microscopy

Invited Paper. Nukui-Kitamachi, Koganei, Tokyo, , Japan ABSTRACT 1. INTRODUCTION

EPFL SV PTBIOP BIOP COURSE 2015 OPTICAL SLICING METHODS

picoemerald Tunable Two-Color ps Light Source Microscopy & Spectroscopy CARS SRS

Imager Design using Object-Space Prior Knowledge

Scientific Visualization Example exam questions with commented answers

Mightex Simply Brighter. Polygon400 Multiwavelength Dynamic Spatial Illuminators (Part Numbers: DSI-x-xxxx-xxxx-xxx-xxx) PRODUCT DESCRIPTION FEATURES

Classification of Hyperspectral Breast Images for Cancer Detection. Sander Parawira December 4, 2009

Overview of techniques applicable to self-interference incoherent digital holography

CHAPTER 3 SURFACE ROUGHNESS

CoE4TN4 Image Processing. Chapter 5 Image Restoration and Reconstruction

WHITE PAPER LIGHTNING IMAGE INFORMATION EXTRACTION BY ADAPTIVE DECONVOLUTION. LIGHTNING White Paper, September

Bioimage Informatics

Using Trichromatic and Multi-channel Imaging

Gpufit: An open-source toolkit for GPU-accelerated curve fitting

Leica Microsystems Intelligent Structured Illumination Microscopy

BME I5000: Biomedical Imaging

This paper is part of the following report: UNCLASSIFIED

Coherent Diffraction Imaging with Nano- and Microbeams

Surface and thickness profile measurement of a transparent film by three-wavelength vertical scanning interferometry

Product Information Version 1.1. ZEISS Axiocam 702 mono Your 2.3 Megapixel Microscope Camera for Fast Low Light and Live Cell Imaging

Mode-Field Diameter and Spot Size Measurements of Lensed and Tapered Specialty Fibers

BSI scmos. High Quantum Efficiency. Cooled Scientific CMOS Camera

Transcription:

Effect of OTF attenuation on single-slice SR-SIM reconstruction Supplementary Figure 1: Actin filaments in U2OS cells, labelled with Phalloidin-Atto488, measured on a DeltaVision OMX, excited at 488 nm wavelength. (a) Wide-field, (b) Wiener-filtered wide-field, (c) reconstruction using a standard 2D OTF, (d) reconstruction using the attenuated OTF (strength 0.995, FWHM 2 cycles/micron). Due to the 2D OTFs missing cone problem, background artifacts emerge when reconstructing with an unmodified OTF (c). For 3-beam data (where the bands overlap each others missing cones) and for 2-beam data (trading lateral resolution improvement for a larger overlap) the missing cones can be filled from other bands through the OTF attenuation, and the artifacts are mitigated (d). Thus, the reconstruction gains optical sectioning. Scale bar 5 μm, inset 2.0 μm.

SR-SIM of actin filaments in liver sinusoidal endothelial cells Supplementary Figure 2: Actin filaments in liver sinusoidal endothelial cells (LSECs). DeltaVision OMX, excited at 488 nm wavelength. (a) Wide-field, (b) Wiener-filtered wide-field, (c) single-slice reconstruction by fairsim, (d) same slice from full 3D reconstruction by manufacturer software. Note that because the single slice reconstruction in (c) is less restricted in the axial direction, it appears to provide more detail than the 3D reconstruction in (d). This is, however, mitigated e.g. when showing the full 3D data as an intensity projection (not shown). Scale bar 5 μm, inset 1.6 μm.

SR-SIM of U2OS osteosarcoma cells stained for tubulin Supplementary Figure 3: Tubulin stain (Alexa 488) in U2OS osteosarcoma cells, DeltaVision OMX, excited at 488 nm wavelength. (a) Wide-field, (b) Wiener-filtered wide-field, (c) single-slice reconstruction by fairsim, (d) same slice from full 3D reconstruction by manufacturer software. Note the significant background reduction through the use of optical sectioning (attenuation strength 0.998, FWHM 1.5 cycles/μm). Scale bar 5 μm, inset 2.0 μm.

SR-SIM of mitochondria in U2OS cells Supplementary Figure 4: Mitrochondria (Mito-Tracker) in U2OS cells, DeltaVision OMX, excited at 568 nm wavelength. (a) Wide-field, (b) Wiener-filtered wide-field, (c) single-slice reconstruction by fairsim, (d) same slice from full 3D reconstruction by manufacturer software. Please note, that the single-slice reconstruction suffers from large background and noise levels, but parameter extraction and reconstruction is still possible. Scale bar 5 μm, inset 2.0 μm.

SR-SIM of actin filaments in U2OS cells Supplementary Figure 5: Actin filaments in U2OS cells, measured on a Zeiss Elyra S1, excited at 488 nm wavelength. Wide-field, (b) Wiener-filtered wide-field, (c) single-slice reconstruction by fairsim, (d) same slice from full 3D reconstruction by manufacturer software. Scale bar 5 μm, inset 1.6 μm. Raw datasets 1 courtesy of Marcus Behringer and Markus Sauer, University of Würzburg.

SR-SIM of mitochondria in U2OS cells Supplementary Figure 6: Mitochondria in U2OS cells, measured on a Zeiss Elyra S1, excited at 565 nm wavelength. Wide-field, (b) Wiener-filtered wide-field, (c) single-slice reconstruction by fairsim, (d) same slice from full 3D reconstruction by manufacturer software. Scale bar 5 μm, inset 1.6 μm. Raw datasets 1 courtesy of Marcus Behringer and Markus Sauer, University of Würzburg.

TIRF-SIM of tubulin in cells Supplementary Figure 7: Tubulin filaments, measured on a 2D TIRF SIM setup, reconstruction of 9 raw data frames (3 angles, 3 phases), excited at 488nm wavelength. Wide-field, (b) Wiener-filtered wide-field, (c) single-slice reconstruction by fairsim, which is able to successfully extract the reconstruction parameters from TIRF datasets. Scale bar 5µm, inset 1.6µm. Raw datasets 2, 3 courtesy of Peter Kner, University of Georgia.

Illustration of SR-SIM band overlap Supplementary Figure 8: Common region of two SIM bands. Left: Power spectra of band S 0 (green), shifted band S 2 (blue) and the common region (magenta), defined here by h(k ), h(k + p) > 0.05, i.e. both bands OTFs are above a certain threshold. Right: Composite spatial representation of only frequencies from the common region, with S 0 (green) and S 2 (blue), base dataset U2OS actin. See Supplementary Note 1 for how the cross-correlation of this band overlap is used in the SR-SIM parameter estimation process.

Supplementary Note 1: Parameter estimation and reconstruction In super-resolved structured illumination microscopy a sample is illuminated with a series of harmonic illumination intensity patterns. The image sequence D n (r) acquired by the microscope is given by 1 M D n (r) = [S(r) a m exp{im(2πpr + φ n )} ] h (r). m= M Here S(r) denotes the fluorophores response to light, i.e. the property to be measured. M denotes the number of harmonics, so M = 1 for two-beam, and M = 2 for three-beam illumination. p is the modulation light wave vector, i.e. the pattern orientation and spacing. φ n denotes the phase, a m the modulation depth of the pattern. h (r) is the point-spread function, which causes the resolution limit. Switching to Fourier space, each harmonic illumination pattern transforms to delta-peaks at δ(±mp) and, using their folding and translation properties M D n(k ) = exp{imφ n } a m S (k mp) h(k ) m= M is obtained. The translation of S to k mp, caused by the delta-peaks position at δ(mp), is what allows previously unobservable frequencies in S to move into the support of h(k ), thus yielding the resolution improvement in SIM. The component S m(k ) = S(k mp) is referred to as the m th band. Bands are symmetric by construction, i.e. S m contains the same information as S m. Now, acquiring N measurements of D n (k ), with varying (usually equi-distant) phases φ n, but fixed p, allows to rewrite the equation to matrix form as with vectors and where D (k ) = MC(k ) D (k ) = [ D 1 (k ),, D N (k )], C(k ) = [ C M (k ),, C 0 (k ),, C M (k )] = [C(k + mp),, C(k ),, C(k mp)] M nm = a m exp imφ n and C(k ) = S (k ) h(k ) With a sufficient number (N M) of known phases φ n, M can be inverted 2, so with C(k ) = M 1 D (k ) all bands S m(k ) in C(k ) can be extracted. This step is referred to as band separation. 1 Mathematical naming conventions largely follow the ones used by Heintzmann et. al. 2 For an over-defined matrix (N > M), the Moore-Penrose pseudo-inverse is used to invert M.

Afterwards, the bands S m(k ) are moved to their correct position ±mp in Fourier space, added up and transformed back to a high resolution image in real space. The image assembly in Fourier space is usually performed through a Wiener filter: S SR (k ) = M m= M h (k + mp) C m (k + mp) ω 2 + M m= M h 2 (k + mp) A(k ) The filtering compensates for the frequency dampening introduced by h(k ), the parameter ω dampens the degree of compensation especially in regions where h is low. It should thus be set in accordance to the SNR of the input data. A(k ) is the apodization, compensating for ringing artifacts. A SIM reconstruction thus amounts to Fourier-transforming the input, carrying out bandseparation, shifting the bands to mp, summing them up through (e.g.) a Wiener filter, and transforming the result back to a high resolution image. The resolution gain is given by the length Mp, which is approximately 3 limited to the same cut-off as h(k ) for linear SIM 4. Thus, SIM typically doubles the resolution in comparison to a wide-field measurement. Parameter estimation: The SIM reconstruction introduced so far needs correct parameters (pattern spacing and orientation p, phases φ n ) to be carried out, which are typically 5 extracted from the input data. A reliable algorithm to obtain this estimation is often much more involved than the reconstruction itself. The method employed be fairsim follows the method by Gustaffson et. al. 4. Because the original publication provides little detail on the parameter estimation, we briefly lay out the mathematical background here. In general, the use of cross- and autocorrelation of frequency components for SIM parameter estimation is documented in a number of recent publications 4, 5, 6. Assuming equi-distant phases φ m, differing from correct phases φ m = φ m global offset φ Δ, the band-separation step is carried out. + φ Δ only by a For linear SIM 6, the separated and OTF-corrected bands S m will have common, overlapping regions (see Supplementary Fig. 8 for an illustration).with k denoting only components within these regions, S m(k + mp) and S 0(k ) should only differ by a constant, complex factor a m. As S m(k + mp) = a m S 0(k ) only holds for the correct shift vector p, the cross-correlation 3 For an exact number, wavelength change (Stokes-shift) has to be taken into account, and TIRF illumination will further shift the limit somewhat. 4 Non-linear SIM completely circumvents the limit by using effects such as photo-switching, depletion, or twophoton excitation. 5 Stable systems, especially SLM-based, should yield rather constant reconstruction parameters over time. However, retrieving a parameter estimate from data should often be much easier than characterizing them from the experimental properties. It might then be used to run multiple reconstructions. 6 For non-linear SIM, at least neighboring bands S m 1, S m will overlap (otherwise, frequencies are missing from the reconstruction), thus the process can be carried out iteratively.

C(p) = [ S m S 0 ](p) = S m (k + mp) S 0(k ) again with summation k ( ) limited to a region common to both band, will reach a maximum at the correct p. This can be used in an iterative search to find p, and implemented effectively, to sub-pixel precision, via the Fourier shift theorem. FairSIM provides visual feedback of this fit process, so the user can check it for plausibility. Now, at the correct p, the equivalence given above holds, so a m is found as a m = C(p) S 02 k k = k S m (k + mp) S 0(k ) k S 02 (k ) and yields both, the global phase offset φ Δ = arg(a ) and in principle the pattern modulation depth a m = a.

Supplementary References: 1. Sauer M. Raw SIM images Zeiss Elyra S1. (personal communication Huser T.) (2015). 2. Kner P. Raw datsets TIRF SIM. (personal communication Huser T.) (2015). 3. Kner P, Chhun BB, Griffis ER, Winoto L, Gustafsson MGL. Super-resolution video microscopy of live cells by structured illumination. Nat Methods 6, 339-342 (2009). 4. Gustafsson MGL, et al. Three-dimensional resolution doubling in wide-field fluorescence microscopy by structured illumination. Biophys J 94, 4957-4970 (2008). 5. Wicker K. Non-iterative determination of pattern phase in structured illumination microscopy using auto-correlations in Fourier space. Opt Express 21, 24692-24701 (2013). 6. Wicker K, Mandula O, Best G, Fiolka R, Heintzmann R. Phase optimisation for structured illumination microscopy. Opt Express 21, 2032-2049 (2013).