Supplementary Figure 1

Similar documents
Faster STORM using compressed sensing. Supplementary Software. Nature Methods. Nature Methods: doi: /nmeth.1978

Live-cell 3D super-resolution imaging in thick biological samples

Vutara 350. Innovation with Integrity. The Fastest, Super-Resolution Microscope Deep 3D Imaging on Live Cells, Quickly and Easily

Supporting Information for Azimuthal Polarization Filtering for Accurate, Precise, and Robust Single-Molecule Localization Microscopy

1. ABOUT INSTALLATION COMPATIBILITY SURESIM WORKFLOWS a. Workflow b. Workflow SURESIM TUTORIAL...

Gpufit: An open-source toolkit for GPU-accelerated curve fitting

Effect of OTF attenuation on single-slice SR-SIM reconstruction

BSI scmos. High Quantum Efficiency. Cooled Scientific CMOS Camera

Single Molecule Light Microscopy ImageJ Plugins

COLOCALISATION. Alexia Ferrand. Imaging Core Facility Biozentrum Basel

MetaMorph Super-Resolution Software. Localization-based super-resolution microscopy

SUPPLEMENTARY INFORMATION

Transmitted light Illuminator VIS-LED, color temperature. Epifluorescence lamp module X-Cite 120PC Q (Excelitas

Automatic Partiicle Tracking Software USE ER MANUAL Update: May 2015

Chao, J., Ram, S., Ward, E. S., and Ober, R. J. Investigating the usage of point spread functions in point source and microsphere localization.

Swammerdam Institute for Life Sciences (Universiteit van Amsterdam), 1098 XH Amsterdam, The Netherland

CS 395T Lecture 12: Feature Matching and Bundle Adjustment. Qixing Huang October 10 st 2018

COLOCALISATION. Alexia Loynton-Ferrand. Imaging Core Facility Biozentrum Basel

Virtual Frap User Guide

Supporting Information. Super Resolution Imaging of Nanoparticles Cellular Uptake and Trafficking

Super-Resolution on Moving Objects and Background

Back Illuminated Scientific CMOS

Single Particle Tracking Analyses of Hyperspectral Fluorescent Images. FACSS October 20 th, 2010 Pat Cutler, University of New Mexico

Localization Accuracy in Single-Molecule Microscopy

4.2 Megapixel Scientific CMOS Camera

Digital Volume Correlation for Materials Characterization

Searching for Handedness in Large Data

doi: /

Detector systems for light microscopy

Time-resolved wavelet- based acquisitions using a single pixel camera

Accurate extraction of reciprocal space information from transmission electron microscopy images. Edward Rosten and Susan Cox LA-UR

Detection of Sub-resolution Dots in Microscopy Images

Image Coding with Active Appearance Models

Thomas Cajgfinger, Eric Chabanat, Agnes Dominjon, Quang T. Doan, Cyrille Guerin, Julien Houles, Remi Barbier.

Edges, interpolation, templates. Nuno Vasconcelos ECE Department, UCSD (with thanks to David Forsyth)

Locally Weighted Least Squares Regression for Image Denoising, Reconstruction and Up-sampling

High Resolution BSI Scientific CMOS

45 µm polystyrene bead embedded in scattering tissue phantom. (a,b) raw images under oblique

Application of Proximal Algorithms to Three Dimensional Deconvolution Microscopy

Intensity-based axial localization approaches for multifocal plane microscopy

SUPPLEMENTARY INFORMATION

Raster Image Correlation Spectroscopy and Number and Brightness Analysis

Broad field that includes low-level operations as well as complex high-level algorithms

Supplementary Figure 1. Decoding results broken down for different ROIs

Guided Image Super-Resolution: A New Technique for Photogeometric Super-Resolution in Hybrid 3-D Range Imaging

Colocalisation/Correlation

Tomographic Algorithm for Industrial Plasmas

EPFL SV PTBIOP BIOP COURSE 2015 OPTICAL SLICING METHODS

Experimental Data and Training

Supplementary Information

Tracking of Virus Particles in Time-Lapse Fluorescence Microscopy Image Sequences

Renishaw invia Raman Microscope (April 2006)

Comparison of fiber orientation analysis methods in Avizo

On the quality of measured optical aberration coefficients using phase wheel monitor

x' = c 1 x + c 2 y + c 3 xy + c 4 y' = c 5 x + c 6 y + c 7 xy + c 8

2, the coefficient of variation R 2, and properties of the photon counts traces

Contents. 1 Introduction Background Organization Features... 7

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov

Software Reference Manual June, 2015 revision 3.1

Assembly dynamics of microtubules at molecular resolution

Hartley - Zisserman reading club. Part I: Hartley and Zisserman Appendix 6: Part II: Zhengyou Zhang: Presented by Daniel Fontijne

DeltaVision OMX SR super-resolution microscope. Super-resolution doesn t need to be complicated

Generation of Triangle Meshes from Time-of-Flight Data for Surface Registration

Phasor based single-molecule localization microscopy in 3D. (psmlm-3d): an algorithm for MHz localization rates using

OPTICAL COHERENCE TOMOGRAPHY:SIGNAL PROCESSING AND ALGORITHM

Cluster Analysis of Super Resolution Fluorescence Images Ki Woong Sung

Leica Microsystems Intelligent Structured Illumination Microscopy

On the uncertainty of Astigmatic Particle Tracking Velocimetry in the depth direction

Super-Resolution from Image Sequences A Review

Optical Sectioning. Bo Huang. Pharmaceutical Chemistry

Independent Resolution Test of

Dense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm

Digital Image Processing. Prof. P. K. Biswas. Department of Electronic & Electrical Communication Engineering

Quantifying Caveolin-1 Molecular Domains via Machine Learning and Computational Network Analysis of Super-resolution Microscopy Data

ANALYSIS OF GEOPHYSICAL POTENTIAL FIELDS A Digital Signal Processing Approach

arxiv: v1 [cs.cv] 28 Sep 2018

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror

3-D. Here red spheres show the location of gold nanoparticles inside/around a cell nucleus.

Product Information Version 1.1. ZEISS Axiocam 503 mono Your Flexible and Sensitive 3 Megapixel Microscope Camera for Live Cell Imaging

3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.

Adaptive Multiple-Frame Image Super- Resolution Based on U-Curve

Super-Resolution. Many slides from Miki Elad Technion Yosi Rubner RTC and more

Advanced Image Combine Techniques

Correcting Radial Distortion of Cameras With Wide Angle Lens Using Point Correspondences

pco.edge electrons 2048 x 1536 pixel 50 fps :1 > 60 % pco. low noise high resolution high speed high dynamic range

SUPPLEMENTARY INFORMATION

TN425: A study of fluorescence standards confirms that OptiGrid confocal images are suitable for quantitative microscopy

Neo scmos. Specifications Summary. Pixel size (W x H) 6.5 µm. Pixel well depth (typical) 30,000 e - Pixel readout rate (MHz) 560, 200

arxiv: v1 [physics.optics] 13 Oct 2017

Iterative Closest Point Algorithm in the Presence of Anisotropic Noise

ProEM -HS:1KBX3-10µm

ProEM -HS:1024BX3 FEATURES BENEFITS

Local Readjustment for High-Resolution 3D Reconstruction: Supplementary Material

Bioimage Informatics

Status of PSF Reconstruction at Lick

TAU-POGRAPHY-FLIM Software

Multi-Input Cardiac Image Super-Resolution using Convolutional Neural Networks

Level-set MCMC Curve Sampling and Geometric Conditional Simulation

Chapter 3 Image Registration. Chapter 3 Image Registration

SPATIAL DENSITY ESTIMATION BASED SEGMENTATION OF SUPER-RESOLUTION LOCALIZATION MICROSCOPY IMAGES

Transcription:

Supplementary Figure 1 Experimental unmodified 2D and astigmatic 3D PSFs. (a) The averaged experimental unmodified 2D PSF used in this study. PSFs at axial positions from -800 nm to 800 nm are shown. The x-z reconstruction represents a vertical cross-section along the line depicted in the image corresponding to the axial position 0 nm. (b) Same as (a), but for the averaged experimental astigmatic 3D PSF. Scale bars 1 µm.

Supplementary Figure 2 The localization precision of the fitter achieves minimum uncertainty with the cspline interpolated experimental astigmatic PSF. Single molecule images were simulated using an experimental astigmatic PSF model with 5000 photons/localization (panel a) or 500 photons/localization (panel b) and 10 background photons/pixel and fitted with the interpolated cubic spline model. We then evaluated the x, y and z localization precisions at different axial positions as the standard deviation of the error between fitted 3D positions and ground truth of the 10000 simulated molecules at each axial position (symbols). Additionally, we calculated the root-mean-square error between fitted positions and ground truth (dots). The localization precision as well as the localization accuracy of the fitted positions achieves the estimated Cramér Rao lower bound (CRLB) (denoted by lines) in all 3 dimensions. Only for dimmer fluorophores and large defocus, a small fraction (<5%) of fluorophores that converged to a z position close to the starting z position (focus), result in a deteriorated average localization accuracy. The CRLB is evaluated as the diagonal element of the inverse of the Fisher information matrix with the fitted parameters and cspline interpolated experimental PSF model.

Supplementary Figure 3 Experimental localization precision compared with the Cramér Rao lower bound (CRLB), measured by repeated imaging of a single bead. For each z-position, spaced 50 nm apart, 50 images were acquired. The upper panel shows the fitted z-position vs. the objective z position and the lower panel compares the experimental localization precision (standard deviation of the fitted z position) with the CRLB estimated by the software. (a): The EM gain was switched off, median photons per localization were 28650. (b): The EM gain was switched off, median photons per localization were 7060. For fitting of a, b, the CCD readout noise was taken into account by fitting the data with the scmos noise model, using a pixel-independent noise calibrated from a stack of dark images (21.7 photoelectrons). (c): An EM gain of 200 was used, median photons per localization were 6500. The beads were fitted with a noise model that approximates the EM excess noise by Poisson noise 1. To this end, we divided the photon numbers prior to fitting by the noise excess factor, which approaches 2 for large EM gain. This approximation seems to overestimate the noise; thus, the experimental uncertainty is slightly below the CRLB. 1. Fullerton, S., Bennett, K., Toda, E. & Takahashi, T. Optimization of precision localization microscopy using CMOS camera technology. Proc of SPIE 8228: 82280T 1 (2012).

Supplementary Figure 4 Experimental profiles and localization precisions for the data used in this paper. The insets denote the regions where the profiles were taken. Dotted lines: Fit with two Gaussians with a distance d and a standard deviation s in nm. Scale bars 100 nm.

Supplementary Figure 5 Comparison of our fitter to previous work, using the example of immunolabeled microtubules. (a) Front view reconstructions of immunolabeled microtubules taken from the literature 2 4. The hollow structure of the microtubules can only be resolved in the interferometric 4-Pi methods. (b) Front view reconstructions of microtubules presented in this work. We are able to resolve hollow, cylinder-like structure of microtubules in both DNA-PAINT and dstorm imaging. (c) Sketch of a microtubule labeled with antibodies to illustrate its dimensions. Scale bars 100 nm. (a, top) Adapted with permission from Ref 2, Springer Customer Service Centre GmbH: Springer Nature, Nature Photonics, copyright 2015. (a, middle and bottom) Adapted with permission from Refs 3 and 4, respectively, under creative commons license CC BY 4.0 (https://creativecommons.org/licenses/by/4.0), cropped from original and added scale bar. 2. Verdeny-Vilanova, I. et al. 3D motion of vesicles along microtubules helps them to circumvent obstacles in cells. J. Cell Sci. 130, 1904 1916 (2017). 3. Bourg, N. et al. Direct optical nanoscopy with axially localized detection. Nat Phot. 9, 587 593 (2015). 4. Huang, F. et al. Ultra-High Resolution 3D Imaging of Whole Cells. Cell 166, 1028 1040 (2016).

Supplementary Figure 6 3D astigmatic dstorm image of microtubules. Microtubules in U-2 OS cells, labeled with anti-alpha tubulin primary and Alexa Fluor 647-coupled secondary antibodies, were imaged using dstorm with a cylindrical lens. Upper panel: x-y top view. Lines denote regions for which 250 nm x-z (side view) cross-sections are shown in the lower panels. Corresponding localization precisions and profiles can be found in Supplementary Figure 4. Scale bars: 1 µm (top view), 100 nm (side views).

Supplementary Figure 7 Convergence and robustness of Levenberg Marquardt versus the Newton iterative method. (a), (b): Levenberg-Marquardt converges faster than Newton. We compared for the L-M and Newton method the change of the MLE cost function at each iteration. is defined as in ref. 5. The iteration stops when the relative change of decreases by less than 10-6. The number of iterations is 35±4 for the Newton method and 12±1 for the L-M method, which indicates the L-M method is more efficient than the custom Newton solver. (a) Update of during each iteration. (b) Relative change of during each iteration. Newton iterative scheme as in Smith et al 6. (c): The Levenberg-Marquardt algorithm is more robust with respect to starting parameters than the Newton method. The localization precision is plotted in dependence on the photons/localization. Both algorithms can achieve the CRLB for molecules with more than 100 photons when the centroid of the fitting window is used as a start parameter. We then purposely offset the starting parameter for x, y by 2 pixels. Whereas the final localization precision for the L-M algorithm is robust with respect to the start parameters, the Newton method often fails to converge for a wrong starting parameter estimate. Simulation parameters: Elliptical Gaussian PSF model with a sigma 1.5 and 2.5 pixels in x and y, respectively. 5 background photons per pixel. 500 photons per localization was used for (a) and (b). Fitting parameters: ROI size 13 13 pixels, 1000 molecules per data point, maximum number of iterations was 100. 5. Laurence, T. A. & Chromy, B. A. Efficient maximum likelihood estimator fitting of histograms. Nat. Methods 7, 338 339 (2010). 6. Smith, C. S., Joseph, N., Rieger, B. & Lidke, K. a. Fast, single-molecule localization that achieves theoretically minimum uncertainty. Nat. Methods 7, 373 375 (2010).

Supplementary Figure 8 Localization precision and accuracy for a Gaussian versus an experimental PSF model. Single molecule images were simulated using an experimental PSF model with 5000 photons/localization and 10 background photons/pixel. For the cspline 3D and elliptical Gaussian fit, an experimental astigmatic PSF was used for the simulation. For the cspline 2D fit, an unmodified experimental PSF was used. We then evaluated both localization precision and accuracy in 3D at different axial positions from 1000 simulated molecules at each axial position. The localization precision is calculated as the standard deviation of the difference between the fitted positions and ground truth positions, and the localization accuracy is calculated as the root mean square error between the fitted positions and ground truth positions. (a) Localization accuracy and (b) localization precision in z for different models at different axial positions. For the elliptical Gaussian PSF model, two algorithms were used for z localization as described in Online Methods. (c, d) are the same as (a, b) but in lateral direction.

Supplementary Figure 9 Comparison of the experimental PSF fit with a Gaussian fit for astigmatic data on the nuclear complex. (a) Nup107-SNAP-BG-AF647 in U-2 OS cells, imaged using dstorm with a cylindrical lens (top view). (b) 500 nm side view cross-section of the region denoted in (a) using the experimental PSF fit. (c) Side view reconstruction of the region denoted in (a) using the Gaussian z fit 6. Scale bars 1 µm. 6. Smith, C. S., Joseph, N., Rieger, B. & Lidke, K. a. Fast, single-molecule localization that achieves theoretically minimum uncertainty. Nat. Methods 7, 373 375 (2010).

Supplementary Figure 10 Photon count underestimation by Gaussian fit of experimental PSFs. Single molecule images were simulated using an experimental astigmatic PSF model with 5000 photons/localization and 10 background photons/pixel. The simulated single molecule images were fitted with a cspline interpolated PSF model (a) and an elliptical Gaussian model (b). Accuracy (root mean square error) and precision (standard deviation) of fitted photons/localization at different axial positions for (a) cspline fit and (b) elliptical Gaussian fit. Though the returned photon precision of the Gaussian fit is close to the CRLB, the returned accuracy is much larger than the precision, which indicates a strong systematic error in estimating the photons using the Gaussian PSF model. In contrast, for the cspline interpolated PSF model the accuracy, precision and CRLB of the photons/localization agree well with each other.

Supplementary Figure 11 A noisy PSF model leads to stripe artifacts. (a) Overview image of microtubules in a U-2 OS cell. The axial positions were color coded according to the color scale bar. (b) y-z plot of the boxed region in (a) when the PSF was modeled using only a single bead without smoothing. (c) y-z plot of the boxed region in (a) when PSF was robustly modeled with many beads across different fields of view and with regularization, as described in Online Methods. (d) z-profiles of (b) and (c). The stripe artifact is avoided using the proper averaging and regularization. Scale bars: (a) 1 µm, (b), (c) 100 nm.

Supplementary Figure 12 Computational speed of different fitting routines. (a) Comparison of the speed of the fitter presented in this work and previously published fitters. A 13 13 pixel window size was used for benchmarking. The fitting speeds of Babcock s code and Kirshner s code were measured using the example data provided in the software package by the authors. The fitting speed of ThunderSTORM was estimated using 1,000 frames of dstorm data from Supplementary Figure 6. We measured the overall time difference between an analysis with a stringent detection cutoff and one with a lower threshold. We then divided the difference in number of fitted localization by the time difference to estimate the number of fits per second. (b) Comparison of the speed of the Newton method and the L-M algorithm using an elliptical Gaussian PSF model. The effect of the readout noise variance for scmos camera data was also evaluated. Even though the L- M algorithm has higher complexity as it evaluates every iteration to determine the damping factor, it is still slightly faster than Newton method due to the fact that less iterations are needed. (c) Comparison of the speed of astigmatic Gauss z fit and cspline z fit. The GPU code is overall more than 100 times faster than the CPU code running on a single thread. It is interesting to notice that the spline fit is even faster than the Gauss z fit in the CPU code while it is slower than the Gauss z fit in GPU code. This is probably because the spline coefficients are accessed much more frequently in the GPU than the CPU, which slows down the performance.

Supplementary Figure 13 The scmos noise model avoids readout-noise-induced bias. Single-molecule images were simulated considering pixel-dependent readout noise, as is present in scmos cameras. The readout noise of the overall pixels is set as a Gaussian distribution with a mean of 1.4 e - and a sigma with 0.2 e -. (a) The map of the readout noise. The readout noise of the pixel located 2 pixels to the up of the center is set as 30 e -. (b) Simulated single molecule with the readout noise as shown in (a). Each molecule was simulated as an experimental PSF, 200 photons/localization and 2 background photons/pixel. The positions of the molecules were all placed in the center (6, 6) of the window. (c) Scatter plot of the 1000 fitted positions of the molecules as shown in (b) fitted with the EMCCD noise model. (d) Scatter plot of the 1000 fitted positions of the molecules as shown in (b) fitted with the scmos noise model.

Supplementary Figure 14 The cspline fitter works on reference data, as well as with commercial microscopes, advanced PSF engineering approaches, and highly aberrated PSFs. (a), (b) Fit of the 2016 SMLM Challenge (http://bigwww.epfl.ch/smlm) training data set with our fitter for experimental PSFs. a) Bi-directional fitting of the 2D training dataset (MT0.N1.LD-2D). The panels show topview and side-view reconstructions and slices through the PSF used for fitting. (b) Fitting of the Double-Helix PSF training dataset (MT0.N1.LD-DH). Panels as for (a). Scale bars: 1 µm. (c)-(h) Spline interpolated PSF models were derived from bead stacks and used to fit 6 individual beads from a different stack. (c) Zeiss Elyra, using a phase-ramp PSF 7. (d) Leica SR GSD 3D with astigmatic PSF. (e) Double-Helix PSF from the SMLM challenge (MT0.N1.LD-DH). (f)-(h) Experimental aberrated PSFs

generated with a deformable mirror on a custom microscope. 7. Baddeley, D., Cannell, M. B. & Soeller, C. Three-dimensional sub-100 nm super-resolution imaging of biological samples using a phase ramp in the objective pupil. Nano Res. 4, 589 598 (2011).

Supplementary Figure 15 The cspline fitter can improve the resolution on commercial microscopes. Nup107-SNAP-BG-AlexaFluor647 in U-2 OS cells, imaged using dstorm on a commercial Leica SR GSD 3D microscope. (a) overview, (b) side-view reconstruction using the cspline fitter with an experimentally derived PSF model, (c) as (b), but using the coordinates fitted with the Leica LAS X software.