Image processing in electron tomography

Size: px
Start display at page:

Download "Image processing in electron tomography"

Transcription

1 A. Méndez-Vilas and J. Díaz (Eds.) Image processing in electron tomography J.J. Fernández 1,2, J.I. Agulleiro 2, J.R. Bilbao-Castro 2, A. Martínez 2, I. García 2, F.J. Chichón 1, J. Martín-Benito 1, J.L. Carrascosa 1 1 Centro Nacional de Biotecnología- CSIC. Campus de Excelencia UAM+CSIC. Cantoblanco Madrid. Spain. 2 Unidad Asociada al CSIC 'Supercomputación y Algoritmos'. Univ. Almería & Málaga. Spain. Web site: Electron tomography (ET) has emerged as the leading technique for three-dimensional (3D) structural analysis of unique complex biological specimens. ET makes it possible to directly visualize the molecular architectures of organelles, cells and complex viruses at close-to-molecular resolution. ET has been crucial to reveal some of the major breakthroughs in life sciences in the last few years. ET combines electron microscopy with the power of 3D imaging to derive the 3D structure of complex specimens. A number of computational stages are involved in a typical structural study by ET, which range from the image acquisition with the electron microscope to the 3D reconstruction by means of tomographic reconstruction algorithms. Afterwards, a number of computational steps are necessary to facilitate the interpretation of the 3D data: noise reduction, segmentation and analysis of subvolumes. This chapter reviews the different computational stages involved in ET, from image acquisition to interpretation of the 3D reconstruction. Keywords image processing; electron tomography; electron microscopy; three-dimensional reconstruction; structural biology; cell biology 1. Introduction Electron tomography (ET) has emerged as the leading technique for three-dimensional (3D) structural analysis of unique complex biological specimens [1-3]. The great technological advances in the last decade have made it feasible to directly visualize the molecular architectures of organelles, cells and complex viruses as well as in vivo cellular dynamic events at close-to-molecular resolution [4-6]. The resolution attained by ET is rapidly approaching the molecular level (better than 2nm), which allows the study of the 3D organization of the structural components at a detail sufficient for the identification of macromolecular complexes, the analysis of their spatial distribution and their interactions in the native cellular context [7]. Electron tomography has got a unique potential to bridge the gap between Cellular and Molecular biology as it acts as a link between low resolution imaging techniques (light microscopy, X-ray tomography) and the high-resolution structural techniques (X-ray crystallography, nuclear magnetic resonance, electron crystallography, single particle electron microscopy). Therefore, ET has the power to allow the integration of the structural information derived by the different techniques and gathered at multiple levels of the biological complexity so as to provide a comprehensive description of the cellular function in molecular and even pseudo-atomic detail [2]. ET involves essential computational stages to derive and interpret the 3D structure of the complex biological specimens being studied: data acquisition, image alignment, image restoration, 3D reconstruction, post-processing of the 3D volume and, finally, interpretation. However, prior to these computational stages, there is an important stage related to specimen preparation. Due to the vacuum conditions in the microscope, the sensitivity of the biological material and the limited penetrating power of the electrons, the specimen has to be specially prepared before being imaged in the electron microscope. For an in-depth description of specimen preparation techniques, the reader is referred to [3,26]. 2. Data acquisition The transmission electron microscope, whose optical principles are similar to the widely known light microscope, provides projection images of the specimen being imaged. A beam of electrons is shot towards the specimen, and scattered and unscattered electrons emerging from the specimen are then collected by magnetic lenses and focused to form an interference pattern, which constitutes the projection image [3]. These projection images are thus formed by the integration of the 3D information of the specimen along the direction of the electron beam. In other words, the images look like radiographs of the sample. The images are then recorded on a CCD (charge-coupled device) camera. The principle of ET is the 3D reconstruction of a specimen from a series of projection images taken with a transmission electron microscope. In ET, a single individual biological sample is introduced in the electron microscope and a series of images (so-called tilt series) is recorded by tilting the sample around a single-tilt axis at different angles, typically over a tilt range of +/- 60 or 70 degrees and at small increments of 1-2 degrees (Figure 1). Sometimes, for better angular coverage, another tilt series is taken with the specimen rotated by 90 degrees (the double-axis tilting 19

2 A. Méndez-Vilas and J. Díaz (Eds.) geometry). Typical ET data sets then range from 60 to 280 images. Due to the resolution requirements, the image size typically is 2048 x 2048, 4096 x 4096 or even 8192 x 8192 pixels. The computation of a distortion-free 3D reconstruction from a tilt series would require that a data set from the full tilt range (+/- 90 degrees) be available. Due to physical limitations of microscopes, the angular tilt range is limited and, as a result, tomographic tilt series have a wedge of missing data corresponding to the uncovered angular range. This limitation, which is not present in other disciplines such as medical tomography, causes distortions in 3D reconstructions, as described below. Computer-automated data collection has been crucial for the advent of ET as a structural technique in cellular biology [1,3]. It allows automated tracking, focusing and recording of images under low electron-dose conditions by dividing the maximum tolerable dose over the total number of images, which preserves the specimen from radiation damage. But, as a consequence, the images exhibit a poor signal-to-noise ratio (SNR) around 0.1. During acquisition, the imperfections of the mechanical tilt system and the electron optics produce shifts in the images. The larger component of these shifts is compensated by the automated tracking procedure. However, a more accurate alignment of the images is needed afterwards by computational procedures. Fig. 1 Single-tilt axis data acquisition geometry. The specimen is imaged in the microscope by tilting it over a range typically +/- 60 or 70 degrees in small tilt increments (left). As a result, a set of projection images (so-called tilt series) needed to structure determination is collected (right). 3. Preprocessing: alignment and restoration The computational alignment is intended to mutually set the images to a common coordinate system by correction for the shifts and possible rotations and magnification changes. The standard procedure for the alignment starts at the preparation stage, where colloidal gold particles are included in the biological sample to be used as electron-dense fiducial markers. Once the tilt series is acquired, the coordinates of those markers are determined manually or semiautomatically throughout the images of the tilt series. Using the coordinates of those markers, the images are then mutually aligned by means of a least squares procedure aiming at minimizing the alignment error as a function of the shifts, rotations and other parameters included in the alignment model [3] (see Fig. 2). An alternative automated procedure that does not require the use of fiducial markers is based on cross-correlation, however its sensitivity to noise limits its application to particular high-contrast ET studies. The electron microscope leaves an imprint in the acquired images as a result of its transfer function (so-called CTF, which stands for Contrast Transfer Function). The CTF arises from the aberrations of the lenses and from the defocus used in imaging. The artefacts of the CTF consist in oscillations that produce the attenuation of structural details and, even worse, in contrast reversals at certain spatial resolution ranges. The contrast reversal is especially harmful as the structural details at some resolution ranges are presented as white density over a black background whereas at other resolution ranges they appear as black over white. Correction for the CTF effects is essential for any image to faithfully represent a projection of the specimen at high resolution. So far there have not been urgent needs for that in electron tomography due to the relatively low-resolution limits. However, as the technique improves and the attainable resolution is pushed forward, the need for CTF correction is getting importance. 20

3 A. Méndez-Vilas and J. Díaz (Eds.) Fig. 2 Aligned projection images of Vaccinia virus [8]. Three projection images of a specific virion, corresponding at and 40 o tilts are shown. -60o, 0 o The first issue related to this restoration problem is the determination of the CTF as the low SNR hampers visualization of the oscillatory component of the CTF in the Fourier spectrum. An approach that is getting increasing interest in the field is based on the assumption that the tilt-series is eucentric (i.e. the defocus at the tilt axis is constant during acquisition) [9]. The images of the tilt-series are split into tiles and the spectra of tiles at the same defocus, taken from the images throughout the tilt-series, are averaged. This yields an average spectrum with the CTF oscillations visible and highlighted, and hence an accurate fitting with the theoretical CTF model can be carried out. From this average CTF, the CTF at any point of any image in the tilt series can be easily determined by simple geometry. The major problem of CTF correction in ET is the gradient of the defocus along the direction perpendicular to the tilt axis in tilted images. This turns the restoration problem into a spatially variant one. An approach that succeeds in dealing with this CTF gradient in tilted images decomposes the global restoration problem into multiple local spatially invariant problems confined to strips parallel to the tilt axis [9]. This way, the CTF correction is applied to the aligned tilt series prior to the tomographic reconstruction. 4. Tomographic reconstruction The reconstruction problem in ET is to obtain the 3D structure of the specimen from the set of aligned, and possibly CTF-corrected, images in the tilt series. The mathematical principles of tomographic reconstruction are based upon the central section theorem, which states that the Fourier transform (FT) of a 2D projection of a 3D object is a central section of the 3D FT of the object [3]. Therefore, the 3D FT of the specimen can be computed by assembling the 2D FTs of the images in the tilt series, which yields the 3D structure of the specimen by an inverse FT. One problem of this approach is related to the interpolation in Fourier space. The standard method for tomographic reconstruction is Weighted Backprojection (WBP), which essentially is equivalent to the Fourier approach just described but working in real space [3]. WBP assumes that the projection images represent the amount of mass density encountered by imaging rays. The method simply distributes the known specimen mass present in projection images evenly over computed backprojection rays. This way, the specimen mass is projected back into a reconstruction volume (i.e., backprojected). When this process is repeated for all the projection images in the tilt series, backprojection rays from the different images intersect and reinforce each other at the points where mass is found in the original structure. Therefore, the 3D mass of the specimen is reconstructed from a series of 2D projection images. The backprojection process involves an implicit low-pass filtering that makes reconstructed volumes strongly blurred. In practice, in order to compensate the transfer function of the backprojection process, a previous high-pass filter (i.e., weighting) is applied to the projection images, hence the term ``weighted backprojection''. This weighting is necessary to properly represent the high frequency information in the reconstruction. Fig. 3 shows a sketch of the backprojection process to 3D reconstruction from projections. For a detailed description of the method, refer to [3]. Figure 4 left shows the 3D reconstruction of a Vaccinia virion with WBP [8]. The relevance of WBP in ET mainly stems from the linearity and the computational simplicity of the method. The main disadvantages of WBP are that (i) the results may be strongly affected by limited tilt angle data obtained with the microscope, and (ii) WBP does not implicitly take into account the transfer function of the microscope or the noise conditions. As a consequence of the latter, a posteriori regularization techniques (such as low-pass filtering) may be needed to attenuate the effects of the noise. 21

4 A. Méndez-Vilas and J. Díaz (Eds.) Fig. 3 Three-dimensional reconstruction from projections. In Backprojection (left), the projection images in the tilt-series are projected back into the volume to be reconstructed. In iterative methods (right), the reconstruction is progressively refined by minimizing the error between the experimental and the calculated projections. There exist alternative real-space reconstruction algorithms that formulate the 3D reconstruction problem as a large system of linear equations to be solved by iterative methods [10]. These methods iteratively refine the reconstruction by minimizing the error between the experimental projections and the projections calculated from the current volume. These alternative iterative algorithms are getting increasing interest in the field because their robustness against the experimental conditions found in ET [1] (Fig. 4 right shows the 3D reconstruction of a Vaccinia virion with 100 iterations of SIRT). These methods have not been used extensively in this field so far because of their computational demands. However, high performance computing and the advent of modern computing platforms such as multi-core computers or GPUs (graphics processors) are making them viable alternatives to WBP [11-13]. The standard high performance computing approach to tomographic reconstruction is based on the decomposition of the 3D reconstruction problem into a set of independent 3D reconstruction sub-problems corresponding to slabs of slices perpendicular to the tilt axis (see Fig. 5; the concept of slice is sketched in Fig. 1). Those subproblems can be solved in parallel with clusters of computers, supercomputers or multicore computers [11], or with standard computers using SIMD (single instruction, multiple data) instructions [13] (see Fig. 5 right). With GPUs, the parallelism-grain is usually much finer, processing multiple individual voxels in parallel [12]. The limited tilt range in ET results in a region empty of information in the Fourier space of the 3D reconstruction (so-called missing wedge ). The resolution of the reconstruction is thus anisotropic (i.e., direction-dependent). In real space, it produces artefacts as blurring of the spatial features in the beam direction, making some features appear as elongated in that direction (i.e. there is a significant loss of resolution in the Z-direction), features oriented perpendicular to the tilt axis tend to fade from view, and others are not resolved at all (see Fig. 4). A +/- 70 tilt range involves that 22% of the information is missing. The use of double-tilt axis acquisition geometry significantly reduces the missing information (down to 7% in the case of +/- 70 tilt range). The angular sampling, that is, the interval between successive tilt images, is another point affecting the resolution of the reconstruction. The more projection images, the better the angular sampling, and as a consequence the better the resolution. 5. Post-processing and interpretation of tomograms Although tomographic reconstructions (also known as tomograms in the field) contain a wealth of information, their interpretation is complicated due to a number of factors: the artefacts due to the missing wedge, the low SNR and the inherent biological complexity. Significant efforts are spent to facilitate the interpretation by several stages of postprocessing of the tomograms: noise reduction, segmentation, analysis of macromolecular complexes and resolution assessment. 22

5 A. Méndez-Vilas and J. Díaz (Eds.) Fig. 4 Three-dimensional reconstruction of Vaccinia virus. Left: Result with WBP. Right: 100 iterations of the iterative method called SIRT. The XZ, XY and ZY planes are shown at top-left, bottom-left and bottom-right panels, respectively. The planes containing the Z axis clearly show the effect of the missing wedge, in the form of severe blurring, elongation and fading-out of features. Furthermore, it is clearly seen that the contrast in the SIRT reconstruction is much better. Fig. 5 High performance tomographic reconstruction. Left: Decomposition of a volume into slices or slabs of slices. The reconstruction of the slabs can be then carried out in parallel in clusters of computers, multicore computers or using SIMD instructions. Right: Computation times and speedups of 3D reconstructions with 30 iterations of the iterative method named SIRT with size of 1024x1024xT, with T=128,256,512,1024 on standard computers using code optimization and SIMD instructions. Seq. denotes the sequential version of the program. SSE denotes the version exploiting the SIMD instructions in modern processors. It is clearly seen that the speedup factor is consistently around 3.3 and, more importantly, a standard reconstruction of 1024x1024x128 from 60 images with 30 iterations take less than 5 minutes on a standard computer based on a Intel Core 2 processor. Tomograms are significantly corrupted by noise, which precludes their visualization and analysis. Standard linear filtering techniques based on local averages, Gaussian kernels or low pass Fourier filtering succeed in reducing the noise, but at the expense of blurring edges and features. This has led to the development of more sophisticated noise reduction techniques that preserve the structural features of interest. Iterative median filtering [14] is a nonlinear technique that succeeds in preserving the structures by, for some rounds, substituting a voxel by the median of its neighbours. It is well suited for high contrast tomograms. The Beltrami flow [15] is another nonlinear method that considers the 3D volume as a 3-manifold embedded into a 4D space, with the latest dimension being the density. This method manages to tune the strength of the filtering according to an edge indicator based on geometry operators, hence preserving structures of interest. Bilateral filtering [16] is an anisotropic nonlinear technique that filters noise by applying Gaussian kernels on the spatial domain and on the density domain. Here a voxel is substituted by the weighted mean of the neighbours with a weight reflecting the similarity in terms of density and the spatial relationships. Anisotropic nonlinear diffusion is by far the standard noise reduction algorithm in the field [17,18]. It achieves feature 23

6 A. Méndez-Vilas and J. Díaz (Eds.) preservation and enhancement as the strength and direction of the smoothing are adaptively tuned to the local structures around each voxel. Figure 6 sketches the fundamentals of some nonlinear and anisotropic filtering procedures. Fig. 6 Approaches for noise filtering. (a) The Beltrami flow considers a 3D volume as a 3-manifold embedded into a 4D space. This sketch shows the 2D case, where an image with a white square over black background (top) is viewed as a surface in a 3D space (bottom). The edges are seen as cliffs in the Z direction. At each point of the surface, the projection of the normal (arrows in blue) to the Z direction (arrows in black) acts as an edge indicator, yielding little value at sharp edges where the smoothing should be attenuated or cancelled out. (b) In anisotropic nonlinear filtering, the local structure around each voxel is determined based on an eigen-analysis that provides three orthogonal eigenvectors (v) and their corresponding eigenvalues (µ). This analysis allows identification of basic geometric figures, as shown, and the strength and direction of the smoothing are adaptively tuned so that the edges of these structures are preserved and enhanced. (a) (b) (c) Fig. 7 Performance of denoising methods. (a) tomogram of HIV virions (taken from EM Data Bank, code: 1155) ; original (left), denoised with Beltrami flow (center) and with median filtering (right). (b) tomogram of Vaccinia virion [8], original (left), denoised with Beltrami flow (center) and with median filtering (right). (c) Tomogram of another Vaccinia virion; original (left), denoised with anisotropic nonlinear diffusion (center), which made it possible to visualize it in 3D with isosurface (right). 24

7 A. Méndez-Vilas and J. Díaz (Eds.) Segmentation intends to decompose the tomogram into its structural components by identifying the sets of voxels that constitute them. Though tedious, manual segmentation is the simplest and the most common approach, which consists in that the user assigns the structural features using visualization tools. Several automatic or semi-automatic approaches have been proposed in the field (some of them reviewed in [3,19]). There exist methods based on simple density thresholds or more sophisticated optimal thresholding [8], the Watershed transform extended to 3D, eigenvector analysis of an affinity matrix, eigenanalysis of the structure tensor (similar to what is done with anisotropic nonlinear diffusion, see Fig. 8), oriented filters, fuzzy logic. In addition, template matching with simple 3D geometric templates has been proposed for high contrast tomograms. However, none of these methods has stood out as a general applicable method yet, and manual segmentation still remains the prevalent method. Figure 9 shows a procedure devised to segment Vaccinia virions. Figure 10 shows the result of another segmentation procedure based on optimal thresholding and manual tracing. This segmentation procedure revealed that the Vaccinia virus is a brick-shaped structure with fixed dimensions of 360 x 270 x 250 nm, composed by an outer membrane (yellow), and an inner core (blue) where the genetic material is located. A membrane that has a palisade of spikes surrounds the core. Systematic inspection of the denoised and segmented tomograms allowed discovery of pores through which the genetic material presumably can pass during infection. There also exist lateral densities (orange) behind the outer membrane and there is room to speculate that they may be special areas for the storage of viral components required for the infection process. Fig. 8 Segmentation by exploiting the information provided by the eigen-analysis of the structure tensor (A. Martinez et al., in preparation). (left) Actin filaments and membranes from a Dictyostelium discoideum tomogram kindly provided by Dr. O. Medalia. (right) HIV virions segmented out from the background (see original tomogram in Fig. 7 top). Fig. 9 This procedure combines Gaussian filtering and anisotropic nonlinear diffusion (AND) to segment Vaccinia virions from the background. The AND result in combination to thresholding and morphological operations allowed generation of a mask. This mask was then applied to the Gaussian-filtered map in order to segment it and obtain a clean view of the details of the virus. This masking procedure was useful to produce the 3D views as that shown in Fig. 7(c). 25

8 A. Méndez-Vilas and J. Díaz (Eds.) Fig. 10 Segmentation of a Vaccinia virion by manual tracing and optimal thresholding. The virus comprises an outer membrane (yellow) that encloses a core (blue) where the genetic material is. The core has a membrane and a palisade of spikes. Lateral densities (orange) are speculated to be material to assist the infection process. Electron tomograms of the cell environment are crowded of macromolecular complexes. The high-resolution structure of many of these complexes are usually available from techniques such as X-ray crystallography or single particle electron microscopy. The current resolution levels in ET allow detection of these complexes in the in situ cell environment using these available structures as search-templates against the tomogram. This allows the analysis of the spatial distribution of these macromolecular complexes and their interactions in the native cellular context, an approach that is referred to as 'visual proteomics' [7,20]. Detection is carried out by a template-matching procedure based on cross-correlation function (CCF) on the three coordinates and the three orientation parameters of the putative occurrences in the tomogram. In order to account for the limited tilt conditions, the missing wedge is taken into account during the CCF computation [21]. The numerous false positives have to be discarded by visual inspection or statistics [22]. The putative complexes are then extracted from the tomogram, mutually aligned and averaged, with consideration of the missing wedge [23]. Finally, once the location and the orientation of the positive complexes are known, it is then possible to locate them back in the tomogram space with the proper orientation, thereby creating a macromolecular atlas of the cell that allows the analysis of their 3D distribution and their interactions. Figure 11 shows that the visualization of the macromolecular organization of thick eukaryotic organisms such as yeast Saccharomyces cerevisiae is possible thanks to these techniques. Ribosomes in the cell environment were automatically detected by means of template matching techniques, using as a template a previous ribosome density map obtained by single particle EM. The ribosomes were aligned and an averaged was computed. Finally, the ribosomes were put back into the 3D space in their location with the determined orientations, thus building an atlas of the 80s ribosome of S. Cerevisiae [24]. Fig. 11 Atlas of the 80s ribosome (right) built from a section of S. Cerevisiae (left) after detection with template matching, alignment and averaging. 26

9 A. Méndez-Vilas and J. Díaz (Eds.) Resolution estimation aims to find out the level of detail that is undoubtedly present and reliable in the tomogram. An approach that is getting interest in the field is inspired in the Fourier Shell Correlation (FSC) commonly used in other electron microscopy modalities like single particle electron microscopy [2]. This approach, known as FSCe/o, splits the tilt series into two halves (containing the even and odd projection images, respectively). From these half tilt series, two independent tomograms are computed that are then compared in Fourier space to find out the maximum spatial resolution up to which both are mutually consistent [25] (Fig. 12 left). Another approach, more time-consuming, is known as noise-compensated leave one out (NLOO). Here, for each projection image, a tomogram is computed from the whole tilt series except that projection image. Then, a projection is calculated from the tomogram at the direction of the missing projection, and a comparison in Fourier space (according to the 2D version of the FSC) between the calculated and the missing projection is carried out [25]. Therefore, this method estimates the quality of the tomogram as the resolution up to which it is possible to predict a missing projection. For small tilt intervals (1 degree) FSCe/o and NLOO yield similar results, otherwise NLOO is more reliable. On the other hand, in cases where averaging of substructures or macromolecular complexes is involved, the resolution is estimated from the FSC of two independent averages computed from half-sets of substructures (Fig. 12 right). Fig. 12 Resolution assessment. Vaccinia virus studied by electron tomography was solved at 13.4nm resolution according to the FSCe/o criterion. The average ribosome from a section of S. Cerevisiae was solved at 5.6nm resolution according to the FSC criterion. 6. Conclusion Electron tomography has matured as a structural technique in biology, making it possible to visualize the molecular architectures of organelles, cells and complex viruses at near molecular resolution. ET has got a unique potential to bridge the gap between cellular and molecular biology, allowing the integration of the multi-resolution structural information derived by the different structural techniques and thus a comprehensive description of the cellular function. ET combines electron microscopy with the power of 3D imaging and relies on essential computational image processing stages to derive and interpret the 3D structure of the complex biological specimens: data acquisition, image alignment, image restoration, 3D reconstruction, post-processing and interpretation of the structure. In this chapter, the computational methods and technologies involved in experimental ET studies have been reviewed. These methods are expected to play a key role to help ET scientists explore untrodden paths in cell biology and at a level of detail ever imagined. Acknowledgements The authors wish to thank Dr. O. Medalia for the D. discoideum dataset. The HIV dataset was taken from the EM DataBank. The support by the Spanish Ministry of Science (MCI-TIN , MCI-BFU /BMC), CSIC (PIE I075) and Junta de Andalucía (JA-P06-TIC-01428) is gratefully acknowledged. 27

10 A. Méndez-Vilas and J. Díaz (Eds.) References [1] Lucic V, Forster F, Baumeister W. Structural studies by electron tomography: from cells to molecules. Annual Review of Biochemistry. 2005; 74: [2] Fernández JJ, Sorzano COS, Marabini R, Carazo JM. Image processing and 3D reconstruction in electron microscopy, IEEE Signal Processing Magazine. 2006; 23(3): [3] Frank J, ed. Electron Tomography: Methods for Three-Dimensional Visualization of Structures in the Cell. Springer; [4] Medalia O, Weber I, Frangakis AS, Nicastro D, Gerisch G, Baumeister W. Macromolecular architecture in eukaryotic cells visualized by cryoelectron tomography. Science. 2002; 298: [5] Beck M, Förster F, Ecke M, Plitzko JM, Melchior F, Gerisch G, Baumeister W, Medalia O. Nuclear pore complex structure and dynamics revealed by cryoelectron tomography. Science. 2004;306: [6] Brandt F, Etchells SA, Ortiz JO, Elcock AH, Hartl FU, Baumeister W. The native 3D organization of bacterial polysomes. Cell. 2009; 136: [7] Nickell S, Kofler C, Leis AP, Baumeister W. A visual approach to proteomics. Nature Reviews Molecular Cell Biology. 2006; 7: [8] Cyrklaff M, Risco C, Fernández JJ, Jiménez MV, Esteban M, Baumeister W, Carrascosa JL. Cryo-electron tomography of vaccinia virus. Proceedings of the National Academy of Sciences USA. 2005; 102: [9] Fernandez JJ, Li S, Crowther RA. CTF determination and correction in electron cryotomography. Ultramicroscopy. 2006; 106: [10] Gilbert P. Iterative methods for the three-dimensional reconstruction of an object from projections. Journal of Theoretical Biology. 1972; 36: [11] Fernandez JJ. High performance computing in structural determination by electron cryomicroscopy. Journal of Structural Biology. 2008; 164:1-6. [12] Vazquez F, Garzon EM, Fernandez JJ. A matrix approach to tomographic reconstruction and its implementation on GPUs. Journal of Structural Biology. 2010; 170: [13] Agulleiro JI, Garzon EM, Garcia I, Fernandez JJ. Vectorization with SIMD extensions speeds up reconstruction in electron tomography. Journal of Structural Biology. 2010; 170: [14] van der Heide P, Xu XP, Marsh BJ, Hanein D, Volkmann N. Efficient automatic noise reduction of electron tomographic reconstructions based on iterative median filtering. Journal of Structural Biology. 2007; 158: [15] Fernandez JJ. TOMOBFLOW: Feature-preserving noise filtering for electron tomography. BMC Bioinformatics 2009, 10:178. [16] Jiang W, Baker ML, Wu Q, Bajaj C, Chiu W. Applications of a bilateral denoising filter in biological electron microscopy. Journal of Structural Biology. 2003; 144: [17] Frangakis AS, Hegerl R. Noise reduction in electron tomographic reconstructions using nonlinear anisotropic diffusion. Journal of Structural Biology. 2001; 135: [18] Fernández JJ, Li S. An improved algorithm for anisotropic nonlinear diffusion for denoising cryo-tomograms. Journal of Structural Biology. 2003; 144: [19] McIntosh R, ed. Cellular Electron Microscopy, Volume 79 of Methods in Cell Biology. Academic press, New York, [20] Beck M, Malmström JA, Lange V, Schmidt A, Deutsch EW, Aebersold R. Visual proteomics of the human pathogen Leptospira interrogans. Nature Methods. 2009; 6: [21] Frangakis AS, Böhm J, Förster F, Nickell S, Nicastro D, Typke D, Hegerl R, Baumeister W. Identification of macromolecular complexes in cryoelectron tomograms of phantom cells.. Proceedings of the National Academy of Sciences USA. 2002; 99: [22] Ortiz JO, Förster F, Kürner J, Linaroudis AA, Baumeister W. Mapping 70S ribosomes in intact cells by cryoelectron tomography and pattern recognition. Journal of Structural Biology. 2006; 156: [23] Schmid MF, Booth CR. Methods for aligning and for averaging 3D volumes with missing data. Journal of Structural Biology. 2008; 161: [24] Pierson J, Fernández JJ, Bos E, Amini S, Gnaegi H, Vos M, Bel B, Adolfsen F, Carrascosa JL, Peters PJ. Improving the technique of vitreous cryo-sectioning for cryo-electron tomography: electrostatic charging for section attachment and implementation of an anti-contamination glove box. Journal of Structural Biology. 2010;169: [25] Cardone G, Grünewald K, Steven AC. A resolution criterion for electron tomography based on cross-validation. Journal of Structural Biology. 2005;151: [26] Owen G. Rh., Stokes D.L. An introduction to low dose electron tomography- from specimen preparation to data collection. In Méndez-Vilas A., Díaz J., eds. Modern Research and Educational Topics in Microscopy, Volume 2, Microscopy Book Series, Formatex; 2007:

FASART: An iterative reconstruction algorithm with inter-iteration adaptive NAD filter

FASART: An iterative reconstruction algorithm with inter-iteration adaptive NAD filter Bio-Medical Materials and Engineering 26 (2015) S1409 S1415 DOI 10.3233/BME-151439 IOS Press S1409 FASART: An iterative reconstruction algorithm with inter-iteration adaptive NAD filter Ziying Zhou a,

More information

THREE-DIMENSIONA L ELECTRON MICROSCOP Y OF MACROMOLECULAR ASSEMBLIE S. Visualization of Biological Molecules in Their Native Stat e.

THREE-DIMENSIONA L ELECTRON MICROSCOP Y OF MACROMOLECULAR ASSEMBLIE S. Visualization of Biological Molecules in Their Native Stat e. THREE-DIMENSIONA L ELECTRON MICROSCOP Y OF MACROMOLECULAR ASSEMBLIE S Visualization of Biological Molecules in Their Native Stat e Joachim Frank CHAPTER 1 Introduction 1 1 The Electron Microscope and

More information

The Electron Microscopy Data Bank and OME

The Electron Microscopy Data Bank and OME The Electron Microscopy Data Bank and OME Rich data, quality assessment, and cloud computing Christoph Best European Bioinformatics Institute, Cambridge, UK Transmossion Electron Microscope ADVANTAGES

More information

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror 1 Last month s Nobel Prize in Chemistry Awarded to Jacques Dubochet, Joachim Frank

More information

3. Image formation, Fourier analysis and CTF theory. Paula da Fonseca

3. Image formation, Fourier analysis and CTF theory. Paula da Fonseca 3. Image formation, Fourier analysis and CTF theory Paula da Fonseca EM course 2017 - Agenda - Overview of: Introduction to Fourier analysis o o o o Sine waves Fourier transform (simple examples of 1D

More information

SUPPLEMENTARY INFORMATION

SUPPLEMENTARY INFORMATION SUPPLEMENTARY INFORMATION doi:10.1038/nature10934 Supplementary Methods Mathematical implementation of the EST method. The EST method begins with padding each projection with zeros (that is, embedding

More information

Cover Page. The handle holds various files of this Leiden University dissertation

Cover Page. The handle   holds various files of this Leiden University dissertation Cover Page The handle http://hdl.handle.net/1887/48877 holds various files of this Leiden University dissertation Author: Li, Y. Title: A new method to reconstruct the structure from crystal images Issue

More information

Classification of Hyperspectral Breast Images for Cancer Detection. Sander Parawira December 4, 2009

Classification of Hyperspectral Breast Images for Cancer Detection. Sander Parawira December 4, 2009 1 Introduction Classification of Hyperspectral Breast Images for Cancer Detection Sander Parawira December 4, 2009 parawira@stanford.edu In 2009 approximately one out of eight women has breast cancer.

More information

Alignment and Other Challenges in Reconstructing Cryotomograms with IMOD

Alignment and Other Challenges in Reconstructing Cryotomograms with IMOD Alignment and Other Challenges in Reconstructing Cryotomograms with IMOD Challenges in Cryotomography Alignment, alignment, alignment It can be hard to get fiducials onto/in the sample The low SNR makes

More information

Single Particle Reconstruction Techniques

Single Particle Reconstruction Techniques T H E U N I V E R S I T Y of T E X A S S C H O O L O F H E A L T H I N F O R M A T I O N S C I E N C E S A T H O U S T O N Single Particle Reconstruction Techniques For students of HI 6001-125 Computational

More information

Comparison of fiber orientation analysis methods in Avizo

Comparison of fiber orientation analysis methods in Avizo Comparison of fiber orientation analysis methods in Avizo More info about this article: http://www.ndt.net/?id=20865 Abstract Rémi Blanc 1, Peter Westenberger 2 1 FEI, 3 Impasse Rudolf Diesel, Bât A, 33708

More information

3D Reconstruction in EM

3D Reconstruction in EM 3D Reconstruction in EM C.O.S. Sorzano Biocomputing Unit, CNB-CSIC Instruct Image Processing Center Contents Initial volume Angular assignment 3D Reconstruction 3D Classification Resolution Amplitude correction

More information

Batch Processing of Tomograms with IMOD

Batch Processing of Tomograms with IMOD Batch Processing of Tomograms with IMOD Batch Processing Can Be Useful for a Wide Range of Tilt Series Routine plastic section tilt series can be fully reconstructed automatically with 80-95% success rate

More information

Transmission Electron Microscopy 3D Construction by IPET Method TCBG GPU Workshop

Transmission Electron Microscopy 3D Construction by IPET Method TCBG GPU Workshop Transmission Electron Microscopy 3D Construction by IPET Method TCBG GPU Workshop Xing Zhang 8/4/2013 Molecular Foundry Lawrence Berkeley National Laboratory Department of Applied Physics Xi an Jiaotong

More information

II: Single particle cryoem - an averaging technique

II: Single particle cryoem - an averaging technique II: Single particle cryoem - an averaging technique Radiation damage limits the total electron dose that can be used to image biological sample. Thus, images of frozen hydrated macromolecules are very

More information

STEM electron tomography in the Scanning Electron Microscope

STEM electron tomography in the Scanning Electron Microscope Journal of Physics: Conference Series PAPER OPEN ACCESS STEM electron tomography in the Scanning Electron Microscope To cite this article: M Ferroni et al 2015 J. Phys.: Conf. Ser. 644 012012 Recent citations

More information

SUPPLEMENTARY INFORMATION

SUPPLEMENTARY INFORMATION doi:10.1038/nature12009 Supplementary Figure 1. Experimental tilt series of 104 projections with a tilt range of ±72.6 and equal slope increments, acquired from a Pt nanoparticle using HAADF- STEM (energy:

More information

2D Image Alignment and Classification

2D Image Alignment and Classification Structural Biology from Cells to Atoms Optical microscopy D Image Alignment and Classification Yao Cong cryotomography cryomicroscopy 8nm 00 nm 50nm 1nm 5nm Crystallography 0.1nm 0.35nm 0.6nm 0.3nm Shanghai

More information

Supporting Online Material. Nuclear Pore Complex Structure and Dynamics. revealed by Cryoelectron Tomography

Supporting Online Material. Nuclear Pore Complex Structure and Dynamics. revealed by Cryoelectron Tomography 1 Supporting Online Material Nuclear Pore Complex Structure and Dynamics revealed by Cryoelectron Tomography Martin Beck, Friedrich Förster, Mary Ecke, Jürgen M. Plitzko, Frauke Melchior, Günther Gerisch,

More information

Tomography and Subtomogram Averaging

Tomography and Subtomogram Averaging Tomography and Subtomogram Averaging John Briggs EM course 2017 What do we need to get a 3D structure? Sample preparation methods A transmission electron microscope Different views of our object of interest

More information

Structural Information obtained

Structural Information obtained Structural Information obtained from Electron Microscopy Christiane Schaffitzel, 09.05.2013 Including slides from John Briggs, Bettina Boettcher, Nicolas Boisset, Andy Hoenger, Michael Schatz, and more

More information

Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques

Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques Sea Chen Department of Biomedical Engineering Advisors: Dr. Charles A. Bouman and Dr. Mark J. Lowe S. Chen Final Exam October

More information

3DEM > GENERAL METHODS. SINGLE PARTICLE RECONSTRUCTION (SPA): Introduction

3DEM > GENERAL METHODS. SINGLE PARTICLE RECONSTRUCTION (SPA): Introduction 3DEM > GENERAL METHODS SINGLE PARTICLE RECONSTRUCTION (SPA): Introduction SINGLE PARTICLE RECONSTRUCTION > INTRODUCTION General principle of single particle reconstruction o 2D projection images of a 3D

More information

EMBO Practical Course on Image Processing for Cryo EM 1-11 September 2015

EMBO Practical Course on Image Processing for Cryo EM 1-11 September 2015 EMBO Practical Course on Image Processing for Cryo EM 1-11 September 2015 Practical 4: Optional part for experienced IMOD users - Reconstructing a cryo tomogram and sub-tomogram averaging of GroEL IMOD

More information

Supporting information SI 0: TEM & STEM acquisition parameters, in 2D and 3D

Supporting information SI 0: TEM & STEM acquisition parameters, in 2D and 3D Electronic Supplementary Material (ESI) for Nanoscale. This journal is The Royal Society of Chemistry 2015 Supporting information SI 0: TEM & STEM acquisition parameters, in 2D and 3D Electron tomography

More information

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror

Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror Single-particle electron microscopy (cryo-electron microscopy) CS/CME/BioE/Biophys/BMI 279 Nov. 16 and 28, 2017 Ron Dror 1 Last month s Nobel Prize in Chemistry Awarded to Jacques Dubochet, Joachim Frank

More information

Image Acquisition Systems

Image Acquisition Systems Image Acquisition Systems Goals and Terminology Conventional Radiography Axial Tomography Computer Axial Tomography (CAT) Magnetic Resonance Imaging (MRI) PET, SPECT Ultrasound Microscopy Imaging ITCS

More information

Image Alignment and Application of 2D Fast Rotational Matching in Single Particle cryo-electron Microscopy. Yao Cong. Baylor College of Medicine

Image Alignment and Application of 2D Fast Rotational Matching in Single Particle cryo-electron Microscopy. Yao Cong. Baylor College of Medicine Image Alignment and Application of 2D Fast Rotational Matching in Single Particle cryo-electron Microscopy Yao Cong Baylor College of Medicine cryo-em & single particle analysis Single-particle electron

More information

Ultrasonic Multi-Skip Tomography for Pipe Inspection

Ultrasonic Multi-Skip Tomography for Pipe Inspection 18 th World Conference on Non destructive Testing, 16-2 April 212, Durban, South Africa Ultrasonic Multi-Skip Tomography for Pipe Inspection Arno VOLKER 1, Rik VOS 1 Alan HUNTER 1 1 TNO, Stieltjesweg 1,

More information

2D and 3D Alignment for Electron Microscopy via Graphics Processing Units

2D and 3D Alignment for Electron Microscopy via Graphics Processing Units 2D and 3D Alignment for Electron Microscopy via Graphics Processing Units Eduardo García 1, Miguel Mateo 1, Alessandro Deideri 1, Ana Iriarte 1, Carlos O.S. Sorzano 1,2, and Gabriel Caffarena 1 1 University

More information

Lecture 3: Geometric and Signal 3D Processing (and some Visualization)

Lecture 3: Geometric and Signal 3D Processing (and some Visualization) Lecture 3: Geometric and Signal 3D Processing (and some Visualization) Chandrajit Bajaj Algorithms & Tools Structure elucidation: filtering, contrast enhancement, segmentation, skeletonization, subunit

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Third Edition Rafael C. Gonzalez University of Tennessee Richard E. Woods MedData Interactive PEARSON Prentice Hall Pearson Education International Contents Preface xv Acknowledgments

More information

3D Energy Dispersive Spectroscopy Elemental Tomography in the Scanning Transmission Electron Microscope

3D Energy Dispersive Spectroscopy Elemental Tomography in the Scanning Transmission Electron Microscope 3D Energy Dispersive Spectroscopy Elemental Tomography in the Scanning Transmission Electron Microscope Brian Van Devener Topics 1.Introduction to EDS in the STEM 2.Extending EDS into three dimensions

More information

Denoising Cryotomograms with IMOD

Denoising Cryotomograms with IMOD Denoising Cryotomograms with IMOD Reasons to Denoise Cryotomograms Easier segmentation of features Presentation Particle picking for subvolume averaging The high-resolution information that you hope to

More information

Supplementary Materials

Supplementary Materials Supplementary Materials Microtubule doublets isolated from sea urchin sperm were studied by cryoelectron tomography, producing a density map in which we can identify a number of nontubulin components,

More information

X-RAY crystallography [1], [2] and nuclear magnetic. Computational Approaches for Automatic Structural Analysis of Large Bio-molecular Complexes

X-RAY crystallography [1], [2] and nuclear magnetic. Computational Approaches for Automatic Structural Analysis of Large Bio-molecular Complexes IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 1 Computational Approaches for Automatic Structural Analysis of Large Bio-molecular Complexes Zeyun Yu, Student Member, IEEE, Chandrajit

More information

Cryo-electron microscopy Cryo-EM. Garry Taylor

Cryo-electron microscopy Cryo-EM. Garry Taylor Cryo-electron microscopy Cryo-EM Garry Taylor www.st-andrews.ac.uk/~glt2/bl3301 Electron has a wavelength de Broglie relationship: m v = h / λ or λ = h / mv Accelerate e - in a field of potential V, it

More information

Likelihood-based optimization of cryo-em data. Sjors Scheres National Center for Biotechnology CSIC Madrid, Spain

Likelihood-based optimization of cryo-em data. Sjors Scheres National Center for Biotechnology CSIC Madrid, Spain Likelihood-based optimization of cryo-em data Sjors Scheres National Center for Biotechnology CSIC Madrid, Spain Life based on molecular machines DNA replication Protein synthesis Dynein motion Molecular

More information

Chapter 4. Clustering Core Atoms by Location

Chapter 4. Clustering Core Atoms by Location Chapter 4. Clustering Core Atoms by Location In this chapter, a process for sampling core atoms in space is developed, so that the analytic techniques in section 3C can be applied to local collections

More information

Vision in the Small: Reconstructing the Structure of Protein Macromolecules from Cryo-Electron Micrographs

Vision in the Small: Reconstructing the Structure of Protein Macromolecules from Cryo-Electron Micrographs Vision in the Small: Reconstructing the Structure of Protein Macromolecules from Cryo-Electron Micrographs Satya Mallick Sameer Agarwal David Kriegman Serge Belongie Computer Science and Engineering University

More information

Coherent Diffraction Imaging of Biological Materials

Coherent Diffraction Imaging of Biological Materials Coherent Diffraction Imaging of Biological Materials Jianwei Miao Dept. of Physics and Astronomy & California NanoSystems Institute UCLA Workshop on Science with Free Electron Lasers SINAP, Shanghai, Aug.

More information

MEDICAL IMAGE ANALYSIS

MEDICAL IMAGE ANALYSIS SECOND EDITION MEDICAL IMAGE ANALYSIS ATAM P. DHAWAN g, A B IEEE Engineering in Medicine and Biology Society, Sponsor IEEE Press Series in Biomedical Engineering Metin Akay, Series Editor +IEEE IEEE PRESS

More information

Fast 3D Mean Shift Filter for CT Images

Fast 3D Mean Shift Filter for CT Images Fast 3D Mean Shift Filter for CT Images Gustavo Fernández Domínguez, Horst Bischof, and Reinhard Beichel Institute for Computer Graphics and Vision, Graz University of Technology Inffeldgasse 16/2, A-8010,

More information

Maximum-likelihood methods

Maximum-likelihood methods Maximum-likelihood methods Fred Sigworth, Andrew Barthel, Hemant Tagare Yale University Maximum Likelihood solves all problems. a b Frequency µ 1 µ 2 µ 3 Measured value 3D reconstruction as an optimization

More information

II: Single particle cryoem - an averaging technique

II: Single particle cryoem - an averaging technique II: Single particle cryoem - an averaging technique Radiation damage limits the total electron dose that can be used to image biological sample. Thus, images of frozen hydrated macromolecules are very

More information

Digital Volume Correlation for Materials Characterization

Digital Volume Correlation for Materials Characterization 19 th World Conference on Non-Destructive Testing 2016 Digital Volume Correlation for Materials Characterization Enrico QUINTANA, Phillip REU, Edward JIMENEZ, Kyle THOMPSON, Sharlotte KRAMER Sandia National

More information

Chapter 1 Introduction

Chapter 1 Introduction Chapter 1 Introduction 1.1 Structural biology, cryo-em and image processing Structural biology is a branch of life science which focuses on the structures of biological macromolecules, investigating what

More information

Determination of the image orientation

Determination of the image orientation Lecture E. Orlova Determination of the image orientation Images of molecules in vitreous ice Images: shadow, projection Euler angles Methods of orientation determination: Common lines in Fourier space

More information

Evaluation of Local Filter Approaches for Diffusion Tensor based Fiber Tracking

Evaluation of Local Filter Approaches for Diffusion Tensor based Fiber Tracking Evaluation of Local Filter Approaches for Diffusion Tensor based Fiber Tracking D. Merhof 1, M. Buchfelder 2, C. Nimsky 3 1 Visual Computing, University of Konstanz, Konstanz 2 Department of Neurosurgery,

More information

Locating ego-centers in depth for hippocampal place cells

Locating ego-centers in depth for hippocampal place cells 204 5th Joint Symposium on Neural Computation Proceedings UCSD (1998) Locating ego-centers in depth for hippocampal place cells Kechen Zhang,' Terrence J. Sejeowski112 & Bruce L. ~cnau~hton~ 'Howard Hughes

More information

EE795: Computer Vision and Intelligent Systems

EE795: Computer Vision and Intelligent Systems EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 WRI C225 Lecture 04 130131 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Histogram Equalization Image Filtering Linear

More information

Lecture 8. Conical tilt reconstruction

Lecture 8. Conical tilt reconstruction Lecture 8 Conical tilt reconstruction Central section theorem Euler angles Conical tilt series Missing cone artefact Early D studies and negative staining problems Perspectives and new trends Tilt series

More information

Generation of Hulls Encompassing Neuronal Pathways Based on Tetrahedralization and 3D Alpha Shapes

Generation of Hulls Encompassing Neuronal Pathways Based on Tetrahedralization and 3D Alpha Shapes Generation of Hulls Encompassing Neuronal Pathways Based on Tetrahedralization and 3D Alpha Shapes Dorit Merhof 1,2, Martin Meister 1, Ezgi Bingöl 1, Peter Hastreiter 1,2, Christopher Nimsky 2,3, Günther

More information

CoE4TN4 Image Processing. Chapter 5 Image Restoration and Reconstruction

CoE4TN4 Image Processing. Chapter 5 Image Restoration and Reconstruction CoE4TN4 Image Processing Chapter 5 Image Restoration and Reconstruction Image Restoration Similar to image enhancement, the ultimate goal of restoration techniques is to improve an image Restoration: a

More information

Initial Model Generation

Initial Model Generation Initial Model Generation Workshop on Advanced Topics in EM Structure Determination The Scripps Research Institute La Jolla, November 2007 The issue: Structures of the IP3 receptor as determined by single

More information

Multi-Domain Pattern. I. Problem. II. Driving Forces. III. Solution

Multi-Domain Pattern. I. Problem. II. Driving Forces. III. Solution Multi-Domain Pattern I. Problem The problem represents computations characterized by an underlying system of mathematical equations, often simulating behaviors of physical objects through discrete time

More information

Central Slice Theorem

Central Slice Theorem Central Slice Theorem Incident X-rays y f(x,y) R x r x Detected p(, x ) The thick line is described by xcos +ysin =R Properties of Fourier Transform F [ f ( x a)] F [ f ( x)] e j 2 a Spatial Domain Spatial

More information

Fourier analysis of low-resolution satellite images of cloud

Fourier analysis of low-resolution satellite images of cloud New Zealand Journal of Geology and Geophysics, 1991, Vol. 34: 549-553 0028-8306/91/3404-0549 $2.50/0 Crown copyright 1991 549 Note Fourier analysis of low-resolution satellite images of cloud S. G. BRADLEY

More information

Minimizing Noise and Bias in 3D DIC. Correlated Solutions, Inc.

Minimizing Noise and Bias in 3D DIC. Correlated Solutions, Inc. Minimizing Noise and Bias in 3D DIC Correlated Solutions, Inc. Overview Overview of Noise and Bias Digital Image Correlation Background/Tracking Function Minimizing Noise Focus Contrast/Lighting Glare

More information

Blob-Representation of Multidimensional Objects and Surfaces

Blob-Representation of Multidimensional Objects and Surfaces Blob-Representation of Multidimensional Objects and Surfaces Edgar Garduño and Gabor T. Herman Department of Computer Science The Graduate Center City University of New York Presentation Outline Reconstruction

More information

SuRVoS Workbench. Super-Region Volume Segmentation. Imanol Luengo

SuRVoS Workbench. Super-Region Volume Segmentation. Imanol Luengo SuRVoS Workbench Super-Region Volume Segmentation Imanol Luengo Index - The project - What is SuRVoS - SuRVoS Overview - What can it do - Overview of the internals - Current state & Limitations - Future

More information

Vivekananda. Collegee of Engineering & Technology. Question and Answers on 10CS762 /10IS762 UNIT- 5 : IMAGE ENHANCEMENT.

Vivekananda. Collegee of Engineering & Technology. Question and Answers on 10CS762 /10IS762 UNIT- 5 : IMAGE ENHANCEMENT. Vivekananda Collegee of Engineering & Technology Question and Answers on 10CS762 /10IS762 UNIT- 5 : IMAGE ENHANCEMENT Dept. Prepared by Harivinod N Assistant Professor, of Computer Science and Engineering,

More information

Efficient Image Compression of Medical Images Using the Wavelet Transform and Fuzzy c-means Clustering on Regions of Interest.

Efficient Image Compression of Medical Images Using the Wavelet Transform and Fuzzy c-means Clustering on Regions of Interest. Efficient Image Compression of Medical Images Using the Wavelet Transform and Fuzzy c-means Clustering on Regions of Interest. D.A. Karras, S.A. Karkanis and D. E. Maroulis University of Piraeus, Dept.

More information

Registration concepts for the just-in-time artefact correction by means of virtual computed tomography

Registration concepts for the just-in-time artefact correction by means of virtual computed tomography DIR 2007 - International Symposium on Digital industrial Radiology and Computed Tomography, June 25-27, 2007, Lyon, France Registration concepts for the just-in-time artefact correction by means of virtual

More information

The same X-ray transparent in situ pouch cell design and sample holder plates were used for both 2D

The same X-ray transparent in situ pouch cell design and sample holder plates were used for both 2D Electronic Supplementary Material (ESI) for Energy & Environmental Science. This journal is The Royal Society of Chemistry 2014 Supplementary Information Experimental Materials and Electrochemistry The

More information

HIGH RESOLUTION COMPUTED TOMOGRAPHY FOR METROLOGY

HIGH RESOLUTION COMPUTED TOMOGRAPHY FOR METROLOGY HIGH RESOLUTION COMPUTED TOMOGRAPHY FOR METROLOGY David K. Lehmann 1, Kathleen Brockdorf 1 and Dirk Neuber 2 1 phoenix x-ray Systems + Services Inc. St. Petersburg, FL, USA 2 phoenix x-ray Systems + Services

More information

Digital Image Processing

Digital Image Processing Digital Image Processing SPECIAL TOPICS CT IMAGES Hamid R. Rabiee Fall 2015 What is an image? 2 Are images only about visual concepts? We ve already seen that there are other kinds of image. In this lecture

More information

Diffraction. Single-slit diffraction. Diffraction by a circular aperture. Chapter 38. In the forward direction, the intensity is maximal.

Diffraction. Single-slit diffraction. Diffraction by a circular aperture. Chapter 38. In the forward direction, the intensity is maximal. Diffraction Chapter 38 Huygens construction may be used to find the wave observed on the downstream side of an aperture of any shape. Diffraction The interference pattern encodes the shape as a Fourier

More information

Michael Moody School of Pharmacy University of London 29/39 Brunswick Square London WC1N 1AX, U.K.

Michael Moody School of Pharmacy University of London 29/39 Brunswick Square London WC1N 1AX, U.K. This material is provided for educational use only. The information in these slides including all data, images and related materials are the property of : Michael Moody School of Pharmacy University of

More information

INDUSTRIAL SYSTEM DEVELOPMENT FOR VOLUMETRIC INTEGRITY

INDUSTRIAL SYSTEM DEVELOPMENT FOR VOLUMETRIC INTEGRITY INDUSTRIAL SYSTEM DEVELOPMENT FOR VOLUMETRIC INTEGRITY VERIFICATION AND ANALYSIS M. L. Hsiao and J. W. Eberhard CR&D General Electric Company Schenectady, NY 12301 J. B. Ross Aircraft Engine - QTC General

More information

METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS

METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS M. Lefler, H. Hel-Or Dept. of CS, University of Haifa, Israel Y. Hel-Or School of CS, IDC, Herzliya, Israel ABSTRACT Video analysis often requires

More information

Intrinsic Classification of Single Particle Images by Spectral Clustering

Intrinsic Classification of Single Particle Images by Spectral Clustering Intrinsic Classification of Single Particle Images by Spectral Clustering Yutaka Ueno 1, Masaki Kawata 2 and Shinji Umeyama 1 1 Neuroscience Research Institute, 2 Grid Technology Research Center, National

More information

Towards full-body X-ray images

Towards full-body X-ray images Towards full-body X-ray images Christoph Luckner 1,2, Thomas Mertelmeier 2, Andreas Maier 1, Ludwig Ritschl 2 1 Pattern Recognition Lab, FAU Erlangen-Nuernberg 2 Siemens Healthcare GmbH, Forchheim christoph.luckner@fau.de

More information

A NEW APPROACH FOR 3D SEGMENTATION OF CELLULAR TOMOGRAMS OBTAINED USING THREE-DIMENSIONAL ELECTRON MICROSCOPY

A NEW APPROACH FOR 3D SEGMENTATION OF CELLULAR TOMOGRAMS OBTAINED USING THREE-DIMENSIONAL ELECTRON MICROSCOPY A NEW APPROACH FOR 3D SEGMENTATION OF CELLULAR TOMOGRAMS OBTAINED USING THREE-DIMENSIONAL ELECTRON MICROSCOPY A. Bartesaghi and G. Sapiro University of Minnesota Electrical and Computer Engineering Department

More information

RADIOMICS: potential role in the clinics and challenges

RADIOMICS: potential role in the clinics and challenges 27 giugno 2018 Dipartimento di Fisica Università degli Studi di Milano RADIOMICS: potential role in the clinics and challenges Dr. Francesca Botta Medical Physicist Istituto Europeo di Oncologia (Milano)

More information

Compressed Sensing for Electron Tomography

Compressed Sensing for Electron Tomography University of Maryland, College Park Department of Mathematics February 10, 2015 1/33 Outline I Introduction 1 Introduction 2 3 4 2/33 1 Introduction 2 3 4 3/33 Tomography Introduction Tomography - Producing

More information

Projection and Reconstruction-Based Noise Filtering Methods in Cone Beam CT

Projection and Reconstruction-Based Noise Filtering Methods in Cone Beam CT Projection and Reconstruction-Based Noise Filtering Methods in Cone Beam CT Benedikt Lorch 1, Martin Berger 1,2, Joachim Hornegger 1,2, Andreas Maier 1,2 1 Pattern Recognition Lab, FAU Erlangen-Nürnberg

More information

Three-dimensional structure and flexibility of a membrane-coating module of the nuclear pore complex

Three-dimensional structure and flexibility of a membrane-coating module of the nuclear pore complex CORRECTION NOTICE Nat. Struct. Mol. Biol. advance online publication, doi:10.1038/nsmb.1618 (7 June 2009) Three-dimensional structure and flexibility of a membrane-coating module of the nuclear pore complex

More information

A method and algorithm for Tomographic Imaging of highly porous specimen using Low Frequency Acoustic/Ultrasonic signals

A method and algorithm for Tomographic Imaging of highly porous specimen using Low Frequency Acoustic/Ultrasonic signals More Info at Open Access Database www.ndt.net/?id=15210 A method and algorithm for Tomographic Imaging of highly porous specimen using Low Frequency Acoustic/Ultrasonic signals Subodh P S 1,a, Reghunathan

More information

SUPPLEMENTARY FILE S1: 3D AIRWAY TUBE RECONSTRUCTION AND CELL-BASED MECHANICAL MODEL. RELATED TO FIGURE 1, FIGURE 7, AND STAR METHODS.

SUPPLEMENTARY FILE S1: 3D AIRWAY TUBE RECONSTRUCTION AND CELL-BASED MECHANICAL MODEL. RELATED TO FIGURE 1, FIGURE 7, AND STAR METHODS. SUPPLEMENTARY FILE S1: 3D AIRWAY TUBE RECONSTRUCTION AND CELL-BASED MECHANICAL MODEL. RELATED TO FIGURE 1, FIGURE 7, AND STAR METHODS. 1. 3D AIRWAY TUBE RECONSTRUCTION. RELATED TO FIGURE 1 AND STAR METHODS

More information

Supplementary Information. Structure of a RSC nucleosome Complex and Insights into Chromatin Remodeling

Supplementary Information. Structure of a RSC nucleosome Complex and Insights into Chromatin Remodeling Supplementary Information Structure of a RSC nucleosome Complex and Insights into Chromatin Remodeling Yuriy Chaban 1, Chukwudi Ezeokonkwo 1, Wen-Hsiang Chung 1, Fan Zhang 1, Roger D. Kornberg 2, Barbara

More information

Seismic Noise Attenuation Using Curvelet Transform and Dip Map Data Structure

Seismic Noise Attenuation Using Curvelet Transform and Dip Map Data Structure Seismic Noise Attenuation Using Curvelet Transform and Dip Map Data Structure T. Nguyen* (PGS), Y.J. Liu (PGS) Summary The curvelet transform is a known tool used in the attenuation of coherent and incoherent

More information

Image Denoising Based on Hybrid Fourier and Neighborhood Wavelet Coefficients Jun Cheng, Songli Lei

Image Denoising Based on Hybrid Fourier and Neighborhood Wavelet Coefficients Jun Cheng, Songli Lei Image Denoising Based on Hybrid Fourier and Neighborhood Wavelet Coefficients Jun Cheng, Songli Lei College of Physical and Information Science, Hunan Normal University, Changsha, China Hunan Art Professional

More information

DEVELOPMENT OF CONE BEAM TOMOGRAPHIC RECONSTRUCTION SOFTWARE MODULE

DEVELOPMENT OF CONE BEAM TOMOGRAPHIC RECONSTRUCTION SOFTWARE MODULE Rajesh et al. : Proceedings of the National Seminar & Exhibition on Non-Destructive Evaluation DEVELOPMENT OF CONE BEAM TOMOGRAPHIC RECONSTRUCTION SOFTWARE MODULE Rajesh V Acharya, Umesh Kumar, Gursharan

More information

An Approach for Reduction of Rain Streaks from a Single Image

An Approach for Reduction of Rain Streaks from a Single Image An Approach for Reduction of Rain Streaks from a Single Image Vijayakumar Majjagi 1, Netravati U M 2 1 4 th Semester, M. Tech, Digital Electronics, Department of Electronics and Communication G M Institute

More information

Enhanced material contrast by dual-energy microct imaging

Enhanced material contrast by dual-energy microct imaging Enhanced material contrast by dual-energy microct imaging Method note Page 1 of 12 2 Method note: Dual-energy microct analysis 1. Introduction 1.1. The basis for dual energy imaging Micro-computed tomography

More information

S93-8 Page 1 TOMOGRAPHIC APPROACHES TO NONWOVENS STRUCTURE DEFINITION

S93-8 Page 1 TOMOGRAPHIC APPROACHES TO NONWOVENS STRUCTURE DEFINITION S93-8 Page 1 TOMOGRAPHIC APPROACHES TO NONWOVENS STRUCTURE DEFINITION PIs: T. Gilmore, H. Davis, Z. Mi, North Carolina State University Code: S93-8 Date of Report: 9/94 RELEVANCE TO NTC MISSION AND GOALS:

More information

n o r d i c B r a i n E x Tutorial DTI Module

n o r d i c B r a i n E x Tutorial DTI Module m a k i n g f u n c t i o n a l M R I e a s y n o r d i c B r a i n E x Tutorial DTI Module Please note that this tutorial is for the latest released nordicbrainex. If you are using an older version please

More information

EXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,

EXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006, School of Computer Science and Communication, KTH Danica Kragic EXAM SOLUTIONS Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006, 14.00 19.00 Grade table 0-25 U 26-35 3 36-45

More information

HIGH-SPEED THEE-DIMENSIONAL TOMOGRAPHIC IMAGING OF FRAGMENTS AND PRECISE STATISTICS FROM AN AUTOMATED ANALYSIS

HIGH-SPEED THEE-DIMENSIONAL TOMOGRAPHIC IMAGING OF FRAGMENTS AND PRECISE STATISTICS FROM AN AUTOMATED ANALYSIS 23 RD INTERNATIONAL SYMPOSIUM ON BALLISTICS TARRAGONA, SPAIN 16-20 APRIL 2007 HIGH-SPEED THEE-DIMENSIONAL TOMOGRAPHIC IMAGING OF FRAGMENTS AND PRECISE STATISTICS FROM AN AUTOMATED ANALYSIS P. Helberg 1,

More information

Bioimage Informatics. Lecture 8, Spring Bioimage Data Analysis (II): Point Feature Detection

Bioimage Informatics. Lecture 8, Spring Bioimage Data Analysis (II): Point Feature Detection Bioimage Informatics Lecture 8, Spring 2012 Bioimage Data Analysis (II): Point Feature Detection Lecture 8 February 13, 2012 1 Outline Project assignment 02 Comments on reading assignment 01 Review: pixel

More information

Implementation of a backprojection algorithm on CELL

Implementation of a backprojection algorithm on CELL Implementation of a backprojection algorithm on CELL Mario Koerner March 17, 2006 1 Introduction X-ray imaging is one of the most important imaging technologies in medical applications. It allows to look

More information

Crystallography & Cryo-electron microscopy

Crystallography & Cryo-electron microscopy Crystallography & Cryo-electron microscopy Methods in Molecular Biophysics, Spring 2010 Sample preparation Symmetries and diffraction Single-particle reconstruction Image manipulation Basic idea of diffraction:

More information

An Acquisition Geometry-Independent Calibration Tool for Industrial Computed Tomography

An Acquisition Geometry-Independent Calibration Tool for Industrial Computed Tomography 4th International Symposium on NDT in Aerospace 2012 - Tu.3.A.3 An Acquisition Geometry-Independent Calibration Tool for Industrial Computed Tomography Jonathan HESS *, Patrick KUEHNLEIN *, Steven OECKL

More information

Advanced materials research using the Real-Time 3D Analytical FIB-SEM 'NX9000'

Advanced materials research using the Real-Time 3D Analytical FIB-SEM 'NX9000' SCIENTIFIC INSTRUMENT NEWS 2017 Vol. 9 SEPTEMBER Technical magazine of Electron Microscope and Analytical Instruments. Technical Explanation Advanced materials research using the Real-Time 3D Analytical

More information

Outline 7/2/201011/6/

Outline 7/2/201011/6/ Outline Pattern recognition in computer vision Background on the development of SIFT SIFT algorithm and some of its variations Computational considerations (SURF) Potential improvement Summary 01 2 Pattern

More information

GENERAL AUTOMATED FLAW DETECTION SCHEME FOR NDE X-RAY IMAGES

GENERAL AUTOMATED FLAW DETECTION SCHEME FOR NDE X-RAY IMAGES GENERAL AUTOMATED FLAW DETECTION SCHEME FOR NDE X-RAY IMAGES Karl W. Ulmer and John P. Basart Center for Nondestructive Evaluation Department of Electrical and Computer Engineering Iowa State University

More information

Constrained Reconstruction of Sparse Cardiac MR DTI Data

Constrained Reconstruction of Sparse Cardiac MR DTI Data Constrained Reconstruction of Sparse Cardiac MR DTI Data Ganesh Adluru 1,3, Edward Hsu, and Edward V.R. DiBella,3 1 Electrical and Computer Engineering department, 50 S. Central Campus Dr., MEB, University

More information

Scattering/Wave Terminology A few terms show up throughout the discussion of electron microscopy:

Scattering/Wave Terminology A few terms show up throughout the discussion of electron microscopy: 1. Scattering and Diffraction Scattering/Wave Terology A few terms show up throughout the discussion of electron microscopy: First, what do we mean by the terms elastic and inelastic? These are both related

More information

A Study of Medical Image Analysis System

A Study of Medical Image Analysis System Indian Journal of Science and Technology, Vol 8(25), DOI: 10.17485/ijst/2015/v8i25/80492, October 2015 ISSN (Print) : 0974-6846 ISSN (Online) : 0974-5645 A Study of Medical Image Analysis System Kim Tae-Eun

More information