C9940: 3-Dimensional Transmission Electron Microscopy Lecture 3: Analysis of electron micrographs Content - interaction of electrons with matter, radiation damage - data acquisition, image filtering - projection theorem - image averaging in 2D - principal component analysis Interaction of electrons with specimen Williams et al., TEM, Springer Interaction of electrons with specimen Williams et al., TEM, Springer cryo-TEM Peet et al., (2019) Ultramicroscopy mean free path - mean free path of inelastic scattering in vitrified biological specimens: ~395nm Radiation damage Glaser R. (2016), Meth. Enzym. Radiation damage Glaser R. (2016), Meth. Enzym. Glaser R. (2016), Meth. Enzym. Radiation damage Glaser R. (2016), Meth. Enzym. Grant. (2015), eLife Interaction of electrons with specimen Peet et al., (2019) Ultramicroscopy Data acquisition - data fom each position on the sample stored as a short movie - compensation of sample radiation damage - compensation of the sample motion during exposure Data acquisition - data fom each position on the sample stored as a short movie - compensation of sample radiation damage - compensation of the sample motion during exposure - beam induced motion (sample geometry, local) - drift, vibration (external sources, global) x[i] shift y[i]shift Data acquisition - averaging of the movie into single image – increase S/N - compensation for the global and local motion between the frames – minimize image blur, maximize high-res. Info - dose-weighting – frame filtering based on acquired radiation damage global motion additional local motion Data acquisition - averaging of the movie into single image – increase S/N - compensation for the global and local motion between the frames – minimize image blur, maximize high-res. Info - dose-weighting – frame filtering based on acquired radiation damage aligned image unaligned image aligned image unaligned image Data acquisition - averaging of the movie into single image – increase S/N - compensation for the global and local motion between the frames – minimize image blur, maximize high-res. Info - dose-weighting – frame filtering based on acquired radiation damage - application of adaptive per-frame low pass filter before averaging tim e Image filtering unfiltered image lowpass filtered (50A) lowpass filtered (250A) 130A Image filtering unfiltered image lowpass filtered (50A) bandpass filtered (1000,10A) 130A Image formation Image formation Contrast transfer function A – amplitude contrast s – spatial frequency Cs – spherical abberation λ – electron wavelength z – defocus Contrast transfer function - Finite source size - Energy spread (defocus) - MTF of the camera - Generic envelope (drift, charging, multiple scattering) Envelope function Contrast transfer function Envelope function kV=300,ac=0.07,cs=2.7,z=-1,apix=1,B=30 kV=300,ac=0.07,cs=2.7,z=-1,apix=1,B=300 Contrast transfer function Low defocus High defocus Projection theorem John O’Brien (1991). The New Yorker Projection theorem The 2D Fourier transform of the projection of a 3D density is a central section of the 3D Fourier transform of the density, perpendicular to the direction of projection. Particles (regions of interest) n=1 Particles (regions of interest) n=1 n=2 n=8 n=16 n=64 n=256 Signal to noise ratio increases with square-root of n Image alignment in 2D Sum of unaligned particles Sum of aligned particles Image alignment in 2D In order to align the particles in 2D, we need to determine three parameters: - two translational - one rotational (on of the Euler angles) δx δy ψ ψ δy δx ψ δx Image alignment in 2D Cross correlation Cross correlation Cross correlation coefficient normalization If the alignment is perfect, the cross-correlation coefficient will be 1 Cross correlation Cross correlation Cross correlation function in 1D Cross correlation function in 1D Cross correlation function in 2D Cross correlation function in 2D Convolution Cross correlation function in 2D Convolution FT(F I) = FT(F) . FT(I) FT(F I) = FT(F)* . FT(I) Convolution theorem Cross correlation function Orientation alignment We take a series of rings from each image, unravel them, and compute a series of 1D cross-correlation functions. Shifts along these unraveled CCFs is equivalent to a rotation in Cartesian space. Orientation alignment Orientation alignment Orientation alignment Orientation alignment - after rotation Image alignment in 2D Translational and orientation alignment are interdependent SOLUTION: You try a set of reasonable shifts, and perform separate orientation alignments for each. Image alignment in 2D Set of all shifts of up to 1 pixel Set of all new shifts of up to 2 pixels Shifts of (0, +/-1, +/-2) pixels results in 25 orientation searches. Interpolation Suppose we shift the image in x & y. The new pixels will be weighted averages of the old pixels. The more the mix the pixels, the worse the result will be. Shift Interpolation Suppose we shift the image in x & y. The new pixels will be weighted averages of the old pixels. The more the mix the pixels, the worse the result will be. Shift Interpolation Suppose we shift the image in x & y. The new pixels will be weighted averages of the old pixels. The more the mix the pixels, the worse the result will be. Shift Rotation Interpolation The Fourier transform of noise is noise - “White” noise is evenly distributed in Fourier space - “White” means that each pixel is independent Interpolation The Fourier transform of noise is noise - “White” noise is evenly distributed in Fourier space - “White” means that each pixel is independent The degradation of the images means that we should minimize the number of interpolations. Classification Frank (1996), J.Microscopy Classification Classification methods are divided into those that are “supervised” and those which are “unsupervised”: - Supervised: divide or categorize according to similarity with “template” or “reference” (e.g. projection mathing - Unsupervised: divide according to intrinsic properties (e.g. find classess of projections representing the same view Frank (1996), J.Microscopy Classification Reference based alignment Multivariate data analysis (MDA) or multivariate statistical analysis (MSA) - find new coordinate system tailored to the data - find a space with reduced dimensionality for the representation of the objects. This greatly simplifies classification. eigenvectors Multivariate data analysis (MDA) or multivariate statistical analysis (MSA) - find new coordinate system tailored to the data - find a space with reduced dimensionality for the representation of the objects. This greatly simplifies classification. eigenimages Principle component analysis (PCA), Correspondence analysis (CA) Principle component analysis (PCA), Correspondence analysis (CA) eigenimages For a 4096-pixel image, we will have a 4096x4096 covariance matrix. Row-reduction of the covariance matrix gives us “eigenvectors.” - The eigenvectors describe correlated variations in the data. - The eigenvectors have 4096 elements and can beconverted back into images, called “eigenimages.” - The first eigenvectors will account for the most variation. The later eigenvectors may only describe noise. - Linear combinations of these images will give us approximations of the classes that make up the data. Principle component analysis (PCA), Correspondence analysis (CA) Linear combinations of these images will give us approximations of the classes that make up the data.