-
Structured Detection for Simultaneous Super-Resolution and Optical Sectioning in Laser Scanning Microscopy
Authors:
Alessandro Zunino,
Giacomo Garrè,
Eleonora Perego,
Sabrina Zappone,
Mattia Donato,
Giuseppe Vicidomini
Abstract:
Fast and sensitive detector arrays enable image scanning microscopy (ISM), overcoming the trade-off between spatial resolution and signal-to-noise ratio (SNR) typical of confocal microscopy. However, current ISM approaches cannot provide optical sectioning and fail with thick samples, unless the size of the detector is limited. Thus, another trade-off between optical sectioning and SNR persists. H…
▽ More
Fast and sensitive detector arrays enable image scanning microscopy (ISM), overcoming the trade-off between spatial resolution and signal-to-noise ratio (SNR) typical of confocal microscopy. However, current ISM approaches cannot provide optical sectioning and fail with thick samples, unless the size of the detector is limited. Thus, another trade-off between optical sectioning and SNR persists. Here, we propose a method without drawbacks that combines uncompromised super-resolution, high SNR, and optical sectioning. Furthermore, our approach enables super-sampling of images, relaxing Nyquist's criterion by a factor of two. Based on the observation that imaging with a detector array inherently embeds axial information about the sample, we designed a straightforward reconstruction algorithm that inverts the physical model of ISM. We present the comprehensive theoretical framework and validate our method with synthetic and experimental images of biological samples captured using a custom setup equipped with a single-photon avalanche diode (SPAD) array detector. We demonstrate the feasibility of our approach exciting fluorescence emission both in the linear and non-linear regime. Moreover, we generalize the algorithm for fluorescence lifetime imaging, fully exploiting the single-photon timing ability of the SPAD array detector. Our method outperforms conventional approaches to ISM and can be extended to any LSM technique.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
Image Scanning Microscopy Reconstruction by Autocorrelation Inversion
Authors:
Daniele Ancora,
Alessandro Zunino,
Giuseppe Vicidomini,
Alvaro H. Crevenna
Abstract:
Confocal laser scanning microscopy (CLSM) stands out as one of the most widely used microscopy techniques, thanks to its three-dimensional imaging capability and its sub-diffraction spatial resolution, achieved through the closure of a pinhole in front of a single-element detector. However, the pinhole also rejects useful photons and beating the diffraction limit comes at the price of irremediably…
▽ More
Confocal laser scanning microscopy (CLSM) stands out as one of the most widely used microscopy techniques, thanks to its three-dimensional imaging capability and its sub-diffraction spatial resolution, achieved through the closure of a pinhole in front of a single-element detector. However, the pinhole also rejects useful photons and beating the diffraction limit comes at the price of irremediably compromising the signal-to-noise ratio (SNR) of the data. Image scanning microscopy (ISM) emerged as the natural evolution of CLSM, exploiting a small array detector in place of the pinhole and the single-element detector. Each sensitive element is small enough to achieve sub-diffraction resolution through the confocal effect, but the size of the whole detector is large enough to guarantee excellent collection efficiency and SNR. However, the raw data produced by an ISM setup consists of a 4D dataset which can be seen as a set of confocal-like images. Thus, fusing the dataset into a single super-resolved image requires a dedicated reconstruction algorithm. Conventional methods are multi-image deconvolution, which requires prior knowledge of the system point spread functions (PSF), or adaptive pixel reassignment (APR), which is effective only on a limited range of experimental conditions. In this work, we describe and validate a novel concept for ISM image reconstruction based on autocorrelation inversion. We leverage unique properties of the autocorrelation to discard low-frequency components and maximize the resolution of the reconstructed image, without any assumption on the image or any knowledge of the PSF. Our results push the quality of the ISM reconstruction beyond the level provided by APR and open new perspectives for multi-dimensional image processing.
△ Less
Submitted 13 April, 2024;
originally announced April 2024.
-
Reconstructing the Image Scanning Microscopy Dataset: an Inverse Problem
Authors:
Alessandro Zunino,
Marco Castello,
Giuseppe Vicidomini
Abstract:
Confocal laser-scanning microscopy (CLSM) is one of the most popular optical architectures for fluorescence imaging. In CLSM, a focused laser beam excites the fluorescence emission from a specific specimen position. Some actuators scan the probed region across the sample and a photodetector collects a single intensity value for each scan point, building a two-dimensional image pixel-by-pixel. Rece…
▽ More
Confocal laser-scanning microscopy (CLSM) is one of the most popular optical architectures for fluorescence imaging. In CLSM, a focused laser beam excites the fluorescence emission from a specific specimen position. Some actuators scan the probed region across the sample and a photodetector collects a single intensity value for each scan point, building a two-dimensional image pixel-by-pixel. Recently, new fast single-photon array detectors have allowed the recording of a full bi-dimensional image of the probed region for each scan point, transforming CLSM into image scanning microscopy (ISM). This latter offers significant improvements over traditional imaging but requires an optimal processing tool to extract a super-resolved image from the four-dimensional dataset. Here we describe the image formation process in ISM from a statistical point of view, and we use the Bayesian framework to formulate a multi-image deconvolution problem. Notably, the single-photon detector suffers exclusively from the photon shot noise, enabling the development of an effective likelihood model. We derive an iterative likelihood maximization algorithm and test it on experimental and simulated data. Furthermore, we demonstrate that the ISM dataset is redundant, enabling the possibility of obtaining reconstruction sampled at twice the scanning step. Our results prove that in ISM, under appropriate conditions, the Nyquist-Shannon sampling criterium is effectively relaxed. This finding can be exploited to speed up the acquisition process by a factor of four, further improving the versatility of ISM systems.
△ Less
Submitted 22 November, 2022;
originally announced November 2022.
-
SPAD-based asynchronous-readout array detectors for image-scanning microscopy
Authors:
Mauro Buttafava,
Federica Villa,
Marco Castello,
Giorgio Tortarolo,
Enrico Conca,
Mirko Sanzaro,
Simonluca Piazza,
Paolo Bianchini,
Alberto Diaspro,
Franco Zappa,
Giuseppe Vicidomini,
Alberto Tosi
Abstract:
Fluorescence microscopy and derived techniques are continuously looking for photodetectors able to guarantee increased sensitivity, high spatial and temporal resolution and ease of integration into modern microscopy architectures. Recent advances in single photon avalanche diodes (SPADs) fabricated with industry-standard microelectronic processes allow the development of new detection systems tail…
▽ More
Fluorescence microscopy and derived techniques are continuously looking for photodetectors able to guarantee increased sensitivity, high spatial and temporal resolution and ease of integration into modern microscopy architectures. Recent advances in single photon avalanche diodes (SPADs) fabricated with industry-standard microelectronic processes allow the development of new detection systems tailored to address the requirements of advanced imaging techniques (such as image-scanning microscopy). To this aim, we present the complete design and characterization of two bidimensional SPAD arrays composed of 25 fully independent and asynchronously-operated pixels, both having fill-factor of about 50% and specifically designed for being integrated into existing laser scanning microscopes. We used two different microelectronics technologies to fabricate our detectors: the first technology exhibiting very low noise (roughly 200 dark counts per second at room temperature), and the second one showing enhanced detection efficiency (more than 60% at a wavelength of 500 nm). Starting from the silicon-level device structures and moving towards the in pixel and readout electronics description, we present performance assessments and comparisons between the two detectors. Images of a biological sample acquired after their integration into our custom image-scanning microscope finally demonstrate their exquisite on-field performance in terms of spatial resolution and contrast enhancement. We envisage that this work can trigger the development of a new class of SPAD-based detector arrays able to substitute the typical single-element sensor used in fluorescence laser scanning microscopy.
△ Less
Submitted 26 February, 2020;
originally announced February 2020.
-
The 2015 super-resolution microscopy roadmap
Authors:
Stefan Hell,
Steffen Sahl,
Mark Bates,
Xiaowei Zhuang,
Rainer Heintzmann,
Martin J Booth,
Joerg Bewersdorf,
Gleb Shtengel,
Harald Hess,
Philipp Tinnefeld,
Alf Honigmann,
Stefan Jakobs,
Ilaria Testa,
Laurent Cognet,
Brahim Lounis,
Helge Ewers,
Simon J Davis,
Christian Eggeling,
David Klenerman,
Katrin Willig,
Giuseppe Vicidomini,
Marco Castello,
Alberto Diaspro,
Thorben Cordes,
Steffen J Sahl
, et al. (3 additional authors not shown)
Abstract:
Far-field optical microscopy using focused light is an important tool in a number of scientific disciplines including chemical, (bio)physical and biomedical research, particularly with respect to the study of living cells and organisms. Unfortunately, the applicability of the optical microscope is limited, since the diffraction of light imposes limitations on the spatial resolution of the image. C…
▽ More
Far-field optical microscopy using focused light is an important tool in a number of scientific disciplines including chemical, (bio)physical and biomedical research, particularly with respect to the study of living cells and organisms. Unfortunately, the applicability of the optical microscope is limited, since the diffraction of light imposes limitations on the spatial resolution of the image. Consequently the details of, for example, cellular protein distributions, can be visualized only to a certain extent. Fortunately, recent years have witnessed the development of 'super-resolution' far-field optical microscopy (nanoscopy) techniques such as stimulated emission depletion (STED), ground state depletion (GSD), reversible saturated optical (fluorescence) transitions (RESOLFT), photoactivation localization microscopy (PALM), stochastic optical reconstruction microscopy (STORM), structured illumination microscopy (SIM) or saturated structured illumination microscopy (SSIM), all in one way or another addressing the problem of the limited spatial resolution of far-field optical microscopy. While SIM achieves a two-fold improvement in spatial resolution compared to conventional optical microscopy, STED, RESOLFT, PALM/STORM, or SSIM have all gone beyond, pushing the limits of optical image resolution to the nanometer scale. Consequently, all super-resolution techniques open new avenues of biomedical research. Because the field is so young, the potential capabilities of different super-resolution microscopy approaches have yet to be fully explored, and uncertainties remain when considering the best choice of methodology. Thus, even for experts, the road to the future is sometimes shrouded in mist. The super-resolution optical microscopy roadmap of Journal of Physics D: Applied Physics addresses this need for clarity. It provides guidance to the outstanding questions through a collection of short review articles from experts in the field, giving a thorough discussion on the concepts underlying super-resolution optical microscopy, the potential of different approaches, the importance of label optimization (such as reversible photoswitchable proteins) and applications in which these methods will have a significant impact.
△ Less
Submitted 14 November, 2017;
originally announced November 2017.
