-
Probabilistic volumetric speckle suppression in OCT using deep learning
Authors:
Bhaskara Rao Chintada,
Sebastián Ruiz-Lopera,
René Restrepo,
Brett E. Bouma,
Martin Villiger,
Néstor Uribe-Patarroyo
Abstract:
We present a deep learning framework for volumetric speckle reduction in optical coherence tomography (OCT) based on a conditional generative adversarial network (cGAN) that leverages the volumetric nature of OCT data. In order to utilize the volumetric nature of OCT data, our network takes partial OCT volumes as input, resulting in artifact-free despeckled volumes that exhibit excellent speckle r…
▽ More
We present a deep learning framework for volumetric speckle reduction in optical coherence tomography (OCT) based on a conditional generative adversarial network (cGAN) that leverages the volumetric nature of OCT data. In order to utilize the volumetric nature of OCT data, our network takes partial OCT volumes as input, resulting in artifact-free despeckled volumes that exhibit excellent speckle reduction and resolution preservation in all three dimensions. Furthermore, we address the ongoing challenge of generating ground truth data for supervised speckle suppression deep learning frameworks by using volumetric non-local means despeckling-TNode to generate training data. We show that, while TNode processing is computationally demanding, it serves as a convenient, accessible gold-standard source for training data; our cGAN replicates efficient suppression of speckle while preserving tissue structures with dimensions approaching the system resolution of non-local means despeckling while being two orders of magnitude faster than TNode. We demonstrate fast, effective, and high-quality despeckling of the proposed network in different tissue types acquired with three different OCT systems compared to existing deep learning methods. The open-source nature of our work facilitates re-training and deployment in any OCT system with an all-software implementation, working around the challenge of generating high-quality, speckle-free training data.
△ Less
Submitted 7 December, 2023;
originally announced December 2023.
-
Single-Input Polarization-Sensitive Optical Coherence Tomography Through a Catheter
Authors:
Georgia L. Jones,
Qiaozhou Xiong,
Xinyu Liu,
Brett E. Bouma,
Martin Villiger
Abstract:
Intravascular polarimetry with catheter-based polarization-sensitive optical coherence tomography (PS-OCT) complements the high-resolution structural tomograms of OCT with morphological contrast available through polarimetry. Its clinical translation has been complicated by the need for modification of conventional OCT hardware to enable polarimetric measurements. Here, we present a signal process…
▽ More
Intravascular polarimetry with catheter-based polarization-sensitive optical coherence tomography (PS-OCT) complements the high-resolution structural tomograms of OCT with morphological contrast available through polarimetry. Its clinical translation has been complicated by the need for modification of conventional OCT hardware to enable polarimetric measurements. Here, we present a signal processing method to reconstruct polarization properties of tissue from measurements with a single input polarization state, bypassing the need for modulation or multiplexing of input states. Our method relies on a polarization symmetry intrinsic to round-trip measurements and uses the residual spectral variation of the polarization states incident on the tissue to avoid measurement ambiguities. We demonstrate depth-resolved birefringence and optic axis orientation maps reconstructed from in-vivo data of human coronary arteries. We validate our method through comparison with conventional dual-input state measurements and find a mean cumulative retardance error of 13.2deg without observable bias. The 95% limit of agreement between depth-resolved birefringence is 2.80 x 10^(-4), which is less than the agreement between two repeat pullbacks of conventional PS-OCT (3.14 x 10^(-4)), indicating that the two methods can be used interchangeably. The hardware simplification arising from using a single input state may be decisive in realizing the potential of polarimetric measurements for assessing coronary atherosclerosis in clinical practice.
△ Less
Submitted 5 December, 2023; v1 submitted 16 May, 2023;
originally announced May 2023.
-
Less is More: Rethinking Few-Shot Learning and Recurrent Neural Nets
Authors:
Deborah Pereg,
Martin Villiger,
Brett Bouma,
Polina Golland
Abstract:
The statistical supervised learning framework assumes an input-output set with a joint probability distribution that is reliably represented by the training dataset. The learner is then required to output a prediction rule learned from the training dataset's input-output pairs. In this work, we provide meaningful insights into the asymptotic equipartition property (AEP) \citep{Shannon:1948} in the…
▽ More
The statistical supervised learning framework assumes an input-output set with a joint probability distribution that is reliably represented by the training dataset. The learner is then required to output a prediction rule learned from the training dataset's input-output pairs. In this work, we provide meaningful insights into the asymptotic equipartition property (AEP) \citep{Shannon:1948} in the context of machine learning, and illuminate some of its potential ramifications for few-shot learning. We provide theoretical guarantees for reliable learning under the information-theoretic AEP, and for the generalization error with respect to the sample size. We then focus on a highly efficient recurrent neural net (RNN) framework and propose a reduced-entropy algorithm for few-shot learning. We also propose a mathematical intuition for the RNN as an approximation of a sparse coding solver. We verify the applicability, robustness, and computational efficiency of the proposed approach with image deblurring and optical coherence tomography (OCT) speckle suppression. Our experimental results demonstrate significant potential for improving learning models' sample efficiency, generalization, and time complexity, that can therefore be leveraged for practical real-time applications.
△ Less
Submitted 25 February, 2023; v1 submitted 28 September, 2022;
originally announced September 2022.
-
Confocal 3D reflectance imaging through multimode fibers without wavefront shaping
Authors:
Szu-Yu Lee,
Vicente J. Parot,
Brett E. Bouma,
Martin Villiger
Abstract:
Imaging through optical multimode fibers (MMFs) has the potential to enable hair-thin endoscopes that reduce the invasiveness of imaging deep inside tissues and organs. Current approaches predominantly require active wavefront shaping and fluorescent labeling, which limits their use to preclinical applications and frustrates imaging speed. Here we present a computational approach to reconstruct de…
▽ More
Imaging through optical multimode fibers (MMFs) has the potential to enable hair-thin endoscopes that reduce the invasiveness of imaging deep inside tissues and organs. Current approaches predominantly require active wavefront shaping and fluorescent labeling, which limits their use to preclinical applications and frustrates imaging speed. Here we present a computational approach to reconstruct depth-gated confocal images using a raster-scanned, focused input illumination. We demonstrate the compatibility of this approach with quantitative phase, dark-field, and polarimetric imaging. Computational imaging through MMF opens a new pathway for minimally invasive imaging in medical diagnosis and biological investigations.
△ Less
Submitted 3 September, 2021;
originally announced September 2021.
-
Segmentation of Anatomical Layers and Artifacts in Intravascular Polarization Sensitive Optical Coherence Tomography Using Attending Physician and Boundary Cardinality Losses
Authors:
Mohammad Haft-Javaherian,
Martin Villiger,
Kenichiro Otsuka,
Joost Daemen,
Peter Libby,
Polina Golland,
Brett E. Bouma
Abstract:
Intravascular ultrasound and optical coherence tomography are widely available for characterizing coronary stenoses and provide critical vessel parameters to optimize percutaneous intervention. Intravascular polarization-sensitive optical coherence tomography (PS-OCT) simultaneously provides high-resolution cross-sectional images of vascular structures while also revealing preponderant tissue comp…
▽ More
Intravascular ultrasound and optical coherence tomography are widely available for characterizing coronary stenoses and provide critical vessel parameters to optimize percutaneous intervention. Intravascular polarization-sensitive optical coherence tomography (PS-OCT) simultaneously provides high-resolution cross-sectional images of vascular structures while also revealing preponderant tissue components such as collagen and smooth muscle and thereby enhances plaque characterization. Automated interpretation of these features promises to facilitate the objective clinical investigation of the natural history and significance of coronary atheromas. Here, we propose a convolutional neural network model, optimized using a new multi-term loss function, to classify the lumen, intima, and media layers in addition to the guidewire and plaque shadows. We demonstrate that our multi-class classification model outperforms state-of-the-art methods in detecting the coronary anatomical layers. Furthermore, the proposed model segments two classes of common imaging artifacts and detects the anatomical layers within the thickened vessel wall regions that were excluded from analysis by other studies. The source code and the trained model are publicly available at https://github.com/mhaft/OCTseg
△ Less
Submitted 13 September, 2022; v1 submitted 11 May, 2021;
originally announced May 2021.
-
Reciprocity-induced symmetry in the round-trip transmission through complex systems
Authors:
Szu-Yu Lee,
Vicente J. Parot,
Brett E. Bouma,
Martin Villiger
Abstract:
Reciprocity is a fundamental principle of wave physics and directly relates to the symmetry in the transmission through a system when interchanging the input and output. The coherent transmission matrix (TM) is a convenient method to characterize wave transmission through general media. Here we demonstrate the optical reciprocal nature of complex media by exploring their TM properties. We measured…
▽ More
Reciprocity is a fundamental principle of wave physics and directly relates to the symmetry in the transmission through a system when interchanging the input and output. The coherent transmission matrix (TM) is a convenient method to characterize wave transmission through general media. Here we demonstrate the optical reciprocal nature of complex media by exploring their TM properties. We measured phase-corrected TMs of forward and round-trip propagation through a looped 1m-long step-index optical multimode fiber (MMF) to experimentally verify a transpose relationship between forward and backward transmission. This symmetry impedes straightforward MMF calibration from proximal measurements of the round-trip TM. Furthermore, we show how focusing through the MMF with digital optical phase conjugation is compromised by system loss, since time reversibility relies on power conservation. These insights may inform development of new imaging techniques through complex media and coherent control of waves in photonic systems.
△ Less
Submitted 14 July, 2020;
originally announced July 2020.
-
Polarization constraints in reciprocal unitary backscattering
Authors:
Qiaozhou Xiong,
Nanshuo Wang,
Xinyu Liu,
Si Chen,
Cilwyn S. Braganza,
Brett E. Bouma,
Linbo Liu,
Martin Villiger
Abstract:
We observed that the polarization state of light after round-trip propagation through a birefringent medium frequently aligns with the employed input polarization state "mirrored" by the horizontal plane of the Poincare sphere. In this letter we explore the predisposition for this mirror state and demonstrate how it constrains the evolution of polarization states as a function of the round-trip de…
▽ More
We observed that the polarization state of light after round-trip propagation through a birefringent medium frequently aligns with the employed input polarization state "mirrored" by the horizontal plane of the Poincare sphere. In this letter we explore the predisposition for this mirror state and demonstrate how it constrains the evolution of polarization states as a function of the round-trip depth into weakly scattering birefringent samples, as measured with polarization-sensitive optical coherence tomography (PS-OCT). The constraint enables measurements of depth-resolved sample birefringence with PS-OCT using only a single input polarization state, which offers a critical simplification compared to the use of multiple input states.
△ Less
Submitted 4 March, 2019;
originally announced March 2019.