-
Fast Two-photon Microscopy by Neuroimaging with Oblong Random Acquisition (NORA)
Authors:
Esther Whang,
Skyler Thomas,
Ji Yi,
Adam S. Charles
Abstract:
Advances in neural imaging have enabled neuroscientists to study how large neural populations conspire to produce perception, behavior and cognition. Despite many advances in optical methods, there exists a fundamental tradeoff between imaging speed, field of view, and resolution that limits the scope of neural imaging, especially for the raster-scanning multi-photon imaging needed to image deeper…
▽ More
Advances in neural imaging have enabled neuroscientists to study how large neural populations conspire to produce perception, behavior and cognition. Despite many advances in optical methods, there exists a fundamental tradeoff between imaging speed, field of view, and resolution that limits the scope of neural imaging, especially for the raster-scanning multi-photon imaging needed to image deeper into the brain. One approach to overcoming this trade-off is computational imaging: the co-development of optics designed to encode the target images into fewer measurements that are faster to acquire, with algorithms that compensate by inverting the optical coding to recover a larger or higher resolution image. We present here one such approach for raster-scanning two-photon imaging: Neuroimaging with Oblong Random Acquisition (NORA). NORA quickly acquires each frame in a microscopy video by subsampling only a fraction of the fast scanning lines, ignoring large portions of each frame. NORA mitigates the loss of information by 1) extending the point-spread function in the slow-scan direction to effectively integrate the fluorescence of several lines into a single set of measurements and 2) imaging different, randomly selected, lines at each frame. Rather than reconstruct the video frame-by-frame, NORA recovers full video sequences via nuclear-norm minimization on the pixels-by-time matrix, for which we prove theoretical guarantees on recovery. We simulated NORA imaging using the Neural Anatomy and Optical Microscopy (NAOMi) biophysical simulator, and used the simulations to demonstrate that NORA can accurately recover 400 um X 400 um fields of view at subsampling rates up to 20X, despite realistic noise and motion conditions. As NORA requires minimal changes to current microscopy systems, our results indicate that NORA can provide a promising avenue towards fast imaging of neural circuits.
△ Less
Submitted 9 June, 2025; v1 submitted 19 March, 2025;
originally announced March 2025.
-
realSEUDO for real-time calcium imaging analysis
Authors:
Iuliia Dmitrieva,
Sergey Babkin,
Adam S. Charles
Abstract:
Closed-loop neuroscience experimentation, where recorded neural activity is used to modify the experiment on-the-fly, is critical for deducing causal connections and optimizing experimental time. A critical step in creating a closed-loop experiment is real-time inference of neural activity from streaming recordings. One challenging modality for real-time processing is multi-photon calcium imaging…
▽ More
Closed-loop neuroscience experimentation, where recorded neural activity is used to modify the experiment on-the-fly, is critical for deducing causal connections and optimizing experimental time. A critical step in creating a closed-loop experiment is real-time inference of neural activity from streaming recordings. One challenging modality for real-time processing is multi-photon calcium imaging (CI). CI enables the recording of activity in large populations of neurons however, often requires batch processing of the video data to extract single-neuron activity from the fluorescence videos. We use the recently proposed robust time-trace estimator-Sparse Emulation of Unused Dictionary Objects (SEUDO) algorithm-as a basis for a new on-line processing algorithm that simultaneously identifies neurons in the fluorescence video and infers their time traces in a way that is robust to as-yet unidentified neurons. To achieve real-time SEUDO (realSEUDO), we optimize the core estimator via both algorithmic improvements and an fast C-based implementation, and create a new cell finding loop to enable realSEUDO to also identify new cells. We demonstrate comparable performance to offline algorithms (e.g., CNMF), and improved performance over the current on-line approach (OnACID) at speeds of 120 Hz on average.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics
Authors:
Noga Mudrik,
Yenho Chen,
Eva Yezerets,
Christopher J. Rozell,
Adam S. Charles
Abstract:
Learning interpretable representations of neural dynamics at a population level is a crucial first step to understanding how observed neural activity relates to perception and behavior. Models of neural dynamics often focus on either low-dimensional projections of neural activity, or on learning dynamical systems that explicitly relate to the neural state over time. We discuss how these two approa…
▽ More
Learning interpretable representations of neural dynamics at a population level is a crucial first step to understanding how observed neural activity relates to perception and behavior. Models of neural dynamics often focus on either low-dimensional projections of neural activity, or on learning dynamical systems that explicitly relate to the neural state over time. We discuss how these two approaches are interrelated by considering dynamical systems as representative of flows on a low-dimensional manifold. Building on this concept, we propose a new decomposed dynamical system model that represents complex non-stationary and nonlinear dynamics of time series data as a sparse combination of simpler, more interpretable components. Our model is trained through a dictionary learning procedure, where we leverage recent results in tracking sparse vectors over time. The decomposed nature of the dynamics is more expressive than previous switched approaches for a given number of parameters and enables modeling of overlapping and non-stationary dynamics. In both continuous-time and discrete-time instructional examples we demonstrate that our model can well approximate the original system, learn efficient representations, and capture smooth transitions between dynamical modes, focusing on intuitive low-dimensional non-stationary linear and nonlinear systems. Furthermore, we highlight our model's ability to efficiently capture and demix population dynamics generated from multiple independent subnetworks, a task that is computationally impractical for switched models. Finally, we apply our model to neural "full brain" recordings of C. elegans data, illustrating a diversity of dynamics that is obscured when classified into discrete states.
△ Less
Submitted 16 June, 2023; v1 submitted 6 June, 2022;
originally announced June 2022.
-
Data Processing of Functional Optical Microscopy for Neuroscience
Authors:
Hadas Benisty,
Alexander Song,
Gal Mishne,
Adam S. Charles
Abstract:
Functional optical imaging in neuroscience is rapidly growing with the development of new optical systems and fluorescence indicators. To realize the potential of these massive spatiotemporal datasets for relating neuronal activity to behavior and stimuli and uncovering local circuits in the brain, accurate automated processing is increasingly essential. In this review, we cover recent computation…
▽ More
Functional optical imaging in neuroscience is rapidly growing with the development of new optical systems and fluorescence indicators. To realize the potential of these massive spatiotemporal datasets for relating neuronal activity to behavior and stimuli and uncovering local circuits in the brain, accurate automated processing is increasingly essential. In this review, we cover recent computational developments in the full data processing pipeline of functional optical microscopy for neuroscience data and discuss ongoing and emerging challenges.
△ Less
Submitted 10 January, 2022;
originally announced January 2022.
-
Efficient Tracking of Sparse Signals via an Earth Mover's Distance Dynamics Regularizer
Authors:
Nicholas P. Bertrand,
Adam S. Charles,
John Lee,
Pavel B. Dunn,
Christopher J. Rozell
Abstract:
Tracking algorithms such as the Kalman filter aim to improve inference performance by leveraging the temporal dynamics in streaming observations. However, the tracking regularizers are often based on the $\ell_p$-norm which cannot account for important geometrical relationships between neighboring signal elements. We propose a practical approach to using the earth mover's distance (EMD) via the ea…
▽ More
Tracking algorithms such as the Kalman filter aim to improve inference performance by leveraging the temporal dynamics in streaming observations. However, the tracking regularizers are often based on the $\ell_p$-norm which cannot account for important geometrical relationships between neighboring signal elements. We propose a practical approach to using the earth mover's distance (EMD) via the earth mover's distance dynamic filtering (EMD-DF) algorithm for causally tracking time-varying sparse signals when there is a natural geometry to the coefficient space that should be respected (e.g., meaningful ordering). Specifically, this paper presents a new Beckmann formulation that dramatically reduces computational complexity, as well as an evaluation of the performance and complexity of the proposed approach in imaging and frequency tracking applications with real and simulated neurophysiology data.
△ Less
Submitted 19 May, 2020; v1 submitted 12 June, 2018;
originally announced June 2018.
-
An Efficient and Flexible Spike Train Model via Empirical Bayes
Authors:
Qi She,
Xiaoli Wu,
Beth Jelfs,
Adam S. Charles,
Rosa H. M. Chan
Abstract:
Accurate statistical models of neural spike responses can characterize the information carried by neural populations. But the limited samples of spike counts during recording usually result in model overfitting. Besides, current models assume spike counts to be Poisson-distributed, which ignores the fact that many neurons demonstrate over-dispersed spiking behaviour. Although the Negative Binomial…
▽ More
Accurate statistical models of neural spike responses can characterize the information carried by neural populations. But the limited samples of spike counts during recording usually result in model overfitting. Besides, current models assume spike counts to be Poisson-distributed, which ignores the fact that many neurons demonstrate over-dispersed spiking behaviour. Although the Negative Binomial Generalized Linear Model (NB-GLM) provides a powerful tool for modeling over-dispersed spike counts, the maximum likelihood-based standard NB-GLM leads to highly variable and inaccurate parameter estimates. Thus, we propose a hierarchical parametric empirical Bayes method to estimate the neural spike responses among neuronal population. Our method integrates both Generalized Linear Models (GLMs) and empirical Bayes theory, which aims to (1) improve the accuracy and reliability of parameter estimation, compared to the maximum likelihood-based method for NB-GLM and Poisson-GLM; (2) effectively capture the over-dispersion nature of spike counts from both simulated data and experimental data; and (3) provide insight into both neural interactions and spiking behaviours of the neuronal populations. We apply our approach to study both simulated data and experimental neural data. The estimation of simulation data indicates that the new framework can accurately predict mean spike counts simulated from different models and recover the connectivity weights among neural populations. The estimation based on retinal neurons demonstrate the proposed method outperforms both NB-GLM and Poisson-GLM in terms of the predictive log-likelihood of held-out data. Codes are available in https://doi.org/10.5281/zenodo.4704423
△ Less
Submitted 27 April, 2021; v1 submitted 10 May, 2016;
originally announced May 2016.
