-
TRACE: Contrastive learning for multi-trial time-series data in neuroscience
Authors:
Lisa Schmors,
Dominic Gonschorek,
Jan Niklas Böhm,
Yongrong Qiu,
Na Zhou,
Dmitry Kobak,
Andreas Tolias,
Fabian Sinz,
Jacob Reimer,
Katrin Franke,
Sebastian Damrich,
Philipp Berens
Abstract:
Modern neural recording techniques such as two-photon imaging allow to acquire vast time-series datasets with responses of hundreds or thousands of neurons. Contrastive learning is a powerful self-supervised framework for learning representations of complex datasets. Existing applications for neural time series rely on generic data augmentations and do not exploit the multi-trial data structure in…
▽ More
Modern neural recording techniques such as two-photon imaging allow to acquire vast time-series datasets with responses of hundreds or thousands of neurons. Contrastive learning is a powerful self-supervised framework for learning representations of complex datasets. Existing applications for neural time series rely on generic data augmentations and do not exploit the multi-trial data structure inherent in many neural datasets. Here we present TRACE, a new contrastive learning framework that averages across different subsets of trials to generate positive pairs. TRACE allows to directly learn a two-dimensional embedding, combining ideas from contrastive learning and neighbor embeddings. We show that TRACE outperforms other methods, resolving fine response differences in simulated data. Further, using in vivo recordings, we show that the representations learned by TRACE capture both biologically relevant continuous variation, cell-type-related cluster structure, and can assist data quality control.
△ Less
Submitted 5 June, 2025;
originally announced June 2025.
-
Most discriminative stimuli for functional cell type clustering
Authors:
Max F. Burg,
Thomas Zenkel,
Michaela Vystrčilová,
Jonathan Oesterle,
Larissa Höfling,
Konstantin F. Willeke,
Jan Lause,
Sarah Müller,
Paul G. Fahey,
Zhiwei Ding,
Kelli Restivo,
Shashwat Sridhar,
Tim Gollisch,
Philipp Berens,
Andreas S. Tolias,
Thomas Euler,
Matthias Bethge,
Alexander S. Ecker
Abstract:
Identifying cell types and understanding their functional properties is crucial for unraveling the mechanisms underlying perception and cognition. In the retina, functional types can be identified by carefully selected stimuli, but this requires expert domain knowledge and biases the procedure towards previously known cell types. In the visual cortex, it is still unknown what functional types exis…
▽ More
Identifying cell types and understanding their functional properties is crucial for unraveling the mechanisms underlying perception and cognition. In the retina, functional types can be identified by carefully selected stimuli, but this requires expert domain knowledge and biases the procedure towards previously known cell types. In the visual cortex, it is still unknown what functional types exist and how to identify them. Thus, for unbiased identification of the functional cell types in retina and visual cortex, new approaches are needed. Here we propose an optimization-based clustering approach using deep predictive models to obtain functional clusters of neurons using Most Discriminative Stimuli (MDS). Our approach alternates between stimulus optimization with cluster reassignment akin to an expectation-maximization algorithm. The algorithm recovers functional clusters in mouse retina, marmoset retina and macaque visual area V4. This demonstrates that our approach can successfully find discriminative stimuli across species, stages of the visual system and recording techniques. The resulting most discriminative stimuli can be used to assign functional cell types fast and on the fly, without the need to train complex predictive models or show a large natural scene dataset, paving the way for experiments that were previously limited by experimental time. Crucially, MDS are interpretable: they visualize the distinctive stimulus patterns that most unambiguously identify a specific type of neuron.
△ Less
Submitted 14 March, 2024; v1 submitted 29 November, 2023;
originally announced January 2024.
-
Signatures of criticality arise in simple neural population models with correlations
Authors:
Marcel Nonnenmacher,
Christian Behrens,
Philipp Berens,
Matthias Bethge,
Jakob H Macke
Abstract:
Large-scale recordings of neuronal activity make it possible to gain insights into the collective activity of neural ensembles. It has been hypothesized that neural populations might be optimized to operate at a 'thermodynamic critical point', and that this property has implications for information processing. Support for this notion has come from a series of studies which identified statistical s…
▽ More
Large-scale recordings of neuronal activity make it possible to gain insights into the collective activity of neural ensembles. It has been hypothesized that neural populations might be optimized to operate at a 'thermodynamic critical point', and that this property has implications for information processing. Support for this notion has come from a series of studies which identified statistical signatures of criticality in the ensemble activity of retinal ganglion cells. What are the underlying mechanisms that give rise to these observations? Here we show that signatures of criticality arise even in simple feed-forward models of retinal population activity. In particular, they occur whenever neural population data exhibits correlations, and is randomly sub-sampled during data analysis. These results show that signatures of criticality are not necessarily indicative of an optimized coding strategy, and challenge the utility of analysis approaches based on equilibrium thermodynamics for understanding partially observed biological systems.
△ Less
Submitted 31 January, 2018; v1 submitted 29 February, 2016;
originally announced March 2016.
