Sufficient conditions for offline reactivation in recurrent neural networks
Authors:
Nanda H. Krishna,
Colin Bredenberg,
Daniel Levenstein,
Blake A. Richards,
Guillaume Lajoie
Abstract:
During periods of quiescence, such as sleep, neural activity in many brain circuits resembles that observed during periods of task engagement. However, the precise conditions under which task-optimized networks can autonomously reactivate the same network states responsible for online behavior is poorly understood. In this study, we develop a mathematical framework that outlines sufficient conditi…
▽ More
During periods of quiescence, such as sleep, neural activity in many brain circuits resembles that observed during periods of task engagement. However, the precise conditions under which task-optimized networks can autonomously reactivate the same network states responsible for online behavior is poorly understood. In this study, we develop a mathematical framework that outlines sufficient conditions for the emergence of neural reactivation in circuits that encode features of smoothly varying stimuli. We demonstrate mathematically that noisy recurrent networks optimized to track environmental state variables using change-based sensory information naturally develop denoising dynamics, which, in the absence of input, cause the network to revisit state configurations observed during periods of online activity. We validate our findings using numerical experiments on two canonical neuroscience tasks: spatial position estimation based on self-motion cues, and head direction estimation based on angular velocity cues. Overall, our work provides theoretical support for modeling offline reactivation as an emergent consequence of task optimization in noisy neural circuits.
△ Less
Submitted 22 May, 2025;
originally announced May 2025.
On the role of theory and modeling in neuroscience
Authors:
Daniel Levenstein,
Veronica A. Alvarez,
Asohan Amarasingham,
Habiba Azab,
Zhe Sage Chen,
Richard C. Gerkin,
Andrea Hasenstaub,
Ramakrishnan Iyer,
Renaud B. Jolivet,
Sarah Marzen,
Joseph D. Monaco,
Astrid A. Prinz,
Salma Quraishi,
Fidel Santamaria,
Sabyasachi Shivkumar,
Matthew F. Singh,
Roger Traub,
Horacio G. Rotstein,
Farzan Nadim,
A. David Redish
Abstract:
In recent years, the field of neuroscience has gone through rapid experimental advances and a significant increase in the use of quantitative and computational methods. This growth has created a need for clearer analyses of the theory and modeling approaches used in the field. This issue is particularly complex in neuroscience because the field studies phenomena across a wide range of scales and o…
▽ More
In recent years, the field of neuroscience has gone through rapid experimental advances and a significant increase in the use of quantitative and computational methods. This growth has created a need for clearer analyses of the theory and modeling approaches used in the field. This issue is particularly complex in neuroscience because the field studies phenomena across a wide range of scales and often requires consideration of these phenomena at varying degrees of abstraction, from precise biophysical interactions to the computations they implement. We argue that a pragmatic perspective of science, in which descriptive, mechanistic, and normative approaches each play a distinct role in defining and bridging levels of abstraction will facilitate neuroscientific practice. This analysis leads to methodological suggestions, including selecting a level of abstraction that is appropriate for a given problem, identifying transfer functions to connect models and data, and the use of models themselves as a form of experiment.
△ Less
Submitted 15 December, 2022; v1 submitted 30 March, 2020;
originally announced March 2020.
