Skip to main content

Showing 1–8 of 8 results for author: Kozachkov, L

Searching in archive cs. Search in all archives.
.
  1. arXiv:2507.01946  [pdf, ps, other

    q-bio.QM cs.LG math.DS q-bio.NC

    Characterizing control between interacting subsystems with deep Jacobian estimation

    Authors: Adam J. Eisen, Mitchell Ostrow, Sarthak Chandra, Leo Kozachkov, Earl K. Miller, Ila R. Fiete

    Abstract: Biological function arises through the dynamical interactions of multiple subsystems, including those between brain areas, within gene regulatory networks, and more. A common approach to understanding these systems is to model the dynamics of each subsystem and characterize communication between them. An alternative approach is through the lens of control theory: how the subsystems control one ano… ▽ More

    Submitted 2 July, 2025; originally announced July 2025.

    Comments: 10 pages, 6 figures

  2. arXiv:2506.00138  [pdf, ps, other

    q-bio.NC cs.AI cs.LG cs.RO

    Autonomous Behavior and Whole-Brain Dynamics Emerge in Embodied Zebrafish Agents with Model-based Intrinsic Motivation

    Authors: Reece Keller, Alyn Tornell, Felix Pei, Xaq Pitkow, Leo Kozachkov, Aran Nayebi

    Abstract: Autonomy is a hallmark of animal intelligence, enabling adaptive and intelligent behavior in complex environments without relying on external reward or task structure. Existing reinforcement learning approaches to exploration in sparse reward and reward-free environments, including class of methods known as intrinsic motivation, exhibit inconsistent exploration patterns and thus fail to produce ro… ▽ More

    Submitted 30 May, 2025; originally announced June 2025.

    Comments: 17 pages, 7 figures

  3. arXiv:2409.16422  [pdf, other

    cs.LG math.DS q-bio.NC

    Is All Learning (Natural) Gradient Descent?

    Authors: Lucas Shoji, Kenta Suzuki, Leo Kozachkov

    Abstract: This paper shows that a wide class of effective learning rules -- those that improve a scalar performance measure over a given time window -- can be rewritten as natural gradient descent with respect to a suitably defined loss function and metric. Specifically, we show that parameter updates within this class of learning rules can be expressed as the product of a symmetric positive definite matrix… ▽ More

    Submitted 24 September, 2024; originally announced September 2024.

    Comments: 14 pages, 3 figures

  4. arXiv:2310.01571  [pdf, other

    cs.LG eess.SY q-bio.NC

    Contraction Properties of the Global Workspace Primitive

    Authors: Michaela Ennis, Leo Kozachkov, Jean-Jacques Slotine

    Abstract: To push forward the important emerging research field surrounding multi-area recurrent neural networks (RNNs), we expand theoretically and empirically on the provably stable RNNs of RNNs introduced by Kozachkov et al. in "RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks". We prove relaxed stability conditions for salient special cases of this architecture, mos… ▽ More

    Submitted 2 October, 2023; originally announced October 2023.

  5. arXiv:2306.10168  [pdf, other

    q-bio.NC cs.LG cs.NE q-bio.QM

    Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysis

    Authors: Mitchell Ostrow, Adam Eisen, Leo Kozachkov, Ila Fiete

    Abstract: How can we tell whether two neural networks utilize the same internal processes for a particular computation? This question is pertinent for multiple subfields of neuroscience and machine learning, including neuroAI, mechanistic interpretability, and brain-machine interfaces. Standard approaches for comparing neural networks focus on the spatial geometry of latent states. Yet in recurrent networks… ▽ More

    Submitted 29 October, 2023; v1 submitted 16 June, 2023; originally announced June 2023.

    Comments: 22 pages, 9 figures

  6. arXiv:2201.06656  [pdf, other

    cs.LG math.DS

    Generalization in Supervised Learning Through Riemannian Contraction

    Authors: Leo Kozachkov, Patrick M. Wensing, Jean-Jacques Slotine

    Abstract: We prove that Riemannian contraction in a supervised learning setting implies generalization. Specifically, we show that if an optimizer is contracting in some Riemannian metric with rate $λ> 0$, it is uniformly algorithmically stable with rate $\mathcal{O}(1/λn)$, where $n$ is the number of labelled examples in the training set. The results hold for stochastic and deterministic optimization, in b… ▽ More

    Submitted 26 January, 2022; v1 submitted 17 January, 2022; originally announced January 2022.

    Comments: 22 pages, 5, figures

  7. arXiv:2106.08928  [pdf, other

    cs.LG math.DS q-bio.NC

    RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks

    Authors: Leo Kozachkov, Michaela Ennis, Jean-Jacques Slotine

    Abstract: Recurrent neural networks (RNNs) are widely used throughout neuroscience as models of local neural activity. Many properties of single RNNs are well characterized theoretically, but experimental neuroscience has moved in the direction of studying multiple interacting areas, and RNN theory needs to be likewise extended. We take a constructive approach towards this problem, leveraging tools from non… ▽ More

    Submitted 29 January, 2023; v1 submitted 16 June, 2021; originally announced June 2021.

    Comments: Published as a conference paper at NeurIPS 2022

  8. arXiv:1702.03993  [pdf

    q-bio.NC cs.NE q-bio.CB

    The Causal Role of Astrocytes in Slow-Wave Rhythmogenesis: A Computational Modelling Study

    Authors: Leo Kozachkov, Konstantinos P. Michmizos

    Abstract: Finding the origin of slow and infra-slow oscillations could reveal or explain brain mechanisms in health and disease. Here, we present a biophysically constrained computational model of a neural network where the inclusion of astrocytes introduced slow and infra-slow-oscillations, through two distinct mechanisms. Specifically, we show how astrocytes can modulate the fast network activity through… ▽ More

    Submitted 13 February, 2017; originally announced February 2017.

    Comments: 20 pages, 6 figures