-
REMI: Reconstructing Episodic Memory During Intrinsic Path Planning
Authors:
Zhaoze Wang,
Genela Morris,
Dori Derdikman,
Pratik Chaudhari,
Vijay Balasubramanian
Abstract:
Grid cells in the medial entorhinal cortex (MEC) are believed to path integrate speed and direction signals to activate at triangular grids of locations in an environment, thus implementing a population code for position. In parallel, place cells in the hippocampus (HC) fire at spatially confined locations, with selectivity tuned not only to allocentric position but also to environmental contexts,…
▽ More
Grid cells in the medial entorhinal cortex (MEC) are believed to path integrate speed and direction signals to activate at triangular grids of locations in an environment, thus implementing a population code for position. In parallel, place cells in the hippocampus (HC) fire at spatially confined locations, with selectivity tuned not only to allocentric position but also to environmental contexts, such as sensory cues. Although grid and place cells both encode spatial information and support memory for multiple locations, why animals maintain two such representations remains unclear. Noting that place representations seem to have other functional roles in intrinsically motivated tasks such as recalling locations from sensory cues, we propose that animals maintain grid and place representations together to support planning. Specifically, we posit that place cells auto-associate not only sensory information relayed from the MEC but also grid cell patterns, enabling recall of goal location grid patterns from sensory and motivational cues, permitting subsequent planning with only grid representations. We extend a previous theoretical framework for grid-cell-based planning and show that local transition rules can generalize to long-distance path forecasting. We further show that a planning network can sequentially update grid cell states toward the goal. During this process, intermediate grid activity can trigger place cell pattern completion, reconstructing experiences along the planned path. We demonstrate all these effects using a single-layer RNN that simultaneously models the HC-MEC loop and the planning subnetwork. We show that such recurrent mechanisms for grid cell-based planning, with goal recall driven by the place system, make several characteristic, testable predictions.
△ Less
Submitted 2 July, 2025;
originally announced July 2025.
-
Time Makes Space: Emergence of Place Fields in Networks Encoding Temporally Continuous Sensory Experiences
Authors:
Zhaoze Wang,
Ronald W. Di Tullio,
Spencer Rooke,
Vijay Balasubramanian
Abstract:
The vertebrate hippocampus is believed to use recurrent connectivity in area CA3 to support episodic memory recall from partial cues. This brain area also contains place cells, whose location-selective firing fields implement maps supporting spatial memory. Here we show that place cells emerge in networks trained to remember temporally continuous sensory episodes. We model CA3 as a recurrent autoe…
▽ More
The vertebrate hippocampus is believed to use recurrent connectivity in area CA3 to support episodic memory recall from partial cues. This brain area also contains place cells, whose location-selective firing fields implement maps supporting spatial memory. Here we show that place cells emerge in networks trained to remember temporally continuous sensory episodes. We model CA3 as a recurrent autoencoder that recalls and reconstructs sensory experiences from noisy and partially occluded observations by agents traversing simulated rooms. The agents move in realistic trajectories modeled from rodents and environments are modeled as high-dimensional sensory experience maps. Training our autoencoder to pattern-complete and reconstruct experiences with a constraint on total activity causes spatially localized firing fields, i.e., place cells, to emerge in the encoding layer. The emergent place fields reproduce key aspects of hippocampal phenomenology: a) remapping (maintenance of and reversion to distinct learned maps in different environments), implemented via repositioning of experience manifolds in the network's hidden layer, b) orthogonality of spatial representations in different arenas, c) robust place field emergence in differently shaped rooms, with single units showing multiple place fields in large or complex spaces, and d) slow representational drift of place fields. We argue that these results arise because continuous traversal of space makes sensory experience temporally continuous. We make testable predictions: a) rapidly changing sensory context will disrupt place fields, b) place fields will form even if recurrent connections are blocked, but reversion to previously learned representations upon remapping will be abolished, c) the dimension of temporally smooth experience sets the dimensionality of place fields, including during virtual navigation of abstract spaces.
△ Less
Submitted 9 July, 2025; v1 submitted 11 August, 2024;
originally announced August 2024.
-
Playing it safe: information constrains collective betting strategies
Authors:
Philipp Fleig,
Vijay Balasubramanian
Abstract:
Every interaction of a living organism with its environment involves the placement of a bet. Armed with partial knowledge about a stochastic world, the organism must decide its next step or near-term strategy, an act that implicitly or explicitly involves the assumption of a model of the world. Better information about environmental statistics can improve the bet quality, but in practice resources…
▽ More
Every interaction of a living organism with its environment involves the placement of a bet. Armed with partial knowledge about a stochastic world, the organism must decide its next step or near-term strategy, an act that implicitly or explicitly involves the assumption of a model of the world. Better information about environmental statistics can improve the bet quality, but in practice resources for information gathering are always limited. We argue that theories of optimal inference dictate that ``complex'' models are harder to infer with bounded information and lead to larger prediction errors. Thus, we propose a principle of ``playing it safe'' where, given finite information gathering capacity, biological systems should be biased towards simpler models of the world, and thereby to less risky betting strategies. In the framework of Bayesian inference, we show that there is an optimally safe adaptation strategy determined by the Bayesian prior. We then demonstrate that, in the context of stochastic phenotypic switching by bacteria, implementation of our principle of ``playing it safe'' increases fitness (population growth rate) of the bacterial collective. We suggest that the principle applies broadly to problems of adaptation, learning and evolution, and illuminates the types of environments in which organisms are able to thrive.
△ Less
Submitted 28 May, 2023; v1 submitted 18 April, 2023;
originally announced April 2023.
-
Heterologous autoimmunity and prokaryotic immune defense
Authors:
Hanrong Chen,
Andreas Mayer,
Vijay Balasubramanian
Abstract:
Some prokaryotes possess CRISPR-Cas systems that provide adaptive immunity to viruses guided by DNA segments called spacers acquired from invading phage. However, the patchy incidence and limited memory breadth of CRISPR-Cas systems suggest that their fitness benefits are offset by costs. Here, we propose that cross-reactive CRISPR targeting can lead to heterologous autoimmunity, whereby foreign s…
▽ More
Some prokaryotes possess CRISPR-Cas systems that provide adaptive immunity to viruses guided by DNA segments called spacers acquired from invading phage. However, the patchy incidence and limited memory breadth of CRISPR-Cas systems suggest that their fitness benefits are offset by costs. Here, we propose that cross-reactive CRISPR targeting can lead to heterologous autoimmunity, whereby foreign spacers guide self-targeting in a spacer-length dependent fashion. Balancing antiviral defense against autoimmunity predicts a scaling relation between spacer length and CRISPR repertoire size. We find evidence for this scaling through comparative analysis of sequenced prokaryotic genomes, and show that this association also holds at the level of CRISPR types. In contrast, the scaling is absent in strains with nonfunctional CRISPR loci. Finally, we demonstrate that stochastic spacer loss can explain variations around the scaling relation, even between strains of the same species. Our results suggest that heterologous autoimmunity is a selective factor shaping the evolution of CRISPR-Cas systems.
△ Less
Submitted 4 August, 2021; v1 submitted 4 January, 2021;
originally announced January 2021.
-
Efficient coding of natural scene statistics predicts discrimination thresholds for grayscale textures
Authors:
Tiberiu Tesileanu,
Mary M. Conte,
John J. Briguglio,
Ann M. Hermundstad,
Jonathan D. Victor,
Vijay Balasubramanian
Abstract:
Previously, in (Hermundstad et al., 2014), we showed that when sampling is limiting, the efficient coding principle leads to a "variance is salience" hypothesis, and that this hypothesis accounts for visual sensitivity to binary image statistics. Here, using extensive new psychophysical data and image analysis, we show that this hypothesis accounts for visual sensitivity to a large set of grayscal…
▽ More
Previously, in (Hermundstad et al., 2014), we showed that when sampling is limiting, the efficient coding principle leads to a "variance is salience" hypothesis, and that this hypothesis accounts for visual sensitivity to binary image statistics. Here, using extensive new psychophysical data and image analysis, we show that this hypothesis accounts for visual sensitivity to a large set of grayscale image statistics at a striking level of detail, and also identify the limits of the prediction. We define a 66-dimensional space of local grayscale light-intensity correlations, and measure the relevance of each direction to natural scenes. The "variance is salience" hypothesis predicts that two-point correlations are most salient, and predicts their relative salience. We tested these predictions in a texture-segregation task using un-natural, synthetic textures. As predicted, correlations beyond second order are not salient, and predicted thresholds for over 300 second-order correlations match psychophysical thresholds closely (median fractional error <0.13).
△ Less
Submitted 10 July, 2020; v1 submitted 11 December, 2019;
originally announced December 2019.
-
Active Learning with Point Supervision for Cost-Effective Panicle Detection in Cereal Crops
Authors:
Akshay L Chandra,
Sai Vikas Desai,
Vineeth N Balasubramanian,
Seishi Ninomiya,
Wei Guo
Abstract:
Panicle density of cereal crops such as wheat and sorghum is one of the main components for plant breeders and agronomists in understanding the yield of their crops. To phenotype the panicle density effectively, researchers agree there is a significant need for computer vision-based object detection techniques. Especially in recent times, research in deep learning-based object detection shows prom…
▽ More
Panicle density of cereal crops such as wheat and sorghum is one of the main components for plant breeders and agronomists in understanding the yield of their crops. To phenotype the panicle density effectively, researchers agree there is a significant need for computer vision-based object detection techniques. Especially in recent times, research in deep learning-based object detection shows promising results in various agricultural studies. However, training such systems usually requires a lot of bounding-box labeled data. Since crops vary by both environmental and genetic conditions, acquisition of huge amount of labeled image datasets for each crop is expensive and time-consuming. Thus, to catalyze the widespread usage of automatic object detection for crop phenotyping, a cost-effective method to develop such automated systems is essential. We propose a point supervision based active learning approach for panicle detection in cereal crops. In our approach, the model constantly interacts with a human annotator by iteratively querying the labels for only the most informative images, as opposed to all images in a dataset. Our query method is specifically designed for cereal crops which usually tend to have panicles with low variance in appearance. Our method reduces labeling costs by intelligently leveraging low-cost weak labels (object centers) for picking the most informative images for which strong labels (bounding boxes) are required. We show promising results on two publicly available cereal crop datasets - Sorghum and Wheat. On Sorghum, 6 variants of our proposed method outperform the best baseline method with more than 55% savings in labeling time. Similarly, on Wheat, 3 variants of our proposed methods outperform the best baseline method with more than 50% of savings in labeling time.
△ Less
Submitted 17 April, 2020; v1 submitted 3 October, 2019;
originally announced October 2019.
-
Extensible and Scalable Adaptive Sampling on Supercomputers
Authors:
Eugen Hruska,
Vivekanandan Balasubramanian,
Hyungro Lee,
Shantenu Jha,
Cecilia Clementi
Abstract:
The accurate sampling of protein dynamics is an ongoing challenge despite the utilization of High-Performance Computers (HPC) systems. Utilizing only "brute force" MD simulations requires an unacceptably long time to solution. Adaptive sampling methods allow a more effective sampling of protein dynamics than standard MD simulations. Depending on the restarting strategy the speed up can be more tha…
▽ More
The accurate sampling of protein dynamics is an ongoing challenge despite the utilization of High-Performance Computers (HPC) systems. Utilizing only "brute force" MD simulations requires an unacceptably long time to solution. Adaptive sampling methods allow a more effective sampling of protein dynamics than standard MD simulations. Depending on the restarting strategy the speed up can be more than one order of magnitude. One challenge limiting the utilization of adaptive sampling by domain experts is the relatively high complexity of efficiently running adaptive sampling on HPC systems. We discuss how the ExTASY framework can set up new adaptive sampling strategies, and reliably execute resulting workflows at scale on HPC platforms. Here the folding dynamics of four proteins are predicted with no a priori information.
△ Less
Submitted 24 September, 2020; v1 submitted 16 July, 2019;
originally announced July 2019.
-
Automatic estimation of heading date of paddy rice using deep learning
Authors:
Sai Vikas Desai,
Vineeth N Balasubramanian,
Tokihiro Fukatsu,
Seishi Ninomiya,
Wei Guo
Abstract:
Accurate estimation of heading date of paddy rice greatly helps the breeders to understand the adaptability of different crop varieties in a given location. The heading date also plays a vital role in determining grain yield for research experiments. Visual examination of the crop is laborious and time consuming. Therefore, quick and precise estimation of heading date of paddy rice is highly essen…
▽ More
Accurate estimation of heading date of paddy rice greatly helps the breeders to understand the adaptability of different crop varieties in a given location. The heading date also plays a vital role in determining grain yield for research experiments. Visual examination of the crop is laborious and time consuming. Therefore, quick and precise estimation of heading date of paddy rice is highly essential. In this work, we propose a simple pipeline to detect regions containing flowering panicles from ground level RGB images of paddy rice. Given a fixed region size for an image, the number of regions containing flowering panicles is directly proportional to the number of flowering panicles present. Consequently, we use the flowering panicle region counts to estimate the heading date of the crop. The method is based on image classification using Convolutional Neural Networks (CNNs). We evaluated the performance of our algorithm on five time series image sequences of three different varieties of rice crops. When compared to the previous work on this dataset, the accuracy and general versatility of the method has been improved and heading date has been estimated with a mean absolute error of less than 1 day.
△ Less
Submitted 19 June, 2019;
originally announced June 2019.
-
What the odor is not: Estimation by elimination
Authors:
Vijay Singh,
Martin Tchernookov,
Vijay Balasubramanian
Abstract:
Olfactory systems use a small number of broadly sensitive receptors to combinatorially encode a vast number of odors. We propose a method of decoding such distributed representations by exploiting a statistical fact: receptors that do not respond to an odor carry more information than receptors that do because they signal the absence of all odorants that bind to them. Thus, it is easier to identif…
▽ More
Olfactory systems use a small number of broadly sensitive receptors to combinatorially encode a vast number of odors. We propose a method of decoding such distributed representations by exploiting a statistical fact: receptors that do not respond to an odor carry more information than receptors that do because they signal the absence of all odorants that bind to them. Thus, it is easier to identify what the odor is not, rather than what the odor is. For realistic numbers of receptors, response functions, and odor complexity, this method of elimination turns an underconstrained decoding problem into a solvable one, allowing accurate determination of odorants in a mixture and their concentrations. We construct a neural network realization of our algorithm based on the structure of the olfactory pathway.
△ Less
Submitted 25 August, 2021; v1 submitted 6 March, 2019;
originally announced March 2019.
-
The size of the immune repertoire of bacteria
Authors:
Serena Bradde,
Armita Nourmohammad,
Sidhartha Goyal,
Vijay Balasubramanian
Abstract:
Some bacteria and archaea possess an immune system, based on the CRISPR-Cas mechanism, that confers adaptive immunity against phage. In such species, individual bacteria maintain a "cassette" of viral DNA elements called spacers as a memory of past infections. The typical cassette contains a few dozen spacers. Given that bacteria can have very large genomes, and since having more spacers should co…
▽ More
Some bacteria and archaea possess an immune system, based on the CRISPR-Cas mechanism, that confers adaptive immunity against phage. In such species, individual bacteria maintain a "cassette" of viral DNA elements called spacers as a memory of past infections. The typical cassette contains a few dozen spacers. Given that bacteria can have very large genomes, and since having more spacers should confer a better memory, it is puzzling that so little genetic space would be devoted by bacteria to their adaptive immune system. Here, we identify a fundamental trade-off between the size of the bacterial immune repertoire and effectiveness of response to a given threat, and show how this tradeoff imposes a limit on the optimal size of the CRISPR cassette.
△ Less
Submitted 1 March, 2019;
originally announced March 2019.
-
Dynamic self-organized error-correction of grid cells by border cells
Authors:
Eli Pollock,
Niral Desai,
Xue-Xin Wei,
Vijay Balasubramanian
Abstract:
Grid cells in the entorhinal cortex are believed to establish their regular, spatially correlated firing patterns by path integration of the animal's motion. Mechanisms for path integration, e.g. in attractor network models, predict stochastic drift of grid responses, which is not observed experimentally. We demonstrate a biologically plausible mechanism of dynamic self-organization by which borde…
▽ More
Grid cells in the entorhinal cortex are believed to establish their regular, spatially correlated firing patterns by path integration of the animal's motion. Mechanisms for path integration, e.g. in attractor network models, predict stochastic drift of grid responses, which is not observed experimentally. We demonstrate a biologically plausible mechanism of dynamic self-organization by which border cells, which fire at environmental boundaries, can correct such drift in grid cells. In our model, experience-dependent Hebbian plasticity during exploration allows border cells to learn connectivity to grid cells. Border cells in this learned network reset the phase of drifting grids. This error-correction mechanism is robust to environmental shape and complexity, including enclosures with interior barriers, and makes distinctive predictions for environmental deformation experiments. Our work demonstrates how diverse cell types in the entorhinal cortex could interact dynamically and adaptively to achieve robust path integration.
△ Less
Submitted 4 August, 2018;
originally announced August 2018.
-
How a well-adapting immune system remembers
Authors:
Andreas Mayer,
Vijay Balasubramanian,
Aleksandra M. Walczak,
Thierry Mora
Abstract:
An adaptive agent predicting the future state of an environment must weigh trust in new observations against prior experiences. In this light, we propose a view of the adaptive immune system as a dynamic Bayesian machinery that updates its memory repertoire by balancing evidence from new pathogen encounters against past experience of infection to predict and prepare for future threats. This framew…
▽ More
An adaptive agent predicting the future state of an environment must weigh trust in new observations against prior experiences. In this light, we propose a view of the adaptive immune system as a dynamic Bayesian machinery that updates its memory repertoire by balancing evidence from new pathogen encounters against past experience of infection to predict and prepare for future threats. This framework links the observed initial rapid increase of the memory pool early in life followed by a mid-life plateau to the ease of learning salient features of sparse environments. We also derive a modulated memory pool update rule in agreement with current vaccine response experiments. Our results suggest that pathogenic environments are sparse and that memory repertoires significantly decrease infection costs even with moderate sampling. The predicted optimal update scheme maps onto commonly considered competitive dynamics for antigen receptors.
△ Less
Submitted 13 November, 2018; v1 submitted 14 June, 2018;
originally announced June 2018.
-
A geometric attractor mechanism for self-organization of entorhinal grid modules
Authors:
Louis Kang,
Vijay Balasubramanian
Abstract:
Grid cells in the medial entorhinal cortex (MEC) respond when an animal occupies a periodic lattice of "grid fields" in the environment. The grids are organized in modules with spatial periods, or scales, clustered around discrete values separated by ratios in the range 1.2--2.0. We propose a mechanism that produces this modular structure through dynamical self-organization in the MEC. In attracto…
▽ More
Grid cells in the medial entorhinal cortex (MEC) respond when an animal occupies a periodic lattice of "grid fields" in the environment. The grids are organized in modules with spatial periods, or scales, clustered around discrete values separated by ratios in the range 1.2--2.0. We propose a mechanism that produces this modular structure through dynamical self-organization in the MEC. In attractor network models of grid formation, the grid scale of a single module is set by the distance of recurrent inhibition between neurons. We show that the MEC forms a hierarchy of discrete modules if a smooth increase in inhibition distance along its dorso-ventral axis is accompanied by excitatory interactions along this axis. Moreover, constant scale ratios between successive modules arise through geometric relationships between triangular grids and have values that fall within the observed range. We discuss how interactions required by our model might be tested experimentally.
△ Less
Submitted 11 March, 2019; v1 submitted 4 June, 2018;
originally announced June 2018.
-
A competitive binding model predicts nonlinear responses of olfactory receptors to complex mixtures
Authors:
Vijay Singh,
Nicolle R. Murphy,
Vijay Balasubramanian,
Joel D. Mainland
Abstract:
In color vision, the quantitative rules for mixing lights to make a target color are well understood. By contrast, the rules for mixing odorants to make a target odor remain elusive. A solution to this problem in vision relied on characterizing receptor responses to different wavelengths of light and subsequently relating these responses to perception. In olfaction, experimentally measuring recept…
▽ More
In color vision, the quantitative rules for mixing lights to make a target color are well understood. By contrast, the rules for mixing odorants to make a target odor remain elusive. A solution to this problem in vision relied on characterizing receptor responses to different wavelengths of light and subsequently relating these responses to perception. In olfaction, experimentally measuring receptor responses to a representative set of complex mixtures is intractable due to the vast number of possibilities. To meet this challenge, we develop a biophysical model that predicts mammalian receptor responses to complex mixtures using responses to single odorants. The dominant nonlinearity in our model is competitive binding (CB): only one odorant molecule can attach to a receptor binding site at a time. This simple framework predicts receptor responses to mixtures of up to twelve monomolecular odorants to within 15\% of experimental observations and provides a powerful method for leveraging limited experimental data. Simple extensions of our model describe phenomena such as synergy, overshadowing, and inhibition. We demonstrate that the presence of such interactions can be identified via systematic deviations from the competitive binding model.
△ Less
Submitted 4 February, 2019; v1 submitted 1 May, 2018;
originally announced May 2018.
-
Adaptation of olfactory receptor abundances for efficient coding
Authors:
Tiberiu Tesileanu,
Simona Cocco,
Remi Monasson,
Vijay Balasubramanian
Abstract:
Olfactory receptor usage is highly heterogeneous, with some receptor types being orders of magnitude more abundant than others. We propose an explanation for this striking fact: the receptor distribution is tuned to maximally represent information about the olfactory environment in a regime of efficient coding that is sensitive to the global context of correlated sensor responses. This model predi…
▽ More
Olfactory receptor usage is highly heterogeneous, with some receptor types being orders of magnitude more abundant than others. We propose an explanation for this striking fact: the receptor distribution is tuned to maximally represent information about the olfactory environment in a regime of efficient coding that is sensitive to the global context of correlated sensor responses. This model predicts that in mammals, where olfactory sensory neurons are replaced regularly, receptor abundances should continuously adapt to odor statistics. Experimentally, increased exposure to odorants leads variously, but reproducibly, to increased, decreased, or unchanged abundances of different activated receptors. We demonstrate that this diversity of effects is required for efficient coding when sensors are broadly correlated, and provide an algorithm for predicting which olfactory receptors should increase or decrease in abundance following specific environmental changes. Finally, we give simple dynamical rules for neural birth and death processes that might underlie this adaptation.
△ Less
Submitted 22 January, 2019; v1 submitted 28 January, 2018;
originally announced January 2018.
-
Disorder and the neural representation of complex odors: smelling in the real world
Authors:
Kamesh Krishnamurthy,
Ann M Hermundstad,
Thierry Mora,
Aleksandra M Walczak,
Vijay Balasubramanian
Abstract:
Animals smelling in the real world use a small number of receptors to sense a vast number of natural molecular mixtures, and proceed to learn arbitrary associations between odors and valences. Here, we propose a new interpretation of how the architecture of olfactory circuits is adapted to meet these immense complementary challenges. First, the diffuse binding of receptors to many molecules compre…
▽ More
Animals smelling in the real world use a small number of receptors to sense a vast number of natural molecular mixtures, and proceed to learn arbitrary associations between odors and valences. Here, we propose a new interpretation of how the architecture of olfactory circuits is adapted to meet these immense complementary challenges. First, the diffuse binding of receptors to many molecules compresses a vast odor space into a tiny receptor space, while preserving similarity. Next, lateral interactions "densify" and decorrelate the response, enhancing robustness to noise. Finally, disordered projections from the periphery to the central brain reconfigure the densely packed information into a format suitable for flexible learning of associations and valences. We test our theory empirically using data from Drosophila. Our theory suggests that the neural processing of olfactory information differs from the other senses in its fundamental use of disorder.
△ Less
Submitted 6 July, 2017;
originally announced July 2017.
-
Complete coverage of space favors modularity of the grid system in the brain
Authors:
Alessandro Sanzeni,
Vijay Balasubramanian,
Guido Tiana,
Massimo Vergassola
Abstract:
Grid cells in the entorhinal cortex fire when animals that are exploring a certain region of space occupy the vertices of a triangular grid that spans the environment. Different neurons feature triangular grids that differ in their properties of periodicity, orientation and ellipticity. Taken together, these grids allow the animal to maintain an internal, mental representation of physical space. E…
▽ More
Grid cells in the entorhinal cortex fire when animals that are exploring a certain region of space occupy the vertices of a triangular grid that spans the environment. Different neurons feature triangular grids that differ in their properties of periodicity, orientation and ellipticity. Taken together, these grids allow the animal to maintain an internal, mental representation of physical space. Experiments show that grid cells are modular, i.e. there are groups of neurons which have grids with similar periodicity, orientation and ellipticity. We use statistical physics methods to derive a relation between variability of the properties of the grids within a module and the range of space that can be covered completely (i.e. without gaps) by the grid system with high probability. Larger variability shrinks the range of representation, providing a functional rationale for the experimentally observed co-modularity of grid cell periodicity, orientation and ellipticity. We obtain a scaling relation between the number of neurons and the period of a module, given the variability and coverage range. Specifically, we predict how many more neurons are required at smaller grid scales than at larger ones.
△ Less
Submitted 16 October, 2016;
originally announced October 2016.
-
Rules and mechanisms for efficient two-stage learning in neural circuits
Authors:
Tiberiu Tesileanu,
Bence Ölveczky,
Vijay Balasubramanian
Abstract:
Trial-and-error learning requires evaluating variable actions and reinforcing successful variants. In songbirds, vocal exploration is induced by LMAN, the output of a basal ganglia-circuit that also contributes a corrective bias to the vocal output. This bias is gradually consolidated in RA, a motor cortex analogue downstream of LMAN. We develop a new model of such two-stage learning. Using stocha…
▽ More
Trial-and-error learning requires evaluating variable actions and reinforcing successful variants. In songbirds, vocal exploration is induced by LMAN, the output of a basal ganglia-circuit that also contributes a corrective bias to the vocal output. This bias is gradually consolidated in RA, a motor cortex analogue downstream of LMAN. We develop a new model of such two-stage learning. Using stochastic gradient descent, we derive how the activity in 'tutor' circuits (e.g., LMAN) should match plasticity mechanisms in 'student' circuits (e.g., RA) to achieve efficient learning. We further describe a reinforcement learning framework through which the tutor can build its teaching signal. We show that mismatches between the tutor signal and the plasticity mechanism can impair learning. Applied to birdsong, our results predict the temporal structure of the corrective bias from LMAN given a plasticity rule in RA. Our framework can be applied predictively to other paired brain areas showing two-stage learning.
△ Less
Submitted 8 March, 2017; v1 submitted 29 August, 2016;
originally announced August 2016.
-
Dynamics of adaptive immunity against phage in bacterial populations
Authors:
Serena Bradde,
Marija Vucelja,
Tiberiu Tesileanu,
Vijay Balasubramanian
Abstract:
The CRISPR (clustered regularly interspaced short palindromic repeats) mechanism allows bacteria to adaptively defend against phages by acquiring short genomic sequences (spacers) that target specific sequences in the viral genome. We propose a population dynamical model where immunity can be both acquired and lost. The model predicts regimes where bacterial and phage populations can co-exist, oth…
▽ More
The CRISPR (clustered regularly interspaced short palindromic repeats) mechanism allows bacteria to adaptively defend against phages by acquiring short genomic sequences (spacers) that target specific sequences in the viral genome. We propose a population dynamical model where immunity can be both acquired and lost. The model predicts regimes where bacterial and phage populations can co-exist, others where the populations exhibit damped oscillations, and still others where one population is driven to extinction. Our model considers two key parameters: (1) ease of acquisition and (2) spacer effectiveness in conferring immunity. Analytical calculations and numerical simulations show that if spacers differ mainly in ease of acquisition, or if the probability of acquiring them is sufficiently high, bacteria develop a diverse population of spacers. On the other hand, if spacers differ mainly in their effectiveness, their final distribution will be highly peaked, akin to a "winner-take-all" scenario, leading to a specialized spacer distribution. Bacteria can interpolate between these limiting behaviors by actively tuning their overall acquisition probability.
△ Less
Submitted 24 May, 2017; v1 submitted 20 October, 2015;
originally announced October 2015.
-
How a well-adapted immune system is organized
Authors:
Andreas Mayer,
Vijay Balasubramanian,
Thierry Mora,
Aleksandra M. Walczak
Abstract:
The repertoire of lymphocyte receptors in the adaptive immune system protects organisms from diverse pathogens. A well-adapted repertoire should be tuned to the pathogenic environment to reduce the cost of infections. We develop a general framework for predicting the optimal repertoire that minimizes the cost of infections contracted from a given distribution of pathogens. The theory predicts that…
▽ More
The repertoire of lymphocyte receptors in the adaptive immune system protects organisms from diverse pathogens. A well-adapted repertoire should be tuned to the pathogenic environment to reduce the cost of infections. We develop a general framework for predicting the optimal repertoire that minimizes the cost of infections contracted from a given distribution of pathogens. The theory predicts that the immune system will have more receptors for rare antigens than expected from the frequency of encounters; individuals exposed to the same infections will have sparse repertoires that are largely different, but nevertheless exploit cross-reactivity to provide the same coverage of antigens; and the optimal repertoires can be reached via the dynamics of competitive binding of antigens by receptors, and selective amplification of stimulated receptors. Our results follow from a tension between the statistics of pathogen detection, which favor a broader receptor distribution, and the effects of cross-reactivity, which tend to concentrate the optimal repertoire onto a few highly abundant clones. Our predictions can be tested in high throughput surveys of receptor and pathogen diversity.
△ Less
Submitted 25 July, 2014;
originally announced July 2014.
-
Transformation of stimulus correlations by the retina
Authors:
K. D. Simmons,
J. S. Prentice,
G. Tkacik,
J. Homann,
H. K. Yee,
S. E. Palmer,
P. C. Nelson,
V. Balasubramanian
Abstract:
Redundancies and correlations in the responses of sensory neurons seem to waste neural resources but can carry cues about structured stimuli and may help the brain to correct for response errors. To assess how the retina negotiates this tradeoff, we measured simultaneous responses from populations of ganglion cells presented with natural and artificial stimuli that varied greatly in correlation st…
▽ More
Redundancies and correlations in the responses of sensory neurons seem to waste neural resources but can carry cues about structured stimuli and may help the brain to correct for response errors. To assess how the retina negotiates this tradeoff, we measured simultaneous responses from populations of ganglion cells presented with natural and artificial stimuli that varied greatly in correlation structure. We found that pairwise correlations in the retinal output remained similar across stimuli with widely different spatio-temporal correlations including white noise and natural movies. Meanwhile, purely spatial correlations tended to increase correlations in the retinal response. Responding to more correlated stimuli, ganglion cells had faster temporal kernels and tended to have stronger surrounds. These properties of individual cells, along with gain changes that opposed changes in effective contrast at the ganglion cell input, largely explained the similarity of pairwise correlations across stimuli where receptive field measurements were possible.
△ Less
Submitted 2 July, 2013; v1 submitted 28 June, 2013;
originally announced July 2013.
-
The Sense of Place: Grid Cells in the Brain and the Transcendental Number e
Authors:
Xue-Xin Wei,
Jason Prentice,
Vijay Balasubramanian
Abstract:
Grid cells in the brain respond when an animal occupies a periodic lattice of "grid fields" during spatial navigation. The grid scale varies along the dorso-ventral axis of the entorhinal cortex. We propose that the grid system minimizes the number of neurons required to encode location with a given resolution. We derive several predictions that match recent experiments: (i) grid scales follow a g…
▽ More
Grid cells in the brain respond when an animal occupies a periodic lattice of "grid fields" during spatial navigation. The grid scale varies along the dorso-ventral axis of the entorhinal cortex. We propose that the grid system minimizes the number of neurons required to encode location with a given resolution. We derive several predictions that match recent experiments: (i) grid scales follow a geometric progression, (ii) the ratio between adjacent grid scales is the square root of e for idealized neurons, and robustly lies in the range 1.4-1.7 for realistic neurons, (iii) the scale ratio varies modestly within and between animals, (iv) the ratio between grid scale and individual grid field widths at that scale also lies in this range, (v) grid fields lie on a triangular lattice. The theory also predicts the optimal grids in one and three dimensions, and the total number of discrete scales.
△ Less
Submitted 29 March, 2013;
originally announced April 2013.
-
Natural images from the birthplace of the human eye
Authors:
Gašper Tkačik,
Patrick Garrigan,
Charles Ratliff,
Grega Milčinski,
Jennifer M Klein,
Lucia H Seyfarth,
Peter Sterling,
David Brainard,
Vijay Balasubramanian
Abstract:
Here we introduce a database of calibrated natural images publicly available through an easy-to-use web interface. Using a Nikon D70 digital SLR camera, we acquired about 5000 six-megapixel images of Okavango Delta of Botswana, a tropical savanna habitat similar to where the human eye is thought to have evolved. Some sequences of images were captured unsystematically while following a baboon troop…
▽ More
Here we introduce a database of calibrated natural images publicly available through an easy-to-use web interface. Using a Nikon D70 digital SLR camera, we acquired about 5000 six-megapixel images of Okavango Delta of Botswana, a tropical savanna habitat similar to where the human eye is thought to have evolved. Some sequences of images were captured unsystematically while following a baboon troop, while others were designed to vary a single parameter such as aperture, object distance, time of day or position on the horizon. Images are available in the raw RGB format and in grayscale. Images are also available in units relevant to the physiology of human cone photoreceptors, where pixel values represent the expected number of photoisomerizations per second for cones sensitive to long (L), medium (M) and short (S) wavelengths. This database is distributed under a Creative Commons Attribution-Noncommercial Unported license to facilitate research in computer vision, psychophysics of perception, and visual neuroscience.
△ Less
Submitted 3 February, 2011;
originally announced February 2011.
-
Fast, scalable, Bayesian spike identification for multi-electrode arrays
Authors:
Jason S. Prentice,
Jan Homann,
Kristina D. Simmons,
Gašper Tkačik,
Vijay Balasubramanian,
Philip C. Nelson
Abstract:
We present an algorithm to identify individual neural spikes observed on high-density multi-electrode arrays (MEAs). Our method can distinguish large numbers of distinct neural units, even when spikes overlap, and accounts for intrinsic variability of spikes from each unit. As MEAs grow larger, it is important to find spike-identification methods that are scalable, that is, the computational cost…
▽ More
We present an algorithm to identify individual neural spikes observed on high-density multi-electrode arrays (MEAs). Our method can distinguish large numbers of distinct neural units, even when spikes overlap, and accounts for intrinsic variability of spikes from each unit. As MEAs grow larger, it is important to find spike-identification methods that are scalable, that is, the computational cost of spike fitting should scale well with the number of units observed. Our algorithm accomplishes this goal, and is fast, because it exploits the spatial locality of each unit and the basic biophysics of extracellular signal propagation. Human intervention is minimized and streamlined via a graphical interface. We illustrate our method on data from a mammalian retina preparation and document its performance on simulated data consisting of spikes added to experimentally measured background noise. The algorithm is highly accurate.
△ Less
Submitted 16 July, 2010;
originally announced July 2010.
-
Metabolically Efficient Codes in The Retina
Authors:
Vijay Balasubramanian,
Michael J Berry
Abstract:
We tested the hypothesis that the neural code of retinal ganglion cells is optimized to transmit visual information at minimal metabolic cost. Under a broad ensemble of light patterns, ganglion cell spike trains consisted of sparse, precise bursts of spikes. These bursts were viewed as independent neural symbols. The noise in each burst was measured via repeated presentation of the visual stimul…
▽ More
We tested the hypothesis that the neural code of retinal ganglion cells is optimized to transmit visual information at minimal metabolic cost. Under a broad ensemble of light patterns, ganglion cell spike trains consisted of sparse, precise bursts of spikes. These bursts were viewed as independent neural symbols. The noise in each burst was measured via repeated presentation of the visual stimulus, and the energy cost was estimated from the total charge flow in a biophysically realistic model of ganglion cell spiking. Given these costs and noise, the theory of efficient codes predicts an optimal distribution of symbol usage. Symbols that are either noisy or metabolically costly are suppressed in this optimal code. We found excellent qualitative and quantitative agreement with the measured distribution of burst sizes for ganglion cells in the tiger salamander retina.
△ Less
Submitted 6 May, 2001;
originally announced May 2001.
-
Metabolically Efficient Information Processing
Authors:
Vijay Balasubramanian,
Don Kimber,
Michael J Berry
Abstract:
Energy efficient information transmission may be relevant to biological sensory signal processing as well as to low power electronic devices. We explore its consequences in two different regimes. In an ``immediate'' regime, we argue that the information rate should be maximized subject to a power constraint, while in an ``exploratory'' regime, the transmission rate per power cost should be maxim…
▽ More
Energy efficient information transmission may be relevant to biological sensory signal processing as well as to low power electronic devices. We explore its consequences in two different regimes. In an ``immediate'' regime, we argue that the information rate should be maximized subject to a power constraint, while in an ``exploratory'' regime, the transmission rate per power cost should be maximized. In the absence of noise, discrete inputs are optimally encoded into Boltzmann distributed output symbols. In the exploratory regime, the partition function of this distribution is numerically equal to 1. The structure of the optimal code is strongly affected by noise in the transmission channel. The Arimoto-Blahut algorithm, generalized for cost constraints, can be used to derive and interpret the distribution of symbols for optimal energy efficient coding in the presence of noise. We outline the possibilities and problems in extending our results to information coding and transmission in neurobiological systems.
△ Less
Submitted 6 May, 2001;
originally announced May 2001.
