-
Tensor decomposition of higher-order correlations by nonlinear Hebbian plasticity
Authors:
Gabriel Koch Ocker,
Michael A. Buice
Abstract:
Biological synaptic plasticity exhibits nonlinearities that are not accounted for by classic Hebbian learning rules. Here, we introduce a simple family of generalized nonlinear Hebbian learning rules. We study the computations implemented by their dynamics in the simple setting of a neuron receiving feedforward inputs. These nonlinear Hebbian rules allow a neuron to learn tensor decompositions of…
▽ More
Biological synaptic plasticity exhibits nonlinearities that are not accounted for by classic Hebbian learning rules. Here, we introduce a simple family of generalized nonlinear Hebbian learning rules. We study the computations implemented by their dynamics in the simple setting of a neuron receiving feedforward inputs. These nonlinear Hebbian rules allow a neuron to learn tensor decompositions of its higher-order input correlations. The particular input correlation decomposed and the form of the decomposition depend on the location of nonlinearities in the plasticity rule. For simple, biologically motivated parameters, the neuron learns eigenvectors of higher-order input correlation tensors. We prove that tensor eigenvectors are attractors and determine their basins of attraction. We calculate the volume of those basins, showing that the dominant eigenvector has the largest basin of attraction. We then study arbitrary learning rules and find that any learning rule that admits a finite Taylor expansion into the neural input and output also has stable equilibria at generalized eigenvectors of higher-order input correlation tensors. Nonlinearities in synaptic plasticity thus allow a neuron to encode higher-order input correlations in a simple fashion.
△ Less
Submitted 25 October, 2021; v1 submitted 29 June, 2021;
originally announced June 2021.
-
Comparison Against Task Driven Artificial Neural Networks Reveals Functional Organization of Mouse Visual Cortex
Authors:
Jianghong Shi,
Eric Shea-Brown,
Michael A. Buice
Abstract:
Partially inspired by features of computation in visual cortex, deep neural networks compute hierarchical representations of their inputs. While these networks have been highly successful in machine learning, it remains unclear to what extent they can aid our understanding of cortical function. Several groups have developed metrics that provide a quantitative comparison between representations com…
▽ More
Partially inspired by features of computation in visual cortex, deep neural networks compute hierarchical representations of their inputs. While these networks have been highly successful in machine learning, it remains unclear to what extent they can aid our understanding of cortical function. Several groups have developed metrics that provide a quantitative comparison between representations computed by networks and representations measured in cortex. At the same time, neuroscience is well into an unprecedented phase of large-scale data collection, as evidenced by projects such as the Allen Brain Observatory. Despite the magnitude of these efforts, in a given experiment only a fraction of units are recorded, limiting the information available about the cortical representation. Moreover, only a finite number of stimuli can be shown to an animal over the course of a realistic experiment. These limitations raise the question of how and whether metrics that compare representations of deep networks are meaningful on these datasets. Here, we empirically quantify the capabilities and limitations of these metrics due to limited image presentations and neuron samples. We find that the comparison procedure is robust to different choices of stimuli set and the level of subsampling that one might expect in a large-scale brain survey with thousands of neurons. Using these results, we compare the representations measured in the Allen Brain Observatory in response to natural image presentations to deep neural network. We show that the visual cortical areas are relatively high order representations (in that they map to deeper layers of convolutional neural networks). Furthermore, we see evidence of a broad, more parallel organization rather than a sequential hierarchy, with the primary area VISp(V1) being lower order relative to the other areas.
△ Less
Submitted 18 November, 2019;
originally announced November 2019.
-
From the statistics of connectivity to the statistics of spike times in neuronal networks
Authors:
Gabriel Koch Ocker,
Yu Hu,
Michael A. Buice,
Brent Doiron,
Krešimir Josić,
Robert Rosenbaum,
Eric Shea-Brown
Abstract:
An essential step toward understanding neural circuits is linking their structure and their dynamics. In general, this relationship can be almost arbitrarily complex. Recent theoretical work has, however, begun to identify some broad principles underlying collective spiking activity in neural circuits. The first is that local features of network connectivity can be surprisingly effective in predic…
▽ More
An essential step toward understanding neural circuits is linking their structure and their dynamics. In general, this relationship can be almost arbitrarily complex. Recent theoretical work has, however, begun to identify some broad principles underlying collective spiking activity in neural circuits. The first is that local features of network connectivity can be surprisingly effective in predicting global statistics of activity across a network. The second is that, for the important case of large networks with excitatory-inhibitory balance, correlated spiking persists or vanishes depending on the spatial scales of recurrent and feedforward connectivity. We close by showing how these ideas, together with plasticity rules, can help to close the loop between network structure and activity statistics.
△ Less
Submitted 8 March, 2017;
originally announced March 2017.
-
Predicting how and when hidden neurons skew measured synaptic interactions
Authors:
Braden A. W. Brinkman,
Fred Rieke,
Eric Shea-Brown,
Michael A. Buice
Abstract:
A major obstacle to understanding neural coding and computation is the fact that experimental recordings typically sample only a small fraction of the neurons in a circuit. Measured neural properties are skewed by interactions between recorded neurons and the "hidden" portion of the network. To properly interpret neural data and determine how biological structure gives rise to neural circuit funct…
▽ More
A major obstacle to understanding neural coding and computation is the fact that experimental recordings typically sample only a small fraction of the neurons in a circuit. Measured neural properties are skewed by interactions between recorded neurons and the "hidden" portion of the network. To properly interpret neural data and determine how biological structure gives rise to neural circuit function, we thus need a better understanding of the relationships between measured effective neural properties and the true underlying physiological properties. Here, we focus on how the effective spatiotemporal dynamics of the synaptic interactions between neurons are reshaped by coupling to unobserved neurons. We find that the effective interactions from a pre-synaptic neuron $r'$ to a post-synaptic neuron $r$ can be decomposed into a sum of the true interaction from $r'$ to $r$ plus corrections from every directed path from $r'$ to $r$ through unobserved neurons. Importantly, the resulting formula reveals when the hidden units have---or do not have---major effects on reshaping the interactions among observed neurons. As a particular example of interest, we derive a formula for the impact of hidden units in random networks with "strong" coupling---connection weights that scale with $1/\sqrt{N}$, where $N$ is the network size, precisely the scaling observed in recent experiments. With this quantitative relationship between measured and true interactions, we can study how network properties shape effective interactions, which properties are relevant for neural computations, and how to manipulate effective interactions.
△ Less
Submitted 15 August, 2017; v1 submitted 2 February, 2017;
originally announced February 2017.
-
Linking structure and activity in nonlinear spiking networks
Authors:
Gabriel Koch Ocker,
Krešimir Josić,
Eric Shea-Brown,
Michael A. Buice
Abstract:
Recent experimental advances are producing an avalanche of data on both neural connectivity and neural activity. To take full advantage of these two emerging datasets we need a framework that links them, revealing how collective neural activity arises from the structure of neural connectivity and intrinsic neural dynamics. This problem of {\it structure-driven activity} has drawn major interest in…
▽ More
Recent experimental advances are producing an avalanche of data on both neural connectivity and neural activity. To take full advantage of these two emerging datasets we need a framework that links them, revealing how collective neural activity arises from the structure of neural connectivity and intrinsic neural dynamics. This problem of {\it structure-driven activity} has drawn major interest in computational neuroscience. Existing methods for relating activity and architecture in spiking networks rely on linearizing activity around a central operating point and thus fail to capture the nonlinear responses of individual neurons that are the hallmark of neural information processing. Here, we overcome this limitation and present a new relationship between connectivity and activity in networks of nonlinear spiking neurons by developing a diagrammatic fluctuation expansion based on statistical field theory. We explicitly show how recurrent network structure produces pairwise and higher-order correlated activity, and how nonlinearities impact the networks' spiking activity. Our findings open new avenues to investigating how single-neuron nonlinearities---including those of different cell types---combine with connectivity to shape population activity and function.
△ Less
Submitted 25 February, 2020; v1 submitted 12 October, 2016;
originally announced October 2016.
-
Generalized activity equations for spiking neural network dynamics
Authors:
Michael A. Buice,
Carson C. Chow
Abstract:
Much progress has been made in uncovering the computational capabilities of spiking neural networks. However, spiking neurons will always be more expensive to simulate compared to rate neurons because of the inherent disparity in time scales - the spike duration time is much shorter than the inter-spike time, which is much shorter than any learning time scale. In numerical analysis, this is a clas…
▽ More
Much progress has been made in uncovering the computational capabilities of spiking neural networks. However, spiking neurons will always be more expensive to simulate compared to rate neurons because of the inherent disparity in time scales - the spike duration time is much shorter than the inter-spike time, which is much shorter than any learning time scale. In numerical analysis, this is a classic stiff problem. Spiking neurons are also much more difficult to study analytically. One possible approach to making spiking networks more tractable is to augment mean field activity models with some information about spiking correlations. For example, such a generalized activity model could carry information about spiking rates and correlations between spikes self-consistently. Here, we will show how this can be accomplished by constructing a complete formal probabilistic description of the network and then expanding around a small parameter such as the inverse of the number of neurons in the network. The mean field theory of the system gives a rate-like description. The first order terms in the perturbation expansion keep track of covariances.
△ Less
Submitted 29 October, 2013; v1 submitted 25 October, 2013;
originally announced October 2013.
-
Path Integral Methods for Stochastic Differential Equations
Authors:
Carson C. Chow,
Michael A. Buice
Abstract:
We give a pedagogical review of the application of field theoretic and path integral methods to calculate moments of the probability density function of stochastic differential equations perturbatively.
We give a pedagogical review of the application of field theoretic and path integral methods to calculate moments of the probability density function of stochastic differential equations perturbatively.
△ Less
Submitted 9 October, 2012; v1 submitted 29 September, 2010;
originally announced September 2010.
-
Systematic fluctuation expansion for neural network activity equations
Authors:
Michael A. Buice,
Jack D. Cowan,
Carson C. Chow
Abstract:
Population rate or activity equations are the foundation of a common approach to modeling for neural networks. These equations provide mean field dynamics for the firing rate or activity of neurons within a network given some connectivity. The shortcoming of these equations is that they take into account only the average firing rate while leaving out higher order statistics like correlations bet…
▽ More
Population rate or activity equations are the foundation of a common approach to modeling for neural networks. These equations provide mean field dynamics for the firing rate or activity of neurons within a network given some connectivity. The shortcoming of these equations is that they take into account only the average firing rate while leaving out higher order statistics like correlations between firing. A stochastic theory of neural networks which includes statistics at all orders was recently formulated. We describe how this theory yields a systematic extension to population rate equations by introducing equations for correlations and appropriate coupling terms. Each level of the approximation yields closed equations, i.e. they depend only upon the mean and specific correlations of interest, without an {\it ad hoc} criterion for doing so. We show in an example of an all-to-all connected network how our system of generalized activity equations captures phenomena missed by the mean fieldrate equations alone.
△ Less
Submitted 15 May, 2009; v1 submitted 23 February, 2009;
originally announced February 2009.
-
Correlations, fluctuations and stability of a finite-size network of coupled oscillators
Authors:
Michael A. Buice,
Carson C. Chow
Abstract:
The incoherent state of the Kuramoto model of coupled oscillators exhibits marginal modes in mean field theory. We demonstrate that corrections due to finite size effects render these modes stable in the subcritical case, i.e. when the population is not synchronous. This demonstration is facilitated by the construction of a non-equilibrium statistical field theoretic formulation of a generic mod…
▽ More
The incoherent state of the Kuramoto model of coupled oscillators exhibits marginal modes in mean field theory. We demonstrate that corrections due to finite size effects render these modes stable in the subcritical case, i.e. when the population is not synchronous. This demonstration is facilitated by the construction of a non-equilibrium statistical field theoretic formulation of a generic model of coupled oscillators. This theory is consistent with previous results. In the all-to-all case, the fluctuations in this theory are due completely to finite size corrections, which can be calculated in an expansion in 1/N, where N is the number of oscillators. The N -> infinity limit of this theory is what is traditionally called mean field theory for the Kuramoto model.
△ Less
Submitted 7 June, 2007; v1 submitted 12 April, 2007;
originally announced April 2007.
-
A Kinetic Theory of Coupled Oscillators
Authors:
Eric J. Hildebrand,
Michael A. Buice,
Carson C. Chow
Abstract:
We present an approach for the description of fluctuations that are due to finite system size induced correlations in the Kuramoto model of coupled oscillators. We construct a hierarchy for the moments of the density of oscillators that is analogous to the BBGKY hierarchy in the kinetic theory of plasmas and gases. To calculate the lowest order system size effect, we truncate this hierarchy at s…
▽ More
We present an approach for the description of fluctuations that are due to finite system size induced correlations in the Kuramoto model of coupled oscillators. We construct a hierarchy for the moments of the density of oscillators that is analogous to the BBGKY hierarchy in the kinetic theory of plasmas and gases. To calculate the lowest order system size effect, we truncate this hierarchy at second order and solve the resulting closed equations for the two-oscillator correlation function around the incoherent state. We use this correlation function to compute the fluctuations of the order parameter, including the effect of transients, and compare this computation with numerical simulations.
△ Less
Submitted 12 December, 2006;
originally announced December 2006.
-
Direct Measurement of the Top Quark Charge at Hadron Colliders
Authors:
U. Baur,
M. Buice,
L. H. Orr
Abstract:
We consider photon radiation in tbar-t events at the upgraded Fermilab Tevatron and the CERN Large Hadron Collider (LHC) as a tool to measure the electric charge of the top quark. We analyze the contributions of tbar-t-gamma production and radiative top quark decays to p-p, pbar-p -> gamma l^+/- nu bbar-b jj, assuming that both b-quarks are tagged. With 20~fb^{-1} at the Tevatron, the possibilit…
▽ More
We consider photon radiation in tbar-t events at the upgraded Fermilab Tevatron and the CERN Large Hadron Collider (LHC) as a tool to measure the electric charge of the top quark. We analyze the contributions of tbar-t-gamma production and radiative top quark decays to p-p, pbar-p -> gamma l^+/- nu bbar-b jj, assuming that both b-quarks are tagged. With 20~fb^{-1} at the Tevatron, the possibility that the ``top quark'' discovered in Run I is actually an exotic charge -4/3 quark can be ruled out at the 95% confidence level. At the LHC, it will be possible to determine the charge of the top quark with an accuracy of about 10%.
△ Less
Submitted 28 June, 2001;
originally announced June 2001.
-
Top Quark Physics
Authors:
M. Beneke,
I. Efthymiopoulos,
M. L. Mangano,
J. Womersley,
A. Ahmadov,
G. Azuelos,
U. Baur,
A. Belyaev,
E. L. Berger,
W. Bernreuther,
E. E. Boos,
M. Bosman,
A. Brandenburg,
R. Brock,
M. Buice,
N. Cartiglia,
F. Cerutti,
A. Cheplakov,
L. Chikovani,
M. Cobal-Grassmann,
G. Corcella,
F. del Aguila,
T. Djobava,
J. Dodd,
V. Drollinger
, et al. (53 additional authors not shown)
Abstract:
We review the prospects for studies of the top quark at the LHC.
We review the prospects for studies of the top quark at the LHC.
△ Less
Submitted 4 March, 2000;
originally announced March 2000.
