-
Learning as filtering: implications for spike-based plasticity
Authors:
Jannes Jegminat,
Jean-Pascal Pfister
Abstract:
Most normative models in computational neuroscience describe the task of learning as the optimisation of a cost function with respect to a set of parameters. However, learning as optimisation fails to account for a time varying environment during the learning process; and the resulting point estimate in parameter space does not account for uncertainty. Here, we frame learning as filtering, i.e., a…
▽ More
Most normative models in computational neuroscience describe the task of learning as the optimisation of a cost function with respect to a set of parameters. However, learning as optimisation fails to account for a time varying environment during the learning process; and the resulting point estimate in parameter space does not account for uncertainty. Here, we frame learning as filtering, i.e., a principled method for including time and parameter uncertainty. We derive the filtering-based learning rule for a spiking neuronal network - the Synaptic Filter - and show its computational and biological relevance. For the computational relevance, we show that filtering in combination with Bayesian regression improves performance compared to a gradient learning rule with optimal learning rate in terms of weight estimation. Furthermore, the filtering-based rule outperforms gradient-based rules in the presence of model mismatch, indicating a better generalisation performance. The dynamics of the mean of the Synaptic Filter is consistent with the spike-timing dependent plasticity (STDP) while the dynamics of the variance makes novel predictions regarding spike-timing dependent changes of EPSP variability. Moreover, the Synaptic Filter explains experimentally observed negative correlations between homo- and heterosynaptic plasticity.
△ Less
Submitted 7 August, 2020;
originally announced August 2020.
-
Bayesian regression explains how human participants handle parameter uncertainty
Authors:
Jannes Jegminat,
Maya Jastrzebowska,
Matt Pachai,
Michael Herzog,
Jean-Pascal Pfister
Abstract:
The human brain copes with sensory uncertainty in accordance with Bayes' rule. However, it is unknown how the brain makes predictions in the presence of parameter uncertainty. Here, we tested whether and how humans take parameter uncertainty into account in a regression task. Participants extrapolated a parabola from a limited number of noisy points, shown on a computer screen. The quadratic param…
▽ More
The human brain copes with sensory uncertainty in accordance with Bayes' rule. However, it is unknown how the brain makes predictions in the presence of parameter uncertainty. Here, we tested whether and how humans take parameter uncertainty into account in a regression task. Participants extrapolated a parabola from a limited number of noisy points, shown on a computer screen. The quadratic parameter was drawn from a prior distribution, unknown to the observers. We tested whether human observers take full advantage of the given information, including the likelihood function of the observed points and the prior distribution of the quadratic parameter. We compared human performance with Bayesian regression, which is the (Bayes) optimal solution to this problem, and three sub-optimal models, namely maximum likelihood regression, prior regression and maximum a posteriori regression, which are simpler to compute. Our results clearly show that humans use Bayesian regression. We further investigated several variants of Bayesian regression models depending on how the generative noise is treated and found that participants act in line with the more sophisticated version.
△ Less
Submitted 19 March, 2019;
originally announced March 2019.
-
Synaptic plasticity as Bayesian inference
Authors:
Laurence Aitchison,
Jannes Jegminat,
Jorge Aurelio Menendez,
Jean-Pascal Pfister,
Alex Pouget,
Peter E. Latham
Abstract:
Learning, especially rapid learning, is critical for survival. However, learning is hard: a large number of synaptic weights must be set based on noisy, often ambiguous, sensory information. In such a high-noise regime, keeping track of probability distributions over weights is the optimal strategy. Here we hypothesize that synapses take that strategy; in essence, when they estimate weights, they…
▽ More
Learning, especially rapid learning, is critical for survival. However, learning is hard: a large number of synaptic weights must be set based on noisy, often ambiguous, sensory information. In such a high-noise regime, keeping track of probability distributions over weights is the optimal strategy. Here we hypothesize that synapses take that strategy; in essence, when they estimate weights, they include error bars. They then use that uncertainty to adjust their learning rates, with more uncertain weights having higher learning rates. We also make a second, independent, hypothesis: synapses communicate their uncertainty by linking it to variability in PSP size, with more uncertainty leading to more variability. These two hypotheses cast synaptic plasticity as a problem of Bayesian inference, and thus provide a normative view of learning. They generalize known learning rules, offer an explanation for the large variability in the size of post-synaptic potentials, and make falsifiable experimental predictions.
△ Less
Submitted 19 March, 2021; v1 submitted 4 October, 2014;
originally announced October 2014.
