Showing 1–2 of 2 results for author: Beccaria, M
-
A relativistic extension of Hopfield neural networks via the mechanical analogy
Authors:
Adriano Barra,
Matteo Beccaria,
Alberto Fachechi
Abstract:
We propose a modification of the cost function of the Hopfield model whose salient features shine in its Taylor expansion and result in more than pairwise interactions with alternate signs, suggesting a unified framework for handling both with deep learning and network pruning. In our analysis, we heavily rely on the Hamilton-Jacobi correspondence relating the statistical model with a mechanical s…
▽ More
We propose a modification of the cost function of the Hopfield model whose salient features shine in its Taylor expansion and result in more than pairwise interactions with alternate signs, suggesting a unified framework for handling both with deep learning and network pruning. In our analysis, we heavily rely on the Hamilton-Jacobi correspondence relating the statistical model with a mechanical system. In this picture, our model is nothing but the relativistic extension of the original Hopfield model (whose cost function is a quadratic form in the Mattis magnetization which mimics the non-relativistic Hamiltonian for a free particle). We focus on the low-storage regime and solve the model analytically by taking advantage of the mechanical analogy, thus obtaining a complete characterization of the free energy and the associated self-consistency equations in the thermodynamic limit. On the numerical side, we test the performances of our proposal with MC simulations, showing that the stability of spurious states (limiting the capabilities of the standard Hebbian construction) is sensibly reduced due to presence of unlearning contributions in this extended framework.
△ Less
Submitted 5 January, 2018;
originally announced January 2018.
-
An exact representation of the fermion dynamics in terms of Poisson processes and its connection with Monte Carlo algorithms
Authors:
Matteo Beccaria,
Carlo Presilla,
Gian Fabrizio De Angelis,
Giovanni Jona-Lasinio
Abstract:
We present a simple derivation of a Feynman-Kac type formula to study fermionic systems. In this approach the real time or the imaginary time dynamics is expressed in terms of the evolution of a collection of Poisson processes. A computer implementation of this formula leads to a family of algorithms parametrized by the values of the jump rates of the Poisson processes. From these an optimal alg…
▽ More
We present a simple derivation of a Feynman-Kac type formula to study fermionic systems. In this approach the real time or the imaginary time dynamics is expressed in terms of the evolution of a collection of Poisson processes. A computer implementation of this formula leads to a family of algorithms parametrized by the values of the jump rates of the Poisson processes. From these an optimal algorithm can be chosen which coincides with the Green Function Monte Carlo method in the limit when the latter becomes exact.
△ Less
Submitted 31 March, 1999; v1 submitted 26 October, 1998;
originally announced October 1998.
