-
Statistical mechanics of extensive-width Bayesian neural networks near interpolation
Authors:
Jean Barbier,
Francesco Camilli,
Minh-Toan Nguyen,
Mauro Pastore,
Rudy Skerk
Abstract:
For three decades statistical mechanics has been providing a framework to analyse neural networks. However, the theoretically tractable models, e.g., perceptrons, random features models and kernel machines, or multi-index models and committee machines with few neurons, remained simple compared to those used in applications. In this paper we help reducing the gap between practical networks and thei…
▽ More
For three decades statistical mechanics has been providing a framework to analyse neural networks. However, the theoretically tractable models, e.g., perceptrons, random features models and kernel machines, or multi-index models and committee machines with few neurons, remained simple compared to those used in applications. In this paper we help reducing the gap between practical networks and their theoretical understanding through a statistical physics analysis of the supervised learning of a two-layer fully connected network with generic weight distribution and activation function, whose hidden layer is large but remains proportional to the inputs dimension. This makes it more realistic than infinitely wide networks where no feature learning occurs, but also more expressive than narrow ones or with fixed inner weights. We focus on the Bayes-optimal learning in the teacher-student scenario, i.e., with a dataset generated by another network with the same architecture. We operate around interpolation, where the number of trainable parameters and of data are comparable and feature learning emerges. Our analysis uncovers a rich phenomenology with various learning transitions as the number of data increases. In particular, the more strongly the features (i.e., hidden neurons of the target) contribute to the observed responses, the less data is needed to learn them. Moreover, when the data is scarce, the model only learns non-linear combinations of the teacher weights, rather than "specialising" by aligning its weights with the teacher's. Specialisation occurs only when enough data becomes available, but it can be hard to find for practical training algorithms, possibly due to statistical-to-computational~gaps.
△ Less
Submitted 30 May, 2025;
originally announced May 2025.
-
Approximation of viscous transport and conservative equations with one sided Lipschitz velocity fields
Authors:
Fabio Camilli,
Adriano Festa,
Luciano Marzufero
Abstract:
The aim of this work is to investigate semi-Lagrangian approximation schemes on unstructured grids for viscous transport and conservative equations with measurable coefficients that satisfy a one-sided Lipschitz condition. To establish the convergence of the schemes, we exploit the characterization of the solution for these equations expressed in terms of measurable time-dependent viscosity soluti…
▽ More
The aim of this work is to investigate semi-Lagrangian approximation schemes on unstructured grids for viscous transport and conservative equations with measurable coefficients that satisfy a one-sided Lipschitz condition. To establish the convergence of the schemes, we exploit the characterization of the solution for these equations expressed in terms of measurable time-dependent viscosity solution and, respectively, duality solution. We supplement our theoretical analysis with various numerical examples to illustrate the features of the schemes.
△ Less
Submitted 13 May, 2025;
originally announced May 2025.
-
Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime
Authors:
Francesco Camilli,
Daria Tieplova,
Eleonora Bergamin,
Jean Barbier
Abstract:
We rigorously analyse fully-trained neural networks of arbitrary depth in the Bayesian optimal setting in the so-called proportional scaling regime where the number of training samples and width of the input and all inner layers diverge proportionally. We prove an information-theoretic equivalence between the Bayesian deep neural network model trained from data generated by a teacher with matching…
▽ More
We rigorously analyse fully-trained neural networks of arbitrary depth in the Bayesian optimal setting in the so-called proportional scaling regime where the number of training samples and width of the input and all inner layers diverge proportionally. We prove an information-theoretic equivalence between the Bayesian deep neural network model trained from data generated by a teacher with matching architecture, and a simpler model of optimal inference in a generalized linear model. This equivalence enables us to compute the optimal generalization error for deep neural networks in this regime. We thus prove the "deep Gaussian equivalence principle" conjectured in Cui et al. (2023) (arXiv:2302.00375). Our result highlights that in order to escape this "trivialisation" of deep neural networks (in the sense of reduction to a linear model) happening in the strongly overparametrized proportional regime, models trained from much more data have to be considered.
△ Less
Submitted 6 May, 2025;
originally announced May 2025.
-
Limit theorems for the non-convex multispecies Curie-Weiss model
Authors:
Francesco Camilli,
Emanuele Mingione,
Godwin Osabutey
Abstract:
We study the thermodynamic properties of the generalized non-convex multispecies Curie-Weiss model, where interactions among different types of particles (forming the species) are encoded in a generic matrix. For spins with a generic prior distribution, we compute the pressure in the thermodynamic limit using simple interpolation techniques. For Ising spins, we further analyze the fluctuations of…
▽ More
We study the thermodynamic properties of the generalized non-convex multispecies Curie-Weiss model, where interactions among different types of particles (forming the species) are encoded in a generic matrix. For spins with a generic prior distribution, we compute the pressure in the thermodynamic limit using simple interpolation techniques. For Ising spins, we further analyze the fluctuations of the magnetization in the thermodynamic limit under the Boltzmann-Gibbs measure. It is shown that a central limit theorem holds for a rescaled and centered vector of species magnetizations, which converges to either a centered or non-centered multivariate normal distribution, depending on the rate of convergence of the relative sizes of the species.
△ Less
Submitted 27 February, 2025;
originally announced February 2025.
-
Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
Authors:
Jean Barbier,
Francesco Camilli,
Minh-Toan Nguyen,
Mauro Pastore,
Rudy Skerk
Abstract:
We consider a teacher-student model of supervised learning with a fully-trained two-layer neural network whose width $k$ and input dimension $d$ are large and proportional. We provide an effective theory for approximating the Bayes-optimal generalisation error of the network for any activation function in the regime of sample size $n$ scaling quadratically with the input dimension, i.e., around th…
▽ More
We consider a teacher-student model of supervised learning with a fully-trained two-layer neural network whose width $k$ and input dimension $d$ are large and proportional. We provide an effective theory for approximating the Bayes-optimal generalisation error of the network for any activation function in the regime of sample size $n$ scaling quadratically with the input dimension, i.e., around the interpolation threshold where the number of trainable parameters $kd+k$ and of data $n$ are comparable. Our analysis tackles generic weight distributions. We uncover a discontinuous phase transition separating a "universal" phase from a "specialisation" phase. In the first, the generalisation error is independent of the weight distribution and decays slowly with the sampling rate $n/d^2$, with the student learning only some non-linear combinations of the teacher weights. In the latter, the error is weight distribution-dependent and decays faster due to the alignment of the student towards the teacher network. We thus unveil the existence of a highly predictive solution near interpolation, which is however potentially hard to find by practical algorithms.
△ Less
Submitted 1 April, 2025; v1 submitted 30 January, 2025;
originally announced January 2025.
-
Li-Yau inequality and related properties on metric star graphs
Authors:
Fabio Camilli
Abstract:
We prove a Li-Yau gradient estimate for positive solutions to the heat equation defined on a metric star graph $\mG$ given by the heat kernel formula. As consequence, we derive a Harnack estimate and a Liouville property for bounded harmonic functions. The argument exploits an explicit representation formula for the heat kernel on $\mG$.
We prove a Li-Yau gradient estimate for positive solutions to the heat equation defined on a metric star graph $\mG$ given by the heat kernel formula. As consequence, we derive a Harnack estimate and a Liouville property for bounded harmonic functions. The argument exploits an explicit representation formula for the heat kernel on $\mG$.
△ Less
Submitted 22 January, 2025;
originally announced January 2025.
-
On the phase diagram of the multiscale mean-field spin-glass
Authors:
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione,
Daniele Tantari
Abstract:
In this paper we study the phase diagram of a Sherrington-Kirkpatrick (SK) model where the couplings are forced to thermalize at different times scales. Besides being a challenging generalization of the SK model, such settings may arise naturally in physics whenever part of the many degrees of freedom of a system relaxes to equilibrium considerably faster than the others. For this model we compute…
▽ More
In this paper we study the phase diagram of a Sherrington-Kirkpatrick (SK) model where the couplings are forced to thermalize at different times scales. Besides being a challenging generalization of the SK model, such settings may arise naturally in physics whenever part of the many degrees of freedom of a system relaxes to equilibrium considerably faster than the others. For this model we compute the asymptotic value of the second moment of the overlap distribution. Furthermore, we provide a rigorous sufficient condition for an annealed solution to hold, identifying a high temperature region. In addition, we also prove that for sufficiently low temperature the solution must present a number of replica symmetry breaking levels at least equal to the number of time scales already present in the multiscale model. Finally, we give a sufficient condition for the existence of gaps in the support of the functional order parameters.
△ Less
Submitted 1 December, 2024;
originally announced December 2024.
-
On the phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariance
Authors:
Jean Barbier,
Francesco Camilli,
Justin Ko,
Koki Okajima
Abstract:
Matrix denoising is central to signal processing and machine learning. Its statistical analysis when the matrix to infer has a factorised structure with a rank growing proportionally to its dimension remains a challenge, except when it is rotationally invariant. In this case the information theoretic limits and an efficient Bayes-optimal denoising algorithm, called rotational invariant estimator […
▽ More
Matrix denoising is central to signal processing and machine learning. Its statistical analysis when the matrix to infer has a factorised structure with a rank growing proportionally to its dimension remains a challenge, except when it is rotationally invariant. In this case the information theoretic limits and an efficient Bayes-optimal denoising algorithm, called rotational invariant estimator [1,2], are known. Beyond this setting few results can be found. The reason is that the model is not a usual spin system because of the growing rank dimension, nor a matrix model (as appearing in high-energy physics) due to the lack of rotation symmetry, but rather a hybrid between the two. Here we make progress towards the understanding of Bayesian matrix denoising when the signal is a factored matrix $XX^\intercal$ that is not rotationally invariant. Monte Carlo simulations suggest the existence of a \emph{denoising-factorisation transition} separating a phase where denoising using the rotational invariant estimator remains Bayes-optimal due to universality properties of the same nature as in random matrix theory, from one where universality breaks down and better denoising is possible, though algorithmically hard. We argue that it is only beyond the transition that factorisation, i.e., estimating $X$ itself, becomes possible up to irresolvable ambiguities. On the theory side, we combine mean-field techniques in an interpretable multiscale fashion in order to access the minimum mean-square error and mutual information. Interestingly, our alternative method yields equations reproducible by the replica approach of [3]. Using numerical insights, we delimit the portion of phase diagram where we conjecture the mean-field theory to be exact, and correct it using universality when it is not. Our complete ansatz matches well the numerics in the whole phase diagram when considering finite size effects.
△ Less
Submitted 14 March, 2025; v1 submitted 4 November, 2024;
originally announced November 2024.
-
A note on first order quasi-stationary Mean Field Games
Authors:
Fabio Camilli,
Claudio Marchi,
Cristian Mendico
Abstract:
Quasi-stationary Mean Field Games models consider agents who base their strategies on current information without forecasting future states. In this paper we address the first-order quasi-stationary Mean Field Games system, which involves an ergodic Hamilton-Jacobi equation and an evolutive continuity equation. Our approach relies on weak KAM theory. We introduce assumptions on the Hamiltonian and…
▽ More
Quasi-stationary Mean Field Games models consider agents who base their strategies on current information without forecasting future states. In this paper we address the first-order quasi-stationary Mean Field Games system, which involves an ergodic Hamilton-Jacobi equation and an evolutive continuity equation. Our approach relies on weak KAM theory. We introduce assumptions on the Hamiltonian and coupling cost to ensure continuity of the Peierls barrier and the Aubry set over time. These assumptions, though restrictive, cover interesting cases such as perturbed mechanical Hamiltonians.
△ Less
Submitted 27 September, 2024;
originally announced September 2024.
-
A network model for urban planning
Authors:
Fabio Camilli,
Adriano Festa,
Luciano Marzufero
Abstract:
We study a mathematical model to describe the evolution of a city, which is determined by the interaction of two large populations of agents, workers and firms. The map of the city is described by a network with the edges representing at the same time residential areas and communication routes. The two populations compete for space while interacting through the labour market. The resulting model i…
▽ More
We study a mathematical model to describe the evolution of a city, which is determined by the interaction of two large populations of agents, workers and firms. The map of the city is described by a network with the edges representing at the same time residential areas and communication routes. The two populations compete for space while interacting through the labour market. The resulting model is described by a two population Mean-Field Game system coupled with an Optimal Transport problem.We prove existence and uniqueness of the solution and we provide several numerical simulations.
△ Less
Submitted 9 August, 2024;
originally announced August 2024.
-
Stationary Mean Field Games on networks with sticky transition conditions
Authors:
Jules Berry,
Fabio Camilli
Abstract:
We study stochastic Mean Field Games on networks with sticky transition conditions. In this setting, the diffusion process governing the agent's dynamics can spend finite time both in the interior of the edges and at the vertices. The corresponding generator is subject to limitations concerning second-order derivatives and the invariant measure breaks down into a combination of an absolutely cont…
▽ More
We study stochastic Mean Field Games on networks with sticky transition conditions. In this setting, the diffusion process governing the agent's dynamics can spend finite time both in the interior of the edges and at the vertices. The corresponding generator is subject to limitations concerning second-order derivatives and the invariant measure breaks down into a combination of an absolutely continuous measure within the edges and a sum of Dirac measures positioned at the vertices. Additionally, the value function, solution to the Hamilton-Jacobi-Bellman equation, satisfies generalized Kirchhoff conditions at the vertices.
△ Less
Submitted 16 January, 2025; v1 submitted 28 June, 2024;
originally announced June 2024.
-
Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise
Authors:
Jean Barbier,
Francesco Camilli,
Marco Mondelli,
Yizhou Xu
Abstract:
We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a Gaussian Wigner matrix, the more realistic case of structured noise still proves to be challenging. To capture the structure while maintaining mathematical tractabili…
▽ More
We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a Gaussian Wigner matrix, the more realistic case of structured noise still proves to be challenging. To capture the structure while maintaining mathematical tractability, a line of work has focused on rotationally invariant noise. However, existing studies either provide sub-optimal algorithms or are limited to special cases of noise ensembles. In this paper, using tools from statistical physics (replica method) and random matrix theory (generalized spherical integrals) we establish the first characterization of the information-theoretic limits for a noise matrix drawn from a general trace ensemble. Remarkably, our analysis unveils the asymptotic equivalence between the rotationally invariant model and a surrogate Gaussian one. Finally, we show how to saturate the predicted statistical limits using an efficient algorithm inspired by the theory of adaptive Thouless-Anderson-Palmer (TAP) equations.
△ Less
Submitted 8 July, 2024; v1 submitted 31 May, 2024;
originally announced May 2024.
-
Learning equilibria in Cournot mean field games of controls
Authors:
Fabio Camilli,
Mathieu Laurière,
Qing Tang
Abstract:
We consider Cournot mean field games of controls, a model originally developed for the production of an exhaustible resource by a continuum of producers. We prove uniqueness of the solution under general assumptions on the price function. Then, we prove convergence of a learning algorithm which gives existence of a solution to the mean field games system. The learning algorithm is implemented with…
▽ More
We consider Cournot mean field games of controls, a model originally developed for the production of an exhaustible resource by a continuum of producers. We prove uniqueness of the solution under general assumptions on the price function. Then, we prove convergence of a learning algorithm which gives existence of a solution to the mean field games system. The learning algorithm is implemented with a suitable finite difference discretization to get a numerical method to the solution. We supplement our theoretical analysis with several numerical examples and illustrate the impacts of model parameters.
△ Less
Submitted 29 October, 2024; v1 submitted 2 May, 2024;
originally announced May 2024.
-
On the quadratic convergence of Newton's method for Mean Field Games with non-separable Hamiltonian
Authors:
Fabio Camilli,
Qing Tang
Abstract:
We analyze asymptotic convergence properties of Newton's method for a class of evolutive Mean Field Games systems with non-separable Hamiltonian arising in mean field type models with congestion. We prove the well posedness of the Mean Field Game system with non-separable Hamiltonian and of the linear system giving the Newton iterations. Then, by forward induction and assuming that the initial gue…
▽ More
We analyze asymptotic convergence properties of Newton's method for a class of evolutive Mean Field Games systems with non-separable Hamiltonian arising in mean field type models with congestion. We prove the well posedness of the Mean Field Game system with non-separable Hamiltonian and of the linear system giving the Newton iterations. Then, by forward induction and assuming that the initial guess is sufficiently close to the solution of problem, we show a quadratic rate of convergence for the approximation of the Mean Field Game system by Newton's method. We also consider the case of a nonlocal coupling, but with separable Hamiltonian, and we show a similar rate of convergence.
△ Less
Submitted 18 March, 2024; v1 submitted 9 November, 2023;
originally announced November 2023.
-
The Decimation Scheme for Symmetric Matrix Factorization
Authors:
Francesco Camilli,
Marc Mézard
Abstract:
Matrix factorization is an inference problem that has acquired importance due to its vast range of applications that go from dictionary learning to recommendation systems and machine learning with deep networks. The study of its fundamental statistical limits represents a true challenge, and despite a decade-long history of efforts in the community, there is still no closed formula able to describ…
▽ More
Matrix factorization is an inference problem that has acquired importance due to its vast range of applications that go from dictionary learning to recommendation systems and machine learning with deep networks. The study of its fundamental statistical limits represents a true challenge, and despite a decade-long history of efforts in the community, there is still no closed formula able to describe its optimal performances in the case where the rank of the matrix scales linearly with its size. In the present paper, we study this extensive rank problem, extending the alternative 'decimation' procedure that we recently introduced, and carry out a thorough study of its performance. Decimation aims at recovering one column/line of the factors at a time, by mapping the problem into a sequence of neural network models of associative memory at a tunable temperature. Though being sub-optimal, decimation has the advantage of being theoretically analyzable. We extend its scope and analysis to two families of matrices. For a large class of compactly supported priors, we show that the replica symmetric free entropy of the neural network models takes a universal form in the low temperature limit. For sparse Ising prior, we show that the storage capacity of the neural network models diverges as sparsity in the patterns increases, and we introduce a simple algorithm based on a ground state search that implements decimation and performs matrix factorization, with no need of an informative initialization.
△ Less
Submitted 31 July, 2023;
originally announced July 2023.
-
Quantitative and qualitative properties for Hamilton-Jacobi PDEs via the nonlinear adjoint method
Authors:
Fabio Camilli,
Alessandro Goffi,
Cristian Mendico
Abstract:
We provide some new integral estimates for solutions to Hamilton-Jacobi equations and we discuss several consequences, ranging from $L^p$-rates of convergence for the vanishing viscosity approximation to regularizing effects for the Cauchy problem in the whole Euclidean space and Liouville-type theorems. Our approach is based on duality techniques à la Evans and a careful study of advection-diffus…
▽ More
We provide some new integral estimates for solutions to Hamilton-Jacobi equations and we discuss several consequences, ranging from $L^p$-rates of convergence for the vanishing viscosity approximation to regularizing effects for the Cauchy problem in the whole Euclidean space and Liouville-type theorems. Our approach is based on duality techniques à la Evans and a careful study of advection-diffusion equations. The optimality of the results is discussed by several examples.
△ Less
Submitted 28 November, 2024; v1 submitted 24 July, 2023;
originally announced July 2023.
-
Fundamental limits of overparametrized shallow neural networks for supervised learning
Authors:
Francesco Camilli,
Daria Tieplova,
Jean Barbier
Abstract:
We carry out an information-theoretical analysis of a two-layer neural network trained from input-output pairs generated by a teacher network with matching architecture, in overparametrized regimes. Our results come in the form of bounds relating i) the mutual information between training data and network weights, or ii) the Bayes-optimal generalization error, to the same quantities but for a simp…
▽ More
We carry out an information-theoretical analysis of a two-layer neural network trained from input-output pairs generated by a teacher network with matching architecture, in overparametrized regimes. Our results come in the form of bounds relating i) the mutual information between training data and network weights, or ii) the Bayes-optimal generalization error, to the same quantities but for a simpler (generalized) linear model for which explicit expressions are rigorously known. Our bounds, which are expressed in terms of the number of training samples, input dimension and number of hidden units, thus yield fundamental performance limits for any neural network (and actually any learning procedure) trained from limited data generated according to our two-layer teacher neural network model. The proof relies on rigorous tools from spin glasses and is guided by ``Gaussian equivalence principles'' lying at the core of numerous recent analyses of neural networks. With respect to the existing literature, which is either non-rigorous or restricted to the case of the learning of the readout weights only, our results are information-theoretic (i.e. are not specific to any learning algorithm) and, importantly, cover a setting where all the network parameters are trained.
△ Less
Submitted 11 July, 2023;
originally announced July 2023.
-
Central limit theorem for the overlaps on the Nishimori line
Authors:
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
The overlap distribution of the Sherrington-Kirkpatrick model on the Nishimori line has been proved to be self averaging for large volumes. Here we study the joint distribution of the rescaled overlaps around their common mean and prove that it converges to a Gaussian vector.
The overlap distribution of the Sherrington-Kirkpatrick model on the Nishimori line has been proved to be self averaging for large volumes. Here we study the joint distribution of the rescaled overlaps around their common mean and prove that it converges to a Gaussian vector.
△ Less
Submitted 25 June, 2023; v1 submitted 31 May, 2023;
originally announced May 2023.
-
A continuous dependence estimate for viscous Hamilton-Jacobi equations on networks with applications
Authors:
Fabio Camilli,
Claudio Marchi
Abstract:
We study continuous dependence estimates for viscous Hamilton- Jacobi equations defined on a network Gamma. Given two Hamilton-Jacobi equations, we prove an estimate of the C2-norm of the difference between the corresponding solutions in terms of the distance among the coefficients. We also provide two applications of the previous estimate: the first one is an existence and uniqueness result for a…
▽ More
We study continuous dependence estimates for viscous Hamilton- Jacobi equations defined on a network Gamma. Given two Hamilton-Jacobi equations, we prove an estimate of the C2-norm of the difference between the corresponding solutions in terms of the distance among the coefficients. We also provide two applications of the previous estimate: the first one is an existence and uniqueness result for a quasi-stationary Mean Field Games defined on the network Gamma; the second one is an estimate of the rate of convergence for homogenization of Hamilton-Jacobi equations defined on a periodic network, when the size of the cells vanishes and the limit problem is defined in the whole Euclidean space.
△ Less
Submitted 8 March, 2023;
originally announced March 2023.
-
Matrix factorization with neural networks
Authors:
Francesco Camilli,
Marc Mézard
Abstract:
Matrix factorization is an important mathematical problem encountered in the context of dictionary learning, recommendation systems and machine learning. We introduce a new `decimation' scheme that maps it to neural network models of associative memory and provide a detailed theoretical analysis of its performance, showing that decimation is able to factorize extensive-rank matrices and to denoise…
▽ More
Matrix factorization is an important mathematical problem encountered in the context of dictionary learning, recommendation systems and machine learning. We introduce a new `decimation' scheme that maps it to neural network models of associative memory and provide a detailed theoretical analysis of its performance, showing that decimation is able to factorize extensive-rank matrices and to denoise them efficiently. We introduce a decimation algorithm based on ground-state search of the neural network, which shows performances that match the theoretical prediction.
△ Less
Submitted 5 December, 2022;
originally announced December 2022.
-
Bayes-optimal limits in structured PCA, and how to reach them
Authors:
Jean Barbier,
Francesco Camilli,
Marco Mondelli,
Manuel Saenz
Abstract:
How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by additive noise. We go beyond the usual independence assumption on the noise entries, by drawing the noise from a low-order polynomial orthogonal matrix ensemble. The r…
▽ More
How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by additive noise. We go beyond the usual independence assumption on the noise entries, by drawing the noise from a low-order polynomial orthogonal matrix ensemble. The resulting noise correlations make the setting relevant for applications but analytically challenging. We provide the first characterization of the Bayes-optimal limits of inference in this model. If the spike is rotation-invariant, we show that standard spectral PCA is optimal. However, for more general priors, both PCA and the existing approximate message passing algorithm (AMP) fall short of achieving the information-theoretic limits, which we compute using the replica method from statistical mechanics. We thus propose a novel AMP, inspired by the theory of Adaptive Thouless-Anderson-Palmer equations, which saturates the theoretical limit. This AMP comes with a rigorous state evolution analysis tracking its performance. Although we focus on specific noise distributions, our methodology can be generalized to a wide class of trace matrix ensembles at the cost of more involved expressions. Finally, despite the seemingly strong assumption of rotation-invariant noise, our theory empirically predicts algorithmic performance on real data, pointing at remarkable universality properties.
△ Less
Submitted 2 June, 2023; v1 submitted 3 October, 2022;
originally announced October 2022.
-
Approximation of the value function for optimal control problems on stratified domains
Authors:
Simone Cacace,
Fabio Camilli
Abstract:
In optimal control problems defined on stratified domains, the dynamics and the running cost may have discontinuities on a finite union of submanifolds of RN. In [8, 5], the corresponding value function is characterized as the unique viscosity solution of a discontinuous Hamilton-Jacobi equation satisfying additional viscosity conditions on the submanifolds. In this paper, we consider a semi-Lagra…
▽ More
In optimal control problems defined on stratified domains, the dynamics and the running cost may have discontinuities on a finite union of submanifolds of RN. In [8, 5], the corresponding value function is characterized as the unique viscosity solution of a discontinuous Hamilton-Jacobi equation satisfying additional viscosity conditions on the submanifolds. In this paper, we consider a semi-Lagrangian approximation scheme for the previous problem. Relying on a classical stability argument in viscosity solution theory, we prove the convergence of the scheme to the value function. We also present HJSD, a free software we developed for the numerical solution of control problems on stratified domains in two and three dimensions, showing, in various examples, the particular phenomena that can arise with respect to the classical continuous framework.
△ Less
Submitted 14 July, 2022;
originally announced July 2022.
-
On quasi-stationary Mean Field Games of Controls
Authors:
Fabio Camilli,
Claudio Marchi
Abstract:
In Mean Field Games of Controls, the dynamics of the single agent is influenced not only by the distribution of the agents, as in the classical theory, but also by the distribution of their optimal strategies. In this paper, we study quasi-stationary Mean Field Games of Controls, which differs from the standard case in the strategy-choice mechanism of the agent: it cannot predict the evolution of…
▽ More
In Mean Field Games of Controls, the dynamics of the single agent is influenced not only by the distribution of the agents, as in the classical theory, but also by the distribution of their optimal strategies. In this paper, we study quasi-stationary Mean Field Games of Controls, which differs from the standard case in the strategy-choice mechanism of the agent: it cannot predict the evolution of the population, but chooses its strategy only on the basis of the information available at the given instant of time, without anticipating. We prove existence and uniqueness for the solution of the corresponding quasi-stationary Mean Field Games system under different sets of hypotheses and we provide some examples of models which fall within these hypotheses.
△ Less
Submitted 31 January, 2023; v1 submitted 11 April, 2022;
originally announced April 2022.
-
Rates of convergence for the policy iteration method for Mean Field Games systems
Authors:
Fabio Camilli,
Qing Tang
Abstract:
Convergence of the policy iteration method for discrete and continuous optimal control problems holds under general assumptions. Moreover, in some circumstances, it is also possible to show a quadratic rate of convergence for the algorithm. For Mean Field Games, convergence of the policy iteration method has been recently proved in [9]. Here, we provide an estimate of its rate of convergence.
Convergence of the policy iteration method for discrete and continuous optimal control problems holds under general assumptions. Moreover, in some circumstances, it is also possible to show a quadratic rate of convergence for the algorithm. For Mean Field Games, convergence of the policy iteration method has been recently proved in [9]. Here, we provide an estimate of its rate of convergence.
△ Less
Submitted 1 March, 2022; v1 submitted 2 August, 2021;
originally announced August 2021.
-
An inference problem in a mismatched setting: a spin-glass model with Mattis interaction
Authors:
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
The Wigner spiked model in a mismatched setting is studied with the finite temperature Statistical Mechanics approach through its representation as a Sherrington-Kirkpatrick model with added Mattis interaction. The exact solution of the model with Ising spins is rigorously proved to be given by a variational principle on two order parameters, the Parisi overlap distribution and the Mattis magnetiz…
▽ More
The Wigner spiked model in a mismatched setting is studied with the finite temperature Statistical Mechanics approach through its representation as a Sherrington-Kirkpatrick model with added Mattis interaction. The exact solution of the model with Ising spins is rigorously proved to be given by a variational principle on two order parameters, the Parisi overlap distribution and the Mattis magnetization. The latter is identified by an ordinary variational principle and turns out to concentrate in the thermodynamic limit. The solution leads to the computation of the Mean Square Error of the mismatched reconstruction. The Gaussian signal distribution case is investigated and the corresponding phase diagram is identified.
△ Less
Submitted 28 January, 2022; v1 submitted 24 July, 2021;
originally announced July 2021.
-
A system of of Hamilton-Jacobi equations characterizing geodesic centroidal tessellations
Authors:
Fabio Camilli,
Adriano Festa
Abstract:
We introduce a class of systems of Hamilton-Jacobi equations characterizing geodesic centroidal tessellations, i.e. tessellations of domains with respect to geodesic distances where generators and centroids coincide. Typical examples are given by geodesic centroidal Voronoi tessellations and geodesic centroidal power diagrams. An appropriate version of the Fast Marching method on unstructured grid…
▽ More
We introduce a class of systems of Hamilton-Jacobi equations characterizing geodesic centroidal tessellations, i.e. tessellations of domains with respect to geodesic distances where generators and centroids coincide. Typical examples are given by geodesic centroidal Voronoi tessellations and geodesic centroidal power diagrams. An appropriate version of the Fast Marching method on unstructured grids allows computing the solution of the Hamilton-Jacobi system and therefore the associated tessellations. We propose various numerical examples to illustrate the features of the technique.
△ Less
Submitted 25 May, 2022; v1 submitted 20 June, 2021;
originally announced June 2021.
-
The solution of the deep Boltzmann machine on the Nishimori line
Authors:
Diego Alberici,
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
The deep Boltzmann machine on the Nishimori line with a finite number of layers is exactly solved by a theorem that expresses its pressure through a finite dimensional variational problem of min-max type. In the absence of magnetic fields the order parameter is shown to exhibit a phase transition.
The deep Boltzmann machine on the Nishimori line with a finite number of layers is exactly solved by a theorem that expresses its pressure through a finite dimensional variational problem of min-max type. In the absence of magnetic fields the order parameter is shown to exhibit a phase transition.
△ Less
Submitted 9 July, 2021; v1 submitted 27 December, 2020;
originally announced December 2020.
-
A quadratic Mean Field Games model for the Langevin equation
Authors:
Fabio Camilli
Abstract:
We consider a Mean Field Games model where the dynamics of the agents is given by a controlled Langevin equation and the cost is quadratic. A change of variables, introduced in [9], transforms the Mean Field Games system into a system of two coupled kinetic Fokker-Planck equations. We prove an existence result for the latter system, obtaining consequently existence of a solution for the Mean Field…
▽ More
We consider a Mean Field Games model where the dynamics of the agents is given by a controlled Langevin equation and the cost is quadratic. A change of variables, introduced in [9], transforms the Mean Field Games system into a system of two coupled kinetic Fokker-Planck equations. We prove an existence result for the latter system, obtaining consequently existence of a solution for the Mean Field Games system.
△ Less
Submitted 10 January, 2021; v1 submitted 21 July, 2020;
originally announced July 2020.
-
The multi-species mean-field spin-glass on the Nishimori line
Authors:
Diego Alberici,
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
In this paper we study a multi-species disordered model on the Nishimori line. The typical properties of this line, a set of identities and inequalities among correlation functions, allow us to prove the replica symmetry i.e. the concentration of the order parameter. When the interaction structure is elliptic we rigorously compute the exact solution of the model in terms of a finite dimensional va…
▽ More
In this paper we study a multi-species disordered model on the Nishimori line. The typical properties of this line, a set of identities and inequalities among correlation functions, allow us to prove the replica symmetry i.e. the concentration of the order parameter. When the interaction structure is elliptic we rigorously compute the exact solution of the model in terms of a finite dimensional variational principle and we study its properties.
△ Less
Submitted 26 December, 2020; v1 submitted 17 July, 2020;
originally announced July 2020.
-
A policy iteration method for Mean Field Games
Authors:
Simone Cacace,
Fabio Camilli,
Alessandro Goffi
Abstract:
The policy iteration method is a classical algorithm for solving optimal control problems. In this paper, we introduce a policy iteration method for Mean Field Games systems, and we study the convergence of this procedure to a solution of the problem. We also introduce suitable discretizations to numerically solve both stationary and evolutive problems. We show the convergence of the policy iterat…
▽ More
The policy iteration method is a classical algorithm for solving optimal control problems. In this paper, we introduce a policy iteration method for Mean Field Games systems, and we study the convergence of this procedure to a solution of the problem. We also introduce suitable discretizations to numerically solve both stationary and evolutive problems. We show the convergence of the policy iteration method for the discrete problem and we study the performance of the proposed algorithm on some examples in dimension one and two.
△ Less
Submitted 9 July, 2021; v1 submitted 9 July, 2020;
originally announced July 2020.
-
Approximation of an optimal control problem for the time-fractional Fokker-Planck equation
Authors:
Fabio Camilli,
Serikbolsyn Duisembay,
Qing Tang
Abstract:
In this paper, we study the numerical approximation of a system of PDEs with fractional time derivatives. This system is derived from an optimal control problem for a time-fractional Fokker-Planck equation with time dependent drift by convex duality argument. The system is composed by a time-fractional backward Hamilton-Jacobi-Bellman and a forward Fokker-Planck equation and can be used to describ…
▽ More
In this paper, we study the numerical approximation of a system of PDEs with fractional time derivatives. This system is derived from an optimal control problem for a time-fractional Fokker-Planck equation with time dependent drift by convex duality argument. The system is composed by a time-fractional backward Hamilton-Jacobi-Bellman and a forward Fokker-Planck equation and can be used to describe the evolution of probability density of particles trapped in anomalous diffusion regimes. We approximate Caputo derivatives in the system by means of L1 schemes and the Hamiltonian by finite differences. The scheme for the Fokker-Planck equation is constructed such that the duality structure of the PDE system is preserved on the discrete level. We prove the well posedness of the scheme and the convergence to the solution of the continuous problem.
△ Less
Submitted 5 June, 2020;
originally announced June 2020.
-
A Mean Field Games model for finite mixtures of Bernoulli and Categorical distributions
Authors:
Laura Aquilanti,
Simone Cacace,
Fabio Camilli,
Raul De Maio
Abstract:
Finite mixture models are an important tool in the statistical analysis of data, for example in data clustering. The optimal parameters of a mixture model are usually computed by maximizing the log-likelihood functional via the Expectation-Maximization algorithm. We propose an alternative approach based on the theory of Mean Field Games, a class of differential games with an infinite number of age…
▽ More
Finite mixture models are an important tool in the statistical analysis of data, for example in data clustering. The optimal parameters of a mixture model are usually computed by maximizing the log-likelihood functional via the Expectation-Maximization algorithm. We propose an alternative approach based on the theory of Mean Field Games, a class of differential games with an infinite number of agents. We show that the solution of a finite state space multi-population Mean Field Games system characterizes the critical points of the log-likelihood functional for a Bernoulli mixture. The approach is then generalized to mixture models of categorical distributions. Hence, the Mean Field Games approach provides a method to compute the parameters of the mixture model, and we show its application to some standard examples in cluster analysis.
△ Less
Submitted 27 November, 2020; v1 submitted 17 April, 2020;
originally announced April 2020.
-
A note on Kazdan-Warner equation on networks
Authors:
Fabio Camilli,
Claudio Marchi
Abstract:
We investigate the Kazdan-Warner equation on a network. In this case, the differential equation is defined on each edge, while appropriate transition conditions of Kirchhoff type are prescribed at the vertices. We show that the Kazdan-Warner theory extends to the present setting and we study also the critical case.
We investigate the Kazdan-Warner equation on a network. In this case, the differential equation is defined on each edge, while appropriate transition conditions of Kirchhoff type are prescribed at the vertices. We show that the Kazdan-Warner theory extends to the present setting and we study also the critical case.
△ Less
Submitted 18 September, 2019;
originally announced September 2019.
-
A Mean Field Games approach to Cluster Analysis
Authors:
Laura Aquilanti,
Simone Cacace,
Fabio Camilli,
Raul De Maio
Abstract:
In this paper, we develop a Mean Field Games approach to Cluster Analysis. We consider a finite mixture model, given by a convex combination of probability density functions, to describe the given data set. We interpret a data point as an agent of one of the populations represented by the components of the mixture model, and we introduce a corresponding optimal control problem. In this way, we obt…
▽ More
In this paper, we develop a Mean Field Games approach to Cluster Analysis. We consider a finite mixture model, given by a convex combination of probability density functions, to describe the given data set. We interpret a data point as an agent of one of the populations represented by the components of the mixture model, and we introduce a corresponding optimal control problem. In this way, we obtain a multi-population Mean Field Games system which characterizes the parameters of the finite mixture model. Our method can be interpreted as a continuous version of the classical Expectation-Maximization algorithm.
△ Less
Submitted 23 December, 2019; v1 submitted 4 July, 2019;
originally announced July 2019.
-
Approximation of Hamilton-Jacobi equations with Caputo time-fractional derivative
Authors:
Fabio Camilli,
Serikbolsyn Duisembay
Abstract:
In this paper, we investigate the numerical approximation of Hamilton-Jacobi equations with the Caputo time-fractional derivative. We introduce an explicit in time discretization of the Caputo derivative and a finite difference scheme for the approximation of the Hamiltonian. We show that the approximation scheme so obtained is stable under an appropriate condition on the discretization parameters…
▽ More
In this paper, we investigate the numerical approximation of Hamilton-Jacobi equations with the Caputo time-fractional derivative. We introduce an explicit in time discretization of the Caputo derivative and a finite difference scheme for the approximation of the Hamiltonian. We show that the approximation scheme so obtained is stable under an appropriate condition on the discretization parameters and converges to the unique viscosity solution of the Hamilton-Jacobi equation.
△ Less
Submitted 18 December, 2019; v1 submitted 17 June, 2019;
originally announced June 2019.
-
Existence and regularity results for viscous Hamilton-Jacobi equations with Caputo time-fractional derivative
Authors:
Fabio Camilli,
Alessandro Goffi
Abstract:
We study existence, uniqueness and regularity properties of classical solutions to viscous Hamilton-Jacobi equations with Caputo time-fractional derivative. Our study relies on a combination of a gradient bound for the time-fractional Hamilton-Jacobi equation obtained via nonlinear adjoint method and sharp estimates in Sobolev and Hölder spaces for the corresponding linear problem.
We study existence, uniqueness and regularity properties of classical solutions to viscous Hamilton-Jacobi equations with Caputo time-fractional derivative. Our study relies on a combination of a gradient bound for the time-fractional Hamilton-Jacobi equation obtained via nonlinear adjoint method and sharp estimates in Sobolev and Hölder spaces for the corresponding linear problem.
△ Less
Submitted 25 February, 2020; v1 submitted 4 June, 2019;
originally announced June 2019.
-
Superposition principle and schemes for Measure Differential Equations
Authors:
Fabio Camilli,
Giulia Cavagnari,
Raul De Maio,
Benedetto Piccoli
Abstract:
Measure Differential Equations (MDE) describe the evolution of probability measures driven by probability velocity fields, i.e. probability measures on the tangent bundle. They are, on one side, a measure-theoretic generalization of ordinary differential equations; on the other side, they allow to describe concentration and diffusion phenomena typical of kinetic equations. In this paper, we analyz…
▽ More
Measure Differential Equations (MDE) describe the evolution of probability measures driven by probability velocity fields, i.e. probability measures on the tangent bundle. They are, on one side, a measure-theoretic generalization of ordinary differential equations; on the other side, they allow to describe concentration and diffusion phenomena typical of kinetic equations. In this paper, we analyze some properties of this class of differential equations, especially highlighting their link with nonlocal continuity equations. We prove a representation result in the spirit of the Superposition Principle by Ambrosio-Gigli-Savaré, and we provide alternative schemes converging to a solution of the MDE, with a particular view to uniqueness/non-uniqueness phenomena.
△ Less
Submitted 17 December, 2020; v1 submitted 14 February, 2019;
originally announced February 2019.
-
Variational time-fractional Mean Field Games
Authors:
Tang Qing,
Fabio Camilli
Abstract:
We consider the variational structure of a time-fractional second order Mean Field Games (MFG) system with local coupling. The MFG system consists of time-fractional Fokker-Planck and Hamilton-Jacobi-Bellman equations. In such a situation the individual agent follows a non-Markovian dynamics given by a subdiffusion process. Hence, the results of this paper extend the theory of variational MFG to t…
▽ More
We consider the variational structure of a time-fractional second order Mean Field Games (MFG) system with local coupling. The MFG system consists of time-fractional Fokker-Planck and Hamilton-Jacobi-Bellman equations. In such a situation the individual agent follows a non-Markovian dynamics given by a subdiffusion process. Hence, the results of this paper extend the theory of variational MFG to the subdiffusive situation, providing an Eulerian interpretation of time-fractional MFG systems.
△ Less
Submitted 2 July, 2019; v1 submitted 13 December, 2018;
originally announced December 2018.
-
Memory effects in measure transport equations
Authors:
Fabio Camilli,
Raul De Maio
Abstract:
Transport equations with a nonlocal velocity field have been introduced as a continuum model for interacting particle systems arising in physics, chemistry and biology. Fractional time derivatives, given by convolution integrals of the time-derivative with power-law kernels, are typical for memory effects in complex systems. In this paper we consider a nonlinear transport equation with a fractiona…
▽ More
Transport equations with a nonlocal velocity field have been introduced as a continuum model for interacting particle systems arising in physics, chemistry and biology. Fractional time derivatives, given by convolution integrals of the time-derivative with power-law kernels, are typical for memory effects in complex systems. In this paper we consider a nonlinear transport equation with a fractional time-derivative. We provide a well-posedness theory for weak measure solutions of the problem and an integral formula which generalizes the classical push-forward representation formula to this setting.
△ Less
Submitted 15 April, 2019; v1 submitted 27 June, 2018;
originally announced June 2018.
-
A Hopf-Lax formula for Hamilton-Jacobi equations with Caputo time derivative
Authors:
Fabio Camilli,
Raul De Maio,
Elisa Iacomini
Abstract:
We prove a representation formula of Hopf-Lax type for the solution of a Hamilton-Jacobi equation involving Caputo time-fractional derivative. Equations of these type are associated with optimal control problems where the controlled dynamics is replaced by a time-changed stochastic process describing the trajectory of a particle subject to random trapping effects.
We prove a representation formula of Hopf-Lax type for the solution of a Hamilton-Jacobi equation involving Caputo time-fractional derivative. Equations of these type are associated with optimal control problems where the controlled dynamics is replaced by a time-changed stochastic process describing the trajectory of a particle subject to random trapping effects.
△ Less
Submitted 25 March, 2018;
originally announced March 2018.
-
A measure theoretic approach to traffic flow optimization on networks
Authors:
Simone Cacace,
Fabio Camilli,
Raul De Maio,
Andrea Tosin
Abstract:
We consider a class of optimal control problems for measure-valued nonlinear transport equations describing traffic flow problems on networks. The objective isto minimise/maximise macroscopic quantities, such as traffic volume or average speed,controlling few agents, for example smart traffic lights and automated cars. The measuretheoretic approach allows to study in a same setting local and nonlo…
▽ More
We consider a class of optimal control problems for measure-valued nonlinear transport equations describing traffic flow problems on networks. The objective isto minimise/maximise macroscopic quantities, such as traffic volume or average speed,controlling few agents, for example smart traffic lights and automated cars. The measuretheoretic approach allows to study in a same setting local and nonlocal drivers interactionsand to consider the control variables as additional measures interacting with the driversdistribution. We also propose a gradient descent adjoint-based optimization method, ob-tained by deriving first-order optimality conditions for the control problem, and we providesome numerical experiments in the case of smart traffic lights for a 2-1 junction.
△ Less
Submitted 2 March, 2018;
originally announced March 2018.
-
An ergodic problem for Mean Field Games: qualitative properties and numerical simulations
Authors:
Simone Cacace,
Fabio Camilli,
Annalisa Cesaroni,
Claudio Marchi
Abstract:
This paper is devoted to some qualitative descriptions and some numerical results for ergodic Mean Field Games systems which arise, e.g., in the homogenization with a small noise limit. We shall consider either power type potentials or logarithmic type ones. In both cases, we shall establish some qualitative properties of the effective Hamiltonian $\bar H$ and of the effective drift $\bar b$. In p…
▽ More
This paper is devoted to some qualitative descriptions and some numerical results for ergodic Mean Field Games systems which arise, e.g., in the homogenization with a small noise limit. We shall consider either power type potentials or logarithmic type ones. In both cases, we shall establish some qualitative properties of the effective Hamiltonian $\bar H$ and of the effective drift $\bar b$. In particular we shall provide two cases where the effective system keeps/looses the Mean Field Games structure, namely where $\nabla_P \bar H(P,α)$ coincides or not with $\bar b(P, α)$.
On the other hand, we shall provide some numerical tests validating the aforementioned qualitative properties of $\bar H$ and $\bar b$. In particular, we provide a numerical estimate of the discrepancy $\nabla_P \bar H(P,α)-\bar b(P, α)$.
△ Less
Submitted 26 January, 2018;
originally announced January 2018.
-
Measure-valued solutions to nonlocal transport equations on networks
Authors:
Fabio Camilli,
Raul De Maio,
Andrea Tosin
Abstract:
We study a nonlinear transport equation defined on an oriented network where the velocity field depends not only on the state variable, but also on the solution itself. We prove existence, uniqueness and continuous dependence results for the solution of the problem intended in a suitable measure-theoretic sense. We also provide a representation formula in terms of the push-forward of the initial a…
▽ More
We study a nonlinear transport equation defined on an oriented network where the velocity field depends not only on the state variable, but also on the solution itself. We prove existence, uniqueness and continuous dependence results for the solution of the problem intended in a suitable measure-theoretic sense. We also provide a representation formula in terms of the push-forward of the initial and boundary data along the network and discuss an example of nonlocal velocity field fitting our framework.
△ Less
Submitted 22 January, 2018; v1 submitted 12 September, 2017;
originally announced September 2017.
-
A time-fractional mean field game
Authors:
Fabio Camilli,
Raul De Maio
Abstract:
We consider a Mean Field Games model where the dynamics of the agents is subdiffusive. According to the optimal control interpretation of the problem, we get a system involving fractional time-derivatives for the Hamilton-Jacobi-Bellman and the Fokker-Planck equations. We discuss separately the well-posedness for each of the two equations and then we prove existence and uniqueness of the solution…
▽ More
We consider a Mean Field Games model where the dynamics of the agents is subdiffusive. According to the optimal control interpretation of the problem, we get a system involving fractional time-derivatives for the Hamilton-Jacobi-Bellman and the Fokker-Planck equations. We discuss separately the well-posedness for each of the two equations and then we prove existence and uniqueness of the solution to the Mean Field Games system
△ Less
Submitted 22 January, 2018; v1 submitted 1 September, 2017;
originally announced September 2017.
-
A differential model for growing sandpiles on networks
Authors:
Simone Cacace,
Fabio Camilli,
Lucilla Corrias
Abstract:
We consider a system of differential equations of Monge-Kantorovich type which describes the equilibrium configurations of granular material poured by a constant source on a network. Relying on the definition of viscosity solution for Hamilton-Jacobi equations on networks, recently introduced by P.-L. Lions and P. E. Souganidis, we prove existence and uniqueness of the solution of the system and w…
▽ More
We consider a system of differential equations of Monge-Kantorovich type which describes the equilibrium configurations of granular material poured by a constant source on a network. Relying on the definition of viscosity solution for Hamilton-Jacobi equations on networks, recently introduced by P.-L. Lions and P. E. Souganidis, we prove existence and uniqueness of the solution of the system and we discuss its numerical approximation. Some numerical experiments are carried out.
△ Less
Submitted 13 May, 2017; v1 submitted 28 February, 2017;
originally announced February 2017.
-
Transport of measures on networks
Authors:
Fabio Camilli,
Raul De Maio,
Andrea Tosin
Abstract:
In this paper we formulate a theory of measure-valued linear transport equations on networks. The building block of our approach is the initial/boundary-value problem for the measure-valued linear transport equation on a bounded interval, which is the prototype of an arc of the network. For this problem we give an explicit representation formula of the solution, which also considers the total mass…
▽ More
In this paper we formulate a theory of measure-valued linear transport equations on networks. The building block of our approach is the initial/boundary-value problem for the measure-valued linear transport equation on a bounded interval, which is the prototype of an arc of the network. For this problem we give an explicit representation formula of the solution, which also considers the total mass flowing out of the interval. Then we construct the global solution on the network by gluing all the measure-valued solutions on the arcs by means of appropriate distribution rules at the vertexes. The measure-valued approach makes our framework suitable to deal with multiscale flows on networks, with the microscopic and macroscopic phases represented by Lebesgue-singular and Lebesgue-absolutely continuous measures, respectively, in time and space.
△ Less
Submitted 13 February, 2017; v1 submitted 3 October, 2016;
originally announced October 2016.
-
Absolutely Minimizing Lipschitz Extensions and Infinity Harmonic Functions on the Sierpinski gasket
Authors:
Fabio Camilli,
Raffaela Capitanelli,
Maria Agostina Vivaldi
Abstract:
Aim of this note is to study the infinity Laplace operator and the corresponding Absolutely Minimizing Lipschitz Extension problem on the Sierpinski gasket in the spirit of the classical construction of Kigami for the Laplacian. We introduce a notion of infinity harmonic functions on pre-fractal sets and we show that these functions solve a Lipschitz extension problem in the discrete setting. Then…
▽ More
Aim of this note is to study the infinity Laplace operator and the corresponding Absolutely Minimizing Lipschitz Extension problem on the Sierpinski gasket in the spirit of the classical construction of Kigami for the Laplacian. We introduce a notion of infinity harmonic functions on pre-fractal sets and we show that these functions solve a Lipschitz extension problem in the discrete setting. Then we prove that the limit of the infinity harmonic functions on the pre-fractal sets solves the Absolutely Minimizing Lipschitz Extension problem on the Sierpinski gasket.
△ Less
Submitted 19 April, 2017; v1 submitted 12 August, 2016;
originally announced August 2016.
-
A discrete Hughes' model for pedestrian flow on graphs
Authors:
Fabio Camilli,
Adriano Festa,
Silvia Tozza
Abstract:
In this paper, we introduce a discrete time-finite state model for pedestrian flow on a graph in the spirit of the Hughes dynamic continuum model. The pedestrians, represented by a density function, move on the graph choosing a route to minimize the instantaneous travel cost to the destination. The density is governed by a conservation law while the minimization principle is described by a graph e…
▽ More
In this paper, we introduce a discrete time-finite state model for pedestrian flow on a graph in the spirit of the Hughes dynamic continuum model. The pedestrians, represented by a density function, move on the graph choosing a route to minimize the instantaneous travel cost to the destination. The density is governed by a conservation law while the minimization principle is described by a graph eikonal equation. We show that the model is well posed and we implement some numerical examples to demonstrate the validity of the proposed model.
△ Less
Submitted 18 April, 2016;
originally announced April 2016.
-
A unified approach to the well-posedness of some non-Lambertian models in Shape-from-Shading theory
Authors:
Fabio Camilli,
Silvia Tozza
Abstract:
In this paper we show that the introduction of an attenuation factor in the %image irradiance brightness equations relative to various perspective Shape from Shading models allows to make the corresponding differential problems well-posed. We propose a unified approach based on the theory of viscosity solution and we show that the brightness equations with the attenuation term admit a unique visco…
▽ More
In this paper we show that the introduction of an attenuation factor in the %image irradiance brightness equations relative to various perspective Shape from Shading models allows to make the corresponding differential problems well-posed. We propose a unified approach based on the theory of viscosity solution and we show that the brightness equations with the attenuation term admit a unique viscosity solution. We also discuss in detail the possible boundary conditions that we can use for the Hamilton-Jacobi equations associated to these models.
△ Less
Submitted 4 October, 2016; v1 submitted 21 March, 2016;
originally announced March 2016.
-
Ergodic problems for Hamilton-Jacobi equations: yet another but efficient numerical method
Authors:
Simone Cacace,
Fabio Camilli
Abstract:
We propose a new approach to the numerical solution of ergodic problems arising in the homogenization of Hamilton-Jacobi (HJ) equations. It is based on a Newton-like method for solving inconsistent systems of nonlinear equations, coming from the discretization of the corresponding ergodic HJ equations. We show that our method is able to solve efficiently cell problems in very general contexts, e.g…
▽ More
We propose a new approach to the numerical solution of ergodic problems arising in the homogenization of Hamilton-Jacobi (HJ) equations. It is based on a Newton-like method for solving inconsistent systems of nonlinear equations, coming from the discretization of the corresponding ergodic HJ equations. We show that our method is able to solve efficiently cell problems in very general contexts, e.g., for first and second order scalar convex and nonconvex Hamiltonians, weakly coupled systems, dislocation dynamics and mean field games, also in the case of more competing populations. A large collection of numerical tests in dimension one and two shows the performance of the proposed method, both in terms of accuracy and computational time.
△ Less
Submitted 26 January, 2016;
originally announced January 2016.