-
Consensus Driven by the Geometric Mean
Authors:
Herbert Mangesius,
Dong Xue,
Sandra Hirche
Abstract:
Consensus networks are usually understood as arithmetic mean driven dynamical averaging systems. In applications, however, network dynamics often describe inherently non-arithmetic and non-linear consensus processes. In this paper, we propose and study three novel consensus protocols driven by geometric mean averaging: a polynomial, an entropic, and a scaling-invariant protocol, where terminology…
▽ More
Consensus networks are usually understood as arithmetic mean driven dynamical averaging systems. In applications, however, network dynamics often describe inherently non-arithmetic and non-linear consensus processes. In this paper, we propose and study three novel consensus protocols driven by geometric mean averaging: a polynomial, an entropic, and a scaling-invariant protocol, where terminology characterizes the particular non-linearity appearing in the respective differential protocol equation. We prove exponential convergence to consensus for positive initial conditions. For the novel protocols we highlight connections to applied network problems: The polynomial consensus system is structured like a system of chemical kinetics on a graph. The entropic consensus system converges to the weighted geometric mean of the initial condition, which is an immediate extension of the (weighted) average consensus problem. We find that all three protocols generate gradient flows of free energy on the simplex of constant mass distribution vectors albeit in different metrics. On this basis, we propose a novel variational characterization of the geometric mean as the solution of a non-linear constrained optimization problem involving free energy as cost function. We illustrate our findings in numerical simulations.
△ Less
Submitted 5 August, 2016; v1 submitted 9 November, 2015;
originally announced November 2015.
-
Gradient and Passive Circuit Structure in a Class of Non-linear Dynamics on a Graph
Authors:
Herbert Mangesius,
Jean-Charles Delvenne,
Sanjoy K. Mitter
Abstract:
We consider a class of non-linear dynamics on a graph that contains and generalizes various models from network systems and control and study convergence to uniform agreement states using gradient methods. In particular, under the assumption of detailed balance, we provide a method to formulate the governing ODE system in gradient descent form of sum-separable energy functions, which thus represen…
▽ More
We consider a class of non-linear dynamics on a graph that contains and generalizes various models from network systems and control and study convergence to uniform agreement states using gradient methods. In particular, under the assumption of detailed balance, we provide a method to formulate the governing ODE system in gradient descent form of sum-separable energy functions, which thus represent a class of Lyapunov functions; this class coincides with Csiszár's information divergences. Our approach bases on a transformation of the original problem to a mass-preserving transport problem and it reflects a little-noticed general structure result for passive network synthesis obtained by B.D.O. Anderson and P.J. Moylan in 1975. The proposed gradient formulation extends known gradient results in dynamical systems obtained recently by M. Erbar and J. Maas in the context of porous medium equations. Furthermore, we exhibit a novel relationship between inhomogeneous Markov chains and passive non-linear circuits through gradient systems, and show that passivity of resistor elements is equivalent to strict convexity of sum-separable stored energy. Eventually, we discuss our results at the intersection of Markov chains and network systems under sinusoidal coupling.
△ Less
Submitted 9 August, 2016; v1 submitted 2 August, 2015;
originally announced August 2015.
-
On Lyapunov functions and gradient flow structures in linear consensus systems
Authors:
Herbert Mangesius,
Jean-Charles Delvenne
Abstract:
Quadratic Lyapunov functions are prevalent in stability analysis of linear consensus systems. In this paper we show that weighted sums of convex functions of the different coordinates are Lyapunov functions for irreducible consensus systems. We introduce a particular class of additive convex Lyapunov functions that includes as particular instances the stored electric energy in RC circuits, Kullbac…
▽ More
Quadratic Lyapunov functions are prevalent in stability analysis of linear consensus systems. In this paper we show that weighted sums of convex functions of the different coordinates are Lyapunov functions for irreducible consensus systems. We introduce a particular class of additive convex Lyapunov functions that includes as particular instances the stored electric energy in RC circuits, Kullback-Leiber's information divergence between two probability measures, and Gibbs free energy in chemical reaction networks. On that basis we establish a general gradient formalism that allows to represent linear symmetric consensus dynamics as a gradient descent dynamics of any additive convex Lyapunov function, for a suitable choice of local scalar product. This result generalizes the well-known Euclidean gradient structures of consensus to general Riemannian ones. We also find natural non-linear consensus dynamics differing only from linearity by a different Riemannian structure, sharing a same Lyapunov function. We also see how information-theoretic Lyapunov functions, common in Markov chain theory, generate linear consensus through an appropriate gradient descent. From this unified perspective we hope to open avenues for the study of convergence for linear and non-linear consensus alike.
△ Less
Submitted 7 January, 2015; v1 submitted 21 December, 2014;
originally announced December 2014.
