-
Shannon-and von neumann-entropy regularizations of linear and semidefinite programs
Authors:
Saroj Prasad Chhatoi,
Jean B Lasserre
Abstract:
We consider the LP in standard form min {c T x\,: Ax = b; x $\ge$ 0} and inspired by $ε$-regularization in Optimal Transport, we introduce its $ε$-regularization ''min {c T x + $ε$ f (x)\,: Ax = b; x $\ge$ 0}'' via the (convex) Boltzmann-Shannon entropy f (x)\,:= i x i ln x i . We also provide a similar regularization for the semidefinite program ''min {Tr(C $\bullet$ X)\,: A(X) = b; X 0}'' but wi…
▽ More
We consider the LP in standard form min {c T x\,: Ax = b; x $\ge$ 0} and inspired by $ε$-regularization in Optimal Transport, we introduce its $ε$-regularization ''min {c T x + $ε$ f (x)\,: Ax = b; x $\ge$ 0}'' via the (convex) Boltzmann-Shannon entropy f (x)\,:= i x i ln x i . We also provide a similar regularization for the semidefinite program ''min {Tr(C $\bullet$ X)\,: A(X) = b; X 0}'' but with now the so-called Von Neumann entropy, as in Quantum Optimal Transport. Importantly, both are not barriers of the LP and SDP cones respectively. We show that this problem admits an equivalent unconstrained convex problem max $λ$$\in$R m G$ε$($λ$) for an explicit concave differentiable function G$ε$ in dual variables $λ$ $\in$ R m . As $ε$ goes to zero, its optimal value converges to the optimal value of the initial LP. While it resembles the log-barrier formulation of interior point algorithm for the initial LP, it has a distinguishing advantage. Namely for fixed $λ$, G$ε$($λ$) is obtained as a minimization over the whole space x $\in$ R d (and not over x $\ge$ 0) to still obtain a nonnegative solution x($λ$) $\ge$ 0, whence an explicit form of G$ε$ very useful for its unconstrained maximization over R m .
△ Less
Submitted 7 April, 2025; v1 submitted 31 March, 2025;
originally announced March 2025.
-
Optimizing quasi-dissipative evolution equations with the moment-SOS hierarchy
Authors:
Saroj Prasad Chhatoi,
Didier Henrion,
Swann Marx,
Nicolas Seguin
Abstract:
We prove that there is no relaxation gap between a quasi-dissipative nonlinear evolution equation in a Hilbert space and its linear Liouville equation reformulation on probability measures. In other words, strong and generalized solutions of such equations are unique in the class of measure-valued solutions. As a major consequence, non-convex numerical optimization over these non-linear partial di…
▽ More
We prove that there is no relaxation gap between a quasi-dissipative nonlinear evolution equation in a Hilbert space and its linear Liouville equation reformulation on probability measures. In other words, strong and generalized solutions of such equations are unique in the class of measure-valued solutions. As a major consequence, non-convex numerical optimization over these non-linear partial differential equations can be carried out with the infinite-dimensional moment-SOS hierarchy with global convergence guarantees. This covers in particular all reaction-diffusion equations with polynomial nonlinearity.
△ Less
Submitted 18 April, 2025; v1 submitted 10 December, 2024;
originally announced December 2024.
-
Evolution of Measures in Nonsmooth Dynamical Systems: Formalisms and Computation
Authors:
Saroj Prasad Chhatoi,
Aneel Tanwani,
Didier Henrion
Abstract:
This article develops mathematical formalisms and provides numerical methods for studying the evolution of measures in nonsmooth dynamical systems using the continuity equation. The nonsmooth dynamical system is described by an evolution variational inequality and we derive the continuity equation associated with this system class using three different formalisms. The first formalism consists of u…
▽ More
This article develops mathematical formalisms and provides numerical methods for studying the evolution of measures in nonsmooth dynamical systems using the continuity equation. The nonsmooth dynamical system is described by an evolution variational inequality and we derive the continuity equation associated with this system class using three different formalisms. The first formalism consists of using the {superposition principle} to describe the continuity equation for a measure that disintegrates into a probability measure supported on the set of vector fields and another measure representing the distribution of system trajectories at each time instant. The second formalism is based on the regularization of the nonsmooth vector field and describing the measure as the limit of a sequence of measures associated with the regularization parameter. In doing so, we obtain quantitative bounds on the Wasserstein metric between measure solutions of the regularized vector field and the limiting measure associated with the nonsmooth vector field. The third formalism uses a time-stepping algorithm to model a time-discretized evolution of the measures and show that the absolutely continuous trajectories associated with the continuity equation are recovered in the limit as the sampling time goes to zero. We also validate each formalism with numerical examples. For the first formalism, we use polynomial optimization techniques and the moment-SOS hierarchy to obtain approximate moments of the measures. For the second formalism, we illustrate the bounds on the Wasserstein metric for an academic example for which the closed-form expression of the Wasserstein metric can be calculated. For the third formalism, we illustrate the time-stepping based algorithm for measure evolution on an example that shows the effect of the concentration of measures.
△ Less
Submitted 15 May, 2024;
originally announced May 2024.
