-
Sums of squares representations on singular loci
Authors:
Ngoc Hoang Anh Mai,
Victor Magron
Abstract:
The problem of characterizing a real polynomial $f$ as a sum of squares of polynomials on a real algebraic variety $V$ dates back to the pioneering work of Hilbert in [Mathematische Annalen 32.3 (1888): 342-350]. In this paper, we investigate this problem with a focus on cases where the real zeros of $f$ on $V$ are singular points of $V$. By using optimality conditions and irreducible decompositio…
▽ More
The problem of characterizing a real polynomial $f$ as a sum of squares of polynomials on a real algebraic variety $V$ dates back to the pioneering work of Hilbert in [Mathematische Annalen 32.3 (1888): 342-350]. In this paper, we investigate this problem with a focus on cases where the real zeros of $f$ on $V$ are singular points of $V$. By using optimality conditions and irreducible decomposition, we provide a positive answer to the following essential question of polynomial optimization: Are there always exact semidefinite programs to compute the minimum value attained by a given polynomial over a given real algebraic variety? Our answer implies that Lasserre's hierarchy, which is known as a bridge between convex and non-convex programs with algebraic structures, has finite convergence not only in the generic case but also in the general case. As a result, we constructively prove that each hyperbolic program is equivalent to a semidefinite program.
△ Less
Submitted 9 March, 2023;
originally announced March 2023.
-
A Nichtnegativstellensatz on singular varieties under the denseness of regular loci
Authors:
Ngoc Hoang Anh Mai
Abstract:
Let $V$ be a real algebraic variety with singularities and $f$ be a real polynomial non-negative on $V$. Assume that the regular locus of $V$ is dense in $V$ by the usual topology. Using Hironaka's resolution of singularities and Demmel--Nie--Powers' Nichtnegativstellensatz, we obtain a sum of squares-based representation that characterizes the non-negativity of $f$ on $V$. This representation all…
▽ More
Let $V$ be a real algebraic variety with singularities and $f$ be a real polynomial non-negative on $V$. Assume that the regular locus of $V$ is dense in $V$ by the usual topology. Using Hironaka's resolution of singularities and Demmel--Nie--Powers' Nichtnegativstellensatz, we obtain a sum of squares-based representation that characterizes the non-negativity of $f$ on $V$. This representation allows us to build up exact semidefinite relaxations for polynomial optimization problems whose optimal solutions are possibly singularities of the constraint sets.
△ Less
Submitted 9 March, 2023; v1 submitted 22 November, 2022;
originally announced November 2022.
-
Semi-algebraic description of the closure of the image of a semi-algebraic set under a polynomial
Authors:
Ngoc Hoang Anh Mai
Abstract:
Given a polynomial $f$ and a semi-algebraic set $S$, we provide a symbolic algorithm to find the equations and inequalities defining a semi-algebraic set $Q$ which is identical to the closure of the image of $S$ under $f$, i.e., \begin{equation} Q=\overline{f(S)}\,. \end{equation} Consequently, every polynomial optimization problem whose optimum value is finite has an equivalent form with attained…
▽ More
Given a polynomial $f$ and a semi-algebraic set $S$, we provide a symbolic algorithm to find the equations and inequalities defining a semi-algebraic set $Q$ which is identical to the closure of the image of $S$ under $f$, i.e., \begin{equation} Q=\overline{f(S)}\,. \end{equation} Consequently, every polynomial optimization problem whose optimum value is finite has an equivalent form with attained optimum value, i.e., \begin{equation} \min \limits_{t\in Q} t =\inf\limits_{x\in S} f(x) \end{equation} whenever the right-hand side is finite. Given $d$ as the upper bound on the degrees of $f$ and polynomials defining $S$, we prove that our method requires $O(d^{O(n)})$ arithmetic operations to produce polynomials of degrees at most $d^{O(n)}$ defining $\overline{f(S)}$.
△ Less
Submitted 25 October, 2022;
originally announced October 2022.
-
Tractable hierarchies of convex relaxations for polynomial optimization on the nonnegative orthant
Authors:
Ngoc Hoang Anh Mai,
Victor Magron,
Jean-Bernard Lasserre,
Kim-Chuan Toh
Abstract:
We consider polynomial optimization problems (POP) on a semialgebraic set contained in the nonnegative orthant (every POP on a compact set can be put in this format by a simple translation of the origin). Such a POP can be converted to an equivalent POP by squaring each variable. Using even symmetry and the concept of factor width, we propose a hierarchy of semidefinite relaxations based on the ex…
▽ More
We consider polynomial optimization problems (POP) on a semialgebraic set contained in the nonnegative orthant (every POP on a compact set can be put in this format by a simple translation of the origin). Such a POP can be converted to an equivalent POP by squaring each variable. Using even symmetry and the concept of factor width, we propose a hierarchy of semidefinite relaxations based on the extension of Pólya's Positivstellensatz by Dickinson-Povh. As its distinguishing and crucial feature, the maximal matrix size of each resulting semidefinite relaxation can be chosen arbitrarily and in addition, we prove that the sequence of values returned by the new hierarchy converges to the optimal value of the original POP at the rate $O(\varepsilon^{-c})$ if the semialgebraic set has nonempty interior. When applied to (i) robustness certification of multi-layer neural networks and (ii) computation of positive maximal singular values, our method based on Pólya's Positivstellensatz provides better bounds and runs several hundred times faster than the standard Moment-SOS hierarchy.
△ Less
Submitted 11 June, 2025; v1 submitted 13 September, 2022;
originally announced September 2022.
-
A symbolic algorithm for exact polynomial optimization strengthened with Fritz John conditions
Authors:
Ngoc Hoang Anh Mai
Abstract:
Consider a polynomial optimization problem. Adding polynomial equations generated by the Fritz John conditions to the constraint set does not change the optimal value. As proved in [arXiv:2205.04254 (2022)], the objective polynomial has finitely many values on the new constraint set under some genericity assumption. Based on this, we provide an algorithm that allows us to compute exactly this opti…
▽ More
Consider a polynomial optimization problem. Adding polynomial equations generated by the Fritz John conditions to the constraint set does not change the optimal value. As proved in [arXiv:2205.04254 (2022)], the objective polynomial has finitely many values on the new constraint set under some genericity assumption. Based on this, we provide an algorithm that allows us to compute exactly this optimal value. Our method depends on the computations of real radical generators and Gröbner basis. Finally, we apply our method to solve some instances of mathematical program with complementarity constraints.
△ Less
Submitted 12 November, 2022; v1 submitted 6 June, 2022;
originally announced June 2022.
-
Complexity for exact polynomial optimization strengthened with Fritz John conditions
Authors:
Ngoc Hoang Anh Mai
Abstract:
Let $f,g_1,\dots,g_m$ be polynomials of degree at most $d$ with real coefficients in a vector of variables $x=(x_1,\dots,x_n)$. Assume that $f$ is non-negative on a basic semi-algebraic set $S$ defined by polynomial inequalities $g_j(x)\ge 0$, for $j=1,\dots,m$. Our previous work [arXiv:2205.04254 (2022)] has stated several representations of $f$ based on the Fritz John conditions. This paper prov…
▽ More
Let $f,g_1,\dots,g_m$ be polynomials of degree at most $d$ with real coefficients in a vector of variables $x=(x_1,\dots,x_n)$. Assume that $f$ is non-negative on a basic semi-algebraic set $S$ defined by polynomial inequalities $g_j(x)\ge 0$, for $j=1,\dots,m$. Our previous work [arXiv:2205.04254 (2022)] has stated several representations of $f$ based on the Fritz John conditions. This paper provides some explicit degree bounds depending on $n$, $m$, and $d$ for these representations. In application to polynomial optimization, we obtain explicit rates of finite convergence of the hierarchies of semidefinite relaxations based on these representations.
△ Less
Submitted 15 November, 2022; v1 submitted 24 May, 2022;
originally announced May 2022.
-
On the exactness for polynomial optimization strengthened with Fritz John conditions
Authors:
Ngoc Hoang Anh Mai
Abstract:
We utilize the same technique as in [arXiv:2205.04254 (2022)] to provide some representations of polynomials non-negative on a basic semi-algebraic set, defined by polynomial inequalities, under more general conditions. Based on each representation, we obtain semidefinite programs which return a sequence of values that finitely converges to the optimal value of a given polynomial optimization prob…
▽ More
We utilize the same technique as in [arXiv:2205.04254 (2022)] to provide some representations of polynomials non-negative on a basic semi-algebraic set, defined by polynomial inequalities, under more general conditions. Based on each representation, we obtain semidefinite programs which return a sequence of values that finitely converges to the optimal value of a given polynomial optimization problem under generic assumption. Consequently, we can compute exactly the minimal value of any polynomial over a basic convex semi-algebraic set which is defined by the inequalities of concave polynomials.
△ Less
Submitted 11 October, 2022; v1 submitted 17 May, 2022;
originally announced May 2022.
-
Exact polynomial optimization strengthened with Fritz John conditions
Authors:
Ngoc Hoang Anh Mai
Abstract:
Let $f,g_1,\dots,g_m$ be polynomials with real coefficients in a vector of variables $x=(x_1,\dots,x_n)$. Denote by $\text{diag}(g)$ the diagonal matrix with coefficients $g=(g_1,\dots,g_m)$ and denote by $\nabla g$ the Jacobian of $g$. Let $C$ be the set of critical points defined by \begin{equation}
C=\{x\in\mathbb R^n\,:\,\text{rank}(\varphi(x))< m\}\quad\text{with}\quad\varphi:=\begin{bmatri…
▽ More
Let $f,g_1,\dots,g_m$ be polynomials with real coefficients in a vector of variables $x=(x_1,\dots,x_n)$. Denote by $\text{diag}(g)$ the diagonal matrix with coefficients $g=(g_1,\dots,g_m)$ and denote by $\nabla g$ the Jacobian of $g$. Let $C$ be the set of critical points defined by \begin{equation}
C=\{x\in\mathbb R^n\,:\,\text{rank}(\varphi(x))< m\}\quad\text{with}\quad\varphi:=\begin{bmatrix} \nabla g\\ \text{diag}(g) \end{bmatrix}\,. \end{equation} Assume that the image of $C$ under $f$, denoted by $f(C)$, is empty or finite. (Our assumption holds generically since $C$ is empty in a Zariski open set in the space of the coefficients of $g_1,\dots,g_m$ with given degrees.) We provide a sequence of values, returned by semidefinite programs, finitely converges to the minimal value attained by $f$ over the basic semi-algebraic set $S$ defined by \begin{equation}
S:=\{x\in\mathbb R^n\,:\,g_j(x)\ge 0\,,\,j=1,\dots,m\}\,. \end{equation} Consequently, we can compute exactly the minimal value of any polynomial with real coefficients in $x$ over one of the following sets: the unit ball, the unit hypercube and the unit simplex. Under a slightly more general assumption, we extend this result to the minimization of any polynomial over a basic convex semi-algebraic set that has non-empty interior and is defined by the inequalities of concave polynomials.
△ Less
Submitted 21 January, 2023; v1 submitted 9 May, 2022;
originally announced May 2022.
-
A rigidity result of spectral gap on Finsler manifolds and its application
Authors:
Cong Hung Mai
Abstract:
We investigate the rigidity problem for the sharp spectral gap on Finsler manifolds of weighted Ricci curvature bound $\text{Ric}_{\infty} \geq K > 0$. Our main results show that if the equality holds, the manifold necessarily admits a diffeomorphic splitting (or isometric splitting in the particular class of Berwald spaces). This splitting phenomenon is comparable to the Cheeger-Gromoll type spli…
▽ More
We investigate the rigidity problem for the sharp spectral gap on Finsler manifolds of weighted Ricci curvature bound $\text{Ric}_{\infty} \geq K > 0$. Our main results show that if the equality holds, the manifold necessarily admits a diffeomorphic splitting (or isometric splitting in the particular class of Berwald spaces). This splitting phenomenon is comparable to the Cheeger-Gromoll type splitting theorem by Ohta. We also obtain the rigidity results of logarithmic Sobolev and Bakry-Ledoux isoperimetric inequalities via needle decomposition as corollaries.
△ Less
Submitted 23 July, 2022; v1 submitted 5 April, 2022;
originally announced April 2022.
-
Quantitative estimates for the Bakry-Ledoux isoperimetric inequality. II
Authors:
Cong Hung Mai,
Shin-ichi Ohta
Abstract:
Concerning quantitative isoperimetry for a weighted Riemannian manifold satisfying $\mathrm{Ric}_{\infty} \ge 1$, we give an $L^1$-estimate exhibiting that the push-forward of the reference measure by the guiding function (arising from the needle decomposition) is close to the Gaussian measure. We also show $L^p$- and $W_2$-estimates in the $1$-dimensional case.
Concerning quantitative isoperimetry for a weighted Riemannian manifold satisfying $\mathrm{Ric}_{\infty} \ge 1$, we give an $L^1$-estimate exhibiting that the push-forward of the reference measure by the guiding function (arising from the needle decomposition) is close to the Gaussian measure. We also show $L^p$- and $W_2$-estimates in the $1$-dimensional case.
△ Less
Submitted 26 July, 2022; v1 submitted 7 March, 2022;
originally announced March 2022.
-
Tractable semidefinite bounds of positive maximal singular values
Authors:
Victor Magron,
Ngoc Hoang Anh Mai,
Yoshio Ebihara,
Hayato Waki
Abstract:
We focus on computing certified upper bounds for the positive maximal singular value (PMSV) of a given matrix. The PMSV problem boils down to maximizing a quadratic polynomial on the intersection of the unit sphere and the nonnegative orthant. We provide a hierarchy of tractable semidefinite relaxations to approximate the value of the latter polynomial optimization problem as closely as desired. T…
▽ More
We focus on computing certified upper bounds for the positive maximal singular value (PMSV) of a given matrix. The PMSV problem boils down to maximizing a quadratic polynomial on the intersection of the unit sphere and the nonnegative orthant. We provide a hierarchy of tractable semidefinite relaxations to approximate the value of the latter polynomial optimization problem as closely as desired. This hierarchy is based on an extension of Pólya's representation theorem. Doing so, positive polynomials can be decomposed as weighted sums of squares of $s$-nomials, where $s$ can be a priori fixed ($s=1$ corresponds to monomials, $s=2$ corresponds to binomials, etc.). This in turn allows us to control the size of the resulting semidefinite relaxations.
△ Less
Submitted 17 February, 2022;
originally announced February 2022.
-
Stability Analysis of Recurrent Neural Networks by IQC with Copositive Mutipliers
Authors:
Yoshio Ebihara,
Hayato Waki,
Victor Magron,
Ngoc Hoang Anh Mai,
Dimitri Peaucelle,
Sophie Tarbouriech
Abstract:
This paper is concerned with the stability analysis of the recurrent neural networks (RNNs) by means of the integral quadratic constraint (IQC) framework. The rectified linear unit (ReLU) is typically employed as the activation function of the RNN, and the ReLU has specific nonnegativity properties regarding its input and output signals. Therefore, it is effective if we can derive IQC-based stabil…
▽ More
This paper is concerned with the stability analysis of the recurrent neural networks (RNNs) by means of the integral quadratic constraint (IQC) framework. The rectified linear unit (ReLU) is typically employed as the activation function of the RNN, and the ReLU has specific nonnegativity properties regarding its input and output signals. Therefore, it is effective if we can derive IQC-based stability conditions with multipliers taking care of such nonnegativity properties. However, such nonnegativity (linear) properties are hardly captured by the existing multipliers defined on the positive semidefinite cone. To get around this difficulty, we loosen the standard positive semidefinite cone to the copositive cone, and employ copositive multipliers to capture the nonnegativity properties. We show that, within the framework of the IQC, we can employ copositive multipliers (or their inner approximation) together with existing multipliers such as Zames-Falb multipliers and polytopic bounding multipliers, and this directly enables us to ensure that the introduction of the copositive multipliers leads to better (no more conservative) results. We finally illustrate the effectiveness of the IQC-based stability conditions with the copositive multipliers by numerical examples.
△ Less
Submitted 9 February, 2022;
originally announced February 2022.
-
On the complexity of Putinar-Vasilescu's Positivstellensatz
Authors:
Ngoc Hoang Anh Mai,
Victor Magron
Abstract:
We provide a new degree bound on the weighted sum-of-squares (SOS) polynomials for Putinar-Vasilescu's Positivstellensatz. This leads to another Positivstellensatz saying that if $f$ is a polynomial of degree at most $2 d_f$ nonnegative on a semialgebraic set having nonempty interior defined by finitely many polynomial inequalities $g_j(x)\ge 0$, $j=1,\dots,m$ with $g_1:=L-\|x\|_2^2$ for some…
▽ More
We provide a new degree bound on the weighted sum-of-squares (SOS) polynomials for Putinar-Vasilescu's Positivstellensatz. This leads to another Positivstellensatz saying that if $f$ is a polynomial of degree at most $2 d_f$ nonnegative on a semialgebraic set having nonempty interior defined by finitely many polynomial inequalities $g_j(x)\ge 0$, $j=1,\dots,m$ with $g_1:=L-\|x\|_2^2$ for some $L>0$, then there exist positive constants $\bar c$ and $c$ depending on $f,g_j$ such that for any $\varepsilon>0$, for all $k\ge \bar c \varepsilon^{-c}$, $f$ has the decomposition \begin{equation} \begin{array}{l} (1+\|x\|_2^2)^k(f+\varepsilon)=σ_0+\sum_{j=1}^m σ_jg_j \,, \end{array} \end{equation} for some SOS polynomials $σ_j$ being such that the degrees of $σ_0,σ_jg_j$ are at most $2(d_f+k)$. Here $\|\cdot\|_2$ denotes the $\ell_2$ vector norm. As a consequence, we obtain a converging hierarchy of semidefinite relaxations for lower bounds in polynomial optimization on basic compact semialgebraic sets. The complexity of this hierarchy is $\mathcal{O}(\varepsilon^{-c})$ for prescribed accuracy $\varepsilon>0$. In particular, if $m=L=1$ then $c=65$, yielding the complexity $\mathcal{O}(\varepsilon^{-65})$ for the minimization of a polynomial on the unit ball. Our result improves the complexity bound $\mathcal{O}(\exp(\varepsilon^{-c}))$ due to Nie and Schweighofer in [Journal of Complexity 23.1 (2007): 135-150].
△ Less
Submitted 27 May, 2021; v1 submitted 23 April, 2021;
originally announced April 2021.
-
The Constant Trace Property in Noncommutative Optimization
Authors:
Ngoc Hoang Anh Mai,
Abhishek Bhardwaj,
Victor Magron
Abstract:
In this article, we show that each semidefinite relaxation of a ball-constrained noncommutative polynomial optimization problem can be cast as a semidefinite program with a constant trace matrix variable. We then demonstrate how this constant trace property can be exploited via first order numerical methods to solve efficiently the semidefinite relaxations of the noncommutative problem.
In this article, we show that each semidefinite relaxation of a ball-constrained noncommutative polynomial optimization problem can be cast as a semidefinite program with a constant trace matrix variable. We then demonstrate how this constant trace property can be exploited via first order numerical methods to solve efficiently the semidefinite relaxations of the noncommutative problem.
△ Less
Submitted 3 February, 2021;
originally announced February 2021.
-
Comparing different subgradient methods for solving convex optimization problems with functional constraints
Authors:
Thi Lan Dinh,
Ngoc Hoang Anh Mai
Abstract:
We consider the problem of minimizing a convex, nonsmooth function subject to a closed convex constraint domain. The methods that we propose are reforms of subgradient methods based on Metel--Takeda's paper [Optimization Letters 15.4 (2021): 1491-1504] and Boyd's works [Lecture notes of EE364b, Stanford University, Spring 2013-14, pp. 1-39]. While the former has complexity…
▽ More
We consider the problem of minimizing a convex, nonsmooth function subject to a closed convex constraint domain. The methods that we propose are reforms of subgradient methods based on Metel--Takeda's paper [Optimization Letters 15.4 (2021): 1491-1504] and Boyd's works [Lecture notes of EE364b, Stanford University, Spring 2013-14, pp. 1-39]. While the former has complexity $\mathcal{O}(\varepsilon^{-2r})$ for all $r> 1$, the complexity of the latter is $\mathcal{O}(\varepsilon^{-2})$. We perform some comparisons between these two methods using several test examples.
△ Less
Submitted 21 January, 2023; v1 submitted 4 January, 2021;
originally announced January 2021.
-
Exploiting constant trace property in large-scale polynomial optimization
Authors:
Ngoc Hoang Anh Mai,
Jean-Bernard Lasserre,
Victor Magron,
Jie Wang
Abstract:
We prove that every semidefinite moment relaxation of a polynomial optimization problem (POP) with a ball constraint can be reformulated as a semidefinite program involving a matrix with constant trace property (CTP). As a result such moment relaxations can be solved efficiently by first-order methods that exploit CTP, e.g., the conditional gradient-based augmented Lagrangian method. We also exten…
▽ More
We prove that every semidefinite moment relaxation of a polynomial optimization problem (POP) with a ball constraint can be reformulated as a semidefinite program involving a matrix with constant trace property (CTP). As a result such moment relaxations can be solved efficiently by first-order methods that exploit CTP, e.g., the conditional gradient-based augmented Lagrangian method. We also extend this CTP-exploiting framework to large-scale POPs with different sparsity structures. The efficiency and scalability of our framework are illustrated on second-order moment relaxations for various randomly generated quadratically constrained quadratic programs.
△ Less
Submitted 16 December, 2020;
originally announced December 2020.
-
$l_2$ Induced Norm Analysis of Discrete-Time LTI Systems for Nonnegative Input Signals and Its Application to Stability Analysis of Recurrent Neural Networks
Authors:
Yoshio Ebihara,
Hayato Waki,
Victor Magron,
Ngoc Hoang Anh Mai,
Dimitri Peaucelle,
Sophie Tarbouriech
Abstract:
In this paper, we focus on the "positive" $l_2$ induced norm of discrete-time linear time-invariant systems where the input signals are restricted to be nonnegative. To cope with the nonnegativity of the input signals, we employ copositive programming as the mathematical tool for the analysis. Then, by applying an inner approximation to the copositive cone, we derive numerically tractable semidefi…
▽ More
In this paper, we focus on the "positive" $l_2$ induced norm of discrete-time linear time-invariant systems where the input signals are restricted to be nonnegative. To cope with the nonnegativity of the input signals, we employ copositive programming as the mathematical tool for the analysis. Then, by applying an inner approximation to the copositive cone, we derive numerically tractable semidefinite programming problems for the upper and lower bound computation of the "positive" $l_2$ induced norm. This norm is typically useful for the stability analysis of feedback systems constructed from an LTI system and nonlinearities where the nonlinear elements provide only nonnegative signals. As a concrete example, we illustrate the usefulness of the "positive" $l_2$ induced norm for the stability analysis of recurrent neural networks with activation functions being rectified linear units.
△ Less
Submitted 25 November, 2020;
originally announced November 2020.
-
A hierarchy of spectral relaxations for polynomial optimization
Authors:
Ngoc Hoang Anh Mai,
Victor Magron,
Jean-Bernard Lasserre
Abstract:
We show that (i) any constrained polynomial optimization problem (POP) has an equivalent formulation on a variety contained in an Euclidean sphere and (ii) the resulting semidefinite relaxations in the moment-SOS hierarchy have the constant trace property (CTP) for the involved matrices. We then exploit the CTP to avoid solving the semidefinite relaxations via interior-point methods and rather use…
▽ More
We show that (i) any constrained polynomial optimization problem (POP) has an equivalent formulation on a variety contained in an Euclidean sphere and (ii) the resulting semidefinite relaxations in the moment-SOS hierarchy have the constant trace property (CTP) for the involved matrices. We then exploit the CTP to avoid solving the semidefinite relaxations via interior-point methods and rather use ad-hoc spectral methods that minimize the largest eigenvalue of a matrix pencil. Convergence to the optimal value of the semidefinite relaxation is guaranteed. As a result we obtain a hierarchy of nonsmooth "spectral relaxations" of the initial POP. Efficiency and robustness of this spectral hierarchy is tested against several equality constrained POPs on a sphere as well as on a sample of randomly generated quadratically constrained quadratic problems (QCQPs).
△ Less
Submitted 17 July, 2020;
originally announced July 2020.
-
CS-TSSOS: Correlative and term sparsity for large-scale polynomial optimization
Authors:
Jie Wang,
Victor Magron,
Jean B. Lasserre,
Ngoc Hoang Anh Mai
Abstract:
This work proposes a new moment-SOS hierarchy, called CS-TSSOS, for solving large-scale sparse polynomial optimization problems. Its novelty is to exploit simultaneously correlative sparsity and term sparsity by combining advantages of two existing frameworks for sparse polynomial optimization. The former is due to Waki et al. while the latter was initially proposed by Wang et al. and later exploi…
▽ More
This work proposes a new moment-SOS hierarchy, called CS-TSSOS, for solving large-scale sparse polynomial optimization problems. Its novelty is to exploit simultaneously correlative sparsity and term sparsity by combining advantages of two existing frameworks for sparse polynomial optimization. The former is due to Waki et al. while the latter was initially proposed by Wang et al. and later exploited in the TSSOS hierarchy. In doing so we obtain CS-TSSOS -- a two-level hierarchy of semidefinite programming relaxations with (i), the crucial property to involve blocks of SDP matrices and (ii), the guarantee of convergence to the global optimum under certain conditions. We demonstrate its efficiency and scalability on several large-scale instances of the celebrated Max-Cut problem and the important industrial optimal power flow problem, involving up to six thousand variables and tens of thousands of constraints.
△ Less
Submitted 8 June, 2021; v1 submitted 6 May, 2020;
originally announced May 2020.
-
A sparse version of Reznick's Positivstellensatz
Authors:
Ngoc Hoang Anh Mai,
Victor Magron,
Jean-Bernard Lasserre
Abstract:
If $f$ is a positive definite form, Reznick's Positivstellensatz [Mathematische Zeitschrift. 220 (1995), pp. 75--97] states that there exists $k\in\mathbf{N}$ such that ${\| x \|^{2k}_2}f$ is a sum of squares of polynomials. Assuming that $f$ can be written as a sum of forms $\sum_{l=1}^p f_l$, where each $f_l$ depends on a subset of the initial variables, and assuming that these subsets satisfy t…
▽ More
If $f$ is a positive definite form, Reznick's Positivstellensatz [Mathematische Zeitschrift. 220 (1995), pp. 75--97] states that there exists $k\in\mathbf{N}$ such that ${\| x \|^{2k}_2}f$ is a sum of squares of polynomials. Assuming that $f$ can be written as a sum of forms $\sum_{l=1}^p f_l$, where each $f_l$ depends on a subset of the initial variables, and assuming that these subsets satisfy the so-called running intersection property, we provide a sparse version of Reznick's Positivstellensatz. Namely, there exists $k \in \mathbf{N}$ such that $f=\sum_{l = 1}^p {{σ_l}/{H_l^{k}}}$, where $σ_l$ is a sum of squares of polynomials, $H_l$ is a uniform polynomial denominator, and both polynomials $σ_l,H_l$ involve the same variables as $f_l$, for each $l=1,\dots,p$. In other words, the sparsity pattern of $f$ is also reflected in this sparse version of Reznick's certificate of positivity. We next use this result to also obtain positivity certificates for (i) polynomials nonnegative on the whole space and (ii) polynomials nonnegative on a (possibly non-compact) basic semialgebraic set, assuming that the input data satisfy the running intersection property. Both are sparse versions of a positivity certificate due to Putinar and Vasilescu.
△ Less
Submitted 13 February, 2020; v1 submitted 12 February, 2020;
originally announced February 2020.
-
Positivity certificates and polynomial optimization on non-compact semialgebraic sets
Authors:
Ngoc Hoang Anh Mai,
Jean-Bernard Lasserre,
Victor Magron
Abstract:
In a first contribution, we revisit two certificates of positivity on (possibly non-compact) basic semialgebraic sets due to Putinar and Vasilescu [Comptes Rendus de l'Académie des Sciences-Series I-Mathematics, 328(6) (1999) pp. 495-499]. We use Jacobi's technique from [Mathematische Zeitschrift, 237(2) (2001) pp. 259-273] to provide an alternative proof with an effective degree bound on the sums…
▽ More
In a first contribution, we revisit two certificates of positivity on (possibly non-compact) basic semialgebraic sets due to Putinar and Vasilescu [Comptes Rendus de l'Académie des Sciences-Series I-Mathematics, 328(6) (1999) pp. 495-499]. We use Jacobi's technique from [Mathematische Zeitschrift, 237(2) (2001) pp. 259-273] to provide an alternative proof with an effective degree bound on the sums of squares multipliers in such certificates. As a consequence, it allows one to define a hierarchy of semidefinite relaxations for a general polynomial optimization problem. Convergence of this hierarchy to a neighborhood of the optimal value as well as strong duality and analysis are guaranteed. In a second contribution, we introduce a new numerical method for solving systems of polynomial inequalities and equalities with possibly uncountably many solutions. As a bonus, one may apply this method to obtain approximate global optimizers in polynomial optimization.
△ Less
Submitted 6 December, 2019; v1 submitted 26 November, 2019;
originally announced November 2019.
-
Quantitative estimates for the Bakry-Ledoux isoperimetric inequality
Authors:
Cong Hung Mai,
Shin-ichi Ohta
Abstract:
We establish a quantitative isoperimetric inequality for weighted Riemannian manifolds with $\mathrm{Ric}_{\infty} \ge 1$. Precisely, we give an upper bound of the volume of the symmetric difference between a Borel set and a sub-level (or super-level) set of the associated guiding function (arising from the needle decomposition), in terms of the deficit in Bakry-Ledoux's Gaussian isoperimetric ine…
▽ More
We establish a quantitative isoperimetric inequality for weighted Riemannian manifolds with $\mathrm{Ric}_{\infty} \ge 1$. Precisely, we give an upper bound of the volume of the symmetric difference between a Borel set and a sub-level (or super-level) set of the associated guiding function (arising from the needle decomposition), in terms of the deficit in Bakry-Ledoux's Gaussian isoperimetric inequality. This is the first quantitative isoperimetric inequality on noncompact spaces besides Euclidean and Gaussian spaces. Our argument makes use of Klartag's needle decomposition (also called localization), and is inspired by a recent work of Cavalletti, Maggi and Mondino on compact spaces. Besides the quantitative isoperimetry, a reverse Poincaré inequality for the guiding function that we have as a key step, as well as the way we use it, are of independent interest.
△ Less
Submitted 28 February, 2021; v1 submitted 30 October, 2019;
originally announced October 2019.
-
Yet again on iteration improvement for averaged expected cost control for 1D ergodic diffusions
Authors:
Svetlana Anulova,
Hilmar Mai,
Alexander Veretennikov
Abstract:
The paper is a full version of the short presentation in \cite{amv17}. Ergodic control for one-dimensional controlled diffusion is tackled; both drift and diffusion coefficients may depend on a strategy which is assumed markovian. Ergodic HJB equation is established and existence and uniqueness of its solution is proved, as well as the convergence of the reward improvement algorithm.
The paper is a full version of the short presentation in \cite{amv17}. Ergodic control for one-dimensional controlled diffusion is tackled; both drift and diffusion coefficients may depend on a strategy which is assumed markovian. Ergodic HJB equation is established and existence and uniqueness of its solution is proved, as well as the convergence of the reward improvement algorithm.
△ Less
Submitted 10 August, 2020; v1 submitted 27 December, 2018;
originally announced December 2018.
-
Persistent Homology and Euler Integral Transforms
Authors:
Robert Ghrist,
Rachel Levanger,
Huy Mai
Abstract:
The Euler calculus -- an integral calculus based on Euler characteristic as a valuation on constructible functions -- is shown to be an incisive tool for answering questions about injectivity and invertibility of recent transforms based on persistent homology for shape characterization.
The Euler calculus -- an integral calculus based on Euler characteristic as a valuation on constructible functions -- is shown to be an incisive tool for answering questions about injectivity and invertibility of recent transforms based on persistent homology for shape characterization.
△ Less
Submitted 14 June, 2018; v1 submitted 12 April, 2018;
originally announced April 2018.
-
Rigidity for the isoperimetric inequality of negative effective dimension on weighted Riemannian manifolds
Authors:
Cong Hung Mai
Abstract:
We study, on a weighted Riemannian manifold of Ric$_{N} \geq K > 0$ for $N < -1$, when equality holds in the isoperimetric inequality. Our main theorem asserts that such a manifold is necessarily isometric to the warped product $\mathbb{R} \times_{\cosh(\sqrt{K/(1-N)}t)} Σ^{n-1}$ of hyperbolic nature, where $Σ^{n-1}$ is an $(n-1)$-dimensional manifold with lower weighted Ricci curvature bound and…
▽ More
We study, on a weighted Riemannian manifold of Ric$_{N} \geq K > 0$ for $N < -1$, when equality holds in the isoperimetric inequality. Our main theorem asserts that such a manifold is necessarily isometric to the warped product $\mathbb{R} \times_{\cosh(\sqrt{K/(1-N)}t)} Σ^{n-1}$ of hyperbolic nature, where $Σ^{n-1}$ is an $(n-1)$-dimensional manifold with lower weighted Ricci curvature bound and $\mathbb{R}$ is equipped with a hyperbolic cosine measure. This is a similar phenomenon to the equality condition of Poincaré inequality. Moreover, every isoperimetric minimizer set is isometric to a half-space in an appropriate sense.
△ Less
Submitted 17 June, 2018; v1 submitted 19 December, 2017;
originally announced December 2017.
-
On Riemannian manifolds with positive weighted Ricci curvature of negative effective dimension
Authors:
Cong Hung Mai
Abstract:
In this paper, we investigate complete Riemannian manifolds satisfying the lower weighted Ricci curvature bound $\mathrm{Ric}_{N} \geq K$ with $K>0$ for the negative effective dimension $N<0$. We analyze two $1$-dimensional examples of constant curvature $\mathrm{Ric}_N \equiv K$ with finite and infinite total volumes. We also discuss when the first nonzero eigenvalue of the Laplacian takes its mi…
▽ More
In this paper, we investigate complete Riemannian manifolds satisfying the lower weighted Ricci curvature bound $\mathrm{Ric}_{N} \geq K$ with $K>0$ for the negative effective dimension $N<0$. We analyze two $1$-dimensional examples of constant curvature $\mathrm{Ric}_N \equiv K$ with finite and infinite total volumes. We also discuss when the first nonzero eigenvalue of the Laplacian takes its minimum under the same condition $\mathrm{Ric}_N \ge K>0$, as a counterpart to the classical Obata rigidity theorem. Our main theorem shows that, if $N<-1$ and the minimum is attained, then the manifold splits off the real line as a warped product of hyperbolic nature.
△ Less
Submitted 9 October, 2018; v1 submitted 20 April, 2017;
originally announced April 2017.
-
Jump filtering and efficient drift estimation for Lévy-driven SDE's
Authors:
Arnaud Gloter,
Dasha Loukianova,
Hilmar Mai
Abstract:
The problem of drift estimation for the solution $X$ of a stochastic differential equation with Lévy-type jumps is considered under discrete high-frequency observations with a growing observation window. An efficient and asymptotically normal estimator for the drift parameter is constructed under minimal conditions on the jump behavior and the sampling scheme. In the case of a bounded jump measure…
▽ More
The problem of drift estimation for the solution $X$ of a stochastic differential equation with Lévy-type jumps is considered under discrete high-frequency observations with a growing observation window. An efficient and asymptotically normal estimator for the drift parameter is constructed under minimal conditions on the jump behavior and the sampling scheme. In the case of a bounded jump measure density these conditions reduce to $n Δ_n^{3-ε}\to 0,$ where $n$ is the number of observations and $Δ_n$ is the maximal sampling step. This result relaxes the condition $nΔ_n^2 \to 0$ usually required for joint estimation of drift and diffusion coefficient for SDE's with jumps. The main challenge in this estimation problem stems from the appearance of the unobserved continuous part $X^c$ in the likelihood function. In order to construct the drift estimator we recover this continuous part from discrete observations. More precisely, we estimate, in a nonparametric way, stochastic integrals with respect to $X^c$. Convergence results of independent interest are proved for these nonparametric estimators. Finally, we illustrate the behavior of our drift estimator for a number of popular Lévy-driven models from finance.
△ Less
Submitted 16 March, 2016;
originally announced March 2016.
-
Generalized Post-Widder inversion formula with application to statistics
Authors:
Denis Belomestny,
Hilmar Mai,
John Schoenmakers
Abstract:
In this work we derive an inversion formula for the Laplace transform of a density observed on a curve in the complex domain, which generalizes the well known Post-Widder formula. We establish convergence of our inversion method and derive the corresponding convergence rates for the case of a Laplace transform of a smooth density. As an application we consider the problem of statistical inference…
▽ More
In this work we derive an inversion formula for the Laplace transform of a density observed on a curve in the complex domain, which generalizes the well known Post-Widder formula. We establish convergence of our inversion method and derive the corresponding convergence rates for the case of a Laplace transform of a smooth density. As an application we consider the problem of statistical inference for variance-mean mixture models. We construct a nonparametric estimator for the mixing density based on the generalized Post-Widder formula, derive bounds for its root mean square error and give a brief numerical example.
△ Less
Submitted 30 November, 2015;
originally announced November 2015.
-
Forward-reverse EM algorithm for Markov chains: convergence and numerical analysis
Authors:
Christian Bayer,
Hilmar Mai,
John Schoenmakers
Abstract:
We develop a forward-reverse EM (FREM) algorithm for estimating parameters that determine the dynamics of a discrete time Markov chain evolving through a certain measurable state space. As a key tool for the construction of the FREM method we develop forward-reverse representations for Markov chains conditioned on a certain terminal state. These representations may be considered as an extension of…
▽ More
We develop a forward-reverse EM (FREM) algorithm for estimating parameters that determine the dynamics of a discrete time Markov chain evolving through a certain measurable state space. As a key tool for the construction of the FREM method we develop forward-reverse representations for Markov chains conditioned on a certain terminal state. These representations may be considered as an extension of the earlier work Bayer and Schoenmakers [2013] on conditional diffusions. We proof almost sure convergence of our algorithm for a Markov chain model with curved exponential family structure. On the numerical side we give a complexity analysis of the forward-reverse algorithm by deriving its expected cost. Two application examples are discuss to demonstrate the scope of possible applications ranging from models based on continuous time processes to discrete time Markov chain models.
△ Less
Submitted 28 January, 2015;
originally announced January 2015.
-
Efficient maximum likelihood estimation for Lévy-driven Ornstein-Uhlenbeck processes
Authors:
Hilmar Mai
Abstract:
We consider the problem of efficient estimation of the drift parameter of an Ornstein-Uhlenbeck type process driven by a Lévy process when high-frequency observations are given. The estimator is constructed from the time-continuous likelihood function that leads to an explicit maximum likelihood estimator and requires knowledge of the continuous martingale part. We use a thresholding technique to…
▽ More
We consider the problem of efficient estimation of the drift parameter of an Ornstein-Uhlenbeck type process driven by a Lévy process when high-frequency observations are given. The estimator is constructed from the time-continuous likelihood function that leads to an explicit maximum likelihood estimator and requires knowledge of the continuous martingale part. We use a thresholding technique to approximate the continuous part of the process. Under suitable conditions, we prove asymptotic normality and efficiency in the Hájek-Le Cam sense for the resulting drift estimator. Finally, we investigate the finite sample behavior of the method and compare our approach to least squares estimation.
△ Less
Submitted 12 March, 2014;
originally announced March 2014.
-
Pathwise stability of likelihood estimators for diffusions via rough paths
Authors:
Joscha Diehl,
Peter Friz,
Hilmar Mai
Abstract:
We consider the classical estimation problem of an unknown drift parameter within classes of nondegenerate diffusion processes. Using rough path theory (in the sense of T. Lyons), we analyze the Maximum Likelihood Estimator (MLE) with regard to its pathwise stability properties as well as robustness toward misspecification in volatility and even the very nature of the noise. Two numerical examples…
▽ More
We consider the classical estimation problem of an unknown drift parameter within classes of nondegenerate diffusion processes. Using rough path theory (in the sense of T. Lyons), we analyze the Maximum Likelihood Estimator (MLE) with regard to its pathwise stability properties as well as robustness toward misspecification in volatility and even the very nature of the noise. Two numerical examples demonstrate the practical relevance of our results.
△ Less
Submitted 28 September, 2016; v1 submitted 5 November, 2013;
originally announced November 2013.
