-
An Efficient Framework for Global Non-Convex Polynomial Optimization with Algebraic Constraints
Authors:
Mitchell Tong Harris,
Pierre-David Letourneau,
Dalton Jones,
M. Harper Langston
Abstract:
We present an efficient framework for solving algebraically-constrained global non-convex polynomial optimization problems over subsets of the hypercube. We prove the existence of an equivalent nonlinear reformulation of such problems that possesses essentially no spurious local minima. Through numerical experiments on previously intractable global constrained polynomial optimization problems in h…
▽ More
We present an efficient framework for solving algebraically-constrained global non-convex polynomial optimization problems over subsets of the hypercube. We prove the existence of an equivalent nonlinear reformulation of such problems that possesses essentially no spurious local minima. Through numerical experiments on previously intractable global constrained polynomial optimization problems in high dimension, we show that polynomial scaling in dimension and degree is achievable when computing the optimal value and location.
△ Less
Submitted 4 September, 2024; v1 submitted 3 November, 2023;
originally announced November 2023.
-
A Sparse Fast Chebyshev Transform for High-Dimensional Approximation
Authors:
Dalton Jones,
Pierre-David Letourneau,
Matthew J. Morse,
M. Harper Langston
Abstract:
We present the Fast Chebyshev Transform (FCT), a fast, randomized algorithm to compute a Chebyshev approximation of functions in high-dimensions from the knowledge of the location of its nonzero Chebyshev coefficients. Rather than sampling a full-resolution Chebyshev grid in each dimension, we randomly sample several grids with varied resolutions and solve a least-squares problem in coefficient sp…
▽ More
We present the Fast Chebyshev Transform (FCT), a fast, randomized algorithm to compute a Chebyshev approximation of functions in high-dimensions from the knowledge of the location of its nonzero Chebyshev coefficients. Rather than sampling a full-resolution Chebyshev grid in each dimension, we randomly sample several grids with varied resolutions and solve a least-squares problem in coefficient space in order to compute a polynomial approximating the function of interest across all grids simultaneously. We theoretically and empirically show that the FCT exhibits quasi-linear scaling and high numerical accuracy on challenging and complex high-dimensional problems. We demonstrate the effectiveness of our approach compared to alternative Chebyshev approximation schemes. In particular, we highlight our algorithm's effectiveness in high dimensions, demonstrating significant speedups over commonly-used alternative techniques.
△ Less
Submitted 2 October, 2023; v1 submitted 25 September, 2023;
originally announced September 2023.
-
An Efficient Framework for Global Non-Convex Polynomial Optimization over the Hypercube
Authors:
Pierre-David Letourneau,
Dalton Jones,
Matthew Morse,
M. Harper Langston
Abstract:
We present a novel efficient theoretical and numerical framework for solving global non-convex polynomial optimization problems. We analytically demonstrate that such problems can be efficiently reformulated using a non-linear objective over a convex set; further, these reformulated problems possess no spurious local minima (i.e., every local minimum is a global minimum). We introduce an algorithm…
▽ More
We present a novel efficient theoretical and numerical framework for solving global non-convex polynomial optimization problems. We analytically demonstrate that such problems can be efficiently reformulated using a non-linear objective over a convex set; further, these reformulated problems possess no spurious local minima (i.e., every local minimum is a global minimum). We introduce an algorithm for solving these resulting problems using the augmented Lagrangian and the method of Burer and Monteiro. We show through numerical experiments that polynomial scaling in dimension and degree is achievable for computing the optimal value and location of previously intractable global polynomial optimization problems in high dimension.
△ Less
Submitted 16 May, 2024; v1 submitted 31 August, 2023;
originally announced August 2023.
-
Gaussian Quadrature Rule using ε-Quasiorthogonality
Authors:
Pierre-David Létourneau,
Eric Darve
Abstract:
We introduce a new type of quadrature, known as approximate Gaussian quadrature (AGQ) rules using ε-quasiorthogonality, for the approximation of integrals of the form \int f(x)d α(x). The measure α(\cdot) can be arbitrary as long as it possesses finite moments μn for sufficiently large n. The weights and nodes associated with the quadrature can be computed in low complexity and their count is infe…
▽ More
We introduce a new type of quadrature, known as approximate Gaussian quadrature (AGQ) rules using ε-quasiorthogonality, for the approximation of integrals of the form \int f(x)d α(x). The measure α(\cdot) can be arbitrary as long as it possesses finite moments μn for sufficiently large n. The weights and nodes associated with the quadrature can be computed in low complexity and their count is inferior to that required by classical quadratures at fixed accuracy on some families of integrands. Furthermore, we show how AGQ can be used to discretize the Fourier transform with few points in order to obtain short exponential representations of functions.
△ Less
Submitted 12 November, 2018;
originally announced November 2018.
-
Matrix probing: a randomized preconditioner for the wave-equation Hessian
Authors:
Laurent Demanet,
Pierre-David Létourneau,
Nicolas Boumal,
Henri Calandra,
Jiawei Chiu,
Stanley Snelson
Abstract:
This paper considers the problem of approximating the inverse of the wave-equation Hessian, also called normal operator, in seismology and other types of wave-based imaging. An expansion scheme for the pseudodifferential symbol of the inverse Hessian is set up. The coefficients in this expansion are found via least-squares fitting from a certain number of applications of the normal operator on ade…
▽ More
This paper considers the problem of approximating the inverse of the wave-equation Hessian, also called normal operator, in seismology and other types of wave-based imaging. An expansion scheme for the pseudodifferential symbol of the inverse Hessian is set up. The coefficients in this expansion are found via least-squares fitting from a certain number of applications of the normal operator on adequate randomized trial functions built in curvelet space. It is found that the number of parameters that can be fitted increases with the amount of information present in the trial functions, with high probability. Once an approximate inverse Hessian is available, application to an image of the model can be done in very low complexity. Numerical experiments show that randomized operator fitting offers a compelling preconditioner for the linearized seismic inversion problem.
△ Less
Submitted 19 January, 2011;
originally announced January 2011.
