-
Kernel Descent -- a Novel Optimizer for Variational Quantum Algorithms
Authors:
Lars Simon,
Holger Eble,
Manuel Radons
Abstract:
In recent years, variational quantum algorithms have garnered significant attention as a candidate approach for near-term quantum advantage using noisy intermediate-scale quantum (NISQ) devices. In this article we introduce kernel descent, a novel algorithm for minimizing the functions underlying variational quantum algorithms. We compare kernel descent to existing methods and carry out extensive…
▽ More
In recent years, variational quantum algorithms have garnered significant attention as a candidate approach for near-term quantum advantage using noisy intermediate-scale quantum (NISQ) devices. In this article we introduce kernel descent, a novel algorithm for minimizing the functions underlying variational quantum algorithms. We compare kernel descent to existing methods and carry out extensive experiments to demonstrate its effectiveness. In particular, we showcase scenarios in which kernel descent outperforms gradient descent and quantum analytic descent. The algorithm follows the well-established scheme of iteratively computing classical local approximations to the objective function and subsequently executing several classical optimization steps with respect to the former. Kernel descent sets itself apart with its employment of reproducing kernel Hilbert space techniques in the construction of the local approximations -- which leads to the observed advantages.
△ Less
Submitted 16 September, 2024;
originally announced September 2024.
-
Denoising Gradient Descent in Variational Quantum Algorithms
Authors:
Lars Simon,
Holger Eble,
Hagen-Henrik Kowalski,
Manuel Radons
Abstract:
In this article we introduce an algorithm for mitigating the adverse effects of noise on gradient descent in variational quantum algorithms. This is accomplished by computing a {\emph{regularized}} local classical approximation to the objective function at every gradient descent step. The computational overhead of our algorithm is entirely classical, i.e., the number of circuit evaluations is exac…
▽ More
In this article we introduce an algorithm for mitigating the adverse effects of noise on gradient descent in variational quantum algorithms. This is accomplished by computing a {\emph{regularized}} local classical approximation to the objective function at every gradient descent step. The computational overhead of our algorithm is entirely classical, i.e., the number of circuit evaluations is exactly the same as when carrying out gradient descent using the parameter-shift rules. We empirically demonstrate the advantages offered by our algorithm on randomized parametrized quantum circuits.
△ Less
Submitted 6 March, 2024;
originally announced March 2024.
-
Interpolating Parametrized Quantum Circuits using Blackbox Queries
Authors:
Lars Simon,
Holger Eble,
Hagen-Henrik Kowalski,
Manuel Radons
Abstract:
This article focuses on developing classical surrogates for parametrized quantum circuits using interpolation via (trigonometric) polynomials. We develop two algorithms for the construction of such surrogates and prove performance guarantees. The constructions are based on circuit evaluations which are blackbox in the sense that no structural specifics of the circuits are exploited. While acknowle…
▽ More
This article focuses on developing classical surrogates for parametrized quantum circuits using interpolation via (trigonometric) polynomials. We develop two algorithms for the construction of such surrogates and prove performance guarantees. The constructions are based on circuit evaluations which are blackbox in the sense that no structural specifics of the circuits are exploited. While acknowledging the limitations of the blackbox approach compared to whitebox evaluations, which exploit specific circuit properties, we demonstrate scenarios in which the blackbox approach might prove beneficial. Sample applications include but are not restricted to the approximation of VQEs and the alleviaton of the barren plateau problem.
△ Less
Submitted 11 July, 2024; v1 submitted 6 October, 2023;
originally announced October 2023.
-
Edge-unfolding nested prismatoids
Authors:
Manuel Radons
Abstract:
A $3$-Prismatoid is the convex hull of two convex polygons $A$ and $B$ which lie in parallel planes $H_A, H_B\subset\mathbb{R}^3$. Let $A'$ be the orthogonal projection of $A$ onto $H_B$. A prismatoid is called nested if $A'$ is properly contained in $B$, or vice versa. We show that every nested prismatoid has an edge-unfolding to a non-overlapping polygon in the plane.
A $3$-Prismatoid is the convex hull of two convex polygons $A$ and $B$ which lie in parallel planes $H_A, H_B\subset\mathbb{R}^3$. Let $A'$ be the orthogonal projection of $A$ onto $H_B$. A prismatoid is called nested if $A'$ is properly contained in $B$, or vice versa. We show that every nested prismatoid has an edge-unfolding to a non-overlapping polygon in the plane.
△ Less
Submitted 21 December, 2023; v1 submitted 2 May, 2021;
originally announced May 2021.
-
Convergence results for some piecewise linear solvers
Authors:
Manuel Radons,
Siegfried M. Rump
Abstract:
Let $A$ be a real $n\times n$ matrix and $z,b\in \mathbb R^n$. The piecewise linear equation system $z-A\vert z\vert = b$ is called an \textit{absolute value equation}. We consider two solvers for this problem, one direct, one semi-iterative, and extend their previously known ranges of convergence.
Let $A$ be a real $n\times n$ matrix and $z,b\in \mathbb R^n$. The piecewise linear equation system $z-A\vert z\vert = b$ is called an \textit{absolute value equation}. We consider two solvers for this problem, one direct, one semi-iterative, and extend their previously known ranges of convergence.
△ Less
Submitted 4 December, 2020;
originally announced December 2020.
-
Generalized Perron Roots and Solvability of the Absolute Value Equation
Authors:
Manuel Radons,
Josué Tonelli-Cueto
Abstract:
Let $A$ be a $n\times n$ real matrix. The piecewise linear equation system $z-A\vert z\vert =b$ is called an absolute value equation (AVE). It is well-known to be equivalent to the linear complementarity problem. Unique solvability of the AVE is known to be characterized in terms of a generalized Perron root called the sign-real spectral radius of $A$. For mere, possibly non-unique, solvability no…
▽ More
Let $A$ be a $n\times n$ real matrix. The piecewise linear equation system $z-A\vert z\vert =b$ is called an absolute value equation (AVE). It is well-known to be equivalent to the linear complementarity problem. Unique solvability of the AVE is known to be characterized in terms of a generalized Perron root called the sign-real spectral radius of $A$. For mere, possibly non-unique, solvability no such characterization exists. We narrow this gap in the theory. That is, we define the concept of the aligned spectrum of $A$ and prove, under some mild genericity assumptions on $A$, that the mapping degree of the piecewise linear function $F_A:\mathbb{R}^n\to\mathbb{R}^n\,, z\mapsto z-A\lvert z\rvert$ is congruent to $(k+1)\mod 2$, where $k$ is the number of aligned values of $A$ which are larger than $1$. We also derive an exact--but more technical--formula for the degree of $F_A$ in terms of the aligned spectrum. Finally, we derive the analogous quantities and results for the LCP.
△ Less
Submitted 19 June, 2023; v1 submitted 17 December, 2019;
originally announced December 2019.
-
An Open Newton Method for Piecewise Smooth Functions
Authors:
Manuel Radons,
Lutz Lehmann,
Tom Streubel,
Andreas Griewank
Abstract:
Recent research has shown that piecewise smooth (PS) functions can be approximated by piecewise linear functions with second order error in the distance to a given reference point. A semismooth Newton type algorithm based on successive application of these piecewise linearizations was subsequently developed for the solution of PS equation systems. For local bijectivity of the linearization at a ro…
▽ More
Recent research has shown that piecewise smooth (PS) functions can be approximated by piecewise linear functions with second order error in the distance to a given reference point. A semismooth Newton type algorithm based on successive application of these piecewise linearizations was subsequently developed for the solution of PS equation systems. For local bijectivity of the linearization at a root, a radius of quadratic convergence was explicitly calculated in terms of local Lipschitz constants of the underlying PS function. In the present work we relax the criterium of local bijectivity of the linearization to local openness. For this purpose a weak implicit function theorem is proved via local mapping degree theory. It is shown that there exist PS functions $f:\mathbb R^2\rightarrow\mathbb R^2$ satisfying the weaker criterium where every neighborhood of the root of $f$ contains a point $x$ such that all elements of the Clarke Jacobian at $x$ are singular. In such neighborhoods the steps of classical semismooth Newton are not defined, which establishes the new method as an independent algorithm. To further clarify the relation between a PS function and its piecewise linearization, several statements about structure correspondences between the two are proved. Moreover, the influence of the specific representation of the local piecewise linear models on the robustness of our method is studied. An example application from cardiovascular mathematics is given.
△ Less
Submitted 1 August, 2018;
originally announced August 2018.
-
Semi-automatically optimized calibration of internal combustion engines
Authors:
Timo Burggraf,
Michael Joswig,
Marc E. Pfetsch,
Manuel Radons,
Stefan Ulbrich
Abstract:
Modern combustion engines incorporate a number of actuators and sensors that can be used to control and optimize the performance and emissions. We describe a semi-automatic method to simultaneously measure and calibrate the actuator settings and the resulting behavior of the engine. The method includes an adaptive process for refining the measurements, a data cleaning step, and an optimization pro…
▽ More
Modern combustion engines incorporate a number of actuators and sensors that can be used to control and optimize the performance and emissions. We describe a semi-automatic method to simultaneously measure and calibrate the actuator settings and the resulting behavior of the engine. The method includes an adaptive process for refining the measurements, a data cleaning step, and an optimization procedure. The optimization works in a discretized space and incorporates the conditions to describe the dependence between the actuators and the engine behavior as well as emission bounds. We demonstrate our method on practical examples.
△ Less
Submitted 31 January, 2019; v1 submitted 28 June, 2018;
originally announced June 2018.
-
Sign controlled solvers for the absolute value equation with an application to support vector machines
Authors:
Lutz Lehmann,
Manuel Radons,
Siegfried M. Rump,
Christian Strohm
Abstract:
Let $A$ be a real $n\times n$ matrix and $z,b\in \mathbb R^n$. The piecewise linear equation system $z-A\vert z\vert = b$ is called an absolute value equation. It is equivalent to the general linear complementarity problem, and thus NP hard in general. Concerning the latter problem, three solvers are presented: One direct, one semi-iterative and one discrete variant of damped Newton. Their previou…
▽ More
Let $A$ be a real $n\times n$ matrix and $z,b\in \mathbb R^n$. The piecewise linear equation system $z-A\vert z\vert = b$ is called an absolute value equation. It is equivalent to the general linear complementarity problem, and thus NP hard in general. Concerning the latter problem, three solvers are presented: One direct, one semi-iterative and one discrete variant of damped Newton. Their previously proved ranges of correctness and convergence, respectively, are extended. Their performance is compared on instances of the XOR separation problem for support vector machines which can be reformulated as an absolute value equation.
△ Less
Submitted 3 March, 2021; v1 submitted 28 July, 2017;
originally announced July 2017.
-
A note on surjectivity of piecewise affine mappings
Authors:
Manuel Radons
Abstract:
A standard theorem in nonsmooth analysis states that a piecewise affine function $F:\mathbb R^n\rightarrow\mathbb R^n$ is surjective if it is coherently oriented in that the linear parts of its selection functions all have the same nonzero determinant sign. In this note we prove that surjectivity already follows from coherent orientation of the selection functions which are active on the unbounded…
▽ More
A standard theorem in nonsmooth analysis states that a piecewise affine function $F:\mathbb R^n\rightarrow\mathbb R^n$ is surjective if it is coherently oriented in that the linear parts of its selection functions all have the same nonzero determinant sign. In this note we prove that surjectivity already follows from coherent orientation of the selection functions which are active on the unbounded sets of a polyhedral subdivision of the domain corresponding to $F$. A side bonus of the argumentation is a short proof of the classical statement that an injective piecewise affine function is coherently oriented.
△ Less
Submitted 22 January, 2018; v1 submitted 27 July, 2017;
originally announced July 2017.
-
Piecewise linear secant approximation via Algorithmic Piecewise Differentiation
Authors:
Andreas Griewank,
Tom Streubel,
Lutz Lehmann,
Manuel Radons,
Richard Hasenfelder
Abstract:
It is shown how piecewise differentiable functions $F: \mathbb R^n \mapsto \mathbb R^m $ that are defined by evaluation programs can be approximated locally by a piecewise linear model based on a pair of sample points $\check x$ and $\hat x$. We show that the discrepancy between function and model at any point $x$ is of the bilinear order $O(\|x-\check x\| \|x-\hat x\|)$. This is a little surprisi…
▽ More
It is shown how piecewise differentiable functions $F: \mathbb R^n \mapsto \mathbb R^m $ that are defined by evaluation programs can be approximated locally by a piecewise linear model based on a pair of sample points $\check x$ and $\hat x$. We show that the discrepancy between function and model at any point $x$ is of the bilinear order $O(\|x-\check x\| \|x-\hat x\|)$. This is a little surprising since $x \in \mathbb R^n$ may vary over the whole Euclidean space, and we utilize only two function samples $\check F=F(\check x)$ and $\hat F=F(\hat x)$, as well as the intermediates computed during their evaluation. As an application of the piecewise linearization procedure we devise a generalized Newton's method based on successive piecewise linearization and prove for it sufficient conditions for convergence and convergence rates equaling those of semismooth Newton. We conclude with the derivation of formulas for the numerically stable implementation of the aforedeveloped piecewise linearization methods.
△ Less
Submitted 11 August, 2017; v1 submitted 16 January, 2017;
originally announced January 2017.
-
Solving piecewise linear equations in abs-normal form
Authors:
Andreas Griewank,
Jens Uwe Bernt,
Manuel Radons,
Tom Streubel
Abstract:
With the ultimate goal of iteratively solving piecewise smooth (PS) systems, we consider the solution of piecewise linear (PL) equations. PL models can be derived in the fashion of automatic or algorithmic differentiation as local approximations of PS functions with a second order error in the distance to a given reference point. The resulting PL functions are obtained quite naturally in what we c…
▽ More
With the ultimate goal of iteratively solving piecewise smooth (PS) systems, we consider the solution of piecewise linear (PL) equations. PL models can be derived in the fashion of automatic or algorithmic differentiation as local approximations of PS functions with a second order error in the distance to a given reference point. The resulting PL functions are obtained quite naturally in what we call the abs-normal form, a variant of the state representation proposed by Bokhoven in his dissertation. Apart from the tradition of PL modeling by electrical engineers, which dates back to the Master thesis of Thomas Stern in 1956, we take into account more recent results on linear complementarity problems and semi-smooth equations originating in the optimization community. We analyze simultaneously the original PL problem (OPL) in abs-normal form and a corresponding complementary system (CPL), which is closely related to the absolute value equation (AVE) studied by Mangasarian et al and a corresponding linear complementarity problem (LCP). We show that the CPL, like KKT conditions and other simply switched systems, cannot be open without being injective. Hence some of the intriguing PL structure described by Scholtes is lost in the transformation from OPL to CPL. To both problems one may apply Newton variants with appropriate generalized Jacobians directly computable from the abs-normal representation. Alternatively, the CPL can be solved by Bokhoven's modulus method and related fixed point iterations. We compile the properties of the various schemes and highlight the connection to the properties of the Schur complement matrix, in particular its signed real spectral radius as analyzed by Rump. Numerical experiments and suitable combinations of the fixed point solvers and stabilized generalized Newton variants remain to be realized.
△ Less
Submitted 3 January, 2017;
originally announced January 2017.
-
Integrating Lipschitzian Dynamical Systems using Piecewise Algorithmic Differentiation
Authors:
Andreas Griewank,
Richard Hasenfelder,
Manuel Radons,
Tom Streubel
Abstract:
In this article we analyze a generalized trapezoidal rule for initial value problems with piecewise smooth right hand side \(F:\R^n\to\R^n\). When applied to such a problem the classical trapezoidal rule suffers from a loss of accuracy if the solution trajectory intersects a nondifferentiability of \(F\). The advantage of the proposed generalized trapezoidal rule is threefold: Firstly we can achie…
▽ More
In this article we analyze a generalized trapezoidal rule for initial value problems with piecewise smooth right hand side \(F:\R^n\to\R^n\). When applied to such a problem the classical trapezoidal rule suffers from a loss of accuracy if the solution trajectory intersects a nondifferentiability of \(F\). The advantage of the proposed generalized trapezoidal rule is threefold: Firstly we can achieve a higher convergence order than with the classical method. Moreover, the method is energy preserving for piecewise linear Hamiltonian systems. Finally, in analogy to the classical case we derive a third order interpolation polynomial for the numerical trajectory. In the smooth case the generalized rule reduces to the classical one. Hence, it is a proper extension of the classical theory. An error estimator is given and numerical results are presented.
△ Less
Submitted 3 January, 2017;
originally announced January 2017.
-
Direct solution of piecewise linear systems
Authors:
Manuel Radons
Abstract:
Let $S$ be a real $n\times n$ matrix, $z,\hat c\in \mathbb R^n$, and $| z|$ the componentwise modulus of $z$. Then the piecewise linear equation system $$z-S| z| = \hat c$$ is called an \textit{absolute value equation} (AVE). It has been proven to be equivalent to the general \textit{linear complementarity problem}, which means that it is NP hard in general.
We will show that for several system…
▽ More
Let $S$ be a real $n\times n$ matrix, $z,\hat c\in \mathbb R^n$, and $| z|$ the componentwise modulus of $z$. Then the piecewise linear equation system $$z-S| z| = \hat c$$ is called an \textit{absolute value equation} (AVE). It has been proven to be equivalent to the general \textit{linear complementarity problem}, which means that it is NP hard in general.
We will show that for several system classes the AVE essentially retains the good natured solvability properties of regular linear systems. I.e., it can be solved directly by a slightly modified Gaussian elimination that we call the signed Gaussian elimination. For dense matrices $S$ this algorithm has the same operations count as the classical Gaussian elimination with symmetric pivoting. For tridiagonal systems in $n$ variables its computational cost is roughly that of sorting $n$ floating point numbers. The sharpness of the proposed restrictions on $S$ will be established.
△ Less
Submitted 29 November, 2016;
originally announced November 2016.
-
$\mathcal O(n)$ working precision inverses for symmetric tridiagonal Toeplitz matrices with $\mathcal O(1)$ floating point calculations
Authors:
Manuel Radons
Abstract:
A well known numerical task is the inversion of large symmetric tridiagonal Toeplitz matrices, i.e., matrices whose entries equal $a$ on the diagonal and $b$ on the extra diagonals ($a, b\in \mathbb R$). The inverses of such matrices are dense and there exist well known explicit formulas by which they can be calculated in $\mathcal O(n^2)$. In this note we present a simplification of the problem t…
▽ More
A well known numerical task is the inversion of large symmetric tridiagonal Toeplitz matrices, i.e., matrices whose entries equal $a$ on the diagonal and $b$ on the extra diagonals ($a, b\in \mathbb R$). The inverses of such matrices are dense and there exist well known explicit formulas by which they can be calculated in $\mathcal O(n^2)$. In this note we present a simplification of the problem that has proven to be rather useful in everyday practice: If $\vert a\vert > 2\vert b\vert$, that is, if the matrix is strictly diagonally dominant, its inverse is a band matrix to working precision and the bandwidth is independent of $n$ for sufficiently large $n$. Employing this observation, we construct a linear time algorithm for an explicit tridiagonal inversion that only uses $\mathcal O(1)$ floating point operations. On the basis of this simplified inversion algorithm we outline the cornerstones for an efficient parallelizable approximative equation solver.
△ Less
Submitted 27 November, 2016;
originally announced November 2016.
