-
Decoupled Structure-Preserving Doubling Algorithm with Truncation for Large-Scale Algebraic Riccati Equations
Authors:
Zhen-Chen Guo,
Eric King-Wah Chu,
Xin Liang,
Wen-Wei Lin
Abstract:
In \emph{Guo et al, arXiv:2005.08288}, we propose a decoupled form of the structure-preserving doubling algorithm (dSDA). The method decouples the original two to four coupled recursions, enabling it to solve large-scale algebraic Riccati equations and other related problems. In this paper, we consider the numerical computations of the novel dSDA for solving large-scale continuous-time algebraic R…
▽ More
In \emph{Guo et al, arXiv:2005.08288}, we propose a decoupled form of the structure-preserving doubling algorithm (dSDA). The method decouples the original two to four coupled recursions, enabling it to solve large-scale algebraic Riccati equations and other related problems. In this paper, we consider the numerical computations of the novel dSDA for solving large-scale continuous-time algebraic Riccati equations with low-rank structures (thus possessing numerically low-rank solutions). With the help of a new truncation strategy, the rank of the approximate solution is controlled. Consequently, large-scale problems can be treated efficiently. Illustrative numerical examples are presented to demonstrate and confirm our claims.
△ Less
Submitted 3 November, 2020;
originally announced November 2020.
-
Highly accurate decoupled doubling algorithm for large-scale M-matrix algebraic Riccati equations
Authors:
Zhen-Chen Guo,
Eric King-wah Chu,
Xin Liang
Abstract:
We consider the numerical solution of large-scale M-matrix algebraic Riccati equations with low-rank structures. We derive a new doubling iteration, decoupling the four original iteration formulae in the alternating-directional doubling algorithm. We prove that the kernels in the decoupled algorithm are small M-matrices. Illumined by the highly accurate algorithm proposed by Xue and Li in 2017, we…
▽ More
We consider the numerical solution of large-scale M-matrix algebraic Riccati equations with low-rank structures. We derive a new doubling iteration, decoupling the four original iteration formulae in the alternating-directional doubling algorithm. We prove that the kernels in the decoupled algorithm are small M-matrices. Illumined by the highly accurate algorithm proposed by Xue and Li in 2017, we construct the triplet representations for the small M-matrix kernels in a highly accurate doubling algorithm. Illustrative numerical examples will be presented on the efficiency of our algorithm.
△ Less
Submitted 7 December, 2020; v1 submitted 1 November, 2020;
originally announced November 2020.
-
A decoupled form of the structure-preserving doubling algorithm with low-rank structures
Authors:
Zhen-Chen Guo,
Eric King-Wah Chu,
Xin Liang,
Wen-Wei Lin
Abstract:
The structure-preserving doubling algorithm (SDA) is a fairly efficient method for solving problems closely related to Hamiltonian (or Hamiltonian-like) matrices, such as computing the required solutions to algebraic Riccati equations. However, for large-scale problems in $\mathbb{C}^n$ (also $\mathbb{R}^n$), the SDA with an $O(n^3)$ computational complexity does not work well. In this paper, we p…
▽ More
The structure-preserving doubling algorithm (SDA) is a fairly efficient method for solving problems closely related to Hamiltonian (or Hamiltonian-like) matrices, such as computing the required solutions to algebraic Riccati equations. However, for large-scale problems in $\mathbb{C}^n$ (also $\mathbb{R}^n$), the SDA with an $O(n^3)$ computational complexity does not work well. In this paper, we propose a new decoupled form of the SDA (we name it as dSDA), building on the associated Krylov subspaces thus leading to the inherent low-rank structures. Importantly, the approach decouples the original two to four iteration formulae. The resulting dSDA is much more efficient since only one quantity (instead of the original two to four) is computed iteratively. For large-scale problems, further efficiency is gained from the low-rank structures. This paper presents the theoretical aspects of the dSDA. A practical algorithm dSDA t with truncation and many illustrative numerical results will appear in a second paper.
△ Less
Submitted 17 May, 2020;
originally announced May 2020.
-
Doubling algorithm for the discretized Bethe-Salpeter eigenvalue problem
Authors:
Zhen-Chen Guo,
Eric King-Wah Chu,
Wen-Wei Lin
Abstract:
The discretized Bethe-Salpeter eigenvalue problem arises in the Green's function evaluation in many body physics and quantum chemistry. Discretization leads to a matrix eigenvalue problem for $H \in \mathbb{C}^{2n\times 2n}$ with a Hamiltonian-like structure. After an appropriate transformation of $H$ to a standard symplectic form, the structure-preserving doubling algorithm, originally for algebr…
▽ More
The discretized Bethe-Salpeter eigenvalue problem arises in the Green's function evaluation in many body physics and quantum chemistry. Discretization leads to a matrix eigenvalue problem for $H \in \mathbb{C}^{2n\times 2n}$ with a Hamiltonian-like structure. After an appropriate transformation of $H$ to a standard symplectic form, the structure-preserving doubling algorithm, originally for algebraic Riccati equations, is extended for the discretized Bethe-Salpeter eigenvalue problem. Potential breakdowns of the algorithm, due to the ill condition or singularity of certain matrices, can be avoided with a double-Cayley transform or a three-recursion remedy. A detailed convergence analysis is conducted for the proposed algorithm, especially on the benign effects of the double-Cayley transform. Numerical results are presented to demonstrate the efficiency and structure-preserving nature of the algorithm.
△ Less
Submitted 3 January, 2018;
originally announced January 2018.
-
Backward Errors and Small Sample Condition Estimation for $\star$-Sylveter Equations
Authors:
Huai-An Diao,
Hong Yan,
Eric King-wah Chu
Abstract:
In this paper, we adopt a componentwise perturbation analysis for $\star$-Sylvester equations. Based on the small condition estimation (SCE), we devise the algorithms to estimate normwise, mixed and componentwise condition numbers for $\star$-Sylvester equations. We also define a componentwise backward error with a sharp and easily computable bound. Numerical examples illustrate that our algorithm…
▽ More
In this paper, we adopt a componentwise perturbation analysis for $\star$-Sylvester equations. Based on the small condition estimation (SCE), we devise the algorithms to estimate normwise, mixed and componentwise condition numbers for $\star$-Sylvester equations. We also define a componentwise backward error with a sharp and easily computable bound. Numerical examples illustrate that our algorithm under componentwise perturbations produces reliable estimates, and the new derived computable bound for the componentwise backward error is sharp and reliable for well conditioned and moderate ill-conditioned $\star$-Sylvester equations under large or small perturbations.
△ Less
Submitted 14 July, 2016; v1 submitted 4 July, 2016;
originally announced July 2016.
-
Conic Optimization via Operator Splitting and Homogeneous Self-Dual Embedding
Authors:
Brendan O'Donoghue,
Eric Chu,
Neal Parikh,
Stephen Boyd
Abstract:
We introduce a first order method for solving very large convex cone programs. The method uses an operator splitting method, the alternating directions method of multipliers, to solve the homogeneous self-dual embedding, an equivalent feasibility problem involving finding a nonzero point in the intersection of a subspace and a cone. This approach has several favorable properties. Compared to inter…
▽ More
We introduce a first order method for solving very large convex cone programs. The method uses an operator splitting method, the alternating directions method of multipliers, to solve the homogeneous self-dual embedding, an equivalent feasibility problem involving finding a nonzero point in the intersection of a subspace and a cone. This approach has several favorable properties. Compared to interior-point methods, first-order methods scale to very large problems, at the cost of requiring more time to reach very high accuracy. Compared to other first-order methods for cone programs, our approach finds both primal and dual solutions when available or a certificate of infeasibility or unboundedness otherwise, is parameter-free, and the per-iteration cost of the method is the same as applying a splitting method to the primal or dual alone. We discuss efficient implementation of the method in detail, including direct and indirect methods for computing projection onto the subspace, scaling the original problem data, and stopping criteria. We describe an open-source implementation, which handles the usual (symmetric) non-negative, second-order, and semidefinite cones as well as the (non-self-dual) exponential and power cones and their duals. We report numerical results that show speedups over interior-point cone solvers for large problems, and scaling to very large general cone programs.
△ Less
Submitted 25 July, 2016; v1 submitted 11 December, 2013;
originally announced December 2013.
-
Message Passing for Dynamic Network Energy Management
Authors:
Matt Kraning,
Eric Chu,
Javad Lavaei,
Stephen Boyd
Abstract:
We consider a network of devices, such as generators, fixed loads, deferrable loads, and storage devices, each with its own dynamic constraints and objective, connected by lossy capacitated lines. The problem is to minimize the total network objective subject to the device and line constraints, over a given time horizon. This is a large optimization problem, with variables for consumption or gener…
▽ More
We consider a network of devices, such as generators, fixed loads, deferrable loads, and storage devices, each with its own dynamic constraints and objective, connected by lossy capacitated lines. The problem is to minimize the total network objective subject to the device and line constraints, over a given time horizon. This is a large optimization problem, with variables for consumption or generation in each time period for each device. In this paper we develop a decentralized method for solving this problem. The method is iterative: At each step, each device exchanges simple messages with its neighbors in the network and then solves its own optimization problem, minimizing its own objective function, augmented by a term determined by the messages it has received. We show that this message passing method converges to a solution when the device objective and constraints are convex. The method is completely decentralized, and needs no global coordination other than synchronizing iterations; the problems to be solved by each device can typically be solved extremely efficiently and in parallel. The method is fast enough that even a serial implementation can solve substantial problems in reasonable time frames. We report results for several numerical experiments, demonstrating the method's speed and scaling, including the solution of a problem instance with over 30 million variables in 52 minutes for a serial implementation; with decentralized computing, the solve time would be less than one second.
△ Less
Submitted 4 April, 2012;
originally announced April 2012.
