-
Connecting Kaporin's condition number and the Bregman log determinant divergence
Authors:
Andreas A. Bock,
Martin S. Andersen
Abstract:
This paper presents some theoretical results relating the Bregman log determinant matrix divergence to Kaporin's condition number. These can be viewed as nearness measures between a preconditioner and a given matrix, and we show under which conditions these two functions coincide. We also give examples of constraint sets over which it is equivalent to minimise these two objectives. We focus on pre…
▽ More
This paper presents some theoretical results relating the Bregman log determinant matrix divergence to Kaporin's condition number. These can be viewed as nearness measures between a preconditioner and a given matrix, and we show under which conditions these two functions coincide. We also give examples of constraint sets over which it is equivalent to minimise these two objectives. We focus on preconditioners that are the sum of a positive definite and low-rank matrix, which were developed in a previous work. These were constructed as minimisers of the aforementioned divergence, and we show that they are only a constant scaling from also minimising Kaporin's condition number. We highlight connections to information geometry and comment on future directions.
△ Less
Submitted 28 March, 2025;
originally announced March 2025.
-
The Geometry and Well-Posedness of Sparse Regularized Linear Regression
Authors:
Jasper Marijn Everink,
Yiqiu Dong,
Martin Skovgaard Andersen
Abstract:
In this work, we study the well-posedness of certain sparse regularized linear regression problems, i.e., the existence, uniqueness and continuity of the solution map with respect to the data. We focus on regularization functions that are convex piecewise linear, i.e., whose epigraph is polyhedral. This includes total variation on graphs and polyhedral constraints. We provide a geometric framework…
▽ More
In this work, we study the well-posedness of certain sparse regularized linear regression problems, i.e., the existence, uniqueness and continuity of the solution map with respect to the data. We focus on regularization functions that are convex piecewise linear, i.e., whose epigraph is polyhedral. This includes total variation on graphs and polyhedral constraints. We provide a geometric framework for these functions based on their connection to polyhedral sets and apply this to the study of the well-posedness of the corresponding sparse regularized linear regression problem. Particularly, we provide geometric conditions for well-posedness of the regression problem, compare these conditions to those for smooth regularization, and show the computational difficulty of verifying these conditions.
△ Less
Submitted 5 September, 2024;
originally announced September 2024.
-
Sampling Strategies in Bayesian Inversion: A Study of RTO and Langevin Methods
Authors:
Remi Laumont,
Yiqiu Dong,
Martin Skovgaard Andersen
Abstract:
This paper studies two classes of sampling methods for the solution of inverse problems, namely Randomize-Then-Optimize (RTO), which is rooted in sensitivity analysis, and Langevin methods, which are rooted in the Bayesian framework. The two classes of methods correspond to different assumptions and yield samples from different target distributions. We highlight the main conceptual and theoretical…
▽ More
This paper studies two classes of sampling methods for the solution of inverse problems, namely Randomize-Then-Optimize (RTO), which is rooted in sensitivity analysis, and Langevin methods, which are rooted in the Bayesian framework. The two classes of methods correspond to different assumptions and yield samples from different target distributions. We highlight the main conceptual and theoretical differences between the two approaches and compare them from a practical point of view by tackling two classical inverse problems in imaging: deblurring and inpainting. We show that the choice of the sampling method has a significant impact on the quality of the reconstruction and that the RTO method is more robust to the choice of the parameters.
△ Less
Submitted 5 November, 2024; v1 submitted 24 June, 2024;
originally announced June 2024.
-
A New Matrix Truncation Method for Improving Approximate Factorisation Preconditioners
Authors:
Andreas A. Bock,
Martin S. Andersen
Abstract:
In this experimental work, we present a general framework based on the Bregman log determinant divergence for preconditioning Hermitian positive definite linear systems. We explore this divergence as a measure of discrepancy between a preconditioner and a matrix. Given an approximate factorisation of a given matrix, the proposed framework informs the construction of a low-rank approximation of the…
▽ More
In this experimental work, we present a general framework based on the Bregman log determinant divergence for preconditioning Hermitian positive definite linear systems. We explore this divergence as a measure of discrepancy between a preconditioner and a matrix. Given an approximate factorisation of a given matrix, the proposed framework informs the construction of a low-rank approximation of the typically indefinite factorisation error. The resulting preconditioner is therefore a sum of a Hermitian positive definite matrix given by an approximate factorisation plus a low-rank matrix. Notably, the low-rank term is not generally obtained as a truncated singular value decomposition (TSVD). This framework leads to a new truncation where principal directions are not based on the magnitude of the singular values, and we prove that such truncations are minimisers of the aforementioned divergence. We present several numerical examples showing that the proposed preconditioner can reduce the number of PCG iterations compared to a preconditioner constructed using a TSVD for the same rank. We also propose a heuristic to approximate the proposed preconditioner in the case where exact truncations cannot be computed explicitly (e.g. in a large-scale setting) and demonstrate its effectiveness over TSVD-based approaches.
△ Less
Submitted 9 October, 2024; v1 submitted 11 December, 2023;
originally announced December 2023.
-
Direct System Identification of Dynamical Networks with Partial Measurements: a Maximum Likelihood Approach
Authors:
João Victor Galvão da Mata,
Anders Hansson,
Martin S. Andersen
Abstract:
This paper introduces a novel direct approach to system identification of dynamic networks with missing data based on maximum likelihood estimation. Dynamic networks generally present a singular probability density function, which poses a challenge in the estimation of their parameters. By leveraging knowledge about the network's interconnections, we show that it is possible to transform the probl…
▽ More
This paper introduces a novel direct approach to system identification of dynamic networks with missing data based on maximum likelihood estimation. Dynamic networks generally present a singular probability density function, which poses a challenge in the estimation of their parameters. By leveraging knowledge about the network's interconnections, we show that it is possible to transform the problem into a more tractable form by applying linear transformations. This results in a nonsingular probability density function, enabling the application of maximum likelihood estimation techniques. Our preliminary numerical results suggest that when combined with global optimization algorithms or a suitable initialization strategy, we are able to obtain a good estimate of the dynamics of the internal systems.
△ Less
Submitted 6 March, 2024; v1 submitted 1 November, 2023;
originally announced November 2023.
-
AdaSub: Stochastic Optimization Using Second-Order Information in Low-Dimensional Subspaces
Authors:
João Victor Galvão da Mata,
Martin S. Andersen
Abstract:
We introduce AdaSub, a stochastic optimization algorithm that computes a search direction based on second-order information in a low-dimensional subspace that is defined adaptively based on available current and past information. Compared to first-order methods, second-order methods exhibit better convergence characteristics, but the need to compute the Hessian matrix at each iteration results in…
▽ More
We introduce AdaSub, a stochastic optimization algorithm that computes a search direction based on second-order information in a low-dimensional subspace that is defined adaptively based on available current and past information. Compared to first-order methods, second-order methods exhibit better convergence characteristics, but the need to compute the Hessian matrix at each iteration results in excessive computational expenses, making them impractical. To address this issue, our approach enables the management of computational expenses and algorithm efficiency by enabling the selection of the subspace dimension for the search. Our code is freely available on GitHub, and our preliminary numerical results demonstrate that AdaSub surpasses popular stochastic optimizers in terms of time and number of iterations required to reach a given accuracy.
△ Less
Submitted 6 November, 2023; v1 submitted 30 October, 2023;
originally announced October 2023.
-
Preconditioner Design via the Bregman Divergence
Authors:
Andreas Bock,
Martin S. Andersen
Abstract:
We study a preconditioner for a Hermitian positive definite linear system, which is obtained as the solution of a matrix nearness problem based on the Bregman log determinant divergence. The preconditioner is of the form of a Hermitian positive definite matrix plus a low-rank matrix. For this choice of structure, the generalised eigenvalues of the preconditioned matrix are easily calculated, and w…
▽ More
We study a preconditioner for a Hermitian positive definite linear system, which is obtained as the solution of a matrix nearness problem based on the Bregman log determinant divergence. The preconditioner is of the form of a Hermitian positive definite matrix plus a low-rank matrix. For this choice of structure, the generalised eigenvalues of the preconditioned matrix are easily calculated, and we show under which conditions the preconditioner minimises the $\ell_2$ condition number of the preconditioned matrix. We develop practical numerical approximations of the preconditioner based on the randomised singular value decomposition (SVD) and the Nyström approximation and provide corresponding approximation results. Furthermore, we prove that the Nyström approximation is in fact also a matrix approximation in a range-restricted Bregman divergence and establish several connections between this divergence and matrix nearness problems in different measures. Numerical examples are provided to support the theoretical results.
△ Less
Submitted 14 December, 2023; v1 submitted 24 April, 2023;
originally announced April 2023.
-
Sparse Bayesian Inference with Regularized Gaussian Distributions
Authors:
Jasper Marijn Everink,
Yiqiu Dong,
Martin Skovgaard Andersen
Abstract:
Regularization is a common tool in variational inverse problems to impose assumptions on the parameters of the problem. One such assumption is sparsity, which is commonly promoted using lasso and total variation-like regularization. Although the solutions to many such regularized inverse problems can be considered as points of maximum probability of well-chosen posterior distributions, samples fro…
▽ More
Regularization is a common tool in variational inverse problems to impose assumptions on the parameters of the problem. One such assumption is sparsity, which is commonly promoted using lasso and total variation-like regularization. Although the solutions to many such regularized inverse problems can be considered as points of maximum probability of well-chosen posterior distributions, samples from these distributions are generally not sparse. In this paper, we present a framework for implicitly defining a probability distribution that combines the effects of sparsity imposing regularization with Gaussian distributions. Unlike continuous distributions, these implicit distributions can assign positive probability to sparse vectors. We study these regularized distributions for various regularization functions including total variation regularization and piecewise linear convex functions. We apply the developed theory to uncertainty quantification for Bayesian linear inverse problems and derive a Gibbs sampler for a Bayesian hierarchical model. To illustrate the difference between our sparsity-inducing framework and continuous distributions, we apply our framework to small-scale deblurring and computed tomography examples.
△ Less
Submitted 14 February, 2023;
originally announced February 2023.
-
Bayesian Inference with Projected Densities
Authors:
Jasper Marijn Everink,
Yiqiu Dong,
Martin Skovgaard Andersen
Abstract:
Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a constrained prior such that the posterior assigns positive probability to the boundary of the constraint set. We show that by projecting posterior mass onto the constrain…
▽ More
Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a constrained prior such that the posterior assigns positive probability to the boundary of the constraint set. We show that by projecting posterior mass onto the constraint set, we obtain a new posterior with a rich probabilistic structure on the boundary of that set. If the original posterior is a Gaussian, then such a projection can be done efficiently. We apply the method to Bayesian linear inverse problems, in which case samples can be obtained by repeatedly solving constrained least squares problems, similar to a MAP estimate, but with perturbations in the data. When combined into a Bayesian hierarchical model and the constraint set is a polyhedral cone, we can derive a Gibbs sampler to efficiently sample from the hierarchical model. To show the effect of projecting the posterior, we applied the method to deblurring and computed tomography examples.
△ Less
Submitted 26 September, 2022;
originally announced September 2022.
-
Low-rank flat-field correction for artifact reduction in spectral computed tomography
Authors:
Katrine O Bangsgaard,
Genoveva Burca,
Evelina Ametova,
Martin S Andersen,
Jakob S Jørgensen
Abstract:
Spectral computed tomography has received considerable interest in recent years since spectral measurements contain much richer information about the object of interest. In spectral computed tomography, we are interested in the energy channel-wise reconstructions of the object. However, such reconstructions suffer from low signal-to-noise ratio and share the challenges of conventional low-dose com…
▽ More
Spectral computed tomography has received considerable interest in recent years since spectral measurements contain much richer information about the object of interest. In spectral computed tomography, we are interested in the energy channel-wise reconstructions of the object. However, such reconstructions suffer from low signal-to-noise ratio and share the challenges of conventional low-dose computed tomography such as ring artifacts. Ring artifacts arise from errors in the flat-field correction and can significantly degrade the quality of the reconstruction. We propose an extended flat-field model that exploits high correlation in the spectral flat-fields to reduce ring artifacts in the channel-wise reconstructions. The extended model relies on the assumption that the spectral flat-fields can be well-approximated by a low-rank matrix. Our proposed model works directly on the spectral flat-fields and can be combined with any existing reconstruction model, e.g., filtered back projection and iterative methods. The proposed model is validated on a neutron data set. The results show that our method successfully diminishes ring artifacts and improves the quality of the reconstructions. Moreover, the results indicate that our method is robust; it only needs a single spectral flat-field image, whereas existing methods need multiple spectral flat-field images to reach a similar level of ring reduction.
△ Less
Submitted 3 March, 2022;
originally announced March 2022.
-
A Bayesian Approach to CT Reconstruction with Uncertain Geometry
Authors:
Frederik H. Pedersen,
Jakob S. Jørgensen,
Martin S. Andersen
Abstract:
Computed tomography is a method for synthesizing volumetric or cross-sectional images of an object from a collection of projections. Popular reconstruction methods for computed tomography are based on idealized models and assumptions that may not be valid in practice. One such assumption is that the exact projection geometry is known. The projection geometry describes the relative location of the…
▽ More
Computed tomography is a method for synthesizing volumetric or cross-sectional images of an object from a collection of projections. Popular reconstruction methods for computed tomography are based on idealized models and assumptions that may not be valid in practice. One such assumption is that the exact projection geometry is known. The projection geometry describes the relative location of the radiation source, object, and detector for each projection. However, in practice, the geometric parameters used to describe the position and orientation of the radiation source, object, and detector are estimated quantities with uncertainty. A failure to accurately estimate the geometry may lead to reconstructions with severe misalignment artifacts that significantly decrease their scientific or diagnostic value. We propose a novel reconstruction method that jointly estimates the reconstruction and the projection geometry. The reconstruction method is based on a Bayesian approach that yields a point estimate for the reconstruction and geometric parameters and, in addition, provides valuable information regarding their uncertainty. This is achieved by approximately sampling from the joint posterior distribution of the reconstruction and projection geometry using a hierarchical Gibbs sampler. Using real tomographic data, we demonstrate that the proposed reconstruction method significantly reduces misalignment artifacts. Compared with two commonly used alignment methods, our proposed method achieves comparable or better results under challenging conditions.
△ Less
Submitted 2 March, 2022;
originally announced March 2022.
-
Regularization by Denoising Sub-sampled Newton Method for Spectral CT Multi-Material Decomposition
Authors:
Alessandro Perelli,
Martin S. Andersen
Abstract:
Spectral Computed Tomography (CT) is an emerging technology that enables to estimate the concentration of basis materials within a scanned object by exploiting different photon energy spectra. In this work, we aim at efficiently solving a model-based maximum-a-posterior problem to reconstruct multi-materials images with application to spectral CT. In particular, we propose to solve a regularized o…
▽ More
Spectral Computed Tomography (CT) is an emerging technology that enables to estimate the concentration of basis materials within a scanned object by exploiting different photon energy spectra. In this work, we aim at efficiently solving a model-based maximum-a-posterior problem to reconstruct multi-materials images with application to spectral CT. In particular, we propose to solve a regularized optimization problem based on a plug-in image-denoising function using a randomized second order method. By approximating the Newton step using a sketching of the Hessian of the likelihood function, it is possible to reduce the complexity while retaining the complex prior structure given by the data-driven regularizer. We exploit a non-uniform block sub-sampling of the Hessian with inexact but efficient Conjugate gradient updates that require only Jacobian-vector products for denoising term. Finally, we show numerical and experimental results for spectral CT materials decomposition.
△ Less
Submitted 25 March, 2021;
originally announced March 2021.
-
On the Robustness and Scalability of Semidefinite Relaxation for Optimal Power Flow Problems
Authors:
Anders Eltved,
Joachim Dahl,
Martin S. Andersen
Abstract:
Semidefinite relaxation techniques have shown great promise for nonconvex optimal power flow problems. However, a number of independent numerical experiments have led to concerns about scalability and robustness of existing SDP solvers. To address these concerns, we investigate some numerical aspects of the problem and compare different state-of-the-art solvers. Our results demonstrate that semide…
▽ More
Semidefinite relaxation techniques have shown great promise for nonconvex optimal power flow problems. However, a number of independent numerical experiments have led to concerns about scalability and robustness of existing SDP solvers. To address these concerns, we investigate some numerical aspects of the problem and compare different state-of-the-art solvers. Our results demonstrate that semidefinite relaxations of large problem instances with on the order of 10,000 buses can be solved reliably and to reasonable accuracy within minutes. Furthermore, the semidefinite relaxation of a test case with 25,000 buses can be solved reliably within half an hour; the largest test case with 82,000 buses is solved within eight hours. We also compare the lower bound obtained via semidefinite relaxation to locally optimal solutions obtained with nonlinear optimization methods and calculate the optimality gap.
△ Less
Submitted 4 March, 2019; v1 submitted 22 June, 2018;
originally announced June 2018.
-
A Convex Reconstruction Model for X-ray Tomographic Imaging with Uncertain Flat-fields
Authors:
Hari Om Aggrawal,
Martin Skovgaard Andersen,
Sean Rose,
Emil Y. Sidky
Abstract:
Classical methods for X-ray computed tomography are based on the assumption that the X-ray source intensity is known, but in practice, the intensity is measured and hence uncertain. Under normal operating conditions, when the exposure time is sufficiently high, this kind of uncertainty typically has a negligible effect on the reconstruction quality. However, in time- or dose-limited applications s…
▽ More
Classical methods for X-ray computed tomography are based on the assumption that the X-ray source intensity is known, but in practice, the intensity is measured and hence uncertain. Under normal operating conditions, when the exposure time is sufficiently high, this kind of uncertainty typically has a negligible effect on the reconstruction quality. However, in time- or dose-limited applications such as dynamic CT, this uncertainty may cause severe and systematic artifacts known as ring artifacts. By carefully modeling the measurement process and by taking uncertainties into account, we derive a new convex model that leads to improved reconstructions despite poor quality measurements. We demonstrate the effectiveness of the methodology based on simulated and real data sets.
△ Less
Submitted 14 July, 2017;
originally announced July 2017.
-
Distributed Semidefinite Programming with Application to Large-scale System Analysis
Authors:
Sina Khoshfetrat Pakazad,
Anders Hansson,
Martin S. Andersen,
Anders Rantzer
Abstract:
Distributed algorithms for solving coupled semidefinite programs (SDPs) commonly require many iterations to converge. They also put high computational demand on the computational agents. In this paper we show that in case the coupled problem has an inherent tree structure, it is possible to devise an efficient distributed algorithm for solving such problems. This algorithm can potentially enjoy th…
▽ More
Distributed algorithms for solving coupled semidefinite programs (SDPs) commonly require many iterations to converge. They also put high computational demand on the computational agents. In this paper we show that in case the coupled problem has an inherent tree structure, it is possible to devise an efficient distributed algorithm for solving such problems. This algorithm can potentially enjoy the same efficiency as centralized solvers that exploit sparsity. The proposed algorithm relies on predictor-corrector primal-dual interior-point methods, where we use a message-passing algorithm to compute the search directions distributedly. Message-passing here is closely related to dynamic programming over trees. This allows us to compute the exact search directions in a finite number of steps. Furthermore this number can be computed a priori and only depends on the coupling structure of the problem. We use the proposed algorithm for analyzing robustness of large-scale uncertain systems distributedly. We test the performance of this algorithm using numerical examples.
△ Less
Submitted 29 April, 2015;
originally announced April 2015.
-
Tomographic Image Reconstruction using Training images
Authors:
Sara Soltani,
Martin S. Andersen,
Per Christian Hansen
Abstract:
We describe and examine an algorithm for tomographic image reconstruction where prior knowledge about the solution is available in the form of training images. We first construct a nonnegative dictionary based on prototype elements from the training images; this problem is formulated as a regularized non-negative matrix factorization. Incorporating the dictionary as a prior in a convex reconstruct…
▽ More
We describe and examine an algorithm for tomographic image reconstruction where prior knowledge about the solution is available in the form of training images. We first construct a nonnegative dictionary based on prototype elements from the training images; this problem is formulated as a regularized non-negative matrix factorization. Incorporating the dictionary as a prior in a convex reconstruction problem, we then find an approximate solution with a sparse representation in the dictionary. The dictionary is applied to non-overlapping patches of the image, which reduces the computational complexity compared to other algorithms. Computational experiments clarify the choice and interplay of the model parameters and the regularization parameters, and we show that in few-projection low-dose settings our algorithm is competitive with total variation regularization and tends to include more texture and more correct edges.
△ Less
Submitted 17 August, 2015; v1 submitted 6 March, 2015;
originally announced March 2015.
-
Distributed Primal-dual Interior-point Methods for Solving Loosely Coupled Problems Using Message Passing
Authors:
Sina Khoshfetrat Pakazad,
Anders Hansson,
Martin S. Andersen
Abstract:
In this paper, we propose a distributed algorithm for solving loosely coupled problems with chordal sparsity which relies on primal-dual interior-point methods. We achieve this by distributing the computations at each iteration, using message-passing. In comparison to already existing distributed algorithms for solving such problems, this algorithm requires far less number of iterations to converg…
▽ More
In this paper, we propose a distributed algorithm for solving loosely coupled problems with chordal sparsity which relies on primal-dual interior-point methods. We achieve this by distributing the computations at each iteration, using message-passing. In comparison to already existing distributed algorithms for solving such problems, this algorithm requires far less number of iterations to converge to a solution with high accuracy. Furthermore, it is possible to compute an upper-bound for the number of required iterations which, unlike already existing methods, only depends on the coupling structure in the problem. We illustrate the performance of our proposed method using a set of numerical examples.
△ Less
Submitted 29 June, 2015; v1 submitted 23 February, 2015;
originally announced February 2015.
-
Distributed Robustness Analysis of Interconnected Uncertain Systems Using Chordal Decomposition
Authors:
Sina Khoshfetrat Pakazad,
Anders Hansson,
Martin S. Andersen,
Anders Rantzer
Abstract:
Large-scale interconnected uncertain systems commonly have large state and uncertainty dimensions. Aside from the heavy computational cost of solving centralized robust stability analysis techniques, privacy requirements in the network can also introduce further issues. In this paper, we utilize IQC analysis for analyzing large-scale interconnected uncertain systems and we evade these issues by de…
▽ More
Large-scale interconnected uncertain systems commonly have large state and uncertainty dimensions. Aside from the heavy computational cost of solving centralized robust stability analysis techniques, privacy requirements in the network can also introduce further issues. In this paper, we utilize IQC analysis for analyzing large-scale interconnected uncertain systems and we evade these issues by describing a decomposition scheme that is based on the interconnection structure of the system. This scheme is based on the so-called chordal decomposition and does not add any conservativeness to the analysis approach. The decomposed problem can be solved using distributed computational algorithms without the need for a centralized computational unit. We further discuss the merits of the proposed analysis approach using a numerical experiment.
△ Less
Submitted 10 February, 2014;
originally announced February 2014.
-
Distributed Interior-point Method for Loosely Coupled Problems
Authors:
Sina Khoshfetrat Pakazad,
Anders Hansson,
Martin S. Andersen
Abstract:
In this paper, we put forth distributed algorithms for solving loosely coupled unconstrained and constrained optimization problems. Such problems are usually solved using algorithms that are based on a combination of decomposition and first order methods. These algorithms are commonly very slow and require many iterations to converge. In order to alleviate this issue, we propose algorithms that co…
▽ More
In this paper, we put forth distributed algorithms for solving loosely coupled unconstrained and constrained optimization problems. Such problems are usually solved using algorithms that are based on a combination of decomposition and first order methods. These algorithms are commonly very slow and require many iterations to converge. In order to alleviate this issue, we propose algorithms that combine the Newton and interior-point methods with proximal splitting methods for solving such problems. Particularly, the algorithm for solving unconstrained loosely coupled problems, is based on Newton's method and utilizes proximal splitting to distribute the computations for calculating the Newton step at each iteration. A combination of this algorithm and the interior-point method is then used to introduce a distributed algorithm for solving constrained loosely coupled problems. We also provide guidelines on how to implement the proposed methods efficiently and briefly discuss the properties of the resulting solutions.
△ Less
Submitted 19 December, 2013;
originally announced December 2013.
-
Robust Stability Analysis of Sparsely Interconnected Uncertain Systems
Authors:
Martin S. Andersen,
Sina Khoshfetrat Pakazad,
Anders Hansson,
Anders Rantzer
Abstract:
In this paper, we consider robust stability analysis of large-scale sparsely interconnected uncertain systems. By modeling the interconnections among the subsystems with integral quadratic constraints, we show that robust stability analysis of such systems can be performed by solving a set of sparse linear matrix inequalities. We also show that a sparse formulation of the analysis problem is equiv…
▽ More
In this paper, we consider robust stability analysis of large-scale sparsely interconnected uncertain systems. By modeling the interconnections among the subsystems with integral quadratic constraints, we show that robust stability analysis of such systems can be performed by solving a set of sparse linear matrix inequalities. We also show that a sparse formulation of the analysis problem is equivalent to the classical formulation of the robustness analysis problem and hence does not introduce any additional conservativeness. The sparse formulation of the analysis problem allows us to apply methods that rely on efficient sparse factorization techniques, and our numerical results illustrate the effectiveness of this approach compared to methods that are based on the standard formulation of the analysis problem.
△ Less
Submitted 11 November, 2013;
originally announced November 2013.
-
Reduced-Complexity Semidefinite Relaxations of Optimal Power Flow Problems
Authors:
Martin S. Andersen,
Anders Hansson,
Lieven Vandenberghe
Abstract:
We propose a new method for generating semidefinite relaxations of optimal power flow problems. The method is based on chordal conversion techniques: by dropping some equality constraints in the conversion, we obtain semidefinite relaxations that are computationally cheaper, but potentially weaker, than the standard semidefinite relaxation. Our numerical results show that the new relaxations often…
▽ More
We propose a new method for generating semidefinite relaxations of optimal power flow problems. The method is based on chordal conversion techniques: by dropping some equality constraints in the conversion, we obtain semidefinite relaxations that are computationally cheaper, but potentially weaker, than the standard semidefinite relaxation. Our numerical results show that the new relaxations often produce the same results as the standard semidefinite relaxation, but at a lower computational cost.
△ Less
Submitted 6 December, 2013; v1 submitted 30 August, 2013;
originally announced August 2013.
-
Generalized Row-Action Methods for Tomographic Imaging
Authors:
Martin S. Andersen,
Per Christian Hansen
Abstract:
Row-action methods play an important role in tomographic image reconstruction. Many such methods can be viewed as incremental gradient methods for minimizing a sum of a large number of convex functions, and despite their relatively poor global rate of convergence, these methods often exhibit fast initial convergence which is desirable in applications where a low-accuracy solution is acceptable. In…
▽ More
Row-action methods play an important role in tomographic image reconstruction. Many such methods can be viewed as incremental gradient methods for minimizing a sum of a large number of convex functions, and despite their relatively poor global rate of convergence, these methods often exhibit fast initial convergence which is desirable in applications where a low-accuracy solution is acceptable. In this paper, we propose relaxed variants of a class of incremental proximal gradient methods, and these variants generalize many existing row-action methods for tomographic imaging. Moreover, they allow us to derive new incremental algorithms for tomographic imaging that incorporate different types of prior information via regularization. We demonstrate the efficacy of the approach with some numerical examples.
△ Less
Submitted 2 November, 2013; v1 submitted 2 July, 2013;
originally announced July 2013.
-
Distributed Solutions for Loosely Coupled Feasibility Problems Using Proximal Splitting Methods
Authors:
Sina Khoshfetrat Pakazad,
Martin S. Andersen,
Anders Hansson
Abstract:
In this paper, we consider convex feasibility problems where the underlying sets are loosely coupled, and we propose several algorithms to solve such problems in a distributed manner. These algorithms are obtained by applying proximal splitting methods to convex minimization reformulations of convex feasibility problems. We also put forth distributed convergence tests which enable us to establish…
▽ More
In this paper, we consider convex feasibility problems where the underlying sets are loosely coupled, and we propose several algorithms to solve such problems in a distributed manner. These algorithms are obtained by applying proximal splitting methods to convex minimization reformulations of convex feasibility problems. We also put forth distributed convergence tests which enable us to establish feasibility or infeasibility of the problem distributedly, and we provide convergence rate results. Under the assumption that the problem is feasible and boundedly linearly regular, these convergence results are given in terms of the distance of the iterates to the feasible set, which are similar to those of classical projection methods. In case the feasibility problem is infeasible, we provide convergence rate results that concern the convergence of certain error-bounds.
△ Less
Submitted 28 June, 2013;
originally announced June 2013.
-
Decomposition in conic optimization with partially separable structure
Authors:
Yifan Sun,
Martin S. Andersen,
Lieven Vandenberghe
Abstract:
Decomposition techniques for linear programming are difficult to extend to conic optimization problems with general non-polyhedral convex cones because the conic inequalities introduce an additional nonlinear coupling between the variables. However in many applications the convex cones have a partially separable structure that allows them to be characterized in terms of simpler lower-dimensional c…
▽ More
Decomposition techniques for linear programming are difficult to extend to conic optimization problems with general non-polyhedral convex cones because the conic inequalities introduce an additional nonlinear coupling between the variables. However in many applications the convex cones have a partially separable structure that allows them to be characterized in terms of simpler lower-dimensional cones. The most important example is sparse semidefinite programming with a chordal sparsity pattern. Here partial separability derives from the clique decomposition theorems that characterize positive semidefinite and positive-semidefinite-completable matrices with chordal sparsity patterns. The paper describes a decomposition method that exploits partial separability in conic linear optimization. The method is based on Spingarn's method for equality constrained convex optimization, combined with a fast interior-point method for evaluating proximal operators.
△ Less
Submitted 31 May, 2013;
originally announced June 2013.
-
Distributed Robust Stability Analysis of Interconnected Uncertain Systems
Authors:
Martin S. Andersen,
Anders Hansson,
Sina Khoshfetrat Pakazad,
Anders Rantzer
Abstract:
This paper considers robust stability analysis of a large network of interconnected uncertain systems. To avoid analyzing the entire network as a single large, lumped system, we model the network interconnections with integral quadratic constraints. This approach yields a sparse linear matrix inequality which can be decomposed into a set of smaller, coupled linear matrix inequalities. This allows…
▽ More
This paper considers robust stability analysis of a large network of interconnected uncertain systems. To avoid analyzing the entire network as a single large, lumped system, we model the network interconnections with integral quadratic constraints. This approach yields a sparse linear matrix inequality which can be decomposed into a set of smaller, coupled linear matrix inequalities. This allows us to solve the analysis problem efficiently and in a distributed manner. We also show that the decomposed problem is equivalent to the original robustness analysis problem, and hence our method does not introduce additional conservativeness.
△ Less
Submitted 6 November, 2012;
originally announced November 2012.
-
Logarithmic barriers for sparse matrix cones
Authors:
Martin S. Andersen,
Joachim Dahl,
Lieven Vandenberghe
Abstract:
Algorithms are presented for evaluating gradients and Hessians of logarithmic barrier functions for two types of convex cones: the cone of positive semidefinite matrices with a given sparsity pattern, and its dual cone, the cone of sparse matrices with the same pattern that have a positive semidefinite completion. Efficient large-scale algorithms for evaluating these barriers and their derivatives…
▽ More
Algorithms are presented for evaluating gradients and Hessians of logarithmic barrier functions for two types of convex cones: the cone of positive semidefinite matrices with a given sparsity pattern, and its dual cone, the cone of sparse matrices with the same pattern that have a positive semidefinite completion. Efficient large-scale algorithms for evaluating these barriers and their derivatives are important in interior-point methods for nonsymmetric conic formulations of sparse semidefinite programs. The algorithms are based on the multifrontal method for sparse Cholesky factorization.
△ Less
Submitted 13 March, 2012;
originally announced March 2012.
