-
Term-sparse polynomial optimization for the design of frame structures
Authors:
Marouan Handa,
Marek Tyburec,
Michal Kočvara
Abstract:
This work investigates an efficient solution to two fundamental problems in topology optimization of frame structures. The first one involves minimizing structural compliance under linear-elastic equilibrium and weight constraint, while the second one minimizes the weight under compliance constraints. These problems are non-convex and generally challenging to solve globally, with the non-convexity…
▽ More
This work investigates an efficient solution to two fundamental problems in topology optimization of frame structures. The first one involves minimizing structural compliance under linear-elastic equilibrium and weight constraint, while the second one minimizes the weight under compliance constraints. These problems are non-convex and generally challenging to solve globally, with the non-convexity concentrated in a polynomial matrix inequality. We solve these problems using the moment-sum-of-squares (mSOS) hierarchy and improve the scalability by enhancing (mSOS) with the Term Sparsity Pattern (TSP) technique. Additionally, we exploit the unique polynomial structure of our problems by adopting a reduced monomial basis containing only non-mixed terms. These modifications significantly enhance computational efficiency. Extensive numerical experiments demonstrate that our approach achieves global solutions for instances twice as large as those previously solved while substantially accelerating the solution process.
△ Less
Submitted 26 March, 2025;
originally announced March 2025.
-
On the numerical solution of Lasserre relaxations of unconstrained binary quadratic optimization problem
Authors:
Soodeh Habibi,
Michal Kocvara,
Michael Stingl
Abstract:
The aim of this paper is to solve linear semidefinite programs arising from higher-order Lasserre relaxations of unconstrained binary quadratic optimization problems. For this we use an interior point method with a preconditioned conjugate gradient method solving the linear systems. The preconditioner utilizes the low-rank structure of the solution of the relaxations. In order to fully exploit thi…
▽ More
The aim of this paper is to solve linear semidefinite programs arising from higher-order Lasserre relaxations of unconstrained binary quadratic optimization problems. For this we use an interior point method with a preconditioned conjugate gradient method solving the linear systems. The preconditioner utilizes the low-rank structure of the solution of the relaxations. In order to fully exploit this, we need to re-write the moment relaxations. To treat the arising linear equality constraints we use an $\ell_1$-penalty approach within the interior-point solver. The efficiency of this approach is demonstrated by numerical experiments with the MAXCUT and other randomly generated problems and a comparison with a state-of-the-art semidefinite solver and the ADMM method. We further propose a hybrid ADMM-interior-point method that proves to be efficient for certain problem classes. As a by-product, we observe that the second-order relaxation is often high enough to deliver a globally optimal solution of the original problem.
△ Less
Submitted 27 December, 2024;
originally announced December 2024.
-
On the role of semismoothness in the implicit programming approach to selected nonsmooth optimization problems
Authors:
Helmut Gfrerer,
Michal Kočvara,
Jiří V. Outrata
Abstract:
The paper deals with the implicit programming approach to a class of Mathematical Programs with Equilibrium Constraints (MPECs) and bilevel programs in the case when the corresponding reduced problems are solved using a bundle method of nonsmooth optimization. The results obtained allow us to supply the bundle algorithm with suitable, easily computable ``pseudogradients'', ensuring convergence to…
▽ More
The paper deals with the implicit programming approach to a class of Mathematical Programs with Equilibrium Constraints (MPECs) and bilevel programs in the case when the corresponding reduced problems are solved using a bundle method of nonsmooth optimization. The results obtained allow us to supply the bundle algorithm with suitable, easily computable ``pseudogradients'', ensuring convergence to points satisfying a stationary condition. Both the theory and computational implementation heavily rely on the notion of SCD (subspace containing derivatives) mappings and the associated calculus. The approach is validated via a complex MPEC with equilibrium governed by a variational inequality of the 2nd kind and by an academic bilevel program with a nonsmooth upper-level objective.
△ Less
Submitted 8 December, 2024;
originally announced December 2024.
-
Global weight optimization of frame structures under free-vibration eigenvalue constraints
Authors:
Marek Tyburec,
Michal Kočvara,
Marouan Handa,
Jan Zeman
Abstract:
Topology optimization of frame structures under free-vibration eigenvalue constraints constitutes a challenging nonconvex polynomial optimization problem with disconnected feasible sets. In this article, we first formulate it as a polynomial semidefinite programming problem (SDP) of minimizing a linear function over a basic semi-algebraic feasible set. We then propose to solve this problem by Lass…
▽ More
Topology optimization of frame structures under free-vibration eigenvalue constraints constitutes a challenging nonconvex polynomial optimization problem with disconnected feasible sets. In this article, we first formulate it as a polynomial semidefinite programming problem (SDP) of minimizing a linear function over a basic semi-algebraic feasible set. We then propose to solve this problem by Lasserre hierarchy of linear semidefinite relaxations providing a sequence of increasing lower bounds. To obtain also a sequence of upper bounds and thus conditions on global $\varepsilon$-optimality, we propose a novel technique. Namely, we provide a bilevel reformulation that exhibits a special structure: The lower level is quasiconvex univariate and its solution satisfies the constraints of the upper-level problem. After deriving the conditions for the solvability of the lower-level problem, we thus provide a way to construct feasible points to the original SDP. Using such a feasible point, we modify the original nonlinear SDP to satisfy the conditions for the deployment of the Lasserre hierarchy. Solving arbitrary degree relaxation of the hierarchy, we prove that scaled first-order moments associated with the problem variables satisfy feasibility conditions for the lower-level problem and thus provide guaranteed upper and lower bounds on the objective function. Using these bounds, we develop a simple sufficient condition for global $\varepsilon$-optimality and prove that the optimality gap $\varepsilon$ converges to zero if the set of global minimizers is convex. Finally, we illustrate these results with three representative problems for which the hierarchy converges in at most four relaxation degrees.
△ Less
Submitted 11 February, 2025; v1 submitted 14 May, 2024;
originally announced May 2024.
-
Global weight optimization of frame structures with polynomial programming
Authors:
Marek Tyburec,
Michal Kočvara,
Martin Kružík
Abstract:
Weight optimization of frame structures with continuous cross-section parametrization is a challenging non-convex problem that has traditionally been solved by local optimization techniques. Here, we exploit its inherent semi-algebraic structure and adopt the Lasserre hierarchy of relaxations to compute the global minimizers. While this hierarchy generates a natural sequence of lower bounds, we sh…
▽ More
Weight optimization of frame structures with continuous cross-section parametrization is a challenging non-convex problem that has traditionally been solved by local optimization techniques. Here, we exploit its inherent semi-algebraic structure and adopt the Lasserre hierarchy of relaxations to compute the global minimizers. While this hierarchy generates a natural sequence of lower bounds, we show, under mild assumptions, how to project the relaxed solutions onto the feasible set of the original problem and thus construct feasible upper bounds. Based on these bounds, we develop a simple sufficient condition of global $\varepsilon$-optimality. Finally, we prove that the optimality gap converges to zero in the limit if the set of global minimizers is convex. We demonstrate these results by means of two academic illustrations.
△ Less
Submitted 6 January, 2023; v1 submitted 25 November, 2022;
originally announced November 2022.
-
Partial Gradient Optimal Thresholding Algorithms for a Class of Sparse Optimization Problems
Authors:
Nan Meng,
Yun-Bin Zhao,
Michal Kocvara
Abstract:
The optimization problems with a sparsity constraint is a class of important global optimization problems. A typical type of thresholding algorithms for solving such a problem adopts the traditional full steepest descent direction or Newton-like direction as a search direction to generate an iterate on which a certain thresholding is performed. Traditional hard thresholding discards a large part o…
▽ More
The optimization problems with a sparsity constraint is a class of important global optimization problems. A typical type of thresholding algorithms for solving such a problem adopts the traditional full steepest descent direction or Newton-like direction as a search direction to generate an iterate on which a certain thresholding is performed. Traditional hard thresholding discards a large part of a vector when the vector is dense. Thus a large part of important information contained in a dense vector has been lost in such a thresholding process. Recent study [Zhao, SIAM J Optim, 30(1), pp. 31-55, 2020] shows that the hard thresholding should be applied to a compressible vector instead of a dense vector to avoid a big loss of information. On the other hand, the optimal $k$-thresholding as a novel thresholding technique may overcome the intrinsic drawback of hard thresholding, and performs thresholding and objective function minimization simultaneously. This motivates us to propose the so-called partial gradient optimal thresholding method in this paper, which is an integration of the partial gradient and the optimal $k$-thresholding technique. The solution error bound and convergence for the proposed algorithms have been established in this paper under suitable conditions. Application of our results to the sparse optimization problems arising from signal recovery is also discussed. Experiment results from synthetic data indicate that the proposed algorithm called PGROTP is efficient and comparable to several existing algorithms.
△ Less
Submitted 18 July, 2021; v1 submitted 9 July, 2021;
originally announced July 2021.
-
Barrier and penalty methods for low-rank semidefinite programming with application to truss topology design
Authors:
Soodeh Habibi,
Arefeh Kavand,
Michal Kocvara,
Michael Stingl
Abstract:
The aim of this paper is to solve large-and-sparse linear Semidefinite Programs (SDPs) with low-rank solutions. We propose to use a preconditioned conjugate gradient method within second-order SDP algorithms and introduce a new efficient preconditioner fully utilizing the low-rank information. We demonstrate that the preconditioner is universal, in the sense that it can be efficiently used within…
▽ More
The aim of this paper is to solve large-and-sparse linear Semidefinite Programs (SDPs) with low-rank solutions. We propose to use a preconditioned conjugate gradient method within second-order SDP algorithms and introduce a new efficient preconditioner fully utilizing the low-rank information. We demonstrate that the preconditioner is universal, in the sense that it can be efficiently used within a standard interior-point algorithm, as well as a newly developed primal-dual penalty method. The efficiency is demonstrated by numerical experiments using the truss topology optimization problems of growing dimension.
△ Less
Submitted 18 May, 2021;
originally announced May 2021.
-
Newton-type Multilevel Optimization Method
Authors:
Chin Pang Ho,
Michal Kocvara,
Panos Parpas
Abstract:
Inspired by multigrid methods for linear systems of equations, multilevel optimization methods have been proposed to solve structured optimization problems. Multilevel methods make more assumptions regarding the structure of the optimization model, and as a result, they outperform single-level methods, especially for large-scale models. The impressive performance of multilevel optimization methods…
▽ More
Inspired by multigrid methods for linear systems of equations, multilevel optimization methods have been proposed to solve structured optimization problems. Multilevel methods make more assumptions regarding the structure of the optimization model, and as a result, they outperform single-level methods, especially for large-scale models. The impressive performance of multilevel optimization methods is an empirical observation, and no theoretical explanation has so far been proposed. In order to address this issue, we study the convergence properties of a multilevel method that is motivated by second-order methods. We take the first step toward establishing how the structure of an optimization problem is related to the convergence rate of multilevel algorithms.
△ Less
Submitted 26 November, 2019;
originally announced November 2019.
-
Decomposition of arrow type positive semidefinite matrices with application to topology optimization
Authors:
Michal Kocvara
Abstract:
Decomposition of large matrix inequalities for matrices with chordal sparsity graph has been recently used by Kojima et al.\ \cite{kim2011exploiting} to reduce problem size of large scale semidefinite optimization (SDO) problems and thus increase efficiency of standard SDO software. A by-product of such a decomposition is the introduction of new dense small-size matrix variables. We will show that…
▽ More
Decomposition of large matrix inequalities for matrices with chordal sparsity graph has been recently used by Kojima et al.\ \cite{kim2011exploiting} to reduce problem size of large scale semidefinite optimization (SDO) problems and thus increase efficiency of standard SDO software. A by-product of such a decomposition is the introduction of new dense small-size matrix variables. We will show that for arrow type matrices satisfying suitable assumptions, the additional matrix variables have rank one and can thus be replaced by vector variables of the same dimensions. This leads to significant improvement in efficiency of standard SDO software. We will apply this idea to the problem of topology optimization formulated as a large scale linear semidefinite optimization problem. Numerical examples will demonstrate tremendous speed-up in the solution of the decomposed problems, as compared to the original large scale problem. In our numerical example the decomposed problems exhibit linear growth in complexity, compared to the more than cubic growth in the original problem formulation. We will also give a connection of our approach to the standard theory of domain decomposition and show that the additional vector variables are outcomes of the corresponding discrete Steklov-Poincaré operators.
△ Less
Submitted 21 November, 2019;
originally announced November 2019.
-
On barrier and modified barrier multigrid methods for 3d topology optimization
Authors:
Alexander Brune,
Michal Kocvara
Abstract:
One of the challenges encountered in optimization of mechanical structures, in particular in what is known as topology optimization, is the size of the problems, which can easily involve millions of variables. A basic example is the minimum compliance formulation of the variable thickness sheet (VTS) problem, which is equivalent to a convex problem. We propose to solve the VTS problem by the Penal…
▽ More
One of the challenges encountered in optimization of mechanical structures, in particular in what is known as topology optimization, is the size of the problems, which can easily involve millions of variables. A basic example is the minimum compliance formulation of the variable thickness sheet (VTS) problem, which is equivalent to a convex problem. We propose to solve the VTS problem by the Penalty-Barrier Multiplier (PBM) method, introduced by R.\ Polyak and later studied by Ben-Tal and Zibulevsky and others. The most computationally expensive part of the algorithm is the solution of linear systems arising from the Newton method used to minimize a generalized augmented Lagrangian. We use a special structure of the Hessian of this Lagrangian to reduce the size of the linear system and to convert it to a form suitable for a standard multigrid method. This converted system is solved approximately by a multigrid preconditioned MINRES method. The proposed PBM algorithm is compared with the optimality criteria (OC) method and an interior point (IP) method, both using a similar iterative solver setup. We apply all three methods to different loading scenarios. In our experiments, the PBM method clearly outperforms the other methods in terms of computation time required to achieve a certain degree of accuracy.
△ Less
Submitted 13 April, 2019;
originally announced April 2019.
-
A Subgradient Method for Free Material Design
Authors:
Michal Kocvara,
Yurii Nesterov,
Yu Xia
Abstract:
A small improvement in the structure of the material could save the manufactory a lot of money. The free material design can be formulated as an optimization problem. However, due to its large scale, second-order methods cannot solve the free material design problem in reasonable size. We formulate the free material optimization (FMO) problem into a saddle-point form in which the inverse of the st…
▽ More
A small improvement in the structure of the material could save the manufactory a lot of money. The free material design can be formulated as an optimization problem. However, due to its large scale, second-order methods cannot solve the free material design problem in reasonable size. We formulate the free material optimization (FMO) problem into a saddle-point form in which the inverse of the stiffness matrix A(E) in the constraint is eliminated. The size of A(E) is generally large, denoted as N by N. This is the first formulation of FMO without A(E). We apply the primal-dual subgradient method [17] to solve the restricted saddle-point formula. This is the first gradient-type method for FMO. Each iteration of our algorithm takes a total of $O(N^2)$ foating-point operations and an auxiliary vector storage of size O(N), compared with formulations having the inverse of A(E) which requires $O(N^3)$ arithmetic operations and an auxiliary vector storage of size $O(N^2)$. To solve the problem, we developed a closed-form solution to a semidefinite least squares problem and an efficient parameter update scheme for the gradient method, which are included in the appendix. We also approximate a solution to the bounded Lagrangian dual problem. The problem is decomposed into small problems each only having an unknown of k by k (k = 3 or 6) matrix, and can be solved in parallel. The iteration bound of our algorithm is optimal for general subgradient scheme. Finally we present promising numerical results.
△ Less
Submitted 2 July, 2016;
originally announced July 2016.
-
Primal-dual interior-point multigrid method for topology optimization
Authors:
Michal Kocvara,
Sudaba Mohammed
Abstract:
An interior point method for the structural topology optimization is proposed. The linear systems arising in the method are solved by the conjugate gradient method preconditioned by geometric multigrid. The resulting method is then compared with the so-called optimality condition method, an established technique in topology optimization. This method is also equipped with the multigrid precondition…
▽ More
An interior point method for the structural topology optimization is proposed. The linear systems arising in the method are solved by the conjugate gradient method preconditioned by geometric multigrid. The resulting method is then compared with the so-called optimality condition method, an established technique in topology optimization. This method is also equipped with the multigrid preconditioned conjugate gradient algorithm. We conclude that, for large scale problems, the interior point method with an inexact iterative linear solver is superior to any other variant studied in the paper.
△ Less
Submitted 20 June, 2016;
originally announced June 2016.
-
A first-order multigrid method for bound-constrained convex optimization
Authors:
Michal Kocvara,
Sudaba Mohammed
Abstract:
The aim of this paper is to design an efficient multigrid method for constrained convex optimization problems arising from discretization of some underlying infinite dimensional problems. Due to problem dependency of this approach, we only consider bound constraints with (possibly) a single equality constraint. As our aim is to target large-scale problems, we want to avoid computation of second de…
▽ More
The aim of this paper is to design an efficient multigrid method for constrained convex optimization problems arising from discretization of some underlying infinite dimensional problems. Due to problem dependency of this approach, we only consider bound constraints with (possibly) a single equality constraint. As our aim is to target large-scale problems, we want to avoid computation of second derivatives of the objective function, thus excluding Newton like methods. We propose a smoothing operator that only uses first-order information and study the computational efficiency of the resulting method.
△ Less
Submitted 11 February, 2016;
originally announced February 2016.
-
Constraint interface preconditioning for topology optimization problems
Authors:
Michal Kocvara,
Daniel Loghin,
James Turner
Abstract:
The discretization of constrained nonlinear optimization problems arising in the field of topology optimization yields algebraic systems which are challenging to solve in practice, due to pathological ill-conditioning, strong nonlinearity and size. In this work we propose a methodology which brings together existing fast algorithms, namely, interior-point for the optimization problem and a novel s…
▽ More
The discretization of constrained nonlinear optimization problems arising in the field of topology optimization yields algebraic systems which are challenging to solve in practice, due to pathological ill-conditioning, strong nonlinearity and size. In this work we propose a methodology which brings together existing fast algorithms, namely, interior-point for the optimization problem and a novel substructuring domain decomposition method for the ensuing large-scale linear systems. The main contribution is the choice of interface preconditioner which allows for the acceleration of the domain decomposition method, leading to performance independent of problem size.
△ Less
Submitted 15 October, 2015;
originally announced October 2015.
-
PENNON: Software for linear and nonlinear matrix inequalities
Authors:
Michal Kocvara,
Michael Stingl
Abstract:
The goal of this paper is to present an overview of the software collection for the solution of linear and nonlinear semidefinite optimization problems PENNON. In the first part we present theoretical and practical details of the underlying algorithm and several implementation issues. In the second part we introduce the particular codes PENSDP, PENBMI and PENNON, focus on some specific features of…
▽ More
The goal of this paper is to present an overview of the software collection for the solution of linear and nonlinear semidefinite optimization problems PENNON. In the first part we present theoretical and practical details of the underlying algorithm and several implementation issues. In the second part we introduce the particular codes PENSDP, PENBMI and PENNON, focus on some specific features of these codes and show how they can be used for the solution of selected problems.
△ Less
Submitted 28 April, 2015; v1 submitted 27 April, 2015;
originally announced April 2015.
-
Parallel Solution of the Linear Elasticity problem with Applications in Topology Optimization
Authors:
James Turner,
Michal Kocvara,
Daniel Loghin
Abstract:
In this paper, we aim to solve the system of equations governing linear elasticity in parallel using domain decomposition. Through a non-overlapping decomposition of the domain, our approach aims to target the resulting interface problem, allowing for the parallel computation of solutions in an efficient manner. As a major application of our work, we apply our results to the field of topology opti…
▽ More
In this paper, we aim to solve the system of equations governing linear elasticity in parallel using domain decomposition. Through a non-overlapping decomposition of the domain, our approach aims to target the resulting interface problem, allowing for the parallel computation of solutions in an efficient manner. As a major application of our work, we apply our results to the field of topology optimization, where typical solvers require repeated solutions of linear elasticity problems resulting from the use of a Picard approach.
△ Less
Submitted 28 January, 2015; v1 submitted 25 January, 2015;
originally announced January 2015.
-
PENLAB: A MATLAB solver for nonlinear semidefinite optimization
Authors:
Jan Fiala,
Michal Kočvara,
Michael Stingl
Abstract:
PENLAB is an open source software package for nonlinear optimization, linear and nonlinear semidefinite optimization and any combination of these. It is written entirely in MATLAB. PENLAB is a young brother of our code PENNON \cite{pennon} and of a new implementation from NAG \cite{naglib}: it can solve the same classes of problems and uses the same algorithm. Unlike PENNON, PENLAB is open source…
▽ More
PENLAB is an open source software package for nonlinear optimization, linear and nonlinear semidefinite optimization and any combination of these. It is written entirely in MATLAB. PENLAB is a young brother of our code PENNON \cite{pennon} and of a new implementation from NAG \cite{naglib}: it can solve the same classes of problems and uses the same algorithm. Unlike PENNON, PENLAB is open source and allows the user not only to solve problems but to modify various parts of the algorithm. As such, PENLAB is particularly suitable for teaching and research purposes and for testing new algorithmic ideas.
In this article, after a brief presentation of the underlying algorithm, we focus on practical use of the solver, both for general problem classes and for specific practical problems.
△ Less
Submitted 20 November, 2013;
originally announced November 2013.
-
On Robustness Criteria and Robust Topology Optimization with Uncertain Loads
Authors:
Michal Kocvara
Abstract:
We propose a new algorithm for the solution of the robust multiple-load topology optimization problem. The algorithm can be applied to any type of problem, e.g., truss topology, variable thickness sheet or free material optimization. We assume that the given loads are uncertain and can be subject to small random perturbations. Furthermore, we define a rigorous measure of robustness of the given de…
▽ More
We propose a new algorithm for the solution of the robust multiple-load topology optimization problem. The algorithm can be applied to any type of problem, e.g., truss topology, variable thickness sheet or free material optimization. We assume that the given loads are uncertain and can be subject to small random perturbations. Furthermore, we define a rigorous measure of robustness of the given design with respect to these perturbations. To implement the algorithm, the users only need software to solve their standard multiple-load problem. Additionally, they have to solve a few small-dimensional eigenvalue problems. Numerical examples demonstrate the efficiency of our approach.
△ Less
Submitted 29 July, 2013;
originally announced July 2013.
