-
Convex Reformulation of LMI-Based Distributed Controller Design with a Class of Non-Block-Diagonal Lyapunov Functions
Authors:
Yuto Watanabe,
Sotaro Fushimi,
Kazunori Sakurama
Abstract:
This study addresses a distributed state feedback controller design problem for continuous-time linear time-invariant systems by means of linear matrix inequalities (LMI). As the exact convexification is still open, the block-diagonal relaxation of Lyapunov functions has been prevalent despite its conservatism. In this work, we target a class of non-block-diagonal Lyapunov functions that has the s…
▽ More
This study addresses a distributed state feedback controller design problem for continuous-time linear time-invariant systems by means of linear matrix inequalities (LMI). As the exact convexification is still open, the block-diagonal relaxation of Lyapunov functions has been prevalent despite its conservatism. In this work, we target a class of non-block-diagonal Lyapunov functions that has the same sparsity as distributed controllers. By leveraging a block-diagonal factorization of sparse matrices and Finsler's lemma, we first present a (nonlinear) matrix inequality for stabilizing distributed controllers with such Lyapunov functions, which boils down to a necessary and sufficient condition for such controllers if the sparsity pattern is chordal. As a relaxation of the inequality, we derive an LMI that completely covers the conventional relaxation and then provide analogous results for $H_\infty$ control. Lastly, numerical examples underscore the efficacy of our results.
△ Less
Submitted 8 April, 2024; v1 submitted 6 April, 2024;
originally announced April 2024.
-
Distributed Optimization of Clique-Wise Coupled Problems via Three-Operator Splitting
Authors:
Yuto Watanabe,
Kazunori Sakurama
Abstract:
This study explores distributed optimization problems with clique-wise coupling via operator splitting and how we can utilize this framework for performance analysis and enhancement. This framework extends beyond conventional pairwise coupled problems (e.g., consensus optimization) and is applicable to broader examples. To this end, we first introduce a new distributed optimization algorithm by le…
▽ More
This study explores distributed optimization problems with clique-wise coupling via operator splitting and how we can utilize this framework for performance analysis and enhancement. This framework extends beyond conventional pairwise coupled problems (e.g., consensus optimization) and is applicable to broader examples. To this end, we first introduce a new distributed optimization algorithm by leveraging a clique-based matrix and the Davis-Yin splitting (DYS), a versatile three-operator splitting method. We then demonstrate that this approach sheds new light on conventional algorithms in the following way: (i) Existing algorithms (NIDS, Exact diffusion, diffusion, and our previous work) can be derived from our proposed method; (ii) We present a new mixing matrix based on clique-wise coupling, which surfaces when deriving the NIDS. We prove its preferable distribution of eigenvalues, enabling fast consensus; (iii) These observations yield a new linear convergence rate for the NIDS with non-smooth objective functions. Remarkably our linear rate is first established for the general DYS with a projection for a subspace. This case is not covered by any prior results, to our knowledge. Finally, numerical examples showcase the efficacy of our proposed approach.
△ Less
Submitted 9 October, 2024; v1 submitted 28 October, 2023;
originally announced October 2023.
-
Distributed Optimization of Clique-wise Coupled Problems
Authors:
Yuto Watanabe,
Kazunori Sakurama
Abstract:
This study addresses a distributed optimization with a novel class of coupling of variables, called clique-wise coupling.
A clique is a node set of a complete subgraph of an undirected graph.
This setup is an extension of pairwise coupled optimization problems (e.g., consensus optimization) and allows us to handle coupling of variables consisting of more than two agents systematically.
To so…
▽ More
This study addresses a distributed optimization with a novel class of coupling of variables, called clique-wise coupling.
A clique is a node set of a complete subgraph of an undirected graph.
This setup is an extension of pairwise coupled optimization problems (e.g., consensus optimization) and allows us to handle coupling of variables consisting of more than two agents systematically.
To solve this problem, we propose a clique-based linearized ADMM algorithm, which is proved to be distributed.
Additionally, we consider objective functions given as a sum of nonsmooth and smooth convex functions and present a more flexible algorithm based on the FLiP-ADMM algorithm.
Moreover, we provide convergence theorems of these algorithms.
Notably, all the algorithmic parameters and the derived condition in the theorems depend only on local information, which means that each agent can choose the parameters in a distributed manner.
Finally, we apply the proposed methods to a consensus optimization problem and demonstrate their effectiveness via numerical experiments.
△ Less
Submitted 21 April, 2023;
originally announced April 2023.
-
Accelerated Distributed Projected Gradient Descent for Convex Optimization with Clique-wise Coupled Constraints
Authors:
Yuto Watanabe,
Kazunori Sakurama
Abstract:
This paper addresses a distributed convex optimization problem with a class of coupled constraints, which arise in a multi-agent system composed of multiple communities modeled by cliques. First, we propose a fully distributed gradient-based algorithm with a novel operator inspired by the convex projection, called the clique-based projection. Next, we scrutinize the convergence properties for both…
▽ More
This paper addresses a distributed convex optimization problem with a class of coupled constraints, which arise in a multi-agent system composed of multiple communities modeled by cliques. First, we propose a fully distributed gradient-based algorithm with a novel operator inspired by the convex projection, called the clique-based projection. Next, we scrutinize the convergence properties for both diminishing and fixed step sizes. For diminishing ones, we show the convergence to an optimal solution under the assumptions of the smoothness of an objective function and the compactness of the constraint set. Additionally, when the objective function is strongly monotone, the strict convergence to the unique solution is proved without the assumption of compactness. For fixed step sizes, we prove the non-ergodic convergence rate of O(1/k) concerning the objective residual under the assumption of the smoothness of the objective function. Furthermore, we apply Nesterov's acceleration method to the proposed algorithm and establish the convergence rate of O(1/k^2). Numerical experiments illustrate the effectiveness of the proposed method.
△ Less
Submitted 18 November, 2022; v1 submitted 11 November, 2022;
originally announced November 2022.
-
Multiple sparsity constrained control node scheduling with application to rebalancing of mobility networks
Authors:
Takuya Ikeda,
Kazunori Sakurama,
Kenji Kashima
Abstract:
This paper treats an optimal scheduling problem of control nodes in networked systems. We newly introduce both the L0 and l0 constraints on control inputs to extract a time-varying small number of effective control nodes. As the cost function, we adopt the trace of the controllability Gramian to reduce the required control energy. Since the formulated optimization problem is combinatorial, we intr…
▽ More
This paper treats an optimal scheduling problem of control nodes in networked systems. We newly introduce both the L0 and l0 constraints on control inputs to extract a time-varying small number of effective control nodes. As the cost function, we adopt the trace of the controllability Gramian to reduce the required control energy. Since the formulated optimization problem is combinatorial, we introduce a convex relaxation problem for its computational tractability. After a reformulation of the problem into an optimal control problem to which Pontryagin's maximum principle is applicable, we give a sufficient condition under which the relaxed problem gives a solution of the main problem. Finally, the proposed method is applied to a rebalancing problem of a mobility network.
△ Less
Submitted 28 August, 2021;
originally announced August 2021.
