-
A Fast Row-Stochastic Decentralized Method for Distributed Optimization Over Directed Graphs
Authors:
Diyako Ghaderyan,
Necdet Serhat Aybat,
A. Pedro Aguiar,
Fernando Lobo Pereira
Abstract:
In this paper, we introduce a fast row-stochastic decentralized algorithm, referred to as FRSD, to solve consensus optimization problems over directed communication graphs. The proposed algorithm only utilizes row-stochastic weights, leading to certain practical advantages in broadcast communication settings over those requiring column-stochastic weights. Under the assumption that each node-specif…
▽ More
In this paper, we introduce a fast row-stochastic decentralized algorithm, referred to as FRSD, to solve consensus optimization problems over directed communication graphs. The proposed algorithm only utilizes row-stochastic weights, leading to certain practical advantages in broadcast communication settings over those requiring column-stochastic weights. Under the assumption that each node-specific function is smooth and strongly convex, we show that the FRSD iterate sequence converges with a linear rate to the optimal consensus solution. In contrast to the existing methods for directed networks, FRSD enjoys linear convergence without employing a gradient tracking (GT) technique explicitly, rather it implements GT implicitly with the use of a novel momentum term, which leads to a significant reduction in communication and storage overhead for each node when FRSD is implemented for solving high-dimensional problems over small-to-medium scale networks. In the numerical tests, we compare FRSD with other state-of-the-art methods, which use row-stochastic and/or column-stochastic weights.
△ Less
Submitted 28 September, 2023; v1 submitted 25 December, 2021;
originally announced December 2021.
-
A Maximum Principle for a Time-Optimal Bilevel Sweeping Control Problem
Authors:
Nathalie T. Khalil,
Fernando Lobo Pereira
Abstract:
In this article, we investigate a time-optimal state-constrained bilevel optimal control problem whose lower-level dynamics feature a sweeping control process involving a {\it truncated normal cone}. By bilevel, it is meant that the optimization of the upper level problem is carried out over the solution set of the lower level problem.This problem instance arises in structured crowd motion control…
▽ More
In this article, we investigate a time-optimal state-constrained bilevel optimal control problem whose lower-level dynamics feature a sweeping control process involving a {\it truncated normal cone}. By bilevel, it is meant that the optimization of the upper level problem is carried out over the solution set of the lower level problem.This problem instance arises in structured crowd motion control problems in a confined space. We establish the corresponding necessary optimality conditions in the Gamkrelidze's form. The analysis relies on the {\it smooth approximation} of the lower level sweeping control system, thereby dealing with the resulting lack of Lipschitzianity with respect to the state variable inherent to the sweeping process, and on the {\it flattening} of the bilevel structure via an exact penalization technique. Necessary conditions of optimality in the Gamkrelidze's form are applied to the resulting standard approximating penalized state-constrained single-level problem, and the main result of this article is obtained by passing to the limit.
△ Less
Submitted 6 January, 2022; v1 submitted 17 September, 2021;
originally announced September 2021.
-
Feedback maximum principle for ensemble control of local continuity equations. An application to supervised machine learning
Authors:
Maxim Staritsyn,
Nikolay Pogodaev,
Roman Chertovskih,
Fernando Lobo Pereira
Abstract:
We consider an optimal control problem for a system of local continuity equations on a space of probability measures. Such systems can be viewed as macroscopic models of ensembles of non-interacting particles or homotypic individuals, representing several different ``populations''. For the stated problem, we propose a necessary optimality condition, which involves feedback controls inherent to the…
▽ More
We consider an optimal control problem for a system of local continuity equations on a space of probability measures. Such systems can be viewed as macroscopic models of ensembles of non-interacting particles or homotypic individuals, representing several different ``populations''. For the stated problem, we propose a necessary optimality condition, which involves feedback controls inherent to the extremal structure, designed via the standard Pontryagin's Maximum Principle conditions. This optimality condition admits a realization as an iterative algorithm for optimal control. As a motivating case, we discuss an application of the derived optimality condition and the consequent numeric method to a problem of supervised machine learning via dynamic systems.
△ Less
Submitted 10 May, 2021;
originally announced May 2021.
-
Optimization of Controlled Free-Time Sweeping Processes with Applications to Marine Surface Vehicle Modeling
Authors:
Tan H. Cao,
Nathalie T. Khalil,
Boris S. Mordukhovich,
Dao Nguyen,
Trang Nguyen,
Fernando Lobo Pereira
Abstract:
The paper is devoted to a free-time optimal control problem for sweeping processes. We develop a constructive finite-difference approximation procedure that allows us to establish necessary optimality conditions for discrete optimal solutions and then show how these optimality conditions are applied to solving a controlled marine surface vehicle model.
The paper is devoted to a free-time optimal control problem for sweeping processes. We develop a constructive finite-difference approximation procedure that allows us to establish necessary optimality conditions for discrete optimal solutions and then show how these optimality conditions are applied to solving a controlled marine surface vehicle model.
△ Less
Submitted 7 May, 2021;
originally announced May 2021.
-
Crowd motion paradigm modeled by a bilevel sweeping control problem
Authors:
Tan H. Cao,
Nathalie T. Khalil,
Boris S. Mordukhovich,
Dao Nguyen,
Fernando Lobo Pereira
Abstract:
This article concerns an optimal crowd motion control problem in which the crowd features a structure given by its organization into N groups (participants) each one spatially confined in a set. The overall optimal control problem consists in driving the ensemble of sets as close as possible to a given point (the 'exit') while the population in each set minimizes its control effort subject to its…
▽ More
This article concerns an optimal crowd motion control problem in which the crowd features a structure given by its organization into N groups (participants) each one spatially confined in a set. The overall optimal control problem consists in driving the ensemble of sets as close as possible to a given point (the 'exit') while the population in each set minimizes its control effort subject to its sweeping dynamics with a controlled state dependent velocity drift. In order to capture the conflict between the goal of the overall population and those of the various groups, the problem is cast as a bilevel optimization framework. A key challenge of this problem consists in bringing together two quite different paradigms: bilevel programming and sweeping dynamics with a controlled drift. Necessary conditions of optimality in the form of a Maximum Principle of Pontryagin in the Gamkrelidze framework are derived. These conditions are then used to solve a simple illustrative example with two participants, emphasizing the interaction between them.
△ Less
Submitted 19 April, 2021;
originally announced April 2021.
-
Regular path-constrained time-optimal control problems in three-dimensional flow fields
Authors:
Roman Chertovskih,
Dmitry Karamzin,
Nathalie T. Khalil,
Fernando Lobo Pereira
Abstract:
This article concerns a class of time-optimal state constrained control problems with dynamics defined by an ordinary differential equation involving a three-dimensional steady flow vector field. The problem is solved via an indirect method based on the maximum principle in Gamkrelidze's form. The proposed computational method essentially uses a certain regularity condition imposed on the data of…
▽ More
This article concerns a class of time-optimal state constrained control problems with dynamics defined by an ordinary differential equation involving a three-dimensional steady flow vector field. The problem is solved via an indirect method based on the maximum principle in Gamkrelidze's form. The proposed computational method essentially uses a certain regularity condition imposed on the data of the problem. The property of regularity guarantees the continuity of the measure multiplier associated with the state constraint, and ensures the appropriate behavior of the corresponding numerical procedure which, in general, consists in computing the entire field of extremals for the problem in question. Several examples of vector fields are considered to illustrate the computational approach.
△ Less
Submitted 10 July, 2019;
originally announced July 2019.
-
Time-Optimal Control Problem With State Constraints In A Time-Periodic Flow Field
Authors:
Roman Chertovskih,
Nathalie T. Khalil,
Fernando Lobo Pereira
Abstract:
This article contributes to a framework for a computational indirect method based on the Pontryagin maximum principle to efficiently solve a class of state constrained time-optimal control problems in the presence of a time-dependent flow field. Path-planning in a flow with tidal variations is an emblematic real-life task that serves as an example falling in the class of problems considered here.…
▽ More
This article contributes to a framework for a computational indirect method based on the Pontryagin maximum principle to efficiently solve a class of state constrained time-optimal control problems in the presence of a time-dependent flow field. Path-planning in a flow with tidal variations is an emblematic real-life task that serves as an example falling in the class of problems considered here. Under rather natural assumptions on the flow field, the problem is regular and the measure Lagrange multiplier, associated with the state constraint, is continuous. These properties (regularity and continuity) play a critical role in computing the field of extremals by solving the two-point boundary value problem given by the maximum principle. Moreover, some sufficient conditions preventing the emergence of singular control processes are given. A couple of examples of time-periodic fluid flows are studied and the corresponding optimal solutions are found.
△ Less
Submitted 10 June, 2019;
originally announced June 2019.
-
An indirect numerical method for a time-optimal state-constrained control problem in a steady two-dimensional fluid flow
Authors:
Roman Chertovskih,
Nathalie T. Khalil,
Dmitry Karamzin,
Fernando Lobo Pereira
Abstract:
This article concerns the problem of computing solutions to state-constrained optimal control problems whose trajectory is affected by a flow field. This general mathematical framework is particularly pertinent to the requirements underlying the control of Autonomous Underwater Vehicles in realistic scenarii. The key contribution consists in devising a computational indirect method which becomes e…
▽ More
This article concerns the problem of computing solutions to state-constrained optimal control problems whose trajectory is affected by a flow field. This general mathematical framework is particularly pertinent to the requirements underlying the control of Autonomous Underwater Vehicles in realistic scenarii. The key contribution consists in devising a computational indirect method which becomes effective in the numerical computation of extremals to optimal control problems with state constraints by using the maximum principle in Gamkrelidze's form in which the measure Lagrange multiplier is ensured to be continuous. The specific problem of time-optimal control of an Autonomous Underwater Vehicle in a bounded space set, subject to the effect of a flow field and with bounded actuation, is used to illustrate the proposed approach. The corresponding numerical results are presented and discussed.
△ Less
Submitted 29 November, 2018; v1 submitted 19 October, 2018;
originally announced October 2018.
-
A new approach to the Pontryagin maximum principle for nonlinear fractional optimal control problems
Authors:
H. M. Ali,
F. Lobo Pereira,
S. M. A. Gama
Abstract:
In this paper, we discuss a new general formulation of fractional optimal control problems whose performance index is in the fractional integral form and the dynamics are given by a set of fractional differential equations in the Caputo sense. We use a new approach to prove necessary conditions of optimality in the form of Pontryagin maximum principle for fractional nonlinear optimal control probl…
▽ More
In this paper, we discuss a new general formulation of fractional optimal control problems whose performance index is in the fractional integral form and the dynamics are given by a set of fractional differential equations in the Caputo sense. We use a new approach to prove necessary conditions of optimality in the form of Pontryagin maximum principle for fractional nonlinear optimal control problems. Moreover, a new method based on a generalization of the Mittag-Leffler function is used to solving this class of fractional optimal control problems. A simple example is provided to illustrate the effectiveness of our main result.
△ Less
Submitted 10 April, 2015; v1 submitted 26 March, 2015;
originally announced March 2015.
