-
PID-inspired Continuous-time Distributed Optimization
Authors:
Meng Tao,
Dongdong Yue,
Jinde Cao
Abstract:
This paper proposes two novel distributed continuous-time algorithms inspired by PID control to solve distributed optimization problems. The algorithms are referred to as first-order and second-order, respectively, depend on the intrinsic dynamics of the agents in the network. Sufficient conditions are derived so that both algorithms converge exponentially over undirected connected graphs. Finally…
▽ More
This paper proposes two novel distributed continuous-time algorithms inspired by PID control to solve distributed optimization problems. The algorithms are referred to as first-order and second-order, respectively, depend on the intrinsic dynamics of the agents in the network. Sufficient conditions are derived so that both algorithms converge exponentially over undirected connected graphs. Finally, numerical simulations illustrate the effectiveness and efficiency of the proposed algorithms.
△ Less
Submitted 8 November, 2023;
originally announced November 2023.
-
Byzantine-Resilient Multi-Agent Distributed Exact Optimization with Less Data
Authors:
Yang Zhai,
Zhi-Wei Liu,
Dong Yue,
Songlin Hu,
Xiangpeng Xie
Abstract:
This paper studies the distributed multi-agent resilient optimization problem under the f-total Byzantine attacks. Compared with the previous work on Byzantineresilient multi-agent exact optimization problems, we do not require the communication topology to be fully connected. Under the redundancy of cost functions, we propose the distributed comparative gradient elimination resilient optimization…
▽ More
This paper studies the distributed multi-agent resilient optimization problem under the f-total Byzantine attacks. Compared with the previous work on Byzantineresilient multi-agent exact optimization problems, we do not require the communication topology to be fully connected. Under the redundancy of cost functions, we propose the distributed comparative gradient elimination resilient optimization algorithm based on the traditional assumptions on strongly convex global costs and Lipschitz continuous gradients. Under this algorithm, we successfully prove that if the number of inneighbors of each normal agent is greater than some constant and the parameter f satisfies certain conditions, all normal agents' local estimations of the global variable will finally reach consensus and converge to the optimized solution. Finally, the numerical experiments successfully verify the correctness of the results.
△ Less
Submitted 28 March, 2023; v1 submitted 28 February, 2023;
originally announced February 2023.
-
Distributed stochastic subgradient-free algorithm for Nash equilibrium seeking in two-network zero-sum games
Authors:
Dandan Yue,
Ziyang Meng
Abstract:
This paper investigates the distributed Nash equilibrium seeking problem for two-network zero-sum games with set constraints, where the two networks have the opposite nonsmooth cost functions. The interaction of the agents in each network is characterized by an unbalanced directed graph. We are particularly interested in the case that the local cost function of each agent in the two networks is un…
▽ More
This paper investigates the distributed Nash equilibrium seeking problem for two-network zero-sum games with set constraints, where the two networks have the opposite nonsmooth cost functions. The interaction of the agents in each network is characterized by an unbalanced directed graph. We are particularly interested in the case that the local cost function of each agent in the two networks is unknown in this paper. We first construct the stochastic subgradient-free two-variable oracles based on the measurements of the local cost functions. Instead of using subgradients of the local cost functions, the subgradient-free two-variable oracles are employed to design the distributed algorithm for the agents to search the Nash equilibrium. Under the strong connectivity assumption, it is shown that the proposed algorithm guarantees that the states of all the agents converge almost surely to the neighborhood of the Nash equilibrium, where the scale of the neighborhood can be arbitrarily small by selecting suitable smooth parameter in the oracles. Numerical simulations are finally given to validate the theoretical results.
△ Less
Submitted 2 December, 2019;
originally announced December 2019.
-
A Projection-Based Reformulation and Decomposition Algorithm for Global Optimization of a Class of Mixed Integer Bilevel Linear Programs
Authors:
Dajun Yue,
Jiyao Gao,
Bo Zeng,
Fengqi You
Abstract:
We propose an extended variant of the reformulation and decomposition algorithm for solving a special class of mixed-integer bilevel linear programs (MIBLPs) where continuous and integer variables are involved in both upper- and lower-level problems. In particular, we consider MIBLPs with upper-level constraints that involve lower-level variables. We assume that the inducible region is nonempty an…
▽ More
We propose an extended variant of the reformulation and decomposition algorithm for solving a special class of mixed-integer bilevel linear programs (MIBLPs) where continuous and integer variables are involved in both upper- and lower-level problems. In particular, we consider MIBLPs with upper-level constraints that involve lower-level variables. We assume that the inducible region is nonempty and all variables are bounded. By using the reformulation and decomposition scheme, an MIBLP is first converted into its equivalent single-level formulation, then computed by a column-and-constraint generation based decomposition algorithm. The solution procedure is enhanced by a projection strategy that does not require the relatively complete response property. To ensure its performance, we prove that our new method converges to the global optimal solution in a finite number of iterations. A large-scale computational study on random instances and instances of hierarchical supply chain planning are presented to demonstrate the effectiveness of the algorithm.
△ Less
Submitted 2 July, 2018; v1 submitted 19 July, 2017;
originally announced July 2017.