Showing 1–8 of 8 results for author: Nekouei, E

Survey of Distributed Algorithms for Resource Allocation over Multi-Agent Systems

Authors: Mohammadreza Doostmohammadian, Alireza Aghasi, Mohammad Pirani, Ehsan Nekouei, Houman Zarrabi, Reza Keypour, Apostolos I. Rikos, Karl H. Johansson

Abstract: Resource allocation and scheduling in multi-agent systems present challenges due to complex interactions and decentralization. This survey paper provides a comprehensive analysis of distributed algorithms for addressing the distributed resource allocation (DRA) problem over multi-agent systems. It covers a significant area of research at the intersection of optimization, multi-agent systems, and d… ▽ More Resource allocation and scheduling in multi-agent systems present challenges due to complex interactions and decentralization. This survey paper provides a comprehensive analysis of distributed algorithms for addressing the distributed resource allocation (DRA) problem over multi-agent systems. It covers a significant area of research at the intersection of optimization, multi-agent systems, and distributed consensus-based computing. The paper begins by presenting a mathematical formulation of the DRA problem, establishing a solid foundation for further exploration. Real-world applications of DRA in various domains are examined to underscore the importance of efficient resource allocation, and relevant distributed optimization formulations are presented. The survey then delves into existing solutions for DRA, encompassing linear, nonlinear, primal-based, and dual-formulation-based approaches. Furthermore, this paper evaluates the features and properties of DRA algorithms, addressing key aspects such as feasibility, convergence rate, and network reliability. The analysis of mathematical foundations, diverse applications, existing solutions, and algorithmic properties contributes to a broader comprehension of the challenges and potential solutions for this domain. △ Less

Submitted 28 January, 2024; originally announced January 2024.

Comments: Submitted to annual reviews in control

Memory-based Controllers for Efficient Data-driven Control of Soft Robots

Authors: Yuzhe Wu, Ehsan Nekouei

Abstract: Controller design for soft robots is challenging due to nonlinear deformation and high degrees of freedom of flexible material. The data-driven approach is a promising solution to the controller design problem for soft robots. However, the existing data-driven controller design methods for soft robots suffer from two drawbacks: (i) they require excessively long training time, and (ii) they may res… ▽ More Controller design for soft robots is challenging due to nonlinear deformation and high degrees of freedom of flexible material. The data-driven approach is a promising solution to the controller design problem for soft robots. However, the existing data-driven controller design methods for soft robots suffer from two drawbacks: (i) they require excessively long training time, and (ii) they may result in potentially inefficient controllers. This paper addresses these issues by developing two memory-based controllers for soft robots that can be trained in a data-driven fashion: the finite memory controller (FMC) approach and the long short-term memory (LSTM) based approach. An FMC stores the tracking errors at different time instances and computes the actuation signal according to a weighted sum of the stored tracking errors. We develop three reinforcement learning algorithms for computing the optimal weights of an FMC using the Q-learning, soft actor-critic, and deterministic policy gradient (DDPG) methods. An LSTM-based controller is composed of an LSTM network where the inputs of the network are the robot's desired configuration and current configuration. The LSTM network computes the required actuation signal for the soft robot to follow the desired configuration. We study the performance of the proposed approaches in controlling a soft finger where, as benchmarks, we use the existing reinforcement learning (RL) based controllers and proportional-integral-derivative (PID) controllers. Our numerical results show that the training time of the proposed memory-based controllers is significantly shorter than that of the classical RL-based controllers. Moreover, the proposed controllers achieve a smaller tracking error compared with the classical RL algorithms and the PID controller. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Fast-Convergent Dynamics for Distributed Allocation of Resources Over Switching Sparse Networks with Quantized Communication Links

Authors: Mohammadreza Doostmohammadian, Alireza Aghasi, Mohammad Pirani, Ehsan Nekouei, Usman A. Khan, Themistoklis Charalambous

Abstract: This paper proposes networked dynamics to solve resource allocation problems over time-varying multi-agent networks. The state of each agent represents the amount of used resources (or produced utilities) while the total amount of resources is fixed. The idea is to optimally allocate the resources among the group of agents by minimizing the overall cost function subject to fixed sum of resources.… ▽ More This paper proposes networked dynamics to solve resource allocation problems over time-varying multi-agent networks. The state of each agent represents the amount of used resources (or produced utilities) while the total amount of resources is fixed. The idea is to optimally allocate the resources among the group of agents by minimizing the overall cost function subject to fixed sum of resources. Each agents' information is restricted to its own state and cost function and those of its immediate in-neighbors. This is motivated by distributed applications such as mobile edge-computing, economic dispatch over smart grids, and multi-agent coverage control. This work provides a fast convergent solution (in comparison with linear dynamics) while considering relaxed network connectivity with quantized communication links. The proposed dynamics reaches optimal solution over switching (possibly disconnected) undirected networks as far as their union over some bounded non-overlapping time-intervals has a spanning-tree. We prove feasibility of the solution, uniqueness of the optimal state, and convergence to the optimal value under the proposed dynamics, where the analysis is applicable to similar 1st-order allocation dynamics with strongly sign-preserving nonlinearities, such as actuator saturation. △ Less

Submitted 25 July, 2022; v1 submitted 15 December, 2020; originally announced December 2020.

Comments: ECC2022

An Entropy Power Inequality for Discrete Random Variables

Authors: Ehsan Nekouei, Mikael Skoglund, Karl Henrik Johansson

Abstract: Let $\mathsf{N}_{\rm d}\left[X\right]=\frac{1}{2π{\rm e}}{\rm e}^{2\mathsf{H}\left[X\right]}$ denote the entropy power of the discrete random variable $X$ where $\mathsf{H}\left[X\right]$ denotes the discrete entropy of $X$. In this paper, we show that for two independent discrete random variables $X$ and $Y$, the entropy power inequality… ▽ More Let $\mathsf{N}_{\rm d}\left[X\right]=\frac{1}{2π{\rm e}}{\rm e}^{2\mathsf{H}\left[X\right]}$ denote the entropy power of the discrete random variable $X$ where $\mathsf{H}\left[X\right]$ denotes the discrete entropy of $X$. In this paper, we show that for two independent discrete random variables $X$ and $Y$, the entropy power inequality $\mathsf{N}_{\rm d}\left[X\right]+\mathsf{N}_{\rm d}\left[Y\right]\leq 2 \mathsf{N}_{\rm d}\left[X+Y\right]$ holds and it can be tight. The basic idea behind the proof is to perturb the discrete random variables using suitably designed continuous random variables. Then, the continuous entropy power inequality is applied to the sum of the perturbed random variables and the resulting lower bound is optimized. △ Less

Submitted 8 May, 2019; originally announced May 2019.

Lower Bounds on the Complexity of Solving Two Classes of Non-cooperative Games

Authors: Ehsan Nekouei, Girish N. Nair, Tansu Alpcan, Robin J. Evans

Abstract: This paper studies the complexity of solving two classes of non-cooperative games in a distributed manner in which the players communicate with a set of system nodes over noisy communication channels. The complexity of solving each game class is defined as the minimum number of iterations required to find a Nash equilibrium (NE) of any game in that class with $ε$ accuracy. First, we consider the c… ▽ More This paper studies the complexity of solving two classes of non-cooperative games in a distributed manner in which the players communicate with a set of system nodes over noisy communication channels. The complexity of solving each game class is defined as the minimum number of iterations required to find a Nash equilibrium (NE) of any game in that class with $ε$ accuracy. First, we consider the class $\mathcal{G}$ of all $N$-player non-cooperative games with a continuous action space that admit at least one NE. Using information-theoretic inequalities, we derive a lower bound on the complexity of solving $\mathcal{G}$ that depends on the Kolmogorov $2ε$-capacity of the constraint set and the total capacity of the communication channels. We also derive a lower bound on the complexity of solving games in $\mathcal{G}$ which depends on the volume and surface area of the constraint set. We next consider the class of all $N$-player non-cooperative games with at least one NE such that the players' utility functions satisfy a certain (differential) constraint. We derive lower bounds on the complexity of solving this game class under both Gaussian and non-Gaussian noise models. Our result in the non-Gaussian case is derived by establishing a connection between the Kullback-Leibler distance and Fisher information. △ Less

Submitted 23 January, 2017; originally announced January 2017.

Distributed Cognitive Multiple Access Networks: Power Control, Scheduling and Multiuser Diversity

Authors: Ehsan Nekouei, Hazer Inaltekin, Subhrakanti Dey

Abstract: This paper studies optimal distributed power allocation and scheduling policies (DPASPs) for distributed total power and interference limited (DTPIL) cognitive multiple access networks in which secondary users (SU) independently perform power allocation and scheduling tasks using their local knowledge of secondary transmitter secondary base-station (STSB) and secondary transmitter primary base-sta… ▽ More This paper studies optimal distributed power allocation and scheduling policies (DPASPs) for distributed total power and interference limited (DTPIL) cognitive multiple access networks in which secondary users (SU) independently perform power allocation and scheduling tasks using their local knowledge of secondary transmitter secondary base-station (STSB) and secondary transmitter primary base-station (STPB) channel gains. In such networks, transmission powers of SUs are limited by an average total transmission power constraint and by a constraint on the average interference power that SUs cause to the primary base-station. We first establish the joint optimality of water-filling power allocation and threshold-based scheduling policies for DTPIL networks. We then show that the secondary network throughput under the optimal DPASP scales according to $\frac{1}{\e{}n_h}\log\logp{N}$, where $n_h$ is a parameter obtained from the distribution of STSB channel power gains and $N$ is the total number of SUs. From a practical point of view, our results signify the fact that distributed cognitive multiple access networks are capable of harvesting multiuser diversity gains without employing centralized schedulers and feedback links as well as without disrupting primary's quality-of-service (QoS) △ Less

Submitted 13 April, 2013; originally announced April 2013.

Comments: arXiv admin note: substantial text overlap with arXiv:1209.1426

Power Control and Multiuser Diversity for the Distributed Cognitive Uplink

Authors: Ehsan Nekouei, Hazer Inaltekin, Subhrakanti Dey

Abstract: This paper studies optimum power control and sum-rate scaling laws for the distributed cognitive uplink. It is first shown that the optimum distributed power control policy is in the form of a threshold based water-filling power control. Each secondary user executes the derived power control policy in a distributed fashion by using local knowledge of its direct and interference channel gains such… ▽ More This paper studies optimum power control and sum-rate scaling laws for the distributed cognitive uplink. It is first shown that the optimum distributed power control policy is in the form of a threshold based water-filling power control. Each secondary user executes the derived power control policy in a distributed fashion by using local knowledge of its direct and interference channel gains such that the resulting aggregate (average) interference does not disrupt primary's communication. Then, the tight sum-rate scaling laws are derived as a function of the number of secondary users $N$ under the optimum distributed power control policy. The fading models considered to derive sum-rate scaling laws are general enough to include Rayleigh, Rician and Nakagami fading models as special cases. When transmissions of secondary users are limited by both transmission and interference power constraints, it is shown that the secondary network sum-rate scales according to $\frac{1}{\e{}n_h}\log\logp{N}$, where $n_h$ is a parameter obtained from the distribution of direct channel power gains. For the case of transmissions limited only by interference constraints, on the other hand, the secondary network sum-rate scales according to $\frac{1}{\e{}γ_g}\logp{N}$, where $γ_g$ is a parameter obtained from the distribution of interference channel power gains. These results indicate that the distributed cognitive uplink is able to achieve throughput scaling behavior similar to that of the centralized cognitive uplink up to a pre-log multiplier $\frac{1}{\e{}}$, whilst primary's quality-of-service requirements are met. The factor $\frac{1}{\e{}}$ can be interpreted as the cost of distributed implementation of the cognitive uplink. △ Less

Submitted 6 April, 2013; v1 submitted 6 September, 2012; originally announced September 2012.

Multiuser Diversity for the Cognitive Uplink with Generalized Fading and Reduced Primary's Cooperation

Authors: Ehsan Nekouei, Hazer Inaltekin, Subhrakanti Dey

Abstract: In cognitive multiple access networks, feedback is an important mechanism to convey secondary transmitter primary base station (STPB) channel gains from the primary base station (PBS) to the secondary base station (SBS). This paper investigates the optimal sum-rate capacity scaling laws for cognitive multiple access networks in feedback limited communication scenarios. First, an efficient feedback… ▽ More In cognitive multiple access networks, feedback is an important mechanism to convey secondary transmitter primary base station (STPB) channel gains from the primary base station (PBS) to the secondary base station (SBS). This paper investigates the optimal sum-rate capacity scaling laws for cognitive multiple access networks in feedback limited communication scenarios. First, an efficient feedback protocol called $K$-smallest channel gains ($K$-SCGs) feedback protocol is proposed in which the PBS feeds back the $\K$ smallest out of $N$ STPB channel gains to the SBS. Second, the sum-rate performance of the $K$-SCG feedback protocol is studied for three network types when transmission powers of secondary users (SUs) are optimally allocated. The network types considered are total-power-and-interference-limited (TPIL), interference-limited (IL) and individual-power-and-interference-limited (IPIL) networks. For each network type studied, we provide a sufficient condition on $\K$ such that the $K$-SCG feedback protocol is {\em asymptotically} optimal in the sense that the secondary network sum-rate scaling behavior under the $K$-SCG feedback protocol is the same with that under the full-feedback protocol. We allow distributions of secondary-transmitter-secondary-base-station (STSB), and STPB channel power gains to belong to a fairly general class of distributions called class $\mathcal{C}$-distributions that includes commonly used fading models. △ Less

Submitted 20 September, 2015; v1 submitted 6 September, 2012; originally announced September 2012.