-
Catch Me If You Can: Deep Meta-RL for Search-and-Rescue using LoRa UAV Networks
Authors:
Mehdi Naderi Soorki,
Hossein Aghajari,
Sajad Ahmadinabi,
Hamed Bakhtiari Babadegani,
Christina Chaccour,
Walid Saad
Abstract:
Long range (LoRa) wireless networks have been widely proposed as a efficient wireless access networks for the battery-constrained Internet of Things (IoT) devices. In many practical search-and-rescue (SAR) operations, one challenging problem is finding the location of devices carried by a lost person. However, using a LoRa-based IoT network for SAR operations will have a limited coverage caused by…
▽ More
Long range (LoRa) wireless networks have been widely proposed as a efficient wireless access networks for the battery-constrained Internet of Things (IoT) devices. In many practical search-and-rescue (SAR) operations, one challenging problem is finding the location of devices carried by a lost person. However, using a LoRa-based IoT network for SAR operations will have a limited coverage caused by high signal attenuation due to the terrestrial blockages especially in highly remote areas. To overcome this challenge, the use of unmanned aerial vehicles (UAVs) as a flying LoRa gateway to transfer messages from ground LoRa nodes to the ground rescue station can be a promising solution. In this paper, the problem of the flying LoRa (FL) gateway control in the search-and-rescue system using the UAV-assisted LoRa network is modeled as a partially observable Markov decision process. Then, a deep meta-RL-based policy is proposed to control the FL gateway trajectory during SAR operation. For initialization of proposed deep meta-RL-based policy, first, a deep RL-based policy is designed to determine the adaptive FL gateway trajectory in a fixed search environment including a fixed radio geometry. Then, as a general solution, a deep meta-RL framework is used for SAR in any new and unknown environments to integrate the prior FL gateway experience with information collected from the other search environments and rapidly adapt the SAR policy model for SAR operation in a new environment. The proposed UAV-assisted LoRa network is then experimentally designed and implemented. Practical evaluation results show that if the deep meta-RL based control policy is applied instead of the deep RL-based one, the number of SAR time slots decreases from 141 to 50.
△ Less
Submitted 12 June, 2023; v1 submitted 5 June, 2023;
originally announced June 2023.
-
Joint User Association and UAV Location Optimization for Two-Tired Visible Light Communication Networks
Authors:
Alireza Qazavi,
Foroogh S Tabataba,
Mehdi Naderi Soorki
Abstract:
In this paper, an unmanned aerial vehicle (UAVs)-assisted visible light communication (VLC) has been considered which has two tiers: UAV-to-centroid and device-to-device (D2D). In the UAV-to-centroid tier, each UAV can simultaneously provide communications and illumination for the centroids of the ground users over VLC links. In the D2D tier, the centroids retransmit received data from UAV over D2…
▽ More
In this paper, an unmanned aerial vehicle (UAVs)-assisted visible light communication (VLC) has been considered which has two tiers: UAV-to-centroid and device-to-device (D2D). In the UAV-to-centroid tier, each UAV can simultaneously provide communications and illumination for the centroids of the ground users over VLC links. In the D2D tier, the centroids retransmit received data from UAV over D2D links to the cluster members. For network, the optimization problem of joint user association and deployment location of UAVs is formulated to maximize the received data, satisfy illumination constraint, and the user cluster size. An iterative algorithm is first proposed to transform the optimization problem into a series of two interdependent sub problems. Following the smallest enclosing disk theorem, a random incremental construction method is designed to find the optimal UAV locations. Then, inspired by unsupervised learning method, a clustering algorithm to find a suboptimal user association is proposed. Our simulation results show that the proposed scheme on average guarantees the users brightness 0.77 lux more than their threshold requirements. Moreover, the received bitrate plus number of D2D connected users under our proposed method is 50.69% more than the scenario in which we have RF Link instead of VLC link and do not optimize UAV location.
△ Less
Submitted 2 June, 2023;
originally announced June 2023.
-
Dynamic Reflections: Optimizing Energy Efficiency in Multi-IRS Empowered Green Networks
Authors:
Alireza Qazavi Khorasgani,
Foroogh S. Tabataba,
Mehdi Naderi Soorki,
Mohammad Sadegh Fazel
Abstract:
Intelligent Reflecting Surface (IRS) technology is revolutionizing wireless communications by shifting from channel adaptation to a responsive wireless environment. This paper introduces a multi-IRS assisted millimeter wave (mm-wave) system, allowing intelligent on/off control of individual IRS elements. Our objective is to optimize energy efficiency under Quality of Service (QoS) constraints. We…
▽ More
Intelligent Reflecting Surface (IRS) technology is revolutionizing wireless communications by shifting from channel adaptation to a responsive wireless environment. This paper introduces a multi-IRS assisted millimeter wave (mm-wave) system, allowing intelligent on/off control of individual IRS elements. Our objective is to optimize energy efficiency under Quality of Service (QoS) constraints. We propose an algorithm where the Access Point (AP) adjusts transmit beamforming, and IRS elements control phaseshifts and on/off status until convergence. Utilizing a fractional programming (FP) approach for AP beamforming and Simulated Annealing (SA) for IRS subproblems, we achieve a suboptimum optimal solution. A modified nested FP approach addresses the beamforming subproblem. Performance analysis in a practical scenario reveals a significant up to 132.16\% improvement in energy efficiency compared to scenarios with randomly selected IRS on/off status. This highlights the efficacy of our algorithm in enhancing mm-wave communication systems' overall efficiency.
△ Less
Submitted 2 January, 2024; v1 submitted 14 February, 2023;
originally announced February 2023.
-
Resource Allocation for mmWave-NOMA Communication through Multiple Access Points Considering Human Blockages
Authors:
Foad Barghikar,
Foroogh S. Tabataba,
Mehdi Naderi Soorki
Abstract:
In this paper, a new framework for optimizing the resource allocation in a millimeter-wave-non-orthogonal multiple access (mmWave-NOMA) communication for crowded venues is proposed. MmWave communications suffer from severe blockage caused by obstacles such as the human body, especially in a dense region. Thus, a detailed method for modeling the blockage events in the in-venue scenarios is introduc…
▽ More
In this paper, a new framework for optimizing the resource allocation in a millimeter-wave-non-orthogonal multiple access (mmWave-NOMA) communication for crowded venues is proposed. MmWave communications suffer from severe blockage caused by obstacles such as the human body, especially in a dense region. Thus, a detailed method for modeling the blockage events in the in-venue scenarios is introduced. Also, several mmWave access points are considered in different locations. To maximize the network sum rate, the resource allocation problem is formulated as a mixed integer non-linear programming, which is NP-hard in general. Hence, a three-stage low-complex solution is proposed to solve the problem. At first, a user scheduling algorithm, i.e., modified worst connection swapping (MWCS), is proposed. Secondly, the antenna allocation problem is solved using the simulated annealing algorithm. Afterward, to maximize the network sum rate and guarantee the quality of service constraints, a non-convex power allocation optimization problem is solved by adopting the difference of convex programming approach. The simulation results show that, under the blockage effect, the proposed mmWave-NOMA scheme performs on average 23% better than the conventional mmWave-orthogonal multiple access scheme. Moreover, the performance of proposed solution is 11.4% lower than the optimal value while reducing complexity by 96%.
△ Less
Submitted 11 October, 2020; v1 submitted 27 May, 2020;
originally announced May 2020.
-
Risk-Based Optimization of Virtual Reality over Terahertz Reconfigurable Intelligent Surfaces
Authors:
Christina Chaccour,
Mehdi Naderi Soorki,
Walid Saad,
Mehdi Bennis,
Petar Popovski
Abstract:
In this paper, the problem of associating reconfigurable intelligent surfaces (RISs) to virtual reality (VR) users is studied for a wireless VR network. In particular, this problem is considered within a cellular network that employs terahertz (THz) operated RISs acting as base stations. To provide a seamless VR experience, high data rates and reliable low latency need to be continuously guarantee…
▽ More
In this paper, the problem of associating reconfigurable intelligent surfaces (RISs) to virtual reality (VR) users is studied for a wireless VR network. In particular, this problem is considered within a cellular network that employs terahertz (THz) operated RISs acting as base stations. To provide a seamless VR experience, high data rates and reliable low latency need to be continuously guaranteed. To address these challenges, a novel risk-based framework based on the entropic value-at-risk is proposed for rate optimization and reliability performance. Furthermore, a Lyapunov optimization technique is used to reformulate the problem as a linear weighted function, while ensuring that higher order statistics of the queue length are maintained under a threshold. To address this problem, given the stochastic nature of the channel, a policy-based reinforcement learning (RL) algorithm is proposed. Since the state space is extremely large, the policy is learned through a deep-RL algorithm. In particular, a recurrent neural network (RNN) RL framework is proposed to capture the dynamic channel behavior and improve the speed of conventional RL policy-search algorithms. Simulation results demonstrate that the maximal queue length resulting from the proposed approach is only within 1% of the optimal solution. The results show a high accuracy and fast convergence for the RNN with a validation accuracy of 91.92%.
△ Less
Submitted 20 February, 2020;
originally announced February 2020.
