-
Learning Power Control from a Fixed Batch of Data
Authors:
Mohammad G. Khoshkholgh,
Halim Yanikomeroglu
Abstract:
We address how to exploit power control data, gathered from a monitored environment, for performing power control in an unexplored environment. We adopt offline deep reinforcement learning, whereby the agent learns the policy to produce the transmission powers solely by using the data. Experiments demonstrate that despite discrepancies between the monitored and unexplored environments, the agent s…
▽ More
We address how to exploit power control data, gathered from a monitored environment, for performing power control in an unexplored environment. We adopt offline deep reinforcement learning, whereby the agent learns the policy to produce the transmission powers solely by using the data. Experiments demonstrate that despite discrepancies between the monitored and unexplored environments, the agent successfully learns the power control very quickly, even if the objective functions in the monitored and unexplored environments are dissimilar. About one third of the collected data is sufficient to be of high-quality and the rest can be from any sub-optimal algorithm.
△ Less
Submitted 4 August, 2020;
originally announced August 2020.
-
A Vision and Framework for the High Altitude Platform Station (HAPS) Networks of the Future
Authors:
Gunes Kurt,
Mohammad G. Khoshkholgh,
Safwan Alfattani,
Ahmed Ibrahim,
Tasneem S. J. Darwish,
Md Sahabul Alam,
Halim Yanikomeroglu,
Abbas Yongacoglu
Abstract:
A High Altitude Platform Station (HAPS) is a network node that operates in the stratosphere at an of altitude around 20 km and is instrumental for providing communication services. Precipitated by technological innovations in the areas of autonomous avionics, array antennas, solar panel efficiency levels, and battery energy densities, and fueled by flourishing industry ecosystems, the HAPS has eme…
▽ More
A High Altitude Platform Station (HAPS) is a network node that operates in the stratosphere at an of altitude around 20 km and is instrumental for providing communication services. Precipitated by technological innovations in the areas of autonomous avionics, array antennas, solar panel efficiency levels, and battery energy densities, and fueled by flourishing industry ecosystems, the HAPS has emerged as an indispensable component of next-generations of wireless networks. In this article, we provide a vision and framework for the HAPS networks of the future supported by a comprehensive and state-of-the-art literature review. We highlight the unrealized potential of HAPS systems and elaborate on their unique ability to serve metropolitan areas. The latest advancements and promising technologies in the HAPS energy and payload systems are discussed. The integration of the emerging Reconfigurable Smart Surface (RSS) technology in the communications payload of HAPS systems for providing a cost-effective deployment is proposed. A detailed overview of the radio resource management in HAPS systems is presented along with synergistic physical layer techniques, including Faster-Than-Nyquist (FTN) signaling. Numerous aspects of handoff management in HAPS systems are described. The notable contributions of Artificial Intelligence (AI) in HAPS, including machine learning in the design, topology management, handoff, and resource allocation aspects are emphasized. The extensive overview of the literature we provide is crucial for substantiating our vision that depicts the expected deployment opportunities and challenges in the next 10 years (next-generation networks), as well as in the subsequent 10 years (next-next-generation networks).
△ Less
Submitted 17 March, 2021; v1 submitted 29 July, 2020;
originally announced July 2020.
-
Energy-Efficient Cooperative Caching in UAV Networks
Authors:
Mohammad G. Khoshkholgh,
Victor C. M. Leung
Abstract:
For an unmanned aerial vehicle (UAV) enabled network we investigate the energy-efficiency (EE) of joint caching and cooperative communication (Fog-RAN). Since UAVs are battery- and cache-limited, placing the popular contents in the caches and managing the energy expenditure of UAVs become crucial. We formulate the energy consumption of UAVs as an aggregate of communication/caching, hovering, and v…
▽ More
For an unmanned aerial vehicle (UAV) enabled network we investigate the energy-efficiency (EE) of joint caching and cooperative communication (Fog-RAN). Since UAVs are battery- and cache-limited, placing the popular contents in the caches and managing the energy expenditure of UAVs become crucial. We formulate the energy consumption of UAVs as an aggregate of communication/caching, hovering, and vertical displacement energies, and then devise an optimization problem for optimally assigning contents to caches and choosing the height of UAVs. Adopting tools from stochastic geometry, we also derive the EE in a numerically tractable form as a function of density, the radius of the cooperation zone, cache size, main communication/physical characteristics of UAVs, and influential environmental parameters. We develop two content placement strategies with low computational complexity. The conducted numerical results demonstrate that by adopting these algorithms one is able to improve EE by up to 800% compared to common content placement schemes, e.g., the least-frequently used (LRU), the most-popular, and Hit-rate. Furthermore, while under LRU and Hit-rate schemes there is no benefit in vertically displacing UAVs, under our algorithms one is able to increase EE by at most 600%. Importantly, via our algorithms one can increase the size of cooperation zone in order to steadily increase EE, which is not the cases of LRU, the most-popular, and Hit-rate schemes. We finally observe that there is optimal values for density and cache-size of UAVs, granting maximum EE.
△ Less
Submitted 19 August, 2019;
originally announced August 2019.
