-
Multi-Armed Bandit Learning in IoT Networks: Learning helps even in non-stationary settings
Authors:
Rémi Bonnefoi,
Lilian Besson,
Christophe Moy,
Emilie Kaufmann,
Jacques Palicot
Abstract:
Setting up the future Internet of Things (IoT) networks will require to support more and more communicating devices. We prove that intelligent devices in unlicensed bands can use Multi-Armed Bandit (MAB) learning algorithms to improve resource exploitation. We evaluate the performance of two classical MAB learning algorithms, UCB1 and Thompson Sampling, to handle the decentralized decision-making…
▽ More
Setting up the future Internet of Things (IoT) networks will require to support more and more communicating devices. We prove that intelligent devices in unlicensed bands can use Multi-Armed Bandit (MAB) learning algorithms to improve resource exploitation. We evaluate the performance of two classical MAB learning algorithms, UCB1 and Thompson Sampling, to handle the decentralized decision-making of Spectrum Access, applied to IoT networks; as well as learning performance with a growing number of intelligent end-devices. We show that using learning algorithms does help to fit more devices in such networks, even when all end-devices are intelligent and are dynamically changing channel. In the studied scenario, stochastic MAB learning provides a up to 16% gain in term of successful transmission probabilities, and has near optimal performance even in non-stationary and non-i.i.d. settings with a majority of intelligent devices.
△ Less
Submitted 2 July, 2018;
originally announced July 2018.
-
On Spectral Coexistence of CP-OFDM and FB-MC Waveforms in 5G Networks
Authors:
Quentin Bodinier,
Faouzi Bader,
Jacques Palicot
Abstract:
Future 5G networks will serve a variety of applications that will coexist on the same spectral band and geographical area, in an uncoordinated and asynchronous manner. It is widely accepted that using CP-OFDM, the waveform used by most current communication systems, will make it difficult to achieve this paradigm. Especially, CP-OFDM is not adapted for spectral coexistence because of its poor spec…
▽ More
Future 5G networks will serve a variety of applications that will coexist on the same spectral band and geographical area, in an uncoordinated and asynchronous manner. It is widely accepted that using CP-OFDM, the waveform used by most current communication systems, will make it difficult to achieve this paradigm. Especially, CP-OFDM is not adapted for spectral coexistence because of its poor spectral localization. Therefore, it has been widely suggested to use filter bank based multi carrier (FB-MC) waveforms with enhanced spectral localization to replace CP-OFDM. Especially, FB-MC waveforms are expected to facilitate coexistence with legacy CP-OFDM based systems. However, this idea is based on the observation of the PSD of FB-MC waveforms only. In this paper, we demonstrate that this approach is flawed and show what metric should be used to rate interference between FB-MC and CP-OFDM systems. Finally, our results show that using FB-MC waveforms does not facilitate coexistence with CP-OFDM based systems to a high extent.
△ Less
Submitted 23 January, 2017;
originally announced January 2017.
-
Coexistence of Filter Banks and CP-OFDM: What are the Real Gains?
Authors:
Quentin Bodinier,
Faouzi Bader,
Jacques Palicot
Abstract:
A coexistence scenario between filter bank (FB) based waveforms and legacy Cyclic Prefix-Orthogonal Frequency Division Multiplexing (CP-OFDM) is studied. It is shown that studies available on that matter use a wrong metric to rate the interference between the coexisting systems. Specifically, it is shown that even well spectrally localized FB waveforms interfere at a high level with incumbent CP-O…
▽ More
A coexistence scenario between filter bank (FB) based waveforms and legacy Cyclic Prefix-Orthogonal Frequency Division Multiplexing (CP-OFDM) is studied. It is shown that studies available on that matter use a wrong metric to rate the interference between the coexisting systems. Specifically, it is shown that even well spectrally localized FB waveforms interfere at a high level with incumbent CP-OFDM receivers. The presented results invalidate a number of studies in the literature, which stated that FB based waveforms could be very efficiently used to insert communications in parts of spectrum left free by incumbent legacy CP-OFDM users.
△ Less
Submitted 6 September, 2016;
originally announced September 2016.
-
Coexistence in 5G: Analysis of Cross-Interference between OFDM/OQAM and Legacy Users
Authors:
Quentin Bodinier,
Faouzi Bader,
Jacques Palicot
Abstract:
To optimize the use of the spectrum, it is expected that the next generation of wireless networks (5G) will enable coexistence of newly introduced services with legacy cellular networks. These new services, like Device-To-Device (D2D) communication, should require limited synchronization with the legacy cell to limit the amount of signaling overhead in the network. However, it is known that Cyclic…
▽ More
To optimize the use of the spectrum, it is expected that the next generation of wireless networks (5G) will enable coexistence of newly introduced services with legacy cellular networks. These new services, like Device-To-Device (D2D) communication, should require limited synchronization with the legacy cell to limit the amount of signaling overhead in the network. However, it is known that Cyclic Prefix-Orthogonal Frequency Division Multiplexing (CP-OFDM) used in Long Term Evolution-Advanced (LTE-A) is not fit for asynchronous environments. This has motivated the search for a new waveform, able to enhance coexistence with CP-OFDM. Namely, it has been widely suggested that new devices could use OFDM/Offset-Quadrature Amplitude Modulation (OFDM/OQAM) to reduce the interference they inject to legacy cellular users. However, values of interference are usually measured at the input antenna of the receiver, based on the PSD of the interfering signal. We showed in previous works that this measurement is not representative of the actual interference that is seen after the demodulation operations. Building on this finding, we provide in this paper the first exact closed forms of cross-interference between OFDM/OQAM and CP-OFDM users. Our results prove that using OFDM/OQAM only marginally reduces interference to legacy users, in contradiction with many results in the literature.
△ Less
Submitted 8 September, 2016; v1 submitted 6 September, 2016;
originally announced September 2016.
-
Modeling Interference Between OFDM/OQAM and CP-OFDM: Limitations of the PSD-Based Model
Authors:
Quentin Bodinier,
Faouzi Bader,
Jacques Palicot
Abstract:
To answer the challenges put out by the next generation of wireless networks (5G), important research efforts have been undertaken during the last few years to find new waveforms that are better spectrally localized and less sensitive to asynchronism effects than the widely deployed Cyclic Prefix Orthogonal Frequency Division Multiplexing (CP-OFDM). One of the most studied schemes is OFDM-Offset Q…
▽ More
To answer the challenges put out by the next generation of wireless networks (5G), important research efforts have been undertaken during the last few years to find new waveforms that are better spectrally localized and less sensitive to asynchronism effects than the widely deployed Cyclic Prefix Orthogonal Frequency Division Multiplexing (CP-OFDM). One of the most studied schemes is OFDM-Offset Quadrature Amplitude Modulation (OFDM/OQAM) based on the PHYDYAS filter pulse. In the recent literature, spectrum coexistence between OFDM/OQAM and CP-OFDM is commonly studied based on the Power Spectral Density (PSD) model. In this paper, we show that this approach is flawed and we show that the actual interference injected by OFDM/OQAM systems onto CP-OFDM is much higher than what is classically expected with the PSD based model in the literature. We show that though using OFDM/OQAM in secondary systems is still advantageous, it brings limited gain in the context of coexistence with incumbent CP-OFDM systems.
△ Less
Submitted 29 March, 2016;
originally announced March 2016.
-
Cognitive Green Radio for Energy-Aware Communications
Authors:
Malek Naoues,
Quentin Bodinier,
Jacques Palicot
Abstract:
In 5G networks, the number of connected devices, data rate and data volume per area, as well as the variety of QoS requirements, will attain unprecedented scales. The achievement of these goals will rely on new technologies and disruptive changes in network architecture and node design. Energy efficiency is believed to play a key role in complementing the 5G technologies and optimizing their deplo…
▽ More
In 5G networks, the number of connected devices, data rate and data volume per area, as well as the variety of QoS requirements, will attain unprecedented scales. The achievement of these goals will rely on new technologies and disruptive changes in network architecture and node design. Energy efficiency is believed to play a key role in complementing the 5G technologies and optimizing their deployment, dynamic configuration and management [1]. Within the framework of green communications and networks, especially for next-generation green cellular radio access networks, the GREAT (Green Cognitive Radio for Energy-Aware wireless communication Technologies evolution) initiative, a CominLabs Excellence Center (Laboratoire d'Excellence) and Université Européenne de Bretagne (UEB)project, has mainly addressed the fundamental issues of energy efficiency from various perspectives and angles, leveraging on cognitive techniques, at networking level as well as at thephysical layer level.
△ Less
Submitted 10 March, 2016;
originally announced March 2016.
-
5G Waveforms for Overlay D2D Communications: Effects of Time-Frequency Misalignment
Authors:
Quentin Bodinier,
Arman Farhang,
Faouzi Bader,
Hamed Ahmadi,
Jacques Palicot,
Luiz A. DaSilva
Abstract:
This paper analyses a scenario where a Device-To-Device (D2D) pair coexists with an Orthogonal Frequency Division Multiplexing (OFDM) based incumbent network. D2D transmitter communicates in parts of spectrum left free by cellular users, while respecting a given spectral mask. The D2D pair is misaligned in time and frequency with the cellular users. Furthermore, the D2D pair utilizes alternative w…
▽ More
This paper analyses a scenario where a Device-To-Device (D2D) pair coexists with an Orthogonal Frequency Division Multiplexing (OFDM) based incumbent network. D2D transmitter communicates in parts of spectrum left free by cellular users, while respecting a given spectral mask. The D2D pair is misaligned in time and frequency with the cellular users. Furthermore, the D2D pair utilizes alternative waveforms to OFDM proposed for 5G. In this study, we show that it is not worth synchronising the D2D pair in time with respect to the cellular users. Indeed, the interference injected into the incumbent network has small variations with respect to time misalignment. We provide interference tables that encompass both time and frequency misalignment. We use them to analyse the maximum rate achievable by the D2D pair when it uses different waveforms. Then, we present numerical results showing what waveform should be utilized by the D2D pair according to the time-frequency resources that are not used by the incumbent network. Our results show that the delay induced by linearly convolved waveforms make them hardly applicable to short time windows, but that they dominate OFDM for long transmissions, mainly in the case where cellular users are very sensitive to interference.
△ Less
Submitted 2 February, 2016;
originally announced February 2016.
-
On Improving Energy Efficiency within Green Femtocell Networks: A Hierarchical Reinforcement Learning Approach
Authors:
Xianfu Chen,
Honggang Zhang,
Tao Chen,
Mika Lasanen,
Jacques Palicot
Abstract:
One of the efficient solutions of improving coverage and increasing capacity in cellular networks is the deployment of femtocells. As the cellular networks are becoming more complex, energy consumption of whole network infrastructure is becoming important in terms of both operational costs and environmental impacts. This paper investigates energy efficiency of two-tier femtocell networks through c…
▽ More
One of the efficient solutions of improving coverage and increasing capacity in cellular networks is the deployment of femtocells. As the cellular networks are becoming more complex, energy consumption of whole network infrastructure is becoming important in terms of both operational costs and environmental impacts. This paper investigates energy efficiency of two-tier femtocell networks through combining game theory and stochastic learning. With the Stackelberg game formulation, a hierarchical reinforcement learning framework is applied for studying the joint expected utility maximization of macrocells and femtocells subject to the minimum signal-to-interference-plus-noise-ratio requirements. In the learning procedure, the macrocells act as leaders and the femtocells are followers. At each time step, the leaders commit to dynamic strategies based on the best responses of the followers, while the followers compete against each other with no further information but the leaders' transmission parameters. In this paper, we propose two reinforcement learning based intelligent algorithms to schedule each cell's stochastic power levels. Numerical experiments are presented to validate the investigations. The results show that the two learning algorithms substantially improve the energy efficiency of the femtocell networks.
△ Less
Submitted 13 March, 2013;
originally announced March 2013.
-
TACT: A Transfer Actor-Critic Learning Framework for Energy Saving in Cellular Radio Access Networks
Authors:
Rongpeng Li,
Zhifeng Zhao,
Xianfu Chen,
Jacques Palicot,
Honggang Zhang
Abstract:
Recent works have validated the possibility of improving energy efficiency in radio access networks (RANs), achieved by dynamically turning on/off some base stations (BSs). In this paper, we extend the research over BS switching operations, which should match up with traffic load variations. Instead of depending on the dynamic traffic loads which are still quite challenging to precisely forecast,…
▽ More
Recent works have validated the possibility of improving energy efficiency in radio access networks (RANs), achieved by dynamically turning on/off some base stations (BSs). In this paper, we extend the research over BS switching operations, which should match up with traffic load variations. Instead of depending on the dynamic traffic loads which are still quite challenging to precisely forecast, we firstly formulate the traffic variations as a Markov decision process. Afterwards, in order to foresightedly minimize the energy consumption of RANs, we design a reinforcement learning framework based BS switching operation scheme. Furthermore, to avoid the underlying curse of dimensionality in reinforcement learning, a transfer actor-critic algorithm (TACT), which utilizes the transferred learning expertise in historical periods or neighboring regions, is proposed and provably converges. In the end, we evaluate our proposed scheme by extensive simulations under various practical configurations and show that the proposed TACT algorithm contributes to a performance jumpstart and demonstrates the feasibility of significant energy efficiency improvement at the expense of tolerable delay performance.
△ Less
Submitted 4 April, 2014; v1 submitted 28 November, 2012;
originally announced November 2012.
