-
Goal-Oriented Interference Coordination in 6G In-Factory Subnetworks
Authors:
Daniel Abode,
Pedro Maia de Sant Ana,
Ramoni Adeogun,
Alexander Artemenko,
Gilberto Berardinelli
Abstract:
Subnetworks are expected to enhance wireless pervasiveness for critical applications such as wireless control of plants, however, they are interference-limited due to their extreme density. This paper proposes a goal-oriented joint power and multiple sub-bands allocation policy for interference coordination in 6G in-factory subnetworks. Current methods for interference coordination in subnetworks…
▽ More
Subnetworks are expected to enhance wireless pervasiveness for critical applications such as wireless control of plants, however, they are interference-limited due to their extreme density. This paper proposes a goal-oriented joint power and multiple sub-bands allocation policy for interference coordination in 6G in-factory subnetworks. Current methods for interference coordination in subnetworks only focus on optimizing communication metrics, such as the block error rate, without considering the goal of the controlled plants. This oversight often leads to inefficient allocation of the limited radio resources. To address this, we devise a novel decentralized inter-subnetwork interference coordination policy optimized using a Bayesian framework to ensure the long-term stability of the subnetwork-controlled plants. Our results show that the proposed decentralized method can support more than twice the density of subnetwork-controlled plants compared to centralized schemes that aim to minimize the block error rate while reducing execution complexity significantly.
△ Less
Submitted 4 March, 2025;
originally announced March 2025.
-
Digital Twin for Autonomous Guided Vehicles based on Integrated Sensing and Communications
Authors:
Van-Phuc Bui,
Pedro Maia de Sant Ana,
Soheil Gherekhloo,
Shashi Raj Pandey,
Petar Popovski
Abstract:
This paper presents a Digital Twin (DT) framework for the remote control of an Autonomous Guided Vehicle (AGV) within a Network Control System (NCS). The AGV is monitored and controlled using Integrated Sensing and Communications (ISAC). In order to meet the real-time requirements, the DT computes the control signals and dynamically allocates resources for sensing and communication. A Reinforcemen…
▽ More
This paper presents a Digital Twin (DT) framework for the remote control of an Autonomous Guided Vehicle (AGV) within a Network Control System (NCS). The AGV is monitored and controlled using Integrated Sensing and Communications (ISAC). In order to meet the real-time requirements, the DT computes the control signals and dynamically allocates resources for sensing and communication. A Reinforcement Learning (RL) algorithm is derived to learn and provide suitable actions while adjusting for the uncertainty in the AGV's position. We present closed-form expressions for the achievable communication rate and the Cramer-Rao bound (CRB) to determine the required number of Orthogonal Frequency-Division Multiplexing (OFDM) subcarriers, meeting the needs of both sensing and communication. The proposed algorithm is validated through a millimeter-Wave (mmWave) simulation, demonstrating significant improvements in both control precision and communication efficiency.
△ Less
Submitted 12 September, 2024;
originally announced September 2024.
-
Timely Communication from Sensors for Wireless Networked Control in Cloud-Based Digital Twins
Authors:
Van-Phuc Bui,
Shashi Raj Pandey,
Pedro M. de Sant Ana,
Beatriz Soret,
Petar Popovski
Abstract:
We consider a Wireless Networked Control System (WNCS) where sensors provide observations to build a DT model of the underlying system dynamics. The focus is on control, scheduling, and resource allocation for sensory observation to ensure timely delivery to the DT model deployed in the cloud. \phuc{Timely and relevant information, as characterized by optimized data acquisition policy and low late…
▽ More
We consider a Wireless Networked Control System (WNCS) where sensors provide observations to build a DT model of the underlying system dynamics. The focus is on control, scheduling, and resource allocation for sensory observation to ensure timely delivery to the DT model deployed in the cloud. \phuc{Timely and relevant information, as characterized by optimized data acquisition policy and low latency, are instrumental in ensuring that the DT model can accurately estimate and predict system states. However, optimizing closed-loop control with DT and acquiring data for efficient state estimation and control computing pose a non-trivial problem given the limited network resources, partial state vector information, and measurement errors encountered at distributed sensing agents.} To address this, we propose the \emph{Age-of-Loop REinforcement learning and Variational Extended Kalman filter with Robust Belief (AoL-REVERB)}, which leverages an uncertainty-control reinforcement learning solution combined with an algorithm based on Value of Information (VoI) for performing optimal control and selecting the most informative sensors to satisfy the prediction accuracy of DT. Numerical results demonstrate that the DT platform can offer satisfactory performance while halving the communication overhead.
△ Less
Submitted 5 August, 2024;
originally announced August 2024.
-
Control-Aware Transmit Power Allocation for 6G In-Factory Subnetwork Control Systems
Authors:
Daniel Abode,
Pedro Maia de Sant Ana,
Alexander Artemenko,
Ramoni Adeogun,
Gilberto Berardinelli
Abstract:
In this paper, we develop a novel power control solution for subnetworks-enabled distributed control systems in factory settings. We propose a channel-independent control-aware (CICA) policy based on the logistic model and learn the parameters using Bayesian optimization with a multi-objective tree-structured Parzen estimator. The objective is to minimize the control cost of the plants, measured a…
▽ More
In this paper, we develop a novel power control solution for subnetworks-enabled distributed control systems in factory settings. We propose a channel-independent control-aware (CICA) policy based on the logistic model and learn the parameters using Bayesian optimization with a multi-objective tree-structured Parzen estimator. The objective is to minimize the control cost of the plants, measured as a finite horizon linear quadratic regulator cost. The proposed policy can be executed in a fully distributed manner and does not require cumbersome measurement of channel gain information, hence it is scalable for large-scale deployment of subnetworks for distributed control applications. With extensive numerical simulation and considering different densities of subnetworks, we show that the proposed method can achieve competitive stability performance and high availability for large-scale distributed control plants with limited radio resources.
△ Less
Submitted 18 May, 2024;
originally announced May 2024.
-
Digital Twin of Industrial Networked Control System based on Value of Information
Authors:
Van-Phuc Bui,
Daniel Abode,
Pedro M. de Sant Ana,
Karthik Muthineni,
Shashi Raj Pandey,
Petar Popovski
Abstract:
The paper examines a scenario wherein sensors are deployed within an Industrial Networked Control System, aiming to construct a digital twin (DT) model for a remotely operated Autonomous Guided Vehicle (AGV). The DT model, situated on a cloud platform, estimates and predicts the system's state, subsequently formulating the optimal scheduling strategy for execution in the physical world. However, a…
▽ More
The paper examines a scenario wherein sensors are deployed within an Industrial Networked Control System, aiming to construct a digital twin (DT) model for a remotely operated Autonomous Guided Vehicle (AGV). The DT model, situated on a cloud platform, estimates and predicts the system's state, subsequently formulating the optimal scheduling strategy for execution in the physical world. However, acquiring data crucial for efficient state estimation and control computation poses a significant challenge, primarily due to constraints such as limited network resources, partial observation, and the necessity to maintain a certain confidence level for DT estimation. We propose an algorithm based on Value of Information (VoI), seamlessly integrated with the Extended Kalman Filter to deliver a polynomial-time solution, selecting the most informative subset of sensing agents for data. Additionally, we put forth an alternative solution leveraging a Graph Neural Network to precisely ascertain the AGV's position with a remarkable accuracy of up to 5 cm. Our experimental validation in an industrial robotic laboratory environment yields promising results, underscoring the potential of high-accuracy DT models in practice.
△ Less
Submitted 23 April, 2024;
originally announced April 2024.
-
Value-Based Reinforcement Learning for Digital Twins in Cloud Computing
Authors:
Van-Phuc Bui,
Shashi Raj Pandey,
Pedro M. de Sant Ana,
Petar Popovski
Abstract:
The setup considered in the paper consists of sensors in a Networked Control System that are used to build a digital twin (DT) model of the system dynamics. The focus is on control, scheduling, and resource allocation for sensory observation to ensure timely delivery to the DT model deployed in the cloud. Low latency and communication timeliness are instrumental in ensuring that the DT model can a…
▽ More
The setup considered in the paper consists of sensors in a Networked Control System that are used to build a digital twin (DT) model of the system dynamics. The focus is on control, scheduling, and resource allocation for sensory observation to ensure timely delivery to the DT model deployed in the cloud. Low latency and communication timeliness are instrumental in ensuring that the DT model can accurately estimate and predict system states. However, acquiring data for efficient state estimation and control computing poses a non-trivial problem given the limited network resources, partial state vector information, and measurement errors encountered at distributed sensors. We propose the REinforcement learning and Variational Extended Kalman filter with Robust Belief (REVERB), which leverages a reinforcement learning solution combined with a Value of Information-based algorithm for performing optimal control and selecting the most informative sensors to satisfy the prediction accuracy of DT. Numerical results demonstrate that the DT platform can offer satisfactory performance while reducing the communication overhead up to five times.
△ Less
Submitted 27 November, 2023;
originally announced November 2023.
-
Age of Loop for Wireless Networked Control Systems Optimization
Authors:
Pedro M. de Sant Ana,
Nikolaj Marchenko,
Petar Popovski,
Beatriz Soret
Abstract:
Joint design of control and communication in Wireless Networked Control Systems (WNCS) is a promising approach for future wireless industrial applications. In this context, Age of Information (AoI) has been increasingly utilized as a metric that is more representative than latency in the context of systems with a sense-compute-actuate cycle. Nevertheless, AoI is commonly defined for a single commu…
▽ More
Joint design of control and communication in Wireless Networked Control Systems (WNCS) is a promising approach for future wireless industrial applications. In this context, Age of Information (AoI) has been increasingly utilized as a metric that is more representative than latency in the context of systems with a sense-compute-actuate cycle. Nevertheless, AoI is commonly defined for a single communication direction, Downlink or Uplink, which does not capture the closed-loop dynamics. In this paper, we extend the concept of AoI by defining a new metric, Age of Loop (AoL), relevant for WNCS closed-loop systems. The AoL is defined as the time elapsed since the piece of information causing the latest action or state (depending on the selected time origin) was generated. We then use the proposed metric to learn the WNCS latency and freshness bounds and we apply such learning methodology to minimize the long term WNCS cost with the least amount of bandwidth. We show that, using the AoL, we can learn the control system requirement and use this information to optimize network resources.
△ Less
Submitted 1 June, 2021;
originally announced June 2021.
