-
Distributed Training of Large Graph Neural Networks with Variable Communication Rates
Authors:
Juan Cervino,
Md Asadullah Turja,
Hesham Mostafa,
Nageen Himayat,
Alejandro Ribeiro
Abstract:
Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to training GNNs on large graphs. However, as the graph cannot generally be decomposed into small non-interacting components, data communication between the traini…
▽ More
Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to training GNNs on large graphs. However, as the graph cannot generally be decomposed into small non-interacting components, data communication between the training machines quickly limits training speeds. Compressing the communicated node activations by a fixed amount improves the training speeds, but lowers the accuracy of the trained GNN. In this paper, we introduce a variable compression scheme for reducing the communication volume in distributed GNN training without compromising the accuracy of the learned model. Based on our theoretical analysis, we derive a variable compression method that converges to a solution equivalent to the full communication case, for all graph partitioning schemes. Our empirical results show that our method attains a comparable performance to the one obtained with full communication. We outperform full communication at any fixed compression ratio for any communication budget.
△ Less
Submitted 25 June, 2024;
originally announced June 2024.
-
Handling Spontaneous Traffic Variations in 5G+ via Offloading onto mmWave-Capable UAV `Bridges'
Authors:
Nikita Tafintsev,
Dmitri Moltchanov,
Sergey Andreev,
Shu-ping Yeh,
Nageen Himayat,
Yevgeni Koucheryavy,
Mikko Valkama
Abstract:
Unmanned aerial vehicles (UAVs) are increasingly employed for numerous public and civil applications, such as goods delivery, medicine, surveillance, and telecommunications. For the latter, UAVs with onboard communication equipment may help temporarily offload traffic onto the neighboring cells in fifth-generation networks and beyond (5G+). In this paper, we propose and evaluate the use of UAVs tr…
▽ More
Unmanned aerial vehicles (UAVs) are increasingly employed for numerous public and civil applications, such as goods delivery, medicine, surveillance, and telecommunications. For the latter, UAVs with onboard communication equipment may help temporarily offload traffic onto the neighboring cells in fifth-generation networks and beyond (5G+). In this paper, we propose and evaluate the use of UAVs traveling over the area of interest to relieve congestion in 5G+ systems under spontaneous traffic fluctuations. To this end, we assess two inherently different offloading schemes, named routed and controlled UAV `bridging'. Using the tools of renewal theory and stochastic geometry, we analytically characterize these schemes in terms of the fraction of traffic demand that can be offloaded onto the UAV `bridge' as our parameter of interest. This framework accounts for the unique features of millimeter-wave (mmWave) radio propagation and city deployment types with potential line-of-sight (LoS) link blockage by buildings. We also introduce enhancements to the proposed schemes that significantly improve the offloading gains. Our findings offer evidence that the UAV `bridges' may be used for efficient traffic offloading in various urban scenarios.
△ Less
Submitted 23 June, 2020;
originally announced June 2020.
-
Control Aware Radio Resource Allocation in Low Latency Wireless Control Systems
Authors:
Mark Eisen,
Mohammad M. Rashid,
Konstantinos Gatsis,
Dave Cavalcanti,
Nageen Himayat,
Alejandro Ribeiro
Abstract:
We consider the problem of allocating radio resources over wireless communication links to control a series of independent wireless control systems. Low-latency transmissions are necessary in enabling time-sensitive control systems to operate over wireless links with high reliability. Achieving fast data rates over wireless links thus comes at the cost of reliability in the form of high packet err…
▽ More
We consider the problem of allocating radio resources over wireless communication links to control a series of independent wireless control systems. Low-latency transmissions are necessary in enabling time-sensitive control systems to operate over wireless links with high reliability. Achieving fast data rates over wireless links thus comes at the cost of reliability in the form of high packet error rates compared to wired links due to channel noise and interference. However, the effect of the communication link errors on the control system performance depends dynamically on the control system state. We propose a novel control-communication co-design approach to the low-latency resource allocation problem. We incorporate control and channel state information to make scheduling decisions over time on frequency, bandwidth and data rates across the next-generation Wi-Fi based wireless communication links that close the control loops. Control systems that are closer to instability or further from a desired range in a given control cycle are given higher packet delivery rate targets to meet. Rather than a simple priority ranking, we derive precise packet error rate targets for each system needed to satisfy stability targets and make scheduling decisions to meet such targets while reducing total transmission time. The resulting Control-Aware Low Latency Scheduling (CALLS) method is tested in numerous simulation experiments that demonstrate its effectiveness in meeting control-based goals under tight latency constraints relative to control-agnostic scheduling.
△ Less
Submitted 1 November, 2018;
originally announced November 2018.
