-
Energy-Aware Federated Learning in Satellite Constellations
Authors:
Nasrin Razmi,
Bho Matthiesen,
Armin Dekorsy,
Petar Popovski
Abstract:
Federated learning in satellite constellations, where the satellites collaboratively train a machine learning model, is a promising technology towards enabling globally connected intelligence and the integration of space networks into terrestrial mobile networks. The energy required for this computationally intensive task is provided either by solar panels or by an internal battery if the satellit…
▽ More
Federated learning in satellite constellations, where the satellites collaboratively train a machine learning model, is a promising technology towards enabling globally connected intelligence and the integration of space networks into terrestrial mobile networks. The energy required for this computationally intensive task is provided either by solar panels or by an internal battery if the satellite is in Earth's shadow. Careful management of this battery and system's available energy resources is not only necessary for reliable satellite operation, but also to avoid premature battery aging. We propose a novel energy-aware computation time scheduler for satellite FL, which aims to minimize battery usage without any impact on the convergence speed. Numerical results indicate an increase of more than 3x in battery lifetime can be achieved over energy-agnostic task scheduling.
△ Less
Submitted 23 September, 2024;
originally announced September 2024.
-
Sparse Incremental Aggregation in Multi-Hop Federated Learning
Authors:
Sourav Mukherjee,
Nasrin Razmi,
Armin Dekorsy,
Petar Popovski,
Bho Matthiesen
Abstract:
This paper investigates federated learning (FL) in a multi-hop communication setup, such as in constellations with inter-satellite links. In this setup, part of the FL clients are responsible for forwarding other client's results to the parameter server. Instead of using conventional routing, the communication efficiency can be improved significantly by using in-network model aggregation at each i…
▽ More
This paper investigates federated learning (FL) in a multi-hop communication setup, such as in constellations with inter-satellite links. In this setup, part of the FL clients are responsible for forwarding other client's results to the parameter server. Instead of using conventional routing, the communication efficiency can be improved significantly by using in-network model aggregation at each intermediate hop, known as incremental aggregation (IA). Prior works [1] have indicated diminishing gains for IA under gradient sparsification. Here we study this issue and propose several novel correlated sparsification methods for IA. Numerical results show that, for some of these algorithms, the full potential of IA is still available under sparsification without impairing convergence. We demonstrate a 15x improvement in communication efficiency over conventional routing and a 11x improvement over state-of-the-art (SoA) sparse IA.
△ Less
Submitted 25 July, 2024;
originally announced July 2024.
-
Machine Unlearning for Medical Imaging
Authors:
Reza Nasirigerdeh,
Nader Razmi,
Julia A. Schnabel,
Daniel Rueckert,
Georgios Kaissis
Abstract:
Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider their contribution in models including medical imaging models. In this study, we evaluate the effectiveness (performance) and computational efficiency of differ…
▽ More
Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider their contribution in models including medical imaging models. In this study, we evaluate the effectiveness (performance) and computational efficiency of different unlearning algorithms in medical imaging domain. Our evaluations demonstrate that the considered unlearning algorithms perform well on the retain set (samples whose influence on the model is allowed to be retained) and forget set (samples whose contribution to the model should be eliminated), and show no bias against male or female samples. They, however, adversely impact the generalization of the model, especially for larger forget set sizes. Moreover, they might be biased against easy or hard samples, and need additional computational overhead for hyper-parameter tuning. In conclusion, machine unlearning seems promising for medical imaging, but the existing unlearning algorithms still needs further improvements to become more practical for medical applications.
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
Scheduling for On-Board Federated Learning with Satellite Clusters
Authors:
Nasrin Razmi,
Bho Matthiesen,
Armin Dekorsy,
Petar Popovski
Abstract:
Mega-constellations of small satellites have evolved into a source of massive amount of valuable data. To manage this data efficiently, on-board federated learning (FL) enables satellites to train a machine learning (ML) model collaboratively without having to share the raw data. This paper introduces a scheme for scheduling on-board FL for constellations connected with intra-orbit inter-satellite…
▽ More
Mega-constellations of small satellites have evolved into a source of massive amount of valuable data. To manage this data efficiently, on-board federated learning (FL) enables satellites to train a machine learning (ML) model collaboratively without having to share the raw data. This paper introduces a scheme for scheduling on-board FL for constellations connected with intra-orbit inter-satellite links. The proposed scheme utilizes the predictable visibility pattern between satellites and ground station (GS), both at the individual satellite level and cumulatively within the entire orbit, to mitigate intermittent connectivity and best use of available time. To this end, two distinct schedulers are employed: one for coordinating the FL procedures among orbits, and the other for controlling those within each orbit. These two schedulers cooperatively determine the appropriate time to perform global updates in GS and then allocate suitable duration to satellites within each orbit for local training, proportional to usable time until next global update. This scheme leads to improved test accuracy within a shorter time.
△ Less
Submitted 14 February, 2024;
originally announced February 2024.
-
On-board Federated Learning for Satellite Clusters with Inter-Satellite Links
Authors:
Nasrin Razmi,
Bho Matthiesen,
Armin Dekorsy,
Petar Popovski
Abstract:
The emergence of mega-constellations of interconnected satellites has a major impact on the integration of cellular wireless and non-terrestrial networks, while simultaneously offering previously inconceivable data gathering capabilities. This paper studies the problem of running a federated learning (FL) algorithm within low Earth orbit satellite constellations connected with intra-orbit inter-sa…
▽ More
The emergence of mega-constellations of interconnected satellites has a major impact on the integration of cellular wireless and non-terrestrial networks, while simultaneously offering previously inconceivable data gathering capabilities. This paper studies the problem of running a federated learning (FL) algorithm within low Earth orbit satellite constellations connected with intra-orbit inter-satellite links (ISL), aiming to efficiently process collected data in situ. Satellites apply on-board machine learning and transmit local parameters to the parameter server (PS). The main contribution is a novel approach to enhance FL in satellite constellations using intra-orbit ISLs. The key idea is to rely on predictability of satellite visits to create a system design in which ISLs mitigate the impact of intermittent connectivity and transmit aggregated parameters to the PS. We first devise a synchronous FL, which is extended towards an asynchronous FL for the case of sparse satellite visits to the PS. An efficient use of the satellite resources is attained by sparsification-based compression the aggregated parameters within each orbit. Performance is evaluated in terms of accuracy and required data transmission size. We observe a sevenfold increase in convergence speed over the state-of-the-art using ISLs, and $10\times$ reduction in communication load through the proposed in-network aggregation strategy.
△ Less
Submitted 21 December, 2023; v1 submitted 17 July, 2023;
originally announced July 2023.
-
Federated Learning in Satellite Constellations
Authors:
Bho Matthiesen,
Nasrin Razmi,
Israel Leyva-Mayorga,
Armin Dekorsy,
Petar Popovski
Abstract:
Federated learning (FL) has recently emerged as a distributed machine learning paradigm for systems with limited and intermittent connectivity. This paper presents the new context brought to FL by satellite constellations, where the connectivity patterns are significantly different from the ones observed in conventional terrestrial FL. The focus is on large constellations in low Earth orbit (LEO),…
▽ More
Federated learning (FL) has recently emerged as a distributed machine learning paradigm for systems with limited and intermittent connectivity. This paper presents the new context brought to FL by satellite constellations, where the connectivity patterns are significantly different from the ones observed in conventional terrestrial FL. The focus is on large constellations in low Earth orbit (LEO), where each satellites participates in a data-driven FL task using a locally stored dataset. This scenario is motivated by the trend towards mega constellations of interconnected small satellites in LEO and the integration of artificial intelligence in satellites. We propose a classification of satellite FL based on the communication capabilities of the satellites, the constellation design, and the location of the parameter server. A comprehensive overview of the current state-of-the-art in this field is provided and the unique challenges and opportunities of satellite FL are discussed. Finally, we outline several open research directions for FL in satellite constellations and present some future perspectives on this topic.
△ Less
Submitted 4 May, 2023; v1 submitted 1 June, 2022;
originally announced June 2022.
-
Ground-Assisted Federated Learning in LEO Satellite Constellations
Authors:
Nasrin Razmi,
Bho Matthiesen,
Armin Dekorsy,
Petar Popovski
Abstract:
In Low Earth Orbit (LEO) mega constellations, there are relevant use cases, such as inference based on satellite imaging, in which a large number of satellites collaboratively train a machine learning model without sharing their local datasets. To address this problem, we propose a new set of algorithms based on Federated learning (FL), including a novel asynchronous FL procedure based on FedAvg t…
▽ More
In Low Earth Orbit (LEO) mega constellations, there are relevant use cases, such as inference based on satellite imaging, in which a large number of satellites collaboratively train a machine learning model without sharing their local datasets. To address this problem, we propose a new set of algorithms based on Federated learning (FL), including a novel asynchronous FL procedure based on FedAvg that exhibits better robustness against heterogeneous scenarios than the state-of-the-art. Extensive numerical evaluations based on MNIST and CIFAR-10 datasets highlight the fast convergence speed and excellent asymptotic test accuracy of the proposed method.
△ Less
Submitted 16 December, 2021; v1 submitted 3 September, 2021;
originally announced September 2021.
-
Analysis of D2D Communication with RF Energy Harvesting and Interference Management
Authors:
Nasrin Razmi,
Mehdi Mahdavi,
Mohammadali Mohammadi,
Petar Popovski
Abstract:
Device-to-device (D2D) underlaid cellular network, enabled with radio frequency energy harvesting (RFEH), and enhanced interference management schemes is a promising candidate to improve spectral and energy efficiency of next generation wireless networks. In this paper, we propose a time division duplexing (TDD)-based protocol, in which allows the devices to harvest energy from the downlink transm…
▽ More
Device-to-device (D2D) underlaid cellular network, enabled with radio frequency energy harvesting (RFEH), and enhanced interference management schemes is a promising candidate to improve spectral and energy efficiency of next generation wireless networks. In this paper, we propose a time division duplexing (TDD)-based protocol, in which allows the devices to harvest energy from the downlink transmissions of the base station, while controlling the interference among D2D and cellular communication in the uplink. We propose two schemes for transmission coordination, based on fixed transmission probability (FTP) and adaptive transmission probability (ATP), respectively. In FTP, the D2D transmitters that have harvested enough energy can initiate data transmission with a fixed probability. Differently from this, in ATP a device utilizes its sensing capability to get improved coordination and interference control among the transmitting devices. We evaluate the network performance by presenting an accurate energy model and leveraging tools from stochastic geometry. The results on outage probability and D2D sum-rate reveal the importance of transmission coordination on network performance. These observations led to a solution for choosing the parameters of the ATP scheme that achieves an optimal tradeoff between the D2D outage probability and number of transmitting users.
△ Less
Submitted 5 February, 2020;
originally announced February 2020.
-
Analysis of LoRaWAN Uplink with Multiple Demodulating Paths and Capture Effect
Authors:
René Brandborg Sørensen,
Nasrin Razmi,
Jimmy Jessen Nielsen,
Petar Popovski
Abstract:
Low power wide area networks (LPWANs), such as the ones based on the LoRaWAN protocol, are seen as enablers of large number of IoT applications and services. In this work, we assess the scalability of LoRaWAN by analyzing the frame success probability (FSP) of a LoRa frame while taking into account the capture effect and the number of parallel demodulation paths of the receiving gateway. We have b…
▽ More
Low power wide area networks (LPWANs), such as the ones based on the LoRaWAN protocol, are seen as enablers of large number of IoT applications and services. In this work, we assess the scalability of LoRaWAN by analyzing the frame success probability (FSP) of a LoRa frame while taking into account the capture effect and the number of parallel demodulation paths of the receiving gateway. We have based our model on the commonly used {SX1301 gateway chipset}, which is capable of demodulating {up to} eight frames simultaneously; however, the results of the model can be generalized to architectures with arbitrary number of demodulation paths. We have also introduced and investigated {three} policies for Spreading Factor (SF) allocation. Each policy is evaluated in terms of coverage {probability}, {FSP}, and {throughput}. The overall conclusion is that the presence of multiple demodulation paths introduces a significant change in the analysis and performance of the LoRa random access schemes.
△ Less
Submitted 7 February, 2019;
originally announced February 2019.
