-
Adaptive Client Selection with Personalization for Communication Efficient Federated Learning
Authors:
Allan M. de Souza,
Filipe Maciel,
Joahannes B. D. da Costa,
Luiz F. Bittencourt,
Eduardo Cerqueira,
Antonio A. F. Loureiro,
Leandro A. Villas
Abstract:
Federated Learning (FL) is a distributed approach to collaboratively training machine learning models. FL requires a high level of communication between the devices and a central server, thus imposing several challenges, including communication bottlenecks and network scalability. This article introduces ACSP-FL (https://github.com/AllanMSouza/ACSP-FL), a solution to reduce the overall communicati…
▽ More
Federated Learning (FL) is a distributed approach to collaboratively training machine learning models. FL requires a high level of communication between the devices and a central server, thus imposing several challenges, including communication bottlenecks and network scalability. This article introduces ACSP-FL (https://github.com/AllanMSouza/ACSP-FL), a solution to reduce the overall communication and computation costs for training a model in FL environments. ACSP-FL employs a client selection strategy that dynamically adapts the number of devices training the model and the number of rounds required to achieve convergence. Moreover, ACSP-FL enables model personalization to improve clients performance. A use case based on human activity recognition datasets aims to show the impact and benefits of ACSP-FL when compared to state-of-the-art approaches. Experimental evaluations show that ACSP-FL minimizes the overall communication and computation overheads to train a model and converges the system efficiently. In particular, ACSP-FL reduces communication up to 95% compared to literature approaches while providing good convergence even in scenarios where data is distributed differently, non-independent and identical way between client devices.
△ Less
Submitted 26 November, 2024;
originally announced November 2024.
-
Management of Resource at the Network Edge for Federated Learning
Authors:
Silvana Trindade,
Luiz F. Bittencourt,
Nelson L. S. da Fonseca
Abstract:
Federated learning has been explored as a promising solution for training at the edge, where end devices collaborate to train models without sharing data with other entities. Since the execution of these learning models occurs at the edge, where resources are limited, new solutions must be developed. In this paper, we describe the recent work on resource management at the edge, and explore the cha…
▽ More
Federated learning has been explored as a promising solution for training at the edge, where end devices collaborate to train models without sharing data with other entities. Since the execution of these learning models occurs at the edge, where resources are limited, new solutions must be developed. In this paper, we describe the recent work on resource management at the edge, and explore the challenges and future directions to allow the execution of federated learning at the edge. Some of the problems of this management, such as discovery of resources, deployment, load balancing, migration, and energy efficiency will be discussed in the paper.
△ Less
Submitted 4 February, 2022; v1 submitted 7 July, 2021;
originally announced July 2021.
-
Fog Computing on Constrained Devices: Paving the Way for the Future IoT
Authors:
Flavia Pisani,
Fabiola M. C. de Oliveira,
Eduardo S. Gama,
Roger Immich,
Luiz F. Bittencourt,
Edson Borin
Abstract:
In the long term, the Internet of Things (IoT) is expected to become an integral part of people's daily lives. In light of this technological advancement, an ever-growing number of objects with limited hardware may become connected to the Internet. In this chapter, we explore the importance of these constrained devices as well as how we can use them in conjunction with fog computing to change the…
▽ More
In the long term, the Internet of Things (IoT) is expected to become an integral part of people's daily lives. In light of this technological advancement, an ever-growing number of objects with limited hardware may become connected to the Internet. In this chapter, we explore the importance of these constrained devices as well as how we can use them in conjunction with fog computing to change the future of the IoT. First, we present an overview of the concepts of constrained devices, IoT, and fog and mist computing, and then we present a classification of applications according to the amount of resources they require (e.g., processing power and memory). After that, we tie in these topics with a discussion of what can be expected in a future where constrained devices and fog computing are used to push the IoT to new limits. Lastly, we discuss some challenges and opportunities that these technologies may bring.
△ Less
Submitted 4 March, 2020; v1 submitted 12 February, 2020;
originally announced February 2020.
-
Towards a distributed and infrastructure-less vehicular traffic management system
Authors:
Ademar T. Akabane,
Roger Immich,
Luiz F. Bittencourt,
Edmundo R. M. Madeira,
Leandro A. Villas
Abstract:
In the past few years, several systems have been proposed to deal with issues related to the vehicular traffic management. Usually, their solutions include the integration of computational technologies such as vehicular networks, central servers, and roadside units. Most systems use a hybrid approach, which means they still need a central entity (central server or roadside unit) and Internet conne…
▽ More
In the past few years, several systems have been proposed to deal with issues related to the vehicular traffic management. Usually, their solutions include the integration of computational technologies such as vehicular networks, central servers, and roadside units. Most systems use a hybrid approach, which means they still need a central entity (central server or roadside unit) and Internet connection to find out an en-route event as well as alternative routes for vehicles. It is easy to understand the need for a central entity because selecting the most appropriate vehicle to perform aforementioned procedures is a difficult task. In addition to that, as far as we know, there are very few systems that apply the altruistic approach (not selfish behavior) to routing decisions. Because of that, the issue addressed in this work is how to perform the vehicular traffic management, when an en-route event is detected, in a distributed, scalable, and cost-effective fashion. To deal with these issues, we proposed a distributed vehicle traffic management system, named as dEASY (distributed vEhicle trAffic management SYstem). The dEASY system was designed and implemented on a three-layer architecture, namely environment sensing and vehicle ranking, knowledge generation and distribution, and knowledge consumption. Each layer of the dEASY architecture is responsible for dealing with the main issues that were not addressed in related works or could be improved. Simulation results have shown that, compared with other systems from the literature, our proposed system has lower network overhead due to applied vehicle selection and broadcast suppression mechanisms. In average, dEASY also outperformed all other competitors in what regards to the travel time and time lost metrics. Through the analysis of results, it is possible to conclude that our infrastructure-less system is scalable and cost-effective.
△ Less
Submitted 10 February, 2020;
originally announced February 2020.
-
Scheduling in distributed systems: A cloud computing perspective
Authors:
Luiz F. Bittencourt,
Alfredo Goldman,
Edmundo R. M. Madeira,
Nelson L. S. da Fonseca,
Rizos Sakellariou
Abstract:
Scheduling is essentially a decision-making process that enables resource sharing among a number of activities by determining their execution order on the set of available resources. The emergence of distributed systems brought new challenges on scheduling in computer systems, including clusters, grids, and more recently clouds. On the other hand, the plethora of research makes it hard for both ne…
▽ More
Scheduling is essentially a decision-making process that enables resource sharing among a number of activities by determining their execution order on the set of available resources. The emergence of distributed systems brought new challenges on scheduling in computer systems, including clusters, grids, and more recently clouds. On the other hand, the plethora of research makes it hard for both newcomers researchers to understand the relationship among different scheduling problems and strategies proposed in the literature, which hampers the identification of new and relevant research avenues. In this paper we introduce a classification of the scheduling problem in distributed systems by presenting a taxonomy that incorporates recent developments, especially those in cloud computing. We review the scheduling literature to corroborate the taxonomy and analyze the interest in different branches of the proposed taxonomy. Finally, we identify relevant future directions in scheduling for distributed systems.
△ Less
Submitted 10 January, 2019;
originally announced January 2019.
-
The Internet of Things, Fog and Cloud Continuum: Integration and Challenges
Authors:
Luiz F. Bittencourt,
Roger Immich,
Rizos Sakellariou,
Nelson L. S. da Fonseca,
Edmundo R. M. Madeira,
Marilia Curado,
Leandro Villas,
Luiz da Silva,
Craig Lee,
Omer Rana
Abstract:
The Internet of Things needs for computing power and storage are expected to remain on the rise in the next decade. Consequently, the amount of data generated by devices at the edge of the network will also grow. While cloud computing has been an established and effective way of acquiring computation and storage as a service to many applications, it may not be suitable to handle the myriad of data…
▽ More
The Internet of Things needs for computing power and storage are expected to remain on the rise in the next decade. Consequently, the amount of data generated by devices at the edge of the network will also grow. While cloud computing has been an established and effective way of acquiring computation and storage as a service to many applications, it may not be suitable to handle the myriad of data from IoT devices and fulfill largely heterogeneous application requirements. Fog computing has been developed to lie between IoT and the cloud, providing a hierarchy of computing power that can collect, aggregate, and process data from/to IoT devices. Combining fog and cloud may reduce data transfers and communication bottlenecks to the cloud and also contribute to reduced latencies, as fog computing resources exist closer to the edge. This paper examines this IoT-Fog-Cloud ecosystem and provides a literature review from different facets of it: how it can be organized, how management is being addressed, and how applications can benefit from it. Lastly, we present challenging issues yet to be addressed in IoT-Fog-Cloud infrastructures.
△ Less
Submitted 26 September, 2018;
originally announced September 2018.
-
MODULAR: Software for the Autonomous Computation of Modularity in Large Network Sets
Authors:
Flavia Maria Darcie Marquitti,
Paulo Roberto Guimaraes Jr.,
Mathias Mistretta Pires,
Luiz Fernando Bittencourt
Abstract:
Ecological systems can be seen as networks of interactions between individual, species, or habitat patches. A key feature of many ecological networks is their organization into modules, which are subsets of elements that are more connected to each other than to the other elements in the network. We introduce MODULAR to perform rapid and autonomous calculation of modularity in sets of networks. MOD…
▽ More
Ecological systems can be seen as networks of interactions between individual, species, or habitat patches. A key feature of many ecological networks is their organization into modules, which are subsets of elements that are more connected to each other than to the other elements in the network. We introduce MODULAR to perform rapid and autonomous calculation of modularity in sets of networks. MODULAR reads a set of files with matrices or edge lists that represent unipartite or bipartite networks, and identify modules using two different modularity metrics that have been previously used in studies of ecological networks. To find the network partition that maximizes modularity, the software offers five optimization methods to the user. We also included two of the most common null models that are used in studies of ecological networks to verify how the modularity found by the maximization of each metric differs from a theoretical benchmark.
△ Less
Submitted 9 April, 2013;
originally announced April 2013.
-
A Seamless Flow Mobility Management Architecture for Vehicular Communication Networks
Authors:
Rodolfo I. Meneguette,
Luiz F. Bittencourt,
Edmundo R. M. Madeira
Abstract:
Vehicular Ad Hoc Networks (VANETs) are self-organizing, self-healing networks which provide wireless communication among vehicular and roadside devices. Applications in such networks can take advantage of the use of simultaneous connections, thereby maximizing the throughput and lowering latency. In order to take advantage of all radio interfaces of the vehicle and to provide good quality of servi…
▽ More
Vehicular Ad Hoc Networks (VANETs) are self-organizing, self-healing networks which provide wireless communication among vehicular and roadside devices. Applications in such networks can take advantage of the use of simultaneous connections, thereby maximizing the throughput and lowering latency. In order to take advantage of all radio interfaces of the vehicle and to provide good quality of service for vehicular applications, we de- veloped a seamless flow mobility management architecture based on vehicular network application classes with network-based mobility management. Our goal is to minimize the time of flow connection exchange in order to comply with the minimum requirements of vehicular application classes, as well as to maximize their throughput. NS3 simulations were performed to analyse the behaviour of our architecture by comparing it with other three scenarios. As a result of this work, we observed that the proposed architecture presented a low handover time, with lower packet loss and lower delay.
△ Less
Submitted 3 April, 2013;
originally announced April 2013.
