Recommending Pre-Trained Models for IoT Devices
Authors:
Parth V. Patil,
Wenxin Jiang,
Huiyun Peng,
Daniel Lugo,
Kelechi G. Kalu,
Josh LeBlanc,
Lawrence Smith,
Hyeonwoo Heo,
Nathanael Aou,
James C. Davis
Abstract:
The availability of pre-trained models (PTMs) has enabled faster deployment of machine learning across applications by reducing the need for extensive training. Techniques like quantization and distillation have further expanded PTM applicability to resource-constrained IoT hardware. Given the many PTM options for any given task, engineers often find it too costly to evaluate each model's suitabil…
▽ More
The availability of pre-trained models (PTMs) has enabled faster deployment of machine learning across applications by reducing the need for extensive training. Techniques like quantization and distillation have further expanded PTM applicability to resource-constrained IoT hardware. Given the many PTM options for any given task, engineers often find it too costly to evaluate each model's suitability. Approaches such as LogME, LEEP, and ModelSpider help streamline model selection by estimating task relevance without exhaustive tuning. However, these methods largely leave hardware constraints as future work-a significant limitation in IoT settings. In this paper, we identify the limitations of current model recommendation approaches regarding hardware constraints and introduce a novel, hardware-aware method for PTM selection. We also propose a research agenda to guide the development of effective, hardware-conscious model recommendation systems for IoT applications.
△ Less
Submitted 25 December, 2024;
originally announced December 2024.
System Architecture and Communication Infrastructure for the RoboVaaS project
Authors:
Emanuele Coccolo,
Cosmin Delea,
Fabian Steinmetz,
Roberto Francescon,
Alberto Signori,
Ching Nok Au,
Filippo Campagnaro,
Vincent Schneider,
Federico Favaro,
Johannes Oeffner,
Christian Renner,
Michele Zorzi
Abstract:
Current advancements in waterborne autonomous systems, together with the development of cloud-based service-oriented architectures and the recent availability of low-cost underwater acoustic modems and long-range above water wireless devices, enabled the development of new applications to support ships and port activities. Unmanned Surface Vehicle (USV) can, for instance, be used to perform bathym…
▽ More
Current advancements in waterborne autonomous systems, together with the development of cloud-based service-oriented architectures and the recent availability of low-cost underwater acoustic modems and long-range above water wireless devices, enabled the development of new applications to support ships and port activities. Unmanned Surface Vehicle (USV) can, for instance, be used to perform bathymetry and environmental data collection tasks to ensure under-keel clearance and to monitor the quality of the water. Similarly, Remotely Operated Vehicles (ROVs) can be deployed to inspect ship hulls and typical port infrastructure elements, such as quay and sheet pilling walls. In this paper we present the complete system deployed for the small-scale demonstrations of the Robotic Vessels as-a-Service (RoboVaaS) project, which introduces an on-demand service-based cloud system that dispatches Unmanned Vehicles (UVs) capable of performing the required service either autonomously or piloted. These vessels are able to interact with sensors deployed in the port and with the shore station through an integrated underwater and above water network. The developed system has been validated through sea trials and showcased through an underwater sensor data collection service. The results of the test presented in this paper provide a proof-of-concept of the system design and indicate its technical feasibility. It also shows the need for further developments for a mature technology allowing on-demand robotic maritime assistance services in real operational scenarios.
△ Less
Submitted 10 June, 2022;
originally announced June 2022.