-
ACES -- Automatic Configuration of Energy Harvesting Sensors with Reinforcement Learning
Authors:
Francesco Fraternali,
Bharathan Balaji,
Yuvraj Agarwal,
Rajesh K. Gupta
Abstract:
Internet of Things forms the backbone of modern building applications. Wireless sensors are being increasingly adopted for their flexibility and reduced cost of deployment. However, most wireless sensors are powered by batteries today and large deployments are inhibited by manual battery replacement. Energy harvesting sensors provide an attractive alternative, but they need to provide adequate qua…
▽ More
Internet of Things forms the backbone of modern building applications. Wireless sensors are being increasingly adopted for their flexibility and reduced cost of deployment. However, most wireless sensors are powered by batteries today and large deployments are inhibited by manual battery replacement. Energy harvesting sensors provide an attractive alternative, but they need to provide adequate quality of service to applications given uncertain energy availability. We propose using reinforcement learning to optimize the operation of energy harvesting sensors to maximize sensing quality with available energy. We present our system ACES that uses reinforcement learning for periodic and event-driven sensing indoors with ambient light energy harvesting. Our custom-built board uses a supercapacitor to store energy temporarily, senses light, motion events and relays them using Bluetooth Low Energy. Using simulations and real deployments, we show that our sensor nodes adapt to their lighting conditions and continuously sends measurements and events across nights and weekends. We use deployment data to continually adapt sensing to changing environmental patterns and transfer learning to reduce the training time in real deployments. In our 60 node deployment lasting two weeks, we observe a dead time of 0.1%. The periodic sensors that measure luminosity have a mean sampling period of 90 seconds and the event sensors that detect motion with PIR captured 86% of the events on average compared to a battery-powered node.
△ Less
Submitted 3 August, 2020; v1 submitted 4 September, 2019;
originally announced September 2019.
-
Resource-Efficient Computing in Wearable Systems
Authors:
Mahdi Pedram,
Mahsan Rofouei,
Francesco Fraternali,
Zhila Esna Ashari,
Hassan Ghasemzadeh
Abstract:
We propose two optimization techniques to minimize memory usage and computation while meeting system timing constraints for real-time classification in wearable systems. Our method derives a hierarchical classifier structure for Support Vector Machine (SVM) in order to reduce the amount of computations, based on the probability distribution of output classes occurrences. Also, we propose a memory…
▽ More
We propose two optimization techniques to minimize memory usage and computation while meeting system timing constraints for real-time classification in wearable systems. Our method derives a hierarchical classifier structure for Support Vector Machine (SVM) in order to reduce the amount of computations, based on the probability distribution of output classes occurrences. Also, we propose a memory optimization technique based on SVM parameters, which results in storing fewer support vectors and as a result requiring less memory. To demonstrate the efficiency of our proposed techniques, we performed an activity recognition experiment and were able to save up to 35% and 56% in memory storage when classifying 14 and 6 different activities, respectively. In addition, we demonstrated that there is a trade-off between accuracy of classification and memory savings, which can be controlled based on application requirements.
△ Less
Submitted 7 July, 2019;
originally announced July 2019.
-
Towards Large-Scale Autonomous Wireless Sensor Networks
Authors:
Francesco Fraternali
Abstract:
Wireless Sensor Networks (WSNs) have the goal of gathering data from the environment. The advent of the Internet of Things (IoT) drastically changed WSN's vision that, as never before, needs to expand and include hundreds or thousands of sensors. But to follow the current IoT trends new techniques need to be implemented since orders of thousands of sensor nodes are not manageable by today's WSNs s…
▽ More
Wireless Sensor Networks (WSNs) have the goal of gathering data from the environment. The advent of the Internet of Things (IoT) drastically changed WSN's vision that, as never before, needs to expand and include hundreds or thousands of sensors. But to follow the current IoT trends new techniques need to be implemented since orders of thousands of sensor nodes are not manageable by today's WSNs systems that often rely on manual configuration and hence are not practical. As an example, the replacement of batteries of thousand of nodes could be extremely arduous or even impossible for structural health monitoring of civil infrastructures (i.e. bridges, towers). Hence, the solution to the growing burden of the system manager is automation, allowing the system to check its own status, to re-configure itself and fix the major problems in the network whenever it is possible. In this paper, we present and discuss the main features needed to achieve an autonomous large scale WSN. Furthermore, we compare these features with the state of the art of real-world large scale WSN deployments showing that further solutions are needed to drastically reduce human intervention while guaranteeing the main functionalities of the system.
△ Less
Submitted 27 June, 2019;
originally announced June 2019.
-
Demo Abstract: Pible: Battery-Free Mote for Perpetual Indoor BLE Applications
Authors:
Francesco Fraternali,
Bharathan Balaji,
Yuvraj Agarwal,
Luca Benini,
Rajesh Gupta
Abstract:
As of today, large-scale wireless sensor networks are adopted for smart building applications as they are easy and flexible to deploy. Low-power wireless nodes can achieve multi-year lifetimes with an AA battery using Bluetooth Low Energy (BLE) and Zig-Bee. However, replacing these batteries at scale is a non-trivial, labor-intensive task. Energy harvesting has emerged as a potential solution to a…
▽ More
As of today, large-scale wireless sensor networks are adopted for smart building applications as they are easy and flexible to deploy. Low-power wireless nodes can achieve multi-year lifetimes with an AA battery using Bluetooth Low Energy (BLE) and Zig-Bee. However, replacing these batteries at scale is a non-trivial, labor-intensive task. Energy harvesting has emerged as a potential solution to avoid battery replacement but requires compromises such as application specific sensor node design, simplified communication protocol or reduced quality of service. We show the design of a battery-free sensor node using commercial off the shelf components, and present Pible: a Perpetual Indoor BLE sensor node that uses an ambient light energy harvesting system and can support numerous smart building applications. We show trade-offs between node-lifetime, quality of service and light availability and present a predictive algorithm that adapts to changing lighting conditions to maximize node lifetime and application quality of service.
△ Less
Submitted 1 May, 2019;
originally announced May 2019.
-
Pible: Battery-Free Mote for Perpetual Indoor BLE Applications
Authors:
Francesco Fraternali,
Bharathan Balaji,
Yuvraj Agarwal,
Luca Benini,
Rajesh Gupta
Abstract:
Smart building applications require a large-scale deployment of sensors distributed across the environment. Recent innovations in smart environments are driven by wireless networked sensors as they are easy to deploy. However, replacing these batteries at scale is a non-trivial, labor-intensive task. Energy harvesting has emerged as a potential solution to avoid battery replacement but requires co…
▽ More
Smart building applications require a large-scale deployment of sensors distributed across the environment. Recent innovations in smart environments are driven by wireless networked sensors as they are easy to deploy. However, replacing these batteries at scale is a non-trivial, labor-intensive task. Energy harvesting has emerged as a potential solution to avoid battery replacement but requires compromises such as application specific design, simplified communication protocol or reduced quality of service. We explore the design space of battery-free sensor nodes using commercial off the shelf components, and present Pible: a Perpetual Indoor BLE sensor node that leverages ambient light and can support numerous smart building applications. We analyze node-lifetime, quality of service and light availability trade-offs and present a predictive algorithm that adapts to changing lighting conditions to maximize node lifetime and application quality of service. Using a 20 node, 15-day deployment in a real building under varying lighting conditions, we show feasible applications that can be implemented using Pible and the boundary conditions under which they can fail.
△ Less
Submitted 27 November, 2018;
originally announced December 2018.
-
Scaling Configuration of Energy Harvesting Sensors with Reinforcement Learning
Authors:
Francesco Fraternali,
Bharathan Balaji,
Rajesh Gupta
Abstract:
With the advent of the Internet of Things (IoT), an increasing number of energy harvesting methods are being used to supplement or supplant battery based sensors. Energy harvesting sensors need to be configured according to the application, hardware, and environmental conditions to maximize their usefulness. As of today, the configuration of sensors is either manual or heuristics based, requiring…
▽ More
With the advent of the Internet of Things (IoT), an increasing number of energy harvesting methods are being used to supplement or supplant battery based sensors. Energy harvesting sensors need to be configured according to the application, hardware, and environmental conditions to maximize their usefulness. As of today, the configuration of sensors is either manual or heuristics based, requiring valuable domain expertise. Reinforcement learning (RL) is a promising approach to automate configuration and efficiently scale IoT deployments, but it is not yet adopted in practice. We propose solutions to bridge this gap: reduce the training phase of RL so that nodes are operational within a short time after deployment and reduce the computational requirements to scale to large deployments. We focus on configuration of the sampling rate of indoor solar panel based energy harvesting sensors. We created a simulator based on 3 months of data collected from 5 sensor nodes subject to different lighting conditions. Our simulation results show that RL can effectively learn energy availability patterns and configure the sampling rate of the sensor nodes to maximize the sensing data while ensuring that energy storage is not depleted. The nodes can be operational within the first day by using our methods. We show that it is possible to reduce the number of RL policies by using a single policy for nodes that share similar lighting conditions.
△ Less
Submitted 27 November, 2018;
originally announced November 2018.
