Showing 1–4 of 4 results for author: Mai, R

Analysis of human steering behavior differences in human-in-control and autonomy-in-control driving

Authors: Rene Mai, Agung Julius, Sandipan Mishra

Abstract: Steering models (such as the generalized two-point model) predict human steering behavior well when the human is in direct control of a vehicle. In vehicles under autonomous control, human control inputs are not used; rather, an autonomous controller applies steering and acceleration commands to the vehicle. For example, human steering input may be used for state estimation rather than direct cont… ▽ More Steering models (such as the generalized two-point model) predict human steering behavior well when the human is in direct control of a vehicle. In vehicles under autonomous control, human control inputs are not used; rather, an autonomous controller applies steering and acceleration commands to the vehicle. For example, human steering input may be used for state estimation rather than direct control. We show that human steering behavior changes when the human no longer directly controls the vehicle and the two are instead working in a shared autonomy paradigm. Thus, when a vehicle is not under direct human control, steering models like the generalized two-point model do not predict human steering behavior. We also show that the error between predicted human steering behavior and actual human steering behavior reflects a fundamental difference when the human directly controls the vehicle compared to when the vehicle is autonomously controlled. Moreover, we show that a single distribution describes the error between predicted human steering behavior and actual human steering behavior when the human's steering inputs are used for state estimation and the vehicle is autonomously controlled, indicating there may be a underlying model for human steering behavior under this type of shared autonomous control. Future work includes determining this shared autonomous human steering model and demonstrating its performance. △ Less

Submitted 30 September, 2024; originally announced October 2024.

Comments: 6 pages, 10 figures, accepted for publication at the 5th IFAC at the 5th IFAC Workshop on Cyber-Physical Human Systems

Desynchronization Index: a New Approach for Exploring Complex Epileptogenic Networks in Stereoelectroencephalography

Authors: Federico Mason, Lorenzo Ferri, Lidia Di Vito, Lara Alvisi, Luca Zanuttini, Matteo Martinoni, Roberto Mai, Francesco Cardinale, Paolo Tinuper, Roberto Michelucci, Elena Pasini, Francesca Bisulli

Abstract: In this work, we propose a new computational framework to assist neurophysiologists in Stereoelectroencephalography (SEEG) analysis, with the final aim of improving the definition of the Epileptogenic Zone (EZ) in patients with drug-resistant epilepsy. We design a new algorithm, named Desynchronization Index (DI), that classifies as most epileptogenic those SEEG channels that show independent beha… ▽ More In this work, we propose a new computational framework to assist neurophysiologists in Stereoelectroencephalography (SEEG) analysis, with the final aim of improving the definition of the Epileptogenic Zone (EZ) in patients with drug-resistant epilepsy. We design a new algorithm, named Desynchronization Index (DI), that classifies as most epileptogenic those SEEG channels that show independent behavior during the seconds preceding the seizure propagation. We test the proposed DI algorithm against the Epileptogenic Index (EI) algorithm on a clinical dataset of 11 patients, considering the neurophysiological evaluation of the EZ as the clinical ground truth. Our results denote that DI overcomes EI in terms of area under the ROC curve (AUC=0.81 vs AUC=0.74) while combining the two algorithms as a unique tool leads to the best performance (AUC=0.87). The DI algorithm underscores connectivity dynamics that can hardly be identified with a pure visual analysis, increasing the accuracy of the EZ definition compared to traditional methods. This technique can lead to the definition of a new effective biomarker of the EZ, reducing the burden required by the SEEG review in the case of extensive implants and improving our understanding of the dynamics leading to the generation of seizures. △ Less

Submitted 26 March, 2025; v1 submitted 29 August, 2024; originally announced August 2024.

Comments: This work is submitted to ACM Transactions on Computing for Healthcare

Generalized two-point visual control model of human steering for accurate state estimation

Authors: Rene Mai, Katherine Sears, Grace Roessling, Agung Julius, Sandipan Mishra

Abstract: We derive and validate a generalization of the two-point visual control model, an accepted cognitive science model for human steering behavior. The generalized model is needed as current steering models are either insufficiently accurate or too complex for online state estimation. We demonstrate that the generalized model replicates specific human steering behavior with high precision (85\% reduct… ▽ More We derive and validate a generalization of the two-point visual control model, an accepted cognitive science model for human steering behavior. The generalized model is needed as current steering models are either insufficiently accurate or too complex for online state estimation. We demonstrate that the generalized model replicates specific human steering behavior with high precision (85\% reduction in modeling error) and integrate this model into a human-as-advisor framework where human steering inputs are used for state estimation. As a benchmark study, we use this framework to decipher ambiguous lane markings represented by biased lateral position measurements. We demonstrate that, with the generalized model, the state estimator can accurately estimate the true vehicle state, providing lateral state estimates with under 0.25 m error on average across participants. However, without the generalized model, the estimator cannot accurately estimate the vehicle's lateral state. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: 6 pages, 9 figures, This work has been submitted to IFAC for possible publication

Optimal Demand Response Using Device Based Reinforcement Learning

Authors: Zheng Wen, Daniel O'Neill, Hamid Reza Maei

Abstract: Demand response (DR) for residential and small commercial buildings is estimated to account for as much as 65% of the total energy savings potential of DR, and previous work shows that a fully automated Energy Management System (EMS) is a necessary prerequisite to DR in these areas. In this paper, we propose a novel EMS formulation for DR problems in these sectors. Specifically, we formulate a ful… ▽ More Demand response (DR) for residential and small commercial buildings is estimated to account for as much as 65% of the total energy savings potential of DR, and previous work shows that a fully automated Energy Management System (EMS) is a necessary prerequisite to DR in these areas. In this paper, we propose a novel EMS formulation for DR problems in these sectors. Specifically, we formulate a fully automated EMS's rescheduling problem as a reinforcement learning (RL) problem, and argue that this RL problem can be approximately solved by decomposing it over device clusters. Compared with existing formulations, our new formulation (1) does not require explicitly modeling the user's dissatisfaction on job rescheduling, (2) enables the EMS to self-initiate jobs, (3) allows the user to initiate more flexible requests and (4) has a computational complexity linear in the number of devices. We also demonstrate the simulation results of applying Q-learning, one of the most popular and classical RL algorithms, to a representative example. △ Less

Submitted 28 June, 2014; v1 submitted 7 January, 2014; originally announced January 2014.