-
Contactless pulse rate assessment: Results and insights for application in driving simulator
Authors:
Đorđe D. Nešković,
Kristina Stojmenova Pečečnik,
Jaka Sodnik,
Nadica Miljković
Abstract:
Remote Photoplethysmography (rPPG) enables continuous and unobtrusive assessment of driver's state, allowing estimation of fatigue, stress, and user experience. Commonly used wearable PPG sensors, while effective, suffer from motion artifacts and user discomfort. This study explores the feasibility of non-contact Pulse Rate (PR) assessment using facial video recordings captured by a Red, Green, an…
▽ More
Remote Photoplethysmography (rPPG) enables continuous and unobtrusive assessment of driver's state, allowing estimation of fatigue, stress, and user experience. Commonly used wearable PPG sensors, while effective, suffer from motion artifacts and user discomfort. This study explores the feasibility of non-contact Pulse Rate (PR) assessment using facial video recordings captured by a Red, Green, and Blue (RGB) camera in a driving simulator. The proposed approach detects subtle skin color variations due to blood flow and compares extracted PR values against reference measurements from a wearable Empatica E4 sensor. We evaluate the impact of Eulerian Video Magnification (EVM) on PR estimation and assess statistical differences in PR between age groups. Data obtained from 80 recordings from 64 healthy subjects covering a PR range of 45-160 bpm are analyzed, and PR extraction accuracy is quantified using metrics, such as Mean Absolute Error (MAE). Results show that EVM slightly improves PR estimation, reducing MAE from 6.48 bpm to 5.04 bpm. Significant differences between PRs in younger and older drivers are observed in both rPPG and reference data. The study also thoroughly discusses bias within Empatica E4. Overall, results support the feasibility of integrating camera-based PR monitoring into driving simulators for real-time subject's assessment.
△ Less
Submitted 27 June, 2025; v1 submitted 2 May, 2025;
originally announced May 2025.
-
Data Augmentation for Generating Synthetic Electrogastrogram Time Series
Authors:
Nadica Miljković,
Nikola Milenić,
Nenad B. Popović,
Jaka Sodnik
Abstract:
To address an emerging need for large number of diverse datasets for rigor evaluation of signal processing techniques, we developed and evaluated a new method for generating synthetic electrogastrogram time series. We used electrogastrography (EGG) data from an open database to set model parameters and statistical tests to evaluate synthesized data. Additionally, we illustrated method customizatio…
▽ More
To address an emerging need for large number of diverse datasets for rigor evaluation of signal processing techniques, we developed and evaluated a new method for generating synthetic electrogastrogram time series. We used electrogastrography (EGG) data from an open database to set model parameters and statistical tests to evaluate synthesized data. Additionally, we illustrated method customization for generating artificial EGG time series alterations caused by the simulator sickness. Proposed data augmentation method generates synthetic EGG data with specified duration, sampling frequency, recording state (postprandial or fasting state), overall noise and breathing artifact injection, and pauses in the gastric rhythm (arrhythmia occurrence) with statistically significant difference between postprandial and fasting states in > 70% cases while not accounting for individual differences. Features obtained from the synthetic EGG signal resembling simulator sickness occurrence displayed expected trends. The code for generation of synthetic EGG time series is not only freely available and can be further customized to assess signal processing algorithms but also may be used to increase data diversity for training artificial intelligence (AI) algorithms. The proposed approach is customized for EGG data synthesis but can be easily utilized for other biosignals with similar nature such as electroencephalogram.
△ Less
Submitted 8 May, 2024; v1 submitted 4 March, 2023;
originally announced March 2023.
-
Effectiveness of a time to fixate for fitness to drive evaluation in neurological patients
Authors:
Nadica Miljković,
Jaka Sodnik
Abstract:
We present a method to automatically calculate time to fixate (TTF) from the eye-tracker data in subjects with neurological impairment using a driving simulator. TTF presents the time interval for a person to notice the stimulus from its first occurrence. Precisely, we measured the time since the children started to cross the street until the drivers directed their look to the children. From 108 n…
▽ More
We present a method to automatically calculate time to fixate (TTF) from the eye-tracker data in subjects with neurological impairment using a driving simulator. TTF presents the time interval for a person to notice the stimulus from its first occurrence. Precisely, we measured the time since the children started to cross the street until the drivers directed their look to the children. From 108 neurological patients recruited for the study, the analysis of TTF was performed in 56 patients to assess fit-, unfit-, and conditionally-fit-to-drive patients. The results showed that the proposed method based on the YOLO (you only look once) object detector is efficient for computing TTFs from the eye-tracker data. We obtained discriminative results for fit-to-drive patients by application of Tukey's honest significant difference post hoc test (p < 0.01), while no difference was observed between conditionally-fit and unfit-to-drive groups (p = 0.542). Moreover, we show that time-to-collision (TTC), initial gaze distance (IGD) from pedestrians, and speed at the hazard onset did not influence the result, while the only significant interaction is among fitness, IGD, and TTC on TTF. Obtained TTFs are also compared with the perception response times (PRT) calculated independently from eye-tracker data and YOLO. Although we reached statistically significant results that speak in favor of possible method application for assessment of fitness to drive, we provide detailed directions for future driving simulation-based evaluation and propose processing workflow to secure reliable TTF calculation and its possible application in for example psychology and neuroscience.
△ Less
Submitted 25 July, 2023; v1 submitted 18 May, 2022;
originally announced May 2022.
