-
Predicting Workload in Virtual Flight Simulations using EEG Features (Including Post-hoc Analysis in Appendix)
Authors:
Bas Verkennis,
Evy van Weelden,
Francesca L. Marogna,
Maryam Alimardani,
Travis J. Wiltshire,
Max M. Louwerse
Abstract:
Effective cognitive workload management has a major impact on the safety and performance of pilots. Integrating brain-computer interfaces (BCIs) presents an opportunity for real-time workload assessment. Leveraging cognitive workload data from high-fidelity virtual reality (VR) flight simulations allows for dynamic adjustments to training scenarios. While prior studies have predominantly concentra…
▽ More
Effective cognitive workload management has a major impact on the safety and performance of pilots. Integrating brain-computer interfaces (BCIs) presents an opportunity for real-time workload assessment. Leveraging cognitive workload data from high-fidelity virtual reality (VR) flight simulations allows for dynamic adjustments to training scenarios. While prior studies have predominantly concentrated on EEG spectral power for workload prediction, delving into intra-brain connectivity may yield deeper insights. This study assessed the predictive value of EEG spectral and connectivity features in distinguishing high vs. low workload periods during simulated flight in VR and Desktop conditions. Using an ensemble approach, a stacked classifier was trained to predict workload from the EEG signals of 52 participants. Results showed that the mean accuracy of the model incorporating both spectral and connectivity features improved by 28% compared to the model that solely relied on spectral features. Further research on other connectivity metrics and deep learning models in a large sample of pilots is essential to validate the potential of a real-time workload-prediction BCI. This could contribute to the development of an adaptive training system for safety-critical operational environments.
△ Less
Submitted 11 March, 2025; v1 submitted 16 December, 2024;
originally announced December 2024.
-
Differentiating Workload using Pilot's Stick Input in a Virtual Reality Flight Task
Authors:
Evy van Weelden,
Carl W. E. van Beek,
Maryam Alimardani,
Travis J. Wiltshire,
Wietse D. Ledegang,
Eric L. Groen,
Max M. Louwerse
Abstract:
High-risk operational tasks such as those in aviation require training environments that are realistic and capable of inducing high levels of workload. Virtual Reality (VR) offers a simulated 3D environment for immersive, safe and valid training of pilots. An added advantage of such training environments is that they can be personalized to enhance learning, e.g., by adapting the simulation to the…
▽ More
High-risk operational tasks such as those in aviation require training environments that are realistic and capable of inducing high levels of workload. Virtual Reality (VR) offers a simulated 3D environment for immersive, safe and valid training of pilots. An added advantage of such training environments is that they can be personalized to enhance learning, e.g., by adapting the simulation to the user's workload in real-time. The question remains how to reliably and robustly measure a pilot's workload during the training. In this study, six novice military pilots (average of 34.33 flight hours) conducted a speed change maneuver in a VR flight simulator. In half of the runs an auditory 2-back task was added as a secondary task. This led to trials of low and high workload which we compared using the pilot's control input in longitudinal (i.e., pitch) and lateral (i.e., roll) directions. We extracted Pilot Inceptor Workload (PIW) from the stick data and conducted a binary logistic regression to determine whether PIW is predictive of task-induced workload. The results show that inputs on the stick along its longitudinal direction were predictive of workload (low vs. high) when performing a speed change maneuver. Given that PIW may be a task-specific measure, future work may consider (neuro)physiological predictors. Nonetheless, the current paper provides evidence that measuring PIW in a VR flight simulator yields real-time and non-invasive means to determine workload.
△ Less
Submitted 19 September, 2023; v1 submitted 18 September, 2023;
originally announced September 2023.
-
Local Exceptionality Detection in Time Series Using Subgroup Discovery
Authors:
Dan Hudson,
Travis J. Wiltshire,
Martin Atzmueller
Abstract:
In this paper, we present a novel approach for local exceptionality detection on time series data. This method provides the ability to discover interpretable patterns in the data, which can be used to understand and predict the progression of a time series. This being an exploratory approach, the results can be used to generate hypotheses about the relationships between the variables describing a…
▽ More
In this paper, we present a novel approach for local exceptionality detection on time series data. This method provides the ability to discover interpretable patterns in the data, which can be used to understand and predict the progression of a time series. This being an exploratory approach, the results can be used to generate hypotheses about the relationships between the variables describing a specific process and its dynamics. We detail our approach in a concrete instantiation and exemplary implementation, specifically in the field of teamwork research. Using a real-world dataset of team interactions we include results from an example data analytics application of our proposed approach, showcase novel analysis options, and discuss possible implications of the results from the perspective of teamwork research.
△ Less
Submitted 5 August, 2021;
originally announced August 2021.
-
Social Analytics of Team Interaction using Dynamic Complexity Heat Maps and Network Visualizations
Authors:
Travis J. Wiltshire,
Dan Hudson,
Philia Lijdsman,
Stijn Wever,
Martin Atzmueller
Abstract:
Given the increasing complexity of many sociotechnical work domains, effective teamwork has become increasingly crucial. While there is evidence that face-to-face communication contributes to effective teamwork, methods for understanding the time-varying nature and structure of team communication are limited. In this work, we combine sensor-based social analytics of Sociometric badges (Rhythm Badg…
▽ More
Given the increasing complexity of many sociotechnical work domains, effective teamwork has become increasingly crucial. While there is evidence that face-to-face communication contributes to effective teamwork, methods for understanding the time-varying nature and structure of team communication are limited. In this work, we combine sensor-based social analytics of Sociometric badges (Rhythm Badge) with two visualization techniques (Dynamic Complexity Heat Maps and Network Visualizations) to advance an intuitive way of understanding the dynamics of team interaction. To demonstrate the utility of our approach, we provide a case study that examines one team's interaction for a Lost at Sea simulation. We were able to recover transitions in the task and team interaction as well as uncover structural changes in team member energy and engagement, which we visualize using networks. Taken together, this work represents an important first step at optimizing team effectiveness by identifying critical transitions/events in team communication and interaction patterns.
△ Less
Submitted 5 August, 2021; v1 submitted 7 September, 2020;
originally announced September 2020.
