-
A Conceptual Framework for AI-based Decision Systems in Critical Infrastructures
Authors:
Milad Leyli-abadi,
Ricardo J. Bessa,
Jan Viebahn,
Daniel Boos,
Clark Borst,
Alberto Castagna,
Ricardo Chavarriaga,
Mohamed Hassouna,
Bruno Lemetayer,
Giulia Leto,
Antoine Marot,
Maroua Meddeb,
Manuel Meyer,
Viola Schiaffonati,
Manuel Schneider,
Toni Waefler
Abstract:
The interaction between humans and AI in safety-critical systems presents a unique set of challenges that remain partially addressed by existing frameworks. These challenges stem from the complex interplay of requirements for transparency, trust, and explainability, coupled with the necessity for robust and safe decision-making. A framework that holistically integrates human and AI capabilities wh…
▽ More
The interaction between humans and AI in safety-critical systems presents a unique set of challenges that remain partially addressed by existing frameworks. These challenges stem from the complex interplay of requirements for transparency, trust, and explainability, coupled with the necessity for robust and safe decision-making. A framework that holistically integrates human and AI capabilities while addressing these concerns is notably required, bridging the critical gaps in designing, deploying, and maintaining safe and effective systems. This paper proposes a holistic conceptual framework for critical infrastructures by adopting an interdisciplinary approach. It integrates traditionally distinct fields such as mathematics, decision theory, computer science, philosophy, psychology, and cognitive engineering and draws on specialized engineering domains, particularly energy, mobility, and aeronautics. The flexibility in its adoption is also demonstrated through its instantiation on an already existing framework.
△ Less
Submitted 21 April, 2025;
originally announced April 2025.
-
Towards a Governance Framework for Brain Data
Authors:
Marcello Ienca,
Joseph J. Fins,
Ralf J. Jox,
Fabrice Jotterand,
Silja Voeneky,
Roberto Andorno,
Tonio Ball,
Claude Castelluccia,
Ricardo Chavarriaga,
Hervé Chneiweiss,
Agata Ferretti,
Orsolya Friedrich,
Samia Hurst,
Grischa Merkel,
Fruzsina Molnar-Gabor,
Jean-Marc Rickli,
James Scheibner,
Effy Vayena,
Rafael Yuste,
Philipp Kellmeyer
Abstract:
The increasing availability of brain data within and outside the biomedical field, combined with the application of artificial intelligence (AI) to brain data analysis, poses a challenge for ethics and governance. We identify distinctive ethical implications of brain data acquisition and processing, and outline a multi-level governance framework. This framework is aimed at maximizing the benefits…
▽ More
The increasing availability of brain data within and outside the biomedical field, combined with the application of artificial intelligence (AI) to brain data analysis, poses a challenge for ethics and governance. We identify distinctive ethical implications of brain data acquisition and processing, and outline a multi-level governance framework. This framework is aimed at maximizing the benefits of facilitated brain data collection and further processing for science and medicine whilst minimizing risks and preventing harmful use. The framework consists of four primary areas of regulatory intervention: binding regulation, ethics and soft law, responsible innovation, and human rights.
△ Less
Submitted 28 September, 2021; v1 submitted 24 September, 2021;
originally announced September 2021.
-
EEG-Based Brain-Computer Interfaces Are Vulnerable to Backdoor Attacks
Authors:
Lubin Meng,
Jian Huang,
Zhigang Zeng,
Xue Jiang,
Shan Yu,
Tzyy-Ping Jung,
Chin-Teng Lin,
Ricardo Chavarriaga,
Dongrui Wu
Abstract:
Research and development of electroencephalogram (EEG) based brain-computer interfaces (BCIs) have advanced rapidly, partly due to deeper understanding of the brain and wide adoption of sophisticated machine learning approaches for decoding the EEG signals. However, recent studies have shown that machine learning algorithms are vulnerable to adversarial attacks. This article proposes to use narrow…
▽ More
Research and development of electroencephalogram (EEG) based brain-computer interfaces (BCIs) have advanced rapidly, partly due to deeper understanding of the brain and wide adoption of sophisticated machine learning approaches for decoding the EEG signals. However, recent studies have shown that machine learning algorithms are vulnerable to adversarial attacks. This article proposes to use narrow period pulse for poisoning attack of EEG-based BCIs, which is implementable in practice and has never been considered before. One can create dangerous backdoors in the machine learning model by injecting poisoning samples into the training set. Test samples with the backdoor key will then be classified into the target class specified by the attacker. What most distinguishes our approach from previous ones is that the backdoor key does not need to be synchronized with the EEG trials, making it very easy to implement. The effectiveness and robustness of the backdoor attack approach is demonstrated, highlighting a critical security concern for EEG-based BCIs and calling for urgent attention to address it.
△ Less
Submitted 2 January, 2021; v1 submitted 30 October, 2020;
originally announced November 2020.
-
Tiny noise, big mistakes: Adversarial perturbations induce errors in Brain-Computer Interface spellers
Authors:
Xiao Zhang,
Dongrui Wu,
Lieyun Ding,
Hanbin Luo,
Chin-Teng Lin,
Tzyy-Ping Jung,
Ricardo Chavarriaga
Abstract:
An electroencephalogram (EEG) based brain-computer interface (BCI) speller allows a user to input text to a computer by thought. It is particularly useful to severely disabled individuals, e.g., amyotrophic lateral sclerosis patients, who have no other effective means of communication with another person or a computer. Most studies so far focused on making EEG-based BCI spellers faster and more re…
▽ More
An electroencephalogram (EEG) based brain-computer interface (BCI) speller allows a user to input text to a computer by thought. It is particularly useful to severely disabled individuals, e.g., amyotrophic lateral sclerosis patients, who have no other effective means of communication with another person or a computer. Most studies so far focused on making EEG-based BCI spellers faster and more reliable; however, few have considered their security. This study, for the first time, shows that P300 and steady-state visual evoked potential BCI spellers are very vulnerable, i.e., they can be severely attacked by adversarial perturbations, which are too tiny to be noticed when added to EEG signals, but can mislead the spellers to spell anything the attacker wants. The consequence could range from merely user frustration to severe misdiagnosis in clinical applications. We hope our research can attract more attention to the security of EEG-based BCI spellers, and more broadly, EEG-based BCIs, which has received little attention before.
△ Less
Submitted 16 July, 2020; v1 submitted 30 January, 2020;
originally announced January 2020.
-
Applying Transfer Learning To Deep Learned Models For EEG Analysis
Authors:
Axel Uran,
Coert van Gemeren,
Rosanne van Diepen,
Ricardo Chavarriaga,
José del R. Millán
Abstract:
The introduction of deep learning and transfer learning techniques in fields such as computer vision allowed a leap forward in the accuracy of image classification tasks. Currently there is only limited use of such techniques in neuroscience. The challenge of using deep learning methods to successfully train models in neuroscience, lies in the complexity of the information that is processed, the a…
▽ More
The introduction of deep learning and transfer learning techniques in fields such as computer vision allowed a leap forward in the accuracy of image classification tasks. Currently there is only limited use of such techniques in neuroscience. The challenge of using deep learning methods to successfully train models in neuroscience, lies in the complexity of the information that is processed, the availability of data and the cost of producing sufficient high quality annotations. Inspired by its application in computer vision, we introduce transfer learning on electrophysiological data to enable training a model with limited amounts of data. Our method was tested on the dataset of the BCI competition IV 2a and compared to the top results that were obtained using traditional machine learning techniques. Using our DL model we outperform the top result of the competition by 33%. We also explore transferability of knowledge between trained models over different experiments, called inter-experimental transfer learning. This reduces the amount of required data even further and is especially useful when few subjects are available. This method is able to outperform the standard deep learning methods used in the BCI competition IV 2b approaches by 18%. In this project we propose a method that can produce reliable electroencephalography (EEG) signal classification, based on modest amounts of training data through the use of transfer learning.
△ Less
Submitted 2 July, 2019;
originally announced July 2019.
