-
EEG-Based Auditory BCI for Communication in a Completely Locked-In Patient Using Volitional Frequency Band Modulation
Authors:
Deland Liu,
Frigyes Samuel Racz,
Zoe Lalji,
Jose del R. Millan
Abstract:
Patients with amyotrophic lateral sclerosis (ALS) in the completely locked-in state (CLIS) can lose all reliable motor control and are left without any means of communication. It remains unknown whether non-invasive electroencephalogram (EEG) based brain-computer interfaces (BCIs) can support volitional communication in CLIS. Here, we show that a CLIS patient was able to operate an EEG-based BCI a…
▽ More
Patients with amyotrophic lateral sclerosis (ALS) in the completely locked-in state (CLIS) can lose all reliable motor control and are left without any means of communication. It remains unknown whether non-invasive electroencephalogram (EEG) based brain-computer interfaces (BCIs) can support volitional communication in CLIS. Here, we show that a CLIS patient was able to operate an EEG-based BCI across multiple online sessions to respond to both general knowledge and personally relevant assistive questions. The patient delivered "Yes"/"No" responses by volitionally modulating alpha and beta band power at different channels, guided by real-time auditory feedback from the BCI. The patient communicated assistive needs above chance in all sessions, achieving a perfect score in the final session. Performance on general knowledge questions varied across sessions, with two sessions showing accurate and above-chance responses, while the first and last sessions remained at chance level. The patient also showed consistent modulation patterns over time. These findings suggest that non-invasive BCIs may offer a potential pathway for restoring basic communication in CLIS.
△ Less
Submitted 30 June, 2025;
originally announced July 2025.
-
A comparison of rational and neural network based approximations
Authors:
Vinesha Peiris,
Reinier Diaz Millan,
Nadezda Sukhorukova,
Julien Ugon
Abstract:
Rational and neural network based approximations are efficient tools in modern approximation. These approaches are able to produce accurate approximations to nonsmooth and non-Lipschitz functions, including multivariate domain functions. In this paper we compare the efficiency of function approximation using rational approximation, neural network and their combinations. It was found that rational…
▽ More
Rational and neural network based approximations are efficient tools in modern approximation. These approaches are able to produce accurate approximations to nonsmooth and non-Lipschitz functions, including multivariate domain functions. In this paper we compare the efficiency of function approximation using rational approximation, neural network and their combinations. It was found that rational approximation is superior to neural network based approaches with the same number of decision variables. Our numerical experiments demonstrate the efficiency of rational approximation, even when the number of approximation parameters (that is, the dimension of the corresponding optimisation problems) is small. Another important contribution of this paper lies in the improvement of rational approximation algorithms. Namely, the optimisation based algorithms for rational approximation can be adjusted to in such a way that the conditioning number of the constraint matrices are controlled. This simple adjustment enables us to work with high dimension optimisation problems and improve the design of the neural network. The main strength of neural networks is in their ability to handle models with a large number of variables: complex models are decomposed in several simple optimisation problems. Therefore the the large number of decision variables is in the nature of neural networks.
△ Less
Submitted 6 September, 2023; v1 submitted 8 March, 2023;
originally announced March 2023.
-
Quantum Circuit Compiler for a Shuttling-Based Trapped-Ion Quantum Computer
Authors:
Fabian Kreppel,
Christian Melzer,
Diego Olvera Millán,
Janis Wagner,
Janine Hilder,
Ulrich Poschinger,
Ferdinand Schmidt-Kaler,
André Brinkmann
Abstract:
The increasing capabilities of quantum computing hardware and the challenge of realizing deep quantum circuits require fully automated and efficient tools for compiling quantum circuits. To express arbitrary circuits in a sequence of native gates specific to the quantum computer architecture, it is necessary to make algorithms portable across the landscape of quantum hardware providers. In this wo…
▽ More
The increasing capabilities of quantum computing hardware and the challenge of realizing deep quantum circuits require fully automated and efficient tools for compiling quantum circuits. To express arbitrary circuits in a sequence of native gates specific to the quantum computer architecture, it is necessary to make algorithms portable across the landscape of quantum hardware providers. In this work, we present a compiler capable of transforming and optimizing a quantum circuit targeting a shuttling-based trapped-ion quantum processor. It consists of custom algorithms set on top of the quantum circuit framework Pytket. The performance was evaluated for a wide range of quantum circuits and the results show that the gate counts can be reduced by factors up to 5.1 compared to standard Pytket and up to 2.2 compared to standard Qiskit compilation.
△ Less
Submitted 2 November, 2023; v1 submitted 5 July, 2022;
originally announced July 2022.
-
Brain Signals to Rescue Aphasia, Apraxia and Dysarthria Speech Recognition
Authors:
Gautam Krishna,
Mason Carnahan,
Shilpa Shamapant,
Yashitha Surendranath,
Saumya Jain,
Arundhati Ghosh,
Co Tran,
Jose del R Millan,
Ahmed H Tewfik
Abstract:
In this paper, we propose a deep learning-based algorithm to improve the performance of automatic speech recognition (ASR) systems for aphasia, apraxia, and dysarthria speech by utilizing electroencephalography (EEG) features recorded synchronously with aphasia, apraxia, and dysarthria speech. We demonstrate a significant decoding performance improvement by more than 50\% during test time for isol…
▽ More
In this paper, we propose a deep learning-based algorithm to improve the performance of automatic speech recognition (ASR) systems for aphasia, apraxia, and dysarthria speech by utilizing electroencephalography (EEG) features recorded synchronously with aphasia, apraxia, and dysarthria speech. We demonstrate a significant decoding performance improvement by more than 50\% during test time for isolated speech recognition task and we also provide preliminary results indicating performance improvement for the more challenging continuous speech recognition task by utilizing EEG features. The results presented in this paper show the first step towards demonstrating the possibility of utilizing non-invasive neural signals to design a real-time robust speech prosthetic for stroke survivors recovering from aphasia, apraxia, and dysarthria. Our aphasia, apraxia, and dysarthria speech-EEG data set will be released to the public to help further advance this interesting and crucial research.
△ Less
Submitted 17 July, 2021; v1 submitted 27 February, 2021;
originally announced March 2021.
-
Applying Transfer Learning To Deep Learned Models For EEG Analysis
Authors:
Axel Uran,
Coert van Gemeren,
Rosanne van Diepen,
Ricardo Chavarriaga,
José del R. Millán
Abstract:
The introduction of deep learning and transfer learning techniques in fields such as computer vision allowed a leap forward in the accuracy of image classification tasks. Currently there is only limited use of such techniques in neuroscience. The challenge of using deep learning methods to successfully train models in neuroscience, lies in the complexity of the information that is processed, the a…
▽ More
The introduction of deep learning and transfer learning techniques in fields such as computer vision allowed a leap forward in the accuracy of image classification tasks. Currently there is only limited use of such techniques in neuroscience. The challenge of using deep learning methods to successfully train models in neuroscience, lies in the complexity of the information that is processed, the availability of data and the cost of producing sufficient high quality annotations. Inspired by its application in computer vision, we introduce transfer learning on electrophysiological data to enable training a model with limited amounts of data. Our method was tested on the dataset of the BCI competition IV 2a and compared to the top results that were obtained using traditional machine learning techniques. Using our DL model we outperform the top result of the competition by 33%. We also explore transferability of knowledge between trained models over different experiments, called inter-experimental transfer learning. This reduces the amount of required data even further and is especially useful when few subjects are available. This method is able to outperform the standard deep learning methods used in the BCI competition IV 2b approaches by 18%. In this project we propose a method that can produce reliable electroencephalography (EEG) signal classification, based on modest amounts of training data through the use of transfer learning.
△ Less
Submitted 2 July, 2019;
originally announced July 2019.
-
Cell-based Maximum Entropy Approximants for Three Dimensional Domains: Application in Large Strain Elastodynamics using the Meshless Total Lagrangian Explicit Dynamics Method
Authors:
Konstantinos A. Mountris,
George C. Bourantas,
Daniel Millán,
Grand R. Joldes,
Karol Miller,
Esther Pueyo,
Adam Wittek
Abstract:
We present the Cell-based Maximum Entropy (CME) approximants in E3 space by constructing the smooth approximation distance function to polyhedral surfaces. CME is a meshfree approximation method combining the properties of the Maximum Entropy approximants and the compact support of element-based interpolants. The method is evaluated in problems of large strain elastodynamics for three-dimensional…
▽ More
We present the Cell-based Maximum Entropy (CME) approximants in E3 space by constructing the smooth approximation distance function to polyhedral surfaces. CME is a meshfree approximation method combining the properties of the Maximum Entropy approximants and the compact support of element-based interpolants. The method is evaluated in problems of large strain elastodynamics for three-dimensional (3D) continua using the well-established Meshless Total Lagrangian Explicit Dynamics (MTLED) method. The accuracy and efficiency of the method is assessed in several numerical examples in terms of computational time, accuracy in boundary conditions imposition, and strain energy density error. Due to the smoothness of CME basis functions, the numerical stability in explicit time integration is preserved for large time step. The challenging task of essential boundary conditions imposition in non-interpolating meshless methods (e.g., Moving Least Squares) is eliminated in CME due to the weak Kronecker-delta property. The essential boundary conditions are imposed directly, similar to the Finite Element Method. CME is proven a valuable alternative to other meshless and element-based methods for large-scale elastodynamics in 3D.
△ Less
Submitted 29 October, 2019; v1 submitted 13 May, 2019;
originally announced May 2019.
-
Exploring Embedding Methods in Binary Hyperdimensional Computing: A Case Study for Motor-Imagery based Brain-Computer Interfaces
Authors:
Michael Hersche,
José del R. Millán,
Luca Benini,
Abbas Rahimi
Abstract:
Key properties of brain-inspired hyperdimensional (HD) computing make it a prime candidate for energy-efficient and fast learning in biosignal processing. The main challenge is however to formulate embedding methods that map biosignal measures to a binary HD space. In this paper, we explore variety of such embedding methods and examine them with a challenging application of motor imagery brain-com…
▽ More
Key properties of brain-inspired hyperdimensional (HD) computing make it a prime candidate for energy-efficient and fast learning in biosignal processing. The main challenge is however to formulate embedding methods that map biosignal measures to a binary HD space. In this paper, we explore variety of such embedding methods and examine them with a challenging application of motor imagery brain-computer interface (MI-BCI) from electroencephalography (EEG) recordings. We explore embedding methods including random projections, quantization based thermometer and Gray coding, and learning HD representations using end-to-end training. All these methods, differing in complexity, aim to represent EEG signals in binary HD space, e.g. with 10,000 bits. This leads to development of a set of HD learning and classification methods that can be selectively chosen (or configured) based on accuracy and/or computational complexity requirements of a given task. We compare them with state-of-the-art linear support vector machine (SVM) on an NVIDIA TX2 board using the 4-class BCI competition IV-2a dataset as well as a new 3-class dataset. Compared to SVM, results on 3-class dataset show that simple thermometer embedding achieves moderate average accuracy (79.56% vs. 82.67%) with 26.8$\times$ faster training time and 22.3$\times$ lower energy; on the other hand, switching to end-to-end training with learned HD representations wipes out these training benefits while boosting the accuracy to 84.22% (1.55% higher than SVM). Similar trend is observed on the 4-class dataset where SVM achieves on average 74.29%: the thermometer embedding achieves 89.9$\times$ faster training time and 58.7$\times$ lower energy, but a lower accuracy (67.09%) than the learned representation of 72.54%.
△ Less
Submitted 30 December, 2018; v1 submitted 13 December, 2018;
originally announced December 2018.
