-
MYND: Unsupervised Evaluation of Novel BCI Control Strategies on Consumer Hardware
Authors:
Matthias R. Hohmann,
Lisa Konieczny,
Michelle Hackl,
Brian Wirth,
Talha Zaman,
Raffi Enficiaud,
Moritz Grosse-Wentrup,
Bernhard Schölkopf
Abstract:
Neurophysiological studies are typically conducted in laboratories with limited ecological validity, scalability, and generalizability of findings. This is a significant challenge for the development of brain-computer interfaces (BCIs), which ultimately need to function in unsupervised settings on consumer-grade hardware. We introduce MYND: A framework that couples consumer-grade recording hardwar…
▽ More
Neurophysiological studies are typically conducted in laboratories with limited ecological validity, scalability, and generalizability of findings. This is a significant challenge for the development of brain-computer interfaces (BCIs), which ultimately need to function in unsupervised settings on consumer-grade hardware. We introduce MYND: A framework that couples consumer-grade recording hardware with an easy-to-use application for the unsupervised evaluation of BCI control strategies. Subjects are guided through experiment selection, hardware fitting, recording, and data upload in order to self-administer multi-day studies that include neurophysiological recordings and questionnaires. As a use case, we evaluate two BCI control strategies ("Positive memories" and "Music imagery") in a realistic scenario by combining MYND with a four-channel electroencephalogram (EEG). Thirty subjects recorded 70.4 hours of EEG data with the system at home. The median headset fitting time was 25.9 seconds, and a median signal quality of 90.2% was retained during recordings.Neural activity in both control strategies could be decoded with an average offline accuracy of 68.5% and 64.0% across all days. The repeated unsupervised execution of the same strategy affected performance, which could be tackled by implementing feedback to let subjects switch between strategies or devise new strategies with the platform.
△ Less
Submitted 15 March, 2020; v1 submitted 26 February, 2020;
originally announced February 2020.
-
Neural Signatures of Motor Skill in the Resting Brain
Authors:
Ozan Özdenizci,
Timm Meyer,
Felix Wichmann,
Jan Peters,
Bernhard Schölkopf,
Müjdat Çetin,
Moritz Grosse-Wentrup
Abstract:
Stroke-induced disturbances of large-scale cortical networks are known to be associated with the extent of motor deficits. We argue that identifying brain networks representative of motor behavior in the resting brain would provide significant insights for current neurorehabilitation approaches. Particularly, we aim to investigate the global configuration of brain rhythms and their relation to mot…
▽ More
Stroke-induced disturbances of large-scale cortical networks are known to be associated with the extent of motor deficits. We argue that identifying brain networks representative of motor behavior in the resting brain would provide significant insights for current neurorehabilitation approaches. Particularly, we aim to investigate the global configuration of brain rhythms and their relation to motor skill, instead of learning performance as broadly studied. We empirically approach this problem by conducting a three-dimensional physical space visuomotor learning experiment during electroencephalographic (EEG) data recordings with thirty-seven healthy participants. We demonstrate that across-subjects variations in average movement smoothness as the quantified measure of subjects' motor skills can be predicted from the global configuration of resting-state EEG alpha-rhythms (8-14 Hz) recorded prior to the experiment. Importantly, this neural signature of motor skill was found to be orthogonal to (independent of) task -- as well as to learning-related changes in alpha-rhythms, which we interpret as an organizing principle of the brain. We argue that disturbances of such configurations in the brain may contribute to motor deficits in stroke, and that reconfiguring stroke patients' brain rhythms by neurofeedback may enhance post-stroke neurorehabilitation.
△ Less
Submitted 22 July, 2019;
originally announced July 2019.
-
Beta Power May Mediate the Effect of Gamma-TACS on Motor Performance
Authors:
Atalanti A. Mastakouri,
Bernhard Schölkopf,
Moritz Grosse-Wentrup
Abstract:
Transcranial alternating current stimulation (tACS) is becoming an important method in the field of motor rehabilitation because of its ability to non-invasively influence ongoing brain oscillations at arbitrary frequencies. However, substantial variations in its effect across individuals are reported, making tACS a currently unreliable treatment tool. One reason for this variability is the lack o…
▽ More
Transcranial alternating current stimulation (tACS) is becoming an important method in the field of motor rehabilitation because of its ability to non-invasively influence ongoing brain oscillations at arbitrary frequencies. However, substantial variations in its effect across individuals are reported, making tACS a currently unreliable treatment tool. One reason for this variability is the lack of knowledge about the exact way tACS entrains and interacts with ongoing brain oscillations. The present crossover stimulation study on 20 healthy subjects contributes to the understanding of cross-frequency effects of gamma (70 Hz) tACS over the contralateral motor cortex by providing empirical evidence which is consistent with a role of low- (12~-20 Hz) and high- (20-~30 Hz) beta power as a mediator of gamma-tACS on motor performance.
△ Less
Submitted 1 May, 2019;
originally announced May 2019.
-
The right tool for the right question --- beyond the encoding versus decoding dichotomy
Authors:
Sebastian Weichwald,
Moritz Grosse-Wentrup
Abstract:
There are two major questions that neuroimaging studies attempt to answer: First, how are sensory stimuli represented in the brain (which we term the stimulus-based setting)? And, second, how does the brain generate cognition (termed the response-based setting)? There has been a lively debate in the neuroimaging community whether encoding and decoding models can provide insights into these questio…
▽ More
There are two major questions that neuroimaging studies attempt to answer: First, how are sensory stimuli represented in the brain (which we term the stimulus-based setting)? And, second, how does the brain generate cognition (termed the response-based setting)? There has been a lively debate in the neuroimaging community whether encoding and decoding models can provide insights into these questions. In this commentary, we construct two simple and analytically tractable examples to demonstrate that while an encoding model analysis helps with the former, neither model is appropriate to satisfactorily answer the latter question. Consequently, we argue that if we want to understand how the brain generates cognition, we need to move beyond the encoding versus decoding dichotomy and instead discuss and develop tools that are specifically tailored to our endeavour.
△ Less
Submitted 28 April, 2017;
originally announced April 2017.
-
A note on the expected minimum error probability in equientropic channels
Authors:
Sebastian Weichwald,
Tatiana Fomina,
Bernhard Schölkopf,
Moritz Grosse-Wentrup
Abstract:
While the channel capacity reflects a theoretical upper bound on the achievable information transmission rate in the limit of infinitely many bits, it does not characterise the information transfer of a given encoding routine with finitely many bits. In this note, we characterise the quality of a code (i. e. a given encoding routine) by an upper bound on the expected minimum error probability that…
▽ More
While the channel capacity reflects a theoretical upper bound on the achievable information transmission rate in the limit of infinitely many bits, it does not characterise the information transfer of a given encoding routine with finitely many bits. In this note, we characterise the quality of a code (i. e. a given encoding routine) by an upper bound on the expected minimum error probability that can be achieved when using this code. We show that for equientropic channels this upper bound is minimal for codes with maximal marginal entropy. As an instructive example we show for the additive white Gaussian noise (AWGN) channel that random coding---also a capacity achieving code---indeed maximises the marginal entropy in the limit of infinite messages.
△ Less
Submitted 4 April, 2017; v1 submitted 23 May, 2016;
originally announced May 2016.
-
Causal and anti-causal learning in pattern recognition for neuroimaging
Authors:
Sebastian Weichwald,
Bernhard Schölkopf,
Tonio Ball,
Moritz Grosse-Wentrup
Abstract:
Pattern recognition in neuroimaging distinguishes between two types of models: encoding- and decoding models. This distinction is based on the insight that brain state features, that are found to be relevant in an experimental paradigm, carry a different meaning in encoding- than in decoding models. In this paper, we argue that this distinction is not sufficient: Relevant features in encoding- and…
▽ More
Pattern recognition in neuroimaging distinguishes between two types of models: encoding- and decoding models. This distinction is based on the insight that brain state features, that are found to be relevant in an experimental paradigm, carry a different meaning in encoding- than in decoding models. In this paper, we argue that this distinction is not sufficient: Relevant features in encoding- and decoding models carry a different meaning depending on whether they represent causal- or anti-causal relations. We provide a theoretical justification for this argument and conclude that causal inference is essential for interpretation in neuroimaging.
△ Less
Submitted 15 December, 2015;
originally announced December 2015.
-
Decoding index finger position from EEG using random forests
Authors:
Sebastian Weichwald,
Timm Meyer,
Bernhard Schölkopf,
Tonio Ball,
Moritz Grosse-Wentrup
Abstract:
While invasively recorded brain activity is known to provide detailed information on motor commands, it is an open question at what level of detail information about positions of body parts can be decoded from non-invasively acquired signals. In this work it is shown that index finger positions can be differentiated from non-invasive electroencephalographic (EEG) recordings in healthy human subjec…
▽ More
While invasively recorded brain activity is known to provide detailed information on motor commands, it is an open question at what level of detail information about positions of body parts can be decoded from non-invasively acquired signals. In this work it is shown that index finger positions can be differentiated from non-invasive electroencephalographic (EEG) recordings in healthy human subjects. Using a leave-one-subject-out cross-validation procedure, a random forest distinguished different index finger positions on a numerical keyboard above chance-level accuracy. Among the different spectral features investigated, high $β$-power (20-30 Hz) over contralateral sensorimotor cortex carried most information about finger position. Thus, these findings indicate that finger position is in principle decodable from non-invasive features of brain activity that generalize across individuals.
△ Less
Submitted 14 December, 2015;
originally announced December 2015.
-
MERLiN: Mixture Effect Recovery in Linear Networks
Authors:
Sebastian Weichwald,
Moritz Grosse-Wentrup,
Arthur Gretton
Abstract:
Causal inference concerns the identification of cause-effect relationships between variables, e.g. establishing whether a stimulus affects activity in a certain brain region. The observed variables themselves often do not constitute meaningful causal variables, however, and linear combinations need to be considered. In electroencephalographic studies, for example, one is not interested in establis…
▽ More
Causal inference concerns the identification of cause-effect relationships between variables, e.g. establishing whether a stimulus affects activity in a certain brain region. The observed variables themselves often do not constitute meaningful causal variables, however, and linear combinations need to be considered. In electroencephalographic studies, for example, one is not interested in establishing cause-effect relationships between electrode signals (the observed variables), but rather between cortical signals (the causal variables) which can be recovered as linear combinations of electrode signals.
We introduce MERLiN (Mixture Effect Recovery in Linear Networks), a family of causal inference algorithms that implement a novel means of constructing causal variables from non-causal variables. We demonstrate through application to EEG data how the basic MERLiN algorithm can be extended for application to different (neuroimaging) data modalities. Given an observed linear mixture, the algorithms can recover a causal variable that is a linear effect of another given variable. That is, MERLiN allows us to recover a cortical signal that is affected by activity in a certain brain region, while not being a direct effect of the stimulus. The Python/Matlab implementation for all presented algorithms is available on https://github.com/sweichwald/MERLiN
△ Less
Submitted 27 September, 2016; v1 submitted 3 December, 2015;
originally announced December 2015.
-
Transfer Learning in Brain-Computer Interfaces
Authors:
Vinay Jayaram,
Morteza Alamgir,
Yasemin Altun,
Bernhard Schölkopf,
Moritz Grosse-Wentrup
Abstract:
The performance of brain-computer interfaces (BCIs) improves with the amount of available training data, the statistical distribution of this data, however, varies across subjects as well as across sessions within individual subjects, limiting the transferability of training data or trained models between them. In this article, we review current transfer learning techniques in BCIs that exploit sh…
▽ More
The performance of brain-computer interfaces (BCIs) improves with the amount of available training data, the statistical distribution of this data, however, varies across subjects as well as across sessions within individual subjects, limiting the transferability of training data or trained models between them. In this article, we review current transfer learning techniques in BCIs that exploit shared structure between training data of multiple subjects and/or sessions to increase performance. We then present a framework for transfer learning in the context of BCIs that can be applied to any arbitrary feature space, as well as a novel regression estimation method that is specifically designed for the structure of a system based on the electroencephalogram (EEG). We demonstrate the utility of our framework and method on subject-to-subject transfer in a motor-imagery paradigm as well as on session-to-session transfer in one patient diagnosed with amyotrophic lateral sclerosis (ALS), showing that it is able to outperform other comparable methods on an identical dataset.
△ Less
Submitted 1 December, 2015;
originally announced December 2015.
-
Causal interpretation rules for encoding and decoding models in neuroimaging
Authors:
Sebastian Weichwald,
Timm Meyer,
Ozan Özdenizci,
Bernhard Schölkopf,
Tonio Ball,
Moritz Grosse-Wentrup
Abstract:
Causal terminology is often introduced in the interpretation of encoding and decoding models trained on neuroimaging data. In this article, we investigate which causal statements are warranted and which ones are not supported by empirical evidence. We argue that the distinction between encoding and decoding models is not sufficient for this purpose: relevant features in encoding and decoding model…
▽ More
Causal terminology is often introduced in the interpretation of encoding and decoding models trained on neuroimaging data. In this article, we investigate which causal statements are warranted and which ones are not supported by empirical evidence. We argue that the distinction between encoding and decoding models is not sufficient for this purpose: relevant features in encoding and decoding models carry a different meaning in stimulus- and in response-based experimental paradigms. We show that only encoding models in the stimulus-based setting support unambiguous causal interpretations. By combining encoding and decoding models trained on the same data, however, we obtain insights into causal relations beyond those that are implied by each individual model type. We illustrate the empirical relevance of our theoretical findings on EEG data recorded during a visuo-motor learning task.
△ Less
Submitted 15 November, 2015;
originally announced November 2015.
-
The Influence of Decoding Accuracy on Perceived Control: A Simulated BCI Study
Authors:
Pouyan R. Fard,
Moritz Grosse-Wentrup
Abstract:
Understanding the relationship between the decoding accuracy of a brain-computer interface (BCI) and a subject's subjective feeling of control is important for determining a lower limit on decoding accuracy for a BCI that is to be deployed outside a laboratory environment. We investigated this relationship by systematically varying the level of control in a simulated BCI task. We find that a binar…
▽ More
Understanding the relationship between the decoding accuracy of a brain-computer interface (BCI) and a subject's subjective feeling of control is important for determining a lower limit on decoding accuracy for a BCI that is to be deployed outside a laboratory environment. We investigated this relationship by systematically varying the level of control in a simulated BCI task. We find that a binary decoding accuracy of 65% is required for users to report more often than not that they are feeling in control of the system. Decoding accuracies above 75%, on the other hand, added little in terms of the level of perceived control. We further find that the probability of perceived control does not only depend on the actual decoding accuracy, but is also in influenced by whether subjects successfully complete the given task in the allotted time frame.
△ Less
Submitted 24 October, 2014;
originally announced October 2014.
