-
Comparison of P300 Responses in Auditory, Visual and Audiovisual Spatial Speller BCI Paradigms
Authors:
M. Chang,
N. Nishikawa,
Z. R. Struzik,
K. Mori,
S. Makino,
D. Mandic,
T. M. Rutkowski
Abstract:
The aim of this study is to provide a comprehensive test of three spatial speller settings, for the auditory, visual, and audiovisual paradigms. For rigour, the study is conducted with 16 BCI-naïve subjects in an experimental set-up based on five Japanese hiragana characters. Auditory P300 responses give encouragingly longer target vs. non-target latencies during the training phase, however, real-…
▽ More
The aim of this study is to provide a comprehensive test of three spatial speller settings, for the auditory, visual, and audiovisual paradigms. For rigour, the study is conducted with 16 BCI-naïve subjects in an experimental set-up based on five Japanese hiragana characters. Auditory P300 responses give encouragingly longer target vs. non-target latencies during the training phase, however, real-world online BCI experiments in the multimodal setting do not validate this potential advantage. Our case studies indicate that the auditory spatial unimodal paradigm needs further development in order to be a viable alternative to the established visual domain speller applications, as far as BCI-naïve subjects are concerned.
△ Less
Submitted 12 May, 2013; v1 submitted 27 January, 2013;
originally announced January 2013.
-
Psychophysical Responses Comparison in Spatial Visual, Audiovisual, and Auditory BCI-Spelling Paradigms
Authors:
Moonjeong Chang,
Nozomu Nishikawa,
Zhenyu Cai,
Shoji Makino,
Tomasz M. Rutkowski
Abstract:
The paper presents a pilot study conducted with spatial visual, audiovisual and auditory brain-computer-interface (BCI) based speller paradigms. The psychophysical experiments are conducted with healthy subjects in order to evaluate a difficulty and a possible response accuracy variability. We also present preliminary EEG results in offline BCI mode. The obtained results validate a thesis, that sp…
▽ More
The paper presents a pilot study conducted with spatial visual, audiovisual and auditory brain-computer-interface (BCI) based speller paradigms. The psychophysical experiments are conducted with healthy subjects in order to evaluate a difficulty and a possible response accuracy variability. We also present preliminary EEG results in offline BCI mode. The obtained results validate a thesis, that spatial auditory only paradigm performs as good as the traditional visual and audiovisual speller BCI tasks.
△ Less
Submitted 10 October, 2012;
originally announced October 2012.
-
The Spatial Real and Virtual Sound Stimuli Optimization for the Auditory BCI
Authors:
Nozomu Nishikawa,
Yoshihiro Matsumoto,
Shoji Makino,
Tomasz M. Rutkowski
Abstract:
The paper presents results from a project aiming to create horizontally distributed surround sound sources and virtual sound images as auditory BCI (aBCI) stimuli. The purpose is to create evoked brain wave response patterns depending on attended or ignored sound directions. We propose to use a modified version of the vector based amplitude panning (VBAP) approach to achieve the goal. The so creat…
▽ More
The paper presents results from a project aiming to create horizontally distributed surround sound sources and virtual sound images as auditory BCI (aBCI) stimuli. The purpose is to create evoked brain wave response patterns depending on attended or ignored sound directions. We propose to use a modified version of the vector based amplitude panning (VBAP) approach to achieve the goal. The so created spatial sound stimulus system for the novel oddball aBCI paradigm allows us to create a multi-command experimental environment with very encouraging results reported in this paper. We also present results showing that a modulation of the sound image depth changes also the subject responses. Finally, we also compare the proposed virtual sound approach with the traditional one based on real sound sources generated from the real loudspeaker directions. The so obtained results confirm the hypothesis of the possibility to modulate independently the brain responses to spatial types and depths of sound sources which allows for the development of the novel multi-command aBCI.
△ Less
Submitted 10 October, 2012;
originally announced October 2012.
-
Auditory Steady-State Response Stimuli based BCI Application - The Optimization of the Stimuli Types and Lengths
Authors:
Yoshihiro Matsumoto,
Nozomu Nishikawa,
Takeshi Yamada,
Shoji Makino,
Tomasz M. Rutkowski
Abstract:
We propose a method for an improvement of auditory BCI (aBCI) paradigm based on a combination of ASSR stimuli optimization by choosing the subjects' best responses to AM-, flutter-, AM/FM and click-envelope modulated sounds. As the ASSR response features we propose pairwise phase-locking-values calculated from the EEG and next classified using binary classifier to detect attended and ignored stimu…
▽ More
We propose a method for an improvement of auditory BCI (aBCI) paradigm based on a combination of ASSR stimuli optimization by choosing the subjects' best responses to AM-, flutter-, AM/FM and click-envelope modulated sounds. As the ASSR response features we propose pairwise phase-locking-values calculated from the EEG and next classified using binary classifier to detect attended and ignored stimuli. We also report on a possibility to use the stimuli as short as half a second, which is a step forward in ASSR based aBCI. The presented results are helpful for optimization of the aBCI stimuli for each subject.
△ Less
Submitted 10 October, 2012;
originally announced October 2012.
-
Haptic BCI Paradigm based on Somatosensory Evoked Potential
Authors:
Tomasz M. Rutkowski,
Hiromu Mori,
Yoshihiro Matsumoto,
Zhenyu Cai,
Moonjeong Chang,
Nozomu Nishikawa,
Shoji Makino,
Koichi Mori
Abstract:
A new concept and an online prototype of haptic BCI paradigm are presented. Our main goal is to develop a new, alternative and low cost paradigm, with open-source hardware and software components. We also report results obtained with the novel dry EEG electrodes based signal acquisition system by g.tec, which further improves experimental comfort. We address the following points: a novel applicati…
▽ More
A new concept and an online prototype of haptic BCI paradigm are presented. Our main goal is to develop a new, alternative and low cost paradigm, with open-source hardware and software components. We also report results obtained with the novel dry EEG electrodes based signal acquisition system by g.tec, which further improves experimental comfort. We address the following points: a novel application of the BCI; a new methodological approach used compared to earlier projects; a new benefit for potential users of a BCI; the approach working online/in real-time; development of a novel stimuli delivery hardware and software. The results with five healthy subjects and discussion of future developments conclude this submission.
△ Less
Submitted 10 October, 2012; v1 submitted 24 July, 2012;
originally announced July 2012.
