-
Evaluation of the Automatic Classifier AutoSense Sky OS for Pediatric Cochlear Implant Users using a Virtual Classroom Environment
Authors:
Maartje M. E. Hendrikse,
André Goedegebure,
Kars R. Tjepkema,
Jantien L. Vroegop
Abstract:
This study evaluated whether AutoSense Sky OS, an automatic classifier used in pediatric Advanced Bionics cochlear implants (CIs), improves speech intelligibility from the front without significantly impairing spatial awareness (i.e., sound detection and identification from all directions), with the main focus on the classroom situation. A double-blind crossover study was conducted with 12 pediatr…
▽ More
This study evaluated whether AutoSense Sky OS, an automatic classifier used in pediatric Advanced Bionics cochlear implants (CIs), improves speech intelligibility from the front without significantly impairing spatial awareness (i.e., sound detection and identification from all directions), with the main focus on the classroom situation. A double-blind crossover study was conducted with 12 pediatric CI users aged 7-16 years. Participants tested two settings: one with AutoSense Sky OS activated and the other with an omnidirectional microphone mode. Speech intelligibility from the front and spatial awareness were assessed in a virtual classroom environment using a Virtual Reality headset and a 12-loudspeaker array. Participants also rated the performance of each setting during a take-home period. A technical evaluation revealed that AutoSense Sky OS activated its directional microphone mode in the virtual classroom, and during the listening test this significantly improved speech intelligibility from the front while significantly reducing spatial awareness. While not all participants reported noticeable differences between settings in daily life, 8 out of 12 children preferred "AutoSense on", perceiving improved speech intelligibility in noisy environments. Conversely, some participants preferred "AutoSense off" due to poorer localization and speech intelligibility from behind with "AutoSense on". In conclusion, the automatic classifier provided improved speech understanding in noisy conditions such as a classroom, at the cost of a slightly reduced spatial awareness. The preference for AutoSense Sky OS among CI children and their parents appears to be a matter of individual trade-offs between improved speech intelligibility in noisy conditions and reduced spatial awareness.
△ Less
Submitted 25 April, 2025;
originally announced April 2025.
-
Auditory-visual scenes for hearing research
Authors:
Steven van de Par,
Stephan D. Ewert,
Lubos Hladek,
Christoph Kirsch,
Julia Schütze,
Josep Llorca-Bofí,
Giso Grimm,
Maartje M. E. Hendrikse,
Birger Kollmeier,
Bernhard U. Seeber
Abstract:
While experimentation with synthetic stimuli in abstracted listening situations has a long standing and successful history in hearing research, an increased interest exists on closing the remaining gap towards real-life listening by replicating situations with high ecological validity in the lab. This is important for understanding the underlying auditory mechanisms and their relevance in real-lif…
▽ More
While experimentation with synthetic stimuli in abstracted listening situations has a long standing and successful history in hearing research, an increased interest exists on closing the remaining gap towards real-life listening by replicating situations with high ecological validity in the lab. This is important for understanding the underlying auditory mechanisms and their relevance in real-life situations as well as for developing and evaluating increasingly sophisticated algorithms for hearing assistance. A range of 'classical' stimuli and paradigms have evolved to de-facto standards in psychoacoustics, which are simplistic and can be easily reproduced across laboratories. While they ideally allow for across laboratory comparisons and reproducible research, they, however, lack the acoustic stimulus complexity and the availability of visual information as observed in everyday life communication and listening situations. This contribution aims to provide and establish an extendable set of complex auditory-visual scenes for hearing research that allow for ecologically valid testing in realistic scenes while also supporting reproducibility and comparability of scientific results. Three virtual environments are provided (underground station, pub, living room), consisting of a detailed visual model, an acoustic geometry model with acoustic surface properties as well as a set of acoustic measurements in the respective real-world environments. The current data set enables i) audio-visual research in a reproducible set of environments, ii) comparison of room acoustic simulation methods with "ground truth" acoustic measurements, iii) a condensation point for future extensions and contributions for developments towards standardized test cases for ecologically valid hearing research in complex scenes.
△ Less
Submitted 1 November, 2021;
originally announced November 2021.
-
Interaction of hearing aids with self-motion and the influence of hearing impairment
Authors:
Maartje M. E. Hendrikse,
Theda Eichler,
Giso Grimm,
Volker Hohmann
Abstract:
When listening to a sound source in everyday-life situations, typical movement behavior can lead to a mismatch between the direction of the head and the direction of interest. This could reduce the performance of directional algorithms, as was shown in previous work for head movements of normal-hearing listeners. However, the movement behavior of hearing-impaired listeners and hearing aid users mi…
▽ More
When listening to a sound source in everyday-life situations, typical movement behavior can lead to a mismatch between the direction of the head and the direction of interest. This could reduce the performance of directional algorithms, as was shown in previous work for head movements of normal-hearing listeners. However, the movement behavior of hearing-impaired listeners and hearing aid users might be different, and if hearing aid users adapt their self-motion because of the directional algorithm, its performance might increase. In this work we therefore investigated the influence of hearing impairment on self-motion, and the interaction of hearing aids with self-motion. In order to do this, the self-motion of three hearing-impaired (HI) participant groups, aided with an adaptive differential microphone (ADM), aided without ADM, and unaided, was compared, also to previously measured self-motion data from younger and older normal-hearing (NH) participants. The self-motion was measured in virtual audiovisual environments (VEs) in the laboratory. Furthermore, the signal-to-noise ratios (SNRs) and SNR improvement of the ADM resulting from the head movements of the participants were estimated with acoustic simulations. A strong effect of hearing impairment on self-motion was found, which led to an overall increase in estimated SNR of 0.8 dB for the HI participants compared to the NH participants, and differences in estimated SNR improvement of the ADM. However, the self-motion of the HI participants aided with ADM and the other HI participants was very similar, indicating that they did not adapt their self-motion because of the ADM.
△ Less
Submitted 4 January, 2021;
originally announced January 2021.
-
Comparison of a Head-Mounted Display and a Curved Screen in a Multi-Talker Audiovisual Listening Task
Authors:
Gerard Llorach,
Maartje M. E. Hendrikse,
Giso Grimm,
Volker Hohmann
Abstract:
Introduction: Virtual audiovisual technology and its methodology has yet to be established for psychoacoustic research. This study examined the effects of different audiovisual conditions on preference when listening to multi-talker conversations. The study's goal is to explore and assess audiovisual technologies in the context of hearing research. Methods: The participants listened to audiovisual…
▽ More
Introduction: Virtual audiovisual technology and its methodology has yet to be established for psychoacoustic research. This study examined the effects of different audiovisual conditions on preference when listening to multi-talker conversations. The study's goal is to explore and assess audiovisual technologies in the context of hearing research. Methods: The participants listened to audiovisual conversations between four talkers. Two displays were tested and compared: a curved screen (CS) and a head-mounted display (HMD). Using three visual conditions (audio-only, virtual characters and video recordings), three groups of participants were tested: seventeen young normal-hearing, ten older normal-hearing, and ten older hearing-impaired listeners. Results: Open interviews showed that the CS was preferred over the HMD for older normal-hearing participants and that video recordings were the preferred visual condition. Young and older hearing-impaired participants did not show a preference between the CS and the HMD. Conclusions: CSs and video recordings should be the preferred audiovisual setup of laboratories and clinics, although HMDs and virtual characters can be used for hearing research when necessary and suitable.
△ Less
Submitted 16 January, 2023; v1 submitted 3 April, 2020;
originally announced April 2020.
-
Influence of visual cues on head and eye movements during listening tasks in multi-talker audiovisual environments with animated characters
Authors:
Maartje M. E. Hendrikse,
Gerard Llorach,
Giso Grimm,
Volker Hohmann
Abstract:
Recent studies of hearing aid benefits indicate that head movement behavior influences performance. To systematically assess these effects, movement behavior must be measured in realistic communication conditions. For this, the use of virtual audiovisual environments with animated characters as visual stimuli has been proposed. It is unclear, however, how these animations influence the head- and e…
▽ More
Recent studies of hearing aid benefits indicate that head movement behavior influences performance. To systematically assess these effects, movement behavior must be measured in realistic communication conditions. For this, the use of virtual audiovisual environments with animated characters as visual stimuli has been proposed. It is unclear, however, how these animations influence the head- and eye-movement behavior of subjects. Here, two listening tasks were carried out with a group of 14 young normal hearing subjects to investigate the influence of visual cues on head- and eye-movement behavior; on combined localization and speech intelligibility task performance; as well as on perceived speech intelligibility, perceived listening effort and the general impression of the audiovisual environments. Animated characters with different lip-syncing and gaze patterns were compared to an audio-only condition and to a video of real persons. Results show that movement behavior, task performance, and perception were all influenced by visual cues. The movement behavior of young normal hearing listeners in animation conditions with lip-syncing was similar to that in the video condition. These results in young normal hearing listeners are a first step towards using the animated characters to assess the influence of head movement behavior on hearing aid performance.
△ Less
Submitted 16 November, 2018;
originally announced December 2018.
