-
Deep learning-based denoising streamed from mobile phones improves speech-in-noise understanding for hearing aid users
Authors:
Peter Udo Diehl,
Hannes Zilly,
Felix Sattler,
Yosef Singer,
Kevin Kepp,
Mark Berry,
Henning Hasemann,
Marlene Zippel,
Müge Kaya,
Paul Meyer-Rachner,
Annett Pudszuhn,
Veit M. Hofmann,
Matthias Vormann,
Elias Sprengel
Abstract:
The hearing loss of almost half a billion people is commonly treated with hearing aids. However, current hearing aids often do not work well in real-world noisy environments. We present a deep learning based denoising system that runs in real time on iPhone 7 and Samsung Galaxy S10 (25ms algorithmic latency). The denoised audio is streamed to the hearing aid, resulting in a total delay of around 7…
▽ More
The hearing loss of almost half a billion people is commonly treated with hearing aids. However, current hearing aids often do not work well in real-world noisy environments. We present a deep learning based denoising system that runs in real time on iPhone 7 and Samsung Galaxy S10 (25ms algorithmic latency). The denoised audio is streamed to the hearing aid, resulting in a total delay of around 75ms. In tests with hearing aid users having moderate to severe hearing loss, our denoising system improves audio across three tests: 1) listening for subjective audio ratings, 2) listening for objective speech intelligibility, and 3) live conversations in a noisy environment for subjective ratings. Subjective ratings increase by more than 40%, for both the listening test and the live conversation compared to a fitted hearing aid as a baseline. Speech reception thresholds, measuring speech understanding in noise, improve by 1.6 dB SRT. Ours is the first denoising system that is implemented on a mobile device, streamed directly to users' hearing aids using only a single channel as audio input while improving user satisfaction on all tested aspects, including speech intelligibility. This includes overall preference of the denoised and streamed signal over the hearing aid, thereby accepting the higher latency for the significant improvement in speech understanding.
△ Less
Submitted 22 August, 2023;
originally announced August 2023.
-
The Wiselib TupleStore: A Modular RDF Database for the Internet of Things
Authors:
Henning Hasemann,
Alexander Kröller,
Max Pagel
Abstract:
The Internet of Things movement provides self-configuring and universally interoperable devices. While such devices are often built with a specific application in mind, they often turn out to be useful in other contexts as well. We claim that by describing the devices' knowledge in a universal way, IoT devices can become first-class citizens in the Internet. They can then exchange data between het…
▽ More
The Internet of Things movement provides self-configuring and universally interoperable devices. While such devices are often built with a specific application in mind, they often turn out to be useful in other contexts as well. We claim that by describing the devices' knowledge in a universal way, IoT devices can become first-class citizens in the Internet. They can then exchange data between heterogeneous hardware, different applications and large data sources on the Web. Our key idea --- in contrast to most existing approaches --- is to not restrict the domain of knowledge that can be expressed on the device in any way and, at the same time, allow this knowledge to be machine-understandable and linkable across different locations.
We propose an architecture that allows to connect embedded devices to the Semantic Web by expressing their knowledge in the Resource Description Framework (RDF). We present the Wiselib TupleStore, a modular embedded database tailored specifically for the storage of RDF. The Wiselib TupleStore is portable to many platforms including Contiki and TinyOS and allows a variety of trade-offs, making it able to scale to a large variety of hardware scenarios. We discuss the applicability of RDF to heterogeneous resource-constrained devices and compare our system to the existing embedded tuple stores Antelope and TeenyLIME.
△ Less
Submitted 28 February, 2014;
originally announced February 2014.
-
SPARQL for Networks of Embedded Systems
Authors:
Dennis Boldt,
Henning Hasemann,
Alexander Kröller,
Marcel Karnstedt,
Christian von der Weth
Abstract:
The Semantic Web (or Web of Data) represents the successful efforts towards linking and sharing data over the Web. The cornerstones of the Web of Data are RDF as data format and SPARQL as de-facto standard query language. Recent trends show the evolution of the Web of Data towards the Web of Things, integrating embedded devices and smart objects. Data stemming from such devices do not share a comm…
▽ More
The Semantic Web (or Web of Data) represents the successful efforts towards linking and sharing data over the Web. The cornerstones of the Web of Data are RDF as data format and SPARQL as de-facto standard query language. Recent trends show the evolution of the Web of Data towards the Web of Things, integrating embedded devices and smart objects. Data stemming from such devices do not share a common format, making the integration and querying impossible. To overcome this problem, we present our approach to make embedded systems first-class citizens of the Web of Things. Our framework abstracts from individual deployments to represent them as common data sources in line with the ideas behind the Semantic Web. This includes the execution of arbitrary SPARQL queries over the data from a pool of embedded devices and/or external data sources. Handling verbose RDF data and executing SPARQL queries in an embedded network poses major challenges to minimize the involved processing and communication cost. We therefore present an in-network query processor aiming to push processing steps onto devices. We demonstrate the practical application and the potential benefits of our framework in a comprehensive evaluation using a real-world deployment and a range of SPARQL queries stemming from a common use case of the Web of Things.
△ Less
Submitted 28 February, 2014;
originally announced February 2014.
