SpokeN-100: A Cross-Lingual Benchmarking Dataset for The Classification of Spoken Numbers in Different Languages
Authors:
René Groh,
Nina Goes,
Andreas M. Kist
Abstract:
Benchmarking plays a pivotal role in assessing and enhancing the performance of compact deep learning models designed for execution on resource-constrained devices, such as microcontrollers. Our study introduces a novel, entirely artificially generated benchmarking dataset tailored for speech recognition, representing a core challenge in the field of tiny deep learning. SpokeN-100 consists of spok…
▽ More
Benchmarking plays a pivotal role in assessing and enhancing the performance of compact deep learning models designed for execution on resource-constrained devices, such as microcontrollers. Our study introduces a novel, entirely artificially generated benchmarking dataset tailored for speech recognition, representing a core challenge in the field of tiny deep learning. SpokeN-100 consists of spoken numbers from 0 to 99 spoken by 32 different speakers in four different languages, namely English, Mandarin, German and French, resulting in 12,800 audio samples. We determine auditory features and use UMAP (Uniform Manifold Approximation and Projection for Dimension Reduction) as a dimensionality reduction method to show the diversity and richness of the dataset. To highlight the use case of the dataset, we introduce two benchmark tasks: given an audio sample, classify (i) the used language and/or (ii) the spoken number. We optimized state-of-the-art deep neural networks and performed an evolutionary neural architecture search to find tiny architectures optimized for the 32-bit ARM Cortex-M4 nRF52840 microcontroller. Our results represent the first benchmark data achieved for SpokeN-100.
△ Less
Submitted 14 March, 2024;
originally announced March 2024.
What Color is this? Explaining Art Restoration Research Methods using Interactive Museum Installations
Authors:
Franziska Hannß,
Esther Lapczyna,
Mathias Müller,
Rainer Groh
Abstract:
This case study describes an approach to designing interactive museum installations as a student project with the aim of presenting the research results of the restoration process of paintings to a wide range of visitors. During one and a half years, the Chair of Media Design created five interactive media stations in two lectures to enrich the special exhibition "Veronese: The Cuccina Cycle. The…
▽ More
This case study describes an approach to designing interactive museum installations as a student project with the aim of presenting the research results of the restoration process of paintings to a wide range of visitors. During one and a half years, the Chair of Media Design created five interactive media stations in two lectures to enrich the special exhibition "Veronese: The Cuccina Cycle. The Restored Masterpiece". The project was realised in close communication with the conservators of the Dresden State Art Collections and the employees of the Science and Archaeometric Laboratory of the Dresden University of Fine Arts. The students had to learn about the foreign content and how to translate it into a media-related environment. With suitable teaching methods, we pushed the students towards a deeper understanding of the matter.
△ Less
Submitted 27 October, 2020;
originally announced October 2020.
