Clinical Annotations for Automatic Stuttering Severity Assessment
Authors:
Ana Rita Valente,
Rufael Marew,
Hawau Olamide Toyin,
Hamdan Al-Ali,
Anelise Bohnen,
Inma Becerra,
Elsa Marta Soares,
Goncalo Leal,
Hanan Aldarmaki
Abstract:
Stuttering is a complex disorder that requires specialized expertise for effective assessment and treatment. This paper presents an effort to enhance the FluencyBank dataset with a new stuttering annotation scheme based on established clinical standards. To achieve high-quality annotations, we hired expert clinicians to label the data, ensuring that the resulting annotations mirror real-world clin…
▽ More
Stuttering is a complex disorder that requires specialized expertise for effective assessment and treatment. This paper presents an effort to enhance the FluencyBank dataset with a new stuttering annotation scheme based on established clinical standards. To achieve high-quality annotations, we hired expert clinicians to label the data, ensuring that the resulting annotations mirror real-world clinical expertise. The annotations are multi-modal, incorporating audiovisual features for the detection and classification of stuttering moments, secondary behaviors, and tension scores. In addition to individual annotations, we additionally provide a test set with highly reliable annotations based on expert consensus for assessing individual annotators and machine learning models. Our experiments and analysis illustrate the complexity of this task that necessitates extensive clinical expertise for valid training and evaluation of stuttering assessment models.
△ Less
Submitted 31 May, 2025;
originally announced June 2025.
