The Esethu Framework: Reimagining Sustainable Dataset Governance and Curation for Low-Resource Languages
Authors:
Jenalea Rajab,
Anuoluwapo Aremu,
Everlyn Asiko Chimoto,
Dale Dunbar,
Graham Morrissey,
Fadel Thior,
Luandrie Potgieter,
Jessico Ojo,
Atnafu Lambebo Tonja,
Maushami Chetty,
Wilhelmina NdapewaOnyothi Nekoto,
Pelonomi Moiloa,
Jade Abbott,
Vukosi Marivate,
Benjamin Rosman
Abstract:
This paper presents the Esethu Framework, a sustainable data curation framework specifically designed to empower local communities and ensure equitable benefit-sharing from their linguistic resource. This framework is supported by the Esethu license, a novel community-centric data license. As a proof of concept, we introduce the Vuk'uzenzele isiXhosa Speech Dataset (ViXSD), an open-source corpus d…
▽ More
This paper presents the Esethu Framework, a sustainable data curation framework specifically designed to empower local communities and ensure equitable benefit-sharing from their linguistic resource. This framework is supported by the Esethu license, a novel community-centric data license. As a proof of concept, we introduce the Vuk'uzenzele isiXhosa Speech Dataset (ViXSD), an open-source corpus developed under the Esethu Framework and License. The dataset, containing read speech from native isiXhosa speakers enriched with demographic and linguistic metadata, demonstrates how community-driven licensing and curation principles can bridge resource gaps in automatic speech recognition (ASR) for African languages while safeguarding the interests of data creators. We describe the framework guiding dataset development, outline the Esethu license provisions, present the methodology for ViXSD, and present ASR experiments validating ViXSD's usability in building and refining voice-driven applications for isiXhosa.
△ Less
Submitted 12 June, 2025; v1 submitted 21 February, 2025;
originally announced February 2025.
InkubaLM: A small language model for low-resource African languages
Authors:
Atnafu Lambebo Tonja,
Bonaventure F. P. Dossou,
Jessica Ojo,
Jenalea Rajab,
Fadel Thior,
Eric Peter Wairagala,
Anuoluwapo Aremu,
Pelonomi Moiloa,
Jade Abbott,
Vukosi Marivate,
Benjamin Rosman
Abstract:
High-resource language models often fall short in the African context, where there is a critical need for models that are efficient, accessible, and locally relevant, even amidst significant computing and data constraints. This paper introduces InkubaLM, a small language model with 0.4 billion parameters, which achieves performance comparable to models with significantly larger parameter counts an…
▽ More
High-resource language models often fall short in the African context, where there is a critical need for models that are efficient, accessible, and locally relevant, even amidst significant computing and data constraints. This paper introduces InkubaLM, a small language model with 0.4 billion parameters, which achieves performance comparable to models with significantly larger parameter counts and more extensive training data on tasks such as machine translation, question-answering, AfriMMLU, and the AfriXnli task. Notably, InkubaLM outperforms many larger models in sentiment analysis and demonstrates remarkable consistency across multiple languages. This work represents a pivotal advancement in challenging the conventional paradigm that effective language models must rely on substantial resources. Our model and datasets are publicly available at https://huggingface.co/lelapa to encourage research and development on low-resource languages.
△ Less
Submitted 3 September, 2024; v1 submitted 30 August, 2024;
originally announced August 2024.
