RigoChat 2: an adapted language model to Spanish using a bounded dataset and reduced hardware
Authors:
Gonzalo Santamaría Gómez,
Guillem García Subies,
Pablo Gutiérrez Ruiz,
Mario González Valero,
Natàlia Fuertes,
Helena Montoro Zamorano,
Carmen Muñoz Sanz,
Leire Rosado Plaza,
Nuria Aldama García,
David Betancur Sánchez,
Kateryna Sushkova,
Marta Guerrero Nieto,
Álvaro Barbero Jiménez
Abstract:
Large Language Models (LLMs) have become a key element of modern artificial intelligence, demonstrating the ability to address a wide range of language processing tasks at unprecedented levels of accuracy without the need of collecting problem-specific data. However, these versatile models face a significant challenge: both their training and inference processes require substantial computational r…
▽ More
Large Language Models (LLMs) have become a key element of modern artificial intelligence, demonstrating the ability to address a wide range of language processing tasks at unprecedented levels of accuracy without the need of collecting problem-specific data. However, these versatile models face a significant challenge: both their training and inference processes require substantial computational resources, time, and memory. Consequently, optimizing this kind of models to minimize these requirements is crucial. In this article, we demonstrate that, with minimal resources and in a remarkably short time, it is possible to enhance a state-of-the-art model, specifically for a given language task, without compromising its overall capabilities using a relatively small pretrained LLM as a basis. Specifically, we present our use case, RigoChat 2, illustrating how LLMs can be adapted to achieve superior results in Spanish-language tasks.
△ Less
Submitted 11 March, 2025;
originally announced March 2025.
