-
SEA-LION: Southeast Asian Languages in One Network
Authors:
Raymond Ng,
Thanh Ngan Nguyen,
Yuli Huang,
Ngee Chia Tai,
Wai Yi Leong,
Wei Qi Leong,
Xianbin Yong,
Jian Gang Ngui,
Yosephine Susanto,
Nicholas Cheng,
Hamsawardhini Rengarajan,
Peerat Limkonchotiwat,
Adithya Venkatadri Hulagadri,
Kok Wai Teng,
Yeo Yeow Tong,
Bryan Siow,
Wei Yi Teo,
Wayne Lau,
Choon Meng Tan,
Brandon Ong,
Zhi Hao Ong,
Jann Railey Montalan,
Adwin Chan,
Sajeban Antonyrex,
Ren Lee
, et al. (6 additional authors not shown)
Abstract:
Recently, Large Language Models (LLMs) have dominated much of the artificial intelligence scene with their ability to process and generate natural languages. However, the majority of LLM research and development remains English-centric, leaving low-resource languages such as those in the Southeast Asian (SEA) region under-represented. To address this representation gap, we introduce Llama-SEA-LION…
▽ More
Recently, Large Language Models (LLMs) have dominated much of the artificial intelligence scene with their ability to process and generate natural languages. However, the majority of LLM research and development remains English-centric, leaving low-resource languages such as those in the Southeast Asian (SEA) region under-represented. To address this representation gap, we introduce Llama-SEA-LION-v3-8B-IT and Gemma-SEA-LION-v3-9B-IT, two cutting-edge multilingual LLMs designed for SEA languages. The SEA-LION family of LLMs supports 11 SEA languages, namely English, Chinese, Indonesian, Vietnamese, Malay, Thai, Burmese, Lao, Filipino, Tamil, and Khmer. Our work leverages large-scale multilingual continued pre-training with a comprehensive post-training regime involving multiple stages of instruction fine-tuning, alignment, and model merging. Evaluation results on multilingual benchmarks indicate that our models achieve state-of-the-art performance across LLMs supporting SEA languages. We open-source the models to benefit the wider SEA community.
△ Less
Submitted 15 April, 2025; v1 submitted 8 April, 2025;
originally announced April 2025.
-
SEA-HELM: Southeast Asian Holistic Evaluation of Language Models
Authors:
Yosephine Susanto,
Adithya Venkatadri Hulagadri,
Jann Railey Montalan,
Jian Gang Ngui,
Xian Bin Yong,
Weiqi Leong,
Hamsawardhini Rengarajan,
Peerat Limkonchotiwat,
Yifan Mai,
William Chandra Tjhi
Abstract:
With the rapid emergence of novel capabilities in Large Language Models (LLMs), the need for rigorous multilingual and multicultural benchmarks that are integrated has become more pronounced. Though existing LLM benchmarks are capable of evaluating specific capabilities of LLMs in English as well as in various mid- to low-resource languages, including those in the Southeast Asian (SEA) region, a c…
▽ More
With the rapid emergence of novel capabilities in Large Language Models (LLMs), the need for rigorous multilingual and multicultural benchmarks that are integrated has become more pronounced. Though existing LLM benchmarks are capable of evaluating specific capabilities of LLMs in English as well as in various mid- to low-resource languages, including those in the Southeast Asian (SEA) region, a comprehensive and culturally representative evaluation suite for the SEA languages has not been developed thus far. Here, we present SEA-HELM, a holistic linguistic and cultural LLM evaluation suite that emphasises SEA languages, comprising five core pillars: (1) NLP Classics, (2) LLM-specifics, (3) SEA Linguistics, (4) SEA Culture, (5) Safety. SEA-HELM currently supports Filipino, Indonesian, Tamil, Thai, and Vietnamese. We also introduce the SEA-HELM leaderboard, which allows users to understand models' multilingual and multicultural performance in a systematic and user-friendly manner. We make the SEA-HELM evaluation code publicly available.
△ Less
Submitted 2 June, 2025; v1 submitted 20 February, 2025;
originally announced February 2025.
-
Quality Classification of Defective Parts from Injection Moulding
Authors:
Adithya Venkatadri Hulagadri
Abstract:
This report examines machine learning algorithms for detecting short forming and weaving in plastic parts produced by injection moulding. Transfer learning was implemented by using pretrained models and finetuning them on our dataset of 494 samples of 150 by 150 pixels images. The models tested were Xception, InceptionV3 and Resnet-50. Xception showed the highest overall accuracy (86.66%), followe…
▽ More
This report examines machine learning algorithms for detecting short forming and weaving in plastic parts produced by injection moulding. Transfer learning was implemented by using pretrained models and finetuning them on our dataset of 494 samples of 150 by 150 pixels images. The models tested were Xception, InceptionV3 and Resnet-50. Xception showed the highest overall accuracy (86.66%), followed by InceptionV3 (82.47%) and Resnet-50 (80.41%). Short forming was the easiest fault to identify, with the highest F1 score for each model.
△ Less
Submitted 8 July, 2020;
originally announced August 2020.
