Fanar: An Arabic-Centric Multimodal Generative AI Platform
Authors:
Fanar Team,
Ummar Abbas,
Mohammad Shahmeer Ahmad,
Firoj Alam,
Enes Altinisik,
Ehsannedin Asgari,
Yazan Boshmaf,
Sabri Boughorbel,
Sanjay Chawla,
Shammur Chowdhury,
Fahim Dalvi,
Kareem Darwish,
Nadir Durrani,
Mohamed Elfeky,
Ahmed Elmagarmid,
Mohamed Eltabakh,
Masoomali Fatehkia,
Anastasios Fragkopoulos,
Maram Hasanain,
Majd Hawasly,
Mus'ab Husaini,
Soon-Gyo Jung,
Ji Kim Lucas,
Walid Magdy,
Safa Messaoud
, et al. (17 additional authors not shown)
Abstract:
We present Fanar, a platform for Arabic-centric multimodal generative AI systems, that supports language, speech and image generation tasks. At the heart of Fanar are Fanar Star and Fanar Prime, two highly capable Arabic Large Language Models (LLMs) that are best in the class on well established benchmarks for similar sized models. Fanar Star is a 7B (billion) parameter model that was trained from…
▽ More
We present Fanar, a platform for Arabic-centric multimodal generative AI systems, that supports language, speech and image generation tasks. At the heart of Fanar are Fanar Star and Fanar Prime, two highly capable Arabic Large Language Models (LLMs) that are best in the class on well established benchmarks for similar sized models. Fanar Star is a 7B (billion) parameter model that was trained from scratch on nearly 1 trillion clean and deduplicated Arabic, English and Code tokens. Fanar Prime is a 9B parameter model continually trained on the Gemma-2 9B base model on the same 1 trillion token set. Both models are concurrently deployed and designed to address different types of prompts transparently routed through a custom-built orchestrator. The Fanar platform provides many other capabilities including a customized Islamic Retrieval Augmented Generation (RAG) system for handling religious prompts, a Recency RAG for summarizing information about current or recent events that have occurred after the pre-training data cut-off date. The platform provides additional cognitive capabilities including in-house bilingual speech recognition that supports multiple Arabic dialects, voice and image generation that is fine-tuned to better reflect regional characteristics. Finally, Fanar provides an attribution service that can be used to verify the authenticity of fact based generated content.
The design, development, and implementation of Fanar was entirely undertaken at Hamad Bin Khalifa University's Qatar Computing Research Institute (QCRI) and was sponsored by Qatar's Ministry of Communications and Information Technology to enable sovereign AI technology development.
△ Less
Submitted 18 January, 2025;
originally announced January 2025.
NxPlain: Web-based Tool for Discovery of Latent Concepts
Authors:
Fahim Dalvi,
Nadir Durrani,
Hassan Sajjad,
Tamim Jaban,
Musab Husaini,
Ummar Abbas
Abstract:
The proliferation of deep neural networks in various domains has seen an increased need for the interpretability of these models, especially in scenarios where fairness and trust are as important as model performance. A lot of independent work is being carried out to: i) analyze what linguistic and non-linguistic knowledge is learned within these models, and ii) highlight the salient parts of the…
▽ More
The proliferation of deep neural networks in various domains has seen an increased need for the interpretability of these models, especially in scenarios where fairness and trust are as important as model performance. A lot of independent work is being carried out to: i) analyze what linguistic and non-linguistic knowledge is learned within these models, and ii) highlight the salient parts of the input. We present NxPlain, a web application that provides an explanation of a model's prediction using latent concepts. NxPlain discovers latent concepts learned in a deep NLP model, provides an interpretation of the knowledge learned in the model, and explains its predictions based on the used concepts. The application allows users to browse through the latent concepts in an intuitive order, letting them efficiently scan through the most salient concepts with a global corpus level view and a local sentence-level view. Our tool is useful for debugging, unraveling model bias, and for highlighting spurious correlations in a model. A hosted demo is available here: https://nxplain.qcri.org.
△ Less
Submitted 6 March, 2023;
originally announced March 2023.
