Skip to main content

Showing 1–4 of 4 results for author: Sleem, L

Searching in archive cs. Search in all archives.
.
  1. arXiv:2506.07295  [pdf, ps, other

    cs.CL

    Exploring the Impact of Temperature on Large Language Models:Hot or Cold?

    Authors: Lujun Li, Lama Sleem, Niccolo' Gentile, Geoffrey Nichil, Radu State

    Abstract: The sampling temperature, a critical hyperparameter in large language models (LLMs), modifies the logits before the softmax layer, thereby reshaping the distribution of output tokens. Recent studies have challenged the Stochastic Parrots analogy by demonstrating that LLMs are capable of understanding semantics rather than merely memorizing data and that randomness, modulated by sampling temperatur… ▽ More

    Submitted 8 June, 2025; originally announced June 2025.

  2. arXiv:2505.16078  [pdf, ps, other

    cs.CL

    Small Language Models in the Real World: Insights from Industrial Text Classification

    Authors: Lujun Li, Lama Sleem, Niccolo' Gentile, Geoffrey Nichil, Radu State

    Abstract: With the emergence of ChatGPT, Transformer models have significantly advanced text classification and related tasks. Decoder-only models such as Llama exhibit strong performance and flexibility, yet they suffer from inefficiency on inference due to token-by-token generation, and their effectiveness in text classification tasks heavily depends on prompt quality. Moreover, their substantial GPU reso… ▽ More

    Submitted 23 June, 2025; v1 submitted 21 May, 2025; originally announced May 2025.

    Comments: This paper has been accepted as a conference paper in the Industry Track of the 63rd Annual Meeting of the Association for Computational Linguistics (ACL)

  3. arXiv:2503.24102  [pdf, ps, other

    cs.CL

    Is LLM the Silver Bullet to Low-Resource Languages Machine Translation?

    Authors: Yewei Song, Lujun Li, Cedric Lothritz, Saad Ezzini, Lama Sleem, Niccolo Gentile, Radu State, Tegawendé F. Bissyandé, Jacques Klein

    Abstract: Low-Resource Languages (LRLs) present significant challenges in natural language processing due to their limited linguistic resources and underrepresentation in standard datasets. While recent advances in Large Language Models (LLMs) and Neural Machine Translation have substantially improved translation capabilities for high-resource languages, performance disparities persist for LRLs, particularl… ▽ More

    Submitted 5 June, 2025; v1 submitted 31 March, 2025; originally announced March 2025.

  4. arXiv:1701.08371  [pdf, other

    cs.CR

    A Revision of a New Chaos-Based Image Encryption System: Weaknesses and Limitations

    Authors: Hassan Noura, Lama Sleem, Raphaël Couturier

    Abstract: Lately, multimedia encryption has been the focus of attention in many researches. Recently, a large number of encryption algorithms has been presented to protect image contents.The main objective of modern image encryption schemes is to reduce the computation complexity in order to respond to the real time multimedia and/or limited resources requirements without degrading the high level of securit… ▽ More

    Submitted 29 January, 2017; originally announced January 2017.