Information Theory

Authors and titles for May 2025

[251] arXiv:2505.15101 (cross-list from cs.LG) [pdf, html, other]

Title: Cost-aware LLM-based Online Dataset Annotation

Eray Can Elumar, Cem Tekin, Osman Yagan

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Information Theory (cs.IT)

[252] arXiv:2505.15281 (cross-list from quant-ph) [pdf, other]

Title: A Unified Approach to Quantum Contraction and Correlation Coefficients

Ian George, Marco Tomamichel

Comments: ~70 pages, 3 figures. Comments welcome!

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[253] arXiv:2505.15303 (cross-list from cs.LG) [pdf, html, other]

Title: Laplace Sample Information: Data Informativeness Through a Bayesian Lens

Johannes Kaiser, Kristian Schwethelm, Daniel Rueckert, Georgios Kaissis

Journal-ref: The Thirteenth International Conference on Learning Representations ICLR (2025)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[254] arXiv:2505.15412 (cross-list from cs.RO) [pdf, html, other]

Title: Evaluation of Mobile Environment for Vehicular Visible Light Communication Using Multiple LEDs and Event Cameras

Ryota Soga, Shintaro Shiba, Quan Kong, Norimasa Kobori, Tsukasa Shimizu, Shan Lu, Takaya Yamazato

Comments: 6 pages, IEEE IV 2025 conference paper

Subjects: Robotics (cs.RO); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)

[255] arXiv:2505.15643 (cross-list from cs.LG) [pdf, html, other]

Title: Optimal Best-Arm Identification under Fixed Confidence with Multiple Optima

Lan V. Truong

Comments: 22 pages

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[256] arXiv:2505.15720 (cross-list from math.RA) [pdf, html, other]

Title: Linearized Polynomial Chinese remainder codes

Philippe Gaborit, Camille Garnier, Olivier Ruatta

Comments: 26 pages, 7 figures

Subjects: Rings and Algebras (math.RA); Information Theory (cs.IT); Symbolic Computation (cs.SC)

[257] arXiv:2505.15848 (cross-list from cs.NI) [pdf, html, other]

Title: Sionna Research Kit: A GPU-Accelerated Research Platform for AI-RAN

Sebastian Cammerer, Guillermo Marcus, Tobias Zirr, Fayçal Aït Aoudia, Lorenzo Maggi, Jakob Hoydis, Alexander Keller

Comments: Accepted Demo at IEEE ICMLCN 2025

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[258] arXiv:2505.16132 (cross-list from eess.SP) [pdf, html, other]

Title: Beamforming-Codebook-Aware Channel Knowledge Map Construction for Multi-Antenna Systems

Haohan Wang, Xu Shi, Hengyu Zhang, Yashuai Cao, Jintao Wang

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[259] arXiv:2505.16504 (cross-list from eess.SP) [pdf, html, other]

Title: A Tutorial on Beyond-Diagonal Reconfigurable Intelligent Surfaces: Modeling, Architectures, System Design and Optimization, and Applications

Hongyu Li, Matteo Nerini, Shanpu Shen, Bruno Clerckx

Comments: 42 pages, 37 figures, submitted to IEEE journal for future publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[260] arXiv:2505.16950 (cross-list from cs.LG) [pdf, html, other]

Title: Bottlenecked Transformers: Periodic KV Cache Abstraction for Generalised Reasoning

Adnan Oomerjee, Zafeirios Fountas, Zhongwei Yu, Haitham Bou-Ammar, Jun Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[261] arXiv:2505.17117 (cross-list from cs.CL) [pdf, html, other]

Title: From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning

Chen Shani, Liron Soffer, Dan Jurafsky, Yann LeCun, Ravid Shwartz-Ziv

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[262] arXiv:2505.17327 (cross-list from cs.CL) [pdf, html, other]

Title: GPT Editors, Not Authors: The Stylistic Footprint of LLMs in Academic Preprints

Soren DeHaan, Yuanze Liu, Johan Bollen, Sa'ul A. Blanco

Comments: 13 pages

Subjects: Computation and Language (cs.CL); Information Theory (cs.IT); Machine Learning (cs.LG)

[263] arXiv:2505.17423 (cross-list from cs.CV) [pdf, html, other]

Title: VIBE: Video-to-Text Information Bottleneck Evaluation for TL;DR

Shenghui Chen, Po-han Li, Sandeep Chinchali, Ufuk Topcu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Information Theory (cs.IT)

[264] arXiv:2505.17469 (cross-list from cs.LG) [pdf, html, other]

Title: Efficient compression of neural networks and datasets

Lukas Silvester Barth, Paulo von Petersenn

Comments: 10 pages plus appendix, 9 Figures, 3 Tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Optimization and Control (math.OC); Statistics Theory (math.ST)

[265] arXiv:2505.17530 (cross-list from eess.SP) [pdf, html, other]

Title: GPS-Aided Deep Learning for Beam Prediction and Tracking in UAV mmWave Communication

Vendi Ardianto Nugroho, Byung Moo Lee

Comments: The code implementation repository: this https URL

Journal-ref: IEEE Access,volume 13, page 117065 until 117077, 2025

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)

[266] arXiv:2505.17531 (cross-list from math.CO) [pdf, html, other]

Title: Nodal surfaces in $\mathbb{P}^3$ and coding theory

Sascha Kurz

Comments: 11 pages

Subjects: Combinatorics (math.CO); Information Theory (cs.IT); Algebraic Geometry (math.AG)

[267] arXiv:2505.17851 (cross-list from math.ST) [pdf, html, other]

Title: Optimal Decision Rules for Composite Binary Hypothesis Testing under Neyman-Pearson Framework

Yanglei Song, Berkan Dulek, Sinan Gezici

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT)

[268] arXiv:2505.17958 (cross-list from stat.ML) [pdf, html, other]

Title: The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks

Vittorio Erba, Emanuele Troiani, Lenka Zdeborová, Florent Krzakala

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Theory (cs.IT); Machine Learning (cs.LG)

[269] arXiv:2505.18146 (cross-list from math.ST) [pdf, other]

Title: A new measure of dependence: Integrated $R^2$

Mona Azadkia, Pouya Roudaki

Comments: added a result on the asymptotic normality of one of the statistics

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Probability (math.PR); Methodology (stat.ME)

[270] arXiv:2505.18160 (cross-list from eess.SP) [pdf, html, other]

Title: Illuminating the Path: Attention-Assisted Beamforming and Predictive Insights in 5G NR Systems

Dino Pjanić, Guoda Tian, Andres Reial, Xuesong Cai, Bo Bernhardsson, Fredrik Tufvesson

Comments: In this paper, we employ an attention-driven ML/AI model to address both short- and long-term beam prediction tasks in a commercial 5G NR uplink scenario. Our key contributions include demonstrating accurate beam predictions that extend beyond the coherence time, thereby overcoming the limitations of traditional techniques bounded by coherence-time constraints

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[271] arXiv:2505.18163 (cross-list from eess.SP) [pdf, other]

Title: Ray Antenna Array: A Novel Cost-Effective Multi-Antenna Architecture for Enhanced Wireless Communication

Zhenjun Dong, Zhiwen Zhou, Yong Zeng

Subjects: Signal Processing (eess.SP); Hardware Architecture (cs.AR); Information Theory (cs.IT)

[272] arXiv:2505.18167 (cross-list from eess.SP) [pdf, html, other]

Title: Dim and Small Target Detection for Drone Broadcast Frames Based on Time-Frequency Analysis

Jie Li, Jing Li, Zhanyu Ju, Fengkui Gong, Lu Lv

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)

[273] arXiv:2505.18237 (cross-list from cs.CL) [pdf, other]

Title: Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens

Xixian Yong, Xiao Zhou, Yingying Zhang, Jinlin Li, Yefeng Zheng, Xian Wu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[274] arXiv:2505.18277 (cross-list from cs.AI) [pdf, html, other]

Title: The end of radical concept nativism

Joshua S. Rule, Steven T. Piantadosi

Subjects: Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[275] arXiv:2505.18302 (cross-list from cs.CV) [pdf, html, other]

Title: Sampling Strategies for Efficient Training of Deep Learning Object Detection Algorithms

Gefei Shen, Yung-Hong Sun, Yu Hen Hu, Hongrui Jiang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)