Information Theory

Authors and titles for November 2024

[151] arXiv:2411.19754 [pdf, html, other]

Title: Emerging Technologies in Intelligent Metasurfaces: Shaping the Future of Wireless Communications

Jiancheng An, Mérouane Debbah, Tie Jun Cui, Zhi Ning Chen, Chau Yuen

Comments: 17 pages, 12 figures, 2 tables, accepted by IEEE TAP (Invited Paper)

Subjects: Information Theory (cs.IT); Signal Processing (eess.SP)

[152] arXiv:2411.19795 [pdf, html, other]

Title: Characterization of Spatial-Temporal Channel Statistics from Measurement Data at D Band

Chathuri Weragama, Joonas Kokkoniemi, Mar Francis De Guzman, Katsuyuki Haneda, Pekka Kÿosti, Markku Juntti

Comments: arXiv admin note: text overlap with arXiv:2403.18713

Subjects: Information Theory (cs.IT); Signal Processing (eess.SP)

[153] arXiv:2411.19854 [pdf, html, other]

Title: Timely and Energy-Efficient Multi-Step Update Processing

Vishakha Ramani, Ivan Seskar, Roy D. Yates

Comments: The work was presented at ASILOMAR 2024

Subjects: Information Theory (cs.IT); Systems and Control (eess.SY)

[154] arXiv:2411.00319 (cross-list from cs.NI) [pdf, html, other]

Title: Task-oriented Age of Information for Remote Monitoring Systems

Shuying Gan, Xijun Wang, Chao Xu, Xiang Chen

Comments: Accepted by Globecom 2024

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[155] arXiv:2411.00522 (cross-list from cs.LG) [pdf, html, other]

Title: Analyzing Multimodal Integration in the Variational Autoencoder from an Information-Theoretic Perspective

Carlotta Langer, Yasmin Kim Georgie, Ilja Porohovoj, Verena Vanessa Hafner, Nihat Ay

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[156] arXiv:2411.00721 (cross-list from math.CO) [pdf, html, other]

Title: New classes of reversible cellular automata

Jan Kristian Haugland, Tron Omland

Comments: 11 pages

Subjects: Combinatorics (math.CO); Cryptography and Security (cs.CR); Discrete Mathematics (cs.DM); Information Theory (cs.IT); Dynamical Systems (math.DS)

[157] arXiv:2411.00790 (cross-list from math.FA) [pdf, html, other]

Title: Product Entropic Uncertainty Principle

K. Mahesh Krishna

Comments: 5 Pages, 0 Figures

Subjects: Functional Analysis (math.FA); Information Theory (cs.IT)

[158] arXiv:2411.00893 (cross-list from eess.IV) [pdf, other]

Title: Blind Time-of-Flight Imaging: Sparse Deconvolution on the Continuum with Unknown Kernels

Ruiming Guo, Ayush Bhandari

Comments: 27 pages

Journal-ref: SIAM Journal on Imaging Sciences, October 2024

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Signal Processing (eess.SP)

[159] arXiv:2411.01244 (cross-list from eess.SP) [pdf, html, other]

Title: Precoded faster-than-Nyquist signaling using optimal power allocation for OTFS

Zekun Hong, Shinya Sugiura, Chao Xu, Lajos Hanzo

Comments: 5 pages, 3 figures

Journal-ref: IEEE Wireless Communications Letters, 2024

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[160] arXiv:2411.01579 (cross-list from cs.DC) [pdf, html, other]

Title: Flexible Coded Distributed Convolution Computing for Enhanced Straggler Resilience and Numerical Stability in Distributed CNNs

Shuo Tan, Rui Liu, Xuesong Han, XianLei Long, Kai Wan, Linqi Song, Yong Li

Comments: 16 pages, 6 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG)

[161] arXiv:2411.01974 (cross-list from cond-mat.dis-nn) [pdf, html, other]

Title: On the phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariance

Jean Barbier, Francesco Camilli, Justin Ko, Koki Okajima

Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Theory (cs.IT); Machine Learning (cs.LG)

[162] arXiv:2411.02148 (cross-list from cs.DS) [pdf, html, other]

Title: Optimality of Frequency Moment Estimation

Mark Braverman, Or Zamir

Subjects: Data Structures and Algorithms (cs.DS); Computational Complexity (cs.CC); Information Theory (cs.IT)

[163] arXiv:2411.02150 (cross-list from eess.SP) [pdf, other]

Title: Cooperative and Collaborative Multi-Task Semantic Communication for Distributed Sources

Ahmad Halimi Razlighi, Maximilian H. V. Tillmann, Edgar Beck, Carsten Bockelmann, Armin Dekorsy

Comments: Accepted, IEEE International Conference on Communication (ICC 2025)

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)

[164] arXiv:2411.02225 (cross-list from stat.ML) [pdf, html, other]

Title: Variable Selection in Convex Piecewise Linear Regression

Haitham Kanj, Seonho Kim, Kiryung Lee

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[165] arXiv:2411.02366 (cross-list from eess.SP) [pdf, html, other]

Title: Accelerating Multi-UAV Collaborative Sensing Data Collection: A Hybrid TDMA-NOMA-Cooperative Transmission in Cell-Free MIMO Networks

Eunhyuk Park, Junbeom Kim, Seok-Hwan Park, Osvaldo Simeone, Shlomo Shamai

Comments: This work has been accepted for publication in the IEEE Internet of Things Journal

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[166] arXiv:2411.02417 (cross-list from eess.SP) [pdf, html, other]

Title: Revisiting the Fraunhofer and Fresnel Boundaries for Phased Array Antennas

Mehdi Monemi, Mehdi Rasti, Matti Latva-aho

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[167] arXiv:2411.02425 (cross-list from eess.SP) [pdf, html, other]

Title: A Study on Characterization of Near-Field Sub-Regions For Phased-Array Antennas

Mehdi Monemi, Sirous Bahrami, Mehdi Rasti, Matti Latva-aho

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[168] arXiv:2411.02707 (cross-list from math.OA) [pdf, html, other]

Title: Phase Group Category of Bimodule Quantum Channels

Linzhe Huang, Chunlan Jiang, Zhengwei Liu, Jinsong Wu

Comments: 27pages

Subjects: Operator Algebras (math.OA); Information Theory (cs.IT)

[169] arXiv:2411.02817 (cross-list from cs.LG) [pdf, html, other]

Title: Conditional Vendi Score: An Information-Theoretic Approach to Diversity Evaluation of Prompt-based Generative Models

Mohammad Jalali, Azim Ospanov, Amin Gohari, Farzan Farnia

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

[170] arXiv:2411.02827 (cross-list from eess.SP) [pdf, html, other]

Title: Hybrid Beamforming for Integrated Sensing and Communications With Low Resolution DACs

Ahmet M. Elbir, Abdulkadir Celik, Ahmed M. Eltawil

Comments: Accepted Paper in IEEE Wireless Communications Letters

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[171] arXiv:2411.02904 (cross-list from stat.ML) [pdf, html, other]

Title: Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression

Yingzhen Yang, Ping Li

Comments: This article draws results with revisions from the first author's other work in arXiv:2407.11353, with typos in the previous version fixed

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[172] arXiv:2411.03265 (cross-list from math.DG) [pdf, html, other]

Title: Information geometry of diffeomorphism groups

Boris Khesin, Gerard Misiołek, Klas Modin

Comments: 89 pages, 10 figures, updated with index

Subjects: Differential Geometry (math.DG); Information Theory (cs.IT); Mathematical Physics (math-ph)

[173] arXiv:2411.03439 (cross-list from quant-ph) [pdf, html, other]

Title: Towards Entropic Constraints on Quantum Speedups

Jason Pollack, Dylan VanAllen

Comments: 18 pages, 11 figures; Submitted for QIP 2025, comments welcome

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); High Energy Physics - Theory (hep-th)

[174] arXiv:2411.03451 (cross-list from cs.DS) [pdf, html, other]

Title: Redundancy Is All You Need

Joshua Brakensiek, Venkatesan Guruswami

Comments: 66 pages

Subjects: Data Structures and Algorithms (cs.DS); Discrete Mathematics (cs.DM); Information Theory (cs.IT); Logic in Computer Science (cs.LO); Combinatorics (math.CO)

[175] arXiv:2411.03632 (cross-list from quant-ph) [pdf, other]

Title: Quantum fault tolerance with constant-space and logarithmic-time overheads

Quynh T. Nguyen, Christopher A. Pattison

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[176] arXiv:2411.03646 (cross-list from quant-ph) [pdf, html, other]

Title: Quantum LDPC Codes of Almost Linear Distance via Homological Products

Louis Golowich, Venkatesan Guruswami

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[177] arXiv:2411.03776 (cross-list from cs.DM) [pdf, html, other]

Title: Reconstruction of multiple strings of constant weight from prefix-suffix compositions

Yaoyu Yang, Zitan Chen

Subjects: Discrete Mathematics (cs.DM); Information Theory (cs.IT)

[178] arXiv:2411.03839 (cross-list from cs.DM) [pdf, html, other]

Title: Noisy Linear Group Testing: Exact Thresholds and Efficient Algorithms

Lukas Hintze, Lena Krieg, Olga Scheftelowitsch, Haodong Zhu

Subjects: Discrete Mathematics (cs.DM); Information Theory (cs.IT); Combinatorics (math.CO)

[179] arXiv:2411.04035 (cross-list from quant-ph) [pdf, html, other]

Title: Generalized quantum asymptotic equipartition

Kun Fang, Hamza Fawzi, Omar Fawzi

Comments: v2: The section "Application 4: efficient bounds for quantum resource theory" moved to a separate paper. Added superadditivity statements for α> 1, various clarifications and references; v3: The sections "Application 2: adversarial quantum channel discrimination" and "Application 3: a relative entropy accumulation theorem" moved to a separate paper

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[180] arXiv:2411.04370 (cross-list from eess.SP) [pdf, html, other]

Title: Non-Reciprocal Beyond Diagonal RIS: Multiport Network Models and Performance Benefits in Full-Duplex Systems

Hongyu Li, Bruno Clerckx

Comments: 14 pages, 12 figures, accepted by IEEE journal for publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[181] arXiv:2411.04464 (cross-list from quant-ph) [pdf, html, other]

Title: Decoding Quasi-Cyclic Quantum LDPC Codes

Louis Golowich, Venkatesan Guruswami

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[182] arXiv:2411.04675 (cross-list from eess.SP) [pdf, html, other]

Title: Advancing Multi-Connectivity in Satellite-Terrestrial Integrated Networks: Architectures, Challenges, and Applications

Xiangyu Li, Bodong Shang

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Systems and Control (eess.SY)

[183] arXiv:2411.04689 (cross-list from eess.SP) [pdf, html, other]

Title: Over-the-Air DPD and Reciprocity Calibration in Massive MIMO and Beyond

Ashkan Sheikhi, Ove Edfors, Juan Vidal Alegría

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[184] arXiv:2411.04702 (cross-list from eess.SP) [pdf, html, other]

Title: Large Intelligent Surfaces with Low-End Receivers: From Scaling to Antenna and Panel Selection

Ashkan Sheikhi, Juan Vidal Alegría, Ove Edfors

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[185] arXiv:2411.04727 (cross-list from quant-ph) [pdf, html, other]

Title: Quantum Speedup for Polar Maximum Likelihood Decoding

Shintaro Fujiwara, Naoki Ishikawa

Comments: 5pages, 6 figures

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Signal Processing (eess.SP)

[186] arXiv:2411.04728 (cross-list from cs.LG) [pdf, html, other]

Title: Neuromorphic Wireless Split Computing with Multi-Level Spikes

Dengyu Wu, Jiechen Chen, Bipin Rajendran, H. Vincent Poor, Osvaldo Simeone

Journal-ref: IEEE Trans. Mach. Learn. Commun. Netw., vol. 3, pp. 502-516, 2025

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Neural and Evolutionary Computing (cs.NE)

[187] arXiv:2411.04753 (cross-list from eess.SP) [pdf, html, other]

Title: Efficient Channel Estimation With Shorter Pilots in RIS-Aided Communications: Using Array Geometries and Interference Statistics

Özlem Tuğfe Demir, Emil Björnson, Luca Sanguinetti

Comments: 16 pages, 9 figures, to appear in IEEE Transactions on Wireless Communications

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[188] arXiv:2411.04803 (cross-list from cs.DS) [pdf, html, other]

Title: Unbounded Error Correcting Codes

Klim Efremenko, Or Zamir

Subjects: Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Combinatorics (math.CO)

[189] arXiv:2411.04893 (cross-list from quant-ph) [pdf, other]

Title: Efficient quantum pseudorandomness under conservation laws

Zimu Li, Han Zheng, Zi-Wen Liu

Comments: 9 + 48 pages

Subjects: Quantum Physics (quant-ph); Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Mathematical Physics (math-ph)

[190] arXiv:2411.04898 (cross-list from quant-ph) [pdf, other]

Title: Convergence efficiency of quantum gates and circuits

Linghang Kong, Zimu Li, Zi-Wen Liu

Comments: 50 pages + 8 tables + 6 figures

Subjects: Quantum Physics (quant-ph); Strongly Correlated Electrons (cond-mat.str-el); Computational Complexity (cs.CC); Information Theory (cs.IT); Mathematical Physics (math-ph)

[191] arXiv:2411.04992 (cross-list from cs.LG) [pdf, html, other]

Title: Which bits went where? Past and future transfer entropy decomposition with the information bottleneck

Kieran A. Murphy, Zhuowen Yin, Dani S. Bassett

Comments: NeurIPS 2024 workshop "Machine learning and the physical sciences" Camera ready

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[192] arXiv:2411.05239 (cross-list from cs.LG) [pdf, html, other]

Title: ZipNN: Lossless Compression for AI Models

Moshik Hershcovitch, Andrew Wood, Leshem Choshen, Guy Girmonsky, Roy Leibovitz, Ilias Ennmouri, Michal Malka, Peter Chin, Swaminathan Sundararaman, Danny Harnik

Comments: IEEE Cloud. arXiv admin note: text overlap with arXiv:2404.15198

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[193] arXiv:2411.05278 (cross-list from eess.SP) [pdf, html, other]

Title: Integrated Location Sensing and Communication for Ultra-Massive MIMO With Hybrid-Field Beam-Squint Effect

Zhen Gao, Xingyu Zhou, Boyu Ning, Yu Su, Tong Qin, Dusit Niyato

Comments: This paper has been accepted by IEEE JSAC

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[194] arXiv:2411.05471 (cross-list from math.NT) [pdf, html, other]

Title: Some notes on the pseudorandomness of Legendre symbol and Liouville function

Johannes Grünberger, Arne Winterhof

Subjects: Number Theory (math.NT); Information Theory (cs.IT)

[195] arXiv:2411.05531 (cross-list from eess.SP) [pdf, html, other]

Title: CRC-Assisted Channel Codes for Integrated Passive Sensing and Communications

Chenghong Bian, Kaitao Meng, Huihui Wu, Yumeng Zhang, Deniz Gunduz

Comments: Submitted to possible IEEE journal publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[196] arXiv:2411.05936 (cross-list from cs.IR) [pdf, html, other]

Title: Mitigating Hallucination with ZeroG: An Advanced Knowledge Management Engine

Anantha Sharma, Sheeba Elizabeth John, Fatemeh Rezapoor Nikroo, Krupali Bhatt, Mrunal Zambre, Aditi Wikhe

Comments: 10 pages, 4 figures, 1 table

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Theory (cs.IT)

[197] arXiv:2411.06155 (cross-list from cs.LG) [pdf, html, other]

Title: HiHa: Introducing Hierarchical Harmonic Decomposition to Implicit Neural Compression for Atmospheric Data

Zhewen Xu, Baoxiang Pan, Hongliang Li, Xiaohui Wei

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Atmospheric and Oceanic Physics (physics.ao-ph)

[198] arXiv:2411.06291 (cross-list from cs.LG) [pdf, html, other]

Title: TinyML NLP Scheme for Semantic Wireless Sentiment Classification with Privacy Preservation

Ahmed Y. Radwan, Mohammad Shehab, Mohamed-Slim Alouini

Comments: Accepted at EuCNC & 6G Summit 2025

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Information Theory (cs.IT)

[199] arXiv:2411.06508 (cross-list from cs.LG) [pdf, html, other]

Title: Understanding the Role of Equivariance in Self-supervised Learning

Yifei Wang, Kaiwen Hu, Sharut Gupta, Ziyu Ye, Yisen Wang, Stefanie Jegelka

Comments: Accepted at NeurIPS 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (stat.ML)

[200] arXiv:2411.06550 (cross-list from eess.SP) [pdf, html, other]

Title: A Practical Validation of RIS Detection and Identification

Recep Vural, Aymen Khaleel, Majid Gerami, Ertugrul Basar

Comments: 5 pages, 10 figures, submitted for publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)