Information Theory

Authors and titles for April 2024

[251] arXiv:2404.01730 (cross-list from cs.LG) [pdf, html, other]

Title: Asymptotics of Language Model Alignment

Joy Qiping Yang, Salman Salamatian, Ziteng Sun, Ananda Theertha Suresh, Ahmad Beirami

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[252] arXiv:2404.01760 (cross-list from cs.CR) [pdf, html, other]

Title: Security for adversarial wiretap channels

Esther Hänggi, Iyán Méndez Veiga, Ligong Wang

Comments: 25 pages

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[253] arXiv:2404.01804 (cross-list from cs.LG) [pdf, html, other]

Title: Neuromorphic Wireless Device-Edge Co-Inference via the Directed Information Bottleneck

Yuzhen Ke, Zoran Utkovski, Mehdi Heshmati, Osvaldo Simeone, Johannes Dommel, Slawomir Stanczak

Comments: 8 pages

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Neural and Evolutionary Computing (cs.NE)

[254] arXiv:2404.01839 (cross-list from math.CO) [pdf, html, other]

Title: Hypergraphs of girth 5 and 6 and coding theory

Kathryn Haymaker, Michael Tait, Craig Timmons

Subjects: Combinatorics (math.CO); Information Theory (cs.IT)

[255] arXiv:2404.01872 (cross-list from cs.LG) [pdf, html, other]

Title: Fast and Adaptive Questionnaires for Voting Advice Applications

Fynn Bachmann, Cristina Sarasua, Abraham Bernstein

Comments: 16 pages plus appendix, submitted to ECML/PKDD 2024

Subjects: Machine Learning (cs.LG); Human-Computer Interaction (cs.HC); Information Theory (cs.IT)

[256] arXiv:2404.01875 (cross-list from eess.SP) [pdf, html, other]

Title: Satellite Federated Edge Learning: Architecture Design and Convergence Analysis

Yuanming Shi, Li Zeng, Jingyang Zhu, Yong Zhou, Chunxiao Jiang, Khaled B. Letaief

Comments: 16 pages, 15 figures

Subjects: Signal Processing (eess.SP); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Machine Learning (cs.LG)

[257] arXiv:2404.02160 (cross-list from cs.OH) [pdf, html, other]

Title: Trainable Least Squares to Reduce PAPR in OFDM-based Hybrid Beamforming Systems

Andrey Ivanov, Alexander Osinsky, Roman Bychkov, Vladimir Kalinin, Dmitry Lakontsev

Subjects: Other Computer Science (cs.OH); Information Theory (cs.IT)

[258] arXiv:2404.02161 (cross-list from cs.OH) [pdf, html, other]

Title: Virtual Sectorization to Enable Hybrid Beamforming in mm-Wave mMIMO

Roman Bychkov, Andrey Dergachev, Alexander Osinsky, Vladimir Lyashev, Andrey Ivanov

Subjects: Other Computer Science (cs.OH); Information Theory (cs.IT)

[259] arXiv:2404.02162 (cross-list from cs.OH) [pdf, html, other]

Title: LoS Sensing-based Channel Estimation in UAV-Assisted OFDM Systems

Chaojin Qing, Zhiying Liu, Wenquan Hu, Yinjie Zhang, Xi Cai, Pengfei Du

Subjects: Other Computer Science (cs.OH); Information Theory (cs.IT)

[260] arXiv:2404.02301 (cross-list from math.AC) [pdf, html, other]

Title: The edge code of hypergraphs

Delio Jaramillo-Velez

Comments: Comments are welcome!

Subjects: Commutative Algebra (math.AC); Information Theory (cs.IT); Combinatorics (math.CO)

[261] arXiv:2404.02486 (cross-list from eess.SY) [pdf, html, other]

Title: Joint Optimization on Uplink OFDMA and MU-MIMO for IEEE 802.11ax: Deep Hierarchical Reinforcement Learning Approach

Hyeonho Noh, Harim Lee, Hyun Jong Yang

Subjects: Systems and Control (eess.SY); Information Theory (cs.IT)

[262] arXiv:2404.02648 (cross-list from cs.NI) [pdf, html, other]

Title: A Universal Deep Neural Network for Signal Detection in Wireless Communication Systems

Khalid Albagami, Nguyen Van Huynh, Geoffrey Ye Li

Subjects: Networking and Internet Architecture (cs.NI); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[263] arXiv:2404.02663 (cross-list from eess.SP) [pdf, other]

Title: Ground-to-UAV sub-Terahertz channel measurement and modeling

Da Li, Peian Li, Jiabiao Zhao, Jianjian Liang, Jiacheng Liu, Guohao Liu, Yuanshuai Lei, Wenbo Liu, Jianqin Deng, Fuyong Liu, Jianjun Ma

Comments: To be published in Optics Express

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[264] arXiv:2404.02791 (cross-list from physics.bio-ph) [pdf, html, other]

Title: Thermodynamic limits on general far-from-equilibrium molecular templating networks

Benjamin Qureshi, Jenny M. Poulton, Thomas E. Ouldridge

Subjects: Biological Physics (physics.bio-ph); Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Molecular Networks (q-bio.MN)

[265] arXiv:2404.02910 (cross-list from physics.soc-ph) [pdf, html, other]

Title: Hierarchy Selection: New team ranking indicators for cyclist multi-stage races

Marcel Ausloos

Comments: 35 pages, 4 figures, 6 Tables, 75 references

Journal-ref: European Journal of Operational Research 314 (2024) 807-816

Subjects: Physics and Society (physics.soc-ph); Information Theory (cs.IT); Adaptation and Self-Organizing Systems (nlin.AO)

[266] arXiv:2404.02943 (cross-list from cs.LG) [pdf, html, other]

Title: Learning in Convolutional Neural Networks Accelerated by Transfer Entropy

Adrian Moldovan, Angel Caţaron, Răzvan Andonie

Journal-ref: Entropy - MDPI, Year 2021, Number 9, Article Number 1218, PubMedID 34573843, ISSN 1099-4300

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[267] arXiv:2404.03022 (cross-list from cs.CL) [pdf, html, other]

Title: BCAmirs at SemEval-2024 Task 4: Beyond Words: A Multimodal and Multilingual Exploration of Persuasion in Memes

Amirhossein Abaskohi, Amirhossein Dabiriaghdam, Lele Wang, Giuseppe Carenini

Comments: 12 pages, 5 tables, 2 figures, Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024) @ NAACL 2024

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG)

[268] arXiv:2404.03099 (cross-list from cs.LG) [pdf, html, other]

Title: Composite Bayesian Optimization In Function Spaces Using NEON -- Neural Epistemic Operator Networks

Leonardo Ferreira Guilhoto, Paris Perdikaris

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Information Theory (cs.IT); Machine Learning (stat.ML)

[269] arXiv:2404.03176 (cross-list from cs.LG) [pdf, html, other]

Title: Information-Theoretic Generalization Bounds for Deep Neural Networks

Haiyun He, Ziv Goldfeld

Comments: 21 pages, 5 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[270] arXiv:2404.03319 (cross-list from econ.EM) [pdf, html, other]

Title: An early warning system for emerging markets

Artem Kraevskiy, Artem Prokhorov, Evgeniy Sokolovskiy

Subjects: Econometrics (econ.EM); Information Theory (cs.IT)

[271] arXiv:2404.03524 (cross-list from cs.LG) [pdf, html, other]

Title: Approximate Gradient Coding for Privacy-Flexible Federated Learning with Non-IID Data

Okko Makkonen, Sampo Niemelä, Camilla Hollanti, Serge Kas Hanna

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Machine Learning (stat.ML)

[272] arXiv:2404.03619 (cross-list from quant-ph) [pdf, html, other]

Title: Circuit Knitting Faces Exponential Sampling Overhead Scaling Bounded by Entanglement Cost

Mingrui Jing, Chengkai Zhu, Xin Wang

Comments: 27 pages including appendix

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[273] arXiv:2404.03978 (cross-list from cs.AI) [pdf, html, other]

Title: Random Walk in Random Permutation Set Theory

Jiefeng Zhou, Zhen Li, Yong Deng

Comments: 27 pages, 8 figures; references added

Journal-ref: Chaos: An Interdisciplinary Journal of Nonlinear Science(2024)

Subjects: Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[274] arXiv:2404.04182 (cross-list from eess.SP) [pdf, html, other]

Title: Zak-OTFS to Integrate Sensing the I/O Relation and Data Communication

Muhammad Ubadah, Saif Khan Mohammed, Ronny Hadani, Shachar Kons, Ananthanarayanan Chockalingam, Robert Calderbank

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[275] arXiv:2404.04374 (cross-list from physics.bio-ph) [pdf, html, other]

Title: Closing the Loop: How Semantic Closure Enables Open-Ended Evolution

Amahury J. López-Díaz, Carlos Gershenson

Comments: 16 pages, 3 tables

Subjects: Biological Physics (physics.bio-ph); Information Theory (cs.IT); Neural and Evolutionary Computing (cs.NE); Adaptation and Self-Organizing Systems (nlin.AO); Populations and Evolution (q-bio.PE)

[276] arXiv:2404.04753 (cross-list from cs.NI) [pdf, other]

Title: RIS in Cellular Networks -- Challenges and Issues

Magnus Åström, Philipp Gentner, Omer Haliloglu, Behrooz Makki, Ola Tageman

Comments: Submitted to IEEE Access

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[277] arXiv:2404.05108 (cross-list from quant-ph) [pdf, other]

Title: Efficient Gradient Estimation of Variational Quantum Circuits with Lie Algebraic Symmetries

Mohsen Heidari, Masih Mozakka, Wojciech Szpankowski

Comments: 39 pages

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Machine Learning (cs.LG)

[278] arXiv:2404.05199 (cross-list from eess.SP) [pdf, html, other]

Title: Decision Transformers for Wireless Communications: A New Paradigm of Resource Management

Jie Zhang, Jun Li, Long Shi, Zhe Wang, Shi Jin, Wen Chen, H. Vincent Poor

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[279] arXiv:2404.05251 (cross-list from math.CO) [pdf, other]

Title: Association schemes arising from non-weakly regular bent functions

Yadi Wei, Jiaxin Wang, Fang-Wei Fu

Subjects: Combinatorics (math.CO); Information Theory (cs.IT)

[280] arXiv:2404.05271 (cross-list from cs.DS) [pdf, html, other]

Title: Scheduling Multi-Server Jobs is Not Easy

Rahul Vaze

Subjects: Data Structures and Algorithms (cs.DS); Information Theory (cs.IT)

[281] arXiv:2404.05335 (cross-list from eess.SP) [pdf, html, other]

Title: Jammer-Resilient Time Synchronization in the MIMO Uplink

Gian Marti, Flurin Arquint, Christoph Studer

Comments: Accepted at IEEE TSP

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[282] arXiv:2404.05486 (cross-list from math.ST) [pdf, html, other]

Title: Quickest Change Detection for Multiple Data Streams Using the James-Stein Estimator

Topi Halme, Venugopal V. Veeravalli, Visa Koivunen

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT)

[283] arXiv:2404.05775 (cross-list from math.RT) [pdf, html, other]

Title: On easily computable indecomposable dimension group algebras, and group codes

E. J. García-Claro

Comments: 24 pages, 2 tables

Subjects: Representation Theory (math.RT); Information Theory (cs.IT)

[284] arXiv:2404.05819 (cross-list from stat.ML) [pdf, html, other]

Title: Just Wing It: Near-Optimal Estimation of Missing Mass in a Markovian Sequence

Ashwin Pananjady, Vidya Muthukumar, Andrew Thangaraj

Comments: Version v2 simplifies proofs and corrects an error in Theorem 2. It is consistent with manuscript to appear in Journal of Machine Learning Research

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)

[285] arXiv:2404.05929 (cross-list from physics.data-an) [pdf, html, other]

Title: A feature-based information-theoretic approach for detecting interpretable, long-timescale pairwise interactions from time series

Aria Nguyen, Oscar McMullin, Joseph T. Lizier, Ben D. Fulcher

Comments: 20 pages, 7 figures

Subjects: Data Analysis, Statistics and Probability (physics.data-an); Information Theory (cs.IT); Methodology (stat.ME)

[286] arXiv:2404.05962 (cross-list from cs.IR) [pdf, html, other]

Title: Wasserstein Dependent Graph Attention Network for Collaborative Filtering with Uncertainty

Haoxuan Li, Yuanxin Ouyang, Zhuang Liu, Wenge Rong, Zhang Xiong

Comments: Accepted by IEEE TCSS

Subjects: Information Retrieval (cs.IR); Information Theory (cs.IT)

[287] arXiv:2404.06072 (cross-list from eess.SP) [pdf, html, other]

Title: Transmit and Receive Antenna Port Selection for Channel Capacity Maximization in Fluid-MIMO Systems

Christos N. Efrem, Ioannis Krikidis

Comments: 5 pages, 5 figures

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[288] arXiv:2404.06282 (cross-list from quant-ph) [pdf, html, other]

Title: Simple algorithms to test and learn local Hamiltonians

Francisco Escudero Gutiérrez

Comments: 7 pages

Subjects: Quantum Physics (quant-ph); Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG)

[289] arXiv:2404.06632 (cross-list from math.PR) [pdf, html, other]

Title: Relative entropy bounds for sampling with and without replacement

Oliver Johnson, Lampros Gavalakis, Ioannis Kontoyiannis

Comments: 17 pages, 1 figure

Subjects: Probability (math.PR); Information Theory (cs.IT)

[290] arXiv:2404.07009 (cross-list from cs.CL) [pdf, html, other]

Title: A Mathematical Theory for Learning Semantic Languages by Abstract Learners

Kuo-Yu Liao, Cheng-Shang Chang, Y.-W. Peter Hong

Comments: V1 was submitted to ISIT 2024 on Jan. 28, 2024. V2 was uploaded to ArXiv on April 13, 2024. V3 was uploaded to ArXiv on May 16, 2024

Journal-ref: in IEEE Journal on Selected Areas in Communications, vol. 43, no. 7, pp. 2700-2713, July 2025

Subjects: Computation and Language (cs.CL); Information Theory (cs.IT); Machine Learning (cs.LG)

[291] arXiv:2404.07154 (cross-list from math.RA) [pdf, html, other]

Title: Weights with Maximal Symmetry and Failures of the MacWilliams Identities

Jay A. Wood

Comments: 84 pages, 1 figure

Subjects: Rings and Algebras (math.RA); Information Theory (cs.IT)

[292] arXiv:2404.07281 (cross-list from quant-ph) [pdf, other]

Title: Certifying almost all quantum states with few single-qubit measurements

Hsin-Yuan Huang, John Preskill, Mehdi Soleimanifar

Comments: 63 pages, 5 figures

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Machine Learning (cs.LG)

[293] arXiv:2404.07344 (cross-list from cs.RO) [pdf, html, other]

Title: Interactive Learning of Physical Object Properties Through Robot Manipulation and Database of Object Measurements

Andrej Kruzliak, Jiri Hartvich, Shubhan P. Patni, Lukas Rustler, Jan Kristof Behrens, Fares J. Abu-Dakka, Krystian Mikolajczyk, Ville Kyrki, Matej Hoffmann

Comments: 8 pages, 9 figures

Journal-ref: Intelligent Robots and Systems (IROS), 2024 IEEE/RSJ International Conference on

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[294] arXiv:2404.07377 (cross-list from cs.LG) [pdf, html, other]

Title: Deep Generative Sampling in the Dual Divergence Space: A Data-efficient & Interpretative Approach for Generative AI

Sahil Garg, Anderson Schneider, Anant Raj, Kashif Rasul, Yuriy Nevmyvaka, Sneihil Gopal, Amit Dhurandhar, Guillermo Cecchi, Irina Rish

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

[295] arXiv:2404.07425 (cross-list from eess.SP) [pdf, other]

Title: Precoder Design for User-Centric Network Massive MIMO with Matrix Manifold Optimization

Rui Sun, Li You, An-An Lu, Chen Sun, Xiqi Gao, Xiang-Gen Xia

Comments: 14 pages, 9 figures, journal

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[296] arXiv:2404.07721 (cross-list from eess.SP) [pdf, html, other]

Title: Trainable Joint Channel Estimation, Detection and Decoding for MIMO URLLC Systems

Yi Sun, Hong Shen, Bingqing Li, Wei Xu, Pengcheng Zhu, Nan Hu, Chunming Zhao

Comments: 17 pages, 12 figures, accepted by IEEE Transactions on Wireless Communications

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[297] arXiv:2404.08131 (cross-list from cs.LG) [pdf, html, other]

Title: Frame Quantization of Neural Networks

Wojciech Czaja, Sanghoon Na

Comments: 20 pages, 2 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[298] arXiv:2404.08224 (cross-list from cs.LG) [pdf, html, other]

Title: HCL-MTSAD: Hierarchical Contrastive Consistency Learning for Accurate Detection of Industrial Multivariate Time Series Anomalies

Haili Sun, Yan Huang, Lansheng Han, Cai Fu, Chunjie Zhou

Comments: This paper is a manuscript that is still in the process of revision, including Table 1, Figure 2, problem definition in section III.B and method description proposed in section IV. In addition, the submitter has not been authorized by the first author and other co-authors to post the paper to arXiv

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Information Theory (cs.IT); Systems and Control (eess.SY)

[299] arXiv:2404.08455 (cross-list from eess.SP) [pdf, html, other]

Title: Optimized Detection with Analog Beamforming for Monostatic Integrated Sensing and Communication

Rodrigo Hernangómez, Jochen Fink, Renato L.G. Cavalcante, Zoran Utkovski, Sławomir Stańczak

Comments: 7 pages, 4 figures. Published at IEEE International Conference on Communications (ICC) 2024. IEEE Copyright protected

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[300] arXiv:2404.08483 (cross-list from eess.SP) [pdf, other]

Title: Semantic Communication for Cooperative Multi-Task Processing over Wireless Networks

Ahmad Halimi Razlighi, Carsten Bockelmann, Armin Dekorsy

Comments: This work has been submitted to the IEEE Wireless Communications Letters for possible publication

Journal-ref: IEEE Wireless Communications Letters ( Volume: 13, Issue: 10, October 2024)

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)