Information Theory

Authors and titles for October 2019

[251] arXiv:1910.07663 (cross-list from cs.LG) [pdf, other]

Title: Probabilistic Deterministic Finite Automata and Recurrent Networks, Revisited

S. E. Marzen, J. P. Crutchfield

Comments: 15 pages, 4 figures; this http URL

Subjects: Machine Learning (cs.LG); Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Chaotic Dynamics (nlin.CD); Machine Learning (stat.ML)

[252] arXiv:1910.07826 (cross-list from cs.CR) [pdf, other]

Title: Information-theoretic metrics for Local Differential Privacy protocols

Milan Lopuhaä-Zwakenberg, Boris Škorić, Ninghui Li

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[253] arXiv:1910.07843 (cross-list from eess.SP) [pdf, other]

Title: Max-min Fairness of K-user Cooperative Rate-Splitting in MISO Broadcast Channel with User Relaying

Yijie Mao, Bruno Clerckx, Jian Zhang, Victor O.K. Li, Mohammed Arafah

Comments: accepted by IEEE Transactions on Wireless Communications

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[254] arXiv:1910.07870 (cross-list from stat.ML) [pdf, other]

Title: Is There a Trade-Off Between Fairness and Accuracy? A Perspective Using Mismatched Hypothesis Testing

Sanghamitra Dutta, Dennis Wei, Hazar Yueksel, Pin-Yu Chen, Sijia Liu, Kush R. Varshney

Comments: This paper appears in the Proceedings of the 37th International Conference on Machine Learning, pp. 2803--2813, 2020

Subjects: Machine Learning (stat.ML); Computers and Society (cs.CY); Information Theory (cs.IT); Machine Learning (cs.LG)

[255] arXiv:1910.07959 (cross-list from eess.SP) [pdf, other]

Title: Analysis of Cooperative Hybrid ARQ with Adaptive Modulation and Coding on a Correlated Fading Channel

Ibrahim Ozkan

Journal-ref: Third International Balkan Conference on Communications and Networking 2019 (BalkanCom'19)

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[256] arXiv:1910.08197 (cross-list from quant-ph) [pdf, other]

Title: Resource theories of communication

Hlér Kristjánsson, Giulio Chiribella, Sina Salek, Daniel Ebler, Matthew Wilson

Comments: 25 pages, 12 figures

Journal-ref: New Journal of Physics 22, 073014 (2020)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[257] arXiv:1910.08230 (cross-list from eess.SP) [pdf, other]

Title: Cooperative Beamforming in Cognitive Radio Relay Networks Using Amplify-and-Forward Relaying Technique

Amir Behrouzi-Far, Saeideh Mohammadkhani

Comments: Accepted for oral presentation in IEICE SmartCom 2019

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[258] arXiv:1910.08291 (cross-list from cs.NI) [pdf, other]

Title: D2D-Enabled Mobile User Edge Caching: A Multi-Winner Auction Approach

Tiankui Zhang, Xinyuan Fang, Yuanwei Liu, Geoffrey Ye Li, Wenjun Xu

Comments: 14 pages

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[259] arXiv:1910.08296 (cross-list from eess.SP) [pdf, other]

Title: Joint Computation and Communication Design for UAV-Assisted Mobile Edge Computing in IoT

Tiankui Zhang, Yu Xu, Jonathan Loo, Dingcheng Yang, Lin Xiao

Comments: 10 pages

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[260] arXiv:1910.08510 (cross-list from cs.CR) [pdf, other]

Title: Analysis of Nakamoto Consensus, Revisited

Jianyu Niu, Chen Feng, Hoang Dau, Yu-Chih Huang, Jingge Zhu

Comments: 8 pages

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[261] arXiv:1910.08679 (cross-list from cs.CR) [pdf, other]

Title: Improving Privacy in Graphs Through Node Addition

Nazanin Takbiri, Xiaozhe Shao, Lixin Gao, Hossein Pishro-Nik

Comments: Graph Privacy

Journal-ref: 57th Annual Allerton Conference on Communication, Control, and Computing 2019

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[262] arXiv:1910.08828 (cross-list from cs.LG) [pdf, other]

Title: Dictionary Learning with Almost Sure Error Constraints

Mohammed Rayyan Sheriff, Debasish Chatterjee

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Optimization and Control (math.OC); Machine Learning (stat.ML)

[263] arXiv:1910.08844 (cross-list from eess.SP) [pdf, other]

Title: UW-SVC: Scalable Video Coding Transmission for In-network Underwater Imagery Analysis

Mehdi Rahmati, Dario Pompili

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[264] arXiv:1910.08868 (cross-list from cs.NI) [pdf, other]

Title: Downlink Performance of Dense Antenna Deployment: To Distribute or Concentrate?

Mounia Hamidouche, Ejder Baştuğ, Jihong Park, Laura Cottatellucci, Mérouane Debbah

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[265] arXiv:1910.09177 (cross-list from eess.SP) [pdf, other]

Title: A Complexity Efficient DMT-Optimal Tree Pruning Based Sphere Decoding

Mohammad Neinavaie, Mostafa Derakhtian, Negar Daryanavardan, Sergiy Vorobyov

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[266] arXiv:1910.09235 (cross-list from cs.CR) [pdf, other]

Title: Constructing Privacy Channels from Information Channels

Genqiang Wu

Comments: arXiv admin note: substantial text overlap with arXiv:1703.07474

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[267] arXiv:1910.09257 (cross-list from math.CA) [pdf, other]

Title: Finding duality for Riesz bases of exponentials on multi-tiles

Christina Frederick, Kasso Okoudjou

Subjects: Classical Analysis and ODEs (math.CA); Information Theory (cs.IT)

[268] arXiv:1910.09333 (cross-list from quant-ph) [pdf, other]

Title: On Optimality of CSS Codes for Transversal $T$

Narayanan Rengaswamy, Robert Calderbank, Michael Newman, Henry D. Pfister

Comments: v2: Much improved proof for Theorem 2, and some presentation improvements in other proofs. Main sections: 16 pages, double column, IEEEtran style. Examples included. Comments welcome!

Journal-ref: IEEE Journal on Selected Areas in Information Theory, vol. 1, no. 2, pp. 499-514, Aug. 2020

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[269] arXiv:1910.09416 (cross-list from math.CO) [pdf, other]

Title: An Improved Linear Programming Bound on the Average Distance of a Binary Code

Lei Yu, Vincent Y. F. Tan

Comments: 17 pages, 2 figures

Subjects: Combinatorics (math.CO); Discrete Mathematics (cs.DM); Information Theory (cs.IT); Metric Geometry (math.MG)

[270] arXiv:1910.09578 (cross-list from cs.LG) [pdf, other]

Title: On Predictive Information in RNNs

Zhe Dong, Deniz Oktay, Ben Poole, Alexander A. Alemi

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[271] arXiv:1910.09630 (cross-list from eess.SP) [pdf, other]

Title: Blind interactive learning of modulation schemes: Multi-agent cooperation without co-design

Anant Sahai, Joshua Sanz, Vignesh Subramanian, Caryn Tran, Kailas Vodrahalli

Comments: 33 pages, 25 figures, code can be found at this https URL, accepted for publication in IEEE Access

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[272] arXiv:1910.09647 (cross-list from eess.SP) [pdf, other]

Title: Secrecy Analyses of a Full-Duplex MIMOME Network

Reza Sohrabi, Qiping Zhu, Yingbo Hua

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[273] arXiv:1910.09896 (cross-list from cs.SI) [pdf, other]

Title: Simplification of networks via conservation of path diversity and minimisation of the search information

Hengda Yin, Richard. G. Clegg, Raul. J. Mondragon

Comments: 18 pages, 8 figures

Subjects: Social and Information Networks (cs.SI); Information Theory (cs.IT)

[274] arXiv:1910.09912 (cross-list from cs.NI) [pdf, other]

Title: Scalable and Accurate Modeling of the Millimeter Wave Channel

Paolo Testolina, Mattia Lecci, Michele Polese, Marco Giordani, Michele Zorzi

Comments: 6 pages, 7 figures. This paper has been accepted for presentation at IEEE ICNC 2020. Copyright IEEE 2020. Please cite it as Paolo Testolina, Mattia Lecci, Michele Polese, Marco Giordani, Michele Zorzi, Scalable and Accurate Modeling of the Millimeter Wave Channel, IEEE International Conference on Computing, Networking and Communications (ICNC), Big Island, HI, 2020

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[275] arXiv:1910.09945 (cross-list from eess.SP) [pdf, other]

Title: Meta-Learning to Communicate: Fast End-to-End Training for Fading Channels

Sangwoo Park, Osvaldo Simeone, Joonhyuk Kang

Comments: submitted for conference publication

Journal-ref: in Proc. 2020 IEEE 45th International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, May 2020

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)

[276] arXiv:1910.10079 (cross-list from eess.SP) [pdf, other]

Title: New RLL Code with Improved Error Performance for Visible Light Communication

Vitalio Alfonso Reguera

Comments: 4 pages, 3 figures

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[277] arXiv:1910.10283 (cross-list from cs.DC) [pdf, other]

Title: Train Where the Data is: A Case for Bandwidth Efficient Coded Training

Zhifeng Lin, Krishna Giri Narra, Mingchao Yu, Salman Avestimehr, Murali Annavaram

Comments: 10 pages, Under submission

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Machine Learning (cs.LG)

[278] arXiv:1910.10453 (cross-list from cs.LG) [pdf, html, other]

Title: Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning

Anis Elgabli, Jihong Park, Amrit S. Bedi, Chaouki Ben Issaid, Mehdi Bennis, Vaneet Aggarwal

Comments: 20 pages, 8 figures; to appear in IEEE Transactions on Communications

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI); Machine Learning (stat.ML)

[279] arXiv:1910.10831 (cross-list from cs.LG) [pdf, other]

Title: Variational Predictive Information Bottleneck

Alexander A. Alemi

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[280] arXiv:1910.11248 (cross-list from math.ST) [pdf, other]

Title: Wasserstein information matrix

Wuchen Li, Jiaxi Zhao

Comments: 45 pages, 3 figures

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT)

[281] arXiv:1910.11374 (cross-list from stat.ML) [pdf, other]

Title: Robust Principal Component Analysis Based On Maximum Correntropy Power Iterations

Jean P. Chereau, Bruno Scalzo Dees, Danilo P. Mandic

Comments: 5 pages, 1 figure

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Signal Processing (eess.SP); Applications (stat.AP)

[282] arXiv:1910.11378 (cross-list from eess.SP) [pdf, other]

Title: Underwater Cooperative MIMO Communications using Hybrid Acoustic and Magnetic Induction Technique

Zhangyu Li, Soham Desai, Vaishnendr D Sudev, Pu Wang, Jinsong Han, Zhi Sun

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[283] arXiv:1910.11439 (cross-list from eess.SP) [pdf, other]

Title: Computation Efficiency Maximization in OFDMA-Based Mobile Edge Computing Networks

Yuhang Wu, Yuhao Wang, Fuhui Zhou, Rose Qingyang Hu

Comments: This paper has been accepted by IEEE Communications Letters

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[284] arXiv:1910.11451 (cross-list from math.OC) [pdf, other]

Title: Information Flow Optimization in Inference Networks

Aditya Deshmukh, Jing Liu, Venugopal V. Veeravalli, Gunjan Verma

Subjects: Optimization and Control (math.OC); Information Theory (cs.IT)

[285] arXiv:1910.11540 (cross-list from cs.LG) [pdf, other]

Title: Descriptive Dimensionality and Its Characterization of MDL-based Learning and Change Detection

Kenji Yamanishi

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[286] arXiv:1910.11704 (cross-list from eess.SP) [pdf, other]

Title: Joint Source-Channel Coding and Bayesian Message Passing Detection for Grant-Free Radio Access in IoT

Johannes Dommel, Zoran Utkovski, Slawomir Stanczak, Osvaldo Simeone

Comments: submitted for conference publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[287] arXiv:1910.12162 (cross-list from cs.CV) [pdf, other]

Title: Structured Low-Rank Algorithms: Theory, MR Applications, and Links to Machine Learning

Mathews Jacob, Merry P. Mani, Jong Chul Ye

Comments: Accepted for IEEE Signal Processing Magazine

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[288] arXiv:1910.12309 (cross-list from eess.SP) [pdf, other]

Title: Spectral Power Parameter Estimation of Random Sources with Binary Sampled Signals

Manuel S. Stein

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[289] arXiv:1910.12327 (cross-list from math.ST) [pdf, other]

Title: A simple measure of conditional dependence

Mona Azadkia, Sourav Chatterjee

Comments: 41 pages, 2 tables. Final version. To appear in Ann. Statist. An R package is available at this https URL

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Probability (math.PR); Methodology (stat.ME)

[290] arXiv:1910.12428 (cross-list from math.ST) [pdf, other]

Title: Power analysis of knockoff filters for correlated designs

Jingbo Liu, Philippe Rigollet

Comments: Accepted to Neurips 2019. The conference version includes the contents of this version excluding the appendices. v3 on arXiv corrected some typos in v2

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[291] arXiv:1910.12455 (cross-list from eess.SP) [pdf, other]

Title: Deep Learning for Beamspace Channel Estimation in Millimeter-Wave Massive MIMO Systems

Xiuhong Wei, Chen Hu, Linglong Dai

Comments: 12 pages, 10 figures, to appear in IEEE Transactions on Communications

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[292] arXiv:1910.12490 (cross-list from cs.LG) [pdf, other]

Title: Same-Cluster Querying for Overlapping Clusters

Wasim Huleihel, Arya Mazumdar, Muriel Médard, Soumyabrata Pal

Comments: 43 pages, accepted at NeurIPS'19

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (stat.ML)

[293] arXiv:1910.12657 (cross-list from eess.SP) [pdf, other]

Title: Power Allocation and User Assignment Scheme for Beyond 5G Heterogeneous Networks

Khush Bakht, Furqan Jameel, Zain Ali, Wali Ullah Khan, Imran Khan, Guftaar Ahmad Sardar Sidhu, Jeong Woo Lee

Comments: Beyond 5G, Cognitive Radio (CR), Dual Decomposition, User Fairness, Heterogeneous Networks (HetNets)

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)

[294] arXiv:1910.12832 (cross-list from cs.LG) [pdf, other]

Title: Differentially Private Distributed Data Summarization under Covariate Shift

Kanthi Sarpatwar, Karthikeyan Shanmugam, Venkata Sitaramagiridharganesh Ganapavarapu, Ashish Jagmohan, Roman Vaculin

Comments: To appear in the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Information Theory (cs.IT); Machine Learning (stat.ML)

[295] arXiv:1910.12837 (cross-list from stat.ML) [pdf, other]

Title: Online Stochastic Gradient Descent with Arbitrary Initialization Solves Non-smooth, Non-convex Phase Retrieval

Yan Shuo Tan, Roman Vershynin

Journal-ref: Journal of Machine Learning Research, 24(58), 1-47 (2023)

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC)

[296] arXiv:1910.12954 (cross-list from stat.ML) [pdf, other]

Title: Fundamental Limits of Deep Graph Convolutional Networks

Abram Magner, Mayank Baranwal, Alfred O. Hero III

Comments: 19 pages

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Probability (math.PR)

[297] arXiv:1910.13567 (cross-list from eess.SP) [pdf, other]

Title: Cell Association via Boundary Detection: A Scalable Approach Based on Data-Driven Random Features

Yinsong Wang, Hessam Mahdavifar, Kamran Entesari, Shahin Shahrampour

Comments: 6 pages

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[298] arXiv:1910.13613 (cross-list from cs.LG) [pdf, other]

Title: Bounding Regression Errors in Data-driven Power Grid Steady-state Models

Yuxiao Liu, Bolun Xu, Audun Botterud, Ning Zhang, Chongqing Kang

Comments: 11 pages, 10 fugures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP); Machine Learning (stat.ML)

[299] arXiv:1910.13652 (cross-list from eess.SP) [pdf, other]

Title: Achieving Positive Covert Capacity over MIMO AWGN Channels

Ahmed Bendary, Amr Abdelaziz, C. Emre Koksal

Comments: Covert communication, low probability of detection communication, MIMO AWGN, square-root law, secrecy capacity, compound channels, unit-rank MIMO

Journal-ref: IEEE Journal on Selected Areas in Information Theory 2021

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[300] arXiv:1910.13871 (cross-list from cs.NI) [pdf, other]

Title: Closed-Form Whittle's Index-Enabled Random Access for Timely Status Update

Jingzhou Sun, Zhiyuan Jiang, Bhaskar Krishnamachari, Sheng Zhou, Zhisheng Niu

Comments: 30 pages, 7 figures, submitted to IEEE Transactions on Communications. arXiv admin note: substantial text overlap with arXiv:1803.08189

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)