Information Theory

Authors and titles for April 2017

[226] arXiv:1704.09007 [pdf, other]

Title: Entropy of Independent Experiments, Revisited

Maciej Skorski

Subjects: Information Theory (cs.IT)

[227] arXiv:1704.00116 (cross-list from math.OC) [pdf, other]

Title: Stochastic L-BFGS: Improved Convergence Rates and Practical Acceleration Strategies

Renbo Zhao, William B. Haskell, Vincent Y. F. Tan

Subjects: Optimization and Control (math.OC); Information Theory (cs.IT); Machine Learning (stat.ML)

[228] arXiv:1704.00297 (cross-list from math.MG) [pdf, other]

Title: Tropical Limits of Probability Spaces, Part I: The Intrinsic Kolmogorov-Sinai Distance and the Asymptotic Equipartition Property for Configurations

Rostislav Matveev, Jacobus W. Portegies

Comments: Comment to version 2: Fixed typos, a calculation mistake in Lemma 5.1 and its consequences in Proposition 5.2 and Theorem 6.1

Subjects: Metric Geometry (math.MG); Information Theory (cs.IT); Probability (math.PR)

[229] arXiv:1704.00367 (cross-list from cs.LG) [pdf, other]

Title: Provable Inductive Robust PCA via Iterative Hard Thresholding

U.N. Niranjan, Arun Rajkumar, Theja Tulabandhula

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[230] arXiv:1704.00399 (cross-list from cs.NI) [pdf, other]

Title: Ultra-Dense Networks: Is There a Limit to Spatial Spectrum Reuse?

Ming Ding, David Lopez Perez, Guoqiang Mao, Zihuai Lin

Comments: conference submission in Oct. 2017

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[231] arXiv:1704.00436 (cross-list from stat.AP) [pdf, other]

Title: Sparse Bayesian learning with uncertainty models and multiple dictionaries

Santosh Nannuru, Kay L. Gemba, Peter Gerstoft, William S. Hodgkiss, Christoph Mecklenbräuker

Comments: 11 pages, 8 figures

Journal-ref: Elsevier Signal Processing, Volume 159, June 2019, Pages 159-170

Subjects: Applications (stat.AP); Information Theory (cs.IT)

[232] arXiv:1704.00521 (cross-list from cs.NI) [pdf, other]

Title: Power Control in Massive MIMO with Dynamic User Population

Mohamad Assaad, Salah Eddine Hajri, Thomas Bonald, Anthony Ephremides

Comments: conference paper, submitted

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[233] arXiv:1704.00527 (cross-list from cs.GT) [pdf, other]

Title: Truthfulness in Repeated Predictions

Amir Ban

Comments: The main result is not correct when there is more than one agent. The proof considers the effect of untruthfulness on the belief of the public, but errs in not considering the effect on the beliefs of other agents

Subjects: Computer Science and Game Theory (cs.GT); Information Theory (cs.IT)

[234] arXiv:1704.00575 (cross-list from stat.AP) [pdf, other]

Title: Sparse mean localization by information theory

Emiliano Diaz

Subjects: Applications (stat.AP); Information Theory (cs.IT)

[235] arXiv:1704.01053 (cross-list from physics.soc-ph) [pdf, other]

Title: Network-ensemble comparisons with stochastic rewiring and von Neumann entropy

Zichao Li, Peter J. Mucha, Dane Taylor

Comments: 24 pages, 6 figures

Subjects: Physics and Society (physics.soc-ph); Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Theory (cs.IT); Probability (math.PR); Methodology (stat.ME)

[236] arXiv:1704.01101 (cross-list from cs.CC) [pdf, other]

Title: On Resource-bounded versions of the van Lambalgen theorem

Diptarka Chakraborty, Satyadev Nandakumar, Himanshu Shukla

Subjects: Computational Complexity (cs.CC); Information Theory (cs.IT)

[237] arXiv:1704.01177 (cross-list from math.PR) [pdf, other]

Title: Combinatorial Entropy Power Inequalities: A Preliminary Study of the Stam region

Mokshay Madiman, Farhad Ghassemi

Comments: 16 pages

Journal-ref: IEEE Transactions on Information Theory, vol. 65, no. 3, pp. 1375-1386, March 2019

Subjects: Probability (math.PR); Information Theory (cs.IT)

[238] arXiv:1704.01265 (cross-list from cs.NA) [pdf, other]

Title: Geometry of Factored Nuclear Norm Regularization

Qiuwei Li, Zhihui Zhu, Gongguo Tang

Subjects: Numerical Analysis (math.NA); Information Theory (cs.IT); Machine Learning (cs.LG); Optimization and Control (math.OC)

[239] arXiv:1704.01361 (cross-list from quant-ph) [pdf, other]

Title: Applications of position-based coding to classical communication over quantum channels

Haoyu Qi, Qingle Wang, Mark M. Wilde

Comments: v4: 44 pages, v4 includes a simpler proof for an upper bound on one-shot entanglement-assisted capacity, also found recently and independently in arXiv:1804.09644

Journal-ref: Journal of Physics A, vol. 51, no. 44, page 444002, November 2018

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[240] arXiv:1704.01416 (cross-list from quant-ph) [pdf, other]

Title: Emergence of Time in a Participatory Universe

Bharath Ron

Comments: Updated lots of things, clearer presentation

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); General Relativity and Quantum Cosmology (gr-qc); Mathematical Physics (math-ph)

[241] arXiv:1704.01573 (cross-list from quant-ph) [pdf, other]

Title: The algorithmic randomness of quantum measurements

Mohammad Shahbazi

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[242] arXiv:1704.01733 (cross-list from q-bio.MN) [pdf, other]

Title: A stochastic molecular scheme for an artificial cell to infer its environment from partial observations

Muppirala Viswa Virinchi, Abhishek Behera, Manoj Gopalkrishnan

Comments: 12 pages, 1 figure

Subjects: Molecular Networks (q-bio.MN); Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Adaptation and Self-Organizing Systems (nlin.AO); Biological Physics (physics.bio-ph)

[243] arXiv:1704.02094 (cross-list from astro-ph.IM) [pdf, other]

Title: Precise Real-Time Navigation of LEO Satellites Using a Single-Frequency GPS Receiver and Ultra-Rapid Ephemerides

Xiucong Sun, Chao Han, Pei Chen

Comments: 25 pages, 6 figures, Ready for publication in Aerospace Science and Technology, 2017

Journal-ref: Aerospace Science and Technology, Vol. 67, 2017, pp.228-236

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Information Theory (cs.IT)

[244] arXiv:1704.02634 (cross-list from math.PR) [pdf, other]

Title: Rényi entropy power inequality and a reverse

Jiange Li

Journal-ref: Studia Math, 242(3): 303-319, 2018

Subjects: Probability (math.PR); Information Theory (cs.IT); Functional Analysis (math.FA)

[245] arXiv:1704.02716 (cross-list from cs.AI) [pdf, other]

Title: Formal approaches to a definition of agents

Martin Biehl

Comments: PhD thesis, 198 pages

Subjects: Artificial Intelligence (cs.AI); Information Theory (cs.IT); Multiagent Systems (cs.MA)

[246] arXiv:1704.03174 (cross-list from quant-ph) [pdf, other]

Title: Quantum simulation of the integer factorization problem: Bell states in a Penning trap

Jose Luis Rosales, Vicente Martin

Journal-ref: Phys. Rev. A 97, 032325 (2018)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[247] arXiv:1704.03354 (cross-list from stat.ML) [pdf, other]

Title: Optimized Data Pre-Processing for Discrimination Prevention

Flavio P. Calmon, Dennis Wei, Karthikeyan Natesan Ramamurthy, Kush R. Varshney

Subjects: Machine Learning (stat.ML); Computers and Society (cs.CY); Information Theory (cs.IT)

[248] arXiv:1704.03620 (cross-list from cs.GT) [pdf, other]

Title: Inter-Operator Resource Management for Millimeter Wave, Multi-Hop Backhaul Networks

Omid Semiari, Walid Saad, Mehdi Bennis, Zaher Dawy

Comments: Accepted in IEEE Transactions on Wireless Communications

Subjects: Computer Science and Game Theory (cs.GT); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)

[249] arXiv:1704.03816 (cross-list from math.OC) [pdf, other]

Title: Dynamic Signaling Games with Quadratic Criteria under Nash and Stackelberg Equilibria

Serkan Sarıtaş, Serdar Yüksel, Sinan Gezici

Comments: 17 pages

Subjects: Optimization and Control (math.OC); Information Theory (cs.IT)

[250] arXiv:1704.03866 (cross-list from cs.DS) [pdf, other]

Title: Robustly Learning a Gaussian: Getting Optimal Error, Efficiently

Ilias Diakonikolas, Gautam Kamath, Daniel M. Kane, Jerry Li, Ankur Moitra, Alistair Stewart

Comments: To appear in SODA 2018

Subjects: Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[251] arXiv:1704.04118 (cross-list from math.OC) [pdf, other]

Title: From Data to Decisions: Distributionally Robust Optimization is Optimal

Bart P.G. Van Parys, Peyman Mohajerin Esfahani, Daniel Kuhn

Subjects: Optimization and Control (math.OC); Information Theory (cs.IT)

[252] arXiv:1704.04194 (cross-list from q-bio.OT) [pdf, other]

Title: Ultrametrics in the genetic code and the genome

Branko Dragovich, Andrei Yu. Khrennikov, Nataša Ž. Mišić

Comments: 20 pages. Accepted for publication in Applied Mathematics and Computation

Journal-ref: Applied Mathematics and Computation 309 (2017) 359-358

Subjects: Other Quantitative Biology (q-bio.OT); Information Theory (cs.IT); Metric Geometry (math.MG)

[253] arXiv:1704.04206 (cross-list from cs.ET) [pdf, other]

Title: Molecular Communication using Magnetic Nanoparticles

Wayan Wicke, Arman Ahmadzadeh, Vahid Jamali, Harald Unterweger, Christoph Alexiou, Robert Schober

Comments: 6 pages, 4 figures, 1 table. Submitted to the IEEE Wireless Communications and Networking Conference (IEEE WCNC) 2018. Changes: Clarified two-dimensional environment

Subjects: Emerging Technologies (cs.ET); Information Theory (cs.IT)

[254] arXiv:1704.04244 (cross-list from math.CO) [pdf, html, other]

Title: Generalized Three and Four Person Hat Game

Theo van Uem

Comments: 22 pages

Subjects: Combinatorics (math.CO); Discrete Mathematics (cs.DM); Information Theory (cs.IT)

[255] arXiv:1704.04465 (cross-list from cs.NI) [pdf, other]

Title: A Low-Complexity Approach to Distributed Cooperative Caching with Geographic Constraints

Konstantin Avrachenkov, Jasper Goseling, Berksan Serbetci

Comments: 24 pages, 9 figures, presented at SIGMETRICS'17

Journal-ref: Proc. ACM Meas. Anal. Comput. Syst. (Vol. 1, No. 1, Article 27, June 2017)

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[256] arXiv:1704.04548 (cross-list from cs.LG) [pdf, other]

Title: On the Gap Between Strict-Saddles and True Convexity: An Omega(log d) Lower Bound for Eigenvector Approximation

Max Simchowitz, Ahmed El Alaoui, Benjamin Recht

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Combinatorics (math.CO); Machine Learning (stat.ML)

[257] arXiv:1704.04600 (cross-list from math.PR) [pdf, other]

Title: Randomized detection and detection capacity of multidetector networks

Ghurumuruhan Ganesan

Subjects: Probability (math.PR); Information Theory (cs.IT)

[258] arXiv:1704.04681 (cross-list from q-bio.BM) [pdf, other]

Title: Automaton model of protein: dynamics of conformational and functional states

Andrei Khrennikov, Ekaterina Yurova

Journal-ref: Progress in Biophysics and Molecular Biology 130, Part A, 2-14 (2017)

Subjects: Biomolecules (q-bio.BM); Information Theory (cs.IT); Quantum Physics (quant-ph)

[259] arXiv:1704.04707 (cross-list from cond-mat.stat-mech) [pdf, other]

Title: Structure and Randomness of Continuous-Time Discrete-Event Processes

S. E. Marzen, J. P. Crutchfield

Comments: 10 pages, 2 figures; this http URL

Subjects: Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Statistics Theory (math.ST); Chaotic Dynamics (nlin.CD)

[260] arXiv:1704.04795 (cross-list from q-bio.NC) [pdf, other]

Title: Root Mean Square Error of Neural Spike Train Sequence Matching with Optogenetics

Adam Noel, Dimitrios Makrakis, Andrew W. Eckford

Comments: 6 pages, 5 figures. Will be presented at IEEE Global Communications Conference (IEEE GLOBECOM 2017) in December 2017

Subjects: Neurons and Cognition (q-bio.NC); Information Theory (cs.IT); Biological Physics (physics.bio-ph)

[261] arXiv:1704.04810 (cross-list from cs.ET) [pdf, other]

Title: A Novel Experimental Platform for In-Vessel Multi-Chemical Molecular Communications

Nariman Farsad, David Pan, Andrea Goldsmith

Subjects: Emerging Technologies (cs.ET); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[262] arXiv:1704.05120 (cross-list from cs.CC) [pdf, other]

Title: Does robustness imply tractability? A lower bound for planted clique in the semi-random model

Jacob Steinhardt

Comments: Improved lower bound to give recovery probability tending to zero. Factored out and highlighted perturbed Bernoulli argument

Subjects: Computational Complexity (cs.CC); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[263] arXiv:1704.05125 (cross-list from cs.NI) [pdf, other]

Title: Performance Impact of Base Station Antenna Heights in Dense Cellular Networks

Ming Ding, David Lopez-Perez

Comments: To appear in IEEE TWC

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[264] arXiv:1704.05190 (cross-list from cs.NI) [pdf, other]

Title: Competitive Resource Allocation in HetNets: the Impact of Small-cell Spectrum Constraints and Investment Costs

Cheng Chen, Randall A. Berry, Michael L. Honig, Vijay G. Subramanian

Comments: 15 pages, 8 figures. submitted to IEEE Transactions on Cognitive Communications and Networking

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[265] arXiv:1704.05240 (cross-list from cs.CV) [pdf, other]

Title: Image Fusion With Cosparse Analysis Operator

Rui Gao, Sergiy A. Vorobyov, Hong Zhao

Comments: 12 pages, 4 figures, 1 table, Submitted to IEEE Signal Processing Letters on December 2016

Journal-ref: IEEE Signal Processing Letters, vol. 24, no. 7, pp. 943-947, July 2017

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

[266] arXiv:1704.05443 (cross-list from math.LO) [pdf, other]

Title: Approximations from Anywhere and General Rough Sets

A. Mani

Comments: 20 Pages. Scheduled to appear in IJCRS'2017 LNCS Proceedings, Springer

Subjects: Logic (math.LO); Artificial Intelligence (cs.AI); Discrete Mathematics (cs.DM); Information Theory (cs.IT)

[267] arXiv:1704.05477 (cross-list from math.LO) [pdf, other]

Title: Generalized Ideals and Co-Granular Rough Sets

A Mani

Comments: 20pages. Scheduled to appear in IJCRS'2017 Proceedings, LNCS, Springer

Subjects: Logic (math.LO); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Logic in Computer Science (cs.LO)

[268] arXiv:1704.05499 (cross-list from q-fin.ST) [pdf, other]

Title: Quantifying instabilities in Financial Markets

Bruna Amin Gonçalves, Laura Carpi, Osvaldo A. Rosso, Martin G. Ravetti, A.P.F Atman

Comments: 5 pages, 3 figures

Subjects: Statistical Finance (q-fin.ST); Information Theory (cs.IT)

[269] arXiv:1704.05703 (cross-list from quant-ph) [pdf, other]

Title: Quantum Sphere-Packing Bounds with Polynomial Prefactors

Hao-Chung Cheng, Min-Hsiu Hsieh, Marco Tomamichel

Journal-ref: IEEE Transactions on Information Theory, 65(5):2872-2898, May 2019

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[270] arXiv:1704.06279 (cross-list from cond-mat.dis-nn) [pdf, other]

Title: Mutual Information, Neural Networks and the Renormalization Group

Maciej Koch-Janusz, Zohar Ringel

Comments: The accepted (substantially extended) version

Journal-ref: Nature Physics 14, 578--582 (2018)

Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[271] arXiv:1704.06749 (cross-list from cs.NI) [pdf, other]

Title: Proactive Edge Computing in Latency-Constrained Fog Networks

Mohammed S. Elbamby, Mehdi Bennis, Walid Saad

Comments: 6 pages, 5 figures, accepted in EuCNC 2017

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[272] arXiv:1704.06955 (cross-list from quant-ph) [pdf, other]

Title: Superadditivity of the Classical Capacity with Limited Entanglement Assistance

Elton Yechao Zhu, Quntao Zhuang, Peter W. Shor

Comments: 13 pages

Journal-ref: Phys. Rev. Lett. 119, 040503 (2017)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[273] arXiv:1704.07223 (cross-list from cs.NA) [pdf, other]

Title: Entropic Trace Estimates for Log Determinants

Jack Fitzsimons, Diego Granziol, Kurt Cutajar, Michael Osborne, Maurizio Filippone, Stephen Roberts

Comments: 16 pages, 4 figures, 2 tables, 2 algorithms

Subjects: Numerical Analysis (math.NA); Information Theory (cs.IT); Computation (stat.CO); Machine Learning (stat.ML)

[274] arXiv:1704.07461 (cross-list from stat.ML) [pdf, other]

Title: Denoising Linear Models with Permuted Data

Ashwin Pananjady, Martin J. Wainwright, Thomas A. Courtade

Comments: To appear in part at ISIT 2017, Aachen

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Statistics Theory (math.ST)

[275] arXiv:1704.07491 (cross-list from cs.NI) [pdf, other]

Title: How Close Can I Be? - A Comprehensive Analysis of Cellular Interference on ATC Radar

Neelakantan Nurani Krishnan, Ratnesh Kumbhkar, Narayan B. Mandayam, Ivan Seskar, Sastry Kompella

Comments: This paper has been submitted to IEEE Globecom 2017

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)