Statistics Theory

Authors and titles for June 2020

[101] arXiv:2006.15634 [pdf, other]

Title: Non-Stationary Multi-layered Gaussian Priors for Bayesian Inversion

Muhammad Emzir, Sari Lasanen, Zenith Purisha, Lassi Roininen, Simo Särkkä

Subjects: Statistics Theory (math.ST)

[102] arXiv:2006.15738 [pdf, other]

Title: Central limit theorems for local network statistics

P-A. Maugis

Comments: 39 pages, 4 figures, submitted

Subjects: Statistics Theory (math.ST); Social and Information Networks (cs.SI); Combinatorics (math.CO); Methodology (stat.ME)

[103] arXiv:2006.16244 [pdf, other]

Title: Filtering of stationary Gaussian statistical experiments

V.S. Koroliuk, D. Koroliouk

Comments: 9 pages, 54 formulas, no figures, 8 refs

Journal-ref: Ukrainian Matematical Bulletin, Vol. 16, No. 3, pp. 372-382 July-September, 2019

Subjects: Statistics Theory (math.ST)

[104] arXiv:2006.16485 [pdf, other]

Title: Partial Recovery for Top-$k$ Ranking: Optimality of MLE and Sub-Optimality of Spectral Method

Pinhan Chen, Chao Gao, Anderson Y. Zhang

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[105] arXiv:2006.16590 [pdf, other]

Title: Robust Kernel Density Estimation with Median-of-Means principle

Pierre Humbert (ENS Paris Saclay), Batiste Le Bars (ENS Paris Saclay), Ludovic Minvielle (ENS Paris Saclay), Nicolas Vayatis (ENS Paris Saclay)

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[106] arXiv:2006.16600 [pdf, other]

Title: Exponential inequalities for sampling designs

Guillaume Chauvet (IRMAR), Mathieu Gerber (MMT)

Subjects: Statistics Theory (math.ST)

[107] arXiv:2006.00032 (cross-list from stat.CO) [pdf, other]

Title: Rate-optimal refinement strategies for local approximation MCMC

Andrew D. Davis, Youssef Marzouk, Aaron Smith, Natesh Pillai

Comments: 32 pages, 17 figures

Subjects: Computation (stat.CO); Probability (math.PR); Statistics Theory (math.ST)

[108] arXiv:2006.00294 (cross-list from cs.LG) [pdf, other]

Title: Statistical Guarantees for Regularized Neural Networks

Mahsa Taheri, Fang Xie, Johannes Lederer

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)

[109] arXiv:2006.00334 (cross-list from stat.ML) [pdf, other]

Title: Consistent feature selection for neural networks via Adaptive Group Lasso

Vu Dinh, Lam Si Tung Ho

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[110] arXiv:2006.00517 (cross-list from physics.data-an) [pdf, other]

Title: What limits the number of observations that can be effectively assimilated by EnKF?

Daisuke Hotta, Yoichiro Ota

Comments: 52 pages, 10 figures; submitted to the Quarterly Journal of the Royal Meteorological Society

Subjects: Data Analysis, Statistics and Probability (physics.data-an); Statistics Theory (math.ST); Atmospheric and Oceanic Physics (physics.ao-ph)

[111] arXiv:2006.00683 (cross-list from stat.ML) [pdf, other]

Title: Logistic Regression for Massive Data with Rare Events

HaiYing Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[112] arXiv:2006.01073 (cross-list from stat.ML) [pdf, other]

Title: Analysis of Regularized Least Squares in Reproducing Kernel Krein Spaces

Fanghui Liu, Lei Shi, Xiaolin Huang, Jie Yang, Johan A.K. Suykens

Comments: 24 pages, 2 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[113] arXiv:2006.01191 (cross-list from econ.EM) [pdf, other]

Title: New robust inference for predictive regressions

Rustam Ibragimov, Jihyun Kim, Anton Skrobotov

Journal-ref: Econom. Theory 40 (2024) 1364-1390

Subjects: Econometrics (econ.EM); Statistics Theory (math.ST)

[114] arXiv:2006.01212 (cross-list from econ.EM) [pdf, other]

Title: New Approaches to Robust Inference on Market (Non-)Efficiency, Volatility Clustering and Nonlinear Dependence

Rustam Ibragimov, Rasmus Pedersen, Anton Skrobotov

Subjects: Econometrics (econ.EM); Statistics Theory (math.ST)

[115] arXiv:2006.01350 (cross-list from stat.ML) [pdf, other]

Title: On the Estimation of Derivatives Using Plug-in Kernel Ridge Regression Estimators

Zejian Liu, Meng Li

Comments: Accepted by Journal of Machine Learning Research

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[116] arXiv:2006.01631 (cross-list from math.CT) [pdf, other]

Title: Bayesian Updates Compose Optically

Toby St. Clere Smithe

Comments: 40 pages. v2: fix minor typos

Subjects: Category Theory (math.CT); Statistics Theory (math.ST)

[117] arXiv:2006.01662 (cross-list from stat.ML) [pdf, other]

Title: Tree-Projected Gradient Descent for Estimating Gradient-Sparse Parameters on Graphs

Sheng Xu, Zhou Fan, Sahand Negahban

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[118] arXiv:2006.01799 (cross-list from stat.ME) [pdf, other]

Title: The role of exchangeability in causal inference

Olli Saarela, David A. Stephens, Erica E. M. Moodie

Journal-ref: Statistical Science. 2023 Aug; 38(3): 369-385

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[119] arXiv:2006.02611 (cross-list from stat.ME) [pdf, html, other]

Title: Tensor Factor Model Estimation by Iterative Projection

Yuefeng Han, Rong Chen, Dan Yang, Cun-Hui Zhang

Subjects: Methodology (stat.ME); Econometrics (econ.EM); Statistics Theory (math.ST)

[120] arXiv:2006.02643 (cross-list from cs.IT) [pdf, html, other]

Title: Universal Graph Compression: Stochastic Block Models

Alankrita Bhatt, Ziao Wang, Chi Wang, Lele Wang

Subjects: Information Theory (cs.IT); Databases (cs.DB); Statistics Theory (math.ST)

[121] arXiv:2006.03041 (cross-list from cs.LG) [pdf, other]

Title: Sample Complexity of Asynchronous Q-Learning: Sharper Analysis and Variance Reduction

Gen Li, Yuting Wei, Yuejie Chi, Yuantao Gu, Yuxin Chen

Comments: accepted in part to Neural Information Processing Systems (NeurIPS) 2020

Journal-ref: IEEE Transactions on Information Theory, vol. 68, no. 1, pp. 448-473, Jan. 2022

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Optimization and Control (math.OC); Statistics Theory (math.ST); Machine Learning (stat.ML)

[122] arXiv:2006.03134 (cross-list from cs.DS) [pdf, other]

Title: Tensor Completion Made Practical

Allen Liu, Ankur Moitra

Comments: NeurIPS 2020

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[123] arXiv:2006.03452 (cross-list from stat.CO) [pdf, other]

Title: Exact inference for a class of non-linear hidden Markov models on general state spaces

Guillaume Kon Kam King, Omiros Papaspiliopoulos, Matteo Ruggiero

Comments: 39 pages, 10 figures in main text

Subjects: Computation (stat.CO); Statistics Theory (math.ST)

[124] arXiv:2006.03572 (cross-list from stat.ME) [pdf, other]

Title: Detecting Abrupt Changes in High-Dimensional Self-Exciting Poisson Processes

Daren Wang, Yi Yu, Rebecca Willett

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[125] arXiv:2006.04188 (cross-list from math.PR) [pdf, other]

Title: Principal points and elliptical distributions from the multivariate setting to the functional case

Juan Lucas Bali, Graciela Boente

Journal-ref: Statistics and Probability Letters (2009), 79, 1858-1865

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[126] arXiv:2006.04266 (cross-list from stat.ML) [pdf, other]

Title: Sparse learning with CART

Jason M. Klusowski

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[127] arXiv:2006.04347 (cross-list from stat.ME) [pdf, other]

Title: Confidence sequences for sampling without replacement

Ian Waudby-Smith, Aaditya Ramdas

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[128] arXiv:2006.04632 (cross-list from stat.ME) [pdf, other]

Title: Estimating High-dimensional Covariance and Precision Matrices under General Missing Dependence

Seongoh Park, Xinlei Wang, Johan Lim

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[129] arXiv:2006.04740 (cross-list from math.OC) [pdf, other]

Title: The Heavy-Tail Phenomenon in SGD

Mert Gurbuzbalaban, Umut Şimşekli, Lingjiong Zhu

Journal-ref: Published as a conference paper at International Conference on Machine Learning (ICML) 2021

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Statistics Theory (math.ST)

[130] arXiv:2006.04787 (cross-list from cs.LG) [pdf, other]

Title: Classification Under Misspecification: Halfspaces, Generalized Linear Models, and Connections to Evolvability

Sitan Chen, Frederic Koehler, Ankur Moitra, Morris Yau

Comments: 52 pages, v2: updated references

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[131] arXiv:2006.04873 (cross-list from math.OC) [pdf, other]

Title: A Stochastic Subgradient Method for Distributionally Robust Non-Convex Learning

Mert Gürbüzbalaban, Andrzej Ruszczyński, Landi Zhu

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Statistics Theory (math.ST)

[132] arXiv:2006.05381 (cross-list from stat.ME) [pdf, other]

Title: A fiducial approach to nonparametric deconvolution problem: discrete case

Yifan Cui, Jan Hannig

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Computation (stat.CO)

[133] arXiv:2006.05487 (cross-list from cs.LG) [pdf, other]

Title: Probably Approximately Correct Constrained Learning

Luiz F. O. Chamon, Alejandro Ribeiro

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[134] arXiv:2006.05539 (cross-list from eess.SP) [pdf, other]

Title: On Matched Filtering for Statistical Change Point Detection

Kevin C. Cheng, Eric L. Miller, Michael C. Hughes, Shuchin Aeron

Subjects: Signal Processing (eess.SP); Statistics Theory (math.ST); Machine Learning (stat.ML)

[135] arXiv:2006.05591 (cross-list from stat.ME) [pdf, other]

Title: Adaptive Experimental Design with Temporal Interference: A Maximum Likelihood Approach

Peter Glynn, Ramesh Johari, Mohammad Rasouli

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[136] arXiv:2006.05630 (cross-list from cs.LG) [pdf, other]

Title: Distributionally Robust Batch Contextual Bandits

Nian Si, Fan Zhang, Zhengyuan Zhou, Jose Blanchet

Comments: The short version has been accepted in ICML 2020

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST); Machine Learning (stat.ML)

[137] arXiv:2006.05786 (cross-list from math.PR) [pdf, other]

Title: A fundamental problem of hypothesis testing with finite inventory in e-commerce

Dennis Bohle, Alexander Marynych, Matthias Meiners

Comments: 23 pages, 8 figures

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[138] arXiv:2006.05800 (cross-list from stat.ML) [pdf, other]

Title: On the Optimal Weighted $\ell_2$ Regularization in Overparameterized Linear Regression

Denny Wu, Ji Xu

Comments: NeurIPS 2020

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[139] arXiv:2006.06068 (cross-list from stat.ML) [pdf, other]

Title: Variance reduction for Random Coordinate Descent-Langevin Monte Carlo

Zhiyan Ding, Qin Li

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[140] arXiv:2006.06098 (cross-list from cs.LG) [pdf, other]

Title: Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification

Francesca Mignacco, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborová

Comments: 8 pages + appendix, 4 figures

Journal-ref: J. Stat. Mech. 2021 124008 & NeurIPS 2020

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistics Theory (math.ST); Machine Learning (stat.ML)

[141] arXiv:2006.06102 (cross-list from stat.ML) [pdf, other]

Title: Multi-index Antithetic Stochastic Gradient Algorithm

Mateusz B. Majka, Marc Sabate-Vidales, Łukasz Szpruch

Comments: 51 pages, 8 figures. Revised version: an improved introduction, a completely new numerical section including experiments in non-convex settings, a new appendix discussing the dependence of the variance of SGLD on the mini-batch size

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST); Computation (stat.CO)

[142] arXiv:2006.06138 (cross-list from stat.ME) [pdf, other]

Title: Conformal Inference of Counterfactuals and Individual Treatment Effects

Lihua Lei, Emmanuel J. Candès

Comments: Accepted by Journal of the Royal Statistical Society: Series B (JRSSB); 38 pages

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[143] arXiv:2006.06293 (cross-list from stat.ML) [pdf, other]

Title: Multiplicative noise and heavy tails in stochastic optimization

Liam Hodgkinson, Michael W. Mahoney

Comments: 30 pages, 7 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST)

[144] arXiv:2006.06467 (cross-list from cs.LG) [pdf, other]

Title: Learning Halfspaces with Tsybakov Noise

Ilias Diakonikolas, Vasilis Kontonis, Christos Tzamos, Nikos Zarifis

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[145] arXiv:2006.06560 (cross-list from stat.ML) [pdf, other]

Title: Generalization error in high-dimensional perceptrons: Approaching Bayes error with convex optimization

Benjamin Aubin, Florent Krzakala, Yue M. Lu, Lenka Zdeborová

Comments: 11 pages + 45 pages Supplementary Material / 5 figures, v2 revised and accepted at NeurIPS

Journal-ref: Advances in Neural Information Processing Systems, v33, pages 12199--12210, 2020

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Statistics Theory (math.ST)

[146] arXiv:2006.06587 (cross-list from cs.LG) [pdf, other]

Title: AdaS: Adaptive Scheduling of Stochastic Gradients

Mahdi S. Hosseini, Konstantinos N. Plataniotis

Comments: Code is available at this https URL

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST); Machine Learning (stat.ML)

[147] arXiv:2006.06618 (cross-list from stat.ML) [pdf, other]

Title: CoinPress: Practical Private Mean and Covariance Estimation

Sourav Biswas, Yihe Dong, Gautam Kamath, Jonathan Ullman

Comments: Code is available at this https URL

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[148] arXiv:2006.06843 (cross-list from stat.ME) [pdf, other]

Title: Robust Optimization and Inference on Manifolds

Lizhen Lin, Drew Lazar, Bayan Sarpabayeva, David B. Dunson

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[149] arXiv:2006.06994 (cross-list from math.NA) [pdf, other]

Title: Sparse approximation of triangular transports. Part I: the finite dimensional case

Jakob Zech, Youssef Marzouk

Comments: The original manuscript arXiv:2006.06994v1 has been split into two parts; the present paper is the first part

Subjects: Numerical Analysis (math.NA); Statistics Theory (math.ST)

[150] arXiv:2006.06997 (cross-list from cs.LG) [pdf, other]

Title: Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval

Stefano Sarao Mannelli, Giulio Biroli, Chiara Cammarota, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborová

Comments: 9 pages, 5 figures + appendix

Journal-ref: Advances in Neural Information Processing Systems, v22, page 3265--327, 2020

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistics Theory (math.ST); Machine Learning (stat.ML)