Statistics Theory

Authors and titles for February 2021

[101] arXiv:2102.02981 (cross-list from cs.LG) [pdf, other]

Title: Finite Sample Analysis of Minimax Offline Reinforcement Learning: Completeness, Fast Rates and First-Order Efficiency

Masatoshi Uehara, Masaaki Imaizumi, Nan Jiang, Nathan Kallus, Wen Sun, Tengyang Xie

Comments: Under Review

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[102] arXiv:2102.03403 (cross-list from stat.ML) [pdf, other]

Title: Robust Principal Component Analysis: A Median of Means Approach

Debolina Paul, Saptarshi Chakraborty, Swagatam Das

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[103] arXiv:2102.03607 (cross-list from stat.ML) [pdf, other]

Title: Bootstrapping Fitted Q-Evaluation for Off-Policy Inference

Botao Hao, Xiang Ji, Yaqi Duan, Hao Lu, Csaba Szepesvári, Mengdi Wang

Comments: Accepted at ICML 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[104] arXiv:2102.03802 (cross-list from cs.LG) [pdf, other]

Title: Dimension Free Generalization Bounds for Non Linear Metric Learning

Mark Kozdoba, Shie Mannor

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[105] arXiv:2102.03885 (cross-list from cs.LG) [pdf, other]

Title: Few-shot time series segmentation using prototype-defined infinite hidden Markov models

Yazan Qarout, Yordan P. Raykov, Max A. Little

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Statistics Theory (math.ST)

[106] arXiv:2102.04259 (cross-list from stat.ML) [pdf, other]

Title: Concentration of Non-Isotropic Random Tensors with Applications to Learning and Empirical Risk Minimization

Mathieu Even, Laurent Massoulié

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)

[107] arXiv:2102.04363 (cross-list from math.OC) [pdf, other]

Title: Efficient Data-Driven Optimization with Noisy Data

Bart P.G. Van Parys

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Statistics Theory (math.ST)

[108] arXiv:2102.04401 (cross-list from cs.LG) [pdf, other]

Title: The Optimality of Polynomial Regression for Agnostic Learning under Gaussian Marginals

Ilias Diakonikolas, Daniel M. Kane, Thanasis Pittas, Nikos Zarifis

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[109] arXiv:2102.04462 (cross-list from stat.ML) [pdf, other]

Title: Learning-augmented count-min sketches via Bayesian nonparametrics

Emanuele Dolera, Stefano Favaro, Stefano Peluchetti

Comments: 47 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[110] arXiv:2102.04923 (cross-list from math.PR) [pdf, other]

Title: Berry--Esseen Bounds for Multivariate Nonlinear Statistics with Applications to M-estimators and Stochastic Gradient Descent Algorithms

Qi-Man Shao, Zhuo-Song Zhang

Comments: 54 pages

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[111] arXiv:2102.05314 (cross-list from cs.LG) [pdf, other]

Title: Forecasting Nonnegative Time Series via Sliding Mask Method (SMM) and Latent Clustered Forecast (LCF)

Yohann de Castro (ICJ, CERMICS), Luca Mencarelli (CERMICS)

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[112] arXiv:2102.05386 (cross-list from stat.ME) [pdf, other]

Title: On a Bivariate Copula for Modeling Negative Dependence: Application to New York Air Quality Data

Shyamal Ghosh, Prajamitra Bhuyan, Maxim Finkelstein

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[113] arXiv:2102.05472 (cross-list from stat.ML) [pdf, other]

Title: Robust estimation of tree structured models

Marta Casanellas, Marina Garrote-López, Piotr Zwiernik

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[114] arXiv:2102.05629 (cross-list from cs.LG) [pdf, other]

Title: Agnostic Proper Learning of Halfspaces under Gaussian Marginals

Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis, Christos Tzamos, Nikos Zarifis

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[115] arXiv:2102.05802 (cross-list from cs.IT) [pdf, other]

Title: Fisher Information and Mutual Information Constraints

Leighton Pate Barnes, Ayfer Ozgur

Subjects: Information Theory (cs.IT); Statistics Theory (math.ST)

[116] arXiv:2102.06287 (cross-list from math.PR) [pdf, other]

Title: Urn models with random multiple drawing and random addition

Irene Crimaldi, Pierre-Yves Louis, Ida Germana Minelli

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[117] arXiv:2102.06548 (cross-list from stat.ML) [pdf, other]

Title: Is Q-Learning Minimax Optimal? A Tight Sample Complexity Analysis

Gen Li, Changxiao Cai, Yuxin Chen, Yuting Wei, Yuejie Chi

Comments: accepted to Operations Research

Journal-ref: Operations Research, vol. 72, no. 1, pp. 222-236, 2024

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST)

[118] arXiv:2102.06736 (cross-list from math.PR) [pdf, other]

Title: Multivariate Max-Stable Processes and Homogeneous Functionals

Enkelejd Hashorva, Alfred Kume

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[119] arXiv:2102.06851 (cross-list from stat.ME) [pdf, other]

Title: Robust Model-Based Clustering

Juan D. Gonzalez, Ricardo Maronna, Victor J. Yohai, Ruben H.Zamar

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Computation (stat.CO)

[120] arXiv:2102.07378 (cross-list from stat.ME) [pdf, other]

Title: Horseshoe shrinkage methods for Bayesian fusion estimation

Sayantan Banerjee

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[121] arXiv:2102.07501 (cross-list from stat.ML) [pdf, other]

Title: Annealed Flow Transport Monte Carlo

Michael Arbel, Alexander G. D. G. Matthews, Arnaud Doucet

Subjects: Machine Learning (stat.ML); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG); Statistics Theory (math.ST)

[122] arXiv:2102.07856 (cross-list from cs.LG) [pdf, other]

Title: Don't Just Blame Over-parametrization for Over-confidence: Theoretical Analysis of Calibration in Binary Classification

Yu Bai, Song Mei, Huan Wang, Caiming Xiong

Comments: Appearing at ICML 2021

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[123] arXiv:2102.08127 (cross-list from stat.ML) [pdf, other]

Title: Learning curves of generic features maps for realistic datasets with a teacher-student model

Bruno Loureiro, Cédric Gerbelot, Hugo Cui, Sebastian Goldt, Florent Krzakala, Marc Mézard, Lenka Zdeborová

Comments: v3: NeurIPS camera-ready

Journal-ref: 35th Conference on Neural Information Processing Systems (NeurIPS 2021), vol 34 p10137--18151. J. Stat. Mech. (2022) 114001

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)

[124] arXiv:2102.08184 (cross-list from cs.LG) [pdf, other]

Title: Constructing Multiclass Classifiers using Binary Classifiers Under Log-Loss

Assaf Ben-Yishai, Or Ordentlich

Comments: A shorter version of this contribution was presented in ISIT 2021

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)

[125] arXiv:2102.08373 (cross-list from cs.LG) [pdf, other]

Title: Analysis of feature learning in weight-tied autoencoders via the mean field lens

Phan-Minh Nguyen

Comments: 121 pages, 12 figures

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistics Theory (math.ST); Machine Learning (stat.ML)

[126] arXiv:2102.08782 (cross-list from stat.ME) [pdf, other]

Title: Conditional Variance Estimator for Sufficient Dimension Reduction

Lukas Fertl, Efstathia Bura

Comments: 23 pages, 3 figures

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[127] arXiv:2102.09053 (cross-list from stat.ME) [pdf, other]

Title: Estimating The Proportion of Signal Variables Under Arbitrary Covariance Dependence

X. Jessie Jeng

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[128] arXiv:2102.09204 (cross-list from stat.ML) [pdf, other]

Title: Towards a mathematical theory of trajectory inference

Hugo Lavenant, Stephen Zhang, Young-Heon Kim, Geoffrey Schiebinger

Comments: The first two authors contributed equally to this work; 76 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Probability (math.PR); Statistics Theory (math.ST)

[129] arXiv:2102.09385 (cross-list from cs.LG) [pdf, other]

Title: Convergence of stochastic gradient descent schemes for Lojasiewicz-landscapes

Steffen Dereich, Sebastian Kassing

Subjects: Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)

[130] arXiv:2102.09448 (cross-list from stat.ME) [pdf, other]

Title: A Generative Approach to Joint Modeling of Quantitative and Qualitative Responses

Xiaoning Kang, Lulu Kang, Wei Chen, Xinwei Deng

Journal-ref: Journal of Multivariate Analysis 2022

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[131] arXiv:2102.09526 (cross-list from stat.ML) [pdf, other]

Title: Convex regularization in statistical inverse learning problems

Tatiana A. Bubba, Martin Burger, Tapio Helin, Luca Ratti

Comments: 35 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[132] arXiv:2102.09540 (cross-list from cs.LG) [pdf, other]

Title: Off-policy Confidence Sequences

Nikos Karampatziakis, Paul Mineiro, Aaditya Ramdas

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[133] arXiv:2102.09637 (cross-list from math.PR) [pdf, other]

Title: Explicit Bivariate Rate Functions for Large Deviations in AR(1) and MA(1) Processes with Gaussian Innovations

M.J. Karling, A.O. Lopes, S.R.C. Lopes

Subjects: Probability (math.PR); Dynamical Systems (math.DS); Statistics Theory (math.ST)

[134] arXiv:2102.09912 (cross-list from stat.ME) [pdf, other]

Title: Correlation Based Principal Loading Analysis

Jan O. Bauer

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[135] arXiv:2102.09924 (cross-list from math.NA) [pdf, other]

Title: A proof of convergence for gradient descent in the training of artificial neural networks for constant target functions

Patrick Cheridito, Arnulf Jentzen, Adrian Riekert, Florian Rossmannek

Comments: 23 pages

Journal-ref: Journal of Complexity (2022)

Subjects: Numerical Analysis (math.NA); Machine Learning (cs.LG); Statistics Theory (math.ST)

[136] arXiv:2102.10039 (cross-list from stat.ME) [pdf, other]

Title: Solution of Non-negative Least Squares Inverse Problems Using a Span of Regularized Solutions, with Application to Magnetic Resonance Relaxometry

Chuan Bi, Miao-jung Yvonne Ou, Mustapha Bouhrara, Richard G. Spencer

Comments: 22 pages, 7 figures

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[137] arXiv:2102.10080 (cross-list from stat.ME) [pdf, other]

Title: Distributed Bootstrap for Simultaneous Inference Under High Dimensionality

Yang Yu, Shih-Kang Chao, Guang Cheng

Comments: To appear in JMLR. arXiv admin note: text overlap with arXiv:2002.08443

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[138] arXiv:2102.10166 (cross-list from math.PR) [pdf, other]

Title: Mixed Generalized Fractional Brownian Motion

Ezzedine Mliki, Shaykhah Alajmi

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[139] arXiv:2102.10180 (cross-list from math.PR) [pdf, other]

Title: On the long range dependence of time-changed mixed fractional Brownian motion model

Ezzedine Mliki, Shaykhah Alajmi

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[140] arXiv:2102.10196 (cross-list from cs.DS) [pdf, other]

Title: Quantifying Variational Approximation for the Log-Partition Function

Romain Cosson, Devavrat Shah

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST)

[141] arXiv:2102.10226 (cross-list from stat.ML) [pdf, other]

Title: ALMA: Alternating Minimization Algorithm for Clustering Mixture Multilayer Network

Xing Fan, Marianna Pensky, Feng Yu, Teng Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[142] arXiv:2102.10324 (cross-list from cs.LG) [pdf, other]

Title: Necessary and sufficient graphical conditions for optimal adjustment sets in causal graphical models with hidden variables

Jakob Runge

Comments: 41 pages, published as spotlight paper in 35th Conference on Neural Information Processing Systems (NeurIPS 2021); this version has an updated Supplementary Material with corrected proofs (also updated in NeurIPS proceedings)

Journal-ref: In Advances in Neural Information Processing Systems 34 (NeurIPS 2021, Curran Associates, 2021)

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Statistics Theory (math.ST)

[143] arXiv:2102.10429 (cross-list from stat.OT) [pdf, html, other]

Title: Taylor's Theorem and Mean Value Theorem for Random Functions and Random Variables

Yifan Yang, Xiaoyu Zhou, Ming Wang

Subjects: Other Statistics (stat.OT); Statistics Theory (math.ST)

[144] arXiv:2102.10630 (cross-list from math.PR) [pdf, other]

Title: Fractional generalized cumulative entropy and its dynamic version

Antonio Di Crescenzo, Suchandan Kayal, Alessandra Meoli

Comments: 25 pages, 8 figures, accepted for publication on Communications in Nonlinear Science and Numerical Simulation

Subjects: Probability (math.PR); Information Theory (cs.IT); Statistics Theory (math.ST)

[145] arXiv:2102.11076 (cross-list from stat.ML) [pdf, html, other]

Title: Kernel Ridge Riesz Representers: Generalization, Mis-specification, and the Counterfactual Effective Dimension

Rahul Singh

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM); Statistics Theory (math.ST)

[146] arXiv:2102.11229 (cross-list from stat.ME) [pdf, other]

Title: Estimation of a score-explained non-randomized treatment effect in fixed and high dimensions

Debarghya Mukherjee, Moulinath Banerjee, Ya'acov Ritov

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[147] arXiv:2102.11976 (cross-list from stat.ML) [pdf, other]

Title: Learner-Private Convex Optimization

Jiaming Xu, Kuang Xu, Dana Yang

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST)

[148] arXiv:2102.12034 (cross-list from stat.ME) [pdf, other]

Title: Semiparametric counterfactual density estimation

Edward H. Kennedy, Sivaraman Balakrishnan, Larry Wasserman

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[149] arXiv:2102.12225 (cross-list from stat.ME) [pdf, other]

Title: Valid Instrumental Variables Selection Methods using Negative Control Outcomes and Constructing Efficient Estimator

Shunichiro Orihara

Comments: Exclusion restriction, Instrumental variable, Mendelian randomization, Negative control outcome, Semiparametric efficiency, Variable selection, Unmeasured covariates

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Other Statistics (stat.OT)

[150] arXiv:2102.12352 (cross-list from math.PR) [pdf, other]

Title: A convex analysis approach to tight expectation inequalities

André M. Timpanaro

Comments: 26 pages, 13 figures (to be submitted to 'Probability Theory and Related Fields')

Subjects: Probability (math.PR); Statistical Mechanics (cond-mat.stat-mech); Optimization and Control (math.OC); Statistics Theory (math.ST)

[151] arXiv:2102.12451 (cross-list from math.PR) [pdf, other]

Title: Asymptotic results for linear combinations of spacings generated by i.i.d. exponential random variables

Camilla Calì, Maria Longobardi, Claudio Macci, Barbara Pacchiarotti

Subjects: Probability (math.PR); Information Theory (cs.IT); Statistics Theory (math.ST)

[152] arXiv:2102.12512 (cross-list from quant-ph) [pdf, other]

Title: Symmetric distinguishability as a quantum resource

Robert Salzmann, Nilanjana Datta, Gilad Gour, Xin Wang, Mark M. Wilde

Comments: 59 pages main text + 25 pages of appendices, 4 figures

Journal-ref: New Journal of Physics, Volume 23, Article No. 083016, August 2021

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Mathematical Physics (math-ph); Statistics Theory (math.ST)

[153] arXiv:2102.12528 (cross-list from cs.LG) [pdf, other]

Title: Preserved central model for faster bidirectional compression in distributed settings

Constantin Philippenko, Aymeric Dieuleveut

Comments: Bidirectional compression for Federated Learning: 59 pages, 5 theorems, published at NeurIPS 2021

Journal-ref: Advances in Neural Information Processing Systems, 2021, vol. 34, p. 2387-2399

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Statistics Theory (math.ST)

[154] arXiv:2102.12938 (cross-list from stat.ME) [pdf, other]

Title: On Posterior consistency of Bayesian Changepoint models

Nilabja Guha, Jyotishka Datta

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[155] arXiv:2102.12956 (cross-list from stat.ML) [pdf, other]

Title: Stein Variational Gradient Descent: many-particle and long-time asymptotics

Nikolas Nüsken, D.R. Michiel Renger

Comments: 25 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Analysis of PDEs (math.AP); Numerical Analysis (math.NA); Probability (math.PR); Statistics Theory (math.ST)

[156] arXiv:2102.13219 (cross-list from stat.ML) [pdf, other]

Title: Learning with invariances in random features and kernel models

Song Mei, Theodor Misiakiewicz, Andrea Montanari

Comments: 63 pages, 6 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[157] arXiv:2102.13638 (cross-list from econ.EM) [pdf, other]

Title: Permutation Tests at Nonparametric Rates

Marinho Bertanha, EunYi Chung

Comments: One PDF file contains main paper (35 pages) plus supplement (64 pages)

Subjects: Econometrics (econ.EM); Statistics Theory (math.ST); Methodology (stat.ME)