Statistics Theory

Authors and titles for June 2022

[151] arXiv:2206.07252 (cross-list from stat.ML) [pdf, other]

Title: Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions

Courtney Paquette, Elliot Paquette, Ben Adlam, Jeffrey Pennington

Comments: arXiv admin note: text overlap with arXiv:2205.07069

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Probability (math.PR); Statistics Theory (math.ST)

[152] arXiv:2206.07386 (cross-list from econ.EM) [pdf, other]

Title: Finite-Sample Guarantees for High-Dimensional DML

Victor Quintas-Martinez

Subjects: Econometrics (econ.EM); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[153] arXiv:2206.07588 (cross-list from stat.ML) [pdf, other]

Title: Characteristic kernels on Hilbert spaces, Banach spaces, and on sets of measures

Johanna Ziegel, David Ginsbourger, Lutz Dümbgen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Functional Analysis (math.FA); Statistics Theory (math.ST)

[154] arXiv:2206.07640 (cross-list from stat.ML) [pdf, other]

Title: Statistical and Computational Phase Transitions in Group Testing

Amin Coja-Oghlan, Oliver Gebhard, Max Hahn-Klimroth, Alexander S. Wein, Ilias Zadik

Comments: Accepted for presentation at the Conference on Learning Theory (COLT) 2022

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[155] arXiv:2206.07845 (cross-list from econ.EM) [pdf, other]

Title: Optimality of Matched-Pair Designs in Randomized Controlled Trials

Yuehao Bai

Subjects: Econometrics (econ.EM); Statistics Theory (math.ST); Methodology (stat.ME)

[156] arXiv:2206.07912 (cross-list from cs.LG) [pdf, other]

Title: Double Sampling Randomized Smoothing

Linyi Li, Jiawei Zhang, Tao Xie, Bo Li

Comments: ICML 2022; minor typos fixed; minor data corrected on Page 42 (no influence on conclusions)

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Statistics Theory (math.ST)

[157] arXiv:2206.08065 (cross-list from cs.LG) [pdf, other]

Title: Large-width asymptotics for ReLU neural networks with $α$-Stable initializations

Stefano Favaro, Sandra Fortini, Stefano Peluchetti

Comments: 29 pages

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[158] arXiv:2206.08095 (cross-list from math.CO) [pdf, other]

Title: Optimal Resistor Networks

J. Robert Johnson, Mark Walters

Comments: 40 pages incuding 7 page appendix

Subjects: Combinatorics (math.CO); Statistics Theory (math.ST)

[159] arXiv:2206.08149 (cross-list from cs.LG) [pdf, other]

Title: You Are the Best Reviewer of Your Own Papers: The Isotonic Mechanism

Weijie Su

Comments: Changed title

Subjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Theoretical Economics (econ.TH); Statistics Theory (math.ST); Methodology (stat.ME)

[160] arXiv:2206.08420 (cross-list from stat.ME) [pdf, other]

Title: Generalised Bayesian Inference for Discrete Intractable Likelihood

Takuo Matsubara, Jeremias Knoblauch, François-Xavier Briol, Chris. J. Oates

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Computation (stat.CO); Machine Learning (stat.ML)

[161] arXiv:2206.08435 (cross-list from stat.ME) [pdf, other]

Title: Optimal Parallel Sequential Change Detection under Generalized Performance Measures

Zexian Lu, Yunxiao Chen, Xiaoou Li

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[162] arXiv:2206.08461 (cross-list from math.PR) [pdf, other]

Title: On Tournaments and Negative Dependence

Yaakov Malinovsky, Yosef Rinott

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[163] arXiv:2206.08615 (cross-list from cs.LG) [pdf, other]

Title: On the Number of Regions of Piecewise Linear Neural Networks

Alexis Goujon, Arian Etemadi, Michael Unser

Subjects: Machine Learning (cs.LG); Combinatorics (math.CO); Statistics Theory (math.ST); Machine Learning (stat.ML)

[164] arXiv:2206.08619 (cross-list from stat.ME) [pdf, other]

Title: Optimal quasi-Bayesian reduced rank regression with incomplete response

The Tien Mai, Pierre Alquier

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Computation (stat.CO)

[165] arXiv:2206.08918 (cross-list from cs.LG) [pdf, other]

Title: Learning a Single Neuron with Adversarial Label Noise via Gradient Descent

Ilias Diakonikolas, Vasilis Kontonis, Christos Tzamos, Nikos Zarifis

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[166] arXiv:2206.09092 (cross-list from stat.ME) [pdf, other]

Title: Dynamic and heterogeneous treatment effects with abrupt changes

Oscar Hernan Madrid Padilla, Yi Yu

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[167] arXiv:2206.09098 (cross-list from cs.LG) [pdf, html, other]

Title: Existence and Minimax Theorems for Adversarial Surrogate Risks in Binary Classification

Natalie S. Frank, Jonathan Niles-Weed

Comments: 42 pages. version 2: corrects several errors and employs a significantly different proof technique. version 3: modifies the arXiv author list but has no other changes. version 4: improved exposition and fixed typos

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST)

[168] arXiv:2206.09099 (cross-list from cs.LG) [pdf, other]

Title: The Consistency of Adversarial Training for Binary Classification

Natalie S. Frank, Jonathan Niles-Weed

Comments: There was an error in the main theorem of the paper (Theorem 7)

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST)

[169] arXiv:2206.09136 (cross-list from cs.LG) [pdf, other]

Title: Provable Generalization of Overparameterized Meta-learning Trained with SGD

Yu Huang, Yingbin Liang, Longbo Huang

Comments: 45 pages, 3 figures

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST)

[170] arXiv:2206.09194 (cross-list from stat.ML) [pdf, other]

Title: Efficient Aggregated Kernel Tests using Incomplete $U$-statistics

Antonin Schrab, Ilmun Kim, Benjamin Guedj, Arthur Gretton

Comments: 34 pages, 5 figures

Journal-ref: 36th Conference on Neural Information Processing Systems (NeurIPS 2022)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[171] arXiv:2206.09233 (cross-list from stat.CO) [pdf, other]

Title: IID Sampling from Posterior Dirichlet Process Mixtures

Sourabh Bhattacharya

Subjects: Computation (stat.CO); Statistics Theory (math.ST)

[172] arXiv:2206.09390 (cross-list from cs.IT) [pdf, other]

Title: Deterministic Finite-Memory Bias Estimation

Tomer Berg, Or Ordentlich, Ofer Shayevitz

Comments: Presented in COLT 2021

Subjects: Information Theory (cs.IT); Statistics Theory (math.ST)

[173] arXiv:2206.09527 (cross-list from math.NA) [pdf, other]

Title: Simultaneous approximation of a smooth function and its derivatives by deep neural networks with piecewise-polynomial activations

Denis Belomestny, Alexey Naumov, Nikita Puchkin, Sergey Samsonov

Comments: 28 pages

Subjects: Numerical Analysis (math.NA); Statistics Theory (math.ST); Machine Learning (stat.ML)

[174] arXiv:2206.09709 (cross-list from math.OC) [pdf, other]

Title: A Note on the Convergence of Mirrored Stein Variational Gradient Descent under $(L_0,L_1)-$Smoothness Condition

Lukang Sun, Peter Richtárik

Comments: first draft and will be modified

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Statistics Theory (math.ST)

[175] arXiv:2206.09963 (cross-list from math.OC) [pdf, html, other]

Title: Sample Average Approximation for Stochastic Programming with Equality Constraints

Thomas Lew, Riccardo Bonalli, Marco Pavone

Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY); Statistics Theory (math.ST)