Statistics

Authors and titles for March 2023

[551] arXiv:2303.00931 (cross-list from astro-ph.IM) [pdf, other]

Title: A Model-Independent Determination of Red Noise in Pulsar Timing Arrivals

Reinabelle Reyes, Christopher C. Bernido

Comments: 15 pages, 6 figures. Submitted to Frontiers in Astronomy and Space Sciences

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Methodology (stat.ME)

[552] arXiv:2303.00946 (cross-list from math.NA) [pdf, other]

Title: A note on spike localization for line spectrum estimation

Haoya Li, Hongkang Ni, Lexing Ying

Subjects: Numerical Analysis (math.NA); Information Theory (cs.IT); Signal Processing (eess.SP); Statistics Theory (math.ST)

[553] arXiv:2303.00950 (cross-list from cs.LG) [pdf, other]

Title: Open Problem: Optimal Best Arm Identification with Fixed Budget

Chao Qin

Comments: COLT 2022 camera-ready version this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[554] arXiv:2303.00954 (cross-list from cs.LG) [pdf, other]

Title: Large Deviations for Accelerating Neural Networks Training

Sreelekha Guggilam, Varun Chandola, Abani Patra

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[555] arXiv:2303.00970 (cross-list from math.OC) [pdf, html, other]

Title: PAPAL: A Provable PArticle-based Primal-Dual ALgorithm for Mixed Nash Equilibrium

Shihong Ding, Hanze Dong, Cong Fang, Zhouchen Lin, Tong Zhang

Comments: Published in Journal of Machine Learning Research 25 (2024) 1-48

Subjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[556] arXiv:2303.00972 (cross-list from cs.CV) [pdf, other]

Title: Practical Network Acceleration with Tiny Sets: Hypothesis, Theory, and Algorithm

Guo-Hua Wang, Jianxin Wu

Comments: under review for TPAMI. arXiv admin note: substantial text overlap with arXiv:2202.07861

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[557] arXiv:2303.01052 (cross-list from cs.LG) [pdf, other]

Title: Demystifying Causal Features on Adversarial Examples and Causal Inoculation for Robust Network by Adversarial Instrumental Variable Regression

Junho Kim, Byung-Kwan Lee, Yong Man Ro

Comments: Accepted in CVPR 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Methodology (stat.ME)

[558] arXiv:2303.01076 (cross-list from cs.LG) [pdf, other]

Title: Hallucinated Adversarial Control for Conservative Offline Policy Evaluation

Jonas Rothfuss, Bhavya Sukhija, Tobias Birchler, Parnian Kassraie, Andreas Krause

Comments: Conference on Uncertainty in Artificial Intelligence (UAI) 2023, first three authors contributed equally

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[559] arXiv:2303.01335 (cross-list from cs.LG) [pdf, other]

Title: First-order ANIL provably learns representations despite overparametrization

Oğuz Kaan Yüksel, Etienne Boursier, Nicolas Flammarion

Comments: 42 pages, 17 figures

Journal-ref: O. K. Y\"uksel, E. Boursier and N. Flammarion, "First-order ANIL provably learns representations despite overparametrisation", in The Twelfth International Conference on Learning Representations, 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[560] arXiv:2303.01370 (cross-list from math.OC) [pdf, other]

Title: Non asymptotic analysis of Adaptive stochastic gradient algorithms and applications

Antoine Godichon-Baggioni (LPSM (UMR\_8001)), Pierre Tarrago (LPSM (UMR\_8001))

Subjects: Optimization and Control (math.OC); Probability (math.PR); Statistics Theory (math.ST); Machine Learning (stat.ML)

[561] arXiv:2303.01372 (cross-list from cs.LG) [pdf, other]

Title: High-dimensional analysis of double descent for linear regression with random projections

Francis Bach (SIERRA)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[562] arXiv:2303.01385 (cross-list from cs.SI) [pdf, html, other]

Title: Hyperlink communities in higher-order networks

Quintino Francesco Lotito, Federico Musciotto, Alberto Montresor, Federico Battiston

Comments: Accepted for publication in the Journal of Complex Networks

Journal-ref: Journal of Complex Networks, Volume 12, Issue 2, April 2024, cnae013

Subjects: Social and Information Networks (cs.SI); Physics and Society (physics.soc-ph); Methodology (stat.ME)

[563] arXiv:2303.01412 (cross-list from cs.LG) [pdf, other]

Title: Hyperparameter Tuning and Model Evaluation in Causal Effect Estimation

Damian Machlanski, Spyridon Samothrakis, Paul Clarke

Comments: 36 pages, 3 figures

Subjects: Machine Learning (cs.LG); Methodology (stat.ME)

[564] arXiv:2303.01456 (cross-list from cs.LG) [pdf, other]

Title: The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks

Spencer Frei, Gal Vardi, Peter L. Bartlett, Nathan Srebro

Comments: 42 pages; NeurIPS 2023 camera ready

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[565] arXiv:2303.01462 (cross-list from cs.LG) [pdf, other]

Title: Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization

Spencer Frei, Gal Vardi, Peter L. Bartlett, Nathan Srebro

Comments: 53 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[566] arXiv:2303.01469 (cross-list from cs.LG) [pdf, other]

Title: Consistency Models

Yang Song, Prafulla Dhariwal, Mark Chen, Ilya Sutskever

Comments: ICML 2023

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[567] arXiv:2303.01560 (cross-list from cs.LG) [pdf, html, other]

Title: Active Learning and Bayesian Optimization: a Unified Perspective to Learn with a Goal

Francesco Di Fiore, Michela Nardelli, Laura Mainini

Journal-ref: Archives of Computational Methods in Engineering (2024): 1-29

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[568] arXiv:2303.01651 (cross-list from q-fin.ST) [pdf, other]

Title: Optimal probabilistic forecasts for risk management

Yuru Sun, Worapree Maneesoonthorn, Ruben Loaiza-Maya, Gael M. Martin

Subjects: Statistical Finance (q-fin.ST); Applications (stat.AP)

[569] arXiv:2303.01748 (cross-list from cs.LG) [pdf, other]

Title: A Complete Recipe for Diffusion Generative Models

Kushagra Pandey, Stephan Mandt

Comments: Accepted in ICCV'23 (Oral Presentation)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[570] arXiv:2303.01774 (cross-list from cs.LG) [pdf, other]

Title: Bayesian Optimization over High-Dimensional Combinatorial Spaces via Dictionary-based Embeddings

Aryan Deshwal, Sebastian Ament, Maximilian Balandat, Eytan Bakshy, Janardhan Rao Doppa, David Eriksson

Comments: Appearing in AISTATS 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[571] arXiv:2303.01775 (cross-list from cs.LG) [pdf, other]

Title: Continual Causal Inference with Incremental Observational Data

Zhixuan Chu, Ruopeng Li, Stephen Rathbun, Sheng Li

Comments: The 39th IEEE International Conference on Data Engineering (ICDE 2023). arXiv admin note: text overlap with arXiv:2301.01026

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[572] arXiv:2303.01887 (cross-list from econ.EM) [pdf, html, other]

Title: Fast Forecasting of Unstable Data Streams for On-Demand Service Platforms

Yu Jeffrey Hu, Jeroen Rombouts, Ines Wilms

Subjects: Econometrics (econ.EM); Applications (stat.AP)

[573] arXiv:2303.01949 (cross-list from cs.LG) [pdf, other]

Title: Artificial Intelligence for Dementia Research Methods Optimization

Magda Bucholc, Charlotte James, Ahmad Al Khleifat, AmanPreet Badhwar, Natasha Clarke, Amir Dehsarvi, Christopher R. Madan, Sarah J. Marzi, Cameron Shand, Brian M. Schilder, Stefano Tamburin, Hanz M. Tantiangco, Ilianna Lourida, David J. Llewellyn, Janice M. Ranson

Comments: Magda Bucholc and Charlotte James joint first authors

Subjects: Machine Learning (cs.LG); Quantitative Methods (q-bio.QM); Applications (stat.AP); Methodology (stat.ME)

[574] arXiv:2303.02045 (cross-list from cs.LG) [pdf, other]

Title: Uncertainty Estimation by Fisher Information-based Evidential Deep Learning

Danruo Deng, Guangyong Chen, Yang Yu, Furui Liu, Pheng-Ann Heng

Comments: ICML2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[575] arXiv:2303.02047 (cross-list from cs.LG) [pdf, other]

Title: On the complexity of PAC learning in Hilbert spaces

Sergei Chubanov

Comments: 16 pages, 2 figures, to appear in the proceedings of the AAAI-2023 conference

Subjects: Machine Learning (cs.LG); Functional Analysis (math.FA); Machine Learning (stat.ML)

[576] arXiv:2303.02164 (cross-list from astro-ph.IM) [pdf, other]

Title: Eryn : A multi-purpose sampler for Bayesian inference

Nikolaos Karnesis, Michael L. Katz, Natalia Korsakova, Jonathan R. Gair, Nikolaos Stergioulas

Comments: 21 pages, 7 figures

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Cosmology and Nongalactic Astrophysics (astro-ph.CO); General Relativity and Quantum Cosmology (gr-qc); Computational Physics (physics.comp-ph); Applications (stat.AP); Machine Learning (stat.ML)

[577] arXiv:2303.02255 (cross-list from cs.LG) [pdf, other]

Title: Finite-Sample Analysis of Learning High-Dimensional Single ReLU Neuron

Jingfeng Wu, Difan Zou, Zixiang Chen, Vladimir Braverman, Quanquan Gu, Sham M. Kakade

Comments: ICML 2023 camera ready

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[578] arXiv:2303.02266 (cross-list from cs.IT) [pdf, other]

Title: Collaborative Learning with a Drone Orchestrator

Mahdi Boloursaz Mashhadi, Mahnoosh Mahdavimoghadam, Rahim Tafazolli, Walid Saad

Comments: Accepted at the IEEE

Subjects: Information Theory (cs.IT); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)

[579] arXiv:2303.02311 (cross-list from cs.LG) [pdf, html, other]

Title: Traffic State Estimation from Vehicle Trajectories with Anisotropic Gaussian Processes

Fan Wu, Zhanhong Cheng, Huiyu Chen, Tony Z. Qiu, Lijun Sun

Subjects: Machine Learning (cs.LG); Applications (stat.AP)

[580] arXiv:2303.02324 (cross-list from eess.SP) [pdf, other]

Title: Modeling and Quickest Detection of a Rapidly Approaching Object

Tim Brucks, Taposh Banerjee, Rahul Mishra

Subjects: Signal Processing (eess.SP); Statistics Theory (math.ST)

[581] arXiv:2303.02444 (cross-list from cs.LG) [pdf, html, other]

Title: Calibrating Transformers via Sparse Gaussian Processes

Wenlong Chen, Yingzhen Li

Comments: Published at The Eleventh International Conference on Learning Representations (ICLR 2023). This latest Arxiv version includes a clarification of how ECE/MCE are computed (at page 10)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[582] arXiv:2303.02504 (cross-list from cs.LG) [pdf, other]

Title: MNL-Bandit in non-stationary environments

Ayoub Foussoul, Vineet Goyal, Varun Gupta

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[583] arXiv:2303.02550 (cross-list from physics.soc-ph) [pdf, other]

Title: Opinion Dynamics on Complex Networks

Jiarui Dong, Yi-Cheng Zhang, Yixiu Kong

Subjects: Physics and Society (physics.soc-ph); Applications (stat.AP)

[584] arXiv:2303.02554 (cross-list from math.NA) [pdf, other]

Title: Self-reinforced polynomial approximation methods for concentrated probability densities

Tiangang Cui, Sergey Dolgov, Olivier Zahm

Subjects: Numerical Analysis (math.NA); Computation (stat.CO); Machine Learning (stat.ML)

[585] arXiv:2303.02561 (cross-list from cs.LG) [pdf, other]

Title: CAMEL: Curvature-Augmented Manifold Embedding and Learning

Nan Xu, Yongming Liu

Comments: The original results reported in the original manuscript cannot be reproduced by a valid code from the first author. The first author stated that the original code was lost during a computer crash and cannot be retrieved. The corresponding author decided to withdraw the manuscript for further evaluation before resubmission

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[586] arXiv:2303.02644 (cross-list from cs.LG) [pdf, other]

Title: Expectation consistency for calibration of neural networks

Lucas Clarté, Bruno Loureiro, Florent Krzakala, Lenka Zdeborová

Journal-ref: Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence, PMLR 216:443-453, 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[587] arXiv:2303.02658 (cross-list from cs.LG) [pdf, other]

Title: On the Capacity Limits of Privileged ERM

Michal Sharoni, Sivan Sabato

Comments: AISTATS 2023

Journal-ref: Proceedings of the Twenty Sixth International Conference on Artificial Intelligence and Statistics (AISTATS), PMLR 206:523--534, 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[588] arXiv:2303.02691 (cross-list from cs.LG) [pdf, other]

Title: Revisiting Weighted Strategy for Non-stationary Parametric Bandits

Jing Wang, Peng Zhao, Zhi-Hua Zhou

Comments: AISTATS 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[589] arXiv:2303.02716 (cross-list from physics.soc-ph) [pdf, other]

Title: Deterministic, quenched and annealed parameter estimation for heterogeneous network models

Marzio Di Vece, Diego Garlaschelli, Tiziano Squartini

Comments: 13 pages, 5 figures

Journal-ref: Phys. Rev. E 108, 054301 (2023)

Subjects: Physics and Society (physics.soc-ph); Econometrics (econ.EM); Data Analysis, Statistics and Probability (physics.data-an); Applications (stat.AP)

[590] arXiv:2303.02783 (cross-list from cs.LG) [pdf, other]

Title: Improved Sample Complexity Bounds for Distributionally Robust Reinforcement Learning

Zaiyan Xu, Kishan Panaganti, Dileep Kalathil

Comments: Appeared in AISTATS 2023

Journal-ref: Proceedings of The 26th International Conference on Artificial Intelligence and Statistics, PMLR 206:9728-9754, 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[591] arXiv:2303.02833 (cross-list from cs.LG) [pdf, other]

Title: eCDANs: Efficient Temporal Causal Discovery from Autocorrelated and Non-stationary Data (Student Abstract)

Muhammad Hasan Ferdous, Uzma Hasan, Md Osman Gani

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Methodology (stat.ME)

[592] arXiv:2303.02859 (cross-list from cond-mat.dis-nn) [pdf, other]

Title: Bayesian inference with finitely wide neural networks

Chi-Ken Lu

Comments: v2: added relevant references, example of simple non-Gaussian bivariate distribution and corresponding inference

Journal-ref: Phys. Rev. E 108, 014311 (2023)

Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Machine Learning (stat.ML)

[593] arXiv:2303.02883 (cross-list from cs.LG) [pdf, other]

Title: Very fast, approximate counterfactual explanations for decision forests

Miguel Á. Carreira-Perpiñán, Suryabhan Singh Hada

Comments: A shorter version of this paper appears in AAAI 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[594] arXiv:2303.02901 (cross-list from cond-mat.stat-mech) [pdf, html, other]

Title: $α$-divergence Improves the Entropy Production Estimation via Machine Learning

Euijoon Kwon, Yongjoo Baek

Comments: 11 pages, 9 figures

Subjects: Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG); Machine Learning (stat.ML)

[595] arXiv:2303.03016 (cross-list from math.PR) [pdf, other]

Title: The calculation of the probability density of a strictly stable law at large $X$

Viacheslav V. Saenko

Subjects: Probability (math.PR); Statistics Theory (math.ST); Computation (stat.CO)

[596] arXiv:2303.03080 (cross-list from q-fin.RM) [pdf, html, other]

Title: Defining and comparing SICR-events for classifying impaired loans under IFRS 9

Arno Botha, Esmerelda Oberholzer, Janette Larney, Riaan de Jongh

Comments: 36 pages (including appendix), 9199 words, 13 figures

Journal-ref: Annals of Operations Research (2025)

Subjects: Risk Management (q-fin.RM); Statistical Finance (q-fin.ST); Applications (stat.AP)

[597] arXiv:2303.03181 (cross-list from cs.LG) [pdf, other]

Title: MetaPhysiCa: OOD Robustness in Physics-informed Machine Learning

S Chandra Mouli, Muhammad Ashraful Alam, Bruno Ribeiro

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[598] arXiv:2303.03187 (cross-list from cs.LG) [pdf, other]

Title: Boosting Differentiable Causal Discovery via Adaptive Sample Reweighting

An Zhang, Fangfu Liu, Wenchang Ma, Zhibo Cai, Xiang Wang, Tat-seng Chua

Comments: In proceedings of ICLR 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[599] arXiv:2303.03254 (cross-list from math.OC) [pdf, other]

Title: An Online Algorithm for Chance Constrained Resource Allocation

Yuwei Chen, Zengde Deng, Yinzhi Zhou, Zaiyi Chen, Yujie Chen, Haoyuan Hu

Comments: 5 pages, 5 figures. Accepted to ICASSP 2023. arXiv admin note: substantial text overlap with arXiv:2203.16818

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[600] arXiv:2303.03272 (cross-list from cs.LG) [pdf, other]

Title: Accelerated Rates between Stochastic and Adversarial Online Convex Optimization

Sarah Sachs, Hedi Hadiji, Tim van Erven, Cristobal Guzman

Comments: Extended version of 'Between Stochastic and Adversarial Online Convex Optimization: Improved Regret Bounds via Smoothness' by the same authors. arXiv admin note: text overlap with arXiv:2202.07554

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)