Machine Learning

Authors and titles for March 2023

[101] arXiv:2303.15210 [pdf, other]

Title: On the Connection between $L_p$ and Risk Consistency and its Implications on Regularized Kernel Methods

Hannes Köhler

Comments: 33 pages, 1 figure

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[102] arXiv:2303.15579 [pdf, html, other]

Title: Adjusted Wasserstein Distributionally Robust Estimator in Statistical Learning

Yiling Xie, Xiaoming Huo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[103] arXiv:2303.15948 [pdf, other]

Title: Sparse Gaussian Processes with Spherical Harmonic Features Revisited

Stefanos Eleftheriadis, Dominic Richards, James Hensman

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[104] arXiv:2303.16091 [pdf, other]

Title: Learnability, Sample Complexity, and Hypothesis Class Complexity for Regression Models

Soosan Beheshti, Mahdi Shamsi

Comments: 14 pages,10 figures

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[105] arXiv:2303.16208 [pdf, other]

Title: Lifting uniform learners via distributional decomposition

Guy Blanc, Jane Lange, Ali Malik, Li-Yang Tan

Comments: To appear in STOC 2023

Subjects: Machine Learning (stat.ML); Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG)

[106] arXiv:2303.16510 [pdf, html, other]

Title: Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraints

Pierre Ablin, Simon Vary, Bin Gao, P.-A. Absil

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[107] arXiv:2303.16721 [pdf, other]

Title: Performance-guaranteed regularization in maximum likelihood method: Gauge symmetry in Kullback -- Leibler divergence

Akihisa Ichiki

Comments: 9 pages, 2 figures

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[108] arXiv:2303.16816 [pdf, other]

Title: PAC-Bayesian bounds for learning LTI-ss systems with input from empirical loss

Deividas Eringis, John Leth, Zheng-Hua Tan, Rafael Wisniewski, Mihaly Petreczky

Comments: arXiv admin note: text overlap with arXiv:2212.14838

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[109] arXiv:2303.16852 [pdf, other]

Title: Diffusion Schrödinger Bridge Matching

Yuyang Shi, Valentin De Bortoli, Andrew Campbell, Arnaud Doucet

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[110] arXiv:2303.16954 [pdf, html, other]

Title: Leveraging joint sparsity in hierarchical Bayesian learning

Jan Glaubitz, Anne Gelb

Comments: 30 pages, 15 figures

Journal-ref: SIAM-ASA J Uncertain Quantif 12(2), 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[111] arXiv:2303.16971 [pdf, html, other]

Title: Sparse joint shift in multinomial classification

Dirk Tasche

Comments: 27 pages

Journal-ref: Foundations of Data Science, 2024, 6(3): 251-277

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[112] arXiv:2303.17109 [pdf, other]

Title: Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Models

Anant Raj, Umut Şimşekli, Alessandro Rudi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[113] arXiv:2303.17229 [pdf, other]

Title: The Graphical Nadaraya-Watson Estimator on Latent Position Models

M. Gjorgjevski

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[114] arXiv:2303.17765 [pdf, other]

Title: Learning from Similar Linear Representations: Adaptivity, Minimaxity, and Robustness

Ye Tian, Yuqi Gu, Yang Feng

Comments: 125 pages, 10 figures, 2 tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[115] arXiv:2303.17940 [pdf, other]

Title: Per-Example Gradient Regularization Improves Learning Signals from Noisy Data

Xuran Meng, Yuan Cao, Difan Zou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[116] arXiv:2303.18211 [pdf, other]

Title: A Scale-Invariant Sorting Criterion to Find a Causal Order in Additive Noise Models

Alexander G. Reisach, Myriam Tami, Christof Seiler, Antoine Chambaz, Sebastian Weichwald

Comments: accepted at the 2023 Conference on Neural Information Processing Systems (NeurIPS 2023); cf. this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[117] arXiv:2303.00039 (cross-list from cs.LG) [pdf, other]

Title: M-L2O: Towards Generalizable Learning-to-Optimize by Test-Time Fast Self-Adaptation

Junjie Yang, Xuxi Chen, Tianlong Chen, Zhangyang Wang, Yingbin Liang

Comments: This paper is accepted in ICLR 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[118] arXiv:2303.00055 (cross-list from cs.LG) [pdf, other]

Title: Learning time-scales in two-layers neural networks

Raphaël Berthier, Andrea Montanari, Kangjie Zhou

Comments: 64 pages, 15 figures, Found Comput Math (2024)

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[119] arXiv:2303.00058 (cross-list from cs.LG) [pdf, other]

Title: Neural Nonnegative Matrix Factorization for Hierarchical Multilayer Topic Modeling

Tyler Will, Runyu Zhang, Eli Sadovnik, Mengdi Gao, Joshua Vendrow, Jamie Haddock, Denali Molitor, Deanna Needell

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[120] arXiv:2303.00301 (cross-list from stat.CO) [pdf, other]

Title: Auxiliary MCMC and particle Gibbs samplers for parallelisable inference in latent dynamical systems

Adrien Corenflos, Simo Särkkä

Comments: Accepted for publication at the Electronic Journal of Statistics. 33 pages (incl. references and TOC) + 10 pages appendix, 10 figures. Code also updated at this https URL Changes to previous version mostly relate to readability edits

Subjects: Computation (stat.CO); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[121] arXiv:2303.00315 (cross-list from cs.LG) [pdf, other]

Title: Efficient Explorative Key-term Selection Strategies for Conversational Contextual Bandits

Zhiyong Wang, Xutong Liu, Shuai Li, John C.S. Lui

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[122] arXiv:2303.00318 (cross-list from stat.ME) [pdf, other]

Title: Bayesian outcome-guided multi-view mixture models with applications in molecular precision medicine

Paul D. W. Kirk, Filippo Pagani, Sylvia Richardson

Comments: 44 pages, 6 figures

Subjects: Methodology (stat.ME); Applications (stat.AP); Machine Learning (stat.ML)

[123] arXiv:2303.00473 (cross-list from stat.ME) [pdf, other]

Title: Generalized Cumulative Shrinkage Process Priors with Applications to Sparse Bayesian Factor Analysis

Sylvia Frühwirth-Schnatter

Subjects: Methodology (stat.ME); Econometrics (econ.EM); Computation (stat.CO); Machine Learning (stat.ML)

[124] arXiv:2303.00480 (cross-list from cs.DS) [pdf, other]

Title: Sampling with Barriers: Faster Mixing via Lewis Weights

Khashayar Gatmiry, Jonathan Kelner, Santosh S. Vempala

Subjects: Data Structures and Algorithms (cs.DS); Logic in Computer Science (cs.LO); Functional Analysis (math.FA); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[125] arXiv:2303.00570 (cross-list from math.ST) [pdf, other]

Title: Mean-Square Analysis of Discretized Itô Diffusions for Heavy-tailed Sampling

Ye He, Tyler Farghly, Krishnakumar Balasubramanian, Murat A. Erdogdu

Subjects: Statistics Theory (math.ST); Machine Learning (cs.LG); Numerical Analysis (math.NA); Computation (stat.CO); Machine Learning (stat.ML)

[126] arXiv:2303.00620 (cross-list from cs.LG) [pdf, other]

Title: Multi-Armed Bandits with Generalized Temporally-Partitioned Rewards

Ronald C. van den Broek, Rik Litjens, Tobias Sagis, Luc Siecker, Nina Verbeeke, Pratik Gajane

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[127] arXiv:2303.00654 (cross-list from cs.LG) [pdf, other]

Title: How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy

Natalia Ponomareva, Hussein Hazimeh, Alex Kurakin, Zheng Xu, Carson Denison, H. Brendan McMahan, Sergei Vassilvitskii, Steve Chien, Abhradeep Thakurta

Journal-ref: Journal of Artificial Intelligence Research 77 (2023) 1113-1201

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[128] arXiv:2303.00693 (cross-list from hep-ph) [pdf, other]

Title: PE-GAN: Prior Embedding GAN for PXD images at Belle II

Baran Hashemi, Nikolai Hartmann, Thomas Kuhr, Martin Ritter, Matej srebre

Comments: 25th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2021)

Subjects: High Energy Physics - Phenomenology (hep-ph); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[129] arXiv:2303.00706 (cross-list from physics.flu-dyn) [pdf, other]

Title: Predicting the wall-shear stress and wall pressure through convolutional neural networks

Arivazhagan G. Balasubramanian, Luca Guastoni, Philipp Schlatter, Hossein Azizpour, Ricardo Vinuesa

Comments: 33 pages, 10 figures. arXiv admin note: substantial text overlap with arXiv:2107.07340

Subjects: Fluid Dynamics (physics.flu-dyn); Machine Learning (stat.ML)

[130] arXiv:2303.00728 (cross-list from quant-ph) [pdf, html, other]

Title: On the universality of $S_n$-equivariant $k$-body gates

Sujay Kazi, Martin Larocca, M. Cerezo

Comments: 7+15 pages, 3+5 figures, updated to published version

Journal-ref: New J. Phys. 26, 053030 (2024)

Subjects: Quantum Physics (quant-ph); Machine Learning (cs.LG); Machine Learning (stat.ML)

[131] arXiv:2303.00783 (cross-list from cs.LG) [pdf, other]

Title: Adversarial Examples Exist in Two-Layer ReLU Networks for Low Dimensional Linear Subspaces

Odelia Melamed, Gilad Yehudai, Gal Vardi

Comments: Camera ready version for NeurIPS 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[132] arXiv:2303.00800 (cross-list from cs.LG) [pdf, html, other]

Title: Continuous-Time Functional Diffusion Processes

Giulio Franzese, Giulio Corallo, Simone Rossi, Markus Heinonen, Maurizio Filippone, Pietro Michiardi

Comments: Under review

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[133] arXiv:2303.00848 (cross-list from cs.LG) [pdf, other]

Title: Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation

Diederik P. Kingma, Ruiqi Gao

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[134] arXiv:2303.00859 (cross-list from q-fin.CP) [pdf, html, other]

Title: FuNVol: A Multi-Asset Implied Volatility Market Simulator using Functional Principal Components and Neural SDEs

Vedant Choudhary, Sebastian Jaimungal, Maxime Bergeron

Comments: 38 pages, 19 figures, 5 tables

Subjects: Computational Finance (q-fin.CP); Machine Learning (cs.LG); Statistical Finance (q-fin.ST); Machine Learning (stat.ML)

[135] arXiv:2303.00883 (cross-list from cs.LG) [pdf, other]

Title: Variance-reduced Clipping for Non-convex Optimization

Amirhossein Reisizadeh, Haochuan Li, Subhro Das, Ali Jadbabaie

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[136] arXiv:2303.00890 (cross-list from cs.LG) [pdf, html, other]

Title: Comparison of High-Dimensional Bayesian Optimization Algorithms on BBOB

Maria Laura Santoni, Elena Raponi, Renato De Leone, Carola Doerr

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[137] arXiv:2303.00950 (cross-list from cs.LG) [pdf, other]

Title: Open Problem: Optimal Best Arm Identification with Fixed Budget

Chao Qin

Comments: COLT 2022 camera-ready version this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[138] arXiv:2303.00954 (cross-list from cs.LG) [pdf, other]

Title: Large Deviations for Accelerating Neural Networks Training

Sreelekha Guggilam, Varun Chandola, Abani Patra

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[139] arXiv:2303.00970 (cross-list from math.OC) [pdf, html, other]

Title: PAPAL: A Provable PArticle-based Primal-Dual ALgorithm for Mixed Nash Equilibrium

Shihong Ding, Hanze Dong, Cong Fang, Zhouchen Lin, Tong Zhang

Comments: Published in Journal of Machine Learning Research 25 (2024) 1-48

Subjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[140] arXiv:2303.00972 (cross-list from cs.CV) [pdf, other]

Title: Practical Network Acceleration with Tiny Sets: Hypothesis, Theory, and Algorithm

Guo-Hua Wang, Jianxin Wu

Comments: under review for TPAMI. arXiv admin note: substantial text overlap with arXiv:2202.07861

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[141] arXiv:2303.01076 (cross-list from cs.LG) [pdf, other]

Title: Hallucinated Adversarial Control for Conservative Offline Policy Evaluation

Jonas Rothfuss, Bhavya Sukhija, Tobias Birchler, Parnian Kassraie, Andreas Krause

Comments: Conference on Uncertainty in Artificial Intelligence (UAI) 2023, first three authors contributed equally

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[142] arXiv:2303.01186 (cross-list from stat.ME) [pdf, html, other]

Title: Discrete-time Competing-Risks Regression with or without Penalization

Tomer Meir, Malka Gorfine

Journal-ref: Biometrics, Volume 81, Issue 2, June 2025

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[143] arXiv:2303.01335 (cross-list from cs.LG) [pdf, other]

Title: First-order ANIL provably learns representations despite overparametrization

Oğuz Kaan Yüksel, Etienne Boursier, Nicolas Flammarion

Comments: 42 pages, 17 figures

Journal-ref: O. K. Y\"uksel, E. Boursier and N. Flammarion, "First-order ANIL provably learns representations despite overparametrisation", in The Twelfth International Conference on Learning Representations, 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[144] arXiv:2303.01370 (cross-list from math.OC) [pdf, other]

Title: Non asymptotic analysis of Adaptive stochastic gradient algorithms and applications

Antoine Godichon-Baggioni (LPSM (UMR\_8001)), Pierre Tarrago (LPSM (UMR\_8001))

Subjects: Optimization and Control (math.OC); Probability (math.PR); Statistics Theory (math.ST); Machine Learning (stat.ML)

[145] arXiv:2303.01372 (cross-list from cs.LG) [pdf, other]

Title: High-dimensional analysis of double descent for linear regression with random projections

Francis Bach (SIERRA)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[146] arXiv:2303.01422 (cross-list from stat.ME) [pdf, other]

Title: Design-based conformal prediction

Jerzy Wieczorek

Comments: 41 pages, 1 figure

Journal-ref: Survey Methodology 49:2 (2023)

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[147] arXiv:2303.01456 (cross-list from cs.LG) [pdf, other]

Title: The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks

Spencer Frei, Gal Vardi, Peter L. Bartlett, Nathan Srebro

Comments: 42 pages; NeurIPS 2023 camera ready

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[148] arXiv:2303.01462 (cross-list from cs.LG) [pdf, other]

Title: Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization

Spencer Frei, Gal Vardi, Peter L. Bartlett, Nathan Srebro

Comments: 53 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[149] arXiv:2303.01469 (cross-list from cs.LG) [pdf, other]

Title: Consistency Models

Yang Song, Prafulla Dhariwal, Mark Chen, Ilya Sutskever

Comments: ICML 2023

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[150] arXiv:2303.01501 (cross-list from stat.CO) [pdf, other]

Title: Stability and Machine Learning Applications of Persistent Homology Using the Delaunay-Rips Complex

Amish Mishra, Francis C. Motta

Comments: 23 pages, 10 figures and tables

Subjects: Computation (stat.CO); Algebraic Topology (math.AT); Machine Learning (stat.ML)