Machine Learning

Authors and titles for February 2024

[51] arXiv:2402.04114 [pdf, other]

Title: SCAFFLSA: Taming Heterogeneity in Federated Linear Stochastic Approximation and TD Learning

Paul Mangold, Sergey Samsonov, Safwan Labbi, Ilya Levin, Reda Alami, Alexey Naumov, Eric Moulines

Comments: now with linear speed-up!

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[52] arXiv:2402.04146 [pdf, html, other]

Title: Interpretable Multi-Source Data Fusion Through Latent Variable Gaussian Process

Sandipp Krishnan Ravi, Yigitcan Comlek, Arjun Pathak, Vipul Gupta, Rajnikant Umretiya, Andrew Hoffman, Ghanshyam Pilania, Piyush Pandita, Sayan Ghosh, Nathaniel Mckeever, Wei Chen, Liping Wang

Comments: 27 Pages, 10 Figures, 5 Supplementary Figures, 2 Supplementary Tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[53] arXiv:2402.04355 [pdf, html, other]

Title: PQMass: Probabilistic Assessment of the Quality of Generative Models using Probability Mass Estimation

Pablo Lemos, Sammy Sharief, Nikolay Malkin, Salma Salhi, Connor Stone, Laurence Perreault-Levasseur, Yashar Hezaveh

Comments: Published as a conference paper at ICLR 2025

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Methodology (stat.ME)

[54] arXiv:2402.04436 [pdf, html, other]

Title: Continuous Multidimensional Scaling

Michael W. Trosset, Carey E. Priebe

Comments: 25 pages. Modified previous material for greater clarity; added new material about approximate Lipschitz constraints, Approximate Lipschitz Embedding (ALE), and uniform convergence; added material on constrained minimization of raw stress to the appendix

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[55] arXiv:2402.04493 [pdf, html, other]

Title: A Primal-Dual Algorithm for Offline Constrained Reinforcement Learning with Linear MDPs

Kihyuk Hong, Ambuj Tewari

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[56] arXiv:2402.04498 [pdf, html, other]

Title: Pathspace Kalman Filters with Dynamic Process Uncertainty for Analyzing Time-course Data

Chaitra Agrahar, William Poole, Simone Bianco, Hana El-Samad

Comments: 32 pages, 8 figures, Submitted for review

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

[57] arXiv:2402.04516 [pdf, html, other]

Title: Generalized Sobolev Transport for Probability Measures on a Graph

Tam Le, Truyen Nguyen, Kenji Fukumizu

Comments: To appear at ICML'2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[58] arXiv:2402.04550 [pdf, html, other]

Title: Riemann-Lebesgue Forest for Regression

Tian Qin, Wei-Min Huang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[59] arXiv:2402.04613 [pdf, html, other]

Title: Wasserstein Gradient Flows for Moreau Envelopes of f-Divergences in Reproducing Kernel Hilbert Spaces

Viktor Stein, Sebastian Neumayer, Nicolaj Rux, Gabriele Steidl

Comments: 56 pages, 14 figures, 3 tables. Comments welcome! NEW: Incorporated Reviewers' suggestions, added FISTA and tight formulation, typos fixed

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Functional Analysis (math.FA); Optimization and Control (math.OC)

[60] arXiv:2402.04691 [pdf, html, other]

Title: Learning Operators with Stochastic Gradient Descent in General Hilbert Spaces

Lei Shi, Jia-Qi Yang

Comments: 58 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Functional Analysis (math.FA); Statistics Theory (math.ST)

[61] arXiv:2402.04692 [pdf, html, other]

Title: From explained variance of correlated components to PCA without orthogonality constraints

Marie Chavent (IMB), Guy Chavent

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[62] arXiv:2402.04740 [pdf, other]

Title: Non-Parametric Estimation of Multi-dimensional Marked Hawkes Processes

Sobin Joseph, Shashi Jain

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computational Finance (q-fin.CP); Statistical Finance (q-fin.ST)

[63] arXiv:2402.04777 [pdf, other]

Title: A fast score-based search algorithm for maximal ancestral graphs using entropy

Zhongyi Hu, Robin Evans

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[64] arXiv:2402.04885 [pdf, html, other]

Title: A Unified Gaussian Process for Branching and Nested Hyperparameter Optimization

Jiazhao Zhang, Ying Hung, Chung-Ching Lin, Zicheng Liu

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[65] arXiv:2402.04922 [pdf, html, other]

Title: Voronoi Candidates for Bayesian Optimization

Nathan Wycoff, John W. Smith, Annie S. Booth, Robert B. Gramacy

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[66] arXiv:2402.04980 [pdf, html, other]

Title: Asymptotics of feature learning in two-layer networks after one gradient-step

Hugo Cui, Luca Pesce, Yatin Dandi, Florent Krzakala, Yue M. Lu, Lenka Zdeborová, Bruno Loureiro

Journal-ref: Proceedings of the 41st International Conference on Machine Learning, PMLR 235:9662-9695, 2024

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[67] arXiv:2402.04997 [pdf, other]

Title: Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design

Andrew Campbell, Jason Yim, Regina Barzilay, Tom Rainforth, Tommi Jaakkola

Comments: 60 pages, 11 figures, 6 tables; ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

[68] arXiv:2402.05101 [pdf, html, other]

Title: Tighter Generalisation Bounds via Interpolation

Paul Viallard, Maxime Haddouche, Umut Şimşekli, Benjamin Guedj

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[69] arXiv:2402.05187 [pdf, html, other]

Title: Learning mirror maps in policy mirror descent

Carlo Alfano, Sebastian Towers, Silvia Sapora, Chris Lu, Patrick Rebeschini

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[70] arXiv:2402.05220 [pdf, html, other]

Title: On Parameter Estimation in Deviated Gaussian Mixture of Experts

Huy Nguyen, Khai Nguyen, Nhat Ho

Comments: Accepted to AISTATS 2024, 32 pages, 2 figures, 1 table

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[71] arXiv:2402.05271 [pdf, html, other]

Title: Feature learning as alignment: a structural property of gradient descent in non-linear neural networks

Daniel Beaglehole, Ioannis Mitliagkas, Atish Agarwala

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[72] arXiv:2402.05330 [pdf, html, other]

Title: Classification under Nuisance Parameters and Generalized Label Shift in Likelihood-Free Inference

Luca Masserano, Alex Shen, Michele Doro, Tommaso Dorigo, Rafael Izbicki, Ann B. Lee

Comments: 26 pages, 19 figures, code available at this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[73] arXiv:2402.05639 [pdf, html, other]

Title: Nonparametric Instrumental Variable Regression through Stochastic Approximate Gradients

Yuri Fonseca, Caio Peixoto, Yuri Saporito

Comments: Accepted at NeurIPS 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[74] arXiv:2402.05674 [pdf, html, other]

Title: A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs

Kasimir Tanner, Matteo Vilucchio, Bruno Loureiro, Florent Krzakala

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[75] arXiv:2402.05696 [pdf, other]

Title: Fixed width treelike neural networks capacity analysis -- generic activations

Mihailo Stojnic

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Theory (cs.IT); Machine Learning (cs.LG); Probability (math.PR)

[76] arXiv:2402.05715 [pdf, other]

Title: Collaborative non-parametric two-sample testing

Alejandro de la Concha, Nicolas Vayatis, Argyris Kalogeratos

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[77] arXiv:2402.05718 [pdf, html, other]

Title: REMEDI: Corrective Transformations for Improved Neural Entropy Estimation

Viktor Nilsson, Anirban Samaddar, Sandeep Madireddy, Pierre Nyquist

Comments: To appear in ICML 2024. 30 pages, 18 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[78] arXiv:2402.05719 [pdf, other]

Title: Exact capacity of the \emph{wide} hidden layer treelike neural networks with generic activations

Mihailo Stojnic

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Theory (cs.IT); Machine Learning (cs.LG); Probability (math.PR)

[79] arXiv:2402.05787 [pdf, html, other]

Title: How do Transformers perform In-Context Autoregressive Learning?

Michael E. Sander, Raja Giryes, Taiji Suzuki, Mathieu Blondel, Gabriel Peyré

Comments: 20 pages ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[80] arXiv:2402.05878 [pdf, html, other]

Title: Prior-Dependent Allocations for Bayesian Fixed-Budget Best-Arm Identification in Structured Bandits

Nicolas Nguyen, Imad Aouali, András György, Claire Vernade

Journal-ref: International Conference on Artificial Intelligence and Statistics (AISTATS 2025)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[81] arXiv:2402.06151 [pdf, html, other]

Title: POTEC: Off-Policy Learning for Large Action Spaces via Two-Stage Policy Decomposition

Yuta Saito, Jihan Yao, Thorsten Joachims

Comments: arXiv admin note: text overlap with arXiv:2305.08062

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[82] arXiv:2402.06162 [pdf, html, other]

Title: Wasserstein proximal operators describe score-based generative models and resolve memorization

Benjamin J. Zhang, Siting Liu, Wuchen Li, Markos A. Katsoulakis, Stanley J. Osher

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[83] arXiv:2402.06173 [pdf, html, other]

Title: SMC Is All You Need: Parallel Strong Scaling

Xinzhu Liang, Joseph M. Lukens, Sanjaya Lohani, Brian T. Kirby, Thomas A. Searles, Kody J.H. Law

Comments: 23 pages, 17 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[84] arXiv:2402.06320 [pdf, html, other]

Title: Particle Denoising Diffusion Sampler

Angus Phillips, Hai-Dang Dau, Michael John Hutchinson, Valentin De Bortoli, George Deligiannidis, Arnaud Doucet

Comments: To be published in ICML 2024. 37 pages, 20 figures, 3 tables, 5 algorithms

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[85] arXiv:2402.06386 [pdf, other]

Title: Boosting-Based Sequential Meta-Tree Ensemble Construction for Improved Decision Trees

Ryota Maniwa, Naoki Ichijo, Yuta Nakahara, Toshiyasu Matsushima

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[86] arXiv:2402.06388 [pdf, html, other]

Title: Convergence of a L2 regularized Policy Gradient Algorithm for the Multi Armed Bandit

Stefana Anita, Gabriel Turinici

Journal-ref: In: Antonacopoulos, A., et al. (eds) Pattern Recognition. ICPR 2024. Lecture Notes in Computer Science, vol 15326. Springer, Cham (2025)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[87] arXiv:2402.06525 [pdf, other]

Title: Flexible infinite-width graph convolutional networks and the importance of representation learning

Ben Anson, Edward Milsom, Laurence Aitchison

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[88] arXiv:2402.06884 [pdf, html, other]

Title: Low-Rank Approximation of Structural Redundancy for Self-Supervised Learning

Kang Du, Yu Xiang

Comments: Accepted to the 3rd Conference on Causal Learning and Reasoning (CLeaR)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[89] arXiv:2402.06940 [pdf, html, other]

Title: Efficient Incremental Belief Updates Using Weighted Virtual Observations

David Tolpin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[90] arXiv:2402.07025 [pdf, html, other]

Title: Generalization Error of Graph Neural Networks in the Mean-field Regime

Gholamali Aminian, Yixuan He, Gesine Reinert, Łukasz Szpruch, Samuel N. Cohen

Comments: Accepted in ICML 2024

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[91] arXiv:2402.07131 [pdf, html, other]

Title: Resampling methods for private statistical inference

Karan Chadha, John Duchi, Rohith Kuditipudi

Comments: 45 pages

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Methodology (stat.ME)

[92] arXiv:2402.07160 [pdf, other]

Title: PASOA- PArticle baSed Bayesian Optimal Adaptive design

Jacopo Iollo, Christophe Heinkelé, Pierre Alliez, Florence Forbes

Comments: ICML 2024

Journal-ref: Proceedings of the 41st International Conference on Machine Learning, 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[93] arXiv:2402.07189 [pdf, html, other]

Title: Improving LSH via Tensorized Random Projection

Bhisham Dev Verma, Rameshwar Pratap

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG)

[94] arXiv:2402.07307 [pdf, html, other]

Title: Self-Calibrating Conformal Prediction

Lars van der Laan, Ahmed M. Alaa

Comments: Accepted to Neurips 2024. Preprint previously titled Self-Consistent Conformal Prediction. this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[95] arXiv:2402.07341 [pdf, html, other]

Title: Noise-Adaptive Confidence Sets for Linear Bandits and Application to Bayesian Optimization

Kwang-Sung Jun, Jungtaek Kim

Comments: accepted to ICML'24; fixed typos

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[96] arXiv:2402.07357 [pdf, other]

Title: Regression Trees for Fast and Adaptive Prediction Intervals

Luben M. C. Cabezas, Mateus P. Otto, Rafael Izbicki, Rafael B. Stern

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[97] arXiv:2402.07391 [pdf, html, other]

Title: Replicability is Asymptotically Free in Multi-armed Bandits

Junpei Komiyama, Shinji Ito, Yuichi Yoshida, Souta Koshino

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[98] arXiv:2402.07445 [pdf, html, other]

Title: Top-$K$ ranking with a monotone adversary

Yuepeng Yang, Antares Chen, Lorenzo Orecchia, Cong Ma

Comments: Accepted to Conference of Learning Theory, 2024

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[99] arXiv:2402.07626 [pdf, other]

Title: Stochastic Gradient Flow Dynamics of Test Risk and its Exact Solution for Weak Features

Rodrigo Veiga, Anastasia Remizova, Nicolas Macris

Comments: Accepted to ICML 2024

Journal-ref: Proceedings of the 41st International Conference on Machine Learning, PMLR 235:49310-49344, 2024

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[100] arXiv:2402.07723 [pdf, html, other]

Title: Generalization Bounds for Heavy-Tailed SDEs through the Fractional Fokker-Planck Equation

Benjamin Dupuis, Umut Şimşekli

Journal-ref: Proceedings of the 41st International Conference on Machine Learning, PMLR 235:12087-12137, 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)