Machine Learning

Authors and titles for February 2024

[101] arXiv:2402.07735 [pdf, other]

Title: Graph Structure Inference with BAM: Introducing the Bilinear Attention Mechanism

Philipp Froehlich, Heinz Koeppl

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[102] arXiv:2402.07762 [pdf, other]

Title: Scalable Structure Learning for Sparse Context-Specific Systems

Felix Leopoldo Rios, Alex Markham, Liam Solus

Comments: 34 pages, 6 figures; for associated code, see this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Combinatorics (math.CO)

[103] arXiv:2402.07802 [pdf, other]

Title: Towards a mathematical theory for consistency training in diffusion models

Gen Li, Zhihan Huang, Yuting Wei

Comments: The first two authors contributed equally

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[104] arXiv:2402.07868 [pdf, other]

Title: Nesting Particle Filters for Experimental Design in Dynamical Systems

Sahel Iqbal, Adrien Corenflos, Simo Särkkä, Hany Abdulsamad

Comments: Accepted to ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[105] arXiv:2402.08077 [pdf, html, other]

Title: Diffeomorphic Measure Matching with Kernels for Generative Modeling

Biraj Pandey, Bamdad Hosseini, Pau Batlle, Houman Owhadi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS); Computation (stat.CO)

[106] arXiv:2402.08082 [pdf, html, other]

Title: Score-based generative models break the curse of dimensionality in learning a family of sub-Gaussian probability distributions

Frank Cole, Yulong Lu

Comments: 33 pages, to appear in the proceedings of 12th International Conference on Learning Representations

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[107] arXiv:2402.08095 [pdf, html, other]

Title: Convergence Analysis of Discrete Diffusion Model: Exact Implementation through Uniformization

Hongrui Chen, Lexing Ying

Comments: 19 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[108] arXiv:2402.08164 [pdf, html, other]

Title: On Limitations of the Transformer Architecture

Binghui Peng, Srini Narayanan, Christos Papadimitriou

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[109] arXiv:2402.08201 [pdf, other]

Title: Off-Policy Evaluation in Markov Decision Processes under Weak Distributional Overlap

Mohammad Mehrabi, Stefan Wager

Comments: 50 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[110] arXiv:2402.08344 [pdf, other]

Title: Implicit Bias in Noisy-SGD: With Applications to Differentially Private Training

Tom Sander, Maxime Sylvestre, Alain Durmus

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[111] arXiv:2402.08412 [pdf, other]

Title: Interacting Particle Systems on Networks: joint inference of the network and the interaction kernel

Quanjun Lang, Xiong Wang, Fei Lu, Mauro Maggioni

Comments: 53 pages, 17 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS); Statistics Theory (math.ST)

[112] arXiv:2402.08425 [pdf, other]

Title: Transfer Operators from Batches of Unpaired Points via Entropic Transport Kernels

Florian Beier, Hancheng Bi, Clément Sarrazin, Bernhard Schmitzer, Gabriele Steidl

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS)

[113] arXiv:2402.08508 [pdf, other]

Title: A PAC-Bayesian Link Between Generalisation and Flat Minima

Maxime Haddouche, Paul Viallard, Umut Simsekli, Benjamin Guedj

Comments: Published at International Conference on Algorithmic Learning Theory 2025

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[114] arXiv:2402.08616 [pdf, other]

Title: Adjustment Identification Distance: A gadjid for Causal Structure Learning

Leonard Henckel, Theo Würtzen, Sebastian Weichwald

Comments: accepted at UAI 2024 (Conference on Uncertainty in Artificial Intelligence)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[115] arXiv:2402.08711 [pdf, html, other]

Title: Correction to "Wasserstein distance estimates for the distributions of numerical approximations to ergodic stochastic differential equations"

Daniel Paulin, Peter A. Whalley

Comments: 9 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA); Probability (math.PR)

[116] arXiv:2402.08818 [pdf, html, other]

Title: Corridor Geometry in Gradient-Based Optimization

Benoit Dherin, Mihaela Rosca

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[117] arXiv:2402.08847 [pdf, html, other]

Title: Space-Time Diffusion Bridge

Hamidreza Behjoo, Michael Chertkov

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[118] arXiv:2402.08991 [pdf, html, other]

Title: Towards Robust Model-Based Reinforcement Learning Against Adversarial Corruption

Chenlu Ye, Jiafan He, Quanquan Gu, Tong Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[119] arXiv:2402.09018 [pdf, other]

Title: Neural Operators Meet Energy-based Theory: Operator Learning for Hamiltonian and Dissipative PDEs

Yusuke Tanaka, Takaharu Yaguchi, Tomoharu Iwata, Naonori Ueda

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[120] arXiv:2402.09122 [pdf, html, other]

Title: Weighted-Sum of Gaussian Process Latent Variable Models

James Odgers, Ruby Sedgwick, Chrysoula Kappatou, Ruth Misener, Sarah Filippi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[121] arXiv:2402.09328 [pdf, other]

Title: Connecting Algorithmic Fairness to Quality Dimensions in Machine Learning in Official Statistics and Survey Production

Patrick Oliver Schenk, Christoph Kern

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[122] arXiv:2402.09467 [pdf, html, other]

Title: Optimal Thresholding Linear Bandit

Eduardo Ochoa Rivera, Ambuj Tewari

Comments: arXiv admin note: substantial text overlap with arXiv:2006.16073 by other authors

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[123] arXiv:2402.09483 [pdf, html, other]

Title: Oracle-Efficient Differentially Private Learning with Public Data

Adam Block, Mark Bun, Rathin Desai, Abhishek Shetty, Steven Wu

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[124] arXiv:2402.09598 [pdf, html, other]

Title: MCMC-driven learning

Alexandre Bouchard-Côté, Trevor Campbell, Geoff Pleiss, Nikola Surjanovic

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Computation (stat.CO)

[125] arXiv:2402.09623 [pdf, html, other]

Title: Conformalized Adaptive Forecasting of Heterogeneous Trajectories

Yanfei Zhou, Lars Lindemann, Matteo Sesia

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[126] arXiv:2402.09723 [pdf, html, other]

Title: Efficient Prompt Optimization Through the Lens of Best Arm Identification

Chengshuai Shi, Kun Yang, Zihan Chen, Jundong Li, Jing Yang, Cong Shen

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[127] arXiv:2402.09754 [pdf, other]

Title: Robust SVD Made Easy: A fast and reliable algorithm for large-scale data analysis

Sangil Han, Kyoowon Kim, Sungkyu Jung

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[128] arXiv:2402.09796 [pdf, other]

Title: Closed-form Filtering for Non-linear Systems

Théophile Cantelobre, Carlo Ciliberto, Benjamin Guedj, Alessandro Rudi

Comments: 38 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Robotics (cs.RO)

[129] arXiv:2402.09802 [pdf, html, other]

Title: Criterion Collapse and Loss Distribution Control

Matthew J. Holland

Comments: Revised version accepted to ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[130] arXiv:2402.10043 [pdf, html, other]

Title: Negative impact of heavy-tailed uncertainty and error distributions on the reliability of calibration statistics for machine learning regression tasks

Pascal Pernot

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[131] arXiv:2402.10127 [pdf, other]

Title: Nonlinear spiked covariance matrices and signal propagation in deep neural networks

Zhichao Wang, Denny Wu, Zhou Fan

Comments: 55 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)

[132] arXiv:2402.10232 [pdf, other]

Title: Simple, unified analysis of Johnson-Lindenstrauss with applications

Yingru Li

Comments: 24 pages, presented at "High-dimensional Learning Dynamics 2024: The Emergence of Structure and Reasoning"

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Probability (math.PR)

[133] arXiv:2402.10289 [pdf, html, other]

Title: Thompson Sampling in Partially Observable Contextual Bandits

Hongju Park, Mohamad Kazem Shirani Faradonbeh

Comments: 43 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[134] arXiv:2402.10429 [pdf, html, other]

Title: Fixed Confidence Best Arm Identification in the Bayesian Setting

Kyoungseok Jang, Junpei Komiyama, Kazutoshi Yamazaki

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[135] arXiv:2402.10456 [pdf, html, other]

Title: Efficient Generative Modeling via Penalized Optimal Transport Network

Wenhui Sophia Lu, Chenyang Zhong, Wing Hung Wong

Comments: 54 pages, 12 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Methodology (stat.ME)

[136] arXiv:2402.10677 [pdf, other]

Title: Performance Gaps in Multi-view Clustering under the Nested Matrix-Tensor Model

Hugo Lebeau, Mohamed El Amine Seddik, José Henrique de Morais Goulart

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[137] arXiv:2402.10723 [pdf, other]

Title: Conformalized Credal Set Predictors

Alireza Javanmardi, David Stutz, Eyke Hüllermeier

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[138] arXiv:2402.10727 [pdf, html, other]

Title: From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimation

Nikita Kotelevskii, Vladimir Kondratyev, Martin Takáč, Éric Moulines, Maxim Panov

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[139] arXiv:2402.10758 [pdf, html, other]

Title: Stochastic Localization via Iterative Posterior Sampling

Louis Grenioux, Maxence Noble, Marylou Gabrié, Alain Oliviero Durmus

Comments: Accepted at ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[140] arXiv:2402.11156 [pdf, html, other]

Title: Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Bandits

Kyoungseok Jang, Chicheng Zhang, Kwang-Sung Jun

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[141] arXiv:2402.11228 [pdf, other]

Title: Adaptive Split Balancing for Optimal Random Forest

Yuqian Zhang, Weijie Ji, Jelena Bradic

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[142] arXiv:2402.11345 [pdf, html, other]

Title: Variational Entropy Search for Adjusting Expected Improvement

Nuojin Cheng, Stephen Becker

Comments: This is a preliminary technical report. For a more comprehensive study, please refer to arXiv:2501.18756

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[143] arXiv:2402.11552 [pdf, other]

Title: Empirical Density Estimation based on Spline Quasi-Interpolation with applications to Copulas clustering modeling

Cristiano Tamborrino, Antonella Falini, Francesca Mazzia

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[144] arXiv:2402.11705 [pdf, html, other]

Title: Learning Memory Kernels in Generalized Langevin Equations

Quanjun Lang, Jianfeng Lu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[145] arXiv:2402.11789 [pdf, html, other]

Title: Statistical Test on Diffusion Model-based Anomaly Detection by Selective Inference

Teruyuki Katsuoka, Tomohiro Shiraishi, Daiki Miwa, Vo Nguyen Le Duy, Ichiro Takeuchi

Comments: 30 pages, 7 figures

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[146] arXiv:2402.11858 [pdf, html, other]

Title: Stochastic Hessian Fittings with Lie Groups

Xi-Lin Li

Comments: 14 pages; 6 figures; 3 tables; code this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[147] arXiv:2402.12034 [pdf, other]

Title: When Do Off-Policy and On-Policy Policy Gradient Methods Align?

Davide Mambelli, Stephan Bongers, Onno Zoeter, Matthijs T.J. Spaan, Frans A. Oliehoek

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[148] arXiv:2402.12190 [pdf, html, other]

Title: Towards AI-Based Precision Oncology: A Machine Learning Framework for Personalized Counterfactual Treatment Suggestions based on Multi-Omics Data

Manuel Schürch, Laura Boos, Viola Heinzelmann-Schwarz, Gabriele Gut, Michael Krauthammer, Andreas Wicki, Tumor Profiler Consortium

Comments: arXiv admin comment: This version has been removed by arXiv administrators as the submitter did not have the rights to agree to the license at the time of submission

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

[149] arXiv:2402.12232 [pdf, other]

Title: Kernel KMeans clustering splits for end-to-end unsupervised decision trees

Louis Ohl, Pierre-Alexandre Mattei, Mickaël Leclercq, Arnaud Droit, Frédéric Precioso

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[150] arXiv:2402.12292 [pdf, html, other]

Title: Regularization by denoising: Bayesian model and Langevin-within-split Gibbs sampling

Elhadji C. Faye, Mame Diarra Fall, Nicolas Dobigeon

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)