Machine Learning

Authors and titles for February 2024

[101] arXiv:2402.07735 [pdf, other]

Title: Graph Structure Inference with BAM: Introducing the Bilinear Attention Mechanism

Philipp Froehlich, Heinz Koeppl

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[102] arXiv:2402.07762 [pdf, other]

Title: Scalable Structure Learning for Sparse Context-Specific Systems

Felix Leopoldo Rios, Alex Markham, Liam Solus

Comments: 34 pages, 6 figures; for associated code, see this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Combinatorics (math.CO)

[103] arXiv:2402.07802 [pdf, other]

Title: Towards a mathematical theory for consistency training in diffusion models

Gen Li, Zhihan Huang, Yuting Wei

Comments: The first two authors contributed equally

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[104] arXiv:2402.07868 [pdf, other]

Title: Nesting Particle Filters for Experimental Design in Dynamical Systems

Sahel Iqbal, Adrien Corenflos, Simo Särkkä, Hany Abdulsamad

Comments: Accepted to ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[105] arXiv:2402.08077 [pdf, html, other]

Title: Diffeomorphic Measure Matching with Kernels for Generative Modeling

Biraj Pandey, Bamdad Hosseini, Pau Batlle, Houman Owhadi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS); Computation (stat.CO)

[106] arXiv:2402.08082 [pdf, html, other]

Title: Score-based generative models break the curse of dimensionality in learning a family of sub-Gaussian probability distributions

Frank Cole, Yulong Lu

Comments: 33 pages, to appear in the proceedings of 12th International Conference on Learning Representations

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[107] arXiv:2402.08095 [pdf, html, other]

Title: Convergence Analysis of Discrete Diffusion Model: Exact Implementation through Uniformization

Hongrui Chen, Lexing Ying

Comments: 19 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[108] arXiv:2402.08164 [pdf, html, other]

Title: On Limitations of the Transformer Architecture

Binghui Peng, Srini Narayanan, Christos Papadimitriou

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[109] arXiv:2402.08201 [pdf, other]

Title: Off-Policy Evaluation in Markov Decision Processes under Weak Distributional Overlap

Mohammad Mehrabi, Stefan Wager

Comments: 50 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[110] arXiv:2402.08344 [pdf, other]

Title: Implicit Bias in Noisy-SGD: With Applications to Differentially Private Training

Tom Sander, Maxime Sylvestre, Alain Durmus

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[111] arXiv:2402.08412 [pdf, other]

Title: Interacting Particle Systems on Networks: joint inference of the network and the interaction kernel

Quanjun Lang, Xiong Wang, Fei Lu, Mauro Maggioni

Comments: 53 pages, 17 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS); Statistics Theory (math.ST)

[112] arXiv:2402.08425 [pdf, other]

Title: Transfer Operators from Batches of Unpaired Points via Entropic Transport Kernels

Florian Beier, Hancheng Bi, Clément Sarrazin, Bernhard Schmitzer, Gabriele Steidl

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS)

[113] arXiv:2402.08508 [pdf, other]

Title: A PAC-Bayesian Link Between Generalisation and Flat Minima

Maxime Haddouche, Paul Viallard, Umut Simsekli, Benjamin Guedj

Comments: Published at International Conference on Algorithmic Learning Theory 2025

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[114] arXiv:2402.08616 [pdf, other]

Title: Adjustment Identification Distance: A gadjid for Causal Structure Learning

Leonard Henckel, Theo Würtzen, Sebastian Weichwald

Comments: accepted at UAI 2024 (Conference on Uncertainty in Artificial Intelligence)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[115] arXiv:2402.08711 [pdf, html, other]

Title: Correction to "Wasserstein distance estimates for the distributions of numerical approximations to ergodic stochastic differential equations"

Daniel Paulin, Peter A. Whalley

Comments: 9 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA); Probability (math.PR)

[116] arXiv:2402.08818 [pdf, html, other]

Title: Corridor Geometry in Gradient-Based Optimization

Benoit Dherin, Mihaela Rosca

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[117] arXiv:2402.08847 [pdf, html, other]

Title: Space-Time Diffusion Bridge

Hamidreza Behjoo, Michael Chertkov

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[118] arXiv:2402.08991 [pdf, html, other]

Title: Towards Robust Model-Based Reinforcement Learning Against Adversarial Corruption

Chenlu Ye, Jiafan He, Quanquan Gu, Tong Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[119] arXiv:2402.09018 [pdf, other]

Title: Neural Operators Meet Energy-based Theory: Operator Learning for Hamiltonian and Dissipative PDEs

Yusuke Tanaka, Takaharu Yaguchi, Tomoharu Iwata, Naonori Ueda

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[120] arXiv:2402.09122 [pdf, html, other]

Title: Weighted-Sum of Gaussian Process Latent Variable Models

James Odgers, Ruby Sedgwick, Chrysoula Kappatou, Ruth Misener, Sarah Filippi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[121] arXiv:2402.09328 [pdf, other]

Title: Connecting Algorithmic Fairness to Quality Dimensions in Machine Learning in Official Statistics and Survey Production

Patrick Oliver Schenk, Christoph Kern

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[122] arXiv:2402.09467 [pdf, html, other]

Title: Optimal Thresholding Linear Bandit

Eduardo Ochoa Rivera, Ambuj Tewari

Comments: arXiv admin note: substantial text overlap with arXiv:2006.16073 by other authors

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[123] arXiv:2402.09483 [pdf, html, other]

Title: Oracle-Efficient Differentially Private Learning with Public Data

Adam Block, Mark Bun, Rathin Desai, Abhishek Shetty, Steven Wu

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[124] arXiv:2402.09598 [pdf, html, other]

Title: MCMC-driven learning

Alexandre Bouchard-Côté, Trevor Campbell, Geoff Pleiss, Nikola Surjanovic

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Computation (stat.CO)

[125] arXiv:2402.09623 [pdf, html, other]

Title: Conformalized Adaptive Forecasting of Heterogeneous Trajectories

Yanfei Zhou, Lars Lindemann, Matteo Sesia

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[126] arXiv:2402.09723 [pdf, html, other]

Title: Efficient Prompt Optimization Through the Lens of Best Arm Identification

Chengshuai Shi, Kun Yang, Zihan Chen, Jundong Li, Jing Yang, Cong Shen

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[127] arXiv:2402.09754 [pdf, other]

Title: Robust SVD Made Easy: A fast and reliable algorithm for large-scale data analysis

Sangil Han, Kyoowon Kim, Sungkyu Jung

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[128] arXiv:2402.09796 [pdf, other]

Title: Closed-form Filtering for Non-linear Systems

Théophile Cantelobre, Carlo Ciliberto, Benjamin Guedj, Alessandro Rudi

Comments: 38 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Robotics (cs.RO)

[129] arXiv:2402.09802 [pdf, html, other]

Title: Criterion Collapse and Loss Distribution Control

Matthew J. Holland

Comments: Revised version accepted to ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[130] arXiv:2402.10043 [pdf, html, other]

Title: Negative impact of heavy-tailed uncertainty and error distributions on the reliability of calibration statistics for machine learning regression tasks

Pascal Pernot

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[131] arXiv:2402.10127 [pdf, other]

Title: Nonlinear spiked covariance matrices and signal propagation in deep neural networks

Zhichao Wang, Denny Wu, Zhou Fan

Comments: 55 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)

[132] arXiv:2402.10232 [pdf, other]

Title: Simple, unified analysis of Johnson-Lindenstrauss with applications

Yingru Li

Comments: 24 pages, presented at "High-dimensional Learning Dynamics 2024: The Emergence of Structure and Reasoning"

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Probability (math.PR)

[133] arXiv:2402.10289 [pdf, html, other]

Title: Thompson Sampling in Partially Observable Contextual Bandits

Hongju Park, Mohamad Kazem Shirani Faradonbeh

Comments: 43 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[134] arXiv:2402.10429 [pdf, html, other]

Title: Fixed Confidence Best Arm Identification in the Bayesian Setting

Kyoungseok Jang, Junpei Komiyama, Kazutoshi Yamazaki

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[135] arXiv:2402.10456 [pdf, html, other]

Title: Efficient Generative Modeling via Penalized Optimal Transport Network

Wenhui Sophia Lu, Chenyang Zhong, Wing Hung Wong

Comments: 54 pages, 12 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Methodology (stat.ME)

[136] arXiv:2402.10677 [pdf, other]

Title: Performance Gaps in Multi-view Clustering under the Nested Matrix-Tensor Model

Hugo Lebeau, Mohamed El Amine Seddik, José Henrique de Morais Goulart

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[137] arXiv:2402.10723 [pdf, other]

Title: Conformalized Credal Set Predictors

Alireza Javanmardi, David Stutz, Eyke Hüllermeier

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[138] arXiv:2402.10727 [pdf, html, other]

Title: From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimation

Nikita Kotelevskii, Vladimir Kondratyev, Martin Takáč, Éric Moulines, Maxim Panov

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[139] arXiv:2402.10758 [pdf, html, other]

Title: Stochastic Localization via Iterative Posterior Sampling

Louis Grenioux, Maxence Noble, Marylou Gabrié, Alain Oliviero Durmus

Comments: Accepted at ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[140] arXiv:2402.11156 [pdf, html, other]

Title: Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Bandits

Kyoungseok Jang, Chicheng Zhang, Kwang-Sung Jun

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[141] arXiv:2402.11228 [pdf, other]

Title: Adaptive Split Balancing for Optimal Random Forest

Yuqian Zhang, Weijie Ji, Jelena Bradic

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[142] arXiv:2402.11345 [pdf, html, other]

Title: Variational Entropy Search for Adjusting Expected Improvement

Nuojin Cheng, Stephen Becker

Comments: This is a preliminary technical report. For a more comprehensive study, please refer to arXiv:2501.18756

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[143] arXiv:2402.11552 [pdf, other]

Title: Empirical Density Estimation based on Spline Quasi-Interpolation with applications to Copulas clustering modeling

Cristiano Tamborrino, Antonella Falini, Francesca Mazzia

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[144] arXiv:2402.11705 [pdf, html, other]

Title: Learning Memory Kernels in Generalized Langevin Equations

Quanjun Lang, Jianfeng Lu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[145] arXiv:2402.11789 [pdf, html, other]

Title: Statistical Test on Diffusion Model-based Anomaly Detection by Selective Inference

Teruyuki Katsuoka, Tomohiro Shiraishi, Daiki Miwa, Vo Nguyen Le Duy, Ichiro Takeuchi

Comments: 30 pages, 7 figures

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[146] arXiv:2402.11858 [pdf, html, other]

Title: Stochastic Hessian Fittings with Lie Groups

Xi-Lin Li

Comments: 14 pages; 6 figures; 3 tables; code this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[147] arXiv:2402.12034 [pdf, other]

Title: When Do Off-Policy and On-Policy Policy Gradient Methods Align?

Davide Mambelli, Stephan Bongers, Onno Zoeter, Matthijs T.J. Spaan, Frans A. Oliehoek

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[148] arXiv:2402.12190 [pdf, html, other]

Title: Towards AI-Based Precision Oncology: A Machine Learning Framework for Personalized Counterfactual Treatment Suggestions based on Multi-Omics Data

Manuel Schürch, Laura Boos, Viola Heinzelmann-Schwarz, Gabriele Gut, Michael Krauthammer, Andreas Wicki, Tumor Profiler Consortium

Comments: arXiv admin comment: This version has been removed by arXiv administrators as the submitter did not have the rights to agree to the license at the time of submission

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

[149] arXiv:2402.12232 [pdf, other]

Title: Kernel KMeans clustering splits for end-to-end unsupervised decision trees

Louis Ohl, Pierre-Alexandre Mattei, Mickaël Leclercq, Arnaud Droit, Frédéric Precioso

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[150] arXiv:2402.12292 [pdf, html, other]

Title: Regularization by denoising: Bayesian model and Langevin-within-split Gibbs sampling

Elhadji C. Faye, Mame Diarra Fall, Nicolas Dobigeon

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[151] arXiv:2402.12302 [pdf, html, other]

Title: Asymptotic Gaussian Fluctuations of Eigenvectors in Spectral Clustering

Hugo Lebeau, Florent Chatelain, Romain Couillet

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[152] arXiv:2402.12397 [pdf, html, other]

Title: Multi-class Temporal Logic Neural Networks

Danyang Li, Roberto Tron

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[153] arXiv:2402.12630 [pdf, html, other]

Title: FAST: An Optimization Framework for Fast Additive Segmentation in Transparent ML

Brian Liu, Rahul Mazumder

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[154] arXiv:2402.12668 [pdf, html, other]

Title: Randomization Can Reduce Both Bias and Variance: A Case Study in Random Forests

Brian Liu, Rahul Mazumder

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[155] arXiv:2402.12762 [pdf, html, other]

Title: Learning under Singularity: An Information Criterion improving WBIC and sBIC

Lirui Liu, Joe Suzuki

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[156] arXiv:2402.12828 [pdf, html, other]

Title: SGD with Clipping is Secretly Estimating the Median Gradient

Fabian Schaipp, Guillaume Garrigos, Umut Simsekli, Robert Gower

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[157] arXiv:2402.12885 [pdf, html, other]

Title: A Bound on the Maximal Marginal Degrees of Freedom

Paul Dommel

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[158] arXiv:2402.13079 [pdf, other]

Title: Mode Estimation with Partial Feedback

Charles Arnal, Vivien Cabannes, Vianney Perchet

Subjects: Machine Learning (stat.ML); Information Retrieval (cs.IR); Information Theory (cs.IT); Machine Learning (cs.LG)

[159] arXiv:2402.13106 [pdf, other]

Title: On Generalization Bounds for Deep Compound Gaussian Neural Networks

Carter Lyons, Raghu G. Raj, Margaret Cheney

Comments: 14 pages, 1 figure

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[160] arXiv:2402.13285 [pdf, html, other]

Title: Leveraging PAC-Bayes Theory and Gibbs Distributions for Generalization Bounds with Complexity Measures

Paul Viallard, Rémi Emonet, Amaury Habrard, Emilie Morvant, Valentina Zantedeschi

Comments: AISTATS 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[161] arXiv:2402.13400 [pdf, html, other]

Title: The Dimension of Self-Directed Learning

Pramith Devulapalli, Steve Hanneke

Comments: ALT 2024 Camera ready version

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[162] arXiv:2402.13622 [pdf, other]

Title: Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression

Lucas Clarté, Adrien Vandenbroucque, Guillaume Dalle, Bruno Loureiro, Florent Krzakala, Lenka Zdeborová

Journal-ref: Proceedings of the Fortieth Conference on Uncertainty in Artificial Intelligence, PMLR 244:787-819, 2024

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[163] arXiv:2402.13646 [pdf, other]

Title: A Large Dimensional Analysis of Multi-task Semi-Supervised Learning

Victor Leger, Romain Couillet

Comments: 13 pages, 9 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[164] arXiv:2402.13945 [pdf, html, other]

Title: Probabilistic Neural Networks (PNNs) for Modeling Aleatoric Uncertainty in Scientific Machine Learning

Farhad Pourkamali-Anaraki, Jamal F. Husseini, Scott E. Stapleton

Comments: 9 figures

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[165] arXiv:2402.13999 [pdf, html, other]

Title: Asymptotics of Learning with Deep Structured (Random) Features

Dominik Schröder, Daniil Dmitriev, Hugo Cui, Bruno Loureiro

Comments: ICML camera-ready version

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Statistics Theory (math.ST)

[166] arXiv:2402.14145 [pdf, html, other]

Title: Multiply Robust Estimation for Local Distribution Shifts with Multiple Domains

Steven Wilkins-Reeves, Xu Chen, Qi Ma, Christine Agarwal, Aude Hofleitner

Comments: 9 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[167] arXiv:2402.14264 [pdf, html, other]

Title: Structure-agnostic Optimality of Doubly Robust Learning for Treatment Effect Estimation

Jikai Jin, Vasilis Syrgkanis

Comments: 31 pages, to appear in COLT 2025

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM); Statistics Theory (math.ST); Methodology (stat.ME)

[168] arXiv:2402.14578 [pdf, html, other]

Title: Multivariate Online Linear Regression for Hierarchical Forecasting

Massil Hihat, Guillaume Garrigos, Adeline Fermanian, Simon Bussy

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[169] arXiv:2402.14684 [pdf, html, other]

Title: Adaptive time series forecasting with markovian variance switching

Baptiste Abélès, Joseph de Vilmarest, Olivier Wintemberger

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[170] arXiv:2402.14758 [pdf, html, other]

Title: Batch and match: black-box variational inference with a score-based divergence

Diana Cai, Chirag Modi, Loucas Pillaud-Vivien, Charles C. Margossian, Robert M. Gower, David M. Blei, Lawrence K. Saul

Comments: 49 pages, 14 figures. To appear in the Proceedings of the 41st International Conference on Machine Learning (ICML), 2024

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Computation (stat.CO)

[171] arXiv:2402.14777 [pdf, other]

Title: Causal Imputation for Counterfactual SCMs: Bridging Graphs and Latent Factor Models

Alvaro Ribot, Chandler Squires, Caroline Uhler

Comments: 35 pages, 17 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[172] arXiv:2402.14951 [pdf, html, other]

Title: In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization

Ruiqi Zhang, Jingfeng Wu, Peter L. Bartlett

Comments: 39 pages

Subjects: Machine Learning (stat.ML); Computation and Language (cs.CL); Machine Learning (cs.LG)

[173] arXiv:2402.14966 [pdf, html, other]

Title: Smoothness Adaptive Hypothesis Transfer Learning

Haotian Lin, Matthew Reimherr

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[174] arXiv:2402.14987 [pdf, html, other]

Title: On the Performance of Empirical Risk Minimization with Smoothed Data

Adam Block, Alexander Rakhlin, Abhishek Shetty

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[175] arXiv:2402.15053 [pdf, html, other]

Title: Nonlinear Bayesian optimal experimental design using logarithmic Sobolev inequalities

Fengyi Li, Ayoub Belhadji, Youssef Marzouk

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[176] arXiv:2402.15115 [pdf, html, other]

Title: Physics-constrained polynomial chaos expansion for scientific machine learning and uncertainty quantification

Himanshu Sharma, Lukáš Novák, Michael D. Shields

Comments: 34 pages, 15 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)

[177] arXiv:2402.15213 [pdf, html, other]

Title: Statistical Agnostic Regression: a machine learning method to validate regression models

Juan M Gorriz, J. Ramirez, F. Segovia, F. J. Martinez-Murcia, C. Jiménez-Mesa, J. Suckling

Comments: 23 pages, 18 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Computation (stat.CO)

[178] arXiv:2402.15285 [pdf, other]

Title: Generative Modelling with Tensor Train approximations of Hamilton--Jacobi--Bellman equations

David Sommer, Robert Gruhlke, Max Kirstein, Martin Eigel, Claudia Schillings

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[179] arXiv:2402.15344 [pdf, html, other]

Title: Iteration and Stochastic First-order Oracle Complexities of Stochastic Gradient Descent using Constant and Decaying Learning Rates

Kento Imaizumi, Hideaki Iiduka

Comments: The latest version was updated on Feb. 23. arXiv admin note: text overlap with arXiv:2307.13831

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[180] arXiv:2402.15365 [pdf, html, other]

Title: Efficient semi-supervised inference for logistic regression under case-control studies

Zhuojun Quan, Yuanyuan Lin, Kani Chen, Wen Yu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[181] arXiv:2402.15409 [pdf, html, other]

Title: Lasso with Latents: Efficient Estimation, Covariate Rescaling, and Computational-Statistical Gaps

Jonathan Kelner, Frederic Koehler, Raghu Meka, Dhruv Rohatgi

Subjects: Machine Learning (stat.ML); Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST)

[182] arXiv:2402.15625 [pdf, html, other]

Title: Learning Cyclic Causal Models from Incomplete Data

Muralikrishnna G. Sethuraman, Faramarz Fekri

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[183] arXiv:2402.15718 [pdf, html, other]

Title: Optimal Rates and Saturation for Noiseless Kernel Ridge Regression

Jihao Long, Xiaojun Peng, Lei Wu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[184] arXiv:2402.16059 [pdf, html, other]

Title: Gradient-enhanced deep Gaussian processes for multifidelity modelling

Viv Bone, Chris van der Heide, Kieran Mackle, Ingo H.J. Jahn, Peter M. Dower, Chris Manzie

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[185] arXiv:2402.16158 [pdf, html, other]

Title: Distribution-Free Fair Federated Learning with Small Samples

Qichuan Yin, Zexian Wang, Junzhou Huang, Huaxiu Yao, Linjun Zhang

Subjects: Machine Learning (stat.ML); Computers and Society (cs.CY); Machine Learning (cs.LG)

[186] arXiv:2402.16326 [pdf, html, other]

Title: A Provably Accurate Randomized Sampling Algorithm for Logistic Regression

Agniva Chowdhury, Pradeep Ramuhalli

Comments: Published in the proceedings of AAAI 2024

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG)

[187] arXiv:2402.16388 [pdf, html, other]

Title: Leave-One-Out-, Bootstrap- and Cross-Conformal Anomaly Detectors

Oliver Hennhöfer, Christine Preisach

Comments: Published in 2024 IEEE International Conference on Knowledge Graph (ICKG)

Journal-ref: Proc. 2024 IEEE ICKG 15(1): 110-119 (February 2025)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[188] arXiv:2402.16408 [pdf, html, other]

Title: Stable Training of Normalizing Flows for High-dimensional Variational Inference

Daniel Andrade

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[189] arXiv:2402.16661 [pdf, html, other]

Title: Penalized Generative Variable Selection

Tong Wang, Jian Huang, Shuangge Ma

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[190] arXiv:2402.16688 [pdf, other]

Title: On the connection between Noise-Contrastive Estimation and Contrastive Divergence

Amanda Olmin, Jakob Lindqvist, Lennart Svensson, Fredrik Lindsten

Comments: Accepted to AISTATS 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[191] arXiv:2402.16712 [pdf, other]

Title: l1-norm regularized l1-norm best-fit lines

Xiao Ling, Paul Brooks

Comments: 10 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[192] arXiv:2402.16792 [pdf, other]

Title: Rate-Optimal Rank Aggregation with Private Pairwise Rankings

Shirong Xu, Will Wei Sun, Guang Cheng

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[193] arXiv:2402.16811 [pdf, html, other]

Title: Stopping Bayesian Optimization with Probabilistic Regret Bounds

James T. Wilson

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[194] arXiv:2402.16991 [pdf, html, other]

Title: A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Data

Antonio Sclocchi, Alessandro Favero, Matthieu Wyart

Comments: 9 pages, 7 figures. Appendix: 11 pages, 9 figures

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[195] arXiv:2402.17036 [pdf, html, other]

Title: Iterated INLA for State and Parameter Estimation in Nonlinear Dynamical Systems

Rafael Anderka, Marc Peter Deisenroth, So Takao

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[196] arXiv:2402.17087 [pdf, html, other]

Title: A Note on Bayesian Networks with Latent Root Variables

Marco Zaffalon, Alessandro Antonucci

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[197] arXiv:2402.17089 [pdf, other]

Title: Learnability of high-dimensional targets by two-parameter models and gradient flow

Dmitry Yarotsky

Comments: Camera-ready NeurIPS 2024 version; some extra comments and figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[198] arXiv:2402.17106 [pdf, other]

Title: Achievable Fairness on Your Data With Utility Guarantees

Muhammad Faaiz Taufiq, Jean-Francois Ton, Yang Liu

Subjects: Machine Learning (stat.ML); Computers and Society (cs.CY); Machine Learning (cs.LG)

[199] arXiv:2402.17886 [pdf, html, other]

Title: Zeroth-Order Sampling Methods for Non-Log-Concave Distributions: Alleviating Metastability by Denoising Diffusion

Ye He, Kevin Rojas, Molei Tao

Comments: updated related works and experiments

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST); Methodology (stat.ME)

[200] arXiv:2402.17926 [pdf, html, other]

Title: Certain and Approximately Certain Models for Statistical Learning

Cheng Zhen, Nischal Aryal, Arash Termehchy, Alireza Aghasi, Amandeep Singh Chabada

Comments: A technical report for a paper to appear at SIGMOD 2024

Subjects: Machine Learning (stat.ML); Databases (cs.DB); Machine Learning (cs.LG)