Machine Learning

Authors and titles for December 2024

[1] arXiv:2412.00343 [pdf, html, other]

Title: Nonlinearity and Uncertainty Informed Moment-Matching Gaussian Mixture Splitting

Jackson Kulik, Keith A. LeGrand

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[2] arXiv:2412.00545 [pdf, html, other]

Title: Optimal Particle-based Approximation of Discrete Distributions (OPAD)

Hadi Mohasel Afshar, Gilad Francis, Sally Cripps

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[3] arXiv:2412.00864 [pdf, html, other]

Title: Explicit and data-Efficient Encoding via Gradient Flow

Kyriakos Flouris, Anna Volokitin, Gustav Bredell, Ender Konukoglu

Comments: Machine Learning and the Physical Sciences Workshop, NeurIPS 2024. arXiv admin note: text overlap with arXiv:2105.05031

Journal-ref: NeurIPS 2024 Machine Learning and the Physical Sciences

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Optimization and Control (math.OC); Computational Physics (physics.comp-ph)

[4] arXiv:2412.01010 [pdf, html, other]

Title: A Note on Estimation Error Bound and Grouping Effect of Transfer Elastic Net

Yui Tomo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[5] arXiv:2412.01019 [pdf, html, other]

Title: Energy-Based Modelling for Discrete and Mixed Data via Heat Equations on Structured Spaces

Tobias Schröder, Zijing Ou, Yingzhen Li, Andrew B. Duncan

Comments: To appear in the proceedings of NeurIPS 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[6] arXiv:2412.01021 [pdf, other]

Title: On the Feature Learning in Diffusion Models

Andi Han, Wei Huang, Yuan Cao, Difan Zou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[7] arXiv:2412.01098 [pdf, html, other]

Title: Spatial Conformal Inference through Localized Quantile Regression

Hanyang Jiang, Yao Xie

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[8] arXiv:2412.01120 [pdf, html, other]

Title: Reliable and scalable variable importance estimation via warm-start and early stopping

Zexuan Sun, Garvesh Raskutti

Comments: Preliminary version accepted in AISTATS, 2025

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[9] arXiv:2412.01212 [pdf, html, other]

Title: First numerical observation of the Berezinskii-Kosterlitz-Thouless transition in language models

Yuma Toji, Jun Takahashi, Vwani Roychowdhury, Hideyuki Miyahara

Subjects: Machine Learning (stat.ML); Statistical Mechanics (cond-mat.stat-mech); Computation and Language (cs.CL); Machine Learning (cs.LG)

[10] arXiv:2412.01389 [pdf, other]

Title: Refined Analysis of Federated Averaging's Bias and Federated Richardson-Romberg Extrapolation

Paul Mangold, Alain Durmus, Aymeric Dieuleveut, Sergey Samsonov, Eric Moulines

Comments: 37 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[11] arXiv:2412.02090 [pdf, html, other]

Title: MEP-Net: Generating Solutions to Scientific Problems with Limited Knowledge by Maximum Entropy Principle

Wuyue Yang, Liangrong Peng, Guojie Li, Liu Hong

Comments: 35 pages, 6 figures, 2 tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)

[12] arXiv:2412.02251 [pdf, html, other]

Title: Selective Reviews of Bandit Problems in AI via a Statistical View

Pengjie Zhou, Haoyu Wei, Huiming Zhang

Comments: 52 pages, 5 figures

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Econometrics (econ.EM); Probability (math.PR)

[13] arXiv:2412.02292 [pdf, other]

Title: Deep Matrix Factorization with Adaptive Weights for Multi-View Clustering

Yasser Khalafaoui (Alteca), Basarab Matei, Martino Lovisetto (Alteca), Nistor Grozavu (CY)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[14] arXiv:2412.02670 [pdf, html, other]

Title: The Broader Landscape of Robustness in Algorithmic Statistics

Gautam Kamath

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Statistics Theory (math.ST)

[15] arXiv:2412.02810 [pdf, other]

Title: Universal Rates of Empirical Risk Minimization

Steve Hanneke, Mingyue Xu

Comments: This paper has been accepted to the 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[16] arXiv:2412.02861 [pdf, html, other]

Title: An Information-Theoretic Analysis of Thompson Sampling for Logistic Bandits

Amaury Gouverneur, Borja Rodríguez-Gálvez, Tobias J. Oechtering, Mikael Skoglund

Comments: 21 pages, under review

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[17] arXiv:2412.02988 [pdf, html, other]

Title: Preference-based Pure Exploration

Apurv Shukla, Debabrota Basu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[18] arXiv:2412.03134 [pdf, html, other]

Title: Generalized Diffusion Model with Adjusted Offset Noise

Takuro Kutsuna

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[19] arXiv:2412.03271 [pdf, html, other]

Title: Nonparametric Filtering, Estimation and Classification using Neural Jump ODEs

Jakob Heiss, Florian Krach, Thorsten Schmidt, Félix B. Tambe-Ndonfack

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC); Probability (math.PR)

[20] arXiv:2412.03486 [pdf, html, other]

Title: Tight PAC-Bayesian Risk Certificates for Contrastive Learning

Anna Van Elst, Debarghya Ghoshdastidar

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[21] arXiv:2412.03491 [pdf, html, other]

Title: Beyond algorithm hyperparameters: on preprocessing hyperparameters and associated pitfalls in machine learning applications

Christina Sauer, Anne-Laure Boulesteix, Luzia Hanßum, Farina Hodiamont, Claudia Bausewein, Theresa Ullmann

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[22] arXiv:2412.03506 [pdf, html, other]

Title: Self-test loss functions for learning weak-form operators and gradient flows

Yuan Gao, Quanjun Lang, Fei Lu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[23] arXiv:2412.03702 [pdf, html, other]

Title: Asymptotics of Linear Regression with Linearly Dependent Data

Behrad Moniri, Hamed Hassani

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Systems and Control (eess.SY)

[24] arXiv:2412.03768 [pdf, html, other]

Title: Learning Networks from Wide-Sense Stationary Stochastic Processes

Anirudh Rayas, Jiajun Cheng, Rajasekhar Anguluri, Deepjyoti Deka, Gautam Dasarathy

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[25] arXiv:2412.03780 [pdf, other]

Title: Community Detection with Heterogeneous Block Covariance Model

Xiang Li, Yunpeng Zhao, Qing Pan, Ning Hao

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[26] arXiv:2412.03992 [pdf, html, other]

Title: How well behaved is finite dimensional Diffusion Maps?

Wenyu Bo, Marina Meilă (Department of Statistics University of Washington Seattle, WA)

Comments: 33 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[27] arXiv:2412.04047 [pdf, html, other]

Title: Pathwise optimization for bridge-type estimators and its applications

Alessandro De Gregorio, Francesco Iafrate

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Computation (stat.CO)

[28] arXiv:2412.05135 [pdf, html, other]

Title: The Polynomial Stein Discrepancy for Assessing Moment Convergence

Narayan Srinivasan, Matthew Sutton, Christopher Drovandi, Leah F South

Comments: 17 Pages, 14 Figs

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[29] arXiv:2412.05506 [pdf, other]

Title: Confidence Diagram of Nonparametric Ranking for Uncertainty Assessment in Large Language Models Evaluation

Zebin Wang, Yi Han, Ethan X. Fang, Lan Wang, Junwei Lu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[30] arXiv:2412.05723 [pdf, html, other]

Title: Training-Free Bayesianization for Low-Rank Adapters of Large Language Models

Haizhou Shi, Yibin Wang, Ligong Han, Huan Zhang, Hao Wang

Comments: Pre-print; Accepted (non-archivally) at ICLR'25 Workshop: "Quantify Uncertainty and Hallucination in Foundation Models: The Next Frontier in Reliable AI"

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[31] arXiv:2412.05726 [pdf, html, other]

Title: Proximal Iteration for Nonlinear Adaptive Lasso

Nathan Wycoff, Lisa O. Singh, Ali Arab, Katharine M. Donato

Comments: Some of these results were previously presented in the Technical Report at arXiv:2211.05089

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[32] arXiv:2412.05759 [pdf, html, other]

Title: Leveraging Black-box Models to Assess Feature Importance in Unconditional Distribution

Jing Zhou, Chunlin Li

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[33] arXiv:2412.05906 [pdf, html, other]

Title: Reinforcement Learning for a Discrete-Time Linear-Quadratic Control Problem with an Application

Lucky Li

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[34] arXiv:2412.06033 [pdf, html, other]

Title: Can Generative AI Solve Your In-Context Learning Problem? A Martingale Perspective

Andrew Jesson, Nicolas Beltran-Velez, David Blei

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[35] arXiv:2412.06158 [pdf, html, other]

Title: Is the neural tangent kernel of PINNs deep learning general partial differential equations always convergent ?

Zijian Zhou, Zhenya Yan

Comments: 18 pages, 5 figures

Journal-ref: Physica D: Nonlinear Phenomena 457 (2024) 133987

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Mathematical Physics (math-ph); Pattern Formation and Solitons (nlin.PS); Computational Physics (physics.comp-ph)

[36] arXiv:2412.06233 [pdf, html, other]

Title: Representational Transfer Learning for Matrix Completion

Yong He, Zeyu Li, Dong Liu, Kangxiang Qin, Jiahui Xie

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[37] arXiv:2412.06478 [pdf, html, other]

Title: An inferential measure of dependence between two systems using Bayesian model comparison

Guillaume Marrelec, Alain Giron

Comments: To be published in IEEE Transaction on Systems, Man, and Cybernetics: Systems

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

[38] arXiv:2412.07041 [pdf, html, other]

Title: Generalized Least Squares Kernelized Tensor Factorization

Mengying Lei, Lijun Sun

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[39] arXiv:2412.07057 [pdf, html, other]

Title: A Note on Sample Complexity of Interactive Imitation Learning with Log Loss

Yichen Li, Chicheng Zhang

Comments: 18 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[40] arXiv:2412.07081 [pdf, html, other]

Title: Sequential Controlled Langevin Diffusions

Junhua Chen, Lorenz Richter, Julius Berner, Denis Blessing, Gerhard Neumann, Anima Anandkumar

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[41] arXiv:2412.07242 [pdf, html, other]

Title: Optimization Can Learn Johnson Lindenstrauss Embeddings

Nikos Tsikouras, Constantine Caramanis, Christos Tzamos

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[42] arXiv:2412.07265 [pdf, html, other]

Title: Modeling High-Resolution Spatio-Temporal Wind with Deep Echo State Networks and Stochastic Partial Differential Equations

Kesen Wang, Minwoo Kim, Stefano Castruccio, Marc G. Genton

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[43] arXiv:2412.07469 [pdf, html, other]

Title: Score-matching-based Structure Learning for Temporal Data on Networks

Hao Chen, Kai Yi, Lin Liu, Yu Guang Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[44] arXiv:2412.07488 [pdf, html, other]

Title: Dual Random Fields and their Application to Mineral Potential Mapping

Álvaro I. Riquelme

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP)

[45] arXiv:2412.07763 [pdf, html, other]

Title: Bayesian Optimization of Antibodies Informed by a Generative Model of Evolving Sequences

Alan Nawzad Amin, Nate Gruver, Yilun Kuang, Lily Li, Hunter Elliott, Calvin McCarter, Aniruddh Raghu, Peyton Greenside, Andrew Gordon Wilson

Comments: Code available at this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Biomolecules (q-bio.BM)

[46] arXiv:2412.07877 [pdf, html, other]

Title: Score-Optimal Diffusion Schedules

Christopher Williams, Andrew Campbell, Arnaud Doucet, Saifuddin Syed

Comments: NeurIPS 2024 accepted paper

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[47] arXiv:2412.07902 [pdf, html, other]

Title: Low-Rank Correction for Quantized LLMs

Meyer Scetbon, James Hensman

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[48] arXiv:2412.08060 [pdf, html, other]

Title: An Optimistic Algorithm for Online Convex Optimization with Adversarial Constraints

Jordan Lekeufack, Michael I. Jordan

Comments: 18 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[49] arXiv:2412.08661 [pdf, other]

Title: GeoConformal prediction: a model-agnostic framework of measuring the uncertainty of spatial prediction

Xiayin Lou, Peng Luo, Liqiu Meng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an); Applications (stat.AP)

[50] arXiv:2412.08843 [pdf, html, other]

Title: Precise Asymptotics and Refined Regret of Variance-Aware UCB

Yingying Fan, Yuxuan Han, Jinchi Lv, Xiaocong Xu, Zhengyuan Zhou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)