Machine Learning

Authors and titles for December 2024

[51] arXiv:2412.08961 [pdf, html, other]

Title: Belted and Ensembled Neural Network for Linear and Nonlinear Sufficient Dimension Reduction

Yin Tang, Bing Li

Comments: 35 pages, 4 figures, 1 table

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[52] arXiv:2412.09164 [pdf, html, other]

Title: $(ε, δ)$-Differentially Private Partial Least Squares Regression

Ramin Nikzad-Langerodi, Mohit Kumar, Du Nguyen Duy, Mahtab Alghasi

Comments: 14 pages, 5 figure

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[53] arXiv:2412.09369 [pdf, html, other]

Title: Distribution free uncertainty quantification in neuroscience-inspired deep operators

Shailesh Garg, Souvik Chakraborty

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[54] arXiv:2412.09594 [pdf, html, other]

Title: Wait-Less Offline Tuning and Re-solving for Online Decision Making

Jingruo Sun, Wenzhi Gao, Ellen Vitercik, Yinyu Ye

Comments: In this version, we achieve a tighter regret bound with the warm start for the first batch. We also make the proof more elegant by manually accepting all subsequent orders once the constraint is violated. In this way, we do not need to introduce the concept of stopping time for the analysis of the LP-based method

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[55] arXiv:2412.09698 [pdf, html, other]

Title: Langevin Monte Carlo Beyond Lipschitz Gradient Continuity

Matej Benko, Iwona Chlebicka, Jørgen Endal, Błażej Miasojedow

Comments: To appear in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI-25)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[56] arXiv:2412.09712 [pdf, html, other]

Title: Investigating the Impact of Balancing, Filtering, and Complexity on Predictive Multiplicity: A Data-Centric Perspective

Mustafa Cavus, Przemyslaw Biecek

Comments: 38 pages, 7 figures

Journal-ref: Information Fusion (2025)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[57] arXiv:2412.09779 [pdf, html, other]

Title: A Statistical Analysis for Supervised Deep Learning with Exponential Families for Intrinsically Low-dimensional Data

Saptarshi Chakraborty, Peter L. Bartlett

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[58] arXiv:2412.10005 [pdf, html, other]

Title: Matrix Completion via Residual Spectral Matching

Ziyuan Chen, Fang Yao

Comments: 23 pages, 6 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[59] arXiv:2412.10948 [pdf, html, other]

Title: Generative Modeling with Diffusion

Justin Le

Comments: 17 pages with 6 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[60] arXiv:2412.11065 [pdf, html, other]

Title: Representation learning of dynamic networks

Haixu Wang, Jiguo Cao, Jian Pei

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[61] arXiv:2412.11211 [pdf, html, other]

Title: Deep Learning-based Approaches for State Space Models: A Selective Review

Jiahe Lin, George Michailidis

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Other Statistics (stat.OT)

[62] arXiv:2412.11257 [pdf, html, other]

Title: Prediction-Enhanced Monte Carlo: A Machine Learning View on Control Variate

Fengpei Li, Haoxian Chen, Jiahe Lin, Arkin Gupta, Xiaowei Tan, Honglei Zhao, Gang Xu, Yuriy Nevmyvaka, Agostino Capponi, Henry Lam

Subjects: Machine Learning (stat.ML); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG); Pricing of Securities (q-fin.PR)

[63] arXiv:2412.11308 [pdf, html, other]

Title: datadriftR: An R Package for Concept Drift Detection in Predictive Models

Ugur Dar, Mustafa Cavus

Comments: 37 pages, 6 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[64] arXiv:2412.11554 [pdf, html, other]

Title: Learning Massive-scale Partial Correlation Networks in Clinical Multi-omics Studies with HP-ACCORD

Sungdong Lee, Joshua Bang, Youngrae Kim, Hyungwon Choi, Sang-Yun Oh, Joong-Ho Won

Comments: 25 pages, 6 figures, preprint

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[65] arXiv:2412.11743 [pdf, html, other]

Title: Generalized Bayesian deep reinforcement learning

Shreya Sinha Roy, Richard G. Everitt, Christian P. Robert, Ritabrata Dutta

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[66] arXiv:2412.11744 [pdf, other]

Title: Conditional Diffusion Models Based Conditional Independence Testing

Yanfeng Yang, Shuai Li, Yingjie Zhang, Zhuoran Sun, Hai Shu, Ziqi Chen, Renming Zhang

Comments: 17 pages, 7 figures, aaai 2025

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[67] arXiv:2412.11875 [pdf, html, other]

Title: Bayesian Surrogate Training on Multiple Data Sources: A Hybrid Modeling Strategy

Philipp Reiser, Paul-Christian Bürkner, Anneli Guthke

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[68] arXiv:2412.11964 [pdf, html, other]

Title: BetaExplainer: A Probabilistic Method to Explain Graph Neural Networks

Whitney Sloneker, Shalin Patel, Michael Wang, Lorin Crawford, Ritambhara Singh

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[69] arXiv:2412.12014 [pdf, other]

Title: Generalization Analysis for Deep Contrastive Representation Learning

Nong Minh Hieu, Antoine Ledent, Yunwen Lei, Cheng Yeaw Ku

Comments: Accepted at AAAI 2025

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[70] arXiv:2412.12148 [pdf, html, other]

Title: How to Choose a Threshold for an Evaluation Metric for Large Language Models

Bhaskarjit Sarmah, Mingshu Li, Jingrao Lyu, Sebastian Frank, Nathalia Castellanos, Stefano Pasquali, Dhagash Mehta

Comments: 16 pages, 8 figures, 4 tables. 2-columns

Subjects: Machine Learning (stat.ML); Computation and Language (cs.CL); Machine Learning (cs.LG); Statistical Finance (q-fin.ST); Applications (stat.AP)

[71] arXiv:2412.12449 [pdf, html, other]

Title: Adversarially robust generalization theory via Jacobian regularization for deep neural networks

Dongya Wu, Xin Li

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[72] arXiv:2412.12910 [pdf, html, other]

Title: Sequential Harmful Shift Detection Without Labels

Salim I. Amoukou, Tom Bewley, Saumitra Mishra, Freddy Lecue, Daniele Magazzeni, Manuela Veloso

Comments: Accepted at the 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[73] arXiv:2412.12918 [pdf, html, other]

Title: BOIDS: High-dimensional Bayesian Optimization via Incumbent-guided Direction Lines and Subspace Embeddings

Lam Ngo, Huong Ha, Jeffrey Chan, Hongyu Zhang

Comments: Published at AAAI Conference on Artificial Intelligence, 2025

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[74] arXiv:2412.13158 [pdf, other]

Title: On Model Extrapolation in Marginal Shapley Values

Ilya Rozenfeld

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[75] arXiv:2412.13665 [pdf, html, other]

Title: Time-Reversible Bridges of Data with Machine Learning

Ludwig Winkler

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[76] arXiv:2412.13928 [pdf, html, other]

Title: Subspace Langevin Monte Carlo

Tyler Maunu, Jiayi Yao

Comments: 26 pages, 5 figures, 1 table

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[77] arXiv:2412.14132 [pdf, html, other]

Title: jinns: a JAX Library for Physics-Informed Neural Networks

Hugo Gangloff, Nicolas Jouvin

Comments: 12 pages, 1 figure

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[78] arXiv:2412.14315 [pdf, html, other]

Title: On the Robustness of Spectral Algorithms for Semirandom Stochastic Block Models

Aditya Bhaskara, Agastya Vibhuti Jha, Michael Kapralov, Naren Sarayu Manoj, Davide Mazzali, Weronika Wrzos-Kaminska

Comments: 45 pages. NeurIPS 2024

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[79] arXiv:2412.14527 [pdf, html, other]

Title: Statistical Undersampling with Mutual Information and Support Points

Alex Mak, Shubham Sahoo, Shivani Pandey, Yidan Yue, Linglong Kong

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[80] arXiv:2412.14916 [pdf, html, other]

Title: From Point to probabilistic gradient boosting for claim frequency and severity prediction

Dominik Chevalier, Marie-Pier Côté

Comments: 39 pages, 12 figures, 25 tables, 7 algorithms

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[81] arXiv:2412.15315 [pdf, html, other]

Title: Enhancing Masked Time-Series Modeling via Dropping Patches

Tianyu Qiu, Yi Xie, Yun Xiong, Hao Niu, Xiaofeng Gao

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[82] arXiv:2412.15808 [pdf, html, other]

Title: Deep learning joint extremes of metocean variables using the SPAR model

Ed Mackay, Callum Murphy-Barltrop, Jordan Richards, Philip Jonathan

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[83] arXiv:2412.15826 [pdf, html, other]

Title: Using matrix-product states for time-series machine learning

Joshua B. Moore, Hugo P. Stackhouse, Ben D. Fulcher, Sahand Mahmoodian

Comments: 31 pages, 14 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantum Physics (quant-ph)

[84] arXiv:2412.15861 [pdf, html, other]

Title: On Robust Cross Domain Alignment

Anish Chakrabarty, Arkaprabha Basu, Swagatam Das

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[85] arXiv:2412.16031 [pdf, html, other]

Title: Learning sparsity-promoting regularizers for linear inverse problems

Giovanni S. Alberti, Ernesto De Vito, Tapio Helin, Matti Lassas, Luca Ratti, Matteo Santacesaria

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[86] arXiv:2412.16457 [pdf, html, other]

Title: Robust random graph matching in Gaussian models via vector approximate message passing

Zhangsong Li

Comments: 41 pages; revised according to reviewer comments and changed the title; an extended abstract of this paper will be presented at COLT 2025

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)

[87] arXiv:2412.16773 [pdf, other]

Title: Fast Multi-Group Gaussian Process Factor Models

Evren Gokcen, Anna I. Jasper, Adam Kohn, Christian K. Machens, Byron M. Yu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP); Neurons and Cognition (q-bio.NC)

[88] arXiv:2412.16794 [pdf, other]

Title: Gradient-Based Non-Linear Inverse Learning

Abhishake, Nicole Mücke, Tapio Helin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[89] arXiv:2412.16899 [pdf, other]

Title: Integrating Random Effects in Variational Autoencoders for Dimensionality Reduction of Correlated Data

Giora Simchoni, Saharon Rosset

Comments: 30 pages, 5 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[90] arXiv:2412.17455 [pdf, html, other]

Title: Learning from Summarized Data: Gaussian Process Regression with Sample Quasi-Likelihood

Yuta Shikuri

Comments: 19 pages, 4 figures, 5 tables, AAAI2025

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[91] arXiv:2412.17505 [pdf, html, other]

Title: More is Less? A Simulation-Based Approach to Dynamic Interactions between Biases in Multimodal Models

Mounia Drissi

Comments: 9 pages, 3 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[92] arXiv:2412.17518 [pdf, other]

Title: Optimal Convergence Rates for Neural Operators

Mike Nguyen, Nicole Mücke

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[93] arXiv:2412.17547 [pdf, html, other]

Title: Probability-density-aware Semi-supervised Learning

Shuyang Liu, Ruiqiu Zheng, Yunhang Shen, Ke Li, Xing Sun, Zhou Yu, Shaohui Lin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[94] arXiv:2412.17753 [pdf, html, other]

Title: Minimax Optimal Simple Regret in Two-Armed Best-Arm Identification

Masahiro Kato

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM); Statistics Theory (math.ST); Applications (stat.AP)

[95] arXiv:2412.17916 [pdf, html, other]

Title: Data-Driven Priors in the Maximum Entropy on the Mean Method for Linear Inverse Problems

Matthew King-Roskamp, Rustum Choksi, Tim Hoheisel

Comments: 25 pages, 13 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[96] arXiv:2412.18041 [pdf, other]

Title: An information theoretic limit to data amplification

S. J. Watts, L. Crow

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); High Energy Physics - Experiment (hep-ex); Data Analysis, Statistics and Probability (physics.data-an)

[97] arXiv:2412.18081 [pdf, html, other]

Title: Heterogeneous transfer learning for high dimensional regression with feature mismatch

Jae Ho Chang, Massimiliano Russo, Subhadeep Paul

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[98] arXiv:2412.18247 [pdf, html, other]

Title: Fréchet regression with implicit denoising and multicollinearity reduction

Dou El Kefel Mansouri, Seif-Eddine Benkabou, Khalid Benabdeslem

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[99] arXiv:2412.18407 [pdf, html, other]

Title: A Statistical Framework for Ranking LLM-Based Chatbots

Siavash Ameli, Siyuan Zhuang, Ion Stoica, Michael W. Mahoney

Journal-ref: The Thirteenth International Conference on Learning Representations (2025)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[100] arXiv:2412.18432 [pdf, html, other]

Title: Gaussian entropic optimal transport: Schrödinger bridges and the Sinkhorn algorithm

O. Deniz Akyildiz, Pierre Del Moral, Joaquín Miguez

Comments: 80 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Computation (stat.CO)