Machine Learning

Authors and titles for June 2025

[151] arXiv:2506.18656 [pdf, other]

Title: A Random Matrix Analysis of In-context Memorization for Nonlinear Attention

Zhenyu Liao, Jiaqing Liu, TianQi Hou, Difan Zou, Zenan Ling

Comments: 40 pages, 7 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[152] arXiv:2506.18761 [pdf, html, other]

Title: Local Averaging Accurately Distills Manifold Structure From Noisy Data

Yihan Shen, Shiyu Wang, Arnaud Lamy, Mariam Avagyan, John Wright

Subjects: Machine Learning (stat.ML); Computational Geometry (cs.CG); Machine Learning (cs.LG)

[153] arXiv:2506.19010 [pdf, other]

Title: Simulation-Based Sensitivity Analysis in Optimal Treatment Regimes and Causal Decomposition with Individualized Interventions

Soojin Park, Suyeon Kang, Chioun Lee

Comments: 42 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[154] arXiv:2506.19031 [pdf, html, other]

Title: When Diffusion Models Memorize: Inductive Biases in Probability Flow of Minimum-Norm Shallow Neural Nets

Chen Zeno, Hila Manor, Greg Ongie, Nir Weinberger, Tomer Michaeli, Daniel Soudry

Comments: Accepted to the Forty-second International Conference on Machine Learning (ICML 2025)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[155] arXiv:2506.19144 [pdf, other]

Title: Posterior Contraction for Sparse Neural Networks in Besov Spaces with Intrinsic Dimensionality

Kyeongwon Lee, Lizhen Lin, Jaewoo Park, Seonghyun Jeong

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[156] arXiv:2506.19276 [pdf, html, other]

Title: Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDT

Mihailo Stojnic

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Theory (cs.IT); Machine Learning (cs.LG)

[157] arXiv:2506.19695 [pdf, html, other]

Title: Near-optimal estimates for the $\ell^p$-Lipschitz constants of deep random ReLU neural networks

Sjoerd Dirksen, Patrick Finke, Paul Geuchen, Dominik Stöger, Felix Voigtlaender

Comments: The introduction will still be expanded with additional references

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[158] arXiv:2506.19759 [pdf, html, other]

Title: The Shape of Consumer Behavior: A Symbolic and Topological Analysis of Time Series

Pola Bereta, Ioannis Diamantis

Comments: 33 pages, 30 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Applications (stat.AP)

[159] arXiv:2506.19837 [pdf, html, other]

Title: Convergence of Mean Shift Algorithms for Large Bandwidths and Simultaneous Accurate Clustering

Susovan Pal, Praneeth Vepakomma

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[160] arXiv:2506.19945 [pdf, html, other]

Title: Data-Driven Dynamic Factor Modeling via Manifold Learning

Graeme Baker, Agostino Capponi, J. Antonio Sidaoui

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[161] arXiv:2506.20048 [pdf, other]

Title: A Principled Path to Fitted Distributional Evaluation

Sungee Hong, Jiayi Wang, Zhengling Qi, Raymond Ka Wai Wong

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[162] arXiv:2506.20114 [pdf, html, other]

Title: Extracting Interpretable Models from Tree Ensembles: Computational and Statistical Perspectives

Brian Liu, Rahul Mazumder, Peter Radchenko

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[163] arXiv:2506.20173 [pdf, html, other]

Title: Valid Selection among Conformal Sets

Mahmoud Hegazy, Liviu Aolaritei, Michael I. Jordan, Aymeric Dieuleveut

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Methodology (stat.ME); Other Statistics (stat.OT)

[164] arXiv:2506.20406 [pdf, html, other]

Title: POLAR: A Pessimistic Model-based Policy Learning Algorithm for Dynamic Treatment Regimes

Ruijia Zhang, Zhengling Qi, Yue Wu, Xiangyu Zhang, Yanxun Xu

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Methodology (stat.ME)

[165] arXiv:2506.20425 [pdf, other]

Title: Scalable Subset Selection in Linear Mixed Models

Ryan Thompson, Matt P. Wand, Joanna J. J. Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[166] arXiv:2506.20533 [pdf, html, other]

Title: Global Convergence of Iteratively Reweighted Least Squares for Robust Subspace Recovery

Gilad Lerman, Kang Li, Tyler Maunu, Teng Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[167] arXiv:2506.20573 [pdf, html, other]

Title: LARP: Learner-Agnostic Robust Data Prefiltering

Kristian Minchev, Dimitar Iliev Dimitrov, Nikola Konstantinov

Comments: Presented at ICML 2025 Workshop on DataWorld: Unifying Data Curation Frameworks Across Domains

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[168] arXiv:2506.20672 [pdf, html, other]

Title: The final solution of the Hitchhiker's problem #5

Matjaž Omladič, Martin Vuk, Aljaž Zalar

Comments: 20 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST)

[169] arXiv:2506.20779 [pdf, html, other]

Title: Stable Minima of ReLU Neural Networks Suffer from the Curse of Dimensionality: The Neural Shattering Phenomenon

Tongtong Liang, Dan Qiao, Yu-Xiang Wang, Rahul Parhi

Comments: Comments Welcome!

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[170] arXiv:2506.20928 [pdf, html, other]

Title: Active Learning for Manifold Gaussian Process Regression

Yuanxing Cheng, Lulu Kang, Yiwei Wang, Chun Liu

Comments: 13 pages, 6 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[171] arXiv:2506.20933 [pdf, html, other]

Title: Lower Bounds on the Size of Markov Equivalence Classes

Erik Jahn, Frederick Eberhardt, Leonard J. Schulman

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[172] arXiv:2506.20935 [pdf, html, other]

Title: Forecasting Geopolitical Events with a Sparse Temporal Fusion Transformer and Gaussian Process Hybrid: A Case Study in Middle Eastern and U.S. Conflict Dynamics

Hsin-Hsiung Huang, Hayden Hampton

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Computation (stat.CO)

[173] arXiv:2506.21079 [pdf, other]

Title: Homogenization of Multi-agent Learning Dynamics in Finite-state Markov Games

Yann Kerzreho (ENS Paris Saclay)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[174] arXiv:2506.21278 [pdf, html, other]

Title: Hyperspherical Variational Autoencoders Using Efficient Spherical Cauchy Distribution

Lukas Sablica, Kurt Hornik

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Statistics Theory (math.ST)

[175] arXiv:2506.21460 [pdf, html, other]

Title: Wild refitting for black box prediction

Martin J. Wainwright

Comments: Minor revisions: fixed discussion, corrected spelling

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[176] arXiv:2506.21511 [pdf, html, other]

Title: Gaussian Invariant Markov Chain Monte Carlo

Michalis K. Titsias, Angelos Alexopoulos, Siran Liu, Petros Dellaportas

Comments: 29, 2 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[177] arXiv:2506.21739 [pdf, html, other]

Title: Modification of a Numerical Method Using FIR Filters in a Time-dependent SIR Model for COVID-19

Felipe Rogério Pimentel, Rafael Gustavo Alves

Comments: 14 pages, 3 figures, 3 tables, and 2 algorithms

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[178] arXiv:2506.21741 [pdf, html, other]

Title: Critically-Damped Higher-Order Langevin Dynamics

Benjamin Sterling, Chad Gueli, Mónica F. Bugallo

Comments: 12 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[179] arXiv:2506.21757 [pdf, html, other]

Title: TADA: Improved Diffusion Sampling with Training-free Augmented Dynamics

Tianrong Chen, Huangjie Zheng, David Berthelot, Jiatao Gu, Josh Susskind, Shuangfei Zhai

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[180] arXiv:2506.21802 [pdf, html, other]

Title: Classification with Reject Option: Distribution-free Error Guarantees via Conformal Prediction

Johan Hallberg Szabadváry, Tuwe Löfström, Ulf Johansson, Cecilia Sönströd, Ernst Ahlberg, Lars Carlsson

Comments: 20 pages, 3 figures

Journal-ref: Machine Learning with Applications Volume 20, June 2025, 100664

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[181] arXiv:2506.21894 [pdf, html, other]

Title: Thompson Sampling in Function Spaces via Neural Operators

Rafael Oliveira, Xuesong Wang, Kian Ming A. Chai, Edwin V. Bonilla

Comments: Under review

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[182] arXiv:2506.22204 [pdf, html, other]

Title: Hybrid Generative Modeling for Incomplete Physics: Deep Grey-Box Meets Optimal Transport

Gurjeet Sangra Singh, Maciej Falkiewicz, Alexandros Kalousis

Comments: Workshop paper at ICLR 2025 (XAI4Science Workshop)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[183] arXiv:2506.22228 [pdf, html, other]

Title: Uncovering smooth structures in single-cell data with PCS-guided neighbor embeddings

Rong Ma, Xi Li, Jingyuan Hu, Bin Yu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Genomics (q-bio.GN); Applications (stat.AP)

[184] arXiv:2506.22343 [pdf, html, other]

Title: Optimal Estimation of Watermark Proportions in Hybrid AI-Human Texts

Xiang Li, Garrett Wen, Weiqing He, Jiayuan Wu, Qi Long, Weijie J. Su

Subjects: Machine Learning (stat.ML); Computation and Language (cs.CL); Machine Learning (cs.LG); Methodology (stat.ME)

[185] arXiv:2506.22429 [pdf, other]

Title: Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks

David Holzmüller, Max Schölpple

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[186] arXiv:2506.22536 [pdf, html, other]

Title: Strategic A/B testing via Maximum Probability-driven Two-armed Bandit

Yu Zhang, Shanshan Zhao, Bokui Wan, Jinjuan Wang, Xiaodong Yan

Comments: 25 pages, 14 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[187] arXiv:2506.22565 [pdf, html, other]

Title: Adjoint Schrödinger Bridge Sampler

Guan-Horng Liu, Jaemoo Choi, Yongxin Chen, Benjamin Kurt Miller, Ricky T. Q. Chen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[188] arXiv:2506.22675 [pdf, html, other]

Title: Bayesian Invariance Modeling of Multi-Environment Data

Luhuan Wu, Mingzhang Yin, Yixin Wang, John P. Cunningham, David M. Blei

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[189] arXiv:2506.22963 [pdf, html, other]

Title: CN-SBM: Categorical Block Modelling For Primary and Residual Copy Number Variation

Kevin Lam, William Daniels, J Maxwell Douglas, Daniel Lai, Samuel Aparicio, Benjamin Bloem-Reddy, Yongjin Park

Comments: 8 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Genomics (q-bio.GN)

[190] arXiv:2506.23396 [pdf, html, other]

Title: AICO: Feature Significance Tests for Supervised Learning

Kay Giesecke, Enguerrand Horel, Chartsiri Jirachotkulthorn

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[191] arXiv:2506.23429 [pdf, html, other]

Title: DPOT: A DeepParticle method for Computation of Optimal Transport with convergence guarantee

Yingyuan Li, Aokun Wang, Zhongjian Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[192] arXiv:2506.23453 [pdf, html, other]

Title: Minimax Optimal Two-Stage Algorithm For Moment Estimation Under Covariate Shift

Zhen Zhang, Xin Liu, Shaoli Wang, Jiaye Teng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[193] arXiv:2506.23487 [pdf, html, other]

Title: Test of partial effects for Frechet regression on Bures-Wasserstein manifolds

Haoshu Xu, Hongzhe Li

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[194] arXiv:2506.00044 (cross-list from stat.AP) [pdf, html, other]

Title: Probabilistic intraday electricity price forecasting using generative machine learning

Jieyu Chen, Sebastian Lerch, Melanie Schienle, Tomasz Serafin, Rafał Weron

Subjects: Applications (stat.AP); Machine Learning (cs.LG); Machine Learning (stat.ML)

[195] arXiv:2506.00053 (cross-list from q-bio.QM) [pdf, other]

Title: Improving statistical learning methods via features selection without replacement sampling and random projection

Sulaiman khan, Muhammad Ahmad, Fida Ullah, Carlos Aguilar Ibañez, José Eduardo Valdez Rodriguez

Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)

[196] arXiv:2506.00057 (cross-list from cs.CY) [pdf, html, other]

Title: Hierarchical Bayesian Knowledge Tracing in Undergraduate Engineering Education

Yiwei Sun

Comments: 6 pages, 6 figures, 3 tables

Subjects: Computers and Society (cs.CY); Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)

[197] arXiv:2506.00077 (cross-list from cs.CL) [pdf, html, other]

Title: Gaussian mixture models as a proxy for interacting language models

Edward L. Wang, Tianyu Wang, Hayden Helm, Avanti Athreya, Vince Lyzinski, Carey E. Priebe

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[198] arXiv:2506.00102 (cross-list from hep-ph) [pdf, html, other]

Title: Tensor Network for Anomaly Detection in the Latent Space of Proton Collision Events at the LHC

Ema Puljak, Maurizio Pierini, Artur Garcia-Saez

Subjects: High Energy Physics - Phenomenology (hep-ph); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG); High Energy Physics - Experiment (hep-ex); Quantum Physics (quant-ph); Machine Learning (stat.ML)

[199] arXiv:2506.00135 (cross-list from cs.LG) [pdf, html, other]

Title: Tradeoffs between Mistakes and ERM Oracle Calls in Online and Transductive Online Learning

Idan Attias, Steve Hanneke, Arvind Ramaswami

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[200] arXiv:2506.00152 (cross-list from cs.LG) [pdf, html, other]

Title: Aligning Language Models with Observational Data: Opportunities and Risks from a Causal Perspective

Erfan Loghmani

Comments: 10+12 pages, 8 figures

Subjects: Machine Learning (cs.LG); Econometrics (econ.EM); Machine Learning (stat.ML)