Machine Learning

Authors and titles for December 2024

[201] arXiv:2412.05343 (cross-list from eess.IV) [pdf, html, other]

Title: Equivariant Denoisers for Image Restoration

Marien Renaud, Arthur Leclaire, Nicolas Papadakis

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[202] arXiv:2412.05390 (cross-list from cs.LG) [pdf, html, other]

Title: Tabular data generation with tensor contraction layers and transformers

Aníbal Silva, André Restivo, Moisés Santos, Carlos Soares

Comments: 28 pages, 9 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[203] arXiv:2412.05418 (cross-list from cs.LG) [pdf, html, other]

Title: No Free Lunch From Random Feature Ensembles

Benjamin S. Ruben, William L. Tong, Hamza Tahir Chaudhry, Cengiz Pehlevan

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (stat.ML)

[204] arXiv:2412.05421 (cross-list from cs.LG) [pdf, html, other]

Title: KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction

Zhenkai Qin, Baozhong Wei, Caifeng Gao, Jianyuan Ni

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[205] arXiv:2412.05439 (cross-list from cond-mat.dis-nn) [pdf, html, other]

Title: Statistical Mechanics of Support Vector Regression

Abdulkadir Canatar, SueYeon Chung

Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Neurons and Cognition (q-bio.NC); Machine Learning (stat.ML)

[206] arXiv:2412.05481 (cross-list from cs.AI) [pdf, html, other]

Title: A Compositional Atlas for Algebraic Circuits

Benjie Wang, Denis Deratani Mauá, Guy Van den Broeck, YooJung Choi

Comments: NeurIPS 2024

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Logic in Computer Science (cs.LO); Machine Learning (stat.ML)

[207] arXiv:2412.05534 (cross-list from cs.LG) [pdf, html, other]

Title: Memory-enhanced Invariant Prompt Learning for Urban Flow Prediction under Distribution Shifts

Haiyang Jiang, Tong Chen, Wentao Zhang, Nguyen Quoc Viet Hung, Yuan Yuan, Yong Li, Lizhen Cui

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[208] arXiv:2412.05590 (cross-list from cs.LG) [pdf, html, other]

Title: Active Sequential Posterior Estimation for Sample-Efficient Simulation-Based Inference

Sam Griesemer, Defu Cao, Zijun Cui, Carolina Osorio, Yan Liu

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[209] arXiv:2412.05669 (cross-list from cs.LG) [pdf, html, other]

Title: Detecting outliers by clustering algorithms

Qi Li, Shuliang Wang

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[210] arXiv:2412.05674 (cross-list from quant-ph) [pdf, html, other]

Title: No-Free-Lunch Theories for Tensor-Network Machine Learning Models

Jing-Chuan Wu, Qi Ye, Dong-Ling Deng, Li-Wei Yu

Comments: 7+23 pages, comments welcome

Subjects: Quantum Physics (quant-ph); Artificial Intelligence (cs.AI); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[211] arXiv:2412.05783 (cross-list from cs.LG) [pdf, html, other]

Title: Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning

Shuguang Yu, Shuxing Fang, Ruixin Peng, Zhengling Qi, Fan Zhou, Chengchun Shi

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[212] arXiv:2412.05788 (cross-list from q-bio.BM) [pdf, other]

Title: On Diffusion Posterior Sampling via Sequential Monte Carlo for Zero-Shot Scaffolding of Protein Motifs

James Matthew Young, O. Deniz Akyildiz

Subjects: Biomolecules (q-bio.BM); Machine Learning (cs.LG); Machine Learning (stat.ML)

[213] arXiv:2412.06020 (cross-list from stat.ME) [pdf, html, other]

Title: New Additive OCBA Procedures for Robust Ranking and Selection

Yuchen Wan, Zaile Li, L. Jeff Hong

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[214] arXiv:2412.06063 (cross-list from cs.LG) [pdf, html, other]

Title: On Socially Fair Low-Rank Approximation and Column Subset Selection

Zhao Song, Ali Vakilian, David P. Woodruff, Samson Zhou

Comments: NeurIPS 2024

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[215] arXiv:2412.06070 (cross-list from math.OC) [pdf, html, other]

Title: Stochastic Gradient Descent Revisited

Azar Louzi

Comments: 45 pages

Subjects: Optimization and Control (math.OC); Probability (math.PR); Machine Learning (stat.ML)

[216] arXiv:2412.06126 (cross-list from math.ST) [pdf, html, other]

Title: UCB algorithms for multi-armed bandits: Precise regret and adaptive inference

Qiyang Han, Koulik Khamaru, Cun-Hui Zhang

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[217] arXiv:2412.06160 (cross-list from cs.LG) [pdf, html, other]

Title: Obstacle-aware Gaussian Process Regression

Gaurav Shrivastava

Subjects: Machine Learning (cs.LG); Probability (math.PR); Machine Learning (stat.ML)

[218] arXiv:2412.06165 (cross-list from cs.LG) [pdf, html, other]

Title: Conservative Contextual Bandits: Beyond Linear Representations

Rohan Deb, Mohammad Ghavamzadeh, Arindam Banerjee

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[219] arXiv:2412.06168 (cross-list from cs.LG) [pdf, html, other]

Title: Out-of-Distribution Detection with Overlap Index

Hao Fu, Prashanth Krishnamurthy, Siddharth Garg, Farshad Khorrami

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[220] arXiv:2412.06173 (cross-list from cs.LG) [pdf, html, other]

Title: Revisiting the Necessity of Graph Learning and Common Graph Benchmarks

Isay Katsman, Ethan Lou, Anna Gilbert

Comments: Preprint

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[221] arXiv:2412.06368 (cross-list from cs.LG) [pdf, html, other]

Title: Measuring Pre-training Data Quality without Labels for Time Series Foundation Models

Songkang Wen, Vasilii Feofanov, Jianfeng Zhang

Journal-ref: NeurIPS 2024 Workshop on Time Series in the Age of Large Models

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[222] arXiv:2412.06381 (cross-list from cs.LG) [pdf, other]

Title: Gentle Local Robustness implies Generalization

Khoat Than, Dat Phan, Giang Vu

Comments: To appear in Machine Learning journal

Journal-ref: Mach Learn 114, 142 (2025)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[223] arXiv:2412.06410 (cross-list from cs.LG) [pdf, html, other]

Title: BatchTopK Sparse Autoencoders

Bart Bussmann, Patrick Leask, Neel Nanda

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[224] arXiv:2412.06438 (cross-list from cs.LG) [pdf, html, other]

Title: Can foundation models actively gather information in interactive environments to test hypotheses?

Nan Rosemary Ke, Danny P. Sawyer, Hubert Soyer, Martin Engelcke, David P Reichert, Drew A. Hudson, John Reid, Alexander Lerchner, Danilo Jimenez Rezende, Timothy P Lillicrap, Michael Mozer, Jane X Wang

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[225] arXiv:2412.06538 (cross-list from cs.LG) [pdf, html, other]

Title: Understanding Factual Recall in Transformers via Associative Memories

Eshaan Nichani, Jason D. Lee, Alberto Bietti

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Information Theory (cs.IT); Machine Learning (stat.ML)

[226] arXiv:2412.06540 (cross-list from cs.LG) [pdf, html, other]

Title: Sloth: scaling laws for LLM skills to predict multi-benchmark performance across families

Felipe Maia Polo, Seamus Somerstep, Leshem Choshen, Yuekai Sun, Mikhail Yurochkin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[227] arXiv:2412.06604 (cross-list from cs.LG) [pdf, html, other]

Title: VOPy: A Framework for Black-box Vector Optimization

Yaşar Cahit Yıldırım, Efe Mert Karagözlü, İlter Onat Korkmaz, Çağın Ararat, Cem Tekin

Subjects: Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)

[228] arXiv:2412.06629 (cross-list from stat.CO) [pdf, html, other]

Title: PolytopeWalk: Sparse MCMC Sampling over Polytopes

Benny Sun, Yuansi Chen

Comments: 17 pages

Subjects: Computation (stat.CO); Machine Learning (cs.LG); Machine Learning (stat.ML)

[229] arXiv:2412.06655 (cross-list from cs.LG) [pdf, html, other]

Title: Off-Policy Maximum Entropy RL with Future State and Action Visitation Measures

Adrien Bolland, Gaspard Lambrechts, Damien Ernst

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[230] arXiv:2412.06711 (cross-list from cs.LG) [pdf, html, other]

Title: MISFEAT: Feature Selection for Subgroups with Systematic Missing Data

Bar Genossar, Thinh On, Md. Mouinul Islam, Ben Eliav, Senjuti Basu Roy, Avigdor Gal

Subjects: Machine Learning (cs.LG); Databases (cs.DB); Machine Learning (stat.ML)

[231] arXiv:2412.06810 (cross-list from cs.AI) [pdf, html, other]

Title: I See, Therefore I Do: Estimating Causal Effects for Image Treatments

Abhinav Thorat, Ravi Kolla, Niranjan Pedanekar

Comments: 8 Pages

Subjects: Artificial Intelligence (cs.AI); Applications (stat.AP); Machine Learning (stat.ML)

[232] arXiv:2412.06829 (cross-list from cs.LG) [pdf, html, other]

Title: Stably unactivated neurons in ReLU neural networks

Natalie Brownlowe, Christopher R. Cornwell, Ethan Montes, Gabriel Quijano, Grace Stulman, Na Zhang

Subjects: Machine Learning (cs.LG); Probability (math.PR); Machine Learning (stat.ML)

[233] arXiv:2412.06870 (cross-list from stat.ME) [pdf, html, other]

Title: Variable Selection for Comparing High-dimensional Time-Series Data

Kensuke Mitsuzawa, Margherita Grossi, Stefano Bortoli, Motonobu Kanagawa

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[234] arXiv:2412.07075 (cross-list from math.OC) [pdf, html, other]

Title: Conformal Uncertainty Quantification of Electricity Price Predictions for Risk-Averse Storage Arbitrage

Saud Alghumayjan, Ming Yi, Bolun Xu

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[235] arXiv:2412.07106 (cross-list from cs.LG) [pdf, other]

Title: Covered Forest: Fine-grained generalization analysis of graph neural networks

Antonis Vasileiou, Ben Finkelshtein, Floris Geerts, Ron Levie, Christopher Morris

Subjects: Machine Learning (cs.LG); Discrete Mathematics (cs.DM); Data Structures and Algorithms (cs.DS); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[236] arXiv:2412.07120 (cross-list from cs.GT) [pdf, html, other]

Title: Corrupted Learning Dynamics in Games

Taira Tsuchiya, Shinji Ito, Haipeng Luo

Comments: 42 pages, Added regret lower bounds and extended the analysis to account for corruption in observed utilities

Subjects: Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[237] arXiv:2412.07169 (cross-list from cs.LG) [pdf, html, other]

Title: Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimation

Tal Zeevi, Ravid Shwartz-Ziv, Yann LeCun, Lawrence H. Staib, John A. Onofrey

Comments: Accepted to the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2025. Code available at: this https URL

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[238] arXiv:2412.07193 (cross-list from cs.LG) [pdf, html, other]

Title: Epidemiological Model Calibration via Graybox Bayesian Optimization

Puhua Niu, Byung-Jun Yoon, Xiaoning Qian

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[239] arXiv:2412.07299 (cross-list from cond-mat.soft) [pdf, other]

Title: Bidirectional Mamba state-space model for anomalous diffusion

Maxime Lavaud (LOMA), Yosef Shokeeb (LOMA), Juliette Lacherez (LOMA), Yacine Amarouchene (LOMA), Thomas Salez (LOMA)

Subjects: Soft Condensed Matter (cond-mat.soft); Biological Physics (physics.bio-ph); Optics (physics.optics); Machine Learning (stat.ML)

[240] arXiv:2412.07306 (cross-list from math.OC) [pdf, other]

Title: Gearing Gaussian process modeling and sequential design towards stochastic simulators

Mickael Binois (ACUMES), Arindam Fadikar (ANL), Abby Stevens (ANL)

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[241] arXiv:2412.07312 (cross-list from cs.LG) [pdf, html, other]

Title: High-dimensional classification problems with Barron regular boundaries under margin conditions

Jonathan García, Philipp Petersen

Subjects: Machine Learning (cs.LG); Probability (math.PR); Machine Learning (stat.ML)

[242] arXiv:2412.07378 (cross-list from cs.SI) [pdf, html, other]

Title: A Spectral Framework for Tracking Communities in Evolving Networks

Jacob Hume, Laura Balzano

Comments: 34 pages, 13 figures

Subjects: Social and Information Networks (cs.SI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[243] arXiv:2412.07446 (cross-list from cs.AI) [pdf, html, other]

Title: A Causal World Model Underlying Next Token Prediction: Exploring GPT in a Controlled Environment

Raanan Y. Rohekar, Yaniv Gurwicz, Sungduk Yu, Estelle Aflalo, Vasudev Lal

Comments: International Conference on Machine Learning (ICML), 2025

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[244] arXiv:2412.07544 (cross-list from cs.LG) [pdf, html, other]

Title: Contractive Dynamical Imitation Policies for Efficient Out-of-Sample Recovery

Amin Abyaneh, Mahrokh G. Boroujeni, Hsiu-Chin Lin, Giancarlo Ferrari-Trecate

Comments: International Conference on Learning Representations

Subjects: Machine Learning (cs.LG); Robotics (cs.RO); Machine Learning (stat.ML)

[245] arXiv:2412.07586 (cross-list from cs.LG) [pdf, html, other]

Title: Paired Wasserstein Autoencoders for Conditional Sampling

Moritz Piening, Matthias Chung

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[246] arXiv:2412.07611 (cross-list from stat.ME) [pdf, html, other]

Title: Deep Partially Linear Transformation Model for Right-Censored Survival Data

Junkai Yin, Yue Zhang, Zhangsheng Yu

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[247] arXiv:2412.07643 (cross-list from math.PR) [pdf, other]

Title: Ballistic Convergence in Hit-and-Run Monte Carlo and a Coordinate-free Randomized Kaczmarz Algorithm

Nawaf Bou-Rabee, Andreas Eberle, Stefan Oberdörster

Comments: 28 pages

Subjects: Probability (math.PR); Statistics Theory (math.ST); Machine Learning (stat.ML)

[248] arXiv:2412.07684 (cross-list from cs.LG) [pdf, html, other]

Title: The Pitfalls of Memorization: When Memorization Hurts Generalization

Reza Bayat, Mohammad Pezeshki, Elvis Dohmatob, David Lopez-Paz, Pascal Vincent

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[249] arXiv:2412.07687 (cross-list from cs.LG) [pdf, other]

Title: Privacy-Preserving Customer Support: A Framework for Secure and Scalable Interactions

Anant Prakash Awasthi, Girdhar Gopal Agarwal, Chandraketu Singh, Rakshit Varma, Sanchit Sharma

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Applications (stat.AP); Methodology (stat.ME); Machine Learning (stat.ML)

[250] arXiv:2412.07728 (cross-list from math.AP) [pdf, html, other]

Title: Solving the Poisson Equation with Dirichlet data by shallow ReLU$^α$-networks: A regularity and approximation perspective

Malhar Vaishampayan, Stephan Wojtowytsch

Subjects: Analysis of PDEs (math.AP); Machine Learning (stat.ML)

[251] arXiv:2412.07905 (cross-list from stat.ME) [pdf, html, other]

Title: Spectral Differential Network Analysis for High-Dimensional Time Series

Michael Hellstern, Byol Kim, Zaid Harchaoui, Ali Shojaie

Comments: 23 pages, 13 figures, AISTATS 2025

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[252] arXiv:2412.07971 (cross-list from cs.LG) [pdf, html, other]

Title: Distributed Gradient Descent with Many Local Steps in Overparameterized Models

Heng Zhu, Harsh Vardhan, Arya Mazumdar

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[253] arXiv:2412.07972 (cross-list from cs.LG) [pdf, html, other]

Title: Phase-aware Training Schedule Simplifies Learning in Flow-Based Generative Models

Santiago Aranguri, Francesco Insulla

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[254] arXiv:2412.07987 (cross-list from stat.ME) [pdf, html, other]

Title: Hypothesis Testing for High-Dimensional Matrix-Valued Data

Shijie Cui, Danning Li, Runze Li, Lingzhou Xue

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[255] arXiv:2412.07999 (cross-list from math.ST) [pdf, html, other]

Title: Fast Mixing of Data Augmentation Algorithms: Bayesian Probit, Logit, and Lasso Regression

Holden Lee, Kexin Zhang

Comments: 47 pages, 7 figures; added simulations

Subjects: Statistics Theory (math.ST); Probability (math.PR); Machine Learning (stat.ML)

[256] arXiv:2412.08012 (cross-list from cs.LG) [pdf, html, other]

Title: Of Dice and Games: A Theory of Generalized Boosting

Marco Bressan, Nataly Brukhim, Nicolò Cesa-Bianchi, Emmanuel Esposito, Yishay Mansour, Shay Moran, Maximilian Thiessen

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[257] arXiv:2412.08016 (cross-list from cs.LG) [pdf, html, other]

Title: GLL: A Differentiable Graph Learning Layer for Neural Networks

Jason Brown, Bohan Chen, Harris Hardiman-Mostow, Jeff Calder, Andrea L. Bertozzi

Comments: 44 pages, 11 figures. Preprint. Submitted to the Journal of Machine Learning Research

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[258] arXiv:2412.08025 (cross-list from math.OC) [pdf, html, other]

Title: Criteria and Bias of Parameterized Linear Regression under Edge of Stability Regime

Peiyuan Zhang, Amin Karbasi

Comments: 31 pages, 9 figures

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[259] arXiv:2412.08051 (cross-list from stat.ME) [pdf, html, other]

Title: Two-way Node Popularity Model for Directed and Bipartite Networks

Bing-Yi Jing, Ting Li, Jiangzhou Wang, Ya Wang

Subjects: Methodology (stat.ME); Social and Information Networks (cs.SI); Statistics Theory (math.ST); Computation (stat.CO); Machine Learning (stat.ML)

[260] arXiv:2412.08052 (cross-list from cs.LG) [pdf, other]

Title: CANDOR: Counterfactual ANnotated DOubly Robust Off-Policy Evaluation

Aishwarya Mandyam, Shengpu Tang, Jiayu Yao, Jenna Wiens, Barbara E. Engelhardt

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[261] arXiv:2412.08064 (cross-list from math.ST) [pdf, html, other]

Title: Statistical Convergence Rates of Optimal Transport Map Estimation between General Distributions

Yizhe Ding, Runze Li, Lingzhou Xue

Comments: 44 pages, 8 figures

Subjects: Statistics Theory (math.ST); Probability (math.PR); Methodology (stat.ME); Machine Learning (stat.ML)

[262] arXiv:2412.08088 (cross-list from stat.ME) [pdf, html, other]

Title: Dynamic Classification of Latent Disease Progression with Auxiliary Surrogate Labels

Zexi Cai, Donglin Zeng, Karen S. Marder, Lawrence S. Honig, Yuanjia Wang

Subjects: Methodology (stat.ME); Applications (stat.AP); Machine Learning (stat.ML)

[263] arXiv:2412.08114 (cross-list from cs.LG) [pdf, html, other]

Title: Modeling Latent Non-Linear Dynamical System over Time Series

Ren Fujiwara, Yasuko Matsubara, Yasushi Sakurai

Comments: Accepted by AAAI'25

Journal-ref: The Thirty-Ninth AAAI Conference on Artificial Intelligence (AAAI-25), 2025

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[264] arXiv:2412.08147 (cross-list from cs.LG) [pdf, html, other]

Title: How to Weight Multitask Finetuning? Fast Previews via Bayesian Model-Merging

Hugo Monzón Maldonado, Thomas Möllenhoff, Nico Daheim, Iryna Gurevych, Mohammad Emtiyaz Khan

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[265] arXiv:2412.08310 (cross-list from cs.LG) [pdf, html, other]

Title: Edge-Splitting MLP: Node Classification on Homophilic and Heterophilic Graphs without Message Passing

Matthias Kohn, Marcel Hoffmann, Ansgar Scherp

Comments: Published at Learning on Graphs, 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[266] arXiv:2412.08435 (cross-list from cs.LG) [pdf, html, other]

Title: Proactive Model Adaptation Against Concept Drift for Online Time Series Forecasting

Lifan Zhao, Yanyan Shen

Comments: Accepted by KDD 2025. This version fixed typos in Eq. (3)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (stat.ML)

[267] arXiv:2412.08453 (cross-list from math.FA) [pdf, html, other]

Title: On best approximation by multivariate ridge functions with applications to generalized translation networks

Paul Geuchen, Palina Salanevich, Olov Schavemaker, Felix Voigtlaender

Subjects: Functional Analysis (math.FA); Machine Learning (cs.LG); Machine Learning (stat.ML)

[268] arXiv:2412.08579 (cross-list from math.NA) [pdf, html, other]

Title: Sparse Signature Coefficient Recovery via Kernels

Daniil Shmelev, Cristopher Salvi

Subjects: Numerical Analysis (math.NA); Machine Learning (stat.ML)

[269] arXiv:2412.08604 (cross-list from cs.IR) [pdf, other]

Title: Preference Discerning with LLM-Enhanced Generative Retrieval

Fabian Paischer, Liu Yang, Linfeng Liu, Shuai Shao, Kaveh Hassani, Jiacheng Li, Ricky Chen, Zhang Gabriel Li, Xialo Gao, Wei Shao, Xue Feng, Nima Noorshams, Sem Park, Bo Long, Hamid Eghbalzadeh

Comments: 11 pages + references and appendix

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[270] arXiv:2412.08731 (cross-list from cs.LG) [pdf, other]

Title: From MLP to NeoMLP: Leveraging Self-Attention for Neural Fields

Miltiadis Kofinas, Samuele Papa, Efstratios Gavves

Comments: Preprint. Source code: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[271] arXiv:2412.08772 (cross-list from math.OC) [pdf, html, other]

Title: On improving generalization in a class of learning problems with the method of small parameters for weakly-controlled optimal gradient systems

Getachew K. Befekadu

Comments: 9 pages, 3 figures, 3 tables

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[272] arXiv:2412.08776 (cross-list from cs.LG) [pdf, html, other]

Title: Bayesian optimized deep ensemble for uncertainty quantification of deep neural networks: a system safety case study on sodium fast reactor thermal stratification modeling

Zaid Abulawi, Rui Hu, Prasanna Balaprakash, Yang Liu

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[273] arXiv:2412.08794 (cross-list from cs.LG) [pdf, html, other]

Title: Latent Safety-Constrained Policy Approach for Safe Offline Reinforcement Learning

Prajwal Koirala, Zhanhong Jiang, Soumik Sarkar, Cody Fleming

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[274] arXiv:2412.08824 (cross-list from cs.LG) [pdf, html, other]

Title: Disentangling impact of capacity, objective, batchsize, estimators, and step-size on flow VI

Abhinav Agrawal, Justin Domke

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[275] arXiv:2412.08951 (cross-list from cs.LG) [pdf, html, other]

Title: Posterior Approximation using Stochastic Gradient Ascent with Adaptive Stepsize

Kart-Leong Lim, Xudong Jiang

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[276] arXiv:2412.09053 (cross-list from cs.LG) [pdf, html, other]

Title: Safe Active Learning for Gaussian Differential Equations

Leon Glass, Katharina Ensinger, Christoph Zimmer

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[277] arXiv:2412.09068 (cross-list from cs.IT) [pdf, html, other]

Title: MIMO Detection via Gaussian Mixture Expectation Propagation: A Bayesian Machine Learning Approach for High-Order High-Dimensional MIMO Systems

Shachar Shayovitz, Doron Ezri, Yoav Levinbook

Subjects: Information Theory (cs.IT); Machine Learning (stat.ML)

[278] arXiv:2412.09080 (cross-list from math.ST) [pdf, html, other]

Title: On the number of modes of Gaussian kernel density estimators

Borjan Geshkovski, Philippe Rigollet, Yihang Sun

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[279] arXiv:2412.09235 (cross-list from math.PR) [pdf, html, other]

Title: A semiconcavity approach to stability of entropic plans and exponential convergence of Sinkhorn's algorithm

Alberto Chiarini, Giovanni Conforti, Giacomo Greco, Luca Tamanini

Comments: 32 pages

Subjects: Probability (math.PR); Optimization and Control (math.OC); Machine Learning (stat.ML)

[280] arXiv:2412.09250 (cross-list from cs.LG) [pdf, html, other]

Title: GeLoRA: Geometric Adaptive Ranks For Efficient LoRA Fine-tuning

Abdessalam Ed-dib, Zhanibek Datbayev, Amine Mohamed Aboussalah

Subjects: Machine Learning (cs.LG); Geometric Topology (math.GT); Machine Learning (stat.ML)

[281] arXiv:2412.09265 (cross-list from cs.RO) [pdf, html, other]

Title: Score and Distribution Matching Policy: Advanced Accelerated Visuomotor Policies via Matched Distillation

Bofang Jia, Pengxiang Ding, Can Cui, Mingyang Sun, Pengfang Qian, Siteng Huang, Zhaoxin Fan, Donglin Wang

Subjects: Robotics (cs.RO); Machine Learning (cs.LG); Machine Learning (stat.ML)

[282] arXiv:2412.09477 (cross-list from cs.LG) [pdf, html, other]

Title: Bayesian Optimization via Continual Variational Last Layer Training

Paul Brunzema, Mikkel Jordahn, John Willes, Sebastian Trimpe, Jasper Snoek, James Harrison

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[283] arXiv:2412.09498 (cross-list from math.ST) [pdf, other]

Title: Gradient descent inference in empirical risk minimization

Qiyang Han, Xiaocong Xu

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Optimization and Control (math.OC); Methodology (stat.ME); Machine Learning (stat.ML)

[284] arXiv:2412.09538 (cross-list from cs.LG) [pdf, html, other]

Title: Capturing the Temporal Dependence of Training Data Influence

Jiachen T. Wang, Dawn Song, James Zou, Prateek Mittal, Ruoxi Jia

Comments: Correspondence to Jiachen T. Wang and Ruoxi Jia

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[285] arXiv:2412.09544 (cross-list from cs.LG) [pdf, html, other]

Title: Sail into the Headwind: Alignment via Robust Rewards and Dynamic Labels against Reward Hacking

Paria Rashidinejad, Yuandong Tian

Comments: 46 pages, 3 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Statistics Theory (math.ST); Machine Learning (stat.ML)

[286] arXiv:2412.09556 (cross-list from math.OC) [pdf, html, other]

Title: Enhancing Convergence of Decentralized Gradient Tracking under the KL Property

Xiaokai Chen, Tianyu Cao, Gesualdo Scutari

Comments: 25 pages, 4 figures

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Systems and Control (eess.SY); Machine Learning (stat.ML)

[287] arXiv:2412.09687 (cross-list from cs.LG) [pdf, html, other]

Title: DQA: An Efficient Method for Deep Quantization of Deep Neural Network Activations

Wenhao Hu, Paul Henderson, José Cano

Comments: Accepted to Second Workshop on Machine Learning with New Compute Paradigms at NeurIPS 2024 (MLNCP 2024)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[288] arXiv:2412.09752 (cross-list from cs.LG) [pdf, html, other]

Title: A Quasilinear Algorithm for Computing Higher-Order Derivatives of Deep Feed-Forward Neural Networks

Kyle R. Chickering

Comments: 11 pages, 10 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[289] arXiv:2412.09843 (cross-list from cs.LG) [pdf, html, other]

Title: Learning Structural Causal Models from Ordering: Identifiable Flow Models

Minh Khoa Le, Kien Do, Truyen Tran

Comments: Accepted at AAAI 2025

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[290] arXiv:2412.09964 (cross-list from physics.data-an) [pdf, html, other]

Title: Assessing high-order effects in feature importance via predictability decomposition

Marlis Ontivero-Ortega, Luca Faes, Jesus M Cortes, Daniele Marinazzo, Sebastiano Stramaglia

Comments: 11 pages, 3 figures

Journal-ref: Phys. Rev. E 111, L033301 (2025)

Subjects: Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[291] arXiv:2412.10009 (cross-list from cs.LG) [pdf, html, other]

Title: Class flipping for uplift modeling and Heterogeneous Treatment Effect estimation on imbalanced RCT data

Krzysztof Rudaś, Szymon Jaroszewicz

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[292] arXiv:2412.10039 (cross-list from stat.ME) [pdf, html, other]

Title: Are you doing better than random guessing? A call for using negative controls when evaluating causal discovery algorithms

Anne Helby Petersen

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[293] arXiv:2412.10119 (cross-list from cs.LG) [pdf, html, other]

Title: AMUSE: Adaptive Model Updating using a Simulated Environment

Louis Chislett, Catalina A. Vallejos, Timothy I. Cannings, James Liley

Comments: 12 pages, 2 tables. Submitted to AIStats 2025 (under review)

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[294] arXiv:2412.10196 (cross-list from stat.ME) [pdf, other]

Title: High-dimensional Statistics Applications to Batch Effects in Metabolomics

Zhendong Guo

Comments: 25 pages, 5 figures, 9 tables

Subjects: Methodology (stat.ME); Biomolecules (q-bio.BM); Applications (stat.AP); Machine Learning (stat.ML)

[295] arXiv:2412.10288 (cross-list from cs.LG) [pdf, other]

Title: Performance evaluation of predictive AI models to support medical decisions: Overview and guidance

Ben Van Calster, Gary S. Collins, Andrew J. Vickers, Laure Wynants, Kathleen F. Kerr, Lasai Barreñada, Gael Varoquaux, Karandeep Singh, Karel G. M. Moons, Tina Hernandez-boussard, Dirk Timmerman, David J. Mclernon, Maarten Van Smeden, Ewout W. Steyerberg (topic group 6 of the STRATOS initiative)

Comments: 60 pages, 8 tables, 11 figures, two supplementary appendices

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[296] arXiv:2412.10467 (cross-list from cs.LG) [pdf, html, other]

Title: MGM: Global Understanding of Audience Overlap Graphs for Predicting the Factuality and the Bias of News Media

Muhammad Arslan Manzoor, Ruihong Zeng, Dilshod Azizov, Preslav Nakov, Shangsong Liang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[297] arXiv:2412.10504 (cross-list from hep-ph) [pdf, html, other]

Title: Aspen Open Jets: Unlocking LHC Data for Foundation Models in Particle Physics

Oz Amram, Luca Anzalone, Joschka Birk, Darius A. Faroughy, Anna Hallin, Gregor Kasieczka, Michael Krämer, Ian Pang, Humberto Reyes-Gonzalez, David Shih

Comments: 11 pages, 4 figures, the AspenOpenJets dataset can be found at this http URL

Subjects: High Energy Physics - Phenomenology (hep-ph); Machine Learning (cs.LG); High Energy Physics - Experiment (hep-ex); Machine Learning (stat.ML)

[298] arXiv:2412.10512 (cross-list from cs.CR) [pdf, html, other]

Title: Differentially Private Multi-Sampling from Distributions

Albert Cheu, Debanuj Nayak

Comments: 22 pages

Subjects: Cryptography and Security (cs.CR); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[299] arXiv:2412.10545 (cross-list from cs.LG) [pdf, html, other]

Title: Identifying Predictions That Influence the Future: Detecting Performative Concept Drift in Data Streams

Brandon Gower-Winter, Georg Krempl, Sergey Dragomiretskiy, Tineke Jelsma, Arno Siebes

Comments: 21 pages, 17 figures. Extended version of paper with the same name accepted to AAAI2025 v2.0 updated the figures and text to more align with conference paper. Acknowledgements Section added

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[300] arXiv:2412.10570 (cross-list from cs.LG) [pdf, html, other]

Title: Adaptive Sampling to Reduce Epistemic Uncertainty Using Prediction Interval-Generation Neural Networks

Giorgio Morales, John Sheppard

Comments: Accepted to appear in AAAI 2025

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)