Machine Learning

Authors and titles for April 2024

[51] arXiv:2404.09962 [pdf, html, other]

Title: Invariant Subspace Decomposition

Margherita Lazzaretto, Jonas Peters, Niklas Pfister

Comments: 60 pages, 14 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[52] arXiv:2404.10122 [pdf, html, other]

Title: Online Estimation via Offline Estimation: An Information-Theoretic Framework

Dylan J. Foster, Yanjun Han, Jian Qian, Alexander Rakhlin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[53] arXiv:2404.10207 [pdf, html, other]

Title: HELLINGER-UCB: A novel algorithm for stochastic multi-armed bandit problem and cold start problem in recommender system

Ruibo Yang, Jiazhou Wang, Andrew Mullhaupt

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[54] arXiv:2404.10261 [pdf, html, other]

Title: Lighter, Better, Faster Multi-Source Domain Adaptation with Gaussian Mixture Models and Optimal Transport

Eduardo Fernandes Montesuma, Fred Ngolè Mboula, Antoine Souloumiac

Comments: 13 pages, 6 figures, accepted as a research track paper at the ECML-PKDD 2024 conference

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[55] arXiv:2404.10351 [pdf, other]

Title: On the Use of Relative Validity Indices for Comparing Clustering Approaches

Luke W. Yerbury, Ricardo J. G. B. Campello, G. C. Livingston Jr, Mark Goldsworthy, Lachlan O'Neil

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[56] arXiv:2404.10727 [pdf, html, other]

Title: How Deep Networks Learn Sparse and Hierarchical Data: the Sparse Random Hierarchy Model

Umberto Tomasini, Matthieu Wyart

Comments: 9 pages, 6 figures

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[57] arXiv:2404.11330 [pdf, html, other]

Title: Toward Understanding the Disagreement Problem in Neural Network Feature Attribution

Niklas Koenen, Marvin N. Wright

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[58] arXiv:2404.11509 [pdf, html, other]

Title: VC Theory for Inventory Policies

Yaqi Xie, Will Ma, Linwei Xin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[59] arXiv:2404.11965 [pdf, html, other]

Title: Multi-fidelity Gaussian process surrogate modeling for regression problems in physics

Kislaya Ravi, Vladyslav Fediukov, Felix Dietrich, Tobias Neckel, Fabian Buse, Michael Bergmann, Hans-Joachim Bungartz

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)

[60] arXiv:2404.12290 [pdf, other]

Title: Debiased Distribution Compression

Lingxiao Li, Raaz Dwivedi, Lester Mackey

Comments: Published at ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[61] arXiv:2404.12294 [pdf, html, other]

Title: Bayesian evidence estimation from posterior samples with normalizing flows

Rahul Srinivasan, Marco Crisostomi, Roberto Trotta, Enrico Barausse, Matteo Breschi

Comments: 15 pages, 8 figures, 1 table

Journal-ref: PhysRevD.110.123007(2024)

Subjects: Machine Learning (stat.ML); Cosmology and Nongalactic Astrophysics (astro-ph.CO); Machine Learning (cs.LG); General Relativity and Quantum Cosmology (gr-qc)

[62] arXiv:2404.12356 [pdf, html, other]

Title: Improving the interpretability of GNN predictions through conformal-based graph sparsification

Pablo Sanchez-Martin, Kinaan Aamir Khan, Isabel Valera

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[63] arXiv:2404.12478 [pdf, other]

Title: A New Reliable & Parsimonious Learning Strategy Comprising Two Layers of Gaussian Processes, to Address Inhomogeneous Empirical Correlation Structures

Gargi Roy, Dalia Chakrabarty

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[64] arXiv:2404.12481 [pdf, html, other]

Title: Understanding Optimal Feature Transfer via a Fine-Grained Bias-Variance Analysis

Yufan Li, Subhabrata Sen, Ben Adlam

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[65] arXiv:2404.12484 [pdf, html, other]

Title: Neural Methods for Amortized Inference

Andrew Zammit-Mangion, Matthew Sainsbury-Dale, Raphaël Huser

Comments: 45 pages, 11 figures, 2 tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[66] arXiv:2404.12586 [pdf, html, other]

Title: Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$-Lifted Kullback--Leibler Divergence

Mark Chiu Chong, Hien Duy Nguyen, TrungTin Nguyen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[67] arXiv:2404.12613 [pdf, html, other]

Title: A Fourier Approach to the Parameter Estimation Problem for One-dimensional Gaussian Mixture Models

Xinyu Liu, Hai Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP); Methodology (stat.ME)

[68] arXiv:2404.12862 [pdf, html, other]

Title: A Guide to Feature Importance Methods for Scientific Inference

Fiona Katharina Ewald, Ludwig Bothmann, Marvin N. Wright, Bernd Bischl, Giuseppe Casalicchio, Gunnar König

Journal-ref: Longo, L., Lapuschkin, S., Seifert, C. (eds) Explainable Artificial Intelligence. xAI 2024. Communications in Computer and Information Science, vol 2154. Springer, Cham

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[69] arXiv:2404.12923 [pdf, html, other]

Title: Probabilistic Numeric SMC Sampling for Bayesian Nonlinear System Identification in Continuous Time

Joe D. Longbottom, Max D. Champneys, Timothy J. Rogers

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[70] arXiv:2404.12940 [pdf, html, other]

Title: Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modelling

Grigory Bartosh, Dmitry Vetrov, Christian A. Naesseth

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[71] arXiv:2404.13147 [pdf, html, other]

Title: Multiclass ROC

Liang Wang, Luis Carvalho

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[72] arXiv:2404.13198 [pdf, other]

Title: An economically-consistent discrete choice model with flexible utility specification based on artificial neural networks

Jose Ignacio Hernandez, Niek Mouter, Sander van Cranenburgh

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM)

[73] arXiv:2404.13240 [pdf, html, other]

Title: Learning In Reverse Causal Strategic Environments With Ramifications on Two Sided Markets

Seamus Somerstep, Yuekai Sun, Ya'acov Ritov

Comments: 22 pages, 5 figures

Subjects: Machine Learning (stat.ML); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG)

[74] arXiv:2404.13309 [pdf, other]

Title: Latent Schr{ö}dinger Bridge Diffusion Model for Generative Learning

Yuling Jiao, Lican Kang, Huazhen Lin, Jin Liu, Heng Zuo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[75] arXiv:2404.13557 [pdf, html, other]

Title: Preconditioned Neural Posterior Estimation for Likelihood-free Inference

Xiaoyu Wang, Ryan P. Kelly, David J. Warne, Christopher Drovandi

Comments: 31 pages, 11 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[76] arXiv:2404.13649 [pdf, html, other]

Title: Distributional Principal Autoencoders

Xinwei Shen, Nicolai Meinshausen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[77] arXiv:2404.13731 [pdf, html, other]

Title: Training-Conditional Coverage Bounds for Uniformly Stable Learning Algorithms

Mehrdad Pournaderi, Yu Xiang

Comments: Accepted to the ISIT 2024 workshop on Information-Theoretic Methods for Trustworthy Machine Learning (IT-TML)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[78] arXiv:2404.14276 [pdf, html, other]

Title: A Bayesian Approach for Prioritising Driving Behaviour Investigations in Telematic Auto Insurance Policies

Mark McLeod, Bernardo Perez-Orozco, Nika Lee, Davide Zilli

Comments: International Congress of Actuaries (2023)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[79] arXiv:2404.14460 [pdf, html, other]

Title: Inference of Causal Networks using a Topological Threshold

Filipe Barroso, Diogo Gomes, Gareth J. Baxter

Comments: 17 pages, 12 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[80] arXiv:2404.14743 [pdf, html, other]

Title: Gradient Guidance for Diffusion Models: An Optimization Perspective

Yingqing Guo, Hui Yuan, Yukang Yang, Minshuo Chen, Mengdi Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[81] arXiv:2404.14873 [pdf, html, other]

Title: Estimating the Distribution of Parameters in Differential Equations with Repeated Cross-Sectional Data

Hyeontae Jo, Sung Woong Cho, Hyung Ju Hwang

Comments: 16 pages, 10 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[82] arXiv:2404.15466 [pdf, html, other]

Title: Private Optimal Inventory Policy Learning for Feature-based Newsvendor with Unknown Demand

Tuoyi Zhao, Wen-xin Zhou, Lan Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[83] arXiv:2404.15618 [pdf, html, other]

Title: Neural Operator induced Gaussian Process framework for probabilistic solution of parametric partial differential equations

Sawan Kumar, Rajdip Nayek, Souvik Chakraborty

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[84] arXiv:2404.15746 [pdf, html, other]

Title: Collaborative Heterogeneous Causal Inference Beyond Meta-analysis

Tianyu Guo, Sai Praneeth Karimireddy, Michael I. Jordan

Comments: submitted to ICML

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[85] arXiv:2404.15967 [pdf, html, other]

Title: Interpretable Clustering with the Distinguishability Criterion

Ali Turfah, Xiaoquan Wen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[86] arXiv:2404.16287 [pdf, html, other]

Title: Differentially Private Federated Learning: Servers Trustworthiness, Estimation, and Statistical Inference

Zhe Zhang, Ryumei Nakada, Linjun Zhang

Comments: 56 pages, 3 figures

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[87] arXiv:2404.16328 [pdf, html, other]

Title: Distributionally Robust Safe Screening

Hiroyuki Hanada, Satoshi Akahane, Tatsuya Aoyama, Tomonari Tanaka, Yoshito Okura, Yu Inatsu, Noriaki Hashimoto, Taro Murayama, Lee Hanju, Shinya Kojima, Ichiro Takeuchi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[88] arXiv:2404.16560 [pdf, html, other]

Title: Automated Model Selection for Generalized Linear Models

Benjamin Schwendinger, Florian Schwendinger, Laura Vana-Gür

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[89] arXiv:2404.17398 [pdf, other]

Title: Online Policy Learning and Inference by Matrix Completion

Congyuan Duan, Jingyang Li, Dong Xia

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[90] arXiv:2404.17429 [pdf, html, other]

Title: Separation capacity of linear reservoirs with random connectivity matrix

Youness Boutaib

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[91] arXiv:2404.17442 [pdf, html, other]

Title: Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets

Benjamin Dupuis, Paul Viallard, George Deligiannidis, Umut Simsekli

Journal-ref: Journal of Machine Learning Research (2024)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[92] arXiv:2404.17483 [pdf, html, other]

Title: Differentiable Pareto-Smoothed Weighting for High-Dimensional Heterogeneous Treatment Effect Estimation

Yoichi Chikahara, Kansei Ushiyama

Comments: Accepted to the 40th Conference on Uncertainty in Artificial Intelligence (UAI2024). 14 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[93] arXiv:2404.17644 [pdf, html, other]

Title: A Conditional Independence Test in the Presence of Discretization

Boyang Sun, Yu Yao, Guang-Yuan Hao, Yumou Qiu, Kun Zhang

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[94] arXiv:2404.17709 [pdf, html, other]

Title: Low-rank Matrix Bandits with Heavy-tailed Rewards

Yue Kang, Cho-Jui Hsieh, Thomas C. M. Lee

Comments: The 40th Conference on Uncertainty in Artificial Intelligence (UAI 2024)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[95] arXiv:2404.17856 [pdf, html, other]

Title: Uncertainty quantification for iterative algorithms in linear models with application to early stopping

Pierre C. Bellec, Kai Tan

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Computation (stat.CO); Methodology (stat.ME)

[96] arXiv:2404.18233 [pdf, html, other]

Title: A Note on Asynchronous Challenges: Unveiling Formulaic Bias and Data Loss in the Hayashi-Yoshida Estimator

Evangelos Georgiadis

Comments: submitted. 15 pages, 1 appendix, 4 figures, 1 table, 1 algo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Combinatorics (math.CO); Probability (math.PR)

[97] arXiv:2404.18769 [pdf, html, other]

Title: Learning with Norm Constrained, Over-parameterized, Two-layer Neural Networks

Fanghui Liu, Leello Dadi, Volkan Cevher

Comments: Accepted by JMLR, update on the dimension dependence in sample complexity, see Prop. 5

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[98] arXiv:2404.19073 [pdf, html, other]

Title: Learning Sparse High-Dimensional Matrix-Valued Graphical Models From Dependent Data

Jitendra K Tugnait

Comments: 16 pages, 2 figures, 1 table

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[99] arXiv:2404.19157 [pdf, other]

Title: Scalable Bayesian Inference in the Era of Deep Learning: From Gaussian Processes to Deep Neural Networks

Javier Antoran

Comments: PhD Thesis, University of Cambridge

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[100] arXiv:2404.19220 [pdf, other]

Title: Regression for matrix-valued data via Kronecker products factorization

Yin-Jen Chen, Minh Tang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)