Machine Learning

Authors and titles for April 2023

[1] arXiv:2304.00195 [pdf, html, other]

Title: Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformers

Awni Altabaa, Taylor Webb, Jonathan Cohen, John Lafferty

Comments: Published at ICLR 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[2] arXiv:2304.00200 [pdf, html, other]

Title: Diffusion map particle systems for generative modeling

Fengyi Li, Youssef Marzouk

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[3] arXiv:2304.00575 [pdf, other]

Title: Modelling customer churn for the retail industry in a deep learning based sequential framework

Juan Pablo Equihua, Henrik Nordmark, Maged Ali, Berthold Lausen

Comments: 21 pages, 12 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP)

[4] arXiv:2304.00691 [pdf, other]

Title: Lithium-ion Battery Online Knee Onset Detection by Matrix Profile

Kate Qi Zhou, Yan Qin, Chau Yuen

Journal-ref: IEEE Transactions on Transportation Electrification, 2023

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[5] arXiv:2304.00770 [pdf, other]

Title: Online stochastic Newton methods for estimating the geometric median and applications

Antoine Godichon-Baggioni (LPSM (UMR\_8001)), Wei Lu (LMI)

Subjects: Machine Learning (stat.ML)

[6] arXiv:2304.00917 [pdf, html, other]

Title: Diffusion Bridge Mixture Transports, Schrödinger Bridge Problems and Generative Modeling

Stefano Peluchetti

Journal-ref: Journal of Machine Learning Research 24(374):1-51, 2023

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[7] arXiv:2304.01429 [pdf, other]

Title: Learning from data with structured missingness

Robin Mitra, Sarah F. McGough, Tapabrata Chakraborti, Chris Holmes, Ryan Copping, Niels Hagenbuch, Stefanie Biedermann, Jack Noonan, Brieuc Lehmann, Aditi Shenvi, Xuan Vinh Doan, David Leslie, Ginestra Bianconi, Ruben Sanchez-Garcia, Alisha Davies, Maxine Mackintosh, Eleni-Rosalina Andrinopoulou, Anahid Basiri, Chris Harbron, Ben D. MacArthur

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[8] arXiv:2304.01541 [pdf, other]

Title: Privacy Amplification via Compression: Achieving the Optimal Privacy-Accuracy-Communication Trade-off in Distributed Mean Estimation

Wei-Ning Chen, Dan Song, Ayfer Ozgur, Peter Kairouz

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[9] arXiv:2304.01561 [pdf, html, other]

Title: Optimal rates of approximation by shallow ReLU$^k$ neural networks and applications to nonparametric regression

Yunfei Yang, Ding-Xuan Zhou

Comments: Version 3 improves some approximation bounds by using recent results from arXiv:2307.15285

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[10] arXiv:2304.01708 [pdf, other]

Title: Learning and Concentration for High Dimensional Linear Gaussians: an Invariant Subspace Approach

Muhammad Abdullah Naeem

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Systems and Control (eess.SY); Statistics Theory (math.ST)

[11] arXiv:2304.01717 [pdf, other]

Title: Characterizing the contribution of dependent features in XAI methods

Ahmed Salih, Ilaria Boscolo Galazzo, Zahra Raisi-Estabragh, Steffen E. Petersen, Gloria Menegaz, Petia Radeva

Comments: 17 pages, 5 tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP)

[12] arXiv:2304.02023 [pdf, other]

Title: Bounding probabilities of causation through the causal marginal problem

Numair Sani, Atalanti A. Mastakouri, Dominik Janzing

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Methodology (stat.ME)

[13] arXiv:2304.02229 [pdf, other]

Title: Mixed Regression via Approximate Message Passing

Nelvin Tan, Ramji Venkataramanan

Comments: 44 pages. To appear in the Journal of Machine Learning Research. A shorter version of this paper appeared in the proceedings of AISTATS 2023

Journal-ref: Journal of Machine Learning Research, vol. 24, no. 317, pp. 1-44, 2023

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[14] arXiv:2304.02595 [pdf, other]

Title: Bayesian neural networks via MCMC: a Python-based tutorial

Rohitash Chandra, Joshua Simmons

Comments: IEEE Access (2024)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Computation (stat.CO)

[15] arXiv:2304.02641 [pdf, other]

Title: Self-Distillation for Gaussian Process Regression and Classification

Kenneth Borup, Lars Nørvang Andersen

Comments: 10 pages; code at this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[16] arXiv:2304.02899 [pdf, other]

Title: Variable-Complexity Weighted-Tempered Gibbs Samplers for Bayesian Variable Selection

Lan V. Truong

Comments: 29 pages, 12 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[17] arXiv:2304.02902 [pdf, other]

Title: Towards Efficient MCMC Sampling in Bayesian Neural Networks by Exploiting Symmetry

Jonas Gregor Wiese, Lisa Wimmer, Theodore Papamarkou, Bernd Bischl, Stephan Günnemann, David Rügamer

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[18] arXiv:2304.02911 [pdf, other]

Title: Heavy-Tailed Regularization of Weight Matrices in Deep Neural Networks

Xuanzhe Xiao, Zeng Li, Chuanlong Xie, Fengwei Zhou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[19] arXiv:2304.02912 [pdf, other]

Title: Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach

Urte Adomaityte, Gabriele Sicuro, Pierpaolo Vivo

Comments: 25 pages, 8 figures

Journal-ref: Advances in Neural Information Processing Systems 36 (2024)

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Statistics Theory (math.ST)

[20] arXiv:2304.03096 [pdf, other]

Title: Spectral Gap Regularization of Neural Networks

Edric Tam, David Dunson

Comments: This is a journal extension of the ICML conference paper by Tam and Dunson (2020), arXiv:2003.00992

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[21] arXiv:2304.03113 [pdf, other]

Title: Efficient SAGE Estimation via Causal Structure Learning

Christoph Luther, Gunnar König, Moritz Grosse-Wentrup

Comments: equal contribution between Luther and König; accepted at AISTATS 2023

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[22] arXiv:2304.03185 [pdf, other]

Title: Pairwise Ranking with Gaussian Kernels

Guanhang Lei, Lei Shi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[23] arXiv:2304.03408 [pdf, other]

Title: Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks

Blake Bordelon, Cengiz Pehlevan

Comments: Advances in Neural Information Processing Systems 36 (2023) Camera Ready

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[24] arXiv:2304.03775 [pdf, other]

Title: Biological Sequence Kernels with Guaranteed Flexibility

Alan Nawzad Amin, Eli Nathan Weinstein, Debora Susan Marks

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

[25] arXiv:2304.03866 [pdf, other]

Title: Conservative objective models are a special kind of contrastive divergence-based energy model

Christopher Beckham, Christopher Pal

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)