Machine Learning

Authors and titles for March 2024

[201] arXiv:2403.04629 (cross-list from cs.LG) [pdf, html, other]

Title: Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration

Julian Rodemann, Federico Croppi, Philipp Arens, Yusuf Sale, Julia Herbinger, Bernd Bischl, Eyke Hüllermeier, Thomas Augustin, Conor J. Walsh, Giuseppe Casalicchio

Comments: Preprint. Copyright by the authors. 19 pages, 24 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Robotics (cs.RO); Machine Learning (stat.ML)

[202] arXiv:2403.04726 (cross-list from cs.DS) [pdf, html, other]

Title: A Sub-Quadratic Time Algorithm for Robust Sparse Mean Estimation

Ankit Pensia

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[203] arXiv:2403.04744 (cross-list from cs.LG) [pdf, html, other]

Title: SQ Lower Bounds for Non-Gaussian Component Analysis with Weaker Assumptions

Ilias Diakonikolas, Daniel Kane, Lisheng Ren, Yuxin Sun

Comments: Conference version published in NeurIPS 2023

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[204] arXiv:2403.04747 (cross-list from cs.LG) [pdf, html, other]

Title: GNN-VPA: A Variance-Preserving Aggregation Strategy for Graph Neural Networks

Lisa Schneckenreiter, Richard Freinschlag, Florian Sestak, Johannes Brandstetter, Günter Klambauer, Andreas Mayr

Comments: Accepted at ICLR 2024 (Tiny Papers Track)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[205] arXiv:2403.04764 (cross-list from cs.LG) [pdf, html, other]

Title: TS-RSR: A provably efficient approach for batch Bayesian Optimization

Zhaolin Ren, Na Li

Comments: Accepted by the SIAM Journal on Optimization

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[206] arXiv:2403.04805 (cross-list from cs.LG) [pdf, html, other]

Title: Pruning neural network models for gene regulatory dynamics using data and domain knowledge

Intekhab Hossain, Jonas Fischer, Rebekka Burkholz, John Quackenbush

Comments: Accepted to Conference on Neural Information Processing Systems (NeurIPS) 2024

Subjects: Machine Learning (cs.LG); Quantitative Methods (q-bio.QM); Applications (stat.AP); Machine Learning (stat.ML)

[207] arXiv:2403.04867 (cross-list from cs.CR) [pdf, other]

Title: Unified Mechanism-Specific Amplification by Subsampling and Group Privacy Amplification

Jan Schuchardt, Mihail Stoian, Arthur Kosmala, Stephan Günnemann

Comments: Accepted at NeurIPS 2024

Subjects: Cryptography and Security (cs.CR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[208] arXiv:2403.04975 (cross-list from math.OC) [pdf, html, other]

Title: Deep Backward and Galerkin Methods for the Finite State Master Equation

Asaf Cohen, Mathieu Laurière, Ethan Zell

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[209] arXiv:2403.04978 (cross-list from cs.LG) [pdf, html, other]

Title: Stacking as Accelerated Gradient Descent

Naman Agarwal, Pranjal Awasthi, Satyen Kale, Eric Zhao

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[210] arXiv:2403.05006 (cross-list from cs.LG) [pdf, html, other]

Title: Provable Multi-Party Reinforcement Learning with Diverse Human Feedback

Huiying Zhong, Zhun Deng, Weijie J. Su, Zhiwei Steven Wu, Linjun Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Methodology (stat.ME); Machine Learning (stat.ML)

[211] arXiv:2403.05175 (cross-list from cs.LG) [pdf, html, other]

Title: Continual Learning and Catastrophic Forgetting

Gido M. van de Ven, Nicholas Soures, Dhireesha Kudithipudi

Comments: Preprint of a book chapter; 21 pages, 4 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Neurons and Cognition (q-bio.NC); Machine Learning (stat.ML)

[212] arXiv:2403.05293 (cross-list from cs.LG) [pdf, html, other]

Title: Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Hristo Papazov, Scott Pesme, Nicolas Flammarion

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[213] arXiv:2403.05358 (cross-list from cs.CY) [pdf, html, other]

Title: Variational Inference of Parameters in Opinion Dynamics Models

Jacopo Lenti, Fabrizio Silvestri, Gianmarco De Francisci Morales

Subjects: Computers and Society (cs.CY); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[214] arXiv:2403.05446 (cross-list from cs.LG) [pdf, html, other]

Title: An Improved Algorithm for Learning Drifting Discrete Distributions

Alessio Mazzetto

Comments: To be published in AISTATS 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[215] arXiv:2403.05490 (cross-list from cs.LG) [pdf, html, other]

Title: Poly-View Contrastive Learning

Amitis Shidani, Devon Hjelm, Jason Ramapuram, Russ Webb, Eeshan Gunesh Dhekane, Dan Busbridge

Comments: Accepted to ICLR 2024. 42 pages, 7 figures, 3 tables, loss pseudo-code included in appendix

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (stat.ML)

[216] arXiv:2403.05529 (cross-list from cs.LG) [pdf, html, other]

Title: Computational-Statistical Gaps in Gaussian Single-Index Models

Alex Damian, Loucas Pillaud-Vivien, Jason D. Lee, Joan Bruna

Comments: 61 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[217] arXiv:2403.05600 (cross-list from cs.LG) [pdf, html, other]

Title: Density-Regression: Efficient and Distance-Aware Deep Regressor for Uncertainty Estimation under Distribution Shifts

Ha Manh Bui, Anqi Liu

Comments: International Conference on Artificial Intelligence and Statistics, 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[218] arXiv:2403.05759 (cross-list from cs.LG) [pdf, html, other]

Title: Membership Testing in Markov Equivalence Classes via Independence Query Oracles

Jiaqi Zhang, Kirankumar Shiragur, Caroline Uhler

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Methodology (stat.ME); Machine Learning (stat.ML)

[219] arXiv:2403.06100 (cross-list from cs.HC) [pdf, html, other]

Title: Automatic design optimization of preference-based subjective evaluation with online learning in crowdsourcing environment

Yusuke Yasuda, Tomoki Toda

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[220] arXiv:2403.06183 (cross-list from cs.LG) [pdf, html, other]

Title: An Improved Analysis of Langevin Algorithms with Prior Diffusion for Non-Log-Concave Sampling

Xunpeng Huang, Hanze Dong, Difan Zou, Tong Zhang

Comments: 32 pages

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST); Machine Learning (stat.ML)

[221] arXiv:2403.06230 (cross-list from cs.LG) [pdf, html, other]

Title: LinearAPT: An Adaptive Algorithm for the Fixed-Budget Thresholding Linear Bandit Problem

Yun-Ang Wu, Yun-Da Tsai, Shou-De Lin

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[222] arXiv:2403.06235 (cross-list from cs.LG) [pdf, html, other]

Title: Probabilistic Neural Circuits

Pedro Zuidberg Dos Martires

Comments: Proceedings of the AAAI Conference on Artificial Intelligence

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[223] arXiv:2403.06311 (cross-list from cs.LG) [pdf, html, other]

Title: How much data do you need? Part 2: Predicting DL class specific training dataset sizes

Thomas Mühlenstädt, Jelena Frtunikj

Comments: 17 pages, 10 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[224] arXiv:2403.06560 (cross-list from cs.LG) [pdf, html, other]

Title: Sliced-Wasserstein Distances and Flows on Cartan-Hadamard Manifolds

Clément Bonet, Lucas Drumetz, Nicolas Courty

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[225] arXiv:2403.06571 (cross-list from cs.LG) [pdf, other]

Title: Scalable Online Exploration via Coverability

Philip Amortila, Dylan J. Foster, Akshay Krishnamurthy

Comments: ICML 2024

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[226] arXiv:2403.06807 (cross-list from cs.LG) [pdf, html, other]

Title: Multistep Consistency Models

Jonathan Heek, Emiel Hoogeboom, Tim Salimans

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[227] arXiv:2403.06812 (cross-list from cs.LG) [pdf, html, other]

Title: Monotone Individual Fairness

Yahav Bechavod

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Machine Learning (stat.ML)

[228] arXiv:2403.06826 (cross-list from cs.LG) [pdf, html, other]

Title: In-context Exploration-Exploitation for Reinforcement Learning

Zhenwen Dai, Federico Tomasi, Sina Ghiassian

Comments: Published at ICLR 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[229] arXiv:2403.06871 (cross-list from cs.LG) [pdf, html, other]

Title: On the Generalization Ability of Unsupervised Pretraining

Yuyang Deng, Junyuan Hong, Jiayu Zhou, Mehrdad Mahdavi

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[230] arXiv:2403.06903 (cross-list from cs.LG) [pdf, html, other]

Title: Benign overfitting in leaky ReLU networks with moderate input dimension

Kedar Karhadkar, Erin George, Michael Murray, Guido Montúfar, Deanna Needell

Comments: 39 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[231] arXiv:2403.06925 (cross-list from cs.LG) [pdf, html, other]

Title: Transformers Learn Low Sensitivity Functions: Investigations and Implications

Bhavya Vasudeva, Deqing Fu, Tianyi Zhou, Elliott Kau, Youqi Huang, Vatsal Sharan

Comments: ICLR 2025. 24 pages, 19 figures, 3 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[232] arXiv:2403.06942 (cross-list from eess.SY) [pdf, html, other]

Title: Grid Monitoring with Synchro-Waveform and AI Foundation Model Technologies

Lang Tong, Xinyi Wang, Qing Zhao

Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Machine Learning (stat.ML)

[233] arXiv:2403.07004 (cross-list from cs.AI) [pdf, html, other]

Title: Convergence of Some Convex Message Passing Algorithms to a Fixed Point

Vaclav Voracek, Tomas Werner

Comments: ICML 2024; comments are welcome

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[234] arXiv:2403.07031 (cross-list from cs.LG) [pdf, other]

Title: Cramming Contextual Bandits for On-policy Statistical Evaluation

Zeyang Jia, Kosuke Imai, Michael Lingzhi Li

Subjects: Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME); Machine Learning (stat.ML)

[235] arXiv:2403.07136 (cross-list from cs.LG) [pdf, other]

Title: On the Limited Representational Power of Value Functions and its Links to Statistical (In)Efficiency

David Cheikhi, Daniel Russo

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[236] arXiv:2403.07148 (cross-list from math.OC) [pdf, other]

Title: Stochastic Extragradient with Random Reshuffling: Improved Convergence for Variational Inequalities

Konstantinos Emmanouilidis, René Vidal, Nicolas Loizou

Comments: AISTATS 2024. Changes in v2: Some minor typos were fixed; Statement and proof of Theorem 2.3 were updated and improved

Subjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[237] arXiv:2403.07185 (cross-list from cs.LG) [pdf, html, other]

Title: Uncertainty in Graph Neural Networks: A Survey

Fangxin Wang, Yuqing Liu, Kay Liu, Yibo Wang, Sourav Medya, Philip S. Yu

Comments: 14 main pages, 4 figures, 1 table

Journal-ref: Transactions on Machine Learning Research (11/2024)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[238] arXiv:2403.07213 (cross-list from cs.LG) [pdf, html, other]

Title: Which LLM to Play? Convergence-Aware Online Model Selection with Time-Increasing Bandits

Yu Xia, Fang Kong, Tong Yu, Liya Guo, Ryan A. Rossi, Sungchul Kim, Shuai Li

Comments: Accepted by WWW'24 (Oral)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[239] arXiv:2403.07263 (cross-list from cs.CV) [pdf, html, other]

Title: Adaptive Bounding Box Uncertainties via Two-Step Conformal Prediction

Alexander Timans, Christoph-Nikolas Straehle, Kaspar Sakmann, Eric Nalisnick

Comments: European Conference on Computer Vision (ECCV) 2024; 37 pages, 14 figures, 6 tables (incl. appendix)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[240] arXiv:2403.07379 (cross-list from cs.LG) [pdf, html, other]

Title: Hallmarks of Optimization Trajectories in Neural Networks: Directional Exploration and Redundancy

Sidak Pal Singh, Bobby He, Thomas Hofmann, Bernhard Schölkopf

Comments: Preprint, 57 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[241] arXiv:2403.07442 (cross-list from cs.LG) [pdf, html, other]

Title: Proxy Methods for Domain Adaptation

Katherine Tsai, Stephen R. Pfohl, Olawale Salaudeen, Nicole Chiou, Matt J. Kusner, Alexander D'Amour, Sanmi Koyejo, Arthur Gretton

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[242] arXiv:2403.07456 (cross-list from cs.LG) [pdf, html, other]

Title: A tutorial on multi-view autoencoders using the multi-view-AE library

Ana Lawry Aguila, Andre Altmann

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[243] arXiv:2403.07464 (cross-list from math.ST) [pdf, html, other]

Title: On Ranking-based Tests of Independence

Myrto Limnios (UCPH), Stéphan Clémençon (LTCI, IDS, S2A, IP Paris)

Subjects: Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)

[244] arXiv:2403.07495 (cross-list from stat.CO) [pdf, html, other]

Title: Tuning diagonal scale matrices for HMC

Jimmy Huy Tran, Tore Selland Kleppe

Subjects: Computation (stat.CO); Methodology (stat.ME); Machine Learning (stat.ML)

[245] arXiv:2403.07723 (cross-list from cs.LG) [pdf, html, other]

Title: On the Last-Iterate Convergence of Shuffling Gradient Methods

Zijian Liu, Zhengyuan Zhou

Comments: ICML 2024

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[246] arXiv:2403.07724 (cross-list from cs.LG) [pdf, html, other]

Title: Balancing Fairness and Accuracy in Data-Restricted Binary Classification

Zachary McBride Lazri, Danial Dervovic, Antigoni Polychroniadou, Ivan Brugere, Dana Dachman-Soled, Min Wu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (stat.ML)

[247] arXiv:2403.07735 (cross-list from math.ST) [pdf, html, other]

Title: The Minimax Rate of HSIC Estimation for Translation-Invariant Kernels

Florian Kalinke, Zoltan Szabo

Comments: Accepted for publication at NeurIPS 2024

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[248] arXiv:2403.07862 (cross-list from math.ST) [pdf, html, other]

Title: Low coordinate degree algorithms I: Universality of computational thresholds for hypothesis testing

Dmitriy Kunisky

Comments: 49 pages

Subjects: Statistics Theory (math.ST); Data Structures and Algorithms (cs.DS); Probability (math.PR); Machine Learning (stat.ML)

[249] arXiv:2403.07929 (cross-list from cs.LG) [pdf, html, other]

Title: Sketching the Heat Kernel: Using Gaussian Processes to Embed Data

Anna C. Gilbert, Kevin O'Neill

Comments: 28 pages

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[250] arXiv:2403.08118 (cross-list from stat.ME) [pdf, html, other]

Title: Characterising harmful data sources when constructing multi-fidelity surrogate models

Nicolau Andrés-Thió, Mario Andrés Muñoz, Kate Smith-Miles

Subjects: Methodology (stat.ME); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)