Statistics

Authors and titles for June 2023

[726] arXiv:2306.03291 (cross-list from cs.LG) [pdf, other]

Title: Switching Autoregressive Low-rank Tensor Models

Hyun Dong Lee, Andrew Warrington, Joshua I. Glaser, Scott W. Linderman

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[727] arXiv:2306.03401 (cross-list from cs.LG) [pdf, html, other]

Title: A Lightweight Method for Tackling Unknown Participation Statistics in Federated Averaging

Shiqiang Wang, Mingyue Ji

Comments: Accepted to ICLR 2024

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Optimization and Control (math.OC); Machine Learning (stat.ML)

[728] arXiv:2306.03435 (cross-list from cs.LG) [pdf, other]

Title: On the Role of Attention in Prompt-tuning

Samet Oymak, Ankit Singh Rawat, Mahdi Soltanolkotabi, Christos Thrampoulidis

Comments: Published at ICML 2023

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[729] arXiv:2306.03522 (cross-list from cs.LG) [pdf, other]

Title: A Functional Data Perspective and Baseline On Multi-Layer Out-of-Distribution Detection

Eduardo Dadalto, Pierre Colombo, Guillaume Staerman, Nathan Noiry, Pablo Piantanida

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[730] arXiv:2306.03566 (cross-list from cs.LG) [pdf, other]

Title: Memory-Based Dual Gaussian Processes for Sequential Learning

Paul E. Chang, Prakhar Verma, S.T. John, Arno Solin, Mohammad Emtiyaz Khan

Comments: International Conference on Machine Learning (ICML) 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[731] arXiv:2306.03589 (cross-list from cs.LG) [pdf, html, other]

Title: How does over-squashing affect the power of GNNs?

Francesco Di Giovanni, T. Konstantin Rusch, Michael M. Bronstein, Andreea Deac, Marc Lackenby, Siddhartha Mishra, Petar Veličković

Comments: 36 pages; Published in Transactions on Machine Learning Research (TMLR)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[732] arXiv:2306.03638 (cross-list from cs.LG) [pdf, html, other]

Title: Provable convergence guarantees for black-box variational inference

Justin Domke, Guillaume Garrigos, Robert Gower

Comments: Accepted at NeurIPS 2023

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[733] arXiv:2306.03679 (cross-list from cs.CV) [pdf, other]

Title: Human-imperceptible, Machine-recognizable Images

Fusheng Hao, Fengxiang He, Yikai Wang, Fuxiang Wu, Jing Zhang, Jun Cheng, Dacheng Tao

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[734] arXiv:2306.03770 (cross-list from cs.LG) [pdf, other]

Title: Graph Classification Gaussian Processes via Spectral Features

Felix L. Opolka, Yin-Cong Zhi, Pietro Liò, Xiaowen Dong

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[735] arXiv:2306.03801 (cross-list from cs.LG) [pdf, html, other]

Title: Stable Vectorization of Multiparameter Persistent Homology using Signed Barcodes as Measures

David Loiseaux, Luis Scoccola, Mathieu Carrière, Magnus Bakke Botnan, Steve Oudot

Comments: 26 pages, 4 figures, 9 tables; v2: final version in NeurIPS 2023

Subjects: Machine Learning (cs.LG); Computational Geometry (cs.CG); Algebraic Topology (math.AT); Machine Learning (stat.ML)

[736] arXiv:2306.03928 (cross-list from cs.LG) [pdf, html, other]

Title: Designing Decision Support Systems Using Counterfactual Prediction Sets

Eleni Straitouri, Manuel Gomez Rodriguez

Comments: Best paper award in the ICML 2023 AI&HCI Workshop, spotlight paper at ICML 2024

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Methodology (stat.ME); Machine Learning (stat.ML)

[737] arXiv:2306.03929 (cross-list from cs.LG) [pdf, other]

Title: Finding Counterfactually Optimal Action Sequences in Continuous State Spaces

Stratis Tsirtsis, Manuel Gomez-Rodriguez

Comments: Accepted at NeurIPS 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (stat.ML)

[738] arXiv:2306.03949 (cross-list from cs.LG) [pdf, other]

Title: Partial Inference in Structured Prediction

Chuyang Ke, Jean Honorio

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[739] arXiv:2306.03955 (cross-list from math.NA) [pdf, other]

Title: Kernel quadrature with randomly pivoted Cholesky

Ethan N. Epperly, Elvira Moreno

Comments: 19 pages, 3 figures; NeurIPS 2023 (spotlight), camera-ready version

Subjects: Numerical Analysis (math.NA); Machine Learning (stat.ML)

[740] arXiv:2306.03962 (cross-list from cs.LG) [pdf, other]

Title: PILLAR: How to make semi-private learning more effective

Francesco Pinto, Yaxi Hu, Fanny Yang, Amartya Sanyal

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[741] arXiv:2306.03982 (cross-list from cs.LG) [pdf, other]

Title: Globally injective and bijective neural operators

Takashi Furuya, Michael Puthawala, Matti Lassas, Maarten V. de Hoop

Comments: 39 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[742] arXiv:2306.04049 (cross-list from cs.LG) [pdf, other]

Title: One-sided Matrix Completion from Two Observations Per Row

Steven Cao, Percy Liang, Gregory Valiant

Comments: ICML 2023

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[743] arXiv:2306.04066 (cross-list from cs.LG) [pdf, other]

Title: Intelligent sampling for surrogate modeling, hyperparameter optimization, and data analysis

Chandrika Kamath

Comments: 4 Tables, 18 Figures

Journal-ref: Machine Learning with Applications, Volume 9, September 2022

Subjects: Machine Learning (cs.LG); Computation (stat.CO)

[744] arXiv:2306.04111 (cross-list from cs.LG) [pdf, other]

Title: Quasi-Newton Updating for Large-Scale Distributed Learning

Shuyuan Wu, Danyang Huang, Hansheng Wang

Comments: 56 pages, 3 figures

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Methodology (stat.ME)

[745] arXiv:2306.04120 (cross-list from cs.LG) [pdf, html, other]

Title: MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation

Tony Tohme, Mohsen Sadr, Kamal Youcef-Toumi, Nicolas G. Hadjiconstantinou

Comments: Published in Transactions on Machine Learning Research (TMLR)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)

[746] arXiv:2306.04174 (cross-list from math.OC) [pdf, other]

Title: End-to-End Learning for Stochastic Optimization: A Bayesian Perspective

Yves Rychener, Daniel Kuhn, Tobias Sutter

Comments: Accepted at ICML 2023

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[747] arXiv:2306.04177 (cross-list from econ.EM) [pdf, html, other]

Title: Semiparametric Efficiency Gains From Parametric Restrictions on Propensity Scores

Haruki Kono

Subjects: Econometrics (econ.EM); Statistics Theory (math.ST)

[748] arXiv:2306.04201 (cross-list from cs.LG) [pdf, other]

Title: Improving Hyperparameter Learning under Approximate Inference in Gaussian Process Models

Rui Li, ST John, Arno Solin

Comments: International Conference on Machine Learning (ICML) 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[749] arXiv:2306.04251 (cross-list from cs.LG) [pdf, html, other]

Title: Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks

Feng Chen, Daniel Kunin, Atsushi Yamamura, Surya Ganguli

Comments: 37 pages, 12 figures, NeurIPS 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[750] arXiv:2306.04292 (cross-list from cs.AI) [pdf, other]

Title: Dear XAI Community, We Need to Talk! Fundamental Misconceptions in Current XAI Research

Timo Freiesleben, Gunnar König

Comments: A revised version of this preprint has been accepted at the World XAI Conference. It will be referenced as soon as it is published

Subjects: Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[751] arXiv:2306.04396 (cross-list from cs.CV) [pdf, other]

Title: Improving Diffusion-based Image Translation using Asymmetric Gradient Guidance

Gihyun Kwon, Jong Chul Ye

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[752] arXiv:2306.04444 (cross-list from cs.LG) [pdf, other]

Title: Fast Optimal Locally Private Mean Estimation via Random Projections

Hilal Asi, Vitaly Feldman, Jelani Nelson, Huy L. Nguyen, Kunal Talwar

Comments: Added the correct github link

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[753] arXiv:2306.04532 (cross-list from cs.NE) [pdf, other]

Title: Long Sequence Hopfield Memory

Hamza Tahir Chaudhry, Jacob A. Zavatone-Veth, Dmitry Krotov, Cengiz Pehlevan

Comments: NeurIPS 2023 Camera-Ready, 41 pages

Journal-ref: Advances in Neural Information Processing Systems 36 (2023)

Subjects: Neural and Evolutionary Computing (cs.NE); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC); Machine Learning (stat.ML)

[754] arXiv:2306.04539 (cross-list from cs.LG) [pdf, html, other]

Title: Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications

Paul Pu Liang, Chun Kai Ling, Yun Cheng, Alex Obolenskiy, Yudong Liu, Rohan Pandey, Alex Wilf, Louis-Philippe Morency, Ruslan Salakhutdinov

Comments: ICLR 2024, Code available at: this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (stat.ML)

[755] arXiv:2306.04606 (cross-list from econ.EM) [pdf, other]

Title: Network-based Representations and Dynamic Discrete Choice Models for Multiple Discrete Choice Analysis

Hung Tran, Tien Mai

Subjects: Econometrics (econ.EM); Computation (stat.CO)

[756] arXiv:2306.04637 (cross-list from cs.LG) [pdf, other]

Title: Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selection

Yu Bai, Fan Chen, Huan Wang, Caiming Xiong, Song Mei

Comments: V2 releases code

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Statistics Theory (math.ST); Machine Learning (stat.ML)

[757] arXiv:2306.04647 (cross-list from eess.SP) [pdf, html, other]

Title: Compressed Sensing: A Discrete Optimization Approach

Dimitris Bertsimas, Nicholas A. G. Johnson

Journal-ref: Springer Machine Learning 2024

Subjects: Signal Processing (eess.SP); Machine Learning (cs.LG); Machine Learning (stat.ML)

[758] arXiv:2306.04648 (cross-list from cs.LG) [pdf, other]

Title: On training locally adaptive CP

Nicolo Colombo

Comments: 15 pages, 1 table, 1 figure

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[759] arXiv:2306.04675 (cross-list from cs.LG) [pdf, other]

Title: Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models

George Stein, Jesse C. Cresswell, Rasa Hosseinzadeh, Yi Sui, Brendan Leigh Ross, Valentin Villecroze, Zhaoyan Liu, Anthony L. Caterini, J. Eric T. Taylor, Gabriel Loaiza-Ganem

Comments: NeurIPS 2023. 53 pages, 29 figures, 12 tables. Code at this https URL, reviews at this https URL

Journal-ref: Thirty-seventh Conference on Neural Information Processing Systems (2023)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[760] arXiv:2306.04730 (cross-list from eess.SP) [pdf, other]

Title: Stochastic Natural Thresholding Algorithms

Rachel Grotheer, Shuang Li, Anna Ma, Deanna Needell, Jing Qin

Subjects: Signal Processing (eess.SP); Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC); Machine Learning (stat.ML)

[761] arXiv:2306.04734 (cross-list from math.RT) [pdf, other]

Title: Machine-Learning Kronecker Coefficients

Kyu-Hwan Lee

Subjects: Representation Theory (math.RT); Combinatorics (math.CO); Machine Learning (stat.ML)

[762] arXiv:2306.04775 (cross-list from cs.LG) [pdf, html, other]

Title: Exploiting Observation Bias to Improve Matrix Completion

Yassir Jedra, Sean Mann, Charlotte Park, Devavrat Shah

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[763] arXiv:2306.04777 (cross-list from cs.LG) [pdf, html, other]

Title: Invariant Causal Set Covering Machines

Thibaud Godon, Baptiste Bauvin, Pascal Germain, Jacques Corbeil, Alexandre Drouin

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[764] arXiv:2306.04785 (cross-list from cs.LG) [pdf, html, other]

Title: Interpretable Deep Clustering for Tabular Data

Jonathan Svirsky, Ofir Lindenbaum

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[765] arXiv:2306.04793 (cross-list from cs.LG) [pdf, other]

Title: On the Joint Interaction of Models, Data, and Features

Yiding Jiang, Christina Baek, J. Zico Kolter

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[766] arXiv:2306.04815 (cross-list from cs.LG) [pdf, other]

Title: Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning

Libin Zhu, Chaoyue Liu, Adityanarayanan Radhakrishnan, Mikhail Belkin

Comments: ICML 2024

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[767] arXiv:2306.04843 (cross-list from quant-ph) [pdf, other]

Title: Classical Verification of Quantum Learning

Matthias C. Caro, Marcel Hinsche, Marios Ioannou, Alexander Nietner, Ryan Sweke

Comments: 12 + 46 + 23 pages, 1 table, 1 figure; V2 fixes some typos and includes new results in Section 6.3

Journal-ref: In 15th Innovations in Theoretical Computer Science Conference (ITCS 2024). Leibniz International Proceedings in Informatics (LIPIcs), Volume 287, pp. 24:1-24:23, Schloss Dagstuhl -- Leibniz-Zentrum f\"ur Informatik (2024)

Subjects: Quantum Physics (quant-ph); Computational Complexity (cs.CC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[768] arXiv:2306.04848 (cross-list from cs.LG) [pdf, html, other]

Title: Interpreting and Improving Diffusion Models from an Optimization Perspective

Frank Permenter, Chenyang Yuan

Comments: 24 pages, 9 figures, 4 tables. To appear in ICML 2024

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC); Machine Learning (stat.ML)

[769] arXiv:2306.04902 (cross-list from cs.DS) [pdf, other]

Title: A Cover Time Study of a non-Markovian Algorithm

Guanhua Fang, Gennady Samorodnitsky, Zhiqiang Xu

Comments: 25 pages

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST)

[770] arXiv:2306.04923 (cross-list from cs.LG) [pdf, other]

Title: Unconstrained Online Learning with Unbounded Losses

Andrew Jacobsen, Ashok Cutkosky

Comments: 41 pages; ICML 2023; v2: fixed some details in the exposition introducing saddle-point problems

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[771] arXiv:2306.04924 (cross-list from cs.LG) [pdf, other]

Title: Exact Optimality of Communication-Privacy-Utility Tradeoffs in Distributed Mean Estimation

Berivan Isik, Wei-Ning Chen, Ayfer Ozgur, Tsachy Weissman, Albert No

Comments: Published at the Conference on Neural Information Processing Systems (NeurIPS), 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Machine Learning (stat.ML)

[772] arXiv:2306.04933 (cross-list from cs.CL) [pdf, other]

Title: InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding

Junda Wu, Tong Yu, Rui Wang, Zhao Song, Ruiyi Zhang, Handong Zhao, Chaochao Lu, Shuai Li, Ricardo Henao

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[773] arXiv:2306.05059 (cross-list from cs.CY) [pdf, html, other]

Title: Reconciling Predictive and Statistical Parity: A Causal Approach

Drago Plecko, Elias Bareinboim

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[774] arXiv:2306.05066 (cross-list from cs.AI) [pdf, other]

Title: Causal Fairness for Outcome Control

Drago Plecko, Elias Bareinboim

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[775] arXiv:2306.05100 (cross-list from math.OC) [pdf, html, other]

Title: Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates

Siqi Zhang, Sayantan Choudhury, Sebastian U Stich, Nicolas Loizou

Comments: ICLR 2024

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)