Machine Learning

Authors and titles for April 2024

[51] arXiv:2404.09962 [pdf, html, other]

Title: Invariant Subspace Decomposition

Margherita Lazzaretto, Jonas Peters, Niklas Pfister

Comments: 60 pages, 14 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[52] arXiv:2404.10122 [pdf, html, other]

Title: Online Estimation via Offline Estimation: An Information-Theoretic Framework

Dylan J. Foster, Yanjun Han, Jian Qian, Alexander Rakhlin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[53] arXiv:2404.10207 [pdf, html, other]

Title: HELLINGER-UCB: A novel algorithm for stochastic multi-armed bandit problem and cold start problem in recommender system

Ruibo Yang, Jiazhou Wang, Andrew Mullhaupt

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[54] arXiv:2404.10261 [pdf, html, other]

Title: Lighter, Better, Faster Multi-Source Domain Adaptation with Gaussian Mixture Models and Optimal Transport

Eduardo Fernandes Montesuma, Fred Ngolè Mboula, Antoine Souloumiac

Comments: 13 pages, 6 figures, accepted as a research track paper at the ECML-PKDD 2024 conference

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[55] arXiv:2404.10351 [pdf, other]

Title: On the Use of Relative Validity Indices for Comparing Clustering Approaches

Luke W. Yerbury, Ricardo J. G. B. Campello, G. C. Livingston Jr, Mark Goldsworthy, Lachlan O'Neil

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[56] arXiv:2404.10727 [pdf, html, other]

Title: How Deep Networks Learn Sparse and Hierarchical Data: the Sparse Random Hierarchy Model

Umberto Tomasini, Matthieu Wyart

Comments: 9 pages, 6 figures

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[57] arXiv:2404.11330 [pdf, html, other]

Title: Toward Understanding the Disagreement Problem in Neural Network Feature Attribution

Niklas Koenen, Marvin N. Wright

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[58] arXiv:2404.11509 [pdf, html, other]

Title: VC Theory for Inventory Policies

Yaqi Xie, Will Ma, Linwei Xin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[59] arXiv:2404.11965 [pdf, html, other]

Title: Multi-fidelity Gaussian process surrogate modeling for regression problems in physics

Kislaya Ravi, Vladyslav Fediukov, Felix Dietrich, Tobias Neckel, Fabian Buse, Michael Bergmann, Hans-Joachim Bungartz

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)

[60] arXiv:2404.12290 [pdf, other]

Title: Debiased Distribution Compression

Lingxiao Li, Raaz Dwivedi, Lester Mackey

Comments: Published at ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[61] arXiv:2404.12294 [pdf, html, other]

Title: Bayesian evidence estimation from posterior samples with normalizing flows

Rahul Srinivasan, Marco Crisostomi, Roberto Trotta, Enrico Barausse, Matteo Breschi

Comments: 15 pages, 8 figures, 1 table

Journal-ref: PhysRevD.110.123007(2024)

Subjects: Machine Learning (stat.ML); Cosmology and Nongalactic Astrophysics (astro-ph.CO); Machine Learning (cs.LG); General Relativity and Quantum Cosmology (gr-qc)

[62] arXiv:2404.12356 [pdf, html, other]

Title: Improving the interpretability of GNN predictions through conformal-based graph sparsification

Pablo Sanchez-Martin, Kinaan Aamir Khan, Isabel Valera

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[63] arXiv:2404.12478 [pdf, other]

Title: A New Reliable & Parsimonious Learning Strategy Comprising Two Layers of Gaussian Processes, to Address Inhomogeneous Empirical Correlation Structures

Gargi Roy, Dalia Chakrabarty

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[64] arXiv:2404.12481 [pdf, html, other]

Title: Understanding Optimal Feature Transfer via a Fine-Grained Bias-Variance Analysis

Yufan Li, Subhabrata Sen, Ben Adlam

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[65] arXiv:2404.12484 [pdf, html, other]

Title: Neural Methods for Amortized Inference

Andrew Zammit-Mangion, Matthew Sainsbury-Dale, Raphaël Huser

Comments: 45 pages, 11 figures, 2 tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[66] arXiv:2404.12586 [pdf, html, other]

Title: Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$-Lifted Kullback--Leibler Divergence

Mark Chiu Chong, Hien Duy Nguyen, TrungTin Nguyen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[67] arXiv:2404.12613 [pdf, html, other]

Title: A Fourier Approach to the Parameter Estimation Problem for One-dimensional Gaussian Mixture Models

Xinyu Liu, Hai Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP); Methodology (stat.ME)

[68] arXiv:2404.12862 [pdf, html, other]

Title: A Guide to Feature Importance Methods for Scientific Inference

Fiona Katharina Ewald, Ludwig Bothmann, Marvin N. Wright, Bernd Bischl, Giuseppe Casalicchio, Gunnar König

Journal-ref: Longo, L., Lapuschkin, S., Seifert, C. (eds) Explainable Artificial Intelligence. xAI 2024. Communications in Computer and Information Science, vol 2154. Springer, Cham

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[69] arXiv:2404.12923 [pdf, html, other]

Title: Probabilistic Numeric SMC Sampling for Bayesian Nonlinear System Identification in Continuous Time

Joe D. Longbottom, Max D. Champneys, Timothy J. Rogers

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[70] arXiv:2404.12940 [pdf, html, other]

Title: Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modelling

Grigory Bartosh, Dmitry Vetrov, Christian A. Naesseth

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[71] arXiv:2404.13147 [pdf, html, other]

Title: Multiclass ROC

Liang Wang, Luis Carvalho

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[72] arXiv:2404.13198 [pdf, other]

Title: An economically-consistent discrete choice model with flexible utility specification based on artificial neural networks

Jose Ignacio Hernandez, Niek Mouter, Sander van Cranenburgh

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM)

[73] arXiv:2404.13240 [pdf, html, other]

Title: Learning In Reverse Causal Strategic Environments With Ramifications on Two Sided Markets

Seamus Somerstep, Yuekai Sun, Ya'acov Ritov

Comments: 22 pages, 5 figures

Subjects: Machine Learning (stat.ML); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG)

[74] arXiv:2404.13309 [pdf, other]

Title: Latent Schr{ö}dinger Bridge Diffusion Model for Generative Learning

Yuling Jiao, Lican Kang, Huazhen Lin, Jin Liu, Heng Zuo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[75] arXiv:2404.13557 [pdf, html, other]

Title: Preconditioned Neural Posterior Estimation for Likelihood-free Inference

Xiaoyu Wang, Ryan P. Kelly, David J. Warne, Christopher Drovandi

Comments: 31 pages, 11 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[76] arXiv:2404.13649 [pdf, html, other]

Title: Distributional Principal Autoencoders

Xinwei Shen, Nicolai Meinshausen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[77] arXiv:2404.13731 [pdf, html, other]

Title: Training-Conditional Coverage Bounds for Uniformly Stable Learning Algorithms

Mehrdad Pournaderi, Yu Xiang

Comments: Accepted to the ISIT 2024 workshop on Information-Theoretic Methods for Trustworthy Machine Learning (IT-TML)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[78] arXiv:2404.14276 [pdf, html, other]

Title: A Bayesian Approach for Prioritising Driving Behaviour Investigations in Telematic Auto Insurance Policies

Mark McLeod, Bernardo Perez-Orozco, Nika Lee, Davide Zilli

Comments: International Congress of Actuaries (2023)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[79] arXiv:2404.14460 [pdf, html, other]

Title: Inference of Causal Networks using a Topological Threshold

Filipe Barroso, Diogo Gomes, Gareth J. Baxter

Comments: 17 pages, 12 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[80] arXiv:2404.14743 [pdf, html, other]

Title: Gradient Guidance for Diffusion Models: An Optimization Perspective

Yingqing Guo, Hui Yuan, Yukang Yang, Minshuo Chen, Mengdi Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[81] arXiv:2404.14873 [pdf, html, other]

Title: Estimating the Distribution of Parameters in Differential Equations with Repeated Cross-Sectional Data

Hyeontae Jo, Sung Woong Cho, Hyung Ju Hwang

Comments: 16 pages, 10 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[82] arXiv:2404.15466 [pdf, html, other]

Title: Private Optimal Inventory Policy Learning for Feature-based Newsvendor with Unknown Demand

Tuoyi Zhao, Wen-xin Zhou, Lan Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[83] arXiv:2404.15618 [pdf, html, other]

Title: Neural Operator induced Gaussian Process framework for probabilistic solution of parametric partial differential equations

Sawan Kumar, Rajdip Nayek, Souvik Chakraborty

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[84] arXiv:2404.15746 [pdf, html, other]

Title: Collaborative Heterogeneous Causal Inference Beyond Meta-analysis

Tianyu Guo, Sai Praneeth Karimireddy, Michael I. Jordan

Comments: submitted to ICML

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[85] arXiv:2404.15967 [pdf, html, other]

Title: Interpretable Clustering with the Distinguishability Criterion

Ali Turfah, Xiaoquan Wen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[86] arXiv:2404.16287 [pdf, html, other]

Title: Differentially Private Federated Learning: Servers Trustworthiness, Estimation, and Statistical Inference

Zhe Zhang, Ryumei Nakada, Linjun Zhang

Comments: 56 pages, 3 figures

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[87] arXiv:2404.16328 [pdf, html, other]

Title: Distributionally Robust Safe Screening

Hiroyuki Hanada, Satoshi Akahane, Tatsuya Aoyama, Tomonari Tanaka, Yoshito Okura, Yu Inatsu, Noriaki Hashimoto, Taro Murayama, Lee Hanju, Shinya Kojima, Ichiro Takeuchi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[88] arXiv:2404.16560 [pdf, html, other]

Title: Automated Model Selection for Generalized Linear Models

Benjamin Schwendinger, Florian Schwendinger, Laura Vana-Gür

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[89] arXiv:2404.17398 [pdf, other]

Title: Online Policy Learning and Inference by Matrix Completion

Congyuan Duan, Jingyang Li, Dong Xia

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[90] arXiv:2404.17429 [pdf, html, other]

Title: Separation capacity of linear reservoirs with random connectivity matrix

Youness Boutaib

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[91] arXiv:2404.17442 [pdf, html, other]

Title: Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets

Benjamin Dupuis, Paul Viallard, George Deligiannidis, Umut Simsekli

Journal-ref: Journal of Machine Learning Research (2024)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[92] arXiv:2404.17483 [pdf, html, other]

Title: Differentiable Pareto-Smoothed Weighting for High-Dimensional Heterogeneous Treatment Effect Estimation

Yoichi Chikahara, Kansei Ushiyama

Comments: Accepted to the 40th Conference on Uncertainty in Artificial Intelligence (UAI2024). 14 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[93] arXiv:2404.17644 [pdf, html, other]

Title: A Conditional Independence Test in the Presence of Discretization

Boyang Sun, Yu Yao, Guang-Yuan Hao, Yumou Qiu, Kun Zhang

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[94] arXiv:2404.17709 [pdf, html, other]

Title: Low-rank Matrix Bandits with Heavy-tailed Rewards

Yue Kang, Cho-Jui Hsieh, Thomas C. M. Lee

Comments: The 40th Conference on Uncertainty in Artificial Intelligence (UAI 2024)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[95] arXiv:2404.17856 [pdf, html, other]

Title: Uncertainty quantification for iterative algorithms in linear models with application to early stopping

Pierre C. Bellec, Kai Tan

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Computation (stat.CO); Methodology (stat.ME)

[96] arXiv:2404.18233 [pdf, html, other]

Title: A Note on Asynchronous Challenges: Unveiling Formulaic Bias and Data Loss in the Hayashi-Yoshida Estimator

Evangelos Georgiadis

Comments: submitted. 15 pages, 1 appendix, 4 figures, 1 table, 1 algo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Combinatorics (math.CO); Probability (math.PR)

[97] arXiv:2404.18769 [pdf, html, other]

Title: Learning with Norm Constrained, Over-parameterized, Two-layer Neural Networks

Fanghui Liu, Leello Dadi, Volkan Cevher

Comments: Accepted by JMLR, update on the dimension dependence in sample complexity, see Prop. 5

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[98] arXiv:2404.19073 [pdf, html, other]

Title: Learning Sparse High-Dimensional Matrix-Valued Graphical Models From Dependent Data

Jitendra K Tugnait

Comments: 16 pages, 2 figures, 1 table

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[99] arXiv:2404.19157 [pdf, other]

Title: Scalable Bayesian Inference in the Era of Deep Learning: From Gaussian Processes to Deep Neural Networks

Javier Antoran

Comments: PhD Thesis, University of Cambridge

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[100] arXiv:2404.19220 [pdf, other]

Title: Regression for matrix-valued data via Kronecker products factorization

Yin-Jen Chen, Minh Tang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[101] arXiv:2404.19301 [pdf, other]

Title: Statistics and explainability: a fruitful alliance

Valentina Ghidini

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[102] arXiv:2404.19557 [pdf, other]

Title: Neural Dynamic Data Valuation

Zhangyong Liang, Huanhuan Gao, Ji Zhang

Comments: 43 pages, 19 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[103] arXiv:2404.00015 (cross-list from q-fin.RM) [pdf, html, other]

Title: Empowering Credit Scoring Systems with Quantum-Enhanced Machine Learning

Javier Mancilla, André Sequeira, Tomas Tagliani, Francisco Llaneza, Claudio Beiza

Comments: Preprint

Subjects: Risk Management (q-fin.RM); Machine Learning (cs.LG); Statistical Finance (q-fin.ST); Quantum Physics (quant-ph); Machine Learning (stat.ML)

[104] arXiv:2404.00042 (cross-list from math.OC) [pdf, html, other]

Title: Stochastic Optimization with Constraints: A Non-asymptotic Instance-Dependent Analysis

Koulik Khamaru

Comments: 18 pages

Subjects: Optimization and Control (math.OC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[105] arXiv:2404.00085 (cross-list from cs.LG) [pdf, html, other]

Title: Bayesian Nonparametrics: An Alternative to Deep Learning

Bahman Moraffah

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[106] arXiv:2404.00099 (cross-list from cs.AI) [pdf, html, other]

Title: Efficient and Sharp Off-Policy Evaluation in Robust Markov Decision Processes

Andrew Bennett, Nathan Kallus, Miruna Oprescu, Wen Sun, Kaiwen Wang

Comments: 39 pages, 2 figures, NeurIPS 2024

Subjects: Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[107] arXiv:2404.00221 (cross-list from stat.ME) [pdf, other]

Title: Policy Learning for Optimal Dynamic Treatment Regimes with Observational Data

Shosei Sakaguchi

Subjects: Methodology (stat.ME); Econometrics (econ.EM); Statistics Theory (math.ST); Machine Learning (stat.ML)

[108] arXiv:2404.00438 (cross-list from cs.DC) [pdf, html, other]

Title: Communication Efficient Distributed Training with Distributed Lion

Bo Liu, Lemeng Wu, Lizhang Chen, Kaizhao Liang, Jiaxu Zhu, Chen Liang, Raghuraman Krishnamoorthi, Qiang Liu

Comments: 22 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[109] arXiv:2404.00474 (cross-list from cs.LG) [pdf, html, other]

Title: Linguistic Calibration of Long-Form Generations

Neil Band, Xuechen Li, Tengyu Ma, Tatsunori Hashimoto

Comments: ICML 2024. Code available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[110] arXiv:2404.00505 (cross-list from cs.LG) [pdf, html, other]

Title: Transfer Learning with Reconstruction Loss

Wei Cui, Wei Yu

Comments: 16 pages, 5 figures. To appear in IEEE Transactions on Machine Learning in Communications and Networking (TMLCN)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Networking and Internet Architecture (cs.NI); Machine Learning (stat.ML)

[111] arXiv:2404.00522 (cross-list from cs.LG) [pdf, html, other]

Title: Minimum-Norm Interpolation Under Covariate Shift

Neil Mallinar, Austin Zane, Spencer Frei, Bin Yu

Comments: The Forty-first International Conference on Machine Learning (ICML 2024)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[112] arXiv:2404.00688 (cross-list from cs.LG) [pdf, html, other]

Title: Meta Learning in Bandits within Shared Affine Subspaces

Steven Bilaj, Sofien Dhouib, Setareh Maghsudi

Comments: Accepted in AISTATS 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[113] arXiv:2404.00735 (cross-list from stat.ME) [pdf, html, other]

Title: Two-Stage Nuisance Function Estimation for Causal Mediation Analysis

Chang Liu, AmirEmad Ghassami

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[114] arXiv:2404.00768 (cross-list from cs.DS) [pdf, html, other]

Title: Adversarially-Robust Inference on Trees via Belief Propagation

Samuel B. Hopkins, Anqi Li

Subjects: Data Structures and Algorithms (cs.DS); Probability (math.PR); Statistics Theory (math.ST); Machine Learning (stat.ML)

[115] arXiv:2404.00776 (cross-list from cs.LG) [pdf, html, other]

Title: PyTorch Frame: A Modular Framework for Multi-Modal Tabular Learning

Weihua Hu, Yiwen Yuan, Zecheng Zhang, Akihiro Nitta, Kaidi Cao, Vid Kocijan, Jinu Sunil, Jure Leskovec, Matthias Fey

Comments: this https URL

Subjects: Machine Learning (cs.LG); Databases (cs.DB); Machine Learning (stat.ML)

[116] arXiv:2404.00793 (cross-list from cs.SI) [pdf, other]

Title: Learning the mechanisms of network growth

Lourens Touwen, Doina Bucur, Remco van der Hofstad, Alessandro Garavaglia, Nelly Litvak

Comments: Main text: 13 pages, 4 figures. Supplementary: 12 pages; Textual changes

Journal-ref: Scientific Reports, volume 14, Article number: 11866 (2024)

Subjects: Social and Information Networks (cs.SI); Probability (math.PR); Machine Learning (stat.ML)

[117] arXiv:2404.00912 (cross-list from math.ST) [pdf, html, other]

Title: Inference in Randomized Least Squares and PCA via Normality of Quadratic Forms

Leda Wang, Zhixiang Zhang, Edgar Dobriban

Subjects: Statistics Theory (math.ST); Computation (stat.CO); Methodology (stat.ME); Machine Learning (stat.ML)

[118] arXiv:2404.01100 (cross-list from eess.SY) [pdf, html, other]

Title: Finite Sample Frequency Domain Identification

Anastasios Tsiamis, Mohamed Abdalmoaty, Roy S. Smith, John Lygeros

Comments: Version 2 changes: several typos were fixed and some proof steps were expanded

Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[119] arXiv:2404.01111 (cross-list from cs.IT) [pdf, html, other]

Title: The Rate-Distortion-Perception Trade-off: The Role of Private Randomness

Yassine Hamdi, Aaron B. Wagner, Deniz Gündüz

Comments: Submitted to IEEE ISIT 2024

Subjects: Information Theory (cs.IT); Machine Learning (stat.ML)

[120] arXiv:2404.01141 (cross-list from cs.LG) [pdf, html, other]

Title: SoK: A Review of Differentially Private Linear Models For High-Dimensional Data

Amol Khanna, Edward Raff, Nathan Inkawhich

Comments: 21 pages, 7 figures. To be published at the 2nd IEEE Conference on Secure and Trustworthy Machine Learning (SaTML)

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[121] arXiv:2404.01198 (cross-list from cs.LG) [pdf, html, other]

Title: Nearly-tight Approximation Guarantees for the Improving Multi-Armed Bandits Problem

Avrim Blum, Kavya Ravichandran

Comments: 12 pages, 0 figures

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[122] arXiv:2404.01216 (cross-list from cs.LG) [pdf, html, other]

Title: Novel Node Category Detection Under Subpopulation Shift

Hsing-Huan Chung, Shravan Chaudhari, Yoav Wald, Xing Han, Joydeep Ghosh

Comments: Accepted to ECML-PKDD 2024

Subjects: Machine Learning (cs.LG); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[123] arXiv:2404.01233 (cross-list from math.ST) [pdf, html, other]

Title: Optimal Ridge Regularization for Out-of-Distribution Prediction

Pratik Patil, Jin-Hong Du, Ryan J. Tibshirani

Comments: 59 pages, 14 figures

Subjects: Statistics Theory (math.ST); Machine Learning (cs.LG); Machine Learning (stat.ML)

[124] arXiv:2404.01245 (cross-list from math.ST) [pdf, html, other]

Title: A Statistical Framework of Watermarks for Large Language Models: Pivot, Detection Efficiency and Optimal Rules

Xiang Li, Feng Ruan, Huiyuan Wang, Qi Long, Weijie J. Su

Comments: Accepted by Annals of Statistics

Journal-ref: Ann. Statist. 53(1): 322-351 (February 2025)

Subjects: Statistics Theory (math.ST); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[125] arXiv:2404.01308 (cross-list from cs.AI) [pdf, html, other]

Title: Learning to Solve Job Shop Scheduling under Uncertainty

Guillaume Infantes, Stéphanie Roussel, Pierre Pereira, Antoine Jacquet, Emmanuel Benazera

Comments: To be published at CPAIOR 2024

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[126] arXiv:2404.01413 (cross-list from cs.LG) [pdf, html, other]

Title: Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data

Matthias Gerstgrasser, Rylan Schaeffer, Apratim Dey, Rafael Rafailov, Henry Sleight, John Hughes, Tomasz Korbak, Rajashree Agrawal, Dhruv Pai, Andrey Gromov, Daniel A. Roberts, Diyi Yang, David L. Donoho, Sanmi Koyejo

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Emerging Technologies (cs.ET); Machine Learning (stat.ML)

[127] arXiv:2404.01509 (cross-list from cs.CV) [pdf, html, other]

Title: Can Biases in ImageNet Models Explain Generalization?

Paul Gavrikov, Janis Keuper

Comments: Accepted at CVPR2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[128] arXiv:2404.01595 (cross-list from cs.LG) [pdf, html, other]

Title: Propensity Score Alignment of Unpaired Multimodal Data

Johnny Xi, Jana Osea, Zuheng Xu, Jason Hartford

Comments: NeurIPS 2024

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[129] arXiv:2404.01730 (cross-list from cs.LG) [pdf, html, other]

Title: Asymptotics of Language Model Alignment

Joy Qiping Yang, Salman Salamatian, Ziteng Sun, Ananda Theertha Suresh, Ahmad Beirami

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[130] arXiv:2404.01866 (cross-list from q-fin.TR) [pdf, html, other]

Title: Supervised Autoencoder MLP for Financial Time Series Forecasting

Bartosz Bieganowski, Robert Slepaczuk

Comments: 29 pages, 28 figures, 17 tables

Subjects: Trading and Market Microstructure (q-fin.TR); Machine Learning (stat.ML)

[131] arXiv:2404.01930 (cross-list from cs.LG) [pdf, html, other]

Title: Adaptive Combinatorial Maximization: Beyond Approximate Greedy Policies

Shlomi Weitzman, Sivan Sabato

Comments: ALT 2024

Journal-ref: Proceedings of the 35th International Conference on Algorithmic Learning Theory, PMLR 237:1-20, 2024

Subjects: Machine Learning (cs.LG); Discrete Mathematics (cs.DM); Machine Learning (stat.ML)

[132] arXiv:2404.02141 (cross-list from stat.ME) [pdf, other]

Title: Robustly estimating heterogeneity in factorial data using Rashomon Partitions

Aparajithan Venkateswaran, Anirudh Sankar, Arun G. Chandrasekhar, Tyler H. McCormick

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Econometrics (econ.EM); Computation (stat.CO); Machine Learning (stat.ML)

[133] arXiv:2404.02151 (cross-list from cs.CR) [pdf, html, other]

Title: Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks

Maksym Andriushchenko, Francesco Croce, Nicolas Flammarion

Comments: Accepted at ICLR 2025. Updates in the v3: GPT-4o and Claude 3.5 Sonnet results, improved writing. Updates in the v2: more models (Llama3, Phi-3, Nemotron-4-340B), jailbreak artifacts for all attacks are available, evaluation with different judges (Llama-3-70B and Llama Guard 2), more experiments (convergence plots, ablation on the suffix length for random search), examples of jailbroken generation

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[134] arXiv:2404.02179 (cross-list from cs.IT) [pdf, html, other]

Title: Distributed and Rate-Adaptive Feature Compression

Aditya Deshmukh, Venugopal V. Veeravalli, Gunjan Verma

Subjects: Information Theory (cs.IT); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[135] arXiv:2404.02270 (cross-list from q-fin.ST) [pdf, html, other]

Title: Postprocessing of point predictions for probabilistic forecasting of day-ahead electricity prices: The benefits of using isotonic distributional regression

Arkadiusz Lipiecki, Bartosz Uniejewski, Rafał Weron

Journal-ref: Energy Economics (2024) 107934

Subjects: Statistical Finance (q-fin.ST); Applications (stat.AP); Machine Learning (stat.ML)

[136] arXiv:2404.02343 (cross-list from q-fin.PR) [pdf, html, other]

Title: Improved model-free bounds for multi-asset options using option-implied information and deep learning

Evangelia Dragazi, Shuaiqiang Liu, Antonis Papapantoleon

Subjects: Pricing of Securities (q-fin.PR); Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[137] arXiv:2404.02438 (cross-list from cs.CL) [pdf, html, other]

Title: From Narratives to Numbers: Valid Inference Using Language Model Predictions from Verbal Autopsy Narratives

Shuxian Fan, Adam Visokay, Kentaro Hoffman, Stephen Salerno, Li Liu, Jeffrey T. Leek, Tyler H. McCormick

Comments: 12 pages, 7 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[138] arXiv:2404.02446 (cross-list from cs.LG) [pdf, html, other]

Title: Masked Completion via Structured Diffusion with White-Box Transformers

Druv Pai, Ziyang Wu, Sam Buchanan, Yaodong Yu, Yi Ma

Comments: To be published at ICLR 2024; 44 pages. arXiv admin note: substantial text overlap with arXiv:2311.13110

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[139] arXiv:2404.02591 (cross-list from cs.LG) [pdf, html, other]

Title: Adaptive Sampling Policies Imply Biased Beliefs: A Generalization of the Hot Stove Effect

Jerker Denrell

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[140] arXiv:2404.02866 (cross-list from cs.LG) [pdf, html, other]

Title: Guarantees of confidentiality via Hammersley-Chapman-Robbins bounds

Kamalika Chaudhuri, Chuan Guo, Laurens van der Maaten, Saeed Mahloujifar, Mark Tygert

Comments: 18 pages, 6 figures

Journal-ref: Transactions on Machine Learning Research, article 2496: pp. 1-20, 2024

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Computers and Society (cs.CY); Machine Learning (stat.ML)

[141] arXiv:2404.02954 (cross-list from cs.LG) [pdf, other]

Title: Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections

Gabriel Loaiza-Ganem, Brendan Leigh Ross, Rasa Hosseinzadeh, Anthony L. Caterini, Jesse C. Cresswell

Comments: TMLR 2024 (survey certification, expert certification)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[142] arXiv:2404.02986 (cross-list from cs.LG) [pdf, other]

Title: Universal Functional Regression with Neural Operator Flows

Yaozhong Shi, Angela F. Gao, Zachary E. Ross, Kamyar Azizzadenesheli

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[143] arXiv:2404.03050 (cross-list from cs.LG) [pdf, other]

Title: ANOVA-boosting for Random Fourier Features

Daniel Potts, Laura Weidensager

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[144] arXiv:2404.03099 (cross-list from cs.LG) [pdf, html, other]

Title: Composite Bayesian Optimization In Function Spaces Using NEON -- Neural Epistemic Operator Networks

Leonardo Ferreira Guilhoto, Paris Perdikaris

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Information Theory (cs.IT); Machine Learning (stat.ML)

[145] arXiv:2404.03163 (cross-list from cs.CL) [pdf, html, other]

Title: Uncertainty in Language Models: Assessment through Rank-Calibration

Xinmeng Huang, Shuo Li, Mengxin Yu, Matteo Sesia, Hamed Hassani, Insup Lee, Osbert Bastani, Edgar Dobriban

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[146] arXiv:2404.03250 (cross-list from stat.ME) [pdf, html, other]

Title: Multi-task learning via robust regularized clustering with non-convex group penalties

Akira Okazaki, Shuichi Kawano

Comments: 32 pages

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[147] arXiv:2404.03272 (cross-list from cs.LG) [pdf, html, other]

Title: Cryptographic Hardness of Score Estimation

Min Jae Song

Comments: 28 pages

Subjects: Machine Learning (cs.LG); Computational Complexity (cs.CC); Cryptography and Security (cs.CR); Statistics Theory (math.ST); Machine Learning (stat.ML)

[148] arXiv:2404.03273 (cross-list from cs.LG) [pdf, html, other]

Title: Gaussian-Smoothed Sliced Probability Divergences

Mokhtar Z. Alaya (LMAC), Alain Rakotomamonjy (LITIS), Maxime Berar (LITIS), Gilles Gasso (LITIS)

Comments: arXiv admin note: substantial text overlap with arXiv:2110.10524

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[149] arXiv:2404.03329 (cross-list from cs.LG) [pdf, other]

Title: COMPILED: Deep Metric Learning for Defect Classification of Threaded Pipe Connections using Multichannel Partially Observed Functional Data

Juan Du, Yukun Xie, Chen Zhang

Comments: Submitted version to IISE Transactions

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)

[150] arXiv:2404.03331 (cross-list from math.OC) [pdf, html, other]

Title: LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace

Yan Yang, Bin Gao, Ya-xiang Yuan

Comments: This paper is a camera-ready version of ICLR 2025

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)