Machine Learning

Authors and titles for March 2023

[201] arXiv:2303.04245 (cross-list from cs.LG) [pdf, other]

Title: How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding

Yuchen Li, Yuanzhi Li, Andrej Risteski

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[202] arXiv:2303.04286 (cross-list from stat.ME) [pdf, other]

Title: Sufficient dimension reduction for feature matrices

Chanwoo Lee

Comments: 30 pages, 3 figures

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[203] arXiv:2303.04338 (cross-list from cs.LG) [pdf, other]

Title: Provable Pathways: Learning Multiple Tasks over Multiple Paths

Yingcong Li, Samet Oymak

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[204] arXiv:2303.04379 (cross-list from cs.LG) [pdf, other]

Title: HappyMap: A Generalized Multi-calibration Method

Zhun Deng, Cynthia Dwork, Linjun Zhang

Comments: Appeared at ITCS 2023 (submitted on Sept. 8th, 2022)

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Methodology (stat.ME); Machine Learning (stat.ML)

[205] arXiv:2303.04397 (cross-list from cs.LG) [pdf, other]

Title: The Lie-Group Bayesian Learning Rule

Eren Mehmet Kıral, Thomas Möllenhoff, Mohammad Emtiyaz Khan

Comments: AISTATS 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[206] arXiv:2303.04435 (cross-list from cs.LG) [pdf, other]

Title: A Message Passing Perspective on Learning Dynamics of Contrastive Learning

Yifei Wang, Qi Zhang, Tianqi Du, Jiansheng Yang, Zhouchen Lin, Yisen Wang

Comments: ICLR 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[207] arXiv:2303.04437 (cross-list from cs.LG) [pdf, other]

Title: Learning Hybrid Interpretable Models: Theory, Taxonomy, and Methods

Julien Ferry (LAAS-ROC), Gabriel Laberge (EPM), Ulrich Aïvodji (ETS)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[208] arXiv:2303.04444 (cross-list from math.ST) [pdf, other]

Title: A note on $L^1$-Convergence of the Empiric Minimizer for unbounded functions with fast growth

Pierre Bras

Comments: 10 pages

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[209] arXiv:2303.04614 (cross-list from cs.LG) [pdf, other]

Title: Densely Connected $G$-invariant Deep Neural Networks with Signed Permutation Representations

Devanshu Agrawal, James Ostrowski

Comments: 40 pages, 2 figures, 4 tables. For associated code repository see this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[210] arXiv:2303.04743 (cross-list from cs.LG) [pdf, other]

Title: Vector Quantized Time Series Generation with a Bidirectional Prior Model

Daesoo Lee, Sara Malacarne, Erlend Aune

Comments: accepted at AISTATS 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[211] arXiv:2303.04745 (cross-list from cs.LG) [pdf, other]

Title: A General Theory of Correct, Incorrect, and Extrinsic Equivariance

Dian Wang, Xupeng Zhu, Jung Yeon Park, Mingxi Jia, Guanang Su, Robert Platt, Robin Walters

Comments: Published at NeurIPS 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[212] arXiv:2303.04756 (cross-list from stat.ME) [pdf, other]

Title: Meta-learning Control Variates: Variance Reduction with Limited Data

Zhuo Sun, Chris J. Oates, François-Xavier Briol

Comments: Accepted for publication (with an oral presentation) at UAI 2023

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[213] arXiv:2303.04772 (cross-list from cs.LG) [pdf, html, other]

Title: Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation

Paul Hagemann, Sophie Mildenberger, Lars Ruthotto, Gabriele Steidl, Nicole Tianjiao Yang

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Probability (math.PR); Machine Learning (stat.ML)

[214] arXiv:2303.04797 (cross-list from cs.LG) [pdf, other]

Title: Automatic Debiased Learning from Positive, Unlabeled, and Exposure Data

Masahiro Kato, Shuting Wu, Kodai Kureishi, Shota Yasui

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[215] arXiv:2303.04845 (cross-list from cs.LG) [pdf, other]

Title: Smoothed Analysis of Sequential Probability Assignment

Alankrita Bhatt, Nika Haghtalab, Abhishek Shetty

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (stat.ML)

[216] arXiv:2303.04859 (cross-list from cs.LG) [pdf, other]

Title: Agnostic PAC Learning of k-juntas Using L2-Polynomial Regression

Mohsen Heidari, Wojciech Szpankowski

Comments: AISTATS 2023

Subjects: Machine Learning (cs.LG); Computational Complexity (cs.CC); Information Theory (cs.IT); Machine Learning (stat.ML)

[217] arXiv:2303.05024 (cross-list from math.ST) [pdf, other]

Title: Phase transition for detecting a small community in a large network

Jiashun Jin, Zheng Tracy Ke, Paxton Turner, Anru R. Zhang

Subjects: Statistics Theory (math.ST); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[218] arXiv:2303.05148 (cross-list from cs.CV) [pdf, other]

Title: Weakly Supervised Knowledge Transfer with Probabilistic Logical Reasoning for Object Detection

Martijn Oldenhof, Adam Arany, Yves Moreau, Edward De Brouwer

Comments: Accepted to ICLR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[219] arXiv:2303.05445 (cross-list from cs.LG) [pdf, html, other]

Title: Flooding with Absorption: An Efficient Protocol for Heterogeneous Bandits over Complex Networks

Junghyun Lee, Laura Schmid, Se-Young Yun

Comments: 25 pages, 6 figures. Accepted to the 27th International Conference on Principles of Distributed Systems (OPODIS 2023) - Best Student Paper

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI); Machine Learning (stat.ML)

[220] arXiv:2303.05485 (cross-list from cs.LG) [pdf, other]

Title: Efficient Testable Learning of Halfspaces with Adversarial Label Noise

Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis, Sihan Liu, Nikos Zarifis

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[221] arXiv:2303.05487 (cross-list from cs.AI) [pdf, other]

Title: Learning Rational Subgoals from Demonstrations and Instructions

Zhezheng Luo, Jiayuan Mao, Jiajun Wu, Tomás Lozano-Pérez, Joshua B. Tenenbaum, Leslie Pack Kaelbling

Comments: AAAI 2023. First two authors contributed equally. Project page: this https URL

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[222] arXiv:2303.05490 (cross-list from cs.LG) [pdf, other]

Title: On the Expressiveness and Generalization of Hypergraph Neural Networks

Zhezheng Luo, Jiayuan Mao, Joshua B. Tenenbaum, Leslie Pack Kaelbling

Comments: Learning on Graphs Conference (LoG) 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[223] arXiv:2303.05496 (cross-list from cs.LG) [pdf, other]

Title: Sparse and Local Networks for Hypergraph Reasoning

Guangxuan Xiao, Leslie Pack Kaelbling, Jiajun Wu, Jiayuan Mao

Comments: Learning on Graphs Conference (LoG) 2022. Project page: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[224] arXiv:2303.05501 (cross-list from cs.AI) [pdf, other]

Title: PDSketch: Integrated Planning Domain Programming and Learning

Jiayuan Mao, Tomás Lozano-Pérez, Joshua B. Tenenbaum, Leslie Pack Kaelbling

Comments: Minor typo fixes. NeurIPS 2022. Project page: this https URL

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO); Machine Learning (stat.ML)

[225] arXiv:2303.05504 (cross-list from q-bio.QM) [pdf, other]

Title: Computable Phenotypes to Characterize Changing Patient Brain Dysfunction in the Intensive Care Unit

Yuanfang Ren (1 and 2), Tyler J. Loftus (1 and 3), Ziyuan Guan (1 and 2), Rayon Uddin (1), Benjamin Shickel (1 and 2), Carolina B. Maciel (4), Katharina Busl (4), Parisa Rashidi (1 and 5), Azra Bihorac (1 and 2), Tezcan Ozrazgat-Baslanti (1 and 2) ((1) Intelligent Critical Care Center, University of Florida, Gainesville, FL, (2) Department of Medicine, College of Medicine, University of Florida, Gainesville, FL, (3) Department of Surgery, College of Medicine, University of Florida, Gainesville, FL, (4) Department of Neurology, Neurocritical Care Division, College of Medicine, University of Florida, Gainesville, FL, (5) Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL)

Comments: 21 pages, 5 figures, 3 tables, 1 eTable

Subjects: Quantitative Methods (q-bio.QM); Machine Learning (cs.LG); Machine Learning (stat.ML)

[226] arXiv:2303.05506 (cross-list from cs.LG) [pdf, other]

Title: TANGOS: Regularizing Tabular Neural Networks through Gradient Orthogonalization and Specialization

Alan Jeffares, Tennison Liu, Jonathan Crabbé, Fergus Imrie, Mihaela van der Schaar

Comments: Published at International Conference on Learning Representations (ICLR) 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[227] arXiv:2303.05606 (cross-list from cs.LG) [pdf, other]

Title: Variance-aware robust reinforcement learning with linear function approximation under heavy-tailed rewards

Xiang Li, Qiang Sun

Comments: 23 page main text, 42 page appendix

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Statistics Theory (math.ST); Machine Learning (stat.ML)

[228] arXiv:2303.05731 (cross-list from cs.LG) [pdf, other]

Title: Upper Bound of Real Log Canonical Threshold of Tensor Decomposition and its Application to Bayesian Inference

Naoki Yoshida, Sumio Watanabe

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[229] arXiv:2303.05754 (cross-list from cs.LG) [pdf, other]

Title: Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problems

Hyungjin Chung, Suhyeon Lee, Jong Chul Ye

Comments: ICLR 2024; 28 pages, 9 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[230] arXiv:2303.05798 (cross-list from cs.LG) [pdf, other]

Title: Sliced-Wasserstein on Symmetric Positive Definite Matrices for M/EEG Signals

Clément Bonet, Benoît Malézieux, Alain Rakotomamonjy, Lucas Drumetz, Thomas Moreau, Matthieu Kowalski, Nicolas Courty

Comments: Published as a conference paper at ICML2023

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)

[231] arXiv:2303.05838 (cross-list from math.PR) [pdf, other]

Title: Rosenthal-type inequalities for linear statistics of Markov chains

Alain Durmus, Eric Moulines, Alexey Naumov, Sergey Samsonov, Marina Sheshukova

Subjects: Probability (math.PR); Statistics Theory (math.ST); Machine Learning (stat.ML)

[232] arXiv:2303.05909 (cross-list from stat.ME) [pdf, other]

Title: A pseudo-likelihood approach to community detection in weighted networks

Andressa Cerqueira, Elizaveta Levina

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[233] arXiv:2303.05958 (cross-list from cs.CL) [pdf, other]

Title: Robust Knowledge Distillation from RNN-T Models With Noisy Training Labels Using Full-Sum Loss

Mohammad Zeineldeen, Kartik Audhkhasi, Murali Karthick Baskar, Bhuvana Ramabhadran

Comments: Accepted at ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[234] arXiv:2303.05981 (cross-list from stat.ME) [pdf, other]

Title: Feature Importance: A Closer Look at Shapley Values and LOCO

Isabella Verdinelli, Larry Wasserman

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[235] arXiv:2303.06058 (cross-list from cs.LG) [pdf, html, other]

Title: A General Recipe for the Analysis of Randomized Multi-Armed Bandit Algorithms

Dorian Baudry, Kazuya Suzuki, Junya Honda

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[236] arXiv:2303.06067 (cross-list from cs.LG) [pdf, other]

Title: Modeling Events and Interactions through Temporal Processes -- A Survey

Angelica Liguori, Luciano Caroprese, Marco Minici, Bruno Veloso, Francesco Spinnato, Mirco Nanni, Giuseppe Manco, Joao Gama

Comments: Image replacements

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[237] arXiv:2303.06075 (cross-list from cs.LG) [pdf, other]

Title: Long-tailed Classification from a Bayesian-decision-theory Perspective

Bolian Li, Ruqi Zhang

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[238] arXiv:2303.06171 (cross-list from cs.LG) [pdf, other]

Title: DP-Fast MH: Private, Fast, and Accurate Metropolis-Hastings for Large-Scale Bayesian Inference

Wanrong Zhang, Ruqi Zhang

Journal-ref: published at ICML 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[239] arXiv:2303.06198 (cross-list from math.ST) [pdf, other]

Title: Deflated HeteroPCA: Overcoming the curse of ill-conditioning in heteroskedastic PCA

Yuchen Zhou, Yuxin Chen

Comments: accepted to Annals of Statistics

Journal-ref: The Annals of Statistics, vol. 53, no.1, pp. 91-116, 2025

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[240] arXiv:2303.06208 (cross-list from cs.LG) [pdf, other]

Title: Fast computation of permutation equivariant layers with the partition algebra

Charles Godfrey, Michael G. Rawson, Davis Brown, Henry Kvinge

Comments: Comments welcome!

Subjects: Machine Learning (cs.LG); Combinatorics (math.CO); Representation Theory (math.RT); Machine Learning (stat.ML)

[241] arXiv:2303.06296 (cross-list from cs.LG) [pdf, other]

Title: Stabilizing Transformer Training by Preventing Attention Entropy Collapse

Shuangfei Zhai, Tatiana Likhomanenko, Etai Littwin, Dan Busbridge, Jason Ramapuram, Yizhe Zhang, Jiatao Gu, Josh Susskind

Journal-ref: In International Conference on Machine Learning (pp. 40770-40803). PMLR. 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[242] arXiv:2303.06396 (cross-list from cs.LG) [pdf, other]

Title: No-regret Algorithms for Fair Resource Allocation

Abhishek Sinha, Ativ Joshi, Rajarshi Bhattacharjee, Cameron Musco, Mohammad Hajiesmaili

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[243] arXiv:2303.06398 (cross-list from stat.CO) [pdf, other]

Title: Variational Gaussian filtering via Wasserstein gradient flows

Adrien Corenflos, Hany Abdulsamad

Comments: 5 pages, 2 figures, double column, minor modifications compared to version 1 (more experiments + typos). Accepted as a conference paper to EUSIPCO 2023

Subjects: Computation (stat.CO); Computational Engineering, Finance, and Science (cs.CE); Systems and Control (eess.SY); Machine Learning (stat.ML)

[244] arXiv:2303.06484 (cross-list from cs.LG) [pdf, other]

Title: Generalizing and Decoupling Neural Collapse via Hyperspherical Uniformity Gap

Weiyang Liu, Longhui Yu, Adrian Weller, Bernhard Schölkopf

Comments: ICLR 2023 (v2: fixed typos)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[245] arXiv:2303.06526 (cross-list from cs.LG) [pdf, other]

Title: Data Dependent Regret Guarantees Against General Comparators for Full or Bandit Feedback

Kaan Gokcesu, Hakan Gokcesu

Comments: this article draws from arXiv:2009.04372,arXiv:2109.09212,arXiv:2204.06660

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP); Optimization and Control (math.OC); Machine Learning (stat.ML)

[246] arXiv:2303.06561 (cross-list from cs.LG) [pdf, other]

Title: Phase Diagram of Initial Condensation for Two-layer Neural Networks

Zhengan Chen, Yuqing Li, Tao Luo, Zhangchen Zhou, Zhi-Qin John Xu

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Optimization and Control (math.OC); Machine Learning (stat.ML)

[247] arXiv:2303.06562 (cross-list from cs.LG) [pdf, other]

Title: ContraNorm: A Contrastive Learning Perspective on Oversmoothing and Beyond

Xiaojun Guo, Yifei Wang, Tianqi Du, Yisen Wang

Comments: ICLR 2023

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[248] arXiv:2303.06614 (cross-list from cs.LG) [pdf, other]

Title: Synthetic Experience Replay

Cong Lu, Philip J. Ball, Yee Whye Teh, Jack Parker-Holder

Comments: Published at NeurIPS, 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[249] arXiv:2303.06815 (cross-list from cs.LG) [pdf, other]

Title: On Model Compression for Neural Networks: Framework, Algorithm, and Convergence Guarantee

Chenyang Li, Jihoon Chung, Mengnan Du, Haimin Wang, Xianlian Zhou, Bo Shen

Comments: 44 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[250] arXiv:2303.06825 (cross-list from cs.LG) [pdf, other]

Title: Best-of-three-worlds Analysis for Linear Bandits with Follow-the-regularized-leader Algorithm

Fang Kong, Canzhe Zhao, Shuai Li

Comments: Accepted in COLT 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[251] arXiv:2303.06966 (cross-list from stat.AP) [pdf, other]

Title: A new methodology to predict the oncotype scores based on clinico-pathological data with similar tumor profiles

Zeina Al Masry (FEMTO-ST), Romain Pic (LMB), Clément Dombry (LMB), Christine Devalland (HNFC)

Subjects: Applications (stat.AP); Quantitative Methods (q-bio.QM); Machine Learning (stat.ML)

[252] arXiv:2303.06992 (cross-list from cs.LG) [pdf, other]

Title: Improving Mutual Information Estimation with Annealed and Energy-Based Bounds

Rob Brekelmans, Sicong Huang, Marzyeh Ghassemi, Greg Ver Steeg, Roger Grosse, Alireza Makhzani

Comments: A shorter version appeared in the International Conference on Learning Representations (ICLR) 2022

Journal-ref: ICLR 2022 https://openreview.net/forum?id=T0B9AoM_bFg

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[253] arXiv:2303.07109 (cross-list from cs.LG) [pdf, other]

Title: Transformer-based World Models Are Happy With 100k Interactions

Jan Robine, Marc Höftmann, Tobias Uelwer, Stefan Harmeling

Comments: Published as a conference paper at ICLR 2023. Code is available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[254] arXiv:2303.07152 (cross-list from math.ST) [pdf, html, other]

Title: Score Attack: A Lower Bound Technique for Optimal Differentially Private Learning

T. Tony Cai, Yichen Wang, Linjun Zhang

Subjects: Statistics Theory (math.ST); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[255] arXiv:2303.07154 (cross-list from cs.LG) [pdf, html, other]

Title: Differential Good Arm Identification

Yun-Da Tsai, Tzu-Hsien Tsai, Shou-De Lin

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[256] arXiv:2303.07158 (cross-list from q-fin.PM) [pdf, html, other]

Title: Uniform Pessimistic Risk and its Optimal Portfolio

Sungchul Hong, Jong-June Jeon

Subjects: Portfolio Management (q-fin.PM); Machine Learning (cs.LG); Computation (stat.CO); Machine Learning (stat.ML)

[257] arXiv:2303.07160 (cross-list from cs.LG) [pdf, other]

Title: Tighter Lower Bounds for Shuffling SGD: Random Permutations and Beyond

Jaeyoung Cha, Jaewook Lee, Chulhee Yun

Comments: 58 pages

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[258] arXiv:2303.07167 (cross-list from stat.ME) [pdf, html, other]

Title: When Respondents Don't Care Anymore: Identifying the Onset of Careless Responding

Max Welz, Andreas Alfons

Comments: 88 pages, 11 figures (+22 in appendix)

Subjects: Methodology (stat.ME); Applications (stat.AP); Machine Learning (stat.ML)

[259] arXiv:2303.07170 (cross-list from physics.chem-ph) [pdf, other]

Title: Validation of uncertainty quantification metrics: a primer based on the consistency and adaptivity concepts

Pascal Pernot

Subjects: Chemical Physics (physics.chem-ph); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[260] arXiv:2303.07203 (cross-list from cs.CL) [pdf, other]

Title: On the Robustness of Text Vectorizers

Rémi Catellier, Samuel Vaiter, Damien Garreau

Comments: Accepted to ICML 2023. 33 pages, 10 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[261] arXiv:2303.07271 (cross-list from math.OC) [pdf, other]

Title: Provably Convergent Plug-and-Play Quasi-Newton Methods

Hong Ye Tan, Subhadip Mukherjee, Junqi Tang, Carola-Bibiane Schönlieb

Subjects: Optimization and Control (math.OC); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[262] arXiv:2303.07279 (cross-list from cs.IT) [pdf, html, other]

Title: Universal coding, intrinsic volumes, and metric complexity

Jaouad Mourtada

Comments: Minor revision; 56 pages

Subjects: Information Theory (cs.IT); Metric Geometry (math.MG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[263] arXiv:2303.07329 (cross-list from stat.AP) [pdf, other]

Title: Application of targeted maximum likelihood estimation in public health and epidemiological studies: a systematic review

Matthew J. Smith, Rachael V. Phillips, Miguel Angel Luque-Fernandez, Camille Maringe

Comments: 42 pages, 2 figures, 2 tables

Subjects: Applications (stat.AP); Methodology (stat.ME); Machine Learning (stat.ML)

[264] arXiv:2303.07597 (cross-list from cs.LG) [pdf, other]

Title: Fast Regularized Discrete Optimal Transport with Group-Sparse Regularizers

Yasutoshi Ida, Sekitoshi Kanai, Kazuki Adachi, Atsutoshi Kumagai, Yasuhiro Fujiwara

Comments: This is an extended version of the paper accepted by the 37th AAAI Conference on Artificial Intelligence (AAAI 2023)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[265] arXiv:2303.07627 (cross-list from cs.LG) [pdf, other]

Title: Best arm identification in rare events

Anirban Bhattacharjee, Sushant Vijayan, Sandeep K Juneja

Comments: 32 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[266] arXiv:2303.07757 (cross-list from cs.LG) [pdf, other]

Title: Multiway clustering of 3-order tensor via affinity matrix

Dina Faneva Andriantsiory, Joseph Ben Geloun, Mustapha Lebbah

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[267] arXiv:2303.07768 (cross-list from cs.LG) [pdf, other]

Title: DBSCAN of Multi-Slice Clustering for Third-Order Tensors

Dina Faneva Andriantsiory, Joseph Ben Geloun, Mustapha Lebbah

Comments: 13 pages, improved version, typos removed, text restructured, same results

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[268] arXiv:2303.07773 (cross-list from q-fin.MF) [pdf, other]

Title: Axiomatic characterization of pointwise Shapley decompositions

Marcus C Christiansen

Subjects: Mathematical Finance (q-fin.MF); General Economics (econ.GN); Machine Learning (stat.ML)

[269] arXiv:2303.07874 (cross-list from cs.LG) [pdf, other]

Title: Bayes Complexity of Learners vs Overfitting

Grzegorz Głuch, Rudiger Urbanke

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[270] arXiv:2303.08068 (cross-list from cs.CV) [pdf, other]

Title: Style Feature Extraction Using Contrastive Conditioned Variational Autoencoders with Mutual Information Constraints

Suguru Yasutomi, Toshihisa Tanaka

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[271] arXiv:2303.08081 (cross-list from cs.LG) [pdf, other]

Title: Explanation Shift: How Did the Distribution Shift Impact the Model?

Carlos Mougan, Klaus Broelemann, David Masip, Gjergji Kasneci, Thanassis Thiropanis, Steffen Staab

Comments: arXiv admin note: text overlap with arXiv:2210.12369

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[272] arXiv:2303.08102 (cross-list from cs.LG) [pdf, other]

Title: Information-Theoretic Regret Bounds for Bandits with Fixed Expert Advice

Khaled Eldowa, Nicolò Cesa-Bianchi, Alberto Maria Metelli, Marcello Restelli

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[273] arXiv:2303.08230 (cross-list from cs.LG) [pdf, other]

Title: Bayesian Beta-Bernoulli Process Sparse Coding with Deep Neural Networks

Arunesh Mittal, Kai Yang, Paul Sajda, John Paisley

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[274] arXiv:2303.08431 (cross-list from cs.LG) [pdf, html, other]

Title: Policy Gradient Converges to the Globally Optimal Policy for Nearly Linear-Quadratic Regulators

Yinbin Han, Meisam Razaviyayn, Renyuan Xu

Comments: 34 pages

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[275] arXiv:2303.08433 (cross-list from cs.LG) [pdf, other]

Title: The Benefits of Mixup for Feature Learning

Difan Zou, Yuan Cao, Yuanzhi Li, Quanquan Gu

Comments: 72 pages, 4 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)

[276] arXiv:2303.08456 (cross-list from cs.CG) [pdf, other]

Title: Statistical learning on measures: an application to persistence diagrams

Olympio Hacquard (LMO, DATASHAPE), Gilles Blanchard (LMO, DATASHAPE), Clément Levrard (LPSM)

Subjects: Computational Geometry (cs.CG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[277] arXiv:2303.08587 (cross-list from cs.LG) [pdf, other]

Title: Delay-SDE-net: A deep learning approach for time series modelling with memory and uncertainty estimates

Mari Dahl Eggen, Alise Danielle Midtfjord

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[278] arXiv:2303.08613 (cross-list from cs.LG) [pdf, other]

Title: Learning to Incentivize Information Acquisition: Proper Scoring Rules Meet Principal-Agent Model

Siyu Chen, Jibang Wu, Yifan Wu, Zhuoran Yang

Comments: 35 pages, adding an impossible result (Lemma 3.2) with its proof in Section D.1

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Science and Game Theory (cs.GT); Theoretical Economics (econ.TH); Machine Learning (stat.ML)

[279] arXiv:2303.08622 (cross-list from cs.CV) [pdf, other]

Title: Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfer

Serin Yang, Hyunmin Hwang, Jong Chul Ye

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[280] arXiv:2303.08625 (cross-list from cs.LG) [pdf, other]

Title: Interpretable Ensembles of Hyper-Rectangles as Base Models

Andrei V. Konstantinov, Lev V. Utkin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[281] arXiv:2303.08691 (cross-list from eess.SP) [pdf, other]

Title: Learning to Reconstruct Signals From Binary Measurements

Julián Tachella, Laurent Jacques

Comments: this https URL

Journal-ref: TMLR 2023 (Featured paper)

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[282] arXiv:2303.08720 (cross-list from cs.LG) [pdf, other]

Title: Practicality of generalization guarantees for unsupervised domain adaptation with neural networks

Adam Breitholtz, Fredrik D. Johansson

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[283] arXiv:2303.08732 (cross-list from stat.AP) [pdf, other]

Title: Predicting Individualized Effects of Internet-Based Treatment for Genito-Pelvic Pain/Penetration Disorder: Development and Internal Validation of a Multivariable Decision Tree Model

Anna-Carlotta Zarski, Mathias Harrer, Paula Kuper, Antonia A. Sprenger, Matthias Berking, David Daniel Ebert

Subjects: Applications (stat.AP); Methodology (stat.ME); Machine Learning (stat.ML)

[284] arXiv:2303.08816 (cross-list from cs.LG) [pdf, other]

Title: Borda Regret Minimization for Generalized Linear Dueling Bandits

Yue Wu, Tao Jin, Hao Lou, Farzad Farnoud, Quanquan Gu

Comments: 33 pages, 5 figure. This version includes new results for dueling bandits in the adversarial setting

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[285] arXiv:2303.08902 (cross-list from quant-ph) [pdf, other]

Title: Learning ground states of gapped quantum Hamiltonians with Kernel Methods

Clemens Giuliani, Filippo Vicentini, Riccardo Rossi, Giuseppe Carleo

Journal-ref: Quantum 7, 1096 (2023)

Subjects: Quantum Physics (quant-ph); Machine Learning (cs.LG); Computational Physics (physics.comp-ph); Machine Learning (stat.ML)

[286] arXiv:2303.09166 (cross-list from cs.LG) [pdf, other]

Title: Identifiability Results for Multimodal Contrastive Learning

Imant Daunhawer, Alice Bizeul, Emanuele Palumbo, Alexander Marx, Julia E. Vogt

Comments: ICLR 2023 camera-ready version

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[287] arXiv:2303.09261 (cross-list from math.OC) [pdf, other]

Title: Orthogonal Directions Constrained Gradient Method: from non-linear equality constraints to Stiefel manifold

Sholom Schechtman, Daniil Tiapkin, Michael Muehlebach, Eric Moulines

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[288] arXiv:2303.09350 (cross-list from cs.LG) [pdf, html, other]

Title: Unsupervised domain adaptation by learning using privileged information

Adam Breitholtz, Anton Matsson, Fredrik D. Johansson

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[289] arXiv:2303.09390 (cross-list from cs.LG) [pdf, other]

Title: On the Interplay Between Misspecification and Sub-optimality Gap in Linear Contextual Bandits

Weitong Zhang, Jiafan He, Zhiyuan Fan, Quanquan Gu

Comments: 28 pages, 2 figures, 2 tables

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[290] arXiv:2303.09408 (cross-list from math.OC) [pdf, other]

Title: Distributionally Robust Optimization using Cost-Aware Ambiguity Sets

Mathijs Schuurmans, Panagiotis Patrinos

Comments: Revision; More general formulation and additional experiments

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[291] arXiv:2303.09470 (cross-list from cs.LG) [pdf, html, other]

Title: Learning with Noisy Labels through Learnable Weighting and Centroid Similarity

Farooq Ahmad Wani, Maria Sofia Bucarelli, Fabrizio Silvestri

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[292] arXiv:2303.09491 (cross-list from quant-ph) [pdf, other]

Title: Challenges and Opportunities in Quantum Machine Learning

M. Cerezo, Guillaume Verdon, Hsin-Yuan Huang, Lukasz Cincio, Patrick J. Coles

Comments: 14 pages, 5 figures

Journal-ref: Nature Computational Science 2, 567-576 (2022)

Subjects: Quantum Physics (quant-ph); Machine Learning (cs.LG); Machine Learning (stat.ML)

[293] arXiv:2303.09531 (cross-list from cs.LG) [pdf, other]

Title: GLASU: A Communication-Efficient Algorithm for Federated Learning with Vertically Distributed Graph Data

Xinwei Zhang, Mingyi Hong, Jie Chen

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[294] arXiv:2303.09705 (cross-list from cs.LG) [pdf, other]

Title: Batch Updating of a Posterior Tree Distribution over a Meta-Tree

Yuta Nakahara, Toshiyasu Matsushima

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[295] arXiv:2303.09842 (cross-list from eess.SY) [pdf, other]

Title: Error Bounds for Kernel-Based Linear System Identification with Unknown Hyperparameters

Mingzhou Yin, Roy S. Smith

Subjects: Systems and Control (eess.SY); Machine Learning (stat.ML)

[296] arXiv:2303.09989 (cross-list from cs.LG) [pdf, other]

Title: Finding Competence Regions in Domain Generalization

Jens Müller, Stefan T. Radev, Robert Schmier, Felix Draxler, Carsten Rother, Ullrich Köthe

Comments: The paper has been published at TMLR (see this https URL)

Journal-ref: Transactions on Machine Learning Research (06/2023)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[297] arXiv:2303.09995 (cross-list from cond-mat.dis-nn) [pdf, other]

Title: Neural-prior stochastic block model

O. Duranthon, L. Zdeborová

Journal-ref: Mach. Learn.: Sci. Technol. 4 035017 (2023)

Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[298] arXiv:2303.10085 (cross-list from stat.ME) [pdf, other]

Title: Robust probabilistic inference via a constrained transport metric

Abhisek Chakraborty, Anirban Bhattacharya, Debdeep Pati

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[299] arXiv:2303.10104 (cross-list from math.ST) [pdf, other]

Title: A Robustness Analysis of Blind Source Separation

Alexander Schell

Comments: 66 pages, 1 figure

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[300] arXiv:2303.10144 (cross-list from cs.LG) [pdf, other]

Title: Dynamic Update-to-Data Ratio: Minimizing World Model Overfitting

Nicolai Dorka, Tim Welschehold, Wolfram Burgard

Comments: ICLR 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)