Machine Learning

Authors and titles for July 2021

[101] arXiv:2107.12723 [pdf, other]

Title: Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel

Dominic Richards, Ilja Kuzborskij

Comments: Neurips 2021 camera ready

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[102] arXiv:2107.12783 [pdf, other]

Title: Statistical Guarantees for Fairness Aware Plug-In Algorithms

Drona Khurana, Srinivasan Ravichandran, Sparsh Jain, Narayanan Unny Edakunni

Comments: This paper was accepted at the workshop on Socially Responsible Machine Learning, ICML 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[103] arXiv:2107.12797 [pdf, other]

Title: Wasserstein-Splitting Gaussian Process Regression for Heterogeneous Online Bayesian Inference

Michael E. Kepler, Alec Koppel, Amrit Singh Bedi, Daniel J. Stilwell

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[104] arXiv:2107.13430 [pdf, other]

Title: Kernel Density Estimation by Stagewise Algorithm with a Simple Dictionary

Kiheiji Nishida, Kanta Naito

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[105] arXiv:2107.13721 [pdf, other]

Title: Amplitude Mean of Functional Data on $\mathbb{S}^2$

Zhengwu Zhang, Bayan Saparbayeva

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Functional Analysis (math.FA); Applications (stat.AP)

[106] arXiv:2107.13735 [pdf, other]

Title: Learning the temporal evolution of multivariate densities via normalizing flows

Yubin Lu, Romit Maulik, Ting Gao, Felix Dietrich, Ioannis G. Kevrekidis, Jinqiao Duan

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS); Probability (math.PR)

[107] arXiv:2107.14203 [pdf, other]

Title: Did the Model Change? Efficiently Assessing Machine Learning API Shifts

Lingjiao Chen, Tracy Cai, Matei Zaharia, James Zou

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Applications (stat.AP)

[108] arXiv:2107.14324 [pdf, other]

Title: Deep Networks Provably Classify Data on Curves

Tingran Wang, Sam Buchanan, Dar Gilboa, John Wright

Comments: NeurIPS 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[109] arXiv:2107.14442 [pdf, other]

Title: Distribution free optimality intervals for clustering

Marina Meilă, Hanyu Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[110] arXiv:2107.00052 (cross-list from cs.LG) [pdf, other]

Title: Stochastic Gradient Descent-Ascent and Consensus Optimization for Smooth Games: Convergence Analysis under Expected Co-coercivity

Nicolas Loizou, Hugo Berard, Gauthier Gidel, Ioannis Mitliagkas, Simon Lacoste-Julien

Comments: 35th Conference on Neural Information Processing Systems (NeurIPS 2021)

Subjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Optimization and Control (math.OC); Machine Learning (stat.ML)

[111] arXiv:2107.00055 (cross-list from cs.LG) [pdf, other]

Title: Approximate Regions of Attraction in Learning with Decision-Dependent Distributions

Roy Dong, Heling Zhang, Lillian J. Ratliff

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Machine Learning (stat.ML)

[112] arXiv:2107.00068 (cross-list from cs.LG) [pdf, other]

Title: Robust and Fully-Dynamic Coreset for Continuous-and-Bounded Learning (With Outliers) Problems

Zixiu Wang, Yiwen Guo, Hu Ding

Comments: 23 pages

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[113] arXiv:2107.00096 (cross-list from cs.LG) [pdf, other]

Title: Improving black-box optimization in VAE latent space using decoder uncertainty

Pascal Notin, José Miguel Hernández-Lobato, Yarin Gal

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[114] arXiv:2107.00179 (cross-list from math.ST) [pdf, other]

Title: Distributed Nonparametric Function Estimation: Optimal Rate of Convergence and Cost of Adaptation

T. Tony Cai, Hongji Wei

Subjects: Statistics Theory (math.ST); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[115] arXiv:2107.00204 (cross-list from cs.LG) [pdf, other]

Title: Markov Decision Process modeled with Bandits for Sequential Decision Making in Linear-flow

Wenjun Zeng, Yi Liu

Comments: Accepted by 2021 KDD Multi-Armed Bandits and Reinforcement Learning Workshop: this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[116] arXiv:2107.00360 (cross-list from cs.CV) [pdf, other]

Title: Towards Measuring Bias in Image Classification

Nina Schaaf, Omar de Mitri, Hang Beom Kim, Alexander Windberger, Marco F. Huber

Comments: Accepted for publication at the 30th International Conference on Artificial Neural Networks (ICANN)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[117] arXiv:2107.00429 (cross-list from cs.LG) [pdf, other]

Title: Neural Network Training with Highly Incomplete Datasets

Yu-Wei Chang, Laura Natali, Oveis Jamialahmadi, Stefano Romeo, Joana B. Pereira, Giovanni Volpe

Comments: 11 pages, 3 figures, 1 table

Subjects: Machine Learning (cs.LG); Quantitative Methods (q-bio.QM); Machine Learning (stat.ML)

[118] arXiv:2107.00464 (cross-list from math.OC) [pdf, other]

Title: On the Convergence of Stochastic Extragradient for Bilinear Games using Restarted Iteration Averaging

Chris Junchi Li, Yaodong Yu, Nicolas Loizou, Gauthier Gidel, Yi Ma, Nicolas Le Roux, Michael I. Jordan

Comments: Camera-ready version appeared at AISTATS 2022; short version appeared at NeurIPS OPT 2021 Workshop

Subjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[119] arXiv:2107.00520 (cross-list from cs.LG) [pdf, other]

Title: Out-of-distribution Generalization in the Presence of Nuisance-Induced Spurious Correlations

Aahlad Puli, Lily H. Zhang, Eric K. Oermann, Rajesh Ranganath

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[120] arXiv:2107.00531 (cross-list from cs.CY) [pdf, other]

Title: Towards a fairer reimbursement system for burn patients using cost-sensitive classification

Chimdimma Noelyn Onah, Richard Allmendinger, Julia Handl, Ken W. Dunn

Comments: Joint KDD 2021 Health Day and 2021 KDD Workshop on Applied Data Science for Healthcare: State of XAI and trustworthiness in Health

Subjects: Computers and Society (cs.CY); Machine Learning (stat.ML)

[121] arXiv:2107.00593 (cross-list from cs.LG) [pdf, other]

Title: Disaggregated Interventions to Reduce Inequality

Lucius E. J. Bynum, Joshua R. Loftus, Julia Stoyanovich

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Applications (stat.AP); Machine Learning (stat.ML)

[122] arXiv:2107.00594 (cross-list from eess.AS) [pdf, other]

Title: Pretext Tasks selection for multitask self-supervised speech representation learning

Salah Zaiem, Titouan Parcollet, Slim Essid, Abdel Heba

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[123] arXiv:2107.00595 (cross-list from cs.LG) [pdf, other]

Title: Fast Margin Maximization via Dual Acceleration

Ziwei Ji, Nathan Srebro, Matus Telgarsky

Comments: ICML 2021

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[124] arXiv:2107.00630 (cross-list from cs.LG) [pdf, other]

Title: Variational Diffusion Models

Diederik P. Kingma, Tim Salimans, Ben Poole, Jonathan Ho

Comments: Published at NeurIPS'21

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[125] arXiv:2107.00637 (cross-list from cs.LG) [pdf, other]

Title: Generalization and Robustness Implications in Object-Centric Learning

Andrea Dittadi, Samuele Papa, Michele De Vita, Bernhard Schölkopf, Ole Winther, Francesco Locatello

Comments: Published at ICML 2022

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[126] arXiv:2107.00656 (cross-list from cs.LG) [pdf, other]

Title: Shared Data and Algorithms for Deep Learning in Fundamental Physics

Lisa Benato, Erik Buhmann, Martin Erdmann, Peter Fackeldey, Jonas Glombitza, Nikolai Hartmann, Gregor Kasieczka, William Korcari, Thomas Kuhr, Jan Steinheimer, Horst Stöcker, Tilman Plehn, Kai Zhou

Comments: 14 pages, 3 figures, 5 tables - Version accepted by Computing and Software for Big Science

Journal-ref: Comput Softw Big Sci 6, 9 (2022)

Subjects: Machine Learning (cs.LG); Instrumentation and Methods for Astrophysics (astro-ph.IM); High Energy Physics - Phenomenology (hep-ph); Nuclear Theory (nucl-th); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[127] arXiv:2107.00685 (cross-list from cs.LG) [pdf, other]

Title: Gap-Dependent Bounds for Two-Player Markov Games

Zehao Dou, Zhuoran Yang, Zhaoran Wang, Simon S.Du

Comments: 34 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[128] arXiv:2107.00745 (cross-list from cs.LG) [pdf, other]

Title: q-Paths: Generalizing the Geometric Annealing Path using Power Means

Vaden Masrani, Rob Brekelmans, Thang Bui, Frank Nielsen, Aram Galstyan, Greg Ver Steeg, Frank Wood

Comments: arXiv admin note: text overlap with arXiv:2012.07823

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[129] arXiv:2107.00758 (cross-list from cs.LG) [pdf, other]

Title: The Spotlight: A General Method for Discovering Systematic Errors in Deep Learning Models

Greg d'Eon, Jason d'Eon, James R. Wright, Kevin Leyton-Brown

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[130] arXiv:2107.00816 (cross-list from cs.LG) [pdf, other]

Title: Few-shot Learning for Unsupervised Feature Selection

Atsutoshi Kumagai, Tomoharu Iwata, Yasuhiro Fujiwara

Comments: 20 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[131] arXiv:2107.00819 (cross-list from cs.LG) [pdf, other]

Title: Decision tree heuristics can fail, even in the smoothed setting

Guy Blanc, Jane Lange, Mingda Qiao, Li-Yang Tan

Comments: To appear in RANDOM 2021

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[132] arXiv:2107.00833 (cross-list from cs.IR) [pdf, other]

Title: Quantifying Availability and Discovery in Recommender Systems via Stochastic Reachability

Mihaela Curmei, Sarah Dean, Benjamin Recht

Comments: to appear ICML 2021

Subjects: Information Retrieval (cs.IR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[133] arXiv:2107.00871 (cross-list from cs.LG) [pdf, other]

Title: Reconsidering Dependency Networks from an Information Geometry Perspective

Kazuya Takabatake, Shotaro Akaho

Comments: 28pages, 7figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[134] arXiv:2107.00995 (cross-list from cs.DS) [pdf, other]

Title: Online Matching in Sparse Random Graphs: Non-Asymptotic Performances of Greedy Algorithm

Nathan Noiry, Flore Sentenac, Vianney Perchet

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[135] arXiv:2107.00996 (cross-list from cs.LG) [pdf, other]

Title: DeformRS: Certifying Input Deformations with Randomized Smoothing

Motasem Alfarra, Adel Bibi, Naeemullah Khan, Philip H. S. Torr, Bernard Ghanem

Comments: Accepted to AAAI Conference on Artificial Intelligence (AAAI'22)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[136] arXiv:2107.01103 (cross-list from stat.ME) [pdf, other]

Title: Generalized Multivariate Signs for Nonparametric Hypothesis Testing in High Dimensions

Subhabrata Majumdar, Snigdhansu Chatterjee

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[137] arXiv:2107.01509 (cross-list from cs.LG) [pdf, other]

Title: Bayesian decision-making under misspecified priors with applications to meta-learning

Max Simchowitz, Christopher Tosh, Akshay Krishnamurthy, Daniel Hsu, Thodoris Lykouris, Miroslav Dudík, Robert E. Schapire

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[138] arXiv:2107.01561 (cross-list from cs.LG) [pdf, other]

Title: Certifiably Robust Interpretation via Renyi Differential Privacy

Ao Liu, Xiaoyu Chen, Sijia Liu, Lirong Xia, Chuang Gan

Comments: 19 page main text + appendix

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[139] arXiv:2107.01606 (cross-list from cs.LG) [pdf, other]

Title: A Comparison of the Delta Method and the Bootstrap in Deep Learning Classification

Geir K. Nilsen, Antonella Z. Munthe-Kaas, Hans J. Skaug, Morten Brun

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[140] arXiv:2107.01718 (cross-list from math.ST) [pdf, other]

Title: Rates of Estimation of Optimal Transport Maps using Plug-in Estimators via Barycentric Projections

Nabarun Deb, Promit Ghosal, Bodhisattva Sen

Comments: 40 pages

Subjects: Statistics Theory (math.ST); Probability (math.PR); Machine Learning (stat.ML)

[141] arXiv:2107.01777 (cross-list from math.ST) [pdf, other]

Title: Optimal Binary Classification Beyond Accuracy

Shashank Singh, Justin Khim

Comments: Parts of this paper have been revised from arXiv:2004.04715v2 [math.ST]

Subjects: Statistics Theory (math.ST); Machine Learning (cs.LG); Machine Learning (stat.ML)

[142] arXiv:2107.01784 (cross-list from cs.CV) [pdf, other]

Title: Learning a Model for Inferring a Spatial Road Lane Network Graph using Self-Supervision

Robin Karlsson, David Robert Wong, Simon Thompson, Kazuya Takeda

Comments: Accepted for IEEE ITSC 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[143] arXiv:2107.01820 (cross-list from cs.LG) [pdf, other]

Title: An Explainable AI System for the Diagnosis of High Dimensional Biomedical Data

Alfred Ultsch, Jörg Hoffmann, Maximilian Röhnert, Malte Von Bonin, Uta Oelschlägel, Cornelia Brendel, Michael C. Thrun

Comments: 29 pages, 5 figure, 5 tables, data available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Quantitative Methods (q-bio.QM); Machine Learning (stat.ML)

[144] arXiv:2107.01835 (cross-list from cs.LG) [pdf, other]

Title: Fast Rate Learning in Stochastic First Price Bidding

Juliette Achddou (DI-ENS, VALDA ), Olivier Cappé (VALDA, DI-ENS), Aurélien Garivier (UMPA-ENSL)

Journal-ref: ACML 2021 - Proceedings of Machine Learning Research 157, 2021, Nov 2021, SIngapore, Singapore

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[145] arXiv:2107.01848 (cross-list from cs.LG) [pdf, other]

Title: Differentially Private Sliced Wasserstein Distance

Alain Rakotomamonjy (DocApp - LITIS), Liva Ralaivola

Journal-ref: International Conference of Machine Learning, Jul 2021, Virtual, France

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[146] arXiv:2107.01850 (cross-list from stat.ME) [pdf, other]

Title: Matching a Desired Causal State via Shift Interventions

Jiaqi Zhang, Chandler Squires, Caroline Uhler

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[147] arXiv:2107.01952 (cross-list from cs.LG) [pdf, other]

Title: Partition and Code: learning how to compress graphs

Giorgos Bouritsas, Andreas Loukas, Nikolaos Karalias, Michael M. Bronstein

Comments: Published at NeurIPS 2021

Journal-ref: Proc. Adv. Neur. Inf. Process. Syst. (NeurIPS) vol. 34 pp. 18603 - 18619 (2021)

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[148] arXiv:2107.01959 (cross-list from cs.LG) [pdf, other]

Title: Universal Approximation of Functions on Sets

Edward Wagstaff, Fabian B. Fuchs, Martin Engelcke, Michael A. Osborne, Ingmar Posner

Comments: 54 pages, 13 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[149] arXiv:2107.02010 (cross-list from cs.CV) [pdf, other]

Title: Fast and Scalable Optimal Transport for Brain Tractograms

Jean Feydy, Pierre Roussillon, Alain Trouvé, Pietro Gori

Comments: MICCAI 2019

Journal-ref: MICCAI 2019

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[150] arXiv:2107.02085 (cross-list from stat.ME) [pdf, other]

Title: Analyzing Relevance Vector Machines using a single penalty approach

Anand Dixit, Vivekananda Roy

Comments: 25 pages

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)