Machine Learning

Authors and titles for June 2021

[201] arXiv:2106.14813 [pdf, other]

Title: Offline Planning and Online Learning under Recovering Rewards

David Simchi-Levi, Zeyu Zheng, Feng Zhu

Comments: v1 accepted by ICML 2021

Subjects: Machine Learning (stat.ML); Discrete Mathematics (cs.DM); Machine Learning (cs.LG); Optimization and Control (math.OC)

[202] arXiv:2106.14866 [pdf, other]

Title: Learning from an Exploring Demonstrator: Optimal Reward Estimation for Bandits

Wenshuo Guo, Kumar Krishna Agrawal, Aditya Grover, Vidya Muthukumar, Ashwin Pananjady

Comments: Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS), 2022

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG); Robotics (cs.RO)

[203] arXiv:2106.14997 [pdf, other]

Title: Sharp Lower Bounds on the Approximation Rate of Shallow Neural Networks

Jonathan W. Siegel, Jinchao Xu

Comments: This paper has been merged with arXiv:2101.12365

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[204] arXiv:2106.14999 [pdf, other]

Title: Test-Time Adaptation to Distribution Shift by Confidence Maximization and Input Transformation

Chaithanya Kumar Mummadi, Robin Hutmacher, Kilian Rambach, Evgeny Levinkov, Thomas Brox, Jan Hendrik Metzen

Comments: 16 pages, 5 figures, 7 tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[205] arXiv:2106.15002 [pdf, other]

Title: Characterization of the Variation Spaces Corresponding to Shallow Neural Networks

Jonathan W. Siegel, Jinchao Xu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[206] arXiv:2106.15133 [pdf, other]

Title: Meta-learning for Matrix Factorization without Shared Rows or Columns

Tomoharu Iwata

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[207] arXiv:2106.15216 [pdf, other]

Title: A Non-parametric View of FedAvg and FedProx: Beyond Stationary Points

Lili Su, Jiaming Xu, Pengkun Yang

Subjects: Machine Learning (stat.ML); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Optimization and Control (math.OC)

[208] arXiv:2106.15358 [pdf, other]

Title: Towards Sample-Optimal Compressive Phase Retrieval with Sparse and Generative Priors

Zhaoqiang Liu, Subhroshekhar Ghosh, Jonathan Scarlett

Comments: Accepted to NeurIPS 2021

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[209] arXiv:2106.15379 [pdf, other]

Title: Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey

Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

Comments: To appear as a part of an upcoming textbook on dimensionality reduction and manifold learning. v2: corrected some typos

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[210] arXiv:2106.15427 [pdf, other]

Title: Fast Approximation of the Sliced-Wasserstein Distance Using Concentration of Random Projections

Kimia Nadjahi, Alain Durmus, Pierre E. Jacob, Roland Badeau, Umut Şimşekli

Comments: Published at NeurIPS 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[211] arXiv:2106.15666 [pdf, other]

Title: Probabilistic Graphical Models and Tensor Networks: A Hybrid Framework

Jacob Miller, Geoffrey Roeder, Tai-Danae Bradley

Comments: 18 pages, 11 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantum Physics (quant-ph)

[212] arXiv:2106.15921 [pdf, other]

Title: Monte Carlo Variational Auto-Encoders

Achille Thin, Nikita Kotelevskii, Arnaud Doucet, Alain Durmus, Eric Moulines, Maxim Panov

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[213] arXiv:2106.15933 [pdf, other]

Title: Saddle-to-Saddle Dynamics in Deep Linear Networks: Small Initialization Training, Symmetry, and Sparsity

Arthur Jacot, François Ged, Berfin Şimşek, Clément Hongler, Franck Gabriel

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[214] arXiv:2106.15980 [pdf, other]

Title: Variational Refinement for Importance Sampling Using the Forward Kullback-Leibler Divergence

Ghassen Jerfel, Serena Wang, Clara Fannjiang, Katherine A. Heller, Yian Ma, Michael I. Jordan

Comments: Accepted for the 37th Conference on Uncertainty in Artificial Intelligence (UAI 2021)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[215] arXiv:2106.16239 [pdf, html, other]

Title: Fixed points of nonnegative neural networks

Tomasz J. Piotrowski, Renato L. G. Cavalcante, Mateusz Gabor

Comments: License: CC-BY 4.0, see this https URL. Attribution requirements are provided at this http URL

Journal-ref: Journal of Machine Learning Research, 25(139):1-40, 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[216] arXiv:2106.00006 (cross-list from stat.OT) [pdf, other]

Title: Review of Low Voltage Load Forecasting: Methods, Applications, and Recommendations

Stephen Haben, Siddharth Arora, Georgios Giasemidis, Marcus Voss, Danica Vukadinovic Greetham

Comments: 37 pages, 6 figures, 2 tables, review paper

Journal-ref: Applied Energy 304 (2021) 117798

Subjects: Other Statistics (stat.OT); Machine Learning (stat.ML)

[217] arXiv:2106.00058 (cross-list from cs.LG) [pdf, other]

Title: Stable and Interpretable Unrolled Dictionary Learning

Bahareh Tolooshams, Demba Ba

Comments: Published in Transactions on Machine Learning Research (TMLR) (08/2022)

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)

[218] arXiv:2106.00092 (cross-list from cs.LG) [pdf, other]

Title: Generalized AdaGrad (G-AdaGrad) and Adam: A State-Space Perspective

Kushal Chakrabarti, Nikhil Chopra

Comments: Updates: The parameter condition of Adam in Theorem 2 has been relaxed and the proof has been updated accordingly. Experimental results on logistic regression model have been included. Conference: Accepted for presentation in the 2021 60th IEEE Conference on Decision and Control (CDC)

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Machine Learning (stat.ML)

[219] arXiv:2106.00115 (cross-list from cs.LG) [pdf, other]

Title: Fine-grained Generalization Analysis of Structured Output Prediction

Waleed Mustafa, Yunwen Lei, Antoine Ledent, Marius Kloft

Comments: To appearn in IJCAI 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[220] arXiv:2106.00120 (cross-list from cs.LG) [pdf, other]

Title: Probabilistic Deep Learning with Probabilistic Neural Networks and Deep Probabilistic Models

Daniel T. Chang

Comments: arXiv admin note: text overlap with arXiv:1811.06622

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[221] arXiv:2106.00154 (cross-list from cs.LG) [pdf, other]

Title: Explanations for Monotonic Classifiers

Joao Marques-Silva, Thomas Gerspacher, Martin Cooper, Alexey Ignatiev, Nina Narodytska

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[222] arXiv:2106.00170 (cross-list from stat.ME) [pdf, other]

Title: Adaptive Conformal Inference Under Distribution Shift

Isaac Gibbs, Emmanuel Candès

Comments: 25 pages, 9 figures

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[223] arXiv:2106.00173 (cross-list from cs.LG) [pdf, other]

Title: Enhancing Trajectory Prediction using Sparse Outputs: Application to Team Sports

Brandon Victor, Aiden Nibali, Zhen He, David L. Carey

Comments: 10 pages (not including references), 7 figures. Published in Neural Computing and Applications on 20 March 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[224] arXiv:2106.00175 (cross-list from cs.LG) [pdf, other]

Title: Duckworth-Lewis-Stern Method Comparison with Machine Learning Approach

Kumail Abbas, Sajjad Haider

Comments: The paper has been published in the conference of Frontiers of Information Technology 2019

Journal-ref: 2019 International Conference on Frontiers of Information Technology (FIT), 2019, pp. 197-1975

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[225] arXiv:2106.00225 (cross-list from cs.LG) [pdf, other]

Title: Locally Valid and Discriminative Prediction Intervals for Deep Learning Models

Zhen Lin, Shubhendu Trivedi, Jimeng Sun

Comments: Advances in Neural Information Processing Systems 34 (NeurIPS 2021). Code is available at this https URL

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[226] arXiv:2106.00293 (cross-list from math.OC) [pdf, other]

Title: A Non-commutative Extension of Lee-Seung's Algorithm for Positive Semidefinite Factorizations

Yong Sheng Soh, Antonios Varvitsiotis

Comments: Comments welcome

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)

[227] arXiv:2106.00322 (cross-list from cs.LG) [pdf, other]

Title: Sequential Domain Adaptation by Synthesizing Distributionally Robust Experts

Bahar Taskesen, Man-Chung Yue, Jose Blanchet, Daniel Kuhn, Viet Anh Nguyen

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[228] arXiv:2106.00467 (cross-list from cs.LG) [pdf, other]

Title: A Clarification of the Nuances in the Fairness Metrics Landscape

Alessandro Castelnovo, Riccardo Crupi, Greta Greco, Daniele Regoli, Ilaria Giuseppina Penco, Andrea Claudio Cosentini

Comments: 26 pages, 7 figures, 2 tables, title updated: previous title was "The Zoo of Fairness metrics in Machine Learning", authors updated

Journal-ref: Sci Rep 12, 4209 (2022)

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Machine Learning (stat.ML)

[229] arXiv:2106.00474 (cross-list from cs.LG) [pdf, other]

Title: Gaussian Processes with Differential Privacy

Antti Honkela, Laila Melkas

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[230] arXiv:2106.00477 (cross-list from cs.CR) [pdf, other]

Title: Tight Accounting in the Shuffle Model of Differential Privacy

Antti Koskela, Mikko A. Heikkilä, Antti Honkela

Comments: 21 pages, 5 figures

Subjects: Cryptography and Security (cs.CR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[231] arXiv:2106.00492 (cross-list from stat.ME) [pdf, other]

Title: Logistic Regression Through the Veil of Imprecise Data

Nicholas Gray, Scott Ferson

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[232] arXiv:2106.00545 (cross-list from cs.LG) [pdf, other]

Title: Counterfactual Invariance to Spurious Correlations: Why and How to Pass Stress Tests

Victor Veitch, Alexander D'Amour, Steve Yadlowsky, Jacob Eisenstein

Comments: Published at NeurIPS 2021 (spotlight)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[233] arXiv:2106.00553 (cross-list from cs.LG) [pdf, other]

Title: SHINE: SHaring the INverse Estimate from the forward pass for bi-level optimization and implicit models

Zaccharie Ramzi, Florian Mannel, Shaojie Bai, Jean-Luc Starck, Philippe Ciuciu, Thomas Moreau

Comments: Accepted as a spotlight to ICLR 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[234] arXiv:2106.00555 (cross-list from math.AG) [pdf, other]

Title: Tensor decomposition for learning Gaussian mixtures from moments

Rima Khouja (AROMATH), Pierre-Alexandre Mattei (MAASAI), Bernard Mourrain (AROMATH)

Journal-ref: Journal of Symbolic Computation, Elsevier, 2022, 113, pp.193-210

Subjects: Algebraic Geometry (math.AG); Machine Learning (stat.ML)

[235] arXiv:2106.00651 (cross-list from cs.LG) [pdf, other]

Title: Asymptotics of representation learning in finite Bayesian neural networks

Jacob A. Zavatone-Veth, Abdulkadir Canatar, Benjamin S. Ruben, Cengiz Pehlevan

Comments: 13+28 pages, 4 figures; v3: extensive revision with improved exposition and new section on CNNs, accepted to NeurIPS 2021; v4: minor updates to supplement; v5: post-NeurIPS update, minor typos fixed

Journal-ref: Advances in Neural Information Processing Systems 34 (2021); JSTAT 114008 (2022)

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (stat.ML)

[236] arXiv:2106.00661 (cross-list from cs.AI) [pdf, other]

Title: Reward is enough for convex MDPs

Tom Zahavy, Brendan O'Donoghue, Guillaume Desjardins, Satinder Singh

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[237] arXiv:2106.00665 (cross-list from cs.CL) [pdf, other]

Title: Validating GAN-BioBERT: A Methodology For Assessing Reporting Trends In Clinical Trials

Joshua J Myszewski, Emily Klossowski, Patrick Meyer, Kristin Bevil, Lisa Klesius, Kristopher M Schroeder

Comments: 6 pages, 2 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[238] arXiv:2106.00669 (cross-list from cs.AI) [pdf, other]

Title: Discovering Diverse Nearly Optimal Policies with Successor Features

Tom Zahavy, Brendan O'Donoghue, Andre Barreto, Volodymyr Mnih, Sebastian Flennerhag, Satinder Singh

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[239] arXiv:2106.00694 (cross-list from cs.LG) [pdf, other]

Title: Symmetry-via-Duality: Invariant Neural Network Densities from Parameter-Space Correlators

Anindita Maiti, Keegan Stoner, James Halverson

Comments: 20 pages, 3 figures

Subjects: Machine Learning (cs.LG); High Energy Physics - Theory (hep-th); Machine Learning (stat.ML)

[240] arXiv:2106.00719 (cross-list from cs.LG) [pdf, other]

Title: Stochastic Collapsed Variational Inference for Structured Gaussian Process Regression Network

Rui Meng, Herbie Lee, Kristofer Bouchard

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[241] arXiv:2106.00734 (cross-list from cs.LG) [pdf, other]

Title: Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics

Charles H. Martin, Michael W. Mahoney

Comments: 21 pages; 9 figures; 6 tables

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[242] arXiv:2106.00750 (cross-list from cs.LG) [pdf, other]

Title: Unsupervised Representation Learning for Time Series with Temporal Neighborhood Coding

Sana Tonekaboni, Danny Eytan, Anna Goldenberg

Comments: Camera-ready at ICLR 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[243] arXiv:2106.00797 (cross-list from cs.LG) [pdf, other]

Title: QLSD: Quantised Langevin stochastic dynamics for Bayesian federated learning

Maxime Vono, Vincent Plassier, Alain Durmus, Aymeric Dieuleveut, Eric Moulines

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation (stat.CO); Methodology (stat.ME); Machine Learning (stat.ML)

[244] arXiv:2106.00808 (cross-list from cs.LG) [pdf, other]

Title: Invariant Policy Learning: A Causal Perspective

Sorawit Saengkyongam, Nikolaj Thams, Jonas Peters, Niklas Pfister

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[245] arXiv:2106.00810 (cross-list from cs.LG) [pdf, other]

Title: Some Ethical Issues in the Review Process of Machine Learning Conferences

Alessio Russo

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[246] arXiv:2106.00827 (cross-list from cs.LG) [pdf, other]

Title: Weighting vectors for machine learning: numerical harmonic analysis applied to boundary detection

Eric Bunch, Jeffery Kline, Daniel Dickinson, Suhaas Bhat, Glenn Fung

Comments: 16 pages. arXiv admin note: text overlap with arXiv:2006.14063

Subjects: Machine Learning (cs.LG); Algebraic Topology (math.AT); Machine Learning (stat.ML)

[247] arXiv:2106.00839 (cross-list from cs.LG) [pdf, other]

Title: Algorithmic Insurance

Dimitris Bertsimas, Agni Orfanoudaki

Subjects: Machine Learning (cs.LG); Risk Management (q-fin.RM); Machine Learning (stat.ML)

[248] arXiv:2106.00858 (cross-list from cs.LG) [pdf, other]

Title: Uncertainty Characteristics Curves: A Systematic Assessment of Prediction Intervals

Jiri Navratil, Benjamin Elder, Matthew Arnold, Soumya Ghosh, Prasanna Sattigeri

Comments: 10 pages main paper, 9 pages appendix

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[249] arXiv:2106.00886 (cross-list from cs.LG) [pdf, other]

Title: Partial Wasserstein Covering

Keisuke Kawano, Satoshi Koide, Keisuke Otaki

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[250] arXiv:2106.00901 (cross-list from cs.NE) [pdf, other]

Title: A Differentiable Point Process with Its Application to Spiking Neural Networks

Hiroshi Kajino

Comments: Accepted to ICML 2021

Subjects: Neural and Evolutionary Computing (cs.NE); Machine Learning (cs.LG); Machine Learning (stat.ML)