Machine Learning

Authors and titles for July 2021

[351] arXiv:2107.10960 (cross-list from cs.LG) [pdf, other]

Title: Implicit Rate-Constrained Optimization of Non-decomposable Objectives

Abhishek Kumar, Harikrishna Narasimhan, Andrew Cotter

Comments: ICML 2021; Code available at this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[352] arXiv:2107.11059 (cross-list from cs.LG) [pdf, other]

Title: LocalGLMnet: interpretable deep learning for tabular data

Ronald Richman, Mario V. Wüthrich

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Statistical Finance (q-fin.ST); Applications (stat.AP); Machine Learning (stat.ML)

[353] arXiv:2107.11136 (cross-list from cs.LG) [pdf, other]

Title: High Dimensional Differentially Private Stochastic Optimization with Heavy-tailed Data

Lijie Hu, Shuo Ni, Hanshen Xiao, Di Wang

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[354] arXiv:2107.11153 (cross-list from cs.LG) [pdf, other]

Title: Constellation: Learning relational abstractions over objects for compositional imagination

James C.R. Whittington, Rishabh Kabra, Loic Matthey, Christopher P. Burgess, Alexander Lerchner

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[355] arXiv:2107.11231 (cross-list from cond-mat.stat-mech) [pdf, other]

Title: Optimization on manifolds: A symplectic approach

Guilherme França, Alessandro Barp, Mark Girolami, Michael I. Jordan

Comments: additional results, including rates for constrained optimization on manifolds

Subjects: Statistical Mechanics (cond-mat.stat-mech); Optimization and Control (math.OC); Machine Learning (stat.ML)

[356] arXiv:2107.11433 (cross-list from cs.LG) [pdf, other]

Title: A general sample complexity analysis of vanilla policy gradient

Rui Yuan, Robert M. Gower, Alessandro Lazaric

Comments: Accepted at AISTATS 2022. This version updates references and adds acknowledgement to Matteo Papini who greatly improved our work before the submission

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[357] arXiv:2107.11609 (cross-list from cs.LG) [pdf, other]

Title: A Model-Agnostic Algorithm for Bayes Error Determination in Binary Classification

Umberto Michelucci, Michela Sperti, Dario Piga, Francesca Venturini, Marco A. Deriu

Comments: 21 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[358] arXiv:2107.11630 (cross-list from cs.LG) [pdf, other]

Title: Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Them

Florian Tramèr

Comments: ICML 2022 (Long Talk)

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[359] arXiv:2107.11658 (cross-list from cs.LG) [pdf, other]

Title: Tail of Distribution GAN (TailGAN): Generative-Adversarial-Network-Based Boundary Formation

Nikolaos Dionelis, Mehrdad Yaghoobi, Sotirios A. Tsaftaris

Comments: 5 pages, 2020 Sensor Signal Processing for Defence Conference (SSPD)

Journal-ref: 2020 Sensor Signal Processing for Defence Conference (SSPD)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[360] arXiv:2107.11712 (cross-list from cs.DS) [pdf, other]

Title: Efficient inference of interventional distributions

Arnab Bhattacharyya, Sutanu Gayen, Saravanan Kandasamy, Vedant Raval, N. V. Vinodchandran

Comments: 16 pages, 2 figures

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[361] arXiv:2107.11717 (cross-list from cs.LG) [pdf, other]

Title: Invariance-based Multi-Clustering of Latent Space Embeddings for Equivariant Learning

Chandrajit Bajaj, Avik Roy, Haoran Zhang

Comments: The codebase for MCEVAE is available at this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[362] arXiv:2107.11774 (cross-list from cs.LG) [pdf, other]

Title: SGD with a Constant Large Learning Rate Can Converge to Local Maxima

Liu Ziyin, Botao Li, James B. Simon, Masahito Ueda

Comments: Fixed typos

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[363] arXiv:2107.11858 (cross-list from math.ST) [pdf, other]

Title: Estimation of Stationary Optimal Transport Plans

Kevin O'Connor, Kevin McGoff, Andrew B Nobel

Subjects: Statistics Theory (math.ST); Dynamical Systems (math.DS); Machine Learning (stat.ML)

[364] arXiv:2107.11869 (cross-list from econ.EM) [pdf, other]

Title: Adaptive Estimation and Uniform Confidence Bands for Nonparametric Structural Functions and Elasticities

Xiaohong Chen, Timothy Christensen, Sid Kankanala

Comments: The data-driven choice of sieve dimension in this paper is based on and supersedes Section 3 of the preprint arXiv:1508.03365v1

Subjects: Econometrics (econ.EM); Methodology (stat.ME); Machine Learning (stat.ML)

[365] arXiv:2107.11892 (cross-list from cs.LG) [pdf, other]

Title: A brief note on understanding neural networks as Gaussian processes

Mengwu Guo

Subjects: Machine Learning (cs.LG); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (stat.ML)

[366] arXiv:2107.12034 (cross-list from cs.LG) [pdf, other]

Title: Workpiece Image-based Tool Wear Classification in Blanking Processes Using Deep Convolutional Neural Networks

Dirk Alexander Molitor, Christian Kubik, Ruben Helmut Hetfleisch, Peter Groche

Journal-ref: Production Engineering 16(4) (2022) 481-492

Subjects: Machine Learning (cs.LG); Image and Video Processing (eess.IV); Machine Learning (stat.ML)

[367] arXiv:2107.12100 (cross-list from cs.SI) [pdf, other]

Title: Predicting Influential Higher-Order Patterns in Temporal Network Data

Christoph Gote, Vincenzo Perri, Ingo Scholtes

Comments: 18 pages, 4 figures, 2 tables

Subjects: Social and Information Networks (cs.SI); Information Theory (cs.IT); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[368] arXiv:2107.12248 (cross-list from cs.LG) [pdf, other]

Title: Are Bayesian neural networks intrinsically good at out-of-distribution detection?

Christian Henning, Francesco D'Angelo, Benjamin F. Grewe

Comments: Published at UDL Workshop, ICML 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[369] arXiv:2107.12250 (cross-list from cs.LG) [pdf, other]

Title: Uncertainty-Aware Time-to-Event Prediction using Deep Kernel Accelerated Failure Time Models

Zhiliang Wu, Yinchong Yang, Peter A. Fasching, Volker Tresp

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[370] arXiv:2107.12364 (cross-list from math.ST) [pdf, other]

Title: Plugin Estimation of Smooth Optimal Transport Maps

Tudor Manole, Sivaraman Balakrishnan, Jonathan Niles-Weed, Larry Wasserman

Comments: To appear in the Annals of Statistics

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[371] arXiv:2107.12365 (cross-list from math.ST) [pdf, other]

Title: Inference for Heteroskedastic PCA with Missing Data

Yuling Yan, Yuxin Chen, Jianqing Fan

Comments: accepted to Annals of Statistics

Journal-ref: The Annals of Statistics, vol. 52, no. 2, pp. 729-756, 2024

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[372] arXiv:2107.12438 (cross-list from math.OC) [pdf, other]

Title: Debiasing In-Sample Policy Performance for Small-Data, Large-Scale Optimization

Vishal Gupta, Michael Huang, Paat Rusmevichientong

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[373] arXiv:2107.12521 (cross-list from cs.LG) [pdf, other]

Title: Restricted Boltzmann Machine and Deep Belief Network: Tutorial and Survey

Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

Comments: To appear as a part of an upcoming textbook on dimensionality reduction and manifold learning. v2: applied readers' feedback

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[374] arXiv:2107.12525 (cross-list from math.ST) [pdf, other]

Title: Proof: Accelerating Approximate Aggregation Queries with Expensive Predicates

Daniel Kang, John Guibas, Peter Bailis, Tatsunori Hashimoto, Yi Sun, Matei Zaharia

Subjects: Statistics Theory (math.ST); Databases (cs.DB); Machine Learning (cs.LG); Machine Learning (stat.ML)

[375] arXiv:2107.12580 (cross-list from cs.LG) [pdf, other]

Title: Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization

Chiyuan Zhang, Maithra Raghu, Jon Kleinberg, Samy Bengio

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[376] arXiv:2107.12685 (cross-list from cs.LG) [pdf, other]

Title: On the Role of Optimization in Double Descent: A Least Squares Study

Ilja Kuzborskij, Csaba Szepesvári, Omar Rivasplata, Amal Rannen-Triki, Razvan Pascanu

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[377] arXiv:2107.12825 (cross-list from cs.LG) [pdf, other]

Title: Individual Survival Curves with Conditional Normalizing Flows

Guillaume Ausset, Tom Ciffreo, Francois Portier, Stephan Clémençon, Timothée Papin

Comments: IEEE DSAA '21

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[378] arXiv:2107.12890 (cross-list from stat.ME) [pdf, other]

Title: Subset selection for linear mixed models

Daniel R. Kowal

Subjects: Methodology (stat.ME); Computation (stat.CO); Machine Learning (stat.ML)

[379] arXiv:2107.12940 (cross-list from cs.LG) [pdf, other]

Title: Finding Failures in High-Fidelity Simulation using Adaptive Stress Testing and the Backward Algorithm

Mark Koren, Ahmed Nassar, Mykel J. Kochenderfer

Comments: Accepted to IROS 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[380] arXiv:2107.12972 (cross-list from cs.LG) [pdf, other]

Title: Channel-Wise Early Stopping without a Validation Set via NNK Polytope Interpolation

David Bonet, Antonio Ortega, Javier Ruiz-Hidalgo, Sarath Shekkizhar

Comments: Submitted to APSIPA 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[381] arXiv:2107.13059 (cross-list from cs.LG) [pdf, other]

Title: Explicit Pairwise Factorized Graph Neural Network for Semi-Supervised Node Classification

Yu Wang, Yuesong Shen, Daniel Cremers

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[382] arXiv:2107.13068 (cross-list from cs.LG) [pdf, other]

Title: End-to-End Balancing for Causal Continuous Treatment-Effect Estimation

Mohammad Taha Bahadori, Eric Tchetgen Tchetgen, David E. Heckerman

Comments: To be presented in ICML 2022

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[383] arXiv:2107.13090 (cross-list from math.OC) [pdf, other]

Title: Policy Gradient Methods Find the Nash Equilibrium in N-player General-sum Linear-quadratic Games

Ben Hambly, Renyuan Xu, Huining Yang

Subjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[384] arXiv:2107.13163 (cross-list from cs.LG) [pdf, other]

Title: Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers

Colin Wei, Yining Chen, Tengyu Ma

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[385] arXiv:2107.13304 (cross-list from cs.LG) [pdf, other]

Title: Bayesian Autoencoders: Analysing and Fixing the Bernoulli likelihood for Out-of-Distribution Detection

Bang Xiang Yong, Tim Pearce, Alexandra Brintrup

Comments: Presented at the ICML 2020 Workshop on Uncertainty and Ro-bustness in Deep Learning

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[386] arXiv:2107.13494 (cross-list from math.ST) [pdf, other]

Title: Limit Distribution Theory for the Smooth 1-Wasserstein Distance with Applications

Ritwik Sadhu, Ziv Goldfeld, Kengo Kato

Subjects: Statistics Theory (math.ST); Probability (math.PR); Machine Learning (stat.ML)

[387] arXiv:2107.13610 (cross-list from cs.LG) [pdf, other]

Title: Large sample spectral analysis of graph-based multi-manifold clustering

Nicolas Garcia Trillos, Pengfei He, Chenghui Li

Comments: We fixed some typos and added some detailed discussion to our theoretical results. We also supplemented more experimental discussions

Subjects: Machine Learning (cs.LG); Differential Geometry (math.DG); Spectral Theory (math.SP); Machine Learning (stat.ML)

[388] arXiv:2107.13656 (cross-list from cs.LG) [pdf, other]

Title: Characterizing the Generalization Error of Gibbs Algorithm with Symmetrized KL information

Gholamali Aminian, Yuheng Bu, Laura Toni, Miguel R. D. Rodrigues, Gregory Wornell

Comments: The first and second author have contributed equally to the paper. This paper is accepted in the ICML-21 Workshop on Information-Theoretic Methods for Rigorous, Responsible, and Reliable Machine Learning: this https URL

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)

[389] arXiv:2107.13772 (cross-list from cs.LG) [pdf, other]

Title: Bayesian Optimization for Min Max Optimization

Dorina Weichert, Alexander Kister

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[390] arXiv:2107.13944 (cross-list from cs.LG) [pdf, other]

Title: Lyapunov-based uncertainty-aware safe reinforcement learning

Ashkan B. Jeddi, Nariman L. Dehghani, Abdollah Shafieezadeh

Comments: Submitted to IEEE Transactions on Neural Networks and Learning Systems

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[391] arXiv:2107.14151 (cross-list from stat.ME) [pdf, other]

Title: Modern Non-Linear Function-on-Function Regression

Aniruddha Rajendra Rao, Matthew Reimherr

Comments: 6 figures, 6 tables (including supplementary material), 16 pages (including supplementary material). arXiv admin note: text overlap with arXiv:2104.09371

Journal-ref: Statistics and Computing 2023

Subjects: Methodology (stat.ME); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[392] arXiv:2107.14226 (cross-list from cs.LG) [pdf, other]

Title: Learning more skills through optimistic exploration

DJ Strouse, Kate Baumli, David Warde-Farley, Vlad Mnih, Steven Hansen

Comments: Accepted at ICLR 2022 (spotlight)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[393] arXiv:2107.14323 (cross-list from cs.CG) [pdf, other]

Title: Reconstruction of Random Geometric Graphs: Breaking the Omega(r) distortion barrier

Varsha Dani, Josep Díaz, Thomas P. Hayes, Cristopher Moore

Comments: v1 on arxiv was titled "Improved Reconstruction of Random Geometric Graphs." An extended abstract with the above title appeared in ICALP 2022. The current version includes the proofs that were omitted from the ICALP version and adds the section "Missing Edges."

Subjects: Computational Geometry (cs.CG); Social and Information Networks (cs.SI); Probability (math.PR); Physics and Society (physics.soc-ph); Machine Learning (stat.ML)

[394] arXiv:2107.14346 (cross-list from stat.ME) [pdf, other]

Title: Neural Networks for Parameter Estimation in Intractable Models

Amanda Lenzi, Julie Bessac, Johann Rudi, Michael L. Stein

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[395] arXiv:2107.14410 (cross-list from q-fin.ST) [pdf, other]

Title: The Adaptive Multi-Factor Model and the Financial Market

Liao Zhu

Comments: PhD thesis

Journal-ref: eCommons 2020

Subjects: Statistical Finance (q-fin.ST); Machine Learning (cs.LG); Machine Learning (stat.ML)

[396] arXiv:2107.14465 (cross-list from cs.LG) [pdf, other]

Title: Trusted-Maximizers Entropy Search for Efficient Bayesian Optimization

Quoc Phong Nguyen, Zhaoxuan Wu, Bryan Kian Hsiang Low, Patrick Jaillet

Comments: Published as a conference paper at UAI 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[397] arXiv:2107.14702 (cross-list from cs.GT) [pdf, other]

Title: Towards General Function Approximation in Zero-Sum Markov Games

Baihe Huang, Jason D. Lee, Zhaoran Wang, Zhuoran Yang

Subjects: Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[398] arXiv:2107.14728 (cross-list from stat.ME) [pdf, other]

Title: Efficient Multidimensional Functional Data Analysis Using Marginal Product Basis Systems

William Consagra, Arun Venkataraman, Xing Qiu

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)