Machine Learning

Authors and titles for June 2021

[301] arXiv:2106.02584 (cross-list from cs.LG) [pdf, other]

Title: Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning

Jannik Kossen, Neil Band, Clare Lyle, Aidan N. Gomez, Tom Rainforth, Yarin Gal

Comments: Accepted for publication at NeurIPS 2021. First two authors contributed equally

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[302] arXiv:2106.02588 (cross-list from cs.LG) [pdf, other]

Title: Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis

Stephan Wojtowytsch

Subjects: Machine Learning (cs.LG); Analysis of PDEs (math.AP); Machine Learning (stat.ML)

[303] arXiv:2106.02590 (cross-list from stat.ME) [pdf, other]

Title: Spatially relaxed inference on high-dimensional linear models

Jérôme-Alexis Chevalier, Tuan-Binh Nguyen, Bertrand Thirion, Joseph Salmon

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[304] arXiv:2106.02597 (cross-list from cs.LG) [pdf, other]

Title: Model-agnostic and Scalable Counterfactual Explanations via Reinforcement Learning

Robert-Florian Samoilescu, Arnaud Van Looveren, Janis Klaise

Comments: 18 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[305] arXiv:2106.02614 (cross-list from cs.LG) [pdf, other]

Title: Sigma-Delta and Distributed Noise-Shaping Quantization Methods for Random Fourier Features

Jinjie Zhang, Harish Kannan, Alexander Cloninger, Rayan Saab

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[306] arXiv:2106.02619 (cross-list from cs.LG) [pdf, other]

Title: Forward Super-Resolution: How Can GANs Learn Hierarchical Generative Models for Real-World Distributions

Zeyuan Allen-Zhu, Yuanzhi Li

Comments: v2 polishes writing

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Neural and Evolutionary Computing (cs.NE); Optimization and Control (math.OC); Machine Learning (stat.ML)

[307] arXiv:2106.02624 (cross-list from cs.LG) [pdf, other]

Title: ViViT: Curvature access through the generalized Gauss-Newton's low-rank structure

Felix Dangel, Lukas Tatzel, Philipp Hennig

Comments: Main text: 10 pages, 6 figures; Supplements: 26 pages, 27 figures, 5 tables

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[308] arXiv:2106.02654 (cross-list from cs.LG) [pdf, other]

Title: Churn Reduction via Distillation

Heinrich Jiang, Harikrishna Narasimhan, Dara Bahri, Andrew Cotter, Afshin Rostamizadeh

Journal-ref: ICLR 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[309] arXiv:2106.02680 (cross-list from cs.DS) [pdf, other]

Title: Algorithms from Invariants: Smoothed Analysis of Orbit Recovery over $SO(3)$

Allen Liu, Ankur Moitra

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[310] arXiv:2106.02770 (cross-list from cs.LG) [pdf, other]

Title: Deep Bayesian Active Learning for Accelerating Stochastic Simulation

Dongxia Wu, Ruijia Niu, Matteo Chinazzi, Alessandro Vespignani, Yi-An Ma, Rose Yu

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[311] arXiv:2106.02774 (cross-list from cs.DS) [pdf, other]

Title: Robust Model Selection and Nearly-Proper Learning for GMMs

Jerry Li, Allen Liu, Ankur Moitra

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[312] arXiv:2106.02875 (cross-list from cs.LG) [pdf, other]

Title: Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease Progression

Zhaozhi Qian, William R. Zame, Lucas M. Fleuren, Paul Elbers, Mihaela van der Schaar

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[313] arXiv:2106.02878 (cross-list from cs.SI) [pdf, other]

Title: A Generative Node-attribute Network Model for Detecting Generalized Structure

Wei Liu, Zhenhai Chang, Caiyan Jia, Yimei Zheng

Subjects: Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[314] arXiv:2106.02890 (cross-list from cs.LG) [pdf, other]

Title: Can Subnetwork Structure be the Key to Out-of-Distribution Generalization?

Dinghuai Zhang, Kartik Ahuja, Yilun Xu, Yisen Wang, Aaron Courville

Comments: Accepted to ICML2021 as long talk

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[315] arXiv:2106.02993 (cross-list from cs.LG) [pdf, other]

Title: PID-GAN: A GAN Framework based on a Physics-informed Discriminator for Uncertainty Quantification with Physics

Arka Daw, M. Maruf, Anuj Karpatne

Comments: 11 pages, 11 figures, 2 tables, Published at KDD 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[316] arXiv:2106.03022 (cross-list from stat.ME) [pdf, other]

Title: Fisher-Pitman permutation tests based on nonparametric Poisson mixtures with application to single cell genomics

Zhen Miao, Weihao Kong, Ramya Korlakai Vinayak, Wei Sun, Fang Han

Comments: 52 pages

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[317] arXiv:2106.03023 (cross-list from stat.ME) [pdf, other]

Title: Context-tree weighting for real-valued time series: Bayesian inference with hierarchical mixture models

Ioannis Papageorgiou, Ioannis Kontoyiannis

Subjects: Methodology (stat.ME); Applications (stat.AP); Machine Learning (stat.ML)

[318] arXiv:2106.03131 (cross-list from cs.LG) [pdf, other]

Title: The Fine-Grained Hardness of Sparse Linear Regression

Aparna Gupte, Vinod Vaikuntanathan

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[319] arXiv:2106.03194 (cross-list from cs.LG) [pdf, other]

Title: Robust Implicit Networks via Non-Euclidean Contractions

Saber Jafarpour, Alexander Davydov, Anton V. Proskurnikov, Francesco Bullo

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Optimization and Control (math.OC); Machine Learning (stat.ML)

[320] arXiv:2106.03195 (cross-list from cs.LG) [pdf, other]

Title: Meta-Learning Reliable Priors in the Function Space

Jonas Rothfuss, Dominique Heyn, Jinfan Chen, Andreas Krause

Comments: In Advances of Neural Information Processing Systems (NeurIPS) 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[321] arXiv:2106.03207 (cross-list from cs.LG) [pdf, other]

Title: Mitigating Covariate Shift in Imitation Learning via Offline Data Without Great Coverage

Jonathan D. Chang, Masatoshi Uehara, Dhruv Sreenivas, Rahul Kidambi, Wen Sun

Comments: 42 pages, 5 figures, 7 tables

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[322] arXiv:2106.03211 (cross-list from cs.LG) [pdf, other]

Title: Distributed Learning and its Application for Time-Series Prediction

Nhuong V. Nguyen, Sybille Legitime

Comments: 8 pages, 10 figures, and 2 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[323] arXiv:2106.03216 (cross-list from cs.LG) [pdf, other]

Title: On Memorization in Probabilistic Deep Generative Models

Gerrit J. J. van den Burg, Christopher K. I. Williams

Comments: Accepted for publication at NeurIPS 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[324] arXiv:2106.03221 (cross-list from cs.LG) [pdf, other]

Title: PAC Best Arm Identification Under a Deadline

Brijen Thananjeyan, Kirthevasan Kandasamy, Ion Stoica, Michael I. Jordan, Ken Goldberg, Joseph E. Gonzalez

Comments: In submission

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[325] arXiv:2106.03234 (cross-list from cs.LG) [pdf, other]

Title: A call for better unit testing for invariant risk minimisation

Chunyang Xiao, Pranava Madhyastha

Comments: Manuscript v1.0

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[326] arXiv:2106.03273 (cross-list from cs.LG) [pdf, other]

Title: Control-Oriented Model-Based Reinforcement Learning with Implicit Differentiation

Evgenii Nikishin, Romina Abachi, Rishabh Agarwal, Pierre-Luc Bacon

Comments: Code at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[327] arXiv:2106.03300 (cross-list from cs.LG) [pdf, other]

Title: Sum of Ranked Range Loss for Supervised Learning

Shu Hu, Yiming Ying, Xin Wang, Siwei Lyu

Comments: Accepted by Journal of Machine Learning Research (JMLR). arXiv admin note: text overlap with arXiv:2010.01741

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[328] arXiv:2106.03314 (cross-list from cs.LG) [pdf, other]

Title: Measuring Generalization with Optimal Transport

Ching-Yao Chuang, Youssef Mroueh, Kristjan Greenewald, Antonio Torralba, Stefanie Jegelka

Comments: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[329] arXiv:2106.03344 (cross-list from stat.ME) [pdf, other]

Title: Statistical Inference for High-Dimensional Linear Regression with Blockwise Missing Data

Fei Xue, Rong Ma, Hongzhe Li

Comments: V2: 40 pages, 2 figures. Accepted at Statistica Sinica

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[330] arXiv:2106.03352 (cross-list from cs.LG) [pdf, other]

Title: The Power of Exploiter: Provable Multi-Agent RL in Large State Spaces

Chi Jin, Qinghua Liu, Tiancheng Yu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[331] arXiv:2106.03354 (cross-list from cs.LG) [pdf, html, other]

Title: AI without networks

Partha P Mitra, Clément Sire

Comments: 47 pages with 8 figures + 33 pages supplementary with 7 figures and one table (total 80 pages)

Subjects: Machine Learning (cs.LG); Statistical Mechanics (cond-mat.stat-mech); Functional Analysis (math.FA); Machine Learning (stat.ML)

[332] arXiv:2106.03500 (cross-list from cs.LG) [pdf, other]

Title: Density estimation on smooth manifolds with normalizing flows

Dimitris Kalatzis, Johan Ziruo Ye, Alison Pouplin, Jesper Wohlert, Søren Hauberg

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[333] arXiv:2106.03517 (cross-list from cs.LG) [pdf, other]

Title: Top-KAST: Top-K Always Sparse Training

Siddhant M. Jayakumar, Razvan Pascanu, Jack W. Rae, Simon Osindero, Erich Elsen

Journal-ref: Advances in Neural Information Processing Systems, 33, 20744-20754

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[334] arXiv:2106.03585 (cross-list from math.OC) [pdf, other]

Title: Asynchronous speedup in decentralized optimization

Mathieu Even, Hadrien Hendrikx, Laurent Massoulie

Subjects: Optimization and Control (math.OC); Multiagent Systems (cs.MA); Probability (math.PR); Machine Learning (stat.ML)

[335] arXiv:2106.03632 (cross-list from cs.LG) [pdf, other]

Title: Quantifying and Improving Transferability in Domain Generalization

Guojun Zhang, Han Zhao, Yaoliang Yu, Pascal Poupart

Comments: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[336] arXiv:2106.03640 (cross-list from cs.LG) [pdf, other]

Title: Making EfficientNet More Efficient: Exploring Batch-Independent Normalization, Group Convolutions and Reduced Resolution Training

Dominic Masters, Antoine Labatie, Zach Eaton-Rosen, Carlo Luschi

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[337] arXiv:2106.03676 (cross-list from math.AC) [pdf, other]

Title: Learning a performance metric of Buchberger's algorithm

Jelena Mojsilović, Dylan Peifer, Sonja Petrović

Journal-ref: Involve 16 (2023) 227-248

Subjects: Commutative Algebra (math.AC); Machine Learning (cs.LG); Symbolic Computation (cs.SC); Algebraic Geometry (math.AG); Machine Learning (stat.ML)

[338] arXiv:2106.03686 (cross-list from eess.SP) [pdf, other]

Title: Deep Unfolding of Iteratively Reweighted ADMM for Wireless RF Sensing

Udaya S.K.P. Miriya Thanthrige, Peter Jung, Aydin Sezgin

Journal-ref: Sensors 2022,

Subjects: Signal Processing (eess.SP); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[339] arXiv:2106.03696 (cross-list from math.OC) [pdf, other]

Title: Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models

Courtney Paquette, Elliot Paquette

Comments: 39 pages, 7 figures

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Probability (math.PR); Machine Learning (stat.ML)

[340] arXiv:2106.03743 (cross-list from cs.LG) [pdf, other]

Title: Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence

Antoine Labatie, Dominic Masters, Zach Eaton-Rosen, Carlo Luschi

Comments: NeurIPS 2021 camera-ready

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[341] arXiv:2106.03747 (cross-list from quant-ph) [pdf, other]

Title: The Inductive Bias of Quantum Kernels

Jonas M. Kübler, Simon Buchholz, Bernhard Schölkopf

Comments: Accepted version. 9 pages main paper. Total 25 pages

Journal-ref: Advances in Neural Information Processing Systems 34 (NeurIPS 2021)

Subjects: Quantum Physics (quant-ph); Machine Learning (stat.ML)

[342] arXiv:2106.03748 (cross-list from cs.LG) [pdf, other]

Title: Towards robust and domain agnostic reinforcement learning competitions

William Hebgen Guss, Stephanie Milani, Nicholay Topin, Brandon Houghton, Sharada Mohanty, Andrew Melnik, Augustin Harter, Benoit Buschmaas, Bjarne Jaster, Christoph Berganski, Dennis Heitkamp, Marko Henning, Helge Ritter, Chengjie Wu, Xiaotian Hao, Yiming Lu, Hangyu Mao, Yihuan Mao, Chao Wang, Michal Opanowicz, Anssi Kanervisto, Yanick Schraner, Christian Scheller, Xiren Zhou, Lu Liu, Daichi Nishio, Toi Tsuneda, Karolis Ramanauskas, Gabija Juceviciute

Comments: 20 pages, several figures, published PMLR

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Robotics (cs.RO); Machine Learning (stat.ML)

[343] arXiv:2106.03755 (cross-list from cs.CV) [pdf, other]

Title: HERS Superpixels: Deep Affinity Learning for Hierarchical Entropy Rate Segmentation

Hankui Peng, Angelica I. Aviles-Rivero, Carola-Bibiane Schönlieb

Subjects: Computer Vision and Pattern Recognition (cs.CV); Applications (stat.AP); Machine Learning (stat.ML)

[344] arXiv:2106.03760 (cross-list from cs.LG) [pdf, other]

Title: DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning

Hussein Hazimeh, Zhe Zhao, Aakanksha Chowdhery, Maheswaran Sathiamoorthy, Yihua Chen, Rahul Mazumder, Lichan Hong, Ed H. Chi

Comments: Appeared in NeurIPS 2021

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[345] arXiv:2106.03761 (cross-list from cs.CV) [pdf, other]

Title: FairCal: Fairness Calibration for Face Verification

Tiago Salvador, Stephanie Cairns, Vikram Voleti, Noah Marshall, Adam Oberman

Comments: Accepted at ICLR 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[346] arXiv:2106.03790 (cross-list from cs.LG) [pdf, other]

Title: Multi-armed Bandit Requiring Monotone Arm Sequences

Ningyuan Chen

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[347] arXiv:2106.03805 (cross-list from cs.CV) [pdf, other]

Title: 3DB: A Framework for Debugging Computer Vision Models

Guillaume Leclerc, Hadi Salman, Andrew Ilyas, Sai Vemprala, Logan Engstrom, Vibhav Vineet, Kai Xiao, Pengchuan Zhang, Shibani Santurkar, Greg Yang, Ashish Kapoor, Aleksander Madry

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[348] arXiv:2106.03831 (cross-list from cs.LG) [pdf, other]

Title: Counterfactual Maximum Likelihood Estimation for Training Deep Networks

Xinyi Wang, Wenhu Chen, Michael Saxon, William Yang Wang

Comments: 10 pages, 2 figures, accepted to NeurIPS 2021

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[349] arXiv:2106.03880 (cross-list from quant-ph) [pdf, other]

Title: Encoding-dependent generalization bounds for parametrized quantum circuits

Matthias C. Caro, Elies Gil-Fuster, Johannes Jakob Meyer, Jens Eisert, Ryan Sweke

Comments: 35 pages, 3 figures; corrected a mistake in Eq. (38) of the previous version, results remain unchanged except for a restriction to frequency vectors with integer entries; added a conjecture to recover results in full

Journal-ref: Quantum 5, 582 (2021)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Machine Learning (stat.ML)

[350] arXiv:2106.03885 (cross-list from cs.LG) [pdf, other]

Title: Differentiable Multiple Shooting Layers

Stefano Massaroli, Michael Poli, Sho Sonoda, Taji Suzuki, Jinkyoo Park, Atsushi Yamashita, Hajime Asama

Subjects: Machine Learning (cs.LG); Dynamical Systems (math.DS); Optimization and Control (math.OC); Machine Learning (stat.ML)