Statistics

Authors and titles for February 2021

[751] arXiv:2102.07035 (cross-list from cs.LG) [pdf, other]

Title: Model-free Representation Learning and Exploration in Low-rank MDPs

Aditya Modi, Jinglin Chen, Akshay Krishnamurthy, Nan Jiang, Alekh Agarwal

Comments: Changelog v2: Significant reorganization of the paper, added an improved analysis of elliptic planner and updated discussion wrt follow-up work

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[752] arXiv:2102.07048 (cross-list from cs.LG) [pdf, other]

Title: Connecting Interpretability and Robustness in Decision Trees through Separation

Michal Moshkovitz, Yao-Yuan Yang, Kamalika Chaudhuri

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[753] arXiv:2102.07140 (cross-list from cs.LG) [pdf, other]

Title: Perceptually Constrained Adversarial Attacks

Muhammad Zaid Hameed, Andras Gyorgy

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[754] arXiv:2102.07181 (cross-list from cs.LG) [pdf, other]

Title: Distribution Free Uncertainty for the Minimum Norm Solution of Over-parameterized Linear Regression

Koby Bibas, Meir Feder

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[755] arXiv:2102.07206 (cross-list from cs.LG) [pdf, other]

Title: Sample Efficient Subspace-based Representations for Nonlinear Meta-Learning

Halil Ibrahim Gulluk, Yue Sun, Samet Oymak, Maryam Fazel

Comments: To appear in ICASSP 21'

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[756] arXiv:2102.07266 (cross-list from cs.LG) [pdf, other]

Title: Sparse Attention Guided Dynamic Value Estimation for Single-Task Multi-Scene Reinforcement Learning

Jaskirat Singh, Liang Zheng

Comments: This work is a merger of arXiv:2005.12254 and arXiv:2011.12574

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Robotics (cs.RO); Machine Learning (stat.ML)

[757] arXiv:2102.07301 (cross-list from cs.LG) [pdf, other]

Title: Nearly Minimax Optimal Regret for Learning Infinite-horizon Average-reward MDPs with Linear Function Approximation

Yue Wu, Dongruo Zhou, Quanquan Gu

Comments: 31 pages, 2 figures. In AISTATS 2022

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[758] arXiv:2102.07336 (cross-list from math.OC) [pdf, other]

Title: Relaxation of optimal transport problem via strictly convex functions

Asuka Takatsu

Comments: 20pages. Comments are welcome!

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[759] arXiv:2102.07346 (cross-list from cs.LG) [pdf, other]

Title: On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layers

Kenji Kawaguchi

Comments: ICLR 2021. Selected for ICLR Spotlight (top 6% submissions)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC); Machine Learning (stat.ML)

[760] arXiv:2102.07367 (cross-list from math.OC) [pdf, other]

Title: A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum

Prashant Khanduri, Siliang Zeng, Mingyi Hong, Hoi-To Wai, Zhaoran Wang, Zhuoran Yang

Comments: 36 Pages, 10 Figures

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[761] arXiv:2102.07404 (cross-list from cs.LG) [pdf, other]

Title: Almost Optimal Algorithms for Two-player Zero-Sum Linear Mixture Markov Games

Zixiang Chen, Dongruo Zhou, Quanquan Gu

Comments: 35 pages. In ALT 2022

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[762] arXiv:2102.07521 (cross-list from cs.LG) [pdf, other]

Title: Distributed Online Learning for Joint Regret with Communication Constraints

Dirk van der Hoeven, Hédi Hadiji, Tim van Erven

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[763] arXiv:2102.07566 (cross-list from q-bio.PE) [pdf, other]

Title: A stochastic SIR model for the analysis of the COVID-19 Italian epidemic

Sara Pasquali, Antonio Pievatolo, Antonella Bodini, Fabrizio Ruggeri

Subjects: Populations and Evolution (q-bio.PE); Applications (stat.AP)

[764] arXiv:2102.07606 (cross-list from cs.LG) [pdf, other]

Title: A generalized quadratic loss for SVM and Deep Neural Networks

Filippo Portera

Comments: 12 pages, 2 figures, LOD 2020 Conference work

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[765] arXiv:2102.07686 (cross-list from cs.LG) [pdf, other]

Title: Does the Adam Optimizer Exacerbate Catastrophic Forgetting?

Dylan R. Ashley, Sina Ghiassian, Richard S. Sutton

Comments: 9 pages in main text + 3 pages of references + 16 pages of appendices, 6 figures in main text + 21 figures in appendices, 6 tables in appendices; source code available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[766] arXiv:2102.07698 (cross-list from cs.LG) [pdf, other]

Title: How to Learn when Data Reacts to Your Model: Performative Gradient Descent

Zachary Izzo, Lexing Ying, James Zou

Comments: 21 pages, 5 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[767] arXiv:2102.07711 (cross-list from cs.LG) [pdf, other]

Title: Saving Stochastic Bandits from Poisoning Attacks via Limited Data Verification

Anshuka Rangi, Long Tran-Thanh, Haifeng Xu, Massimo Franceschetti

Comments: Accepted to AAAI 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[768] arXiv:2102.07767 (cross-list from cs.LG) [pdf, other]

Title: Communication-efficient Distributed Cooperative Learning with Compressed Beliefs

Mohammad Taha Toghani, César A. Uribe

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA); Optimization and Control (math.OC); Machine Learning (stat.ML)

[769] arXiv:2102.07770 (cross-list from cs.LG) [pdf, other]

Title: Neural Posterior Regularization for Likelihood-Free Inference

Dongjun Kim, Kyungwoo Song, Seungjae Shin, Wanmo Kang, Il-Chul Moon, Weonyoung Joo

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[770] arXiv:2102.07771 (cross-list from cs.LG) [pdf, other]

Title: Online learning of Riemannian hidden Markov models in homogeneous Hadamard spaces

Quinten Tupker, Salem Said, Cyrus Mostajeran

Subjects: Machine Learning (cs.LG); Differential Geometry (math.DG); Computation (stat.CO)

[771] arXiv:2102.07802 (cross-list from cs.LG) [pdf, other]

Title: Efficient Learning with Arbitrary Covariate Shift

Adam Kalai, Varun Kanade

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[772] arXiv:2102.07834 (cross-list from cs.LG) [pdf, other]

Title: One Line To Rule Them All: Generating LO-Shot Soft-Label Prototypes

Ilia Sucholutsky, Nam-Hwui Kim, Ryan P. Browne, Matthias Schonlau

Comments: 8 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[773] arXiv:2102.07835 (cross-list from cs.LG) [pdf, other]

Title: Topological Graph Neural Networks

Max Horn, Edward De Brouwer, Michael Moor, Yves Moreau, Bastian Rieck, Karsten Borgwardt

Journal-ref: Tenth International Conference on Learning Representations (ICLR), 2022

Subjects: Machine Learning (cs.LG); Algebraic Topology (math.AT); Machine Learning (stat.ML)

[774] arXiv:2102.07856 (cross-list from cs.LG) [pdf, other]

Title: Don't Just Blame Over-parametrization for Over-confidence: Theoretical Analysis of Calibration in Binary Classification

Yu Bai, Song Mei, Huan Wang, Caiming Xiong

Comments: Appearing at ICML 2021

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[775] arXiv:2102.07870 (cross-list from cs.LG) [pdf, other]

Title: Momentum Residual Neural Networks

Michael E. Sander, Pierre Ablin, Mathieu Blondel, Gabriel Peyré

Comments: 24 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[776] arXiv:2102.07927 (cross-list from cs.LG) [pdf, other]

Title: Structured Dropout Variational Inference for Bayesian Neural Networks

Son Nguyen, Duong Nguyen, Khai Nguyen, Khoat Than, Hung Bui, Nhat Ho

Comments: 45 pages, 9 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[777] arXiv:2102.07937 (cross-list from cs.LG) [pdf, other]

Title: Inverse Reinforcement Learning in a Continuous State Space with Formal Guarantees

Gregory Dexter, Kevin Bello, Jean Honorio

Journal-ref: Neural Information Processing Systems (NeurIPS), 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[778] arXiv:2102.07951 (cross-list from cs.AI) [pdf, other]

Title: ResNet-LDDMM: Advancing the LDDMM Framework using Deep Residual Networks

Boulbaba Ben Amor, Sylvain Arguillère, Ling Shao

Comments: Accepted for publication by the IEEE Transactions on Pattern Analysis and Machine Intelligence (May, 2022)

Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computation (stat.CO)

[779] arXiv:2102.07954 (cross-list from cs.CV) [pdf, other]

Title: AlphaNet: Improved Training of Supernets with Alpha-Divergence

Dilin Wang, Chengyue Gong, Meng Li, Qiang Liu, Vikas Chandra

Comments: International Conference on Machine Learning (ICML) 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[780] arXiv:2102.08014 (cross-list from cs.AI) [pdf, other]

Title: Representing Hierarchical Structure by Using Cone Embedding

Daisuke Takehara, Kei Kobayashi

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[781] arXiv:2102.08019 (cross-list from cs.LG) [pdf, other]

Title: A Thorough View of Exact Inference in Graphs from the Degree-4 Sum-of-Squares Hierarchy

Kevin Bello, Chuyang Ke, Jean Honorio

Comments: 17 pages, 5 figures

Journal-ref: Artificial Intelligence and Statistics (AISTATS), 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[782] arXiv:2102.08020 (cross-list from math.PR) [pdf, other]

Title: Concentration of measure and generalized product of random vectors with an application to Hanson-Wright-like inequalities

Cosme Louart, Romain Couillet

Comments: 48 pages

Subjects: Probability (math.PR); Machine Learning (stat.ML)

[783] arXiv:2102.08023 (cross-list from cs.LG) [pdf, other]

Title: Joint self-supervised blind denoising and noise estimation

Jean Ollion, Charles Ollion (CMAP), Elisabeth Gassiat (LMO), Luc Lehéricy (JAD), Sylvain Le Corff (IP Paris, TIPIC-SAMOVAR, SAMOVAR)

Subjects: Machine Learning (cs.LG); Image and Video Processing (eess.IV); Machine Learning (stat.ML)

[784] arXiv:2102.08162 (cross-list from cs.LG) [pdf, other]

Title: Integrating Floor Plans into Hedonic Models for Rent Price Appraisal

Kirill Solovev, Nicolas Pröllochs

Subjects: Machine Learning (cs.LG); General Economics (econ.GN); Applications (stat.AP)

[785] arXiv:2102.08184 (cross-list from cs.LG) [pdf, other]

Title: Constructing Multiclass Classifiers using Binary Classifiers Under Log-Loss

Assaf Ben-Yishai, Or Ordentlich

Comments: A shorter version of this contribution was presented in ISIT 2021

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)

[786] arXiv:2102.08189 (cross-list from q-fin.ST) [pdf, other]

Title: On Technical Trading and Social Media Indicators in Cryptocurrencies' Price Classification Through Deep Learning

Marco Ortu, Nicola Uras, Claudio Conversano, Giuseppe Destefanis, Silvia Bartolucci

Subjects: Statistical Finance (q-fin.ST); Machine Learning (cs.LG); Applications (stat.AP)

[787] arXiv:2102.08248 (cross-list from cs.LG) [pdf, other]

Title: Hierarchical VAEs Know What They Don't Know

Jakob D. Havtorn, Jes Frellsen, Søren Hauberg, Lars Maaløe

Comments: Appeared in Proceedings of the 38th International Conference on Machine Learning (ICML 2021). 18 pages, source code available at this https URL, this https URL and this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[788] arXiv:2102.08308 (cross-list from cs.IT) [pdf, other]

Title: Active Privacy-utility Trade-off Against a Hypothesis Testing Adversary

Ecenaz Erdemir, Pier Luigi Dragotti, Deniz Gunduz

Comments: Accepted to IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2021)

Subjects: Information Theory (cs.IT); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[789] arXiv:2102.08310 (cross-list from cs.LG) [pdf, other]

Title: Adaptive Weighting Scheme for Automatic Time-Series Data Augmentation

Elizabeth Fons, Paula Dawson, Xiao-jun Zeng, John Keane, Alexandros Iosifidis

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[790] arXiv:2102.08329 (cross-list from cs.LG) [pdf, other]

Title: An Information-Theoretic Justification for Model Pruning

Berivan Isik, Tsachy Weissman, Albert No

Comments: Published in the International Conference on Artificial Intelligence and Statistics (AISTATS) 2022. Previous titles: 1) Rate-Distortion Theoretic Model Compression: Successive Refinement for Pruning, 2) Successive pruning for model compression via rate distortion theory

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP); Machine Learning (stat.ML)

[791] arXiv:2102.08352 (cross-list from math.OC) [pdf, other]

Title: Stochastic Variance Reduction for Variational Inequality Methods

Ahmet Alacaoglu, Yura Malitsky

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[792] arXiv:2102.08354 (cross-list from cs.LG) [pdf, other]

Title: Topological Deep Learning: Classification Neural Networks

Mustafa Hajij, Kyle Istvan

Comments: arXiv admin note: substantial text overlap with arXiv:2008.13697

Subjects: Machine Learning (cs.LG); Algebraic Topology (math.AT); Machine Learning (stat.ML)

[793] arXiv:2102.08373 (cross-list from cs.LG) [pdf, other]

Title: Analysis of feature learning in weight-tied autoencoders via the mean field lens

Phan-Minh Nguyen

Comments: 121 pages, 12 figures

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistics Theory (math.ST); Machine Learning (stat.ML)

[794] arXiv:2102.08374 (cross-list from cs.LG) [pdf, other]

Title: IntSGD: Adaptive Floatless Compression of Stochastic Gradients

Konstantin Mishchenko, Bokun Wang, Dmitry Kovalev, Peter Richtárik

Comments: Spotlight at ICLR 2022. 27 pages, 6 figures, 3 algorithms

Journal-ref: International Conference on Learning Representations (2022)

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[795] arXiv:2102.08380 (cross-list from hep-ph) [pdf, other]

Title: Topological Obstructions to Autoencoding

Joshua Batson, C. Grace Haaf, Yonatan Kahn, Daniel A. Roberts

Comments: 24 + 20 pages, 26 figures; no autoencoders were harmed in the making of this project. v2: JHEP published version

Journal-ref: JHEP04(2021)280

Subjects: High Energy Physics - Phenomenology (hep-ph); Machine Learning (cs.LG); Machine Learning (stat.ML)

[796] arXiv:2102.08410 (cross-list from cs.LG) [pdf, other]

Title: Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Information

Pranjal Awasthi, Alex Beutel, Matthaeus Kleindessner, Jamie Morgenstern, Xuezhi Wang

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[797] arXiv:2102.08427 (cross-list from cs.LG) [pdf, other]

Title: Evaluating Multi-label Classifiers with Noisy Labels

Wenting Zhao, Carla Gomes

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[798] arXiv:2102.08446 (cross-list from cs.LG) [pdf, other]

Title: Smoothed Analysis with Adaptive Adversaries

Nika Haghtalab, Tim Roughgarden, Abhishek Shetty

Comments: Accepted to FOCS 2021

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[799] arXiv:2102.08452 (cross-list from cs.LG) [pdf, other]

Title: Globally-Robust Neural Networks

Klas Leino, Zifan Wang, Matt Fredrikson

Comments: Appearing in ICML 2021

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[800] arXiv:2102.08454 (cross-list from cs.LG) [pdf, other]

Title: Lexicographically Fair Learning: Algorithms and Generalization

Emily Diana, Wesley Gill, Ira Globus-Harris, Michael Kearns, Aaron Roth, Saeed Sharifi-Malvajerdi

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)