Statistics

Authors and titles for March 2021

[651] arXiv:2103.03098 (cross-list from cs.LG) [pdf, other]

Title: Accounting for Variance in Machine Learning Benchmarks

Xavier Bouthillier, Pierre Delaunay, Mirko Bronzi, Assya Trofimov, Brennan Nichyporuk, Justin Szeto, Naz Sepah, Edward Raff, Kanika Madan, Vikram Voleti, Samira Ebrahimi Kahou, Vincent Michalski, Dmitriy Serdyuk, Tal Arbel, Chris Pal, Gaël Varoquaux, Pascal Vincent

Comments: Submitted to MLSys2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[652] arXiv:2103.03158 (cross-list from cs.CV) [pdf, other]

Title: A Structural Causal Model for MR Images of Multiple Sclerosis

Jacob C. Reinhold, Aaron Carass, Jerry L. Prince

Comments: MICCAI 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV); Applications (stat.AP)

[653] arXiv:2103.03169 (cross-list from math.PR) [pdf, other]

Title: Small Sample Spaces for Gaussian Processes

Toni Karvonen

Comments: To appear in Bernoulli

Subjects: Probability (math.PR); Functional Analysis (math.FA); Statistics Theory (math.ST); Machine Learning (stat.ML)

[654] arXiv:2103.03236 (cross-list from cs.LG) [pdf, other]

Title: Of Moments and Matching: A Game-Theoretic Framework for Closing the Imitation Gap

Gokul Swamy, Sanjiban Choudhury, J. Andrew Bagnell, Zhiwei Steven Wu

Subjects: Machine Learning (cs.LG); Robotics (cs.RO); Machine Learning (stat.ML)

[655] arXiv:2103.03237 (cross-list from econ.EM) [pdf, other]

Title: High-dimensional estimation of quadratic variation based on penalized realized variance

Kim Christensen, Mikkel Slot Nielsen, Mark Podolskij

Subjects: Econometrics (econ.EM); Methodology (stat.ME)

[656] arXiv:2103.03265 (cross-list from cs.LG) [pdf, other]

Title: Better SGD using Second-order Momentum

Hoang Tran, Ashok Cutkosky

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[657] arXiv:2103.03281 (cross-list from cs.LG) [pdf, other]

Title: CLAIMED, a visual and scalable component library for Trusted AI

Romeo Kienzler, Ivan Nesic

Subjects: Machine Learning (cs.LG); Applications (stat.AP)

[658] arXiv:2103.03286 (cross-list from econ.EM) [pdf, other]

Title: Extremal points of Lorenz curves and applications to inequality analysis

Amparo Baíllo, Javier Cárcamo, Carlos Mora-Corral

Subjects: Econometrics (econ.EM); Applications (stat.AP)

[659] arXiv:2103.03302 (cross-list from cs.LG) [pdf, other]

Title: Ensembles of Random SHAPs

Lev V. Utkin, Andrei V. Konstantinov

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[660] arXiv:2103.03305 (cross-list from cs.LG) [pdf, other]

Title: Predicting Kidney Transplant Survival using Multiple Feature Representations for HLAs

Mohammadreza Nemati, Haonan Zhang, Michael Sloma, Dulat Bekbolsynov, Hong Wang, Stanislaw Stepkowski, Kevin S. Xu

Comments: Extended version of AIME 2021 conference paper

Journal-ref: Proceedings of the 19th International Conference on Artificial Intelligence in Medicine (2021) 51-60

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Applications (stat.AP)

[661] arXiv:2103.03307 (cross-list from cs.LG) [pdf, other]

Title: Conservative Optimistic Policy Optimization via Multiple Importance Sampling

Achraf Azize, Othman Gaizi

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[662] arXiv:2103.03348 (cross-list from q-bio.PE) [pdf, other]

Title: From viral evolution to spatial contagion: a biologically modulated Hawkes model

Andrew J. Holbrook, Xiang Ji, Marc A. Suchard

Subjects: Populations and Evolution (q-bio.PE); Applications (stat.AP)

[663] arXiv:2103.03385 (cross-list from cs.LG) [pdf, other]

Title: Gaussian processes meet NeuralODEs: A Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data

Mohamed Aziz Bhouri, Paris Perdikaris

Comments: 27 pages, 16 figures, 4 tables. arXiv admin note: text overlap with arXiv:2004.06843

Subjects: Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[664] arXiv:2103.03399 (cross-list from cs.LG) [pdf, other]

Title: Representation Matters: Assessing the Importance of Subgroup Allocations in Training Data

Esther Rolf, Theodora Worledge, Benjamin Recht, Michael I. Jordan

Comments: Accepted to ICML 2021; 31 pages,9 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[665] arXiv:2103.03460 (cross-list from cs.CV) [pdf, other]

Title: Vicinal and categorical domain adaptation

Hui Tang, Kui Jia

Comments: Accepted by Pattern Recognition

Journal-ref: Pattern Recognition, Volume 115, July 2021, 107907

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[666] arXiv:2103.03466 (cross-list from cs.LG) [pdf, other]

Title: Unintended Effects on Adaptive Learning Rate for Training Neural Network with Output Scale Change

Ryuichi Kanoh, Mahito Sugiyama

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[667] arXiv:2103.03565 (cross-list from cs.LG) [pdf, other]

Title: Physics-aware deep neural networks for surrogate modeling of turbulent natural convection

Didier Lucor (LISN), Atul Agrawal (TUM, LISN), Anne Sergent (LISN, UFR 919)

Subjects: Machine Learning (cs.LG); Computational Physics (physics.comp-ph); Fluid Dynamics (physics.flu-dyn); Machine Learning (stat.ML)

[668] arXiv:2103.03568 (cross-list from cs.LG) [pdf, other]

Title: Can Pretext-Based Self-Supervised Learning Be Boosted by Downstream Data? A Theoretical Analysis

Jiaye Teng, Weiran Huang, Haowei He

Comments: Accepted by AISTATS 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[669] arXiv:2103.03606 (cross-list from cs.LG) [pdf, other]

Title: Unbalanced minibatch Optimal Transport; applications to Domain Adaptation

Kilian Fatras, Thibault Séjourné, Nicolas Courty, Rémi Flamary

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[670] arXiv:2103.03632 (cross-list from econ.EM) [pdf, other]

Title: Modeling tail risks of inflation using unobserved component quantile regressions

Michael Pfarrhofer

Comments: JEL: C11, C22, C53, E31; Keywords: state space models, time-varying parameters, stochastic volatility, predictive inference

Subjects: Econometrics (econ.EM); Applications (stat.AP)

[671] arXiv:2103.03656 (cross-list from cs.LG) [pdf, other]

Title: Automatic Exploration Process Adjustment for Safe Reinforcement Learning with Joint Chance Constraint Satisfaction

Yoshihiro Okawa, Tomotake Sasaki, Hidenao Iwane

Comments: Accepted to the 21st IFAC World Congress (IFAC-V 2020)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Systems and Control (eess.SY); Machine Learning (stat.ML)

[672] arXiv:2103.03788 (cross-list from cs.LG) [pdf, other]

Title: Loss Estimators Improve Model Generalization

Vivek Narayanaswamy, Jayaraman J. Thiagarajan, Deepta Rajan, Andreas Spanias

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[673] arXiv:2103.03841 (cross-list from cs.CV) [pdf, other]

Title: Generating Images with Sparse Representations

Charlie Nash, Jacob Menick, Sander Dieleman, Peter W. Battaglia

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[674] arXiv:2103.03872 (cross-list from cs.LG) [pdf, other]

Title: Rissanen Data Analysis: Examining Dataset Characteristics via Description Length

Ethan Perez, Douwe Kiela, Kyunghyun Cho

Comments: Code at this https URL along with a script to run RDA on your own dataset

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[675] arXiv:2103.03905 (cross-list from cs.NE) [pdf, other]

Title: Kanerva++: extending The Kanerva Machine with differentiable, locally block allocated latent memory

Jason Ramapuram, Yan Wu, Alexandros Kalousis

Journal-ref: ICLR 2021

Subjects: Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[676] arXiv:2103.03945 (cross-list from cs.LG) [pdf, other]

Title: SCRIB: Set-classifier with Class-specific Risk Bounds for Blackbox Models

Zhen Lin, Cao Xiao, Lucas Glass, M. Brandon Westover, Jimeng Sun

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[677] arXiv:2103.04014 (cross-list from cs.IT) [pdf, other]

Title: Over-the-Air Statistical Estimation

Chuan-Zheng Lee, Leighton Pate Barnes, Ayfer Ozgur

Comments: 12 pages, 5 figures

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Statistics Theory (math.ST); Machine Learning (stat.ML)

[678] arXiv:2103.04032 (cross-list from cs.LG) [pdf, other]

Title: CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks

Sakshi Varshney, Vinay Kumar Verma, Srijith P K, Lawrence Carin, Piyush Rai

Comments: Under Submission

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[679] arXiv:2103.04046 (cross-list from cs.LG) [pdf, other]

Title: Simplicial Complex Representation Learning

Mustafa Hajij, Ghada Zamzmi, Theodore Papamarkou, Vasileios Maroulas, Xuanting Cai

Comments: MACHINE LEARNING ON GRAPHS, MLoG Workshop at WSDM'22

Subjects: Machine Learning (cs.LG); Computational Geometry (cs.CG); Computer Vision and Pattern Recognition (cs.CV); Algebraic Topology (math.AT); Machine Learning (stat.ML)

[680] arXiv:2103.04060 (cross-list from cs.LG) [pdf, other]

Title: Low-Rank Isomap Algorithm

Eysan Mehrbani, Mohammad Hossein Kahaei

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[681] arXiv:2103.04064 (cross-list from cs.LG) [pdf, other]

Title: Tensor Laplacian Regularized Low-Rank Representation for Non-uniformly Distributed Data Subspace Clustering

Eysan Mehrbani, Mohammad Hossein Kahaei, Seyed Aliasghar Beheshti

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[682] arXiv:2103.04140 (cross-list from cs.LG) [pdf, other]

Title: Linear Regression over Networks with Communication Guarantees

Konstantinos Gatsis

Comments: Accepted at 3rd Annual Learning for Dynamics & Control Conference (L4DC) 2021. arXiv admin note: substantial text overlap with arXiv:2101.10007

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Optimization and Control (math.OC); Machine Learning (stat.ML)

[683] arXiv:2103.04158 (cross-list from astro-ph.CO) [pdf, other]

Title: On the accuracy and precision of correlation functions and field-level inference in cosmology

Florent Leclercq, Alan Heavens

Comments: 6+8 pages, 4+5 figures. Matches MNRAS Letters published version. Appendices provide supplementary information, including calculations of Fisher matrices. Our code and data are publicly available at this https URL

Journal-ref: MNRAS Letters 506, L85 (2021)

Subjects: Cosmology and Nongalactic Astrophysics (astro-ph.CO); Instrumentation and Methods for Astrophysics (astro-ph.IM); Applications (stat.AP)

[684] arXiv:2103.04211 (cross-list from math.PR) [pdf, other]

Title: Statistical analysis of discretely sampled semilinear SPDEs: a power variation approach

Igor Cialenco, Hyun-Jung Kim, Gregor Pasemann

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[685] arXiv:2103.04217 (cross-list from cs.LG) [pdf, other]

Title: Spectral Tensor Train Parameterization of Deep Learning Layers

Anton Obukhov, Maxim Rakhuba, Alexander Liniger, Zhiwu Huang, Stamatios Georgoulis, Dengxin Dai, Luc Van Gool

Comments: Accepted at AISTATS 2021

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[686] arXiv:2103.04250 (cross-list from cs.LG) [pdf, other]

Title: Greedy Approximation Algorithms for Active Sequential Hypothesis Testing

Kyra Gan, Su Jia, Andrew Li

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[687] arXiv:2103.04387 (cross-list from cs.LG) [pdf, other]

Title: CORe: Capitalizing On Rewards in Bandit Exploration

Nan Wang, Branislav Kveton, Maryam Karimzadehgan

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[688] arXiv:2103.04392 (cross-list from math.OC) [pdf, html, other]

Title: A Retrospective Approximation Approach for Smooth Stochastic Optimization

David Newton, Raghu Bollapragada, Raghu Pasupathy, Nung Kwan Yip

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[689] arXiv:2103.04413 (cross-list from math.OC) [pdf, other]

Title: Escaping Saddle Points with Stochastically Controlled Stochastic Gradient Methods

Guannan Liang, Qianqian Tong, Chunjiang Zhu, Jinbo Bi

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[690] arXiv:2103.04446 (cross-list from cs.LG) [pdf, other]

Title: A Lower Bound for the Sample Complexity of Inverse Reinforcement Learning

Abi Komanduru, Jean Honorio

Journal-ref: International Conference on Machine Learning (ICML), 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[691] arXiv:2103.04554 (cross-list from cs.LG) [pdf, other]

Title: Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models

Zitong Yang, Yu Bai, Song Mei

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[692] arXiv:2103.04556 (cross-list from cs.DS) [pdf, other]

Title: T-SCI: A Two-Stage Conformal Inference Algorithm with Guaranteed Coverage for Cox-MLP

Jiaye Teng, Zeren Tan, Yang Yuan

Subjects: Data Structures and Algorithms (cs.DS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[693] arXiv:2103.04850 (cross-list from cs.LG) [pdf, other]

Title: Quantifying Ignorance in Individual-Level Causal-Effect Estimates under Hidden Confounding

Andrew Jesson, Sören Mindermann, Yarin Gal, Uri Shalit

Comments: 19 pages, 5 figures, ICML 2021

Journal-ref: PMLR 139 (2021) 4829-4838

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[694] arXiv:2103.04886 (cross-list from cs.LG) [pdf, other]

Title: Lipschitz Normalization for Self-Attention Layers with Application to Graph Neural Networks

George Dasoulas, Kevin Scaman, Aladin Virmaux

Comments: 18 pages. Proceedings of the 38th International Conference on Machine Learning, PMLR 139, 2021. Copyright 2021 by the author(s)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[695] arXiv:2103.04902 (cross-list from cond-mat.dis-nn) [pdf, other]

Title: Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problem

Francesca Mignacco, Pierfrancesco Urbani, Lenka Zdeborová

Comments: 28 pages, 11 figures

Journal-ref: Mach. Learn.: Sci. Technol. 2 035029 (2021)

Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[696] arXiv:2103.04922 (cross-list from cs.LG) [pdf, other]

Title: Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models

Sam Bond-Taylor, Adam Leach, Yang Long, Chris G. Willcocks

Comments: 20 pages, 9 figures, will appear in IEEE Transactions on Pattern Analysis and Machine Intelligence

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[697] arXiv:2103.04944 (cross-list from econ.EM) [pdf, other]

Title: Approximate Bayesian inference and forecasting in huge-dimensional multi-country VARs

Martin Feldkircher, Florian Huber, Gary Koop, Michael Pfarrhofer

Comments: JEL: C11, C33, C55, E37; Keywords: Multi-country models, macroeconomic forecasting, vector autoregression, spillovers

Subjects: Econometrics (econ.EM); Applications (stat.AP); Machine Learning (stat.ML)

[698] arXiv:2103.04947 (cross-list from cs.LG) [pdf, other]

Title: Instabilities of Offline RL with Pre-Trained Neural Representation

Ruosong Wang, Yifan Wu, Ruslan Salakhutdinov, Sham M. Kakade

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)

[699] arXiv:2103.04957 (cross-list from cs.LG) [pdf, other]

Title: Learning to Represent and Predict Sets with Deep Neural Networks

Yan Zhang

Comments: PhD thesis submitted December 2019

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[700] arXiv:2103.04972 (cross-list from cs.LG) [pdf, other]

Title: Provably Efficient Cooperative Multi-Agent Reinforcement Learning with Function Approximation

Abhimanyu Dubey, Alex Pentland

Comments: 53 pages including Appendix

Subjects: Machine Learning (cs.LG); Multiagent Systems (cs.MA); Machine Learning (stat.ML)