Statistics

Authors and titles for June 2021

[701] arXiv:2106.02329 (cross-list from cs.LG) [pdf, html, other]

Title: Deep Switching State Space Model (DS$^3$M) for Nonlinear Time Series Forecasting with Regime Switching

Xiuqin Xu, Hanqiu Peng, Ying Chen

Subjects: Machine Learning (cs.LG); Applications (stat.AP)

[702] arXiv:2106.02347 (cross-list from physics.chem-ph) [pdf, other]

Title: SE(3)-equivariant prediction of molecular wavefunctions and electronic densities

Oliver T. Unke, Mihail Bogojeski, Michael Gastegger, Mario Geiger, Tess Smidt, Klaus-Robert Müller

Subjects: Chemical Physics (physics.chem-ph); Machine Learning (stat.ML)

[703] arXiv:2106.02357 (cross-list from cs.LG) [pdf, other]

Title: Adiabatic Quantum Feature Selection for Sparse Linear Regression

Surya Sai Teja Desu, P.K. Srijith, M.V. Panduranga Rao, Naveen Sivadasan

Comments: 8 pages, 2 tables

Subjects: Machine Learning (cs.LG); Quantum Physics (quant-ph); Machine Learning (stat.ML)

[704] arXiv:2106.02389 (cross-list from math.CA) [pdf, other]

Title: The sine kernel, two corresponding operator identities, and random matrices

Lev Sakhnovich

Comments: This paper is a prolongation (and an important development of some results) of our paper arXiv:2104.12694

Subjects: Classical Analysis and ODEs (math.CA); Functional Analysis (math.FA); Probability (math.PR); Spectral Theory (math.SP); Statistics Theory (math.ST)

[705] arXiv:2106.02390 (cross-list from cs.LG) [pdf, other]

Title: Online reinforcement learning with sparse rewards through an active inference capsule

Alejandro Daniel Noel (1), Charel van Hoof (1), Beren Millidge (2) ((1) Delft University of Technology, (2) University of Oxford)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[706] arXiv:2106.02398 (cross-list from cs.LG) [pdf, other]

Title: Strategyproof Learning: Building Trustworthy User-Generated Datasets

Sadegh Farhadkhani, Rachid Guerraoui, Lê-Nguyên Hoang

Comments: 31 pages

Subjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Machine Learning (stat.ML)

[707] arXiv:2106.02453 (cross-list from cond-mat.stat-mech) [pdf, other]

Title: On the nature of time in time-dependent expansionary processes

Laurence Lacey

Comments: 18 pages, 4 figures, 1 appendix

Subjects: Statistical Mechanics (cond-mat.stat-mech); Probability (math.PR); Methodology (stat.ME)

[708] arXiv:2106.02469 (cross-list from cs.LG) [pdf, other]

Title: Can convolutional ResNets approximately preserve input distances? A frequency analysis perspective

Lewis Smith, Joost van Amersfoort, Haiwen Huang, Stephen Roberts, Yarin Gal

Comments: Main paper 10 pages including references, appendix 10 pages. 7 figures and 6 tables including appendix

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[709] arXiv:2106.02488 (cross-list from cs.LG) [pdf, other]

Title: Evaluating Local Explanations using White-box Models

Amir Hossein Akhavan Rahnama, Judith Butepage, Pierre Geurts, Henrik Bostrom

Comments: Submitted to ACM FaCCT 2022 Jan 21 2022, 13 pages, 4 Figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[710] arXiv:2106.02524 (cross-list from cs.CL) [pdf, other]

Title: CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notes

James Mullenbach, Yada Pruksachatkun, Sean Adler, Jennifer Seale, Jordan Swartz, T. Greg McKelvey, Hui Dai, Yi Yang, David Sontag

Comments: ACL 2021

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[711] arXiv:2106.02531 (cross-list from cs.CV) [pdf, other]

Title: CAFLOW: Conditional Autoregressive Flows

Georgios Batzolis, Marcello Carioni, Christian Etmann, Soroosh Afyouni, Zoe Kourtzi, Carola Bibiane Schönlieb

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[712] arXiv:2106.02542 (cross-list from cs.LG) [pdf, other]

Title: Heterogeneous Wasserstein Discrepancy for Incomparable Distributions

Mokhtar Z. Alaya, Gilles Gasso, Maxime Berar, Alain Rakotomamonjy

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[713] arXiv:2106.02552 (cross-list from cs.LG) [pdf, other]

Title: Active Covering

Heinrich Jiang, Afshin Rostamizadeh

Comments: ICML 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[714] arXiv:2106.02553 (cross-list from cs.LG) [pdf, other]

Title: Fair Exploration via Axiomatic Bargaining

Jackie Baek, Vivek F. Farias

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[715] arXiv:2106.02584 (cross-list from cs.LG) [pdf, other]

Title: Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning

Jannik Kossen, Neil Band, Clare Lyle, Aidan N. Gomez, Tom Rainforth, Yarin Gal

Comments: Accepted for publication at NeurIPS 2021. First two authors contributed equally

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[716] arXiv:2106.02588 (cross-list from cs.LG) [pdf, other]

Title: Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis

Stephan Wojtowytsch

Subjects: Machine Learning (cs.LG); Analysis of PDEs (math.AP); Machine Learning (stat.ML)

[717] arXiv:2106.02597 (cross-list from cs.LG) [pdf, other]

Title: Model-agnostic and Scalable Counterfactual Explanations via Reinforcement Learning

Robert-Florian Samoilescu, Arnaud Van Looveren, Janis Klaise

Comments: 18 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[718] arXiv:2106.02600 (cross-list from cs.LG) [pdf, other]

Title: Causal Graph Discovery from Self and Mutually Exciting Time Series

Song Wei, Yao Xie, Christopher S. Josef, Rishikesan Kamaleswaran

Comments: See v2 for a previous workshop paper on Interpretable ML in Healthcare (IMLH) at ICML 2021, titled "Causal Graph Recovery for Sepsis-Associated Derangements via Interpretable Hawkes Networks". Also, see arXiv:2301.11336 for a short version with more experiments of our proposed method to learn "strict" DAGs

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Applications (stat.AP); Methodology (stat.ME)

[719] arXiv:2106.02614 (cross-list from cs.LG) [pdf, other]

Title: Sigma-Delta and Distributed Noise-Shaping Quantization Methods for Random Fourier Features

Jinjie Zhang, Harish Kannan, Alexander Cloninger, Rayan Saab

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[720] arXiv:2106.02619 (cross-list from cs.LG) [pdf, other]

Title: Forward Super-Resolution: How Can GANs Learn Hierarchical Generative Models for Real-World Distributions

Zeyuan Allen-Zhu, Yuanzhi Li

Comments: v2 polishes writing

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Neural and Evolutionary Computing (cs.NE); Optimization and Control (math.OC); Machine Learning (stat.ML)

[721] arXiv:2106.02624 (cross-list from cs.LG) [pdf, other]

Title: ViViT: Curvature access through the generalized Gauss-Newton's low-rank structure

Felix Dangel, Lukas Tatzel, Philipp Hennig

Comments: Main text: 10 pages, 6 figures; Supplements: 26 pages, 27 figures, 5 tables

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[722] arXiv:2106.02654 (cross-list from cs.LG) [pdf, other]

Title: Churn Reduction via Distillation

Heinrich Jiang, Harikrishna Narasimhan, Dara Bahri, Andrew Cotter, Afshin Rostamizadeh

Journal-ref: ICLR 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[723] arXiv:2106.02680 (cross-list from cs.DS) [pdf, other]

Title: Algorithms from Invariants: Smoothed Analysis of Orbit Recovery over $SO(3)$

Allen Liu, Ankur Moitra

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[724] arXiv:2106.02726 (cross-list from cs.SI) [pdf, other]

Title: Popular individuals process the world in particularly normative ways

Elisa C. Baek, Ryan Hyon, Karina López, Emily S. Finn, Mason A. Porter, Carolyn Parkinson

Comments: revised version; title changed. arXiv admin note: text overlap with arXiv:2107.01312

Subjects: Social and Information Networks (cs.SI); Physics and Society (physics.soc-ph); Neurons and Cognition (q-bio.NC); Applications (stat.AP)

[725] arXiv:2106.02770 (cross-list from cs.LG) [pdf, other]

Title: Deep Bayesian Active Learning for Accelerating Stochastic Simulation

Dongxia Wu, Ruijia Niu, Matteo Chinazzi, Alessandro Vespignani, Yi-An Ma, Rose Yu

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[726] arXiv:2106.02774 (cross-list from cs.DS) [pdf, other]

Title: Robust Model Selection and Nearly-Proper Learning for GMMs

Jerry Li, Allen Liu, Ankur Moitra

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[727] arXiv:2106.02805 (cross-list from math.OC) [pdf, other]

Title: Nonconvex Optimization via MM Algorithms: Convergence Theory

Kenneth Lange, Joong-Ho Won, Alfonso Landeros, Hua Zhou

Comments: 33 pages

Journal-ref: Wiley StatsRef: Statistics Reference Online, 2021

Subjects: Optimization and Control (math.OC); Computation (stat.CO)

[728] arXiv:2106.02875 (cross-list from cs.LG) [pdf, other]

Title: Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease Progression

Zhaozhi Qian, William R. Zame, Lucas M. Fleuren, Paul Elbers, Mihaela van der Schaar

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[729] arXiv:2106.02878 (cross-list from cs.SI) [pdf, other]

Title: A Generative Node-attribute Network Model for Detecting Generalized Structure

Wei Liu, Zhenhai Chang, Caiyan Jia, Yimei Zheng

Subjects: Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[730] arXiv:2106.02890 (cross-list from cs.LG) [pdf, other]

Title: Can Subnetwork Structure be the Key to Out-of-Distribution Generalization?

Dinghuai Zhang, Kartik Ahuja, Yilun Xu, Yisen Wang, Aaron Courville

Comments: Accepted to ICML2021 as long talk

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[731] arXiv:2106.02993 (cross-list from cs.LG) [pdf, other]

Title: PID-GAN: A GAN Framework based on a Physics-informed Discriminator for Uncertainty Quantification with Physics

Arka Daw, M. Maruf, Anuj Karpatne

Comments: 11 pages, 11 figures, 2 tables, Published at KDD 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[732] arXiv:2106.03131 (cross-list from cs.LG) [pdf, other]

Title: The Fine-Grained Hardness of Sparse Linear Regression

Aparna Gupte, Vinod Vaikuntanathan

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[733] arXiv:2106.03178 (cross-list from cs.AI) [pdf, other]

Title: Path-specific Effects Based on Information Accounts of Causality

Heyang Gong, Ke Zhu

Subjects: Artificial Intelligence (cs.AI); Other Statistics (stat.OT)

[734] arXiv:2106.03194 (cross-list from cs.LG) [pdf, other]

Title: Robust Implicit Networks via Non-Euclidean Contractions

Saber Jafarpour, Alexander Davydov, Anton V. Proskurnikov, Francesco Bullo

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Optimization and Control (math.OC); Machine Learning (stat.ML)

[735] arXiv:2106.03195 (cross-list from cs.LG) [pdf, other]

Title: Meta-Learning Reliable Priors in the Function Space

Jonas Rothfuss, Dominique Heyn, Jinfan Chen, Andreas Krause

Comments: In Advances of Neural Information Processing Systems (NeurIPS) 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[736] arXiv:2106.03207 (cross-list from cs.LG) [pdf, other]

Title: Mitigating Covariate Shift in Imitation Learning via Offline Data Without Great Coverage

Jonathan D. Chang, Masatoshi Uehara, Dhruv Sreenivas, Rahul Kidambi, Wen Sun

Comments: 42 pages, 5 figures, 7 tables

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[737] arXiv:2106.03211 (cross-list from cs.LG) [pdf, other]

Title: Distributed Learning and its Application for Time-Series Prediction

Nhuong V. Nguyen, Sybille Legitime

Comments: 8 pages, 10 figures, and 2 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[738] arXiv:2106.03216 (cross-list from cs.LG) [pdf, other]

Title: On Memorization in Probabilistic Deep Generative Models

Gerrit J. J. van den Burg, Christopher K. I. Williams

Comments: Accepted for publication at NeurIPS 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[739] arXiv:2106.03221 (cross-list from cs.LG) [pdf, other]

Title: PAC Best Arm Identification Under a Deadline

Brijen Thananjeyan, Kirthevasan Kandasamy, Ion Stoica, Michael I. Jordan, Ken Goldberg, Joseph E. Gonzalez

Comments: In submission

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[740] arXiv:2106.03234 (cross-list from cs.LG) [pdf, other]

Title: A call for better unit testing for invariant risk minimisation

Chunyang Xiao, Pranava Madhyastha

Comments: Manuscript v1.0

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[741] arXiv:2106.03235 (cross-list from math.OC) [pdf, other]

Title: On the Optimality of Backward Regression: Sparse Recovery and Subset Selection

Sebatian Ament, Carla Gomes

Subjects: Optimization and Control (math.OC); Information Theory (cs.IT); Numerical Analysis (math.NA); Computation (stat.CO)

[742] arXiv:2106.03273 (cross-list from cs.LG) [pdf, other]

Title: Control-Oriented Model-Based Reinforcement Learning with Implicit Differentiation

Evgenii Nikishin, Romina Abachi, Rishabh Agarwal, Pierre-Luc Bacon

Comments: Code at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[743] arXiv:2106.03300 (cross-list from cs.LG) [pdf, other]

Title: Sum of Ranked Range Loss for Supervised Learning

Shu Hu, Yiming Ying, Xin Wang, Siwei Lyu

Comments: Accepted by Journal of Machine Learning Research (JMLR). arXiv admin note: text overlap with arXiv:2010.01741

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[744] arXiv:2106.03314 (cross-list from cs.LG) [pdf, other]

Title: Measuring Generalization with Optimal Transport

Ching-Yao Chuang, Youssef Mroueh, Kristjan Greenewald, Antonio Torralba, Stefanie Jegelka

Comments: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[745] arXiv:2106.03350 (cross-list from math.PR) [pdf, other]

Title: Maximum likelihood estimation for sub-fractional Vasicek model

B.L.S. Prakasa Rao

Comments: arXiv admin note: substantial text overlap with arXiv:1901.06102

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[746] arXiv:2106.03352 (cross-list from cs.LG) [pdf, other]

Title: The Power of Exploiter: Provable Multi-Agent RL in Large State Spaces

Chi Jin, Qinghua Liu, Tiancheng Yu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[747] arXiv:2106.03354 (cross-list from cs.LG) [pdf, html, other]

Title: AI without networks

Partha P Mitra, Clément Sire

Comments: 47 pages with 8 figures + 33 pages supplementary with 7 figures and one table (total 80 pages)

Subjects: Machine Learning (cs.LG); Statistical Mechanics (cond-mat.stat-mech); Functional Analysis (math.FA); Machine Learning (stat.ML)

[748] arXiv:2106.03500 (cross-list from cs.LG) [pdf, other]

Title: Density estimation on smooth manifolds with normalizing flows

Dimitris Kalatzis, Johan Ziruo Ye, Alison Pouplin, Jesper Wohlert, Søren Hauberg

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[749] arXiv:2106.03517 (cross-list from cs.LG) [pdf, other]

Title: Top-KAST: Top-K Always Sparse Training

Siddhant M. Jayakumar, Razvan Pascanu, Jack W. Rae, Simon Osindero, Erich Elsen

Journal-ref: Advances in Neural Information Processing Systems, 33, 20744-20754

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[750] arXiv:2106.03585 (cross-list from math.OC) [pdf, other]

Title: Asynchronous speedup in decentralized optimization

Mathieu Even, Hadrien Hendrikx, Laurent Massoulie

Subjects: Optimization and Control (math.OC); Multiagent Systems (cs.MA); Probability (math.PR); Machine Learning (stat.ML)

[751] arXiv:2106.03632 (cross-list from cs.LG) [pdf, other]

Title: Quantifying and Improving Transferability in Domain Generalization

Guojun Zhang, Han Zhao, Yaoliang Yu, Pascal Poupart

Comments: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[752] arXiv:2106.03640 (cross-list from cs.LG) [pdf, other]

Title: Making EfficientNet More Efficient: Exploring Batch-Independent Normalization, Group Convolutions and Reduced Resolution Training

Dominic Masters, Antoine Labatie, Zach Eaton-Rosen, Carlo Luschi

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[753] arXiv:2106.03676 (cross-list from math.AC) [pdf, other]

Title: Learning a performance metric of Buchberger's algorithm

Jelena Mojsilović, Dylan Peifer, Sonja Petrović

Journal-ref: Involve 16 (2023) 227-248

Subjects: Commutative Algebra (math.AC); Machine Learning (cs.LG); Symbolic Computation (cs.SC); Algebraic Geometry (math.AG); Machine Learning (stat.ML)

[754] arXiv:2106.03686 (cross-list from eess.SP) [pdf, other]

Title: Deep Unfolding of Iteratively Reweighted ADMM for Wireless RF Sensing

Udaya S.K.P. Miriya Thanthrige, Peter Jung, Aydin Sezgin

Journal-ref: Sensors 2022,

Subjects: Signal Processing (eess.SP); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[755] arXiv:2106.03691 (cross-list from econ.EM) [pdf, other]

Title: On the "mementum" of Meme Stocks

Michele Costola, Matteo Iacopini, Carlo R.M.A. Santagiustina

Subjects: Econometrics (econ.EM); General Finance (q-fin.GN); Applications (stat.AP)

[756] arXiv:2106.03696 (cross-list from math.OC) [pdf, other]

Title: Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models

Courtney Paquette, Elliot Paquette

Comments: 39 pages, 7 figures

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Probability (math.PR); Machine Learning (stat.ML)

[757] arXiv:2106.03713 (cross-list from q-bio.PE) [pdf, other]

Title: The evolving usefulness of the Test-Negative Design in studying risk factors for COVID-19 due to changes in testing policy

Jan P Vandenbroucke, Elizabeth B Brickley, Christina M.J.E. Vandenbroucke-Grauls, Neil Pearce

Comments: 3 pages

Subjects: Populations and Evolution (q-bio.PE); Methodology (stat.ME)

[758] arXiv:2106.03743 (cross-list from cs.LG) [pdf, other]

Title: Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence

Antoine Labatie, Dominic Masters, Zach Eaton-Rosen, Carlo Luschi

Comments: NeurIPS 2021 camera-ready

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[759] arXiv:2106.03747 (cross-list from quant-ph) [pdf, other]

Title: The Inductive Bias of Quantum Kernels

Jonas M. Kübler, Simon Buchholz, Bernhard Schölkopf

Comments: Accepted version. 9 pages main paper. Total 25 pages

Journal-ref: Advances in Neural Information Processing Systems 34 (NeurIPS 2021)

Subjects: Quantum Physics (quant-ph); Machine Learning (stat.ML)

[760] arXiv:2106.03748 (cross-list from cs.LG) [pdf, other]

Title: Towards robust and domain agnostic reinforcement learning competitions

William Hebgen Guss, Stephanie Milani, Nicholay Topin, Brandon Houghton, Sharada Mohanty, Andrew Melnik, Augustin Harter, Benoit Buschmaas, Bjarne Jaster, Christoph Berganski, Dennis Heitkamp, Marko Henning, Helge Ritter, Chengjie Wu, Xiaotian Hao, Yiming Lu, Hangyu Mao, Yihuan Mao, Chao Wang, Michal Opanowicz, Anssi Kanervisto, Yanick Schraner, Christian Scheller, Xiren Zhou, Lu Liu, Daichi Nishio, Toi Tsuneda, Karolis Ramanauskas, Gabija Juceviciute

Comments: 20 pages, several figures, published PMLR

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Robotics (cs.RO); Machine Learning (stat.ML)

[761] arXiv:2106.03755 (cross-list from cs.CV) [pdf, other]

Title: HERS Superpixels: Deep Affinity Learning for Hierarchical Entropy Rate Segmentation

Hankui Peng, Angelica I. Aviles-Rivero, Carola-Bibiane Schönlieb

Subjects: Computer Vision and Pattern Recognition (cs.CV); Applications (stat.AP); Machine Learning (stat.ML)

[762] arXiv:2106.03760 (cross-list from cs.LG) [pdf, other]

Title: DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning

Hussein Hazimeh, Zhe Zhao, Aakanksha Chowdhery, Maheswaran Sathiamoorthy, Yihua Chen, Rahul Mazumder, Lichan Hong, Ed H. Chi

Comments: Appeared in NeurIPS 2021

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[763] arXiv:2106.03761 (cross-list from cs.CV) [pdf, other]

Title: FairCal: Fairness Calibration for Face Verification

Tiago Salvador, Stephanie Cairns, Vikram Voleti, Noah Marshall, Adam Oberman

Comments: Accepted at ICLR 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[764] arXiv:2106.03790 (cross-list from cs.LG) [pdf, other]

Title: Multi-armed Bandit Requiring Monotone Arm Sequences

Ningyuan Chen

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[765] arXiv:2106.03805 (cross-list from cs.CV) [pdf, other]

Title: 3DB: A Framework for Debugging Computer Vision Models

Guillaume Leclerc, Hadi Salman, Andrew Ilyas, Sai Vemprala, Logan Engstrom, Vibhav Vineet, Kai Xiao, Pengchuan Zhang, Shibani Santurkar, Greg Yang, Ashish Kapoor, Aleksander Madry

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[766] arXiv:2106.03831 (cross-list from cs.LG) [pdf, other]

Title: Counterfactual Maximum Likelihood Estimation for Training Deep Networks

Xinyi Wang, Wenhu Chen, Michael Saxon, William Yang Wang

Comments: 10 pages, 2 figures, accepted to NeurIPS 2021

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[767] arXiv:2106.03880 (cross-list from quant-ph) [pdf, other]

Title: Encoding-dependent generalization bounds for parametrized quantum circuits

Matthias C. Caro, Elies Gil-Fuster, Johannes Jakob Meyer, Jens Eisert, Ryan Sweke

Comments: 35 pages, 3 figures; corrected a mistake in Eq. (38) of the previous version, results remain unchanged except for a restriction to frequency vectors with integer entries; added a conjecture to recover results in full

Journal-ref: Quantum 5, 582 (2021)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Machine Learning (stat.ML)

[768] arXiv:2106.03885 (cross-list from cs.LG) [pdf, other]

Title: Differentiable Multiple Shooting Layers

Stefano Massaroli, Michael Poli, Sho Sonoda, Taji Suzuki, Jinkyoo Park, Atsushi Yamashita, Hajime Asama

Subjects: Machine Learning (cs.LG); Dynamical Systems (math.DS); Optimization and Control (math.OC); Machine Learning (stat.ML)

[769] arXiv:2106.03907 (cross-list from cs.LG) [pdf, html, other]

Title: Deep Proxy Causal Learning and its Application to Confounded Bandit Policy Evaluation

Liyuan Xu, Heishiro Kanagawa, Arthur Gretton

Comments: arXiv admin note: text overlap with arXiv:2010.07154

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[770] arXiv:2106.03922 (cross-list from cs.LG) [pdf, other]

Title: Interactive Label Cleaning with Example-based Explanations

Stefano Teso, Andrea Bontempelli, Fausto Giunchiglia, Andrea Passerini

Comments: main article + supplementary material, Advances in Neural Information Processing Systems 34 (NeurIPS 2021)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[771] arXiv:2106.03931 (cross-list from cs.LG) [pdf, other]

Title: Entropy Regularized Reinforcement Learning Using Large Deviation Theory

Argenis Arriojas, Jacob Adamczyk, Stas Tiomkin, Rahul V. Kulkarni

Journal-ref: Phys. Rev. Research 5, 023085 (2023)

Subjects: Machine Learning (cs.LG); Statistical Mechanics (cond-mat.stat-mech); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[772] arXiv:2106.03955 (cross-list from cs.LG) [pdf, other]

Title: Correcting Momentum in Temporal Difference Learning

Emmanuel Bengio, Joelle Pineau, Doina Precup

Comments: NeurIPS Deep RL Workshop 2020

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[773] arXiv:2106.03969 (cross-list from cs.LG) [pdf, other]

Title: Chow-Liu++: Optimal Prediction-Centric Learning of Tree Ising Models

Enric Boix-Adsera, Guy Bresler, Frederic Koehler

Comments: 49 pages, 3 figures, to appear in FOCS'21

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Statistics Theory (math.ST)

[774] arXiv:2106.03990 (cross-list from physics.data-an) [pdf, other]

Title: Granger causality in the frequency domain: derivation and applications

Vinicius Lima, Fernanda Jaiara Dellajustina, Renan O. Shimoura, Mauricio Girardi-Schappo, Nilton L. Kamiji, Rodrigo F. O. Pena, Antonio C. Roque

Comments: 21 pages, 10 figures

Journal-ref: Rev. Bras. Ensino F\'is. 42: e20200007 (2020)

Subjects: Data Analysis, Statistics and Probability (physics.data-an); Biological Physics (physics.bio-ph); Quantitative Methods (q-bio.QM); Methodology (stat.ME)

[775] arXiv:2106.04082 (cross-list from math.PR) [pdf, other]

Title: Markov Chains Generated by Convolutions of Orthogonality Measures

Satoru Odake, Ryu Sasaki

Comments: 46 pages. Comments added, some repeated results deleted. To appear in J.Phys.A

Journal-ref: J. Phys. A: Math. Theor. 55 (2022) 275201 (42pp)

Subjects: Probability (math.PR); Mathematical Physics (math-ph); Classical Analysis and ODEs (math.CA); Statistics Theory (math.ST); Exactly Solvable and Integrable Systems (nlin.SI)

[776] arXiv:2106.04096 (cross-list from cs.LG) [pdf, other]

Title: Linear Convergence of Entropy-Regularized Natural Policy Gradient with Linear Function Approximation

Semih Cayci, Niao He, R. Srikant

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[777] arXiv:2106.04110 (cross-list from cs.LG) [pdf, other]

Title: A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs

Gadi Naveh, Zohar Ringel

Comments: 9 pages of main text, 23 pages of appendices, 5 figures total

Subjects: Machine Learning (cs.LG); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (stat.ML)

[778] arXiv:2106.04145 (cross-list from math.OC) [pdf, other]

Title: Unbalanced Optimal Transport through Non-negative Penalized Linear Regression

Laetitia Chapel, Rémi Flamary, Haoran Wu, Cédric Févotte, Gilles Gasso

Comments: Laetitia Chapel and Rémi Flamary have equal contribution

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[779] arXiv:2106.04156 (cross-list from cs.LG) [pdf, other]

Title: Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss

Jeff Z. HaoChen, Colin Wei, Adrien Gaidon, Tengyu Ma

Comments: Accepted as an oral to NeurIPS 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[780] arXiv:2106.04186 (cross-list from cs.LG) [pdf, other]

Title: What training reveals about neural network complexity

Andreas Loukas, Marinos Poiitis, Stefanie Jegelka

Comments: Published at NeurIPS 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[781] arXiv:2106.04210 (cross-list from cs.IR) [pdf, other]

Title: Defining definition: a Text mining Approach to Define Innovative Technological Fields

Vito Giordano, Filippo Chiarello, Elena Cervelli

Journal-ref: R&D MANAGEMENT CONFERENCE 2019 - DATA SCIENCE FOR INNOVATION R&D MANAGEMENT CONFERENCE 2019 - DATA SCIENCE FOR INNOVATION R&D Management Conference 2021 - Data Science for Innovatopm

Subjects: Information Retrieval (cs.IR); Machine Learning (stat.ML)

[782] arXiv:2106.04221 (cross-list from cs.LG) [pdf, other]

Title: Multi-output Gaussian Processes for Uncertainty-aware Recommender Systems

Yinchong Yang, Florian Buettner

Comments: Published at UAI 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[783] arXiv:2106.04237 (cross-list from econ.EM) [pdf, other]

Title: Testing Monotonicity of Mean Potential Outcomes in a Continuous Treatment with High-Dimensional Data

Yu-Chin Hsu, Martin Huber, Ying-Ying Lee, Chu-An Liu

Subjects: Econometrics (econ.EM); Methodology (stat.ME)

[784] arXiv:2106.04335 (cross-list from cs.LG) [pdf, other]

Title: Reinforced Few-Shot Acquisition Function Learning for Bayesian Optimization

Bing-Jing Hsieh, Ping-Chun Hsieh, Xi Liu

Comments: 21 pages, 8 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[785] arXiv:2106.04378 (cross-list from cs.LG) [pdf, other]

Title: Adaptive Machine Unlearning

Varun Gupta, Christopher Jung, Seth Neel, Aaron Roth, Saeed Sharifi-Malvajerdi, Chris Waites

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[786] arXiv:2106.04379 (cross-list from cs.LG) [pdf, html, other]

Title: Learning Markov State Abstractions for Deep Reinforcement Learning

Cameron Allen, Neev Parikh, Omer Gottesman, George Konidaris

Comments: Fixed typo (see Errata). Code available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[787] arXiv:2106.04461 (cross-list from cs.AI) [pdf, other]

Title: North Carolina COVID-19 Agent-Based Model Framework for Hospitalization Forecasting Overview, Design Concepts, and Details Protocol

Kasey Jones, Emily Hadley, Sandy Preiss, Caroline Kery, Peter Baumgartner, Marie Stoner, Sarah Rhea

Subjects: Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Applications (stat.AP)

[788] arXiv:2106.04492 (cross-list from eess.AS) [pdf, other]

Title: Description and Discussion on DCASE 2021 Challenge Task 2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring under Domain Shifted Conditions

Yohei Kawaguchi, Keisuke Imoto, Yuma Koizumi, Noboru Harada, Daisuke Niizumi, Kota Dohi, Ryo Tanabe, Harsh Purohit, Takashi Endo

Comments: Accepted to DCASE 2021 Workshop

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[789] arXiv:2106.04502 (cross-list from cs.LG) [pdf, other]

Title: Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing

Mikhail Khodak, Renbo Tu, Tian Li, Liam Li, Maria-Florina Balcan, Virginia Smith, Ameet Talwalkar

Comments: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[790] arXiv:2106.04510 (cross-list from physics.med-ph) [pdf, other]

Title: Random Forest classifier for EEG-based seizure prediction

Remy Ben Messaoud, Mario Chavez

Comments: all the python code used for this work can be found in this repository: this https URL

Subjects: Medical Physics (physics.med-ph); Machine Learning (cs.LG); Signal Processing (eess.SP); Applications (stat.AP)

[791] arXiv:2106.04530 (cross-list from cs.LG) [pdf, other]

Title: Learning from Multiple Noisy Partial Labelers

Peilin Yu, Tiffany Ding, Stephen H. Bach

Comments: In Proceedings of the 25th International Conference on Artificial Intelligence and Statistics (AISTATS) 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[792] arXiv:2106.04546 (cross-list from cs.LG) [pdf, other]

Title: LEADS: Learning Dynamical Systems that Generalize Across Environments

Yuan Yin, Ibrahim Ayed, Emmanuel de Bézenac, Nicolas Baskiotis, Patrick Gallinari

Comments: Published at NeurIPS 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[793] arXiv:2106.04615 (cross-list from cs.LG) [pdf, other]

Title: Vector Quantized Models for Planning

Sherjil Ozair, Yazhe Li, Ali Razavi, Ioannis Antonoglou, Aäron van den Oord, Oriol Vinyals

Comments: ICML 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[794] arXiv:2106.04636 (cross-list from econ.EM) [pdf, other]

Title: Automatically Differentiable Random Coefficient Logistic Demand Estimation

Andrew Chia

Subjects: Econometrics (econ.EM); Distributed, Parallel, and Cluster Computing (cs.DC); Computation (stat.CO); Machine Learning (stat.ML)

[795] arXiv:2106.04682 (cross-list from cs.LG) [pdf, other]

Title: Bayesian Optimization over Hybrid Spaces

Aryan Deshwal, Syrine Belakaria, Janardhan Rao Doppa

Comments: 14 pages, 18 figures

Journal-ref: Thirty-ninth International Conference on Machine Learning (ICML) 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)

[796] arXiv:2106.04692 (cross-list from cs.LG) [pdf, other]

Title: Provably Faster Algorithms for Bilevel Optimization

Junjie Yang, Kaiyi Ji, Yingbin Liang

Comments: This paper is accepted in NeurIPS 2021

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[797] arXiv:2106.04700 (cross-list from cs.LG) [pdf, other]

Title: Scale Free Adversarial Multi Armed Bandits

Sudeep Raja Putta, Shipra Agrawal

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[798] arXiv:2106.04721 (cross-list from math.PR) [pdf, other]

Title: Hitting Time of Rapid Intensification Onset in Hurricane-like Vortices

Wai-Tong Louis Fan, Chanh Kieu, Dimitrios Sakellariou, Mahashweta Patra

Comments: 33 pages, 9 figures

Journal-ref: Physics of Fluids, Volume 33, Issue 9 (2021)

Subjects: Probability (math.PR); Dynamical Systems (math.DS); Applications (stat.AP)

[799] arXiv:2106.04770 (cross-list from cs.LG) [pdf, other]

Title: Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space

Sho Sonoda, Isao Ishikawa, Masahiro Ikeda

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[800] arXiv:2106.04795 (cross-list from cs.LG) [pdf, other]

Title: Nonasymptotic theory for two-layer neural networks: Beyond the bias-variance trade-off

Huiyuan Wang, Wei Lin

Comments: 47 pages, 1 figure

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)