Statistics

Authors and titles for October 2021

[751] arXiv:2110.05283 (cross-list from cs.LG) [pdf, other]

Title: Phase Collapse in Neural Networks

Florentin Guth, John Zarka, Stéphane Mallat

Comments: 17 pages, 2 figures

Journal-ref: International Conference on Learning Representations, 2022

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)

[752] arXiv:2110.05291 (cross-list from cs.LG) [pdf, other]

Title: Graph Neural Network Guided Local Search for the Traveling Salesperson Problem

Benjamin Hudson, Qingbiao Li, Matthew Malencia, Amanda Prorok

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[753] arXiv:2110.05356 (cross-list from math.PR) [pdf, other]

Title: Weak Convergence of Non-neutral Genealogies to Kingman's Coalescent

Suzie Brown, Paul A. Jenkins, Adam M. Johansen, Jere Koskela

Comments: 37 pages, 1 figure

Subjects: Probability (math.PR); Populations and Evolution (q-bio.PE); Computation (stat.CO)

[754] arXiv:2110.05365 (cross-list from cs.LG) [pdf, other]

Title: Intriguing Properties of Input-dependent Randomized Smoothing

Peter Súkeník, Aleksei Kuvshinov, Stephan Günnemann

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[755] arXiv:2110.05371 (cross-list from cs.SE) [pdf, other]

Title: Graph-Based Machine Learning Improves Just-in-Time Defect Prediction

Jonathan Bryan, Pablo Moriano

Comments: 22 pages, 2 figures, 4 tables; references added; expanded results to match baseline conditions

Journal-ref: PLoS ONE 18(4): e0284077, 2023

Subjects: Software Engineering (cs.SE); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[756] arXiv:2110.05430 (cross-list from cs.LG) [pdf, other]

Title: Density-based interpretable hypercube region partitioning for mixed numeric and categorical data

Samuel Ackerman, Eitan Farchi, Orna Raz, Marcel Zalmanovici, Maya Zohar

Subjects: Machine Learning (cs.LG); Applications (stat.AP)

[757] arXiv:2110.05442 (cross-list from cs.LG) [pdf, other]

Title: Neural Algorithmic Reasoners are Implicit Planners

Andreea Deac, Petar Veličković, Ognjen Milinković, Pierre-Luc Bacon, Jian Tang, Mladen Nikolić

Comments: To appear at NeurIPS 2021 (Spotlight talk). 20 pages, 10 figures. arXiv admin note: text overlap with arXiv:2010.13146

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[758] arXiv:2110.05481 (cross-list from cs.LG) [pdf, other]

Title: Which Samples Should be Learned First: Easy or Hard?

Xiaoling Zhou, Ou Wu

Comments: 14 pages,10 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[759] arXiv:2110.05517 (cross-list from quant-ph) [pdf, other]

Title: Learnability of the output distributions of local quantum circuits

Marcel Hinsche, Marios Ioannou, Alexander Nietner, Jonas Haferkamp, Yihui Quek, Dominik Hangleiter, Jean-Pierre Seifert, Jens Eisert, Ryan Sweke

Comments: 24+11 pages, 5 figures, comments welcome

Subjects: Quantum Physics (quant-ph); Computational Complexity (cs.CC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[760] arXiv:2110.05518 (cross-list from cs.LG) [pdf, other]

Title: Global Optimality Beyond Two Layers: Training Deep ReLU Networks via Convex Programs

Tolga Ergen, Mert Pilanci

Comments: Accepted to ICML 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computational Complexity (cs.CC); Machine Learning (stat.ML)

[761] arXiv:2110.05528 (cross-list from eess.SP) [pdf, other]

Title: Smoothed Separable Nonnegative Matrix Factorization

Nicolas Nadisic, Nicolas Gillis, Christophe Kervazo

Comments: 31 pages + 10 pages of supplementary. Many clarifications have been brought to the paper, and we have added numerical experiments on facial images

Journal-ref: Linear Algebra and Its Applications 676, pp. 174-204, 2023

Subjects: Signal Processing (eess.SP); Machine Learning (cs.LG); Image and Video Processing (eess.IV); Machine Learning (stat.ML)

[762] arXiv:2110.05574 (cross-list from q-bio.QM) [pdf, other]

Title: Genetic Regulation of Cytokine Response in Patients with Acute Community-acquired Pneumonia

Andreas Kühnapfel, Katrin Horn, Ulrike Klotz, Michael Kiehntopf, Maciej Rosolowski, Markus Loeffler, Peter Ahnert, Norbert Suttorp, Martin Witzenrath, Markus Scholz

Subjects: Quantitative Methods (q-bio.QM); Applications (stat.AP)

[763] arXiv:2110.05645 (cross-list from cs.LG) [pdf, other]

Title: A global convergence theory for deep ReLU implicit networks via over-parameterization

Tianxiang Gao, Hailiang Liu, Jia Liu, Hridesh Rajan, Hongyang Gao

Comments: Accepted by ICLR 2022

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[764] arXiv:2110.05651 (cross-list from cs.LG) [pdf, other]

Title: Learning with Algorithmic Supervision via Continuous Relaxations

Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen

Comments: Published at NeurIPS 2021, Code @ this https URL, Video @ this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[765] arXiv:2110.05794 (cross-list from cs.LG) [pdf, other]

Title: Information Theoretic Structured Generative Modeling

Bo Hu, Shujian Yu, Jose C. Principe

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[766] arXiv:2110.05960 (cross-list from cs.LG) [pdf, other]

Title: Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations

Jiayao Zhang, Hua Wang, Weijie J. Su

Comments: Accepted to NeurIPS 2021

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[767] arXiv:2110.06017 (cross-list from physics.geo-ph) [pdf, other]

Title: Emerging Directions in Geophysical Inversion

Andrew Valentine, Malcolm Sambridge

Comments: 32 pages, 2 figures. Original manuscript submitted for review as a chapter of "Data Assimilation and Inverse Problems in Geophysical Sciences", eds. Alik Ismail-Zadeh, Fabio Castelli, Dylan Jones and Sabrina Sanchez

Subjects: Geophysics (physics.geo-ph); Optimization and Control (math.OC); Applications (stat.AP)

[768] arXiv:2110.06020 (cross-list from cs.LG) [pdf, other]

Title: On out-of-distribution detection with Bayesian neural networks

Francesco D'Angelo, Christian Henning

Comments: This work is an extension of our previous workshop contribution: arXiv:2107.12248

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[769] arXiv:2110.06057 (cross-list from cs.LG) [pdf, other]

Title: Gated Information Bottleneck for Generalization in Sequential Environments

Francesco Alesiani, Shujian Yu, Xi Yu

Comments: manuscript accepted by IEEE ICDM-21 (regular papers), code is available at this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[770] arXiv:2110.06116 (cross-list from cs.IR) [pdf, other]

Title: Two-level monotonic multistage recommender systems

Ben Dai, Xiaotong Shen, Wei Pan

Journal-ref: 2021

Subjects: Information Retrieval (cs.IR); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[771] arXiv:2110.06193 (cross-list from q-bio.PE) [pdf, other]

Title: EpiBeds: Data informed modelling of the COVID-19 hospital burden in England

Christopher E. Overton, Lorenzo Pellis, Helena B. Stage, Francesca Scarabel, Joshua Burton, Christophe Fraser, Ian Hall, Thomas A. House, Chris Jewell, Anel Nurtay, Filippo Pagani, Katrina A. Lythgoe

Subjects: Populations and Evolution (q-bio.PE); Applications (stat.AP)

[772] arXiv:2110.06198 (cross-list from cs.LG) [pdf, other]

Title: Last Iterate Risk Bounds of SGD with Decaying Stepsize for Overparameterized Linear Regression

Jingfeng Wu, Difan Zou, Vladimir Braverman, Quanquan Gu, Sham M. Kakade

Comments: 35 pages, 2 figures, 1 table. In ICML 2022

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[773] arXiv:2110.06256 (cross-list from cs.LG) [pdf, other]

Title: Neural Network Weights Do Not Converge to Stationary Points: An Invariant Measure Perspective

Jingzhao Zhang, Haochuan Li, Suvrit Sra, Ali Jadbabaie

Journal-ref: ICML 2022

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[774] arXiv:2110.06257 (cross-list from cs.LG) [pdf, html, other]

Title: Causal Discovery from Conditionally Stationary Time Series

Carles Balsells-Rodas, Xavier Sumba, Tanmayee Narendra, Ruibo Tu, Gabriele Schweikert, Hedvig Kjellstrom, Yingzhen Li

Comments: ICML 2025

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[775] arXiv:2110.06282 (cross-list from cs.LG) [pdf, other]

Title: The Rich Get Richer: Disparate Impact of Semi-Supervised Learning

Zhaowei Zhu, Tianyi Luo, Yang Liu

Comments: Published as a conference paper at ICLR 2022. Revised constants Theorems 1,2, and Lemma 3 (consider the union bound). Add acknowledgments to Nautilus

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[776] arXiv:2110.06287 (cross-list from cs.LG) [pdf, other]

Title: Real-Time Learning from An Expert in Deep Recommendation Systems with Marginal Distance Probability Distribution

Arash Mahyari, Peter Pirolli, Jacqueline A. LeBlanc

Journal-ref: IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (stat.ML)

[777] arXiv:2110.06308 (cross-list from math.OC) [pdf, html, other]

Title: Regularized Step Directions in Nonlinear Conjugate Gradient Methods

Cassidy K. Buhler, Hande Y. Benson, David F. Shanno

Comments: 27 pages, 3 figures. Accepted to Math Programming Computation

Subjects: Optimization and Control (math.OC); Computation (stat.CO)

[778] arXiv:2110.06332 (cross-list from eess.SY) [pdf, other]

Title: Distributed Kalman Filters for Relative Formation Control of Mobile Agents

Martijn van der Marel, Raj Thilak Rajan

Comments: In submission

Subjects: Systems and Control (eess.SY); Signal Processing (eess.SP); Applications (stat.AP)

[779] arXiv:2110.06394 (cross-list from cs.LG) [pdf, other]

Title: Reward-Free Model-Based Reinforcement Learning with Linear Function Approximation

Weitong Zhang, Dongruo Zhou, Quanquan Gu

Comments: 29 pages, 1 figure, 1 table. In NeurIPS 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)

[780] arXiv:2110.06395 (cross-list from cs.LG) [pdf, other]

Title: Robust Neural Regression via Uncertainty Learning

Akib Mashrur, Wei Luo, Nayyar A. Zaidi, Antonio Robles-Kelly

Journal-ref: International Joint Conference on Neural Networks (IJCNN), 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[781] arXiv:2110.06418 (cross-list from eess.SY) [pdf, other]

Title: Stabilizing Dynamical Systems via Policy Gradient Methods

Juan C. Perdomo, Jack Umenberger, Max Simchowitz

Comments: accepted for publication at Neurips 2021

Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Machine Learning (stat.ML)

[782] arXiv:2110.06420 (cross-list from math.NA) [pdf, other]

Title: Where are the logs?

Art B. Owen, Zexin Pan

Subjects: Numerical Analysis (math.NA); Computation (stat.CO)

[783] arXiv:2110.06480 (cross-list from physics.data-an) [pdf, other]

Title: Fourier-domain transfer entropy spectrum

Yang Tian, Yaoyuan Wang, Ziyang Zhang, Pei Sun

Subjects: Data Analysis, Statistics and Probability (physics.data-an); Biological Physics (physics.bio-ph); Computational Physics (physics.comp-ph); Computation (stat.CO)

[784] arXiv:2110.06500 (cross-list from cs.LG) [pdf, other]

Title: Differentially Private Fine-tuning of Language Models

Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin A. Inan, Gautam Kamath, Janardhan Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang

Comments: ICLR 2022. Code available at this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[785] arXiv:2110.06562 (cross-list from cs.CV) [pdf, other]

Title: Unsupervised Object Learning via Common Fate

Matthias Tangemann, Steffen Schneider, Julius von Kügelgen, Francesco Locatello, Peter Gehler, Thomas Brox, Matthias Kümmerer, Matthias Bethge, Bernhard Schölkopf

Comments: Published at CLeaR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[786] arXiv:2110.06623 (cross-list from cs.SI) [pdf, other]

Title: SSSNET: Semi-Supervised Signed Network Clustering

Yixuan He, Gesine Reinert, Songchao Wang, Mihai Cucuringu

Comments: 14 pages

Subjects: Social and Information Networks (cs.SI); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[787] arXiv:2110.06639 (cross-list from cs.LG) [pdf, other]

Title: When saliency goes off on a tangent: Interpreting Deep Neural Networks with nonlinear saliency maps

Jan Rosenzweig, Zoran Cvetkovic, Ivana Rosenzweig

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[788] arXiv:2110.06741 (cross-list from cs.LG) [pdf, other]

Title: Dynamical Wasserstein Barycenters for Time-series Modeling

Kevin C. Cheng, Shuchin Aeron, Michael C. Hughes, Eric L. Miller

Comments: To appear at Neurips 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[789] arXiv:2110.06763 (cross-list from econ.EM) [pdf, other]

Title: Efficient Estimation in NPIV Models: A Comparison of Various Neural Networks-Based Estimators

Jiafeng Chen, Xiaohong Chen, Elie Tamer

Subjects: Econometrics (econ.EM); Machine Learning (cs.LG); Statistics Theory (math.ST)

[790] arXiv:2110.06806 (cross-list from cs.SE) [pdf, other]

Title: Simulation Based Probabilistic Risk Assessment (SIMPRA): Risk Based Design

Hamed S Nejad, Tarannom Parhizkar, Ali Mosleh

Subjects: Software Engineering (cs.SE); Methodology (stat.ME)

[791] arXiv:2110.06850 (cross-list from cs.LG) [pdf, other]

Title: Boosting the Certified Robustness of L-infinity Distance Nets

Bohang Zhang, Du Jiang, Di He, Liwei Wang

Comments: Accepted for ICLR 2022; 21 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[792] arXiv:2110.06871 (cross-list from cs.LG) [pdf, other]

Title: Two-argument activation functions learn soft XOR operations like cortical neurons

Kijung Yoon, Emin Orhan, Juhyun Kim, Xaq Pitkow

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neurons and Cognition (q-bio.NC); Machine Learning (stat.ML)

[793] arXiv:2110.06897 (cross-list from math.NA) [pdf, other]

Title: Machine Learning For Elliptic PDEs: Fast Rate Generalization Bound, Neural Scaling Law and Minimax Optimality

Yiping Lu, Haoxuan Chen, Jianfeng Lu, Lexing Ying, Jose Blanchet

Comments: add a proof Proof Sketch in section 4.1

Subjects: Numerical Analysis (math.NA); Machine Learning (cs.LG); Statistics Theory (math.ST); Computational Physics (physics.comp-ph); Machine Learning (stat.ML)

[794] arXiv:2110.06906 (cross-list from cs.LG) [pdf, other]

Title: PER-ETD: A Polynomially Efficient Emphatic Temporal Difference Learning Method

Ziwei Guan, Tengyu Xu, Yingbin Liang

Comments: Published as a conference paper at ICLR 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[795] arXiv:2110.06914 (cross-list from cs.LG) [pdf, other]

Title: What Happens after SGD Reaches Zero Loss? --A Mathematical Framework

Zhiyuan Li, Tianhao Wang, Sanjeev Arora

Comments: 56 pages, 2 figures; ICLR 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[796] arXiv:2110.06980 (cross-list from cs.LG) [pdf, other]

Title: Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization

Syrine Belakaria, Aryan Deshwal, Janardhan Rao Doppa

Comments: Accepted to Journal of Artificial Intelligence Research. arXiv admin note: substantial text overlap with arXiv:2009.05700, arXiv:2009.01721, arXiv:2011.01542

Journal-ref: Journal of Artificial Intelligence Research 72 (2021):667-715

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[797] arXiv:2110.07004 (cross-list from cs.LG) [pdf, other]

Title: On the Convergence Theory for Hessian-Free Bilevel Algorithms

Daouda Sow, Kaiyi Ji, Yingbin Liang

Comments: Submitted for publication

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[798] arXiv:2110.07032 (cross-list from math.PR) [pdf, other]

Title: A Short Review of Ergodicity and Convergence of Markov chain Monte Carlo Estimators

Michael Betancourt

Comments: 19 pages, 10 figures

Subjects: Probability (math.PR); Statistics Theory (math.ST); Methodology (stat.ME)

[799] arXiv:2110.07064 (cross-list from cs.LG) [pdf, other]

Title: Variance Minimization in the Wasserstein Space for Invariant Causal Prediction

Guillaume Martinet, Alexander Strzalkowski, Barbara E. Engelhardt

Subjects: Machine Learning (cs.LG); Methodology (stat.ME)

[800] arXiv:2110.07232 (cross-list from cs.LG) [pdf, other]

Title: Procrastinated Tree Search: Black-box Optimization with Delayed, Noisy, and Multi-Fidelity Feedback

Junxiong Wang, Debabrota Basu, Immanuel Trummer

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)