Statistics

Authors and titles for October 2021

[651] arXiv:2110.02333 (cross-list from cs.LG) [pdf, other]

Title: On the Impact of Stable Ranks in Deep Nets

Bogdan Georgiev, Lukas Franken, Mayukh Mukherjee, Georgios Arvanitidis

Comments: 24 pages, 8 figures, comments welcome!

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Statistics Theory (math.ST)

[652] arXiv:2110.02363 (cross-list from math.PR) [pdf, other]

Title: Bernoulli Sums: The only random variables that count

Pavel Shuldiner, R.W. Oldford

Comments: 27 pages

Subjects: Probability (math.PR); Other Statistics (stat.OT)

[653] arXiv:2110.02473 (cross-list from cs.LG) [pdf, other]

Title: The Power of Contrast for Feature Learning: A Theoretical Analysis

Wenlong Ji, Zhun Deng, Ryumei Nakada, James Zou, Linjun Zhang

Comments: 78 pages, accepted by JMLR

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[654] arXiv:2110.02490 (cross-list from cs.LG) [pdf, other]

Title: The Variability of Model Specification

Joseph R. Barr, Peter Shaw, Marcus Sobel

Comments: 8 pages, 1 figure

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Applications (stat.AP)

[655] arXiv:2110.02491 (cross-list from cs.LG) [pdf, other]

Title: Data-Centric AI Requires Rethinking Data Notion

Mustafa Hajij, Ghada Zamzmi, Karthikeyan Natesan Ramamurthy, Aldo Guzman Saenz

Journal-ref: Conference: 35th Conference on Neural Information Processing Systems (NeurIPS 2021) At: NEURIPS DATA-CENTRIC AI WORKSHOP

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Category Theory (math.CT); Machine Learning (stat.ML)

[656] arXiv:2110.02554 (cross-list from cs.LG) [pdf, other]

Title: A Regularized Wasserstein Framework for Graph Kernels

Asiri Wijesinghe, Qing Wang, Stephen Gould

Comments: 21st IEEE International Conference on Data Mining (ICDM 2021)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[657] arXiv:2110.02573 (cross-list from cs.LG) [pdf, other]

Title: T-SNE Is Not Optimized to Reveal Clusters in Data

Zhirong Yang, Yuwei Chen, Jukka Corander

Comments: arXiv admin note: text overlap with arXiv:2108.08003

Subjects: Machine Learning (cs.LG); Human-Computer Interaction (cs.HC); Machine Learning (stat.ML)

[658] arXiv:2110.02631 (cross-list from cs.CR) [pdf, other]

Title: Inference Attacks Against Graph Neural Networks

Zhikun Zhang, Min Chen, Michael Backes, Yun Shen, Yang Zhang

Comments: 19 pages, 18 figures. To Appear in the 31st USENIX Security Symposium

Subjects: Cryptography and Security (cs.CR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[659] arXiv:2110.02667 (cross-list from cs.LG) [pdf, other]

Title: Attentive Walk-Aggregating Graph Neural Networks

Mehmet F. Demirel, Shengchao Liu, Siddhant Garg, Zhenmei Shi, Yingyu Liang

Comments: Published in TMLR (Transactions on Machine Learning Research) (08/2022) 32 pages

Subjects: Machine Learning (cs.LG); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[660] arXiv:2110.02722 (cross-list from cs.LG) [pdf, other]

Title: Graphon based Clustering and Testing of Networks: Algorithms and Theory

Mahalakshmi Sabanayagam, Leena Chennuru Vankadara, Debarghya Ghoshdastidar

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[661] arXiv:2110.02732 (cross-list from cs.LG) [pdf, other]

Title: On Margin Maximization in Linear and ReLU Networks

Gal Vardi, Ohad Shamir, Nathan Srebro

Comments: This version includes some minor updates

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[662] arXiv:2110.02735 (cross-list from math.OC) [pdf, other]

Title: Optimal pricing for electricity retailers based on data-driven consumers' price-response

Román Pérez-Santalla, Miguel Carrión, Carlos Ruiz

Subjects: Optimization and Control (math.OC); General Economics (econ.GN); Applications (stat.AP)

[663] arXiv:2110.02742 (cross-list from quant-ph) [pdf, other]

Title: A Quantum Generative Adversarial Network for distributions

Amine Assouel, Antoine Jacquier, Alexei Kondratyev

Comments: 19 pages, 17 Figures, 2 table

Subjects: Quantum Physics (quant-ph); Probability (math.PR); Computational Finance (q-fin.CP); Machine Learning (stat.ML)

[664] arXiv:2110.02750 (cross-list from cs.DS) [pdf, other]

Title: Extensions of Karger's Algorithm: Why They Fail in Theory and How They Are Useful in Practice

Erik Jenner, Enrique Fita Sanmartín, Fred A. Hamprecht

Comments: Oral at ICCV 2021; added acknowledgements

Subjects: Data Structures and Algorithms (cs.DS); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[665] arXiv:2110.02752 (cross-list from math.OC) [pdf, other]

Title: Robust Localization with Bounded Noise: Creating a Superset of the Possible Target Positions via Linear-Fractional Representations

João Domingos, Cláudia Soares, João Xavier

Comments: 15 pages, 7 figures. Originally submitted in -IEEE Transactions on Signal Processing- on 01-Oct-2021. Accepted in -IEEE Transactions on Signal Processing- on 06-Jun-2022

Subjects: Optimization and Control (math.OC); Signal Processing (eess.SP); Statistics Theory (math.ST)

[666] arXiv:2110.02768 (cross-list from cs.HC) [pdf, other]

Title: Posture Recognition in the Critical Care Settings using Wearable Devices

Anis Davoudi, Patrick J. Tighe, Azra Bihorac, Parisa Rashidi

Comments: 8 pages

Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Signal Processing (eess.SP); Applications (stat.AP)

[667] arXiv:2110.02796 (cross-list from cs.LG) [pdf, other]

Title: An Unconstrained Layer-Peeled Perspective on Neural Collapse

Wenlong Ji, Yiping Lu, Yiliang Zhang, Zhun Deng, Weijie J. Su

Comments: Published as a conference paper at ICLR 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[668] arXiv:2110.02868 (cross-list from cs.IT) [pdf, other]

Title: Coded Shotgun Sequencing

Aditya Narayan Ravi, Alireza Vahid, Ilan Shomorony

Comments: 35 pages, 4 figures, 8 appendices

Subjects: Information Theory (cs.IT); Applications (stat.AP)

[669] arXiv:2110.02905 (cross-list from cs.LG) [pdf, other]

Title: Geometric and Physical Quantities Improve E(3) Equivariant Message Passing

Johannes Brandstetter, Rob Hesselink, Elise van der Pol, Erik J Bekkers, Max Welling

Comments: Published at ICLR 2022 (Spotlight paper), Github: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[670] arXiv:2110.02910 (cross-list from cs.LG) [pdf, other]

Title: Equivariant Subgraph Aggregation Networks

Beatrice Bevilacqua, Fabrizio Frasca, Derek Lim, Balasubramaniam Srinivasan, Chen Cai, Gopinath Balamurugan, Michael M. Bronstein, Haggai Maron

Comments: Published at ICLR 2022, Spotlight. 46 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[671] arXiv:2110.02915 (cross-list from cs.LG) [pdf, other]

Title: Unrolling Particles: Unsupervised Learning of Sampling Distributions

Fernando Gama, Nicolas Zilberstein, Richard G. Baraniuk, Santiago Segarra

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Computation (stat.CO)

[672] arXiv:2110.02919 (cross-list from cs.LG) [pdf, other]

Title: Residual Overfit Method of Exploration

James McInerney, Nathan Kallus

Comments: 13 pages, 16 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[673] arXiv:2110.02926 (cross-list from cs.LG) [pdf, other]

Title: On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime

Zhiyan Ding, Shi Chen, Qin Li, Stephen Wright

Comments: arXiv admin note: text overlap with arXiv:2105.14417

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[674] arXiv:2110.02954 (cross-list from math.OC) [pdf, other]

Title: A Stochastic Newton Algorithm for Distributed Convex Optimization

Brian Bullins, Kumar Kshitij Patel, Ohad Shamir, Nathan Srebro, Blake Woodworth

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[675] arXiv:2110.03020 (cross-list from cs.LG) [pdf, other]

Title: Efficient Methods for Online Multiclass Logistic Regression

Naman Agarwal, Satyen Kale, Julian Zimmert

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[676] arXiv:2110.03022 (cross-list from cs.LG) [pdf, other]

Title: Tribuo: Machine Learning with Provenance in Java

Adam Pocock

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[677] arXiv:2110.03031 (cross-list from cs.LG) [pdf, other]

Title: RieszNet and ForestRiesz: Automatic Debiased Machine Learning with Neural Nets and Random Forests

Victor Chernozhukov, Whitney K. Newey, Victor Quintas-Martinez, Vasilis Syrgkanis

Comments: Accepted for a long presentation at the ICML. Code available at this https URL

Subjects: Machine Learning (cs.LG); Econometrics (econ.EM); Machine Learning (stat.ML)

[678] arXiv:2110.03032 (cross-list from cs.LG) [pdf, other]

Title: Learning Multi-Objective Curricula for Robotic Policy Learning

Jikun Kang, Miao Liu, Abhinav Gupta, Chris Pal, Xue Liu, Jie Fu

Comments: CoRL 2022; Reinforcement Learning; Meta-Reinforcement Learning; Hyper-network

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Robotics (cs.RO); Systems and Control (eess.SY); Machine Learning (stat.ML)

[679] arXiv:2110.03051 (cross-list from cs.LG) [pdf, other]

Title: Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimation

Dennis Ulmer, Christian Hardmeier, Jes Frellsen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[680] arXiv:2110.03095 (cross-list from cs.LG) [pdf, other]

Title: Which Shortcut Cues Will DNNs Choose? A Study from the Parameter-Space Perspective

Luca Scimeca, Seong Joon Oh, Sanghyuk Chun, Michael Poli, Sangdoo Yun

Comments: To be published in "The International Conference on Learning Representations" (ICLR 2022)(Accepted) First two authors have contributed equally

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[681] arXiv:2110.03097 (cross-list from cs.LG) [pdf, other]

Title: SWAT Watershed Model Calibration using Deep Learning

M. K. Mudunuru, K. Son, P. Jiang, X. Chen

Comments: 23

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Applied Physics (physics.app-ph); Methodology (stat.ME)

[682] arXiv:2110.03135 (cross-list from cs.LG) [pdf, other]

Title: Label Noise in Adversarial Training: A Novel Perspective to Study Robust Overfitting

Chengyu Dong, Liyuan Liu, Jingbo Shang

Comments: Neurips 2022 (Oral); A previous version of this paper (v1) used the title `Double Descent in Adversarial Training: An Implicit Label Noise Perspective`

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[683] arXiv:2110.03140 (cross-list from physics.soc-ph) [pdf, other]

Title: Physics-inspired analysis of the two-class income distribution in the USA in 1983-2018

Danial Ludwig, Victor M. Yakovenko

Comments: 18 pages, 8 figures, submitted to Philosophical Transactions of the Royal Society A for the special issue "Kinetic exchange models of societies and economies"

Journal-ref: Philosophical Transactions of the Royal Society A 380, 20210162 (2022)

Subjects: Physics and Society (physics.soc-ph); General Economics (econ.GN); Applications (stat.AP)

[684] arXiv:2110.03146 (cross-list from math.OC) [pdf, other]

Title: Solving Multistage Stochastic Linear Programming via Regularized Linear Decision Rules: An Application to Hydrothermal Dispatch Planning

Felipe Nazare, Alexandre Street

Comments: European Journal of Operational Research, 2022. See the published version at (EJOR) through the DOI link this https URL

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Econometrics (econ.EM); Systems and Control (eess.SY); Machine Learning (stat.ML)

[685] arXiv:2110.03165 (cross-list from cs.LG) [pdf, other]

Title: Offline RL With Resource Constrained Online Deployment

Jayanth Reddy Regatti, Aniket Anand Deshmukh, Frank Cheng, Young Hun Jung, Abhishek Gupta, Urun Dogan

Comments: Added experiments on discrete control and real world datasets along with more analyses on continuous control tasks

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Systems and Control (eess.SY); Machine Learning (stat.ML)

[686] arXiv:2110.03177 (cross-list from cs.LG) [pdf, other]

Title: EE-Net: Exploitation-Exploration Neural Networks in Contextual Bandits

Yikun Ban, Yuchen Yan, Arindam Banerjee, Jingrui He

Comments: Published on ICLR 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[687] arXiv:2110.03187 (cross-list from cs.LG) [pdf, other]

Title: On the Optimal Memorization Power of ReLU Neural Networks

Gal Vardi, Gilad Yehudai, Ohad Shamir

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[688] arXiv:2110.03224 (cross-list from cs.LG) [pdf, other]

Title: Darts: User-Friendly Modern Machine Learning for Time Series

Julien Herzen, Francesco Lässig, Samuele Giuliano Piazzetta, Thomas Neuer, Léo Tafti, Guillaume Raille, Tomas Van Pottelbergh, Marek Pasieka, Andrzej Skrodzki, Nicolas Huguenin, Maxime Dumonal, Jan Kościsz, Dennis Bader, Frédérick Gusset, Mounir Benheddi, Camila Williamson, Michal Kosinski, Matej Petrik, Gaël Grosch

Comments: Darts Github repository: this https URL

Journal-ref: Journal of Machine Learning Research 23 (2022) 1-6

Subjects: Machine Learning (cs.LG); Computation (stat.CO)

[689] arXiv:2110.03250 (cross-list from cs.IT) [pdf, other]

Title: Minimum Message Length Autoregressive Moving Average Model Order Selection

Zheng Fang, David L. Dowe, Shelton Peiris, Dedi Rosadi

Subjects: Information Theory (cs.IT); Probability (math.PR); Statistics Theory (math.ST)

[690] arXiv:2110.03273 (cross-list from cs.LG) [pdf, other]

Title: AgFlow: Fast Model Selection of Penalized PCA via Implicit Regularization Effects of Gradient Flow

Haiyan Jiang, Haoyi Xiong, Dongrui Wu, Ji Liu, Dejing Dou

Comments: accepted by Machine Learning

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[691] arXiv:2110.03300 (cross-list from cs.LG) [pdf, other]

Title: Permutation Compressors for Provably Faster Distributed Nonconvex Optimization

Rafał Szlendak, Alexander Tyurin, Peter Richtárik

Comments: 53 pages

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[692] arXiv:2110.03313 (cross-list from cs.LG) [pdf, other]

Title: Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees

Aleksandr Beznosikov, Peter Richtárik, Michael Diskin, Max Ryabinin, Alexander Gasnikov

Comments: Appears in: Advances in Neural Information Processing Systems 35 (NeurIPS 2022). Minor modifications with respect to the NeurIPS version. 73 pages, 9 algorithms, 2 figures, 2 tables

Journal-ref: https://proceedings.neurips.cc/paper_files/paper/2022/hash/5ac1428c23b5da5e66d029646ea3206d-Abstract-Conference.html

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[693] arXiv:2110.03336 (cross-list from cs.LG) [pdf, other]

Title: Frame Averaging for Invariant and Equivariant Network Design

Omri Puny, Matan Atzmon, Heli Ben-Hamu, Ishan Misra, Aditya Grover, Edward J. Smith, Yaron Lipman

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[694] arXiv:2110.03337 (cross-list from cs.CV) [pdf, other]

Title: Moment evolution equations and moment matching for stochastic image EPDiff

Alexander Christgau, Alexis Arnaudon, Stefan Sommer

Comments: To appear in: Journal of Mathematical Imaging and Vision

Subjects: Computer Vision and Pattern Recognition (cs.CV); Statistics Theory (math.ST)

[695] arXiv:2110.03360 (cross-list from cs.LG) [pdf, other]

Title: Sparse MoEs meet Efficient Ensembles

James Urquhart Allingham, Florian Wenzel, Zelda E Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton

Comments: 59 pages, 26 figures, 36 tables. Accepted at TMLR

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[696] arXiv:2110.03372 (cross-list from cs.LG) [pdf, other]

Title: Unifying Likelihood-free Inference with Black-box Optimization and Beyond

Dinghuai Zhang, Jie Fu, Yoshua Bengio, Aaron Courville

Comments: ICLR 2022 spotlight

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Biomolecules (q-bio.BM); Methodology (stat.ME); Machine Learning (stat.ML)

[697] arXiv:2110.03411 (cross-list from econ.EM) [pdf, other]

Title: Investigating Growth at Risk Using a Multi-country Non-parametric Quantile Factor Model

Todd E. Clark, Florian Huber, Gary Koop, Massimiliano Marcellino, Michael Pfarrhofer

Comments: JEL: C11, C32, C53; Keywords: non-parametric regression, regression trees, forecasting

Subjects: Econometrics (econ.EM); Applications (stat.AP)

[698] arXiv:2110.03440 (cross-list from cs.LG) [pdf, other]

Title: Towards Robust and Transferable IIoT Sensor based Anomaly Classification using Artificial Intelligence

Jana Kemnitz, Thomas Bierweiler, Herbert Grieb, Stefan von Dosky, Daniel Schall

Comments: This paper is accepted at this https URL. The final authenticated version is available online and this information will be updated

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Signal Processing (eess.SP); Machine Learning (stat.ML)

[699] arXiv:2110.03443 (cross-list from econ.GN) [pdf, html, other]

Title: Unpacking the Black Box: Regulating Algorithmic Decisions

Laura Blattner, Scott Nelson, Jann Spiess

Subjects: General Economics (econ.GN); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[700] arXiv:2110.03484 (cross-list from cs.LG) [pdf, other]

Title: Creating Training Sets via Weak Indirect Supervision

Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner

Comments: ICLR 2022

Subjects: Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)