Statistics

Authors and titles for June 2022

[601] arXiv:2206.00314 (cross-list from cs.LG) [pdf, other]

Title: Contextual Bandits with Knapsacks for a Conversion Model

Zhen Li, Gilles Stoltz (LMO, CELESTE, HEC Paris)

Comments: Thirty-sixth Conference on Neural Information Processing Systems, 2022, New Orleans, United States

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[602] arXiv:2206.00323 (cross-list from math.PR) [pdf, other]

Title: Order estimate of functionals related to fractional Brownian motion and asymptotic expansion of the quadratic variation of fractional stochastic differential equation

Hayate Yamagishi, Nakahiro Yoshida

Comments: 78 pages

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[603] arXiv:2206.00363 (cross-list from cs.LG) [pdf, other]

Title: Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax Optimization

Liang Zhang, Kiran Koshy Thekumparampil, Sewoong Oh, Niao He

Comments: NeurIPS 2022

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Optimization and Control (math.OC); Machine Learning (stat.ML)

[604] arXiv:2206.00364 (cross-list from cs.CV) [pdf, other]

Title: Elucidating the Design Space of Diffusion-Based Generative Models

Tero Karras, Miika Aittala, Timo Aila, Samuli Laine

Comments: NeurIPS 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[605] arXiv:2206.00381 (cross-list from physics.soc-ph) [pdf, other]

Title: The statistical nature of h-index of a network node

Yan Liu, Mudi Jiang, Lianyu Hu, Zengyou He

Subjects: Physics and Society (physics.soc-ph); Social and Information Networks (cs.SI); Applications (stat.AP)

[606] arXiv:2206.00388 (cross-list from cs.LG) [pdf, other]

Title: Transfer without Forgetting

Matteo Boschini, Lorenzo Bonicelli, Angelo Porrello, Giovanni Bellitto, Matteo Pennisi, Simone Palazzo, Concetto Spampinato, Simone Calderara

Comments: 22 pages, 3 Figures. Accepted at 17th European Conference on Computer Vision (ECCV 2022), Tel Aviv, Israel

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[607] arXiv:2206.00397 (cross-list from econ.GN) [pdf, other]

Title: Predicting Political Ideology from Digital Footprints

Michael Kitchener, Nandini Anantharama, Simon D. Angus, Paul A. Raschky

Subjects: General Economics (econ.GN); Machine Learning (cs.LG); Machine Learning (stat.ML)

[608] arXiv:2206.00398 (cross-list from quant-ph) [pdf, other]

Title: On Quantum Circuits for Discrete Graphical Models

Nico Piatkowski, Christa Zoufal

Subjects: Quantum Physics (quant-ph); Machine Learning (stat.ML)

[609] arXiv:2206.00436 (cross-list from q-bio.NC) [pdf, other]

Title: Top-down inference in an early visual cortex inspired hierarchical Variational Autoencoder

Ferenc Csikor (1), Balázs Meszéna (1), Bence Szabó (1), Gergő Orbán (1) ((1) Department of Computational Sciences, Wigner Research Centre for Physics, Budapest, Hungary)

Comments: 15 pages, 5 figures

Subjects: Neurons and Cognition (q-bio.NC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[610] arXiv:2206.00439 (cross-list from cs.LG) [pdf, other]

Title: Algorithmic Foundations of Empirical X-risk Minimization

Tianbao Yang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)

[611] arXiv:2206.00463 (cross-list from quant-ph) [pdf, other]

Title: Fisher information of correlated stochastic processes

Marco Radaelli, Gabriel T. Landi, Kavan Modi, Felix C. Binder

Comments: 16 pages, 6 figures; final version

Journal-ref: New J. Phys. 25 053037 (2023)

Subjects: Quantum Physics (quant-ph); Statistical Mechanics (cond-mat.stat-mech); Statistics Theory (math.ST)

[612] arXiv:2206.00466 (cross-list from cs.LG) [pdf, other]

Title: An $α$-No-Regret Algorithm For Graphical Bilinear Bandits

Geovani Rizk, Igor Colin, Albert Thomas, Rida Laraki, Yann Chevaleyre

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[613] arXiv:2206.00501 (cross-list from cs.LG) [pdf, other]

Title: Benign Overfitting in Classification: Provably Counter Label Noise with Larger Models

Kaiyue Wen, Jiaye Teng, Jingzhao Zhang

Comments: Published as a conference paper at ICLR 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[614] arXiv:2206.00516 (cross-list from cs.LG) [pdf, other]

Title: Feature Selection for Discovering Distributional Treatment Effect Modifiers

Yoichi Chikahara, Makoto Yamada, Hisashi Kashima

Comments: 18 pages, Accepted to UAI2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[615] arXiv:2206.00606 (cross-list from cs.LG) [pdf, other]

Title: Topological Deep Learning: Going Beyond Graph Data

Mustafa Hajij, Ghada Zamzmi, Theodore Papamarkou, Nina Miolane, Aldo Guzmán-Sáenz, Karthikeyan Natesan Ramamurthy, Tolga Birdal, Tamal K. Dey, Soham Mukherjee, Shreyas N. Samaga, Neal Livesay, Robin Walters, Paul Rosen, Michael T. Schaub

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Social and Information Networks (cs.SI); Algebraic Topology (math.AT); Machine Learning (stat.ML)

[616] arXiv:2206.00632 (cross-list from math.OC) [pdf, other]

Title: Computing the Variance of Shuffling Stochastic Gradient Algorithms via Power Spectral Density Analysis

Carles Domingo-Enrich

Comments: The code can be found at \url{this https URL}

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[617] arXiv:2206.00646 (cross-list from math.PR) [pdf, other]

Title: Importance sampling for stochastic reaction-diffusion equations in the moderate deviation regime

Ioannis Gasteratos, Michael Salins, Konstantinos Spiliopoulos

Comments: Version to appear in Stochastics and Partial Differential Equations: Analysis and Computations. 46 pages

Subjects: Probability (math.PR); Optimization and Control (math.OC); Methodology (stat.ME)

[618] arXiv:2206.00730 (cross-list from cs.LG) [pdf, other]

Title: The Phenomenon of Policy Churn

Tom Schaul, André Barreto, John Quan, Georg Ostrovski

Comments: Published at NeurIPS 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[619] arXiv:2206.00743 (cross-list from math.OC) [pdf, other]

Title: Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization

Junchi Yang, Xiang Li, Niao He

Comments: v2: fixed typos and improved Theorem 3.4

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[620] arXiv:2206.00744 (cross-list from cs.LG) [pdf, other]

Title: A Log-Linear Time Sequential Optimal Calibration Algorithm for Quantized Isotonic L2 Regression

Kaan Gokcesu, Hakan Gokcesu

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[621] arXiv:2206.00761 (cross-list from cs.LG) [pdf, other]

Title: On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting

Tomasz Korbak, Hady Elsahar, Germán Kruszewski, Marc Dymetman

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[622] arXiv:2206.00769 (cross-list from cs.LG) [pdf, other]

Title: Defense Against Gradient Leakage Attacks via Learning to Obscure Data

Yuxuan Wan, Han Xu, Xiaorui Liu, Jie Ren, Wenqi Fan, Jiliang Tang

Comments: 13 pages, 2 figures

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[623] arXiv:2206.00810 (cross-list from cs.LG) [pdf, other]

Title: Offline Reinforcement Learning with Differential Privacy

Dan Qiao, Yu-Xiang Wang

Comments: 55 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[624] arXiv:2206.00833 (cross-list from cs.LG) [pdf, other]

Title: Finite-Time Analysis of Entropy-Regularized Neural Natural Actor-Critic Algorithm

Semih Cayci, Niao He, R. Srikant

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[625] arXiv:2206.00846 (cross-list from cs.LG) [pdf, other]

Title: Faster Rates of Convergence to Stationary Points in Differentially Private Optimization

Raman Arora, Raef Bassily, Tomás González, Cristóbal Guzmán, Michael Menart, Enayat Ullah

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Optimization and Control (math.OC); Machine Learning (stat.ML)

[626] arXiv:2206.00927 (cross-list from cs.LG) [pdf, other]

Title: DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps

Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, Jun Zhu

Comments: Accepted in Neurips 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[627] arXiv:2206.00934 (cross-list from math.NA) [pdf, other]

Title: Deep neural networks can stably solve high-dimensional, noisy, non-linear inverse problems

Andrés Felipe Lerma Pineda, Philipp Christian Petersen

Subjects: Numerical Analysis (math.NA); Analysis of PDEs (math.AP); Machine Learning (stat.ML)

[628] arXiv:2206.00941 (cross-list from cs.LG) [pdf, html, other]

Title: Improving Diffusion Models for Inverse Problems using Manifold Constraints

Hyungjin Chung, Byeongsu Sim, Dohoon Ryu, Jong Chul Ye

Comments: NeurIPS 2022 camera-ready; 29 pages, 16 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[629] arXiv:2206.00944 (cross-list from cs.LG) [pdf, other]

Title: Feature Space Particle Inference for Neural Network Ensembles

Shingo Yashima, Teppei Suzuki, Kohta Ishikawa, Ikuro Sato, Rei Kawakami

Comments: ICML2022

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[630] arXiv:2206.00973 (cross-list from math.OC) [pdf, html, other]

Title: Primal-dual extrapolation methods for monotone inclusions under local Lipschitz continuity

Zhaosong Lu, Sanyou Mei

Comments: To appear in Mathematics of Operations Research

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[631] arXiv:2206.01008 (cross-list from cs.LG) [pdf, other]

Title: Approximate Network Motif Mining Via Graph Learning

Carlos Oliver, Dexiong Chen, Vincent Mallet, Pericles Philippopoulos, Karsten Borgwardt

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[632] arXiv:2206.01022 (cross-list from cs.LG) [pdf, other]

Title: Learning Disentangled Representations for Counterfactual Regression via Mutual Information Minimization

Mingyuan Cheng, Xinru Liao, Quan Liu, Bin Ma, Jian Xu, Bo Zheng

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[633] arXiv:2206.01029 (cross-list from math.OC) [pdf, other]

Title: Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions

Kiwon Lee, Andrew N. Cheng, Courtney Paquette, Elliot Paquette

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Probability (math.PR); Machine Learning (stat.ML)

[634] arXiv:2206.01081 (cross-list from cs.LG) [pdf, other]

Title: Revisiting the General Identifiability Problem

Yaroslav Kivva, Ehsan Mokhtarian, Jalal Etesami, Negar Kiyavash

Comments: 22 pages, 4 figures, 2 Algorithms, UAI 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[635] arXiv:2206.01101 (cross-list from cs.LG) [pdf, other]

Title: Weakly Supervised Representation Learning with Sparse Perturbations

Kartik Ahuja, Jason Hartford, Yoshua Bengio

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[636] arXiv:2206.01162 (cross-list from cs.LG) [pdf, other]

Title: Posterior Coreset Construction with Kernelized Stein Discrepancy for Model-Based Reinforcement Learning

Souradip Chakraborty, Amrit Singh Bedi, Alec Koppel, Brian M. Sadler, Furong Huang, Pratap Tokekar, Dinesh Manocha

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[637] arXiv:2206.01167 (cross-list from cs.LG) [pdf, other]

Title: Sparse Mixed Linear Regression with Guarantees: Taming an Intractable Problem with Invex Relaxation

Adarsh Barik, Jean Honorio

Journal-ref: International Conference on Machine Learning (ICML), 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[638] arXiv:2206.01209 (cross-list from math.OC) [pdf, other]

Title: Accelerated first-order methods for convex optimization with locally Lipschitz continuous gradient

Zhaosong Lu, Sanyou Mei

Comments: Accepted by SIAM Journal on Optimization

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[639] arXiv:2206.01278 (cross-list from cs.LG) [pdf, other]

Title: Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks

Mansheej Paul, Brett W. Larsen, Surya Ganguli, Jonathan Frankle, Gintare Karolina Dziugaite

Comments: The first two authors contributed equally

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[640] arXiv:2206.01295 (cross-list from cs.LG) [pdf, other]

Title: Rashomon Capacity: A Metric for Predictive Multiplicity in Classification

Hsiang Hsu, Flavio du Pin Calmon

Comments: NeurIPS 2022 camera-ready version (34 pages, 23 figures, 2 tables)

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[641] arXiv:2206.01315 (cross-list from cs.LG) [pdf, other]

Title: Sample-Efficient Reinforcement Learning of Partially Observable Markov Games

Qinghua Liu, Csaba Szepesvári, Chi Jin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Science and Game Theory (cs.GT); Machine Learning (stat.ML)

[642] arXiv:2206.01341 (cross-list from cs.LG) [pdf, other]

Title: Equipping Black-Box Policies with Model-Based Advice for Stable Nonlinear Control

Tongxin Li, Ruixiao Yang, Guannan Qu, Yiheng Lin, Steven Low, Adam Wierman

Comments: 33 pages, 7 figures

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Machine Learning (stat.ML)

[643] arXiv:2206.01343 (cross-list from cs.LG) [pdf, other]

Title: HEX: Human-in-the-loop Explainability via Deep Reinforcement Learning

Michael T. Lash

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[644] arXiv:2206.01378 (cross-list from cs.LG) [pdf, other]

Title: Regularization-wise double descent: Why it occurs and how to eliminate it

Fatih Furkan Yilmaz, Reinhard Heckel

Comments: To be published in the 2022 IEEE International Symposium on Information Theory (ISIT) Proceedings

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[645] arXiv:2206.01399 (cross-list from cs.LG) [pdf, other]

Title: Generalization for multiclass classification with overparameterized linear models

Vignesh Subramanian, Rahul Arya, Anant Sahai

Comments: 44 pages, 4 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[646] arXiv:2206.01409 (cross-list from cs.LG) [pdf, html, other]

Title: Hybrid Parameter Search and Dynamic Model Selection for Mixed-Variable Bayesian Optimization

Hengrui Luo, Younghyun Cho, James W. Demmel, Xiaoye S. Li, Yang Liu

Comments: 33 pages, 8 Figures

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[647] arXiv:2206.01426 (cross-list from cs.LG) [pdf, other]

Title: Rate-Optimal Online Convex Optimization in Adaptive Linear Control

Asaf Cassel (1), Alon Cohen (2 and 3), Tomer Koren (1 and 3) ((1) School of Computer Science, Tel Aviv University, (2) School of Electrical Engineering, Tel Aviv University, (3) Google Research, Tel Aviv)

Comments: arXiv admin note: text overlap with arXiv:2203.01170

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[648] arXiv:2206.01474 (cross-list from cs.LG) [pdf, other]

Title: Offline Reinforcement Learning with Causal Structured World Models

Zheng-Mao Zhu, Xiong-Hui Chen, Hong-Long Tian, Kun Zhang, Yang Yu

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[649] arXiv:2206.01496 (cross-list from cs.LG) [pdf, other]

Title: Causality Learning With Wasserstein Generative Adversarial Networks

Hristo Petkov, Colin Hanley, Feng Dong

Comments: arXiv admin note: substantial text overlap with arXiv:2204.00387

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Methodology (stat.ME)

[650] arXiv:2206.01515 (cross-list from cs.LG) [pdf, html, other]

Title: Understanding Deep Learning via Decision Boundary

Shiye Lei, Fengxiang He, Yancheng Yuan, Dacheng Tao

Comments: Accepted by IEEE TNNLS

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)