Machine Learning

Authors and titles for February 2021

[76] arXiv:2102.06197 [pdf, other]

Title: Estimating a Directed Tree for Extremes

Ngoc Mai Tran, Johannes Buck, Claudia Klüppelberg

Comments: Extensive Revision. 54 pages, 26 Figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Methodology (stat.ME)

[77] arXiv:2102.06229 [pdf, other]

Title: Higher Order Generalization Error for First Order Discretization of Langevin Diffusion

Mufan Bill Li, Maxime Gazeau

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[78] arXiv:2102.06278 [pdf, other]

Title: Unsupervised Ground Metric Learning using Wasserstein Singular Vectors

Geert-Jan Huizing, Laura Cantini, Gabriel Peyré

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[79] arXiv:2102.06477 [pdf, other]

Title: HNPE: Leveraging Global Parameters for Neural Posterior Estimation

Pedro L. C. Rodrigues, Thomas Moreau, Gilles Louppe, Alexandre Gramfort

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

[80] arXiv:2102.06521 [pdf, other]

Title: Robust and integrative Bayesian neural networks for likelihood-free parameter inference

Fredrik Wrede, Robin Eriksson, Richard Jiang, Linda Petzold, Stefan Engblom, Andreas Hellander, Prashant Singh

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

[81] arXiv:2102.06522 [pdf, other]

Title: Sequential Neural Posterior and Likelihood Approximation

Samuel Wiqvist, Jes Frellsen, Umberto Picchini

Comments: 28 pages, 8 tables, 14 figures. The supplementary material is attached to the main paper

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[82] arXiv:2102.06548 [pdf, other]

Title: Is Q-Learning Minimax Optimal? A Tight Sample Complexity Analysis

Gen Li, Changxiao Cai, Yuxin Chen, Yuting Wei, Yuejie Chi

Comments: accepted to Operations Research

Journal-ref: Operations Research, vol. 72, no. 1, pp. 222-236, 2024

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST)

[83] arXiv:2102.06559 [pdf, other]

Title: Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equations

Winnie Xu, Ricky T.Q. Chen, Xuechen Li, David Duvenaud

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[84] arXiv:2102.06571 [pdf, other]

Title: Bayesian Neural Network Priors Revisited

Vincent Fortuin, Adrià Garriga-Alonso, Sebastian W. Ober, Florian Wenzel, Gunnar Rätsch, Richard E. Turner, Mark van der Wilk, Laurence Aitchison

Comments: Accepted at ICLR 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[85] arXiv:2102.06593 [pdf, other]

Title: Pareto Optimal Model Selection in Linear Bandits

Yinglun Zhu, Robert Nowak

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[86] arXiv:2102.06879 [pdf, other]

Title: Learning from Similarity-Confidence Data

Yuzhou Cao, Lei Feng, Yitian Xu, Bo An, Gang Niu, Masashi Sugiyama

Comments: 33 pages, 5 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[87] arXiv:2102.07005 [pdf, other]

Title: Clustering Interval-Censored Time-Series for Disease Phenotyping

Irene Y. Chen, Rahul G. Krishnan, David Sontag

Comments: AAAI 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[88] arXiv:2102.07006 [pdf, other]

Title: Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections

Alexander Camuto, Xiaoyu Wang, Lingjiong Zhu, Chris Holmes, Mert Gürbüzbalaban, Umut Şimşekli

Comments: Main paper of 12 pages, followed by appendix

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[89] arXiv:2102.07030 [pdf, other]

Title: Diffusion Approximations for a Class of Sequential Testing Problems

Victor F. Araman, Rene Caldentey

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[90] arXiv:2102.07060 [pdf, other]

Title: Achieving Efficiency in Black Box Simulation of Distribution Tails with Self-structuring Importance Samplers

Anand Deo, Karthyek Murthy

Comments: 51 pages, 6 Figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Methodology (stat.ME)

[91] arXiv:2102.07106 [pdf, other]

Title: Healing Products of Gaussian Processes

Samuel Cohen, Rendani Mbuvha, Tshilidzi Marwala, Marc Peter Deisenroth

Comments: ICML 2020

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[92] arXiv:2102.07115 [pdf, other]

Title: Sliced Multi-Marginal Optimal Transport

Samuel Cohen, Alexander Terenin, Yannik Pitcan, Brandon Amos, Marc Peter Deisenroth, K S Sesh Kumar

Journal-ref: NeurIPS Workshop on Optimal Transport and Machine Learning, 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[93] arXiv:2102.07143 [pdf, other]

Title: Manifold Density Estimation via Generalized Dequantization

James A. Brofos, Marcus A. Brubaker, Roy R. Lederman

Comments: Additional experiments and theory

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[94] arXiv:2102.07188 [pdf, other]

Title: Think Global and Act Local: Bayesian Optimisation over High-Dimensional Categorical and Mixed Search Spaces

Xingchen Wan, Vu Nguyen, Huong Ha, Binxin Ru, Cong Lu, Michael A. Osborne

Comments: ICML 2021. 9 page, 6 figures (26 pages, 16 figures, 2 tables including references and appendices)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[95] arXiv:2102.07211 [pdf, other]

Title: Efficient Designs of SLOPE Penalty Sequences in Finite Dimension

Yiliang Zhang, Zhiqi Bu

Comments: Accepted to AISTATS 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[96] arXiv:2102.07238 [pdf, other]

Title: Double-descent curves in neural networks: a new perspective using Gaussian processes

Ouns El Harzli, Bernardo Cuenca Grau, Guillermo Valle-Pérez, Ard A. Louis

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[97] arXiv:2102.07254 [pdf, other]

Title: Asymptotically Optimal Strategies For Combinatorial Semi-Bandits in Polynomial Time

Thibaut Cuvelier, Richard Combes, Eric Gourdin

Comments: 26 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[98] arXiv:2102.07405 [pdf, other]

Title: Tractable structured natural gradient descent using local parameterizations

Wu Lin, Frank Nielsen, Mohammad Emtiyaz Khan, Mark Schmidt

Comments: An extended version of the ICML 2021 paper. Note: A workshop (short) paper with a focus on optimization tasks can be found at arXiv:2107.10884

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[99] arXiv:2102.07432 [pdf, other]

Title: Fast and accurate optimization on the orthogonal manifold without retraction

Pierre Ablin, Gabriel Peyré

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[100] arXiv:2102.07501 [pdf, other]

Title: Annealed Flow Transport Monte Carlo

Michael Arbel, Alexander G. D. G. Matthews, Arnaud Doucet

Subjects: Machine Learning (stat.ML); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG); Statistics Theory (math.ST)

[101] arXiv:2102.07559 [pdf, other]

Title: Certifiably Robust Variational Autoencoders

Ben Barrett, Alexander Camuto, Matthew Willetts, Tom Rainforth

Comments: 12 pages and appendix

Journal-ref: AISTATS 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[102] arXiv:2102.07586 [pdf, other]

Title: On Riemannian Stochastic Approximation Schemes with Fixed Step-Size

Alain Durmus, Pablo Jiménez, Éric Moulines, Salem Said

Comments: 37 pages, 4 figures, to appear in AISTAT21

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[103] arXiv:2102.07663 [pdf, other]

Title: Causal Markov Decision Processes: Learning Good Interventions Efficiently

Yangyi Lu, Amirhossein Meisami, Ambuj Tewari

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[104] arXiv:2102.07695 [pdf, other]

Title: Scalable nonparametric Bayesian learning for heterogeneous and dynamic velocity fields

Sunrit Chakraborty, Aritra Guha, Rayleigh Lei, XuanLong Nguyen

Comments: 5 tables, 8 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[105] arXiv:2102.07800 [pdf, other]

Title: Top-$k$ eXtreme Contextual Bandits with Arm Hierarchy

Rajat Sen, Alexander Rakhlin, Lexing Ying, Rahul Kidambi, Dean Foster, Daniel Hill, Inderjit Dhillon

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[106] arXiv:2102.07850 [pdf, other]

Title: Differentiable Particle Filtering via Entropy-Regularized Optimal Transport

Adrien Corenflos, James Thornton, George Deligiannidis, Arnaud Doucet

Comments: 9 pages of content + 11 pages supplementary, accepted for oral at ICML 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[107] arXiv:2102.07987 [pdf, other]

Title: The Elliptical Potential Lemma for General Distributions with an Application to Linear Thompson Sampling

Nima Hamidi, Mohsen Bayati

Comments: Accepted to Operations Research

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[108] arXiv:2102.08087 [pdf, other]

Title: Making the most of your day: online learning for optimal allocation of time

Etienne Boursier, Tristan Garrec, Vianney Perchet, Marco Scarsini

Comments: NeurIPS 2021 camera ready

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Other Statistics (stat.OT)

[109] arXiv:2102.08093 [pdf, other]

Title: A Law of Robustness for Weight-bounded Neural Networks

Hisham Husain, Borja Balle

Comments: The main result does not resolve the conjecture as claimed. However the proof technique can be used to obtain a weaker result. The manuscript will be updated at a later date

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[110] arXiv:2102.08127 [pdf, other]

Title: Learning curves of generic features maps for realistic datasets with a teacher-student model

Bruno Loureiro, Cédric Gerbelot, Hugo Cui, Sebastian Goldt, Florent Krzakala, Marc Mézard, Lenka Zdeborová

Comments: v3: NeurIPS camera-ready

Journal-ref: 35th Conference on Neural Information Processing Systems (NeurIPS 2021), vol 34 p10137--18151. J. Stat. Mech. (2022) 114001

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)

[111] arXiv:2102.08208 [pdf, other]

Title: Conditional Distributional Treatment Effect with Kernel Conditional Mean Embeddings and U-Statistic Regression

Junhyung Park, Uri Shalit, Bernhard Schölkopf, Krikamol Muandet

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[112] arXiv:2102.08314 [pdf, other]

Title: Tighter Bounds on the Log Marginal Likelihood of Gaussian Process Regression Using Conjugate Gradients

Artem Artemev, David R. Burt, Mark van der Wilk

Comments: Preprint

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[113] arXiv:2102.08554 [pdf, other]

Title: Recoverability Landscape of Tree Structured Markov Random Fields under Symmetric Noise

Ashish Katiyar, Soumya Basu, Vatsal Shah, Constantine Caramanis

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[114] arXiv:2102.08649 [pdf, other]

Title: A General Framework for the Practical Disintegration of PAC-Bayesian Bounds

Paul Viallard (SIERRA), Pascal Germain, Amaury Habrard (LHC), Emilie Morvant (LHC)

Comments: Machine Learning, In press

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[115] arXiv:2102.08659 [pdf, other]

Title: Unbiased Estimations based on Binary Classifiers: A Maximum Likelihood Approach

Marco J.H. Puts, Piet J.H. Daas

Comments: 2 pages, 2 figures, SDSS symposium 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[116] arXiv:2102.08769 [pdf, other]

Title: Muddling Labels for Regularization, a novel approach to generalization

Karim Lounici, Katia Meziani, Benjamin Riu

Comments: arXiv admin note: text overlap with arXiv:2006.06705

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[117] arXiv:2102.08791 [pdf, other]

Title: Geostatistical Learning: Challenges and Opportunities

Júlio Hoffimann, Maciel Zortea, Breno de Carvalho, Bianca Zadrozny

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[118] arXiv:2102.08792 [pdf, other]

Title: Chance-Constrained Active Inference

Thijs van de Laar, Ismail Senoz, Ayça Özçelikkale, Henk Wymeersch

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[119] arXiv:2102.08817 [pdf, other]

Title: Dissecting Supervised Contrastive Learning

Florian Graf, Christoph D. Hofer, Marc Niethammer, Roland Kwitt

Comments: v4 updates: - updated appendix section S1.3 - this includes fixing an oversight in the proofs (Lemma 1 missed an equality condition, which now appears in Lemma 2) - improved figure quality

Journal-ref: Proceedings of the 38th International Conference on Machine Learning, PMLR 139:3821-3830, 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[120] arXiv:2102.08895 [pdf, other]

Title: On the Fundamental Limits of Exact Inference in Structured Prediction

Hanbyul Lee, Kevin Bello, Jean Honorio

Journal-ref: IEEE International Symposium on Information Theory (ISIT), 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[121] arXiv:2102.09042 [pdf, other]

Title: Modeling Extremes with d-max-decreasing Neural Networks

Ali Hasan, Khalil Elkhalil, Yuting Ng, Joao M. Pereira, Sina Farsiu, Jose H. Blanchet, Vahid Tarokh

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[122] arXiv:2102.09191 [pdf, other]

Title: Non-approximate Inference for Collective Graphical Models on Path Graphs via Discrete Difference of Convex Algorithm

Yasunori Akagi, Naoki Marumo, Hideaki Kim, Takeshi Kurashima, Hiroyuki Toda

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[123] arXiv:2102.09204 [pdf, other]

Title: Towards a mathematical theory of trajectory inference

Hugo Lavenant, Stephen Zhang, Young-Heon Kim, Geoffrey Schiebinger

Comments: The first two authors contributed equally to this work; 76 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Probability (math.PR); Statistics Theory (math.ST)

[124] arXiv:2102.09526 [pdf, other]

Title: Convex regularization in statistical inverse learning problems

Tatiana A. Bubba, Martin Burger, Tapio Helin, Luca Ratti

Comments: 35 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[125] arXiv:2102.09669 [pdf, other]

Title: Joint Characterization of Multiscale Information in High Dimensional Data

Daniel Sousa, Christopher Small

Journal-ref: Advances in Artificial Intelligence and Machine Learning, 1 (3):203-220 (2021)

Subjects: Machine Learning (stat.ML); Data Analysis, Statistics and Probability (physics.data-an); Geophysics (physics.geo-ph)