Machine Learning

Authors and titles for July 2021

[1] arXiv:2107.00352 [pdf, other]

Title: Reparameterized Sampling for Generative Adversarial Networks

Yifei Wang, Yisen Wang, Jiansheng Yang, Zhouchen Lin

Comments: ECML PKDD 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[2] arXiv:2107.00363 [pdf, html, other]

Title: Valid prediction intervals for regression problems

Nicolas Dewolf, Bernard De Baets, Willem Waegeman

Comments: Minor correction (bibliography and typo in Fig. 3). Thanks to Dr. María Moreno de Castro for spotting this typo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[3] arXiv:2107.00371 [pdf, other]

Title: Sparse GCA and Thresholded Gradient Descent

Sheng Gao, Zongming Ma

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[4] arXiv:2107.00379 [pdf, other]

Title: On the Expected Complexity of Maxout Networks

Hanna Tseran, Guido Montúfar

Comments: Published at NeurIPS 2021, 47 pages, 18 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[5] arXiv:2107.00801 [pdf, other]

Title: Meta-Learning for Relative Density-Ratio Estimation

Atsutoshi Kumagai, Tomoharu Iwata, Yasuhiro Fujiwara

Comments: 17 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[6] arXiv:2107.00848 [pdf, other]

Title: Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning

Nan Rosemary Ke, Aniket Didolkar, Sarthak Mittal, Anirudh Goyal, Guillaume Lajoie, Stefan Bauer, Danilo Rezende, Yoshua Bengio, Michael Mozer, Christopher Pal

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[7] arXiv:2107.01105 [pdf, other]

Title: Memory Efficient Meta-Learning with Large Images

John Bronskill, Daniela Massiceti, Massimiliano Patacchiola, Katja Hofmann, Sebastian Nowozin, Richard E. Turner

Journal-ref: 35th Conference on Neural Information Processing Systems (NeurIPS 2021)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[8] arXiv:2107.01131 [pdf, other]

Title: Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization

Qing Guo, Junya Chen, Dong Wang, Yuewei Yang, Xinwei Deng, Lawrence Carin, Fan Li, Jing Huang, Chenyang Tao

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[9] arXiv:2107.01152 [pdf, other]

Title: Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE

Junya Chen, Zhe Gan, Xuan Li, Qing Guo, Liqun Chen, Shuyang Gao, Tagyoung Chung, Yi Xu, Belinda Zeng, Wenlian Lu, Fan Li, Lawrence Carin, Chenyang Tao

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG)

[10] arXiv:2107.01214 [pdf, other]

Title: Truncated Marginal Neural Ratio Estimation

Benjamin Kurt Miller, Alex Cole, Patrick Forré, Gilles Louppe, Christoph Weniger

Comments: 10 pages. 27 pages with references and supplemental material. Implementation of experiments at this https URL. Ready-to-use implementation of underlying algorithm at this https URL. Accepted at NeurIPS 2021

Subjects: Machine Learning (stat.ML); Instrumentation and Methods for Astrophysics (astro-ph.IM); Machine Learning (cs.LG); High Energy Physics - Phenomenology (hep-ph)

[11] arXiv:2107.01285 [pdf, other]

Title: Optimizing ROC Curves with a Sort-Based Surrogate Loss Function for Binary Classification and Changepoint Detection

Jonathan Hillman, Toby Dylan Hocking

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[12] arXiv:2107.01323 [pdf, other]

Title: Minimum Wasserstein Distance Estimator under Finite Location-scale Mixtures

Qiong Zhang, Jiahua Chen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[13] arXiv:2107.01333 [pdf, other]

Title: A Uniformly Consistent Estimator of non-Gaussian Causal Effects Under the k-Triangle-Faithfulness Assumption

Shuyan Wang, Peter Spirtes

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[14] arXiv:2107.01408 [pdf, other]

Title: Scale Mixtures of Neural Network Gaussian Processes

Hyungi Lee, Eunggu Yun, Hongseok Yang, Juho Lee

Comments: ICLR 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[15] arXiv:2107.01473 [pdf, other]

Title: Slope and generalization properties of neural networks

Anton Johansson, Niklas Engsner, Claes Strannegård, Petter Mostad

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[16] arXiv:2107.01590 [pdf, other]

Title: Deep Gaussian Process Emulation using Stochastic Imputation

Deyu Ming, Daniel Williamson, Serge Guillas

Comments: This article has been accepted for publication in Technometrics, published by Taylor & Francis

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Computation (stat.CO)

[17] arXiv:2107.01629 [pdf, other]

Title: The Role of "Live" in Livestreaming Markets: Evidence Using Orthogonal Random Forest

Ziwei Cong, Jia Liu, Puneet Manchanda

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); General Economics (econ.GN); Applications (stat.AP)

[18] arXiv:2107.01658 [pdf, other]

Title: Learning Bayesian Networks through Birkhoff Polytope: A Relaxation Method

Aramayis Dallakyan, Mohsen Pourahmadi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[19] arXiv:2107.01734 [pdf, other]

Title: Latent structure blockmodels for Bayesian spectral graph clustering

Francesco Sanna Passino, Nicholas A. Heard

Journal-ref: Statistics and Computing, 32(22) (2022)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[20] arXiv:2107.01876 [pdf, other]

Title: Which Invariance Should We Transfer? A Causal Minimax Learning Approach

Mingzhou Liu, Xiangyu Zheng, Xinwei Sun, Fang Fang, Yizhou Wang

Comments: Accepted version of ICML-23

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[21] arXiv:2107.01988 [pdf, other]

Title: UCSL : A Machine Learning Expectation-Maximization framework for Unsupervised Clustering driven by Supervised Learning

Robin Louiset, Pietro Gori, Benoit Dufumier, Josselin Houenou, Antoine Grigis, Edouard Duchesnay

Comments: ECML/PKDD 2021

Journal-ref: ECML/PKDD 2021

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[22] arXiv:2107.01994 [pdf, other]

Title: Template-Based Graph Clustering

Mateus Riva, Florian Yger, Pietro Gori, Roberto M. Cesar Jr., Isabelle Bloch

Comments: ECML-PKDD, Workshop on Graph Embedding and Minin (GEM) 2020

Journal-ref: ECML-PKDD, Workshop on Graph Embedding and Minin (GEM) 2020

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[23] arXiv:2107.02070 [pdf, other]

Title: Antithetic Riemannian Manifold And Quantum-Inspired Hamiltonian Monte Carlo

Wilson Tsakane Mongwe, Rendani Mbuvha, Tshilidzi Marwala

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[24] arXiv:2107.02145 [pdf, other]

Title: Tiled Squeeze-and-Excite: Channel Attention With Local Spatial Context

Niv Vosco, Alon Shenkler, Mark Grobman

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[25] arXiv:2107.02363 [pdf, other]

Title: Asymptotics of Network Embeddings Learned via Subsampling

Andrew Davison, Morgane Austern

Comments: Accepted at Journal of Machine Learning Research (JMLR). 120 pages, 3 figures, 1 table

Journal-ref: Journal of Machine Learning Research 24 (2023) 1-120. Published 5/23

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[26] arXiv:2107.02474 [pdf, other]

Title: Viscos Flows: Variational Schur Conditional Sampling With Normalizing Flows

Vincent Moens, Aivar Sootla, Haitham Bou Ammar, Jun Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[27] arXiv:2107.02480 [pdf, other]

Title: Midwifery Learning and Forecasting: Predicting Content Demand with User-Generated Logs

Anna Guitart, Ana Fernández del Río, África Periáñez, Lauren Bellhouse

Journal-ref: Artificial Intelligence in Medicine Volume 138, April 2023, 102511

Subjects: Machine Learning (stat.ML); Computers and Society (cs.CY); Machine Learning (cs.LG)

[28] arXiv:2107.02495 [pdf, other]

Title: InfoNCE is variational inference in a recognition parameterised model

Laurence Aitchison, Stoil Ganev

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[29] arXiv:2107.02821 [pdf, other]

Title: New Methods and Datasets for Group Anomaly Detection From Fundamental Physics

Gregor Kasieczka, Benjamin Nachman, David Shih

Comments: Accepted for ANDEA (Anomaly and Novelty Detection, Explanation and Accommodation) Workshop at KDD 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); High Energy Physics - Experiment (hep-ex); High Energy Physics - Phenomenology (hep-ph)

[30] arXiv:2107.02847 [pdf, other]

Title: Transfer Learning in Information Criteria-based Feature Selection

Shaohan Chen, Nikolaos V. Sahinidis, Chuanhou Gao

Comments: Accepted to the Journal of Machine Learning Research

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[31] arXiv:2107.02926 [pdf, other]

Title: Solution of Physics-based Bayesian Inverse Problems with Deep Generative Priors

Dhruv V Patel, Deep Ray, Assad A Oberai

Comments: Paper: 38 pages, 12 figures, 3 Tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[32] arXiv:2107.02990 [pdf, other]

Title: Test for non-negligible adverse shifts

Vathy M. Kamulete

Comments: Accepted at UAI 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[33] arXiv:2107.03144 [pdf, other]

Title: Neural Contextual Bandits without Regret

Parnian Kassraie, Andreas Krause

Comments: 37 pages, 6 figures

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[34] arXiv:2107.03183 [pdf, other]

Title: A Closed-Form Approximation to the Conjugate Prior of the Dirichlet and Beta Distributions

Kaspar Thommen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[35] arXiv:2107.03217 [pdf, other]

Title: Combined Global and Local Search for Optimization with Gaussian Process Models

Qun Meng, Songhao Wang, Szu Hui Ng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[36] arXiv:2107.03280 [pdf, other]

Title: MD-split+: Practical Local Conformal Inference in High Dimensions

Benjamin LeRoy, David Zhao

Comments: Appearing in ICML 2021 workshop on distribution-free uncertainty quantification

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[37] arXiv:2107.03322 [pdf, other]

Title: An algorithmic view of $\ell_2$ regularization and some path-following algorithms

Yunzhang Zhu, Renxiong Liu

Comments: 62 pages, 7 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[38] arXiv:2107.03455 [pdf, other]

Title: Model Selection for Generic Contextual Bandits

Avishek Ghosh, Abishek Sankararaman, Kannan Ramchandran

Comments: Accepted at IEEE Transactions on Information Theory. arXiv admin note: text overlap with arXiv:2006.02612

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[39] arXiv:2107.03730 [pdf, other]

Title: Encoding Domain Information with Sparse Priors for Inferring Explainable Latent Variables

Arber Qoku, Florian Buettner

Comments: 7 pages, 9 figures, Joint KDD 2021 Health Day and 2021 KDD Workshop on Applied Data Science for Healthcare

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[40] arXiv:2107.03770 [pdf, other]

Title: Federated Learning as a Mean-Field Game

Arash Mehrjou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS); Optimization and Control (math.OC); Probability (math.PR)

[41] arXiv:2107.03863 [pdf, html, other]

Title: Benchpress: A Scalable and Versatile Workflow for Benchmarking Structure Learning Algorithms

Felix L. Rios, Giusi Moffa, Jack Kuipers

Comments: 41 pages, 8 figure

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Computation (stat.CO)

[42] arXiv:2107.03920 [pdf, html, other]

Title: Likelihood-Free Frequentist Inference: Bridging Classical Statistics and Machine Learning for Reliable Simulator-Based Inference

Niccolò Dalmasso, Luca Masserano, David Zhao, Rafael Izbicki, Ann B. Lee

Comments: 46 pages, 8 figures, code available at this https URL, supplementary material available at this https URL

Journal-ref: Electronic Journal of Statistics Vol. 18 | No. 2 (2024)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[43] arXiv:2107.04050 [pdf, other]

Title: Efficient Model-Based Multi-Agent Mean-Field Reinforcement Learning

Barna Pásztor, Ilija Bogunovic, Andreas Krause

Journal-ref: P\'asztor, B., Krause, A., & Bogunovic, I. (2023). Efficient Model-Based Multi-Agent Mean-Field Reinforcement Learning. Transactions on Machine Learning Research

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Multiagent Systems (cs.MA)

[44] arXiv:2107.04126 [pdf, other]

Title: Many Objective Bayesian Optimization

Lucia Asencio Martín, Eduardo C. Garrido-Merchán

Comments: arXiv admin note: text overlap with arXiv:2101.08061

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[45] arXiv:2107.04346 [pdf, other]

Title: Generalization of the Change of Variables Formula with Applications to Residual Flows

Niklas Koenen, Marvin N. Wright, Peter Maaß, Jens Behrmann

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS)

[46] arXiv:2107.04384 [pdf, other]

Title: Continual Learning in the Teacher-Student Setup: Impact of Task Similarity

Sebastian Lee, Sebastian Goldt, Andrew Saxe

Journal-ref: Proceedings of the 38th International Conference on Machine Learning, PMLR 139:6109-6119, 2021

Subjects: Machine Learning (stat.ML); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG)

[47] arXiv:2107.04562 [pdf, html, other]

Title: The Bayesian Learning Rule

Mohammad Emtiyaz Khan, Håvard Rue

Journal-ref: Journal of Machine Learning Research 24, no. 281 (2023): 1-46

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[48] arXiv:2107.04831 [pdf, other]

Title: Cluster Regularization via a Hierarchical Feature Regression

Johann Pfitzinger

Comments: Updated figures and arguments. Results unchanged

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[49] arXiv:2107.05001 [pdf, other]

Title: Improving Efficiency and Accuracy of Causal Discovery Using a Hierarchical Wrapper

Shami Nisimov, Yaniv Gurwicz, Raanan Y. Rohekar, Gal Novik

Comments: The 37th Conference on Uncertainty in Artificial Intelligence (UAI 2021), Workshop on Tractable Probabilistic Modeling

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[50] arXiv:2107.05320 [pdf, other]

Title: Metalearning Linear Bandits by Prior Update

Amit Peleg, Naama Pearl, Ron Meir

Journal-ref: Proceedings of The 25th International Conference on Artificial Intelligence and Statistics (AISTATS), 2022

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[51] arXiv:2107.05719 [pdf, other]

Title: Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibration

Shengjia Zhao, Michael P. Kim, Roshni Sahoo, Tengyu Ma, Stefano Ermon

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[52] arXiv:2107.05834 [pdf, other]

Title: Oversampling Divide-and-conquer for Response-skewed Kernel Ridge Regression

Jingyi Zhang, Xiaoxiao Sun

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[53] arXiv:2107.05847 [pdf, other]

Title: Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challenges

Bernd Bischl, Martin Binder, Michel Lang, Tobias Pielok, Jakob Richter, Stefan Coors, Janek Thomas, Theresa Ullmann, Marc Becker, Anne-Laure Boulesteix, Difan Deng, Marius Lindauer

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[54] arXiv:2107.05849 [pdf, other]

Title: Model Selection for Generic Reinforcement Learning

Avishek Ghosh, Sayak Ray Chowdhury, Kannan Ramchandran

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[55] arXiv:2107.05984 [pdf, other]

Title: Deep Autoregressive Models with Spectral Attention

Fernando Moreno-Pino, Pablo M. Olmos, Antonio Artés-Rodríguez

Comments: Errors in Eq. 2 and Eq. 3 corrected

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[56] arXiv:2107.06008 [pdf, other]

Title: Wasserstein GAN: Deep Generation applied on Bitcoins financial time series

Rikli Samuel, Bigler Daniel Nico, Pfenninger Moritz, Osterrieder Joerg

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[57] arXiv:2107.06473 [pdf, other]

Title: Spectrum Gaussian Processes Based On Tunable Basis Functions

Wenqi Fang, Guanlin Wu, Jingjing Li, Zheng Wang, Jiang Cao, Yang Ping

Comments: 10 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[58] arXiv:2107.06675 [pdf, other]

Title: M5 Competition Uncertainty: Overdispersion, distributional forecasting, GAMLSS and beyond

Florian Ziel

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Applications (stat.AP); Methodology (stat.ME)

[59] arXiv:2107.07087 [pdf, other]

Title: Entropic Inequality Constraints from $e$-separation Relations in Directed Acyclic Graphs with Hidden Variables

Noam Finkelstein, Beata Zjawin, Elie Wolfe, Ilya Shpitser, Robert W. Spekkens

Comments: 18 pages. New in v3: Minor changes to the main text, substantial revisions to the proofs in Appendix C. We thank Robin Evans for motivating the most significant changes since v2

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[60] arXiv:2107.07098 [pdf, other]

Title: Hida-Matérn Kernel

Matthew Dowling, Piotr Sokół, Il Memming Park

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[61] arXiv:2107.07115 [pdf, other]

Title: Principal component analysis for Gaussian process posteriors

Hideaki Ishibashi, Shotaro Akaho

Journal-ref: Neural Computation, 34, 1189-1219, 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[62] arXiv:2107.07322 [pdf, other]

Title: A unified framework for bandit multiple testing

Ziyu Xu, Ruodu Wang, Aaditya Ramdas

Comments: 38 pages. 6 figures. Accepted to NeurIPS 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[63] arXiv:2107.07436 [pdf, other]

Title: FastSHAP: Real-Time Shapley Value Estimation

Neil Jethani, Mukund Sudarshan, Ian Covert, Su-In Lee, Rajesh Ranganath

Comments: ICLR 2022 Camera Ready, 20 pages, 10 figures, 3 tables

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[64] arXiv:2107.07443 [pdf, other]

Title: Multi-label Chaining with Imprecise Probabilities

Yonatan Carlos Carranza Alarcón, Sébastien Destercke

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[65] arXiv:2107.07494 [pdf, other]

Title: Mid-flight Forecasting for CPA Lines in Online Advertising

Hao He, Tian Zhou, Lihua Ren, Niklas Karlsson, Aaron Flores

Comments: 41st International Symposium on Forecasting, June 27-30, 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[66] arXiv:2107.07687 [pdf, other]

Title: Auto-differentiable Ensemble Kalman Filters

Yuming Chen, Daniel Sanz-Alonso, Rebecca Willett

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[67] arXiv:2107.07853 [pdf, other]

Title: A Causal Perspective on Meaningful and Robust Algorithmic Recourse

Gunnar König, Timo Freiesleben, Moritz Grosse-Wentrup

Comments: ICML (International Conference on Machine Learning) Workshop on Algorithmic Recourse

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[68] arXiv:2107.07875 [pdf, html, other]

Title: A Penalized Shared-parameter Algorithm for Estimating Optimal Dynamic Treatment Regimens

Palash Ghosh, Xinru Wang, Trikay Nalamada, Shruti Agarwal, Maria Jahja, Bibhas Chakraborty

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[69] arXiv:2107.08001 [pdf, other]

Title: Efficient Bayesian Sampling Using Normalizing Flows to Assist Markov Chain Monte Carlo Methods

Marylou Gabrié, Grant M. Rotskoff, Eric Vanden-Eijnden

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)

[70] arXiv:2107.08020 [pdf, html, other]

Title: Online Graph Topology Learning from Matrix-valued Time Series

Yiye Jiang, Jérémie Bigot, Sofian Maabout

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[71] arXiv:2107.08135 [pdf, other]

Title: Mediated Uncoupled Learning: Learning Functions without Direct Input-output Correspondences

Ikko Yamane, Junya Honda, Florian Yger, Masashi Sugiyama

Comments: ICML 2021 version with correction to Figure 1 and the appendices

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[72] arXiv:2107.08179 [pdf, other]

Title: Model Uncertainty and Correctability for Directed Graphical Models

Panagiota Birmpa, Jinchao Feng, Markos A. Katsoulakis, Luc Rey-Bellet

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Probability (math.PR)

[73] arXiv:2107.08209 [pdf, other]

Title: Minimising quantifier variance under prior probability shift

Dirk Tasche

Comments: 12 pages, 1 figure

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[74] arXiv:2107.08265 [pdf, other]

Title: Subset-of-Data Variational Inference for Deep Gaussian-Processes Regression

Ayush Jain (1), P. K. Srijith (1), Mohammad Emtiyaz Khan (2) ((1) Department of Computer Science and Engineering, Indian Institute of Technology Hyderabad, India, (2) RIKEN Center for AI Project, Tokyo, Japan)

Comments: Accepted in the 37th Conference on Uncertainty in Artificial Intelligence (UAI 2021)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[75] arXiv:2107.08595 [pdf, other]

Title: High-Dimensional Simulation Optimization via Brownian Fields and Sparse Grids

Liang Ding, Rui Tuo, Xiaowei Zhang

Comments: Main body: 36 pages, 7 figures, 2 tables. Supplemental material: 32 pages, 1 figure

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Methodology (stat.ME)

[76] arXiv:2107.08596 [pdf, other]

Title: Equivariant Manifold Flows

Isay Katsman, Aaron Lou, Derek Lim, Qingxuan Jiang, Ser-Nam Lim, Christopher De Sa

Comments: Published at NeurIPS 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Differential Geometry (math.DG)

[77] arXiv:2107.09088 [pdf, other]

Title: Reward-Weighted Regression Converges to a Global Optimum

Miroslav Štrupl, Francesco Faccio, Dylan R. Ashley, Rupesh Kumar Srivastava, Jürgen Schmidhuber

Comments: 7 pages in main text + 2 pages of references + 6 pages of appendices, 1 figure in main text + 1 figure in appendices; source code available at this https URL

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[78] arXiv:2107.09145 [pdf, other]

Title: Adaptive wavelet distillation from neural networks through interpretations

Wooseok Ha, Chandan Singh, Francois Lanusse, Srigokul Upadhyayula, Bin Yu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[79] arXiv:2107.09194 [pdf, other]

Title: Can we globally optimize cross-validation loss? Quasiconvexity in ridge regression

William T. Stephenson, Zachary Frangella, Madeleine Udell, Tamara Broderick

Comments: Published in NeurIPS 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[80] arXiv:2107.09301 [pdf, other]

Title: A Bayesian Approach to Invariant Deep Neural Networks

Nikolaos Mourdoukoutas, Marco Federici, Georges Pantalos, Mark van der Wilk, Vincent Fortuin

Comments: 8 pages, 3 figures, To be published in ICML UDL 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[81] arXiv:2107.09384 [pdf, other]

Title: An induction proof of the backpropagation algorithm in matrix notation

Dirk Ostwald, Franziska Usée

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Neurons and Cognition (q-bio.NC)

[82] arXiv:2107.09519 [pdf, other]

Title: Canonical Polyadic Decomposition and Deep Learning for Machine Fault Detection

Gaetan Frusque, Gabriel Michau, Olga Fink

Comments: 9 pages, 5 figures, conference paper from PHM Society European Conference 2021 (Vol. 6, No. 1)

Journal-ref: In PHM Society European Conference (Vol. 6, No. 1, pp. 9-9) 2021, June

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[83] arXiv:2107.10014 [pdf, other]

Title: Delving Into Deep Walkers: A Convergence Analysis of Random-Walk-Based Vertex Embeddings

Dominik Kloepfer, Angelica I. Aviles-Rivero, Daniel Heydecker

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[84] arXiv:2107.10066 [pdf, other]

Title: Adaptive Inducing Points Selection For Gaussian Processes

Théo Galy-Fajou, Manfred Opper

Comments: Accepted at Continual Learning Workshop - ICML 2020 : this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[85] arXiv:2107.10098 [pdf, other]

Title: Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICA

Sébastien Lachapelle, Pau Rodríguez López, Yash Sharma, Katie Everett, Rémi Le Priol, Alexandre Lacoste, Simon Lacoste-Julien

Comments: Appears in: 1st Conference on Causal Learning and Reasoning (CLeaR 2022). 57 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[86] arXiv:2107.10110 [pdf, other]

Title: On the Convergence of Prior-Guided Zeroth-Order Optimization Algorithms

Shuyu Cheng, Guoqiang Wu, Jun Zhu

Comments: NeurIPS 2021; code available at this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[87] arXiv:2107.10125 [pdf, other]

Title: A variational approximate posterior for the deep Wishart process

Sebastian W. Ober, Laurence Aitchison

Comments: Accepted for publication at the 35th Conference on Neural Information Processing Systems (NeurIPS 2021). 23 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[88] arXiv:2107.10211 [pdf, other]

Title: Differentiable Annealed Importance Sampling and the Perils of Gradient Noise

Guodong Zhang, Kyle Hsu, Jianing Li, Chelsea Finn, Roger Grosse

Comments: 23 pages, NeurIPS 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[89] arXiv:2107.10567 [pdf, other]

Title: An overcome of far-distance limitation on tunnel CCTV-based accident detection in AI deep-learning frameworks

Kyu-Beom Lee, Hyu-Soung Shin

Comments: 6 pages, 3 figures, to be presented in "2021 INTERNATIONAL CONFERENCE ON TUNNELS AND UNDERGROUND SPACES" conference

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[90] arXiv:2107.10663 [pdf, other]

Title: Fed-ensemble: Improving Generalization through Model Ensembling in Federated Learning

Naichen Shi, Fan Lai, Raed Al Kontar, Mosharaf Chowdhury

Journal-ref: IEEE Transactions on Automation Science and Engineering (TASE), 2023

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[91] arXiv:2107.10867 [pdf, html, other]

Title: A local approach to parameter space reduction for regression and classification tasks

Francesco Romor, Marco Tezzele, Gianluigi Rozza

Subjects: Machine Learning (stat.ML); Numerical Analysis (math.NA)

[92] arXiv:2107.10884 [pdf, other]

Title: Structured second-order methods via natural gradient descent

Wu Lin, Frank Nielsen, Mohammad Emtiyaz Khan, Mark Schmidt

Comments: Fixed some typos and added a new figure. ICML 2021 workshop paper. A short version of arXiv:2102.07405 with a focus on optimization tasks

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[93] arXiv:2107.10955 [pdf, html, other]

Title: Learning Linear Polytree Structural Equation Models

Xingmei Lou, Yu Hu, Xiaodong Li

Comments: 35 pages, 5 figures, 4 tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[94] arXiv:2107.10970 [pdf, other]

Title: The decomposition of the higher-order homology embedding constructed from the $k$-Laplacian

Yu-Chia Chen, Marina Meilă

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[95] arXiv:2107.11114 [pdf, other]

Title: A comparison of combined data assimilation and machine learning methods for offline and online model error correction

Alban Farchi, Marc Bocquet, Patrick Laloyaux, Massimo Bonavita, Quentin Malartic

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[96] arXiv:2107.11253 [pdf, other]

Title: State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamics

Quentin Malartic, Alban Farchi, Marc Bocquet

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Chaotic Dynamics (nlin.CD); Atmospheric and Oceanic Physics (physics.ao-ph); Data Analysis, Statistics and Probability (physics.data-an)

[97] arXiv:2107.11357 [pdf, other]

Title: Joint Shapley values: a measure of joint feature importance

Chris Harris, Richard Pymar, Colin Rowat

Comments: Source code available at this https URL

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[98] arXiv:2107.11419 [pdf, other]

Title: Finite-time Analysis of Globally Nonstationary Multi-Armed Bandits

Junpei Komiyama, Edouard Fouché, Junya Honda

Comments: Revision: Regret bound for ADR-Bandit + TS

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[99] arXiv:2107.11533 [pdf, other]

Title: Combining Online Learning and Offline Learning for Contextual Bandits with Deficient Support

Hung Tran-The, Sunil Gupta, Thanh Nguyen-Tang, Santu Rana, Svetha Venkatesh

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[100] arXiv:2107.11662 [pdf, other]

Title: Inference of collective Gaussian hidden Markov models

Rahul Singh, Yongxin Chen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP); Systems and Control (eess.SY)