Machine Learning

Authors and titles for March 2023

[351] arXiv:2303.14084 (cross-list from cs.LG) [pdf, other]

Title: Differentially Private Synthetic Control

Saeyoung Rho, Rachel Cummings, Vishal Misra

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[352] arXiv:2303.14090 (cross-list from astro-ph.CO) [pdf, other]

Title: Physics-informed neural networks in the recreation of hydrodynamic simulations from dark matter

Zhenyu Dai, Ben Moews, Ricardo Vilalta, Romeel Dave

Subjects: Cosmology and Nongalactic Astrophysics (astro-ph.CO); Astrophysics of Galaxies (astro-ph.GA); Machine Learning (cs.LG); Machine Learning (stat.ML)

[353] arXiv:2303.14151 (cross-list from cs.LG) [pdf, other]

Title: Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle

Rylan Schaeffer, Mikail Khona, Zachary Robertson, Akhilan Boopathy, Kateryna Pistunova, Jason W. Rocks, Ila Rani Fiete, Oluwasanmi Koyejo

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[354] arXiv:2303.14173 (cross-list from cs.LG) [pdf, other]

Title: How many dimensions are required to find an adversarial example?

Charles Godfrey, Henry Kvinge, Elise Bishoff, Myles Mckay, Davis Brown, Tim Doster, Eleanor Byler

Comments: Comments welcome! V2: minor edits for clarity

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[355] arXiv:2303.14226 (cross-list from stat.ME) [pdf, html, other]

Title: Synthetic Combinations: A Causal Inference Framework for Combinatorial Interventions

Abhineet Agarwal, Anish Agarwal, Suhas Vijaykumar

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Econometrics (econ.EM); Machine Learning (stat.ML)

[356] arXiv:2303.14244 (cross-list from cs.LG) [pdf, other]

Title: Implicit Balancing and Regularization: Generalization and Convergence Guarantees for Overparameterized Asymmetric Matrix Sensing

Mahdi Soltanolkotabi, Dominik Stöger, Changzhi Xie

Comments: Accepted for presentation at the Conference on Learning Theory (COLT) 2023; 91 pages, 8 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Optimization and Control (math.OC); Machine Learning (stat.ML)

[357] arXiv:2303.14284 (cross-list from cs.LG) [pdf, other]

Title: Feature Space Sketching for Logistic Regression

Gregory Dexter, Rajiv Khanna, Jawad Raheel, Petros Drineas

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[358] arXiv:2303.14293 (cross-list from cs.LG) [pdf, other]

Title: Efficient Lipschitzian Global Optimization of Hölder Continuous Multivariate Functions

Kaan Gokcesu, Hakan Gokcesu

Comments: this work draws from arXiv:2206.02383

Subjects: Machine Learning (cs.LG); Computational Complexity (cs.CC); Optimization and Control (math.OC); Machine Learning (stat.ML)

[359] arXiv:2303.14301 (cross-list from cs.LG) [pdf, html, other]

Title: Natural Language-Based Synthetic Data Generation for Cluster Analysis

Michael J. Zellinger, Peter Bühlmann

Comments: 21 pages, 11 figures

Subjects: Machine Learning (cs.LG); Computation (stat.CO); Machine Learning (stat.ML)

[360] arXiv:2303.14496 (cross-list from cs.LG) [pdf, html, other]

Title: Learning with Explanation Constraints

Rattana Pukdee, Dylan Sam, J. Zico Kolter, Maria-Florina Balcan, Pradeep Ravikumar

Comments: NeurIPS 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[361] arXiv:2303.14553 (cross-list from cs.LG) [pdf, other]

Title: Complexity-calibrated Benchmarks for Machine Learning Reveal When Next-Generation Reservoir Computer Predictions Succeed and Mislead

Sarah E. Marzen, Paul M. Riechers, James P. Crutchfield

Comments: 10 pages, 5 figures; this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[362] arXiv:2303.14582 (cross-list from cs.LG) [pdf, other]

Title: Identification of Negative Transfers in Multitask Learning Using Surrogate Models

Dongyue Li, Huy L. Nguyen, Hongyang R. Zhang

Comments: 30 pages. Appeared in TMLR'23

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[363] arXiv:2303.14658 (cross-list from cs.IT) [pdf, html, other]

Title: Fast Rate Information-theoretic Bounds on Generalization Errors

Xuetong Wu, Jonathan H. Manton, Uwe Aickelin, Jingge Zhu

Comments: 27 pages, 1 figure, accepted to TIT

Subjects: Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[364] arXiv:2303.14760 (cross-list from physics.comp-ph) [pdf, other]

Title: Extrapolation to complete basis-set limit in density-functional theory by quantile random-forest models

Daniel T. Speckhard, Christian Carbogno, Luca Ghiringhelli, Sven Lubeck, Matthias Scheffler, Claudia Draxl

Subjects: Computational Physics (physics.comp-ph); Materials Science (cond-mat.mtrl-sci); Machine Learning (stat.ML)

[365] arXiv:2303.14801 (cross-list from stat.ME) [pdf, html, other]

Title: FAStEN: An Efficient Adaptive Method for Feature Selection and Estimation in High-Dimensional Functional Regressions

Tobia Boschi, Lorenzo Testa, Francesca Chiaromonte, Matthew Reimherr

Journal-ref: Journal of Computational and Graphical Statistics 2024

Subjects: Methodology (stat.ME); Computation (stat.CO); Machine Learning (stat.ML)

[366] arXiv:2303.14811 (cross-list from cs.LG) [pdf, other]

Title: Learning Generative Models with Goal-conditioned Reinforcement Learning

Mariana Vargas Vieyra, Pierre Ménard

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[367] arXiv:2303.14993 (cross-list from cond-mat.dis-nn) [pdf, other]

Title: Low-rank combinatorial optimization and statistical learning by spatial photonic Ising machine

Hiroshi Yamashita, Ken-ichi Okubo, Suguru Shimomura, Yusuke Ogura, Jun Tanida, Hideyuki Suzuki

Comments: 6 pages, 5 figures (with a 4-page supplemental); accepted version

Journal-ref: Phys. Rev. Lett. 131 (2023), 063801

Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Emerging Technologies (cs.ET); Applied Physics (physics.app-ph); Optics (physics.optics); Machine Learning (stat.ML)

[368] arXiv:2303.15121 (cross-list from math.ST) [pdf, html, other]

Title: Learning linear dynamical systems under convex constraints

Hemant Tyagi, Denis Efimov

Comments: 29 pages; added Example 4 (Lipschitz regression), Corollary 4 and Remark 2; corrected minor typos

Subjects: Statistics Theory (math.ST); Systems and Control (eess.SY); Optimization and Control (math.OC); Machine Learning (stat.ML)

[369] arXiv:2303.15226 (cross-list from cs.LG) [pdf, other]

Title: Asynchronous Online Federated Learning with Reduced Communication Requirements

Francois Gauthier, Vinay Chakravarthi Gogineni, Stefan Werner, Yih-Fang Huang, Anthony Kuh

Comments: A conference precursor of this work appears in the 2022 IEEE ICC

Journal-ref: IEEE Internet of Things Journal (2023)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC); Machine Learning (stat.ML)

[370] arXiv:2303.15244 (cross-list from cs.LG) [pdf, html, other]

Title: Manifold Learning by Mixture Models of VAEs for Inverse Problems

Giovanni S. Alberti, Johannes Hertrich, Matteo Santacesaria, Silvia Sciutto

Journal-ref: Journal of Machine Learning Research, 25 (202), 1-35, 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[371] arXiv:2303.15342 (cross-list from cs.LG) [pdf, other]

Title: Exploring Continual Learning of Diffusion Models

Michał Zając, Kamil Deja, Anna Kuzina, Jakub M. Tomczak, Tomasz Trzciński, Florian Shkurti, Piotr Miłoś

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[372] arXiv:2303.15383 (cross-list from cs.LG) [pdf, other]

Title: List Online Classification

Shay Moran, Ohad Sharon, Iska Tsubari, Sivan Yosebashvili

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[373] arXiv:2303.15464 (cross-list from cs.LG) [pdf, other]

Title: Mathematical Challenges in Deep Learning

Vahid Partovi Nia, Guojun Zhang, Ivan Kobyzev, Michael R. Metel, Xinlin Li, Ke Sun, Sobhan Hemati, Masoud Asgharian, Linglong Kong, Wulong Liu, Boxing Chen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Statistics Theory (math.ST); Machine Learning (stat.ML)

[374] arXiv:2303.15617 (cross-list from cs.LG) [pdf, other]

Title: Online Learning for Incentive-Based Demand Response

Deepan Muthirayan, Pramod P. Khargonekar

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Machine Learning (stat.ML)

[375] arXiv:2303.15634 (cross-list from cs.LG) [pdf, other]

Title: Learning Rate Schedules in the Presence of Distribution Shift

Matthew Fahrbach, Adel Javanmard, Vahab Mirrokni, Pratik Worah

Comments: 33 pages, 6 figures

Journal-ref: Proceedings of the 40th International Conference on Machine Learning (ICML 2023) 9523-9546

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[376] arXiv:2303.15739 (cross-list from cs.LG) [pdf, other]

Title: Bayesian Free Energy of Deep ReLU Neural Network in Overparametrized Cases

Shuya Nagayasu, Sumio Watanabe

Comments: 20pages, 2figure

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[377] arXiv:2303.15746 (cross-list from cs.LG) [pdf, other]

Title: qEUBO: A Decision-Theoretic Acquisition Function for Preferential Bayesian Optimization

Raul Astudillo, Zhiyuan Jerry Lin, Eytan Bakshy, Peter I. Frazier

Comments: In Proceedings of the 26th International Conference on Artificial Intelligence and Statistics (AISTATS) 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[378] arXiv:2303.15827 (cross-list from cs.LG) [pdf, html, other]

Title: CONFIDE: Contextual Finite Differences Modelling of PDEs

Ori Linial, Orly Avner, Dotan Di Castro

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[379] arXiv:2303.15833 (cross-list from cs.LG) [pdf, other]

Title: Complementary Domain Adaptation and Generalization for Unsupervised Continual Domain Shift Learning

Wonguk Cho, Jinha Park, Taesup Kim

Comments: ICCV 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[380] arXiv:2303.15950 (cross-list from cs.CR) [pdf, other]

Title: A source separation approach to temporal graph modelling for computer networks

Corentin Larroche

Subjects: Cryptography and Security (cs.CR); Applications (stat.AP); Machine Learning (stat.ML)

[381] arXiv:2303.16047 (cross-list from cs.LG) [pdf, other]

Title: Exploring and Interacting with the Set of Good Sparse Generalized Additive Models

Chudi Zhong, Zhi Chen, Jiachang Liu, Margo Seltzer, Cynthia Rudin

Comments: NeurIPS 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[382] arXiv:2303.16151 (cross-list from q-fin.ST) [pdf, other]

Title: Forecasting Large Realized Covariance Matrices: The Benefits of Factor Models and Shrinkage

Rafael Alves, Diego S. de Brito, Marcelo C. Medeiros, Ruy M. Ribeiro

Subjects: Statistical Finance (q-fin.ST); Machine Learning (cs.LG); Econometrics (econ.EM); Machine Learning (stat.ML)

[383] arXiv:2303.16241 (cross-list from math.OC) [pdf, html, other]

Title: Convergence of the Stochastic Heavy Ball Method With Approximate Gradients and/or Block Updating

Uday Kiran Reddy Tadipatri, Mathukumalli Vidyasagar

Comments: 37 pages, 4 figures

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[384] arXiv:2303.16299 (cross-list from stat.ME) [pdf, other]

Title: Comparison of Methods that Combine Multiple Randomized Trials to Estimate Heterogeneous Treatment Effects

Carly Lupton Brantner, Trang Quynh Nguyen, Tengjie Tang, Congwen Zhao, Hwanhee Hong, Elizabeth A. Stuart

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[385] arXiv:2303.16308 (cross-list from cs.LG) [pdf, other]

Title: Provable Robustness for Streaming Models with a Sliding Window

Aounon Kumar, Vinu Sankar Sadasivan, Soheil Feizi

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[386] arXiv:2303.16317 (cross-list from cs.LG) [pdf, other]

Title: Operator learning with PCA-Net: upper and lower complexity bounds

Samuel Lanthaler

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[387] arXiv:2303.16364 (cross-list from stat.ME) [pdf, other]

Title: Maximum likelihood smoothing estimation in state-space models: An incomplete-information based approach

Budhi Arta Surya

Comments: 3 figures

Subjects: Methodology (stat.ME); Information Theory (cs.IT); Machine Learning (cs.LG); Systems and Control (eess.SY); Machine Learning (stat.ML)

[388] arXiv:2303.16372 (cross-list from cs.LG) [pdf, html, other]

Title: On the Query Complexity of Training Data Reconstruction in Private Learning

Prateeti Mukherjee, Satya Lokam

Comments: Updated proof of Thm 10, fixed typos

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[389] arXiv:2303.16504 (cross-list from cs.LG) [pdf, other]

Title: An Over-parameterized Exponential Regression

Yeqi Gao, Sridhar Mahadevan, Zhao Song

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[390] arXiv:2303.16535 (cross-list from cs.LG) [pdf, other]

Title: Nonlinear Independent Component Analysis for Principled Disentanglement in Unsupervised Deep Learning

Aapo Hyvarinen, Ilyes Khemakhem, Hiroshi Morioka

Comments: Revised version, to appear in Patterns

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[391] arXiv:2303.16668 (cross-list from cs.LG) [pdf, html, other]

Title: Protecting Federated Learning from Extreme Model Poisoning Attacks via Multidimensional Time Series Anomaly Detection

Edoardo Gabrielli, Dimitri Belli, Zoe Matrullo, Vittorio Miori, Gabriele Tolomei

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[392] arXiv:2303.16698 (cross-list from cs.LG) [pdf, other]

Title: Probabilistic inverse optimal control for non-linear partially observable systems disentangles perceptual uncertainty and behavioral costs

Dominik Straub, Matthias Schultheis, Heinz Koeppl, Constantin A. Rothkopf

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Optimization and Control (math.OC); Neurons and Cognition (q-bio.NC); Machine Learning (stat.ML)

[393] arXiv:2303.16711 (cross-list from math.ST) [pdf, other]

Title: One-Step Estimation of Differentiable Hilbert-Valued Parameters

Alex Luedtke, Incheoul Chung

Subjects: Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)

[394] arXiv:2303.16800 (cross-list from math.ST) [pdf, other]

Title: Correcting for Selection Bias and Missing Response in Regression using Privileged Information

Philip Boeken, Noud de Kroon, Mathijs de Jong, Joris M. Mooij, Onno Zoeter

Journal-ref: Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence, PMLR 216:195-205, 2023

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[395] arXiv:2303.16813 (cross-list from math.FA) [pdf, other]

Title: Optimal approximation using complex-valued neural networks

Paul Geuchen, Felix Voigtlaender

Comments: accepted at NeurIPS 2023

Subjects: Functional Analysis (math.FA); Machine Learning (cs.LG); Machine Learning (stat.ML)

[396] arXiv:2303.16822 (cross-list from math.OC) [pdf, html, other]

Title: An inexact LPA for DC composite optimization and application to matrix completions with outliers

Ting Tao, Ruyu Liu, Shaohua Pan

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[397] arXiv:2303.16841 (cross-list from cs.LG) [pdf, other]

Title: Randomly Projected Convex Clustering Model: Motivation, Realization, and Cluster Recovery Guarantees

Ziwen Wang, Yancheng Yuan, Jiaming Ma, Tieyong Zeng, Defeng Sun

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[398] arXiv:2303.16938 (cross-list from cs.LG) [pdf, other]

Title: Are Neural Architecture Search Benchmarks Well Designed? A Deeper Look Into Operation Importance

Vasco Lopes, Bruno Degardin, Luís A. Alexandre

Comments: 15 pages; 11 figues; 10 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[399] arXiv:2303.17043 (cross-list from cs.LG) [pdf, html, other]

Title: Federated Learning for Heterogeneous Bandits with Unobserved Contexts

Jiabin Lin, Shana Moothedath

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[400] arXiv:2303.17045 (cross-list from cs.CC) [pdf, other]

Title: Training Neural Networks is NP-Hard in Fixed Dimension

Vincent Froese, Christoph Hertrich

Comments: Paper accepted at NeurIPS 2023

Subjects: Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)