Machine Learning

Authors and titles for December 2023

[101] arXiv:2312.17210 [pdf, html, other]

Title: Continual Learning via Sequential Function-Space Variational Inference

Tim G. J. Rudner, Freddie Bickford Smith, Qixuan Feng, Yee Whye Teh, Yarin Gal

Comments: Published in Proceedings of the 39th International Conference on Machine Learning (ICML 2022)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[102] arXiv:2312.00073 (cross-list from math.PR) [pdf, other]

Title: Binary perceptrons capacity via fully lifted random duality theory

Mihailo Stojnic

Subjects: Probability (math.PR); Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)

[103] arXiv:2312.00232 (cross-list from cs.LG) [pdf, other]

Title: Uncertainty in Graph Contrastive Learning with Bayesian Neural Networks

Alexander Möllers, Alexander Immer, Elvin Isufi, Vincent Fortuin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[104] arXiv:2312.00234 (cross-list from cs.LG) [pdf, other]

Title: Deep Equilibrium Based Neural Operators for Steady-State PDEs

Tanya Marwah, Ashwini Pokle, J. Zico Kolter, Zachary C. Lipton, Jianfeng Lu, Andrej Risteski

Comments: NeurIPS 2023

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[105] arXiv:2312.00267 (cross-list from cs.LG) [pdf, html, other]

Title: Sample Efficient Preference Alignment in LLMs via Active Exploration

Viraj Mehta, Syrine Belakaria, Vikramjeet Das, Ojash Neopane, Yijia Dai, Ilija Bogunovic, Barbara Engelhardt, Stefano Ermon, Jeff Schneider, Willie Neiswanger

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[106] arXiv:2312.00296 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Aligned Canonical Correlation Analysis: Preliminary Formulation and Proof-of-Concept Results

Biqian Cheng, Evangelos E. Papalexakis, Jia Chen

Comments: 4 pages, 7 figures, KDD SoCal symposium 2023 (extended version)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[107] arXiv:2312.00305 (cross-list from stat.ME) [pdf, html, other]

Title: Multiple Testing of Linear Forms for Noisy Matrix Completion

Wanteng Ma, Lilun Du, Dong Xia, Ming Yuan

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[108] arXiv:2312.00359 (cross-list from cs.LG) [pdf, other]

Title: Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training

Yefan Zhou, Tianyu Pang, Keqin Liu, Charles H. Martin, Michael W. Mahoney, Yaoqing Yang

Comments: NeurIPS 2023 Spotlight, first two authors contributed equally

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[109] arXiv:2312.00379 (cross-list from cs.LG) [pdf, html, other]

Title: Optimal Sample Complexity of Contrastive Learning

Noga Alon, Dmitrii Avdiukhin, Dor Elboim, Orr Fischer, Grigory Yaroslavtsev

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[110] arXiv:2312.00396 (cross-list from cs.LG) [pdf, html, other]

Title: GFN-SR: Symbolic Regression with Generative Flow Networks

Sida Li, Ioana Marinescu, Sebastian Musslick

Comments: Accepted by the NeurIPS 2023 AI4Science Workshop

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[111] arXiv:2312.00477 (cross-list from cs.LG) [pdf, html, other]

Title: Interpretable Meta-Learning of Physical Systems

Matthieu Blanke, Marc Lelarge

Journal-ref: The Twelfth International Conference on Learning Representations, ICLR 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[112] arXiv:2312.00509 (cross-list from stat.ME) [pdf, other]

Title: Bayesian causal discovery from unknown general interventions

Alessandro Mascaro, Federico Castelletti

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[113] arXiv:2312.00540 (cross-list from cs.LG) [pdf, html, other]

Title: Target-agnostic Source-free Domain Adaptation for Regression Tasks

Tianlang He, Zhiqiu Xia, Jierun Chen, Haoliang Li, S.-H. Gary Chan

Comments: Accepted by ICDE 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[114] arXiv:2312.00581 (cross-list from cs.LG) [pdf, html, other]

Title: Pathway to a fully data-driven geotechnics: lessons from materials informatics

Stephen Wu, Yu Otake, Yosuke Higo, Ikumasa Yoshida

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[115] arXiv:2312.00616 (cross-list from cs.LG) [pdf, html, other]

Title: Investigating a domain adaptation approach for integrating different measurement instruments in a longitudinal clinical registry

Maren Hackenberg, Michelle Pfaffenlehner, Max Behrens, Astrid Pechmann, Janbernd Kirschner, Harald Binder

Comments: 18 pages, 4 figures

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[116] arXiv:2312.00626 (cross-list from cs.LG) [pdf, html, other]

Title: Forecasting trends in food security with real time data

Joschka Herteux, Christoph Räth, Giulia Martini, Amine Baha, Kyriacos Koupparis, Ilaria Lauzana, Duccio Piovani

Comments: 19 pages, 7 figures + supplementary material

Journal-ref: Commun Earth Environ 5, 611 (2024)

Subjects: Machine Learning (cs.LG); Physics and Society (physics.soc-ph); Machine Learning (stat.ML)

[117] arXiv:2312.00640 (cross-list from math.OC) [pdf, html, other]

Title: One to beat them all: "RYU" -- a unifying framework for the construction of safe balls

Thu-Le Tran, Clément Elvira, Hong-Phuong Dang, Cédric Herzet

Comments: 19 pages, 1 table

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[118] arXiv:2312.00656 (cross-list from cs.LG) [pdf, html, other]

Title: Simple Transferability Estimation for Regression Tasks

Cuong N. Nguyen, Phong Tran, Lam Si Tung Ho, Vu Dinh, Anh T. Tran, Tal Hassner, Cuong V. Nguyen

Comments: Paper published at The 39th Conference on Uncertainty in Artificial Intelligence (UAI) 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[119] arXiv:2312.00710 (cross-list from cs.LG) [pdf, html, other]

Title: SpaCE: The Spatial Confounding Environment

Mauricio Tec, Ana Trisovic, Michelle Audirac, Sophie Woodward, Jie Kate Hu, Naeem Khoshnevis, Francesca Dominici

Journal-ref: Published at ICLR 2024

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[120] arXiv:2312.00761 (cross-list from cs.LG) [pdf, other]

Title: Deep Unlearning: Fast and Efficient Gradient-free Approach to Class Forgetting

Sangamesh Kodge, Gobinda Saha, Kaushik Roy

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[121] arXiv:2312.00852 (cross-list from cs.LG) [pdf, html, other]

Title: Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusion

Litu Rout, Yujia Chen, Abhishek Kumar, Constantine Caramanis, Sanjay Shakkottai, Wen-Sheng Chu

Comments: Preprint

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[122] arXiv:2312.00995 (cross-list from cs.LG) [pdf, html, other]

Title: Second-Order Uncertainty Quantification: A Distance-Based Approach

Yusuf Sale, Viktor Bengs, Michele Caprio, Eyke Hüllermeier

Comments: 16 pages, 2 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[123] arXiv:2312.01127 (cross-list from math.OC) [pdf, html, other]

Title: Symmetric Mean-field Langevin Dynamics for Distributional Minimax Problems

Juno Kim, Kakei Yamamoto, Kazusato Oko, Zhuoran Yang, Taiji Suzuki

Comments: ICLR 2024 spotlight

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[124] arXiv:2312.01167 (cross-list from cs.CV) [pdf, other]

Title: Meta-Learned Attribute Self-Interaction Network for Continual and Generalized Zero-Shot Learning

Vinay K Verma, Nikhil Mehta, Kevin J Liang, Aakansha Mishra, Lawrence Carin

Comments: Accepted in IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024. arXiv admin note: substantial text overlap with arXiv:2102.11856

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[125] arXiv:2312.01187 (cross-list from cs.CV) [pdf, html, other]

Title: SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer

Renan A. Rojas-Gomez, Karan Singhal, Ali Etemad, Alex Bijamov, Warren R. Morningstar, Philip Andrew Mansfield

Comments: Accepted at Transactions on Machine Learning Research (TMLR 2024)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[126] arXiv:2312.01188 (cross-list from cs.LG) [pdf, html, other]

Title: Efficient Expansion and Gradient Based Task Inference for Replay Free Incremental Learning

Soumya Roy, Vinay K Verma, Deepak Gupta

Comments: To be Appeared in WACV, 2024

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[127] arXiv:2312.01210 (cross-list from stat.ME) [pdf, html, other]

Title: When accurate prediction models yield harmful self-fulfilling prophecies

Wouter A.C. van Amsterdam, Nan van Geloven, Jesse H. Krijthe, Rajesh Ranganath, Giovanni Ciná

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[128] arXiv:2312.01238 (cross-list from cs.LG) [pdf, html, other]

Title: A deep learning pipeline for cross-sectional and longitudinal multiview data integration

Sarthak Jain, Sandra E. Safo

Subjects: Machine Learning (cs.LG); Applications (stat.AP); Computation (stat.CO); Methodology (stat.ME); Machine Learning (stat.ML)

[129] arXiv:2312.01260 (cross-list from cs.LG) [pdf, html, other]

Title: Rethinking PGD Attack: Is Sign Function Necessary?

Junjie Yang, Tianlong Chen, Xuxi Chen, Zhangyang Wang, Yingbin Liang

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[130] arXiv:2312.01294 (cross-list from cs.LG) [pdf, html, other]

Title: Deep Ensembles Meets Quantile Regression: Uncertainty-aware Imputation for Time Series

Ying Liu, Peng Cui, Wenbo Hu, Richang Hong

Comments: fix typo

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[131] arXiv:2312.01379 (cross-list from stat.ME) [pdf, html, other]

Title: Relation between PLS and OLS regression in terms of the eigenvalue distribution of the regressor covariance matrix

David del Val (1), José R. Berrendero (1 and 2), Alberto Suárez (1) ((1) Universidad Autónoma de Madrid UAM, (2) Instituto de Ciencias Matemáticas ICMAT)

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[132] arXiv:2312.01386 (cross-list from cs.LG) [pdf, html, other]

Title: Regret Optimality of GP-UCB

Wenjia Wang, Xiaowei Zhang, Lu Zou

Comments: 23 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[133] arXiv:2312.01414 (cross-list from physics.comp-ph) [pdf, html, other]

Title: Predicting Properties of Periodic Systems from Cluster Data: A Case Study of Liquid Water

Viktor Zaverkin, David Holzmüller, Robin Schuldt, Johannes Kästner

Journal-ref: J. Chem. Phys. 156, 114103 (2022)

Subjects: Computational Physics (physics.comp-ph); Materials Science (cond-mat.mtrl-sci); Machine Learning (stat.ML)

[134] arXiv:2312.01415 (cross-list from physics.comp-ph) [pdf, html, other]

Title: Thermally Averaged Magnetic Anisotropy Tensors via Machine Learning Based on Gaussian Moments

Viktor Zaverkin, Julia Netz, Fabian Zills, Andreas Köhn, Johannes Kästner

Journal-ref: J. Chem. Theory Comput. 2022, 18, 1, 1--12

Subjects: Computational Physics (physics.comp-ph); Materials Science (cond-mat.mtrl-sci); Machine Learning (stat.ML)

[135] arXiv:2312.01416 (cross-list from physics.comp-ph) [pdf, html, other]

Title: Uncertainty-biased molecular dynamics for learning uniformly accurate interatomic potentials

Viktor Zaverkin, David Holzmüller, Henrik Christiansen, Federico Errica, Francesco Alesiani, Makoto Takamoto, Mathias Niepert, Johannes Kästner

Journal-ref: npj Comput. Mater. 10, 83 (2024)

Subjects: Computational Physics (physics.comp-ph); Materials Science (cond-mat.mtrl-sci); Machine Learning (stat.ML)

[136] arXiv:2312.01429 (cross-list from cs.LG) [pdf, other]

Title: Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars

Kaiyue Wen, Yuchen Li, Bingbin Liu, Andrej Risteski

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[137] arXiv:2312.01507 (cross-list from cs.LG) [pdf, html, other]

Title: Learn2Extend: Extending sequences by retaining their statistical properties with mixture models

Dimitris Vartziotis, George Dasoulas, Florian Pausinger

Comments: 17 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[138] arXiv:2312.01520 (cross-list from cs.AI) [pdf, html, other]

Title: Entropy and the Kullback-Leibler Divergence for Bayesian Networks: Computational Complexity and Efficient Implementation

Marco Scutari

Comments: 32 pages, 4 figures

Journal-ref: Algorithms (2024), 17(1), 24

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Computation (stat.CO); Machine Learning (stat.ML)

[139] arXiv:2312.01541 (cross-list from cs.LG) [pdf, html, other]

Title: Revisiting Non-separable Binary Classification and its Applications in Anomaly Detection

Matthew Lau, Ismaila Seck, Athanasios P Meliopoulos, Wenke Lee, Eugene Ndiaye

Comments: Accepted in Transactions on Machine Learning Research (TMLR) 2024. Code: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[140] arXiv:2312.01547 (cross-list from cs.DS) [pdf, other]

Title: Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear Regression

Ilias Diakonikolas, Daniel M. Kane, Ankit Pensia, Thanasis Pittas

Comments: To appear in NeurIPS 2023

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[141] arXiv:2312.01577 (cross-list from cs.LG) [pdf, html, other]

Title: RJHMC-Tree for Exploration of the Bayesian Decision Tree Posterior

Jodie A. Cochrane, Adrian G. Wills, Sarah J. Johnson

Comments: 43 pages, 7 figures

Subjects: Machine Learning (cs.LG); Computation (stat.CO); Machine Learning (stat.ML)

[142] arXiv:2312.01634 (cross-list from cs.LG) [pdf, html, other]

Title: Robust Streaming, Sampling, and a Perspective on Online Learning

Evan Dogariu, Jiatong Yu

Subjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Machine Learning (stat.ML)

[143] arXiv:2312.01657 (cross-list from cs.LG) [pdf, html, other]

Title: On Tuning Neural ODE for Stability, Consistency and Faster Convergence

Sheikh Waqas Akhtar

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[144] arXiv:2312.01692 (cross-list from cs.LG) [pdf, html, other]

Title: Risk-Controlling Model Selection via Guided Bayesian Optimization

Bracha Laufer-Goldshtein, Adam Fisch, Regina Barzilay, Tommi Jaakkola

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Methodology (stat.ME); Machine Learning (stat.ML)

[145] arXiv:2312.01881 (cross-list from econ.EM) [pdf, html, other]

Title: Bayesian Nonlinear Regression using Sums of Simple Functions

Florian Huber

Subjects: Econometrics (econ.EM); Machine Learning (stat.ML)

[146] arXiv:2312.01925 (cross-list from stat.ME) [pdf, html, other]

Title: Coefficient Shape Alignment in Multiple Functional Linear Regression

Shuhao Jiao, Ngai-Hang Chan

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[147] arXiv:2312.01939 (cross-list from cs.LG) [pdf, other]

Title: Foundations for Transfer in Reinforcement Learning: A Taxonomy of Knowledge Modalities

Markus Wulfmeier, Arunkumar Byravan, Sarah Bechtle, Karol Hausman, Nicolas Heess

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Robotics (cs.RO); Machine Learning (stat.ML)

[148] arXiv:2312.02027 (cross-list from math.OC) [pdf, other]

Title: Stochastic Optimal Control Matching

Carles Domingo-Enrich, Jiequn Han, Brandon Amos, Joan Bruna, Ricky T. Q. Chen

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Numerical Analysis (math.NA); Probability (math.PR); Machine Learning (stat.ML)

[149] arXiv:2312.02119 (cross-list from cs.LG) [pdf, html, other]

Title: Tree of Attacks: Jailbreaking Black-Box LLMs Automatically

Anay Mehrotra, Manolis Zampetakis, Paul Kassianik, Blaine Nelson, Hyrum Anderson, Yaron Singer, Amin Karbasi

Comments: Accepted for presentation at NeurIPS 2024. Code: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[150] arXiv:2312.02168 (cross-list from cs.CV) [pdf, html, other]

Title: The SVHN Dataset Is Deceptive for Probabilistic Generative Models Due to a Distribution Mismatch

Tim Z. Xiao, Johannes Zenn, Robert Bamler

Comments: Accepted at NeurIPS 2023 Workshop on Distribution Shifts; 4 pages + appendix; proposed data set at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)