Machine Learning

Authors and titles for October 2024

[151] arXiv:2410.01709 [pdf, html, other]

Title: Meta-TTT: A Meta-learning Minimax Framework For Test-Time Training

Chen Tao, Li Shen, Soumik Mondal

Comments: 10 pages, 7 tables, 1 figure

Subjects: Machine Learning (cs.LG)

[152] arXiv:2410.01727 [pdf, html, other]

Title: Automated Knowledge Concept Annotation and Question Representation Learning for Knowledge Tracing

Yilmazcan Ozyurt, Stefan Feuerriegel, Mrinmaya Sachan

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[153] arXiv:2410.01729 [pdf, other]

Title: Evaluating Robustness of Reward Models for Mathematical Reasoning

Sunghwan Kim, Dongjin Kang, Taeyoon Kwon, Hyungjoo Chae, Jungsoo Won, Dongha Lee, Jinyoung Yeo

Comments: Work in progress

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[154] arXiv:2410.01745 [pdf, html, other]

Title: PreND: Enhancing Intrinsic Motivation in Reinforcement Learning through Pre-trained Network Distillation

Mohammadamin Davoodabadi, Negin Hashemi Dijujin, Mahdieh Soleymani Baghshah

Comments: 8 pages, 4 figures

Subjects: Machine Learning (cs.LG)

[155] arXiv:2410.01746 [pdf, html, other]

Title: Leray-Schauder Mappings for Operator Learning

Emanuele Zappala

Comments: 13 pages, 2 figures, 1 table. Comments are welcome! v2: Theoretical analysis expanded, several explanations regarding the experiments have been added for improved clarity

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA)

[156] arXiv:2410.01748 [pdf, html, other]

Title: Not All LLM Reasoners Are Created Equal

Arian Hosseini, Alessandro Sordoni, Daniel Toyama, Aaron Courville, Rishabh Agarwal

Subjects: Machine Learning (cs.LG)

[157] arXiv:2410.01752 [pdf, html, other]

Title: TorchSISSO: A PyTorch-Based Implementation of the Sure Independence Screening and Sparsifying Operator for Efficient and Interpretable Model Discovery

Madhav Muthyala, Farshud Sorourifar, Joel A. Paulson

Journal-ref: Digital Chemical Engineering, 13, 2024, 100198

Subjects: Machine Learning (cs.LG)

[158] arXiv:2410.01767 [pdf, html, other]

Title: Utility-Directed Conformal Prediction: A Decision-Aware Framework for Actionable Uncertainty Quantification

Santiago Cortes-Gomez, Carlos Patiño, Yewon Byun, Steven Wu, Eric Horvitz, Bryan Wilder

Subjects: Machine Learning (cs.LG)

[159] arXiv:2410.01770 [pdf, html, other]

Title: Explainable Earth Surface Forecasting under Extreme Events

Oscar J. Pellicer-Valero, Miguel-Ángel Fernández-Torres, Chaonan Ji, Miguel D. Mahecha, Gustau Camps-Valls

Subjects: Machine Learning (cs.LG)

[160] arXiv:2410.01771 [pdf, html, other]

Title: Bayesian Binary Search

Vikash Singh, Matthew Khanzadeh, Vincent Davis, Harrison Rush, Emanuele Rossi, Jesse Shrader, Pietro Lio

Subjects: Machine Learning (cs.LG)

[161] arXiv:2410.01774 [pdf, html, other]

Title: Trained Transformer Classifiers Generalize and Exhibit Benign Overfitting In-Context

Spencer Frei, Gal Vardi

Comments: 36 pages; added experiments

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[162] arXiv:2410.01778 [pdf, html, other]

Title: TopER: Topological Embeddings in Graph Representation Learning

Astrit Tola, Funmilola Mary Taiwo, Cuneyt Gurcan Akcora, Baris Coskunuzer

Comments: 17 pages, 7 figures

Subjects: Machine Learning (cs.LG); Algebraic Topology (math.AT)

[163] arXiv:2410.01779 [pdf, html, other]

Title: Composing Global Optimizers to Reasoning Tasks via Algebraic Objects in Neural Nets

Yuandong Tian

Comments: Update presentation and add more lemmas for necessary conditions

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Commutative Algebra (math.AC); Rings and Algebras (math.RA)

[164] arXiv:2410.01786 [pdf, html, other]

Title: Learning To Solve Differential Equation Constrained Optimization Problems

Vincenzo Di Vito, Mostafa Mohammadian, Kyri Baker, Ferdinando Fioretto

Subjects: Machine Learning (cs.LG)

[165] arXiv:2410.01789 [pdf, html, other]

Title: Investigating on RLHF methodology

Alexey Kutalev, Sergei Markoff

Comments: 23 pages, 6 figures, 6 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[166] arXiv:2410.01795 [pdf, html, other]

Title: Knowledge-Driven Feature Selection and Engineering for Genotype Data with Large Language Models

Joseph Lee, Shu Yang, Jae Young Baik, Xiaoxi Liu, Zhen Tan, Dawei Li, Zixuan Wen, Bojian Hou, Duy Duong-Tran, Tianlong Chen, Li Shen

Comments: accepted by AMIA-IS'25: AMIA Informatics Summit [Marco Ramoni Distinguished Paper Award for Translational Bioinformatics]

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Genomics (q-bio.GN)

[167] arXiv:2410.01796 [pdf, html, other]

Title: Bellman Diffusion: Generative Modeling as Learning a Linear Operator in the Distribution Space

Yangming Li, Chieh-Hsin Lai, Carola-Bibiane Schönlieb, Yuki Mitsufuji, Stefano Ermon

Comments: Paper under review

Subjects: Machine Learning (cs.LG)

[168] arXiv:2410.01802 [pdf, html, other]

Title: PROXI: Challenging the GNNs for Link Prediction

Astrit Tola, Jack Myrick, Baris Coskunuzer

Subjects: Machine Learning (cs.LG); Computational Geometry (cs.CG)

[169] arXiv:2410.01803 [pdf, html, other]

Title: On the expressiveness and spectral bias of KANs

Yixuan Wang, Jonathan W. Siegel, Ziming Liu, Thomas Y. Hou

Comments: 20 pages, 7 figures

Journal-ref: ICLR 2025

Subjects: Machine Learning (cs.LG)

[170] arXiv:2410.01847 [pdf, html, other]

Title: Bayes-CATSI: A variational Bayesian deep learning framework for medical time series data imputation

Omkar Kulkarni, Rohitash Chandra

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[171] arXiv:2410.01850 [pdf, other]

Title: An Early-Stage Workflow Proposal for the Generation of Safe and Dependable AI Classifiers

Hans Dermot Doran, Suzana Veljanovska

Comments: 43rd International Conference on Computer Safety, Reliability and Security (SafeComp2024), Florence, Italy, September 17-20.2024

Subjects: Machine Learning (cs.LG)

[172] arXiv:2410.01855 [pdf, html, other]

Title: Explainable Diagnosis Prediction through Neuro-Symbolic Integration

Qiuhao Lu, Rui Li, Elham Sagheb, Andrew Wen, Jinlian Wang, Liwei Wang, Jungwei W. Fan, Hongfang Liu

Comments: Proceedings of AMIA Informatics Summit 2025

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[173] arXiv:2410.01857 [pdf, html, other]

Title: Learning the Optimal Path and DNN Partition for Collaborative Edge Inference

Yin Huang, Letian Zhang, Jie Xu

Comments: 15 pages, 15 figures, submitted to IEEE journals for possible publication

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[174] arXiv:2410.01866 [pdf, html, other]

Title: House of Cards: Massive Weights in LLMs

Jaehoon Oh, Seungjun Shin, Dokwan Oh

Comments: Under review

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[175] arXiv:2410.01870 [pdf, html, other]

Title: NEAT: Nonlinear Parameter-efficient Adaptation of Pre-trained Models

Yibo Zhong, Haoxiang Jiang, Lincan Li, Ryumei Nakada, Tianci Liu, Linjun Zhang, Huaxiu Yao, Haoyu Wang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[176] arXiv:2410.01888 [pdf, html, other]

Title: Conformal Prediction Sets Can Cause Disparate Impact

Jesse C. Cresswell, Bhargava Kumar, Yi Sui, Mouloud Belbahri

Comments: ICLR 2025 Spotlight, this https URL. Code and experimental data are available at this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[177] arXiv:2410.01910 [pdf, html, other]

Title: Is uniform expressivity too restrictive? Towards efficient expressivity of graph neural networks

Sammy Khalife, Josué Tonelli-Cueto

Subjects: Machine Learning (cs.LG); Computational Complexity (cs.CC); Logic in Computer Science (cs.LO)

[178] arXiv:2410.01917 [pdf, html, other]

Title: Provably Accurate Shapley Value Estimation via Leverage Score Sampling

Christopher Musco, R. Teal Witter

Comments: Accepted to ICLR 2025

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[179] arXiv:2410.01920 [pdf, html, other]

Title: Step-by-Step Reasoning for Math Problems via Twisted Sequential Monte Carlo

Shengyu Feng, Xiang Kong, Shuang Ma, Aonan Zhang, Dong Yin, Chong Wang, Ruoming Pang, Yiming Yang

Comments: ICLR 2025

Subjects: Machine Learning (cs.LG)

[180] arXiv:2410.01922 [pdf, html, other]

Title: NTK-DFL: Enhancing Decentralized Federated Learning in Heterogeneous Settings via Neural Tangent Kernel

Gabriel Thompson, Kai Yue, Chau-Wai Wong, Huaiyu Dai

Subjects: Machine Learning (cs.LG)

[181] arXiv:2410.01926 [pdf, html, other]

Title: MARPLE: A Benchmark for Long-Horizon Inference

Emily Jin, Zhuoyi Huang, Jan-Philipp Fränken, Weiyu Liu, Hannah Cha, Erik Brockbank, Sarah Wu, Ruohan Zhang, Jiajun Wu, Tobias Gerstenberg

Comments: NeurIPS 2024. First two authors contributed equally. Project page: this https URL

Subjects: Machine Learning (cs.LG)

[182] arXiv:2410.01930 [pdf, html, other]

Title: Don't flatten, tokenize! Unlocking the key to SoftMoE's efficacy in deep RL

Ghada Sokar, Johan Obando-Ceron, Aaron Courville, Hugo Larochelle, Pablo Samuel Castro

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[183] arXiv:2410.01933 [pdf, html, other]

Title: TAEGAN: Generating Synthetic Tabular Data For Data Augmentation

Jiayu Li, Zilong Zhao, Kevin Yee, Uzair Javaid, Biplab Sikdar

Subjects: Machine Learning (cs.LG)

[184] arXiv:2410.01943 [pdf, html, other]

Title: CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQL

Mohammadreza Pourreza, Hailong Li, Ruoxi Sun, Yeounoh Chung, Shayan Talaei, Gaurav Tarlok Kakkar, Yu Gan, Amin Saberi, Fatma Ozcan, Sercan O. Arik

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)

[185] arXiv:2410.01949 [pdf, html, other]

Title: Discrete Copula Diffusion

Anji Liu, Oliver Broadrick, Mathias Niepert, Guy Van den Broeck

Subjects: Machine Learning (cs.LG)

[186] arXiv:2410.01950 [pdf, html, other]

Title: Score-based Pullback Riemannian Geometry: Extracting the Data Manifold Geometry using Anisotropic Flows

Willem Diepeveen, Georgios Batzolis, Zakhar Shumaylov, Carola-Bibiane Schönlieb

Subjects: Machine Learning (cs.LG); Differential Geometry (math.DG); Machine Learning (stat.ML)

[187] arXiv:2410.01954 [pdf, html, other]

Title: ComaDICE: Offline Cooperative Multi-Agent Reinforcement Learning with Stationary Distribution Shift Regularization

The Viet Bui, Thanh Hong Nguyen, Tien Mai

Subjects: Machine Learning (cs.LG); Multiagent Systems (cs.MA)

[188] arXiv:2410.01959 [pdf, html, other]

Title: Scale-Invariant Learning-to-Rank

Alessio Petrozziello, Christian Sommeregger, Ye-Sheen Lim

Subjects: Machine Learning (cs.LG)

[189] arXiv:2410.01969 [pdf, html, other]

Title: Which Algorithms Have Tight Generalization Bounds?

Michael Gastpar, Ido Nachum, Jonathan Shafer, Thomas Weinberger

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[190] arXiv:2410.01990 [pdf, html, other]

Title: Deep Learning Alternatives of the Kolmogorov Superposition Theorem

Leonardo Ferreira Guilhoto, Paris Perdikaris

Subjects: Machine Learning (cs.LG); Computational Engineering, Finance, and Science (cs.CE)

[191] arXiv:2410.02005 [pdf, html, other]

Title: FairlyUncertain: A Comprehensive Benchmark of Uncertainty in Algorithmic Fairness

Lucas Rosenblatt, R. Teal Witter

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[192] arXiv:2410.02006 [pdf, html, other]

Title: Addressing Data Heterogeneity in Federated Learning with Adaptive Normalization-Free Feature Recalibration

Vasilis Siomos, Sergio Naval-Marimont, Jonathan Passerat-Palmbach, Giacomo Tarroni

Comments: 10 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[193] arXiv:2410.02016 [pdf, html, other]

Title: Adaptively Private Next-Token Prediction of Large Language Models

James Flemings, Meisam Razaviyayn, Murali Annavaram

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR)

[194] arXiv:2410.02017 [pdf, html, other]

Title: Review Non-convex Optimization Method for Machine Learning

Greg B Fotopoulos, Paul Popovich, Nicholas Hall Papadopoulos

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[195] arXiv:2410.02023 [pdf, html, other]

Title: DeepProtein: Deep Learning Library and Benchmark for Protein Sequence Learning

Jiaqing Xie, Tianfan Fu

Comments: Accepted by Bioinformatics

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Quantitative Methods (q-bio.QM)

[196] arXiv:2410.02033 [pdf, html, other]

Title: Model Comparisons: XNet Outperforms KAN

Xin Li, Zhihong Jeff Xia, Xiaotao Zheng

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[197] arXiv:2410.02035 [pdf, html, other]

Title: Tuning Frequency Bias of State Space Models

Annan Yu, Dongwei Lyu, Soon Hoe Lim, Michael W. Mahoney, N. Benjamin Erichson

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[198] arXiv:2410.02038 [pdf, html, other]

Title: Realizable Continuous-Space Shields for Safe Reinforcement Learning

Kyungmin Kim, Davide Corsi, Andoni Rodriguez, JB Lanier, Benjami Parellada, Pierre Baldi, Cesar Sanchez, Roy Fox

Comments: Kim, Corsi, and Rodriguez contributed equally

Subjects: Machine Learning (cs.LG)

[199] arXiv:2410.02042 [pdf, html, other]

Title: EAB-FL: Exacerbating Algorithmic Bias through Model Poisoning Attacks in Federated Learning

Syed Irfan Ali Meerza, Jian Liu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)

[200] arXiv:2410.02062 [pdf, html, other]

Title: TPP-LLM: Modeling Temporal Point Processes by Efficiently Fine-Tuning Large Language Models

Zefang Liu, Yinzhu Quan

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)