Computation and Language

Authors and titles for December 2023

[801] arXiv:2312.03872 (cross-list from cs.CY) [pdf, html, other]

Title: The BigCode Project Governance Card

BigCode collaboration: Sean Hughes, Harm de Vries, Jennifer Robinson, Carlos Muñoz Ferrandis, Loubna Ben Allal, Leandro von Werra, Jennifer Ding, Sebastien Paquet, Yacine Jernite

Comments: 12 pages, related papers arXiv:2305.06161 and arXiv:2301.03988 and arXiv:2211.15533v1, learn more at this https URL

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Programming Languages (cs.PL)

[802] arXiv:2312.03905 (cross-list from cs.LG) [pdf, other]

Title: A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraints

Kareem Ahmed, Kai-Wei Chang, Guy Van den Broeck

Comments: Updated detoxification experiments; moved example toxic generations to Github and added link

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[803] arXiv:2312.04068 (cross-list from cs.CR) [pdf, other]

Title: Making Translators Privacy-aware on the User's Side

Ryoma Sato

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[804] arXiv:2312.04103 (cross-list from cs.AI) [pdf, html, other]

Title: Enhancing the Rationale-Input Alignment for Self-explaining Rationalization

Wei Liu, Haozhao Wang, Jun Wang, Zhiying Deng, YuanKai Zhang, Cheng Wang, Ruixuan Li

Comments: Accept at ICDE 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[805] arXiv:2312.04134 (cross-list from cs.AI) [pdf, other]

Title: Using a Large Language Model to generate a Design Structure Matrix

Edwin C. Y. Koh

Comments: 16 pages, 7 Figures, 6 Tables

Journal-ref: Natural Language Processing Journal, Vol. 9, 2024, Article 100103

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[806] arXiv:2312.04302 (cross-list from cs.CV) [pdf, html, other]

Title: Prompt Highlighter: Interactive Control for Multi-Modal LLMs

Yuechen Zhang, Shengju Qian, Bohao Peng, Shu Liu, Jiaya Jia

Comments: CVPR 2024; Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[807] arXiv:2312.04339 (cross-list from cs.LG) [pdf, html, other]

Title: Merging by Matching Models in Task Parameter Subspaces

Derek Tam, Mohit Bansal, Colin Raffel

Comments: TMLR

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[808] arXiv:2312.04348 (cross-list from cs.CC) [pdf, html, other]

Title: When Input Integers are Given in the Unary Numeral Representation

Tomoyuki Yamakami

Comments: (A4, 10pt, 12 pages, 1 figure) This is a preliminary report of the current work, which has appeared in the Proceedings of the 24th Italian Conference on Theoretical Computer Science (ICTCS 2023), Palermo, Italy, September 13--15, 2023, CEUR Workshop Proceedings (this http URL)

Subjects: Computational Complexity (cs.CC); Computation and Language (cs.CL); Formal Languages and Automata Theory (cs.FL)

[809] arXiv:2312.04469 (cross-list from cs.LG) [pdf, html, other]

Title: On the Learnability of Watermarks for Language Models

Chenchen Gu, Xiang Lisa Li, Percy Liang, Tatsunori Hashimoto

Comments: Accepted at ICLR 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[810] arXiv:2312.04554 (cross-list from cs.CV) [pdf, other]

Title: Improved Visual Grounding through Self-Consistent Explanations

Ruozhen He, Paola Cascante-Bonilla, Ziyan Yang, Alexander C. Berg, Vicente Ordonez

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[811] arXiv:2312.04576 (cross-list from cs.DL) [pdf, other]

Title: The Open Review-Based (ORB) dataset: Towards Automatic Assessment of Scientific Papers and Experiment Proposals in High-Energy Physics

Jaroslaw Szumega, Lamine Bougueroua, Blerina Gkotse, Pierre Jouvelot, Federico Ravotti

Comments: 13 pages, supplementary material included, dataset available

Subjects: Digital Libraries (cs.DL); Computation and Language (cs.CL); Machine Learning (cs.LG); High Energy Physics - Experiment (hep-ex)

[812] arXiv:2312.04578 (cross-list from cs.AI) [pdf, html, other]

Title: Towards a Psychological Generalist AI: A Survey of Current Applications of Large Language Models and Future Prospects

Tianyu He, Guanghui Fu, Yijing Yu, Fan Wang, Jianqiang Li, Qing Zhao, Changwei Song, Hongzhi Qi, Dan Luo, Huijing Zou, Bing Xiang Yang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[813] arXiv:2312.04737 (cross-list from cs.LG) [pdf, html, other]

Title: Efficient End-to-end Language Model Fine-tuning on Graphs

Rui Xue, Xipeng Shen, Ruozhou Yu, Xiaorui Liu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[814] arXiv:2312.04746 (cross-list from cs.CV) [pdf, html, other]

Title: Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videos

Mehmet Saygin Seyfioglu, Wisdom O. Ikezogwo, Fatemeh Ghezloo, Ranjay Krishna, Linda Shapiro

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[815] arXiv:2312.04748 (cross-list from cs.CR) [pdf, html, other]

Title: Forcing Generative Models to Degenerate Ones: The Power of Data Poisoning Attacks

Shuli Jiang, Swanand Ravindra Kadhe, Yi Zhou, Ling Cai, Nathalie Baracaldo

Comments: 19 pages, 6 figures. Published at NeurIPS 2023 Workshop on Backdoors in Deep Learning: The Good, the Bad, and the Ugly

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[816] arXiv:2312.04804 (cross-list from cs.CY) [pdf, html, other]

Title: Hate Cannot Drive out Hate: Forecasting Conversation Incivility following Replies to Hate Speech

Xinchen Yu, Eduardo Blanco, Lingzi Hong

Comments: The 18th International AAAI Conference on Web and Social Media (ICWSM 2024) Accepted

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[817] arXiv:2312.04837 (cross-list from cs.AI) [pdf, other]

Title: Localized Symbolic Knowledge Distillation for Visual Commonsense Models

Jae Sung Park, Jack Hessel, Khyathi Raghavi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Youngjae Yu, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi

Comments: Neurips 2023

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[818] arXiv:2312.04889 (cross-list from cs.AI) [pdf, other]

Title: KwaiAgents: Generalized Information-seeking Agent System with Large Language Models

Haojie Pan, Zepeng Zhai, Hao Yuan, Yaojia Lv, Ruiji Fu, Ming Liu, Zhongyuan Wang, Bing Qin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[819] arXiv:2312.04965 (cross-list from cs.CV) [pdf, other]

Title: Inversion-Free Image Editing with Natural Language

Sihan Xu, Yidong Huang, Jiayi Pan, Ziqiao Ma, Joyce Chai

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[820] arXiv:2312.05209 (cross-list from cs.AI) [pdf, html, other]

Title: HALO: An Ontology for Representing and Categorizing Hallucinations in Large Language Models

Navapat Nananukul, Mayank Kejriwal

Comments: This paper has been accepted and orally presented in "SPIE Defense + Commercial Sensing (DCS 2024)" in National Harbor, Maryland, April 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[821] arXiv:2312.05230 (cross-list from cs.AI) [pdf, html, other]

Title: Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning

Zhiting Hu, Tianmin Shu

Comments: Position paper. Accompanying NeurIPS2023 Tutorial: this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)

[822] arXiv:2312.05291 (cross-list from cs.CV) [pdf, html, other]

Title: GlitchBench: Can large multimodal models detect video game glitches?

Mohammad Reza Taesiri, Tianjun Feng, Anh Nguyen, Cor-Paul Bezemer

Comments: CVPR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[823] arXiv:2312.05356 (cross-list from cs.SE) [pdf, other]

Title: Neuron Patching: Semantic-based Neuron-level Language Model Repair for Code Generation

Jian Gu, Aldeida Aleti, Chunyang Chen, Hongyu Zhang

Comments: 13 pages, 7 figures, 7 tables, under peer-review

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[824] arXiv:2312.05415 (cross-list from cs.SD) [pdf, html, other]

Title: An Experimental Study: Assessing the Combined Framework of WavLM and BEST-RQ for Text-to-Speech Synthesis

Via Nielson, Steven Hillis

Comments: 8 pages, 1 figure, 4 tables

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[825] arXiv:2312.05488 (cross-list from cs.AI) [pdf, html, other]

Title: Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysis

Caoyun Fan, Jindou Chen, Yaohui Jin, Hao He

Comments: AAAI 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT)

[826] arXiv:2312.05640 (cross-list from cs.SD) [pdf, html, other]

Title: Keyword spotting -- Detecting commands in speech using deep learning

Sumedha Rai, Tong Li, Bella Lyu

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[827] arXiv:2312.05677 (cross-list from cs.LG) [pdf, html, other]

Title: Batched Low-Rank Adaptation of Foundation Models

Yeming Wen, Swarat Chaudhuri

Comments: 16 pages, 3 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[828] arXiv:2312.05688 (cross-list from cs.DL) [pdf, html, other]

Title: NLLG Quarterly arXiv Report 09/23: What are the most influential current AI Papers?

Ran Zhang, Aida Kostikova, Christoph Leiter, Jonas Belouadi, Daniil Larionov, Yanran Chen, Vivian Fresen, Steffen Eger

Subjects: Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG)

[829] arXiv:2312.05693 (cross-list from cs.LG) [pdf, html, other]

Title: Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge

Xuan Shen, Peiyan Dong, Lei Lu, Zhenglun Kong, Zhengang Li, Ming Lin, Chao Wu, Yanzhi Wang

Comments: Accepted by AAAI 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[830] arXiv:2312.05720 (cross-list from cs.LG) [pdf, html, other]

Title: Beyond Gradient and Priors in Privacy Attacks: Leveraging Pooler Layer Inputs of Language Models in Federated Learning

Jianwei Li, Sheng Liu, Qi Lei

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[831] arXiv:2312.05842 (cross-list from cs.AI) [pdf, html, other]

Title: Mutual Enhancement of Large and Small Language Models with Cross-Silo Knowledge Transfer

Yongheng Deng, Ziqing Qiao, Ju Ren, Yang Liu, Yaoxue Zhang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[832] arXiv:2312.05934 (cross-list from cs.AI) [pdf, html, other]

Title: Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs

Oded Ovadia, Menachem Brief, Moshik Mishaeli, Oren Elisha

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[833] arXiv:2312.05964 (cross-list from cs.LG) [pdf, html, other]

Title: ConSequence: Synthesizing Logically Constrained Sequences for Electronic Health Record Generation

Brandon Theodorou, Shrusti Jain, Cao Xiao, Jimeng Sun

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[834] arXiv:2312.06056 (cross-list from cs.SE) [pdf, html, other]

Title: METAL: Metamorphic Testing Framework for Analyzing Large-Language Model Qualities

Sangwon Hyun, Mingyu Guo, M. Ali Babar

Comments: Accepted to International Conference on Software Testing, Verification and Validation (ICST) 2024 / Key words: Large-language models, Metamorphic testing, Quality evaluation, Text perturbations

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[835] arXiv:2312.06224 (cross-list from cs.CV) [pdf, html, other]

Title: Medical Vision Language Pretraining: A survey

Prashant Shrestha, Sanskar Amgain, Bidur Khanal, Cristian A. Linte, Binod Bhattarai

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[836] arXiv:2312.06236 (cross-list from cs.LG) [pdf, html, other]

Title: Improving Startup Success with Text Analysis

Emily Gavrilenko, Foaad Khosmood, Mahdi Rastad, Sadra Amiri Moghaddam

Comments: 9 pages. Accepted and presented at ICAIF 2023: ACM International Conference on AI in Finance, Workshop on NLP and Network Analysis, Nov. 27, 2023

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[837] arXiv:2312.06337 (cross-list from cs.SD) [pdf, html, other]

Title: Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations

Tao Meng, Yuntao Shou, Wei Ai, Nan Yin, Keqin Li

Comments: 16 pages, 9 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[838] arXiv:2312.06351 (cross-list from cs.CV) [pdf, html, other]

Title: Evaluation of Large Language Models for Decision Making in Autonomous Driving

Kotaro Tanahashi, Yuichi Inoue, Yu Yamaguchi, Hidetatsu Yaginuma, Daiki Shiotsuka, Hiroyuki Shimatani, Kohei Iwamasa, Yoshiaki Inoue, Takafumi Yamaguchi, Koki Igari, Tsukasa Horinouchi, Kento Tokuhiro, Yugo Tokuchi, Shunsuke Aoki

Comments: Accepted at the 2023 Symposium on Machine Learning for Autonomous Driving collocated with NeurIPS

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Robotics (cs.RO)

[839] arXiv:2312.06352 (cross-list from cs.CV) [pdf, html, other]

Title: NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup Annotations

Yuichi Inoue, Yuki Yada, Kotaro Tanahashi, Yu Yamaguchi

Comments: Accepted at LLVM-AD Workshop @ WACV 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[840] arXiv:2312.06363 (cross-list from cs.AI) [pdf, html, other]

Title: MMICT: Boosting Multi-Modal Fine-Tuning with In-Context Examples

Tao Chen, Enwei Zhang, Yuting Gao, Ke Li, Xing Sun, Yan Zhang, Hui Li, Rongrong Ji

Comments: TOMM 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[841] arXiv:2312.06457 (cross-list from cs.AI) [pdf, html, other]

Title: Large Language Models with Retrieval-Augmented Generation for Zero-Shot Disease Phenotyping

Will E. Thompson, David M. Vidmar, Jessica K. De Freitas, John M. Pfeifer, Brandon K. Fornwalt, Ruijun Chen, Gabriel Altay, Kabir Manghnani, Andrew C. Nelsen, Kellie Morland, Martin C. Stumpe, Riccardo Miotto

Comments: Deep Generative Models for Health Workshop NeurIPS 2023

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[842] arXiv:2312.06635 (cross-list from cs.LG) [pdf, other]

Title: Gated Linear Attention Transformers with Hardware-Efficient Training

Songlin Yang, Bailin Wang, Yikang Shen, Rameswar Panda, Yoon Kim

Comments: minor update

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[843] arXiv:2312.06652 (cross-list from cs.AI) [pdf, html, other]

Title: Building Domain-Specific LLMs Faithful To The Islamic Worldview: Mirage or Technical Possibility?

Shabaz Patel, Hassan Kane, Rayhan Patel

Comments: Accepted for Muslims in ML workshop at the 37th Conference on Neural Information Processing Systems (NeurIPS 2023)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[844] arXiv:2312.06677 (cross-list from cs.LG) [pdf, html, other]

Title: Intelligent Virtual Assistants with LLM-based Process Automation

Yanchu Guan, Dong Wang, Zhixuan Chu, Shiyu Wang, Feiyue Ni, Ruihua Song, Longfei Li, Jinjie Gu, Chenyi Zhuang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[845] arXiv:2312.06722 (cross-list from cs.CV) [pdf, html, other]

Title: EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning

Yi Chen, Yuying Ge, Yixiao Ge, Mingyu Ding, Bohao Li, Rui Wang, Ruifeng Xu, Ying Shan, Xihui Liu

Comments: Project released at: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Robotics (cs.RO)

[846] arXiv:2312.06742 (cross-list from cs.CV) [pdf, html, other]

Title: Honeybee: Locality-enhanced Projector for Multimodal LLM

Junbum Cha, Wooyoung Kang, Jonghwan Mun, Byungseok Roh

Comments: CVPR 2024 camera-ready

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[847] arXiv:2312.06798 (cross-list from cs.AI) [pdf, html, other]

Title: Building Trustworthy NeuroSymbolic AI Systems: Consistency, Reliability, Explainability, and Safety

Manas Gaur, Amit Sheth

Comments: To Appear in AAAI AI Magazine. 15 pages, 7 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[848] arXiv:2312.06820 (cross-list from cs.AI) [pdf, html, other]

Title: Extracting Self-Consistent Causal Insights from Users Feedback with LLMs and In-context Learning

Sara Abdali, Anjali Parikh, Steve Lim, Emre Kiciman

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Methodology (stat.ME)

[849] arXiv:2312.06825 (cross-list from cs.RO) [pdf, other]

Title: Utilization of Non-verbal Behaviour and Social Gaze in Classroom Human-Robot Interaction Communications

Sahand Shaghaghi, Pourya Aliasghari, Bryan Tripp, Kerstin Dautenhahn, Chrystopher Nehaniv

Comments: In WTF Workshop Proceedings (arXiv:2401.04108) held in conjunction with the ACM conference on Conversational User Interfaces (CUI), 19 - 21/07 2023, in Eindhoven, The Netherlands

Subjects: Robotics (cs.RO); Computation and Language (cs.CL)

[850] arXiv:2312.06855 (cross-list from cs.LG) [pdf, html, other]

Title: Multimodal Pretraining of Medical Time Series and Notes

Ryan King, Tianbao Yang, Bobak Mortazavi

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)