Computation and Language

Authors and titles for December 2023

[851] arXiv:2312.06861 (cross-list from cs.CY) [pdf, html, other]

Title: Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates

Aida Davani, Mark Díaz, Dylan Baker, Vinodkumar Prabhakaran

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[852] arXiv:2312.06874 (cross-list from cs.LG) [pdf, html, other]

Title: Sparse Transformer with Local and Seasonal Adaptation for Multivariate Time Series Forecasting

Yifan Zhang, Rui Wu, Sergiu M. Dascalu, Frederick C. Harris Jr

Journal-ref: Sci Rep 14, 15909 (2024)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[853] arXiv:2312.06881 (cross-list from cs.LG) [pdf, other]

Title: DYAD: A Descriptive Yet Abjuring Density efficient approximation to linear neural network layers

Sarin Chandy, Varun Gangal, Yi Yang, Gabriel Maggiotti

Comments: Accepted at WANT workshop at NeurIPS 2023; code at this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[854] arXiv:2312.06950 (cross-list from cs.CV) [pdf, html, other]

Title: READ: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Video-Language Modeling

Thong Nguyen, Xiaobao Wu, Xinshuai Dong, Khoi Le, Zhiyuan Hu, Cong-Duy Nguyen, See-Kiong Ng, Luu Anh Tuan

Comments: Accepted at AAAI 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[855] arXiv:2312.07046 (cross-list from cs.LG) [pdf, html, other]

Title: Rethinking Compression: Reduced Order Modelling of Latent Features in Large Language Models

Arnav Chavan, Nahush Lele, Deepak Gupta

Comments: Brief technical report; Code will be made available at this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[856] arXiv:2312.07395 (cross-list from cs.CV) [pdf, html, other]

Title: A Simple Recipe for Contrastively Pre-training Video-First Encoders Beyond 16 Frames

Pinelopi Papalampidi, Skanda Koppula, Shreya Pathak, Justin Chiu, Joe Heyward, Viorica Patraucean, Jiajun Shen, Antoine Miech, Andrew Zisserman, Aida Nematzadeh

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[857] arXiv:2312.07398 (cross-list from cs.AI) [pdf, html, other]

Title: LLMEval: A Preliminary Study on How to Evaluate Large Language Models

Yue Zhang, Ming Zhang, Haipeng Yuan, Shichun Liu, Yongyao Shi, Tao Gui, Qi Zhang, Xuanjing Huang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[858] arXiv:2312.07435 (cross-list from cs.CV) [pdf, html, other]

Title: Cross-modal Contrastive Learning with Asymmetric Co-attention Network for Video Moment Retrieval

Love Panta, Prashant Shrestha, Brabeem Sapkota, Amrita Bhattarai, Suresh Manandhar, Anand Kumar Sah

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[859] arXiv:2312.07532 (cross-list from cs.CV) [pdf, html, other]

Title: Interfacing Foundation Models' Embeddings

Xueyan Zou, Linjie Li, Jianfeng Wang, Jianwei Yang, Mingyu Ding, Junyi Wei, Zhengyuan Yang, Feng Li, Hao Zhang, Shilong Liu, Arul Aravinthan, Yong Jae Lee, Lijuan Wang

Comments: CODE: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[860] arXiv:2312.07540 (cross-list from cs.AI) [pdf, html, other]

Title: diff History for Neural Language Agents

Ulyana Piterbarg, Lerrel Pinto, Rob Fergus

Comments: ICML 2024 version

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[861] arXiv:2312.07550 (cross-list from cs.CV) [pdf, html, other]

Title: Understanding (Un)Intended Memorization in Text-to-Image Generative Models

Ali Naseh, Jaechul Roh, Amir Houmansadr

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[862] arXiv:2312.07553 (cross-list from cs.AI) [pdf, html, other]

Title: Hijacking Context in Large Multi-modal Models

Joonhyun Jeong

Comments: Technical Report. Preprint

Journal-ref: ICLR 2024 Workshop on Reliable and Responsible Foundation Models

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[863] arXiv:2312.07661 (cross-list from cs.CV) [pdf, html, other]

Title: CLIP as RNN: Segment Countless Visual Concepts without Training Endeavor

Shuyang Sun, Runjia Li, Philip Torr, Xiuye Gu, Siyang Li

Comments: To appear in CVPR 2024. Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[864] arXiv:2312.07743 (cross-list from cs.LG) [pdf, html, other]

Title: FULL-W2V: Fully Exploiting Data Reuse for W2V on GPU-Accelerated Systems

Thomas Randall, Tyler Allen, Rong Ge

Comments: 12 pages, 7 figures, 7 tables, the definitive version of this work is published in the Proceedings of the ACM International Conference on Supercomputing 2021, available at this https URL

Journal-ref: Proceedings of the ACM International Conference on Supercomputing (2021) 455-466

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[865] arXiv:2312.07796 (cross-list from cs.IR) [pdf, other]

Title: Harnessing Retrieval-Augmented Generation (RAG) for Uncovering Knowledge Gaps

Joan Figuerola Hurtado

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[866] arXiv:2312.07867 (cross-list from cs.AI) [pdf, html, other]

Title: BESTMVQA: A Benchmark Evaluation System for Medical Visual Question Answering

Xiaojie Hong, Zixin Song, Liangzhi Li, Xiaoli Wang, Feiyan Liu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[867] arXiv:2312.07886 (cross-list from cs.AI) [pdf, html, other]

Title: Modality Plug-and-Play: Elastic Modality Adaptation in Multimodal LLMs for Embodied AI

Kai Huang, Boyuan Yang, Wei Gao

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[868] arXiv:2312.07910 (cross-list from cs.AI) [pdf, html, other]

Title: PromptBench: A Unified Library for Evaluation of Large Language Models

Kaijie Zhu, Qinlin Zhao, Hao Chen, Jindong Wang, Xing Xie

Comments: Accepted by Journal of Machine Learning Research (JMLR); code: this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[869] arXiv:2312.07930 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Optimal Statistical Watermarking

Baihe Huang, Hanlin Zhu, Banghua Zhu, Kannan Ramchandran, Michael I. Jordan, Jason D. Lee, Jiantao Jiao

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Information Theory (cs.IT); Machine Learning (stat.ML)

[870] arXiv:2312.07950 (cross-list from cs.LG) [pdf, html, other]

Title: CBQ: Cross-Block Quantization for Large Language Models

Xin Ding, Xiaoyu Liu, Zhijun Tu, Yun Zhang, Wei Li, Jie Hu, Hanting Chen, Yehui Tang, Zhiwei Xiong, Baoqun Yin, Yunhe Wang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[871] arXiv:2312.07987 (cross-list from cs.LG) [pdf, html, other]

Title: SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention

Róbert Csordás, Piotr Piękos, Kazuki Irie, Jürgen Schmidhuber

Comments: Accepted to NeurIPS 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)

[872] arXiv:2312.08063 (cross-list from cs.LG) [pdf, html, other]

Title: Estimation of Concept Explanations Should be Uncertainty Aware

Vihari Piratla, Juyeon Heo, Katherine M. Collins, Sukriti Singh, Adrian Weller

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[873] arXiv:2312.08078 (cross-list from cs.CV) [pdf, html, other]

Title: Fine-Grained Image-Text Alignment in Medical Imaging Enables Explainable Cyclic Image-Report Generation

Wenting Chen, Linlin Shen, Jingyang Lin, Jiebo Luo, Xiang Li, Yixuan Yuan

Comments: Accepted by ACL 2024

Journal-ref: https://aclanthology.org/2024.acl-long.514/

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[874] arXiv:2312.08388 (cross-list from cs.SI) [pdf, html, other]

Title: Exploring Graph Based Approaches for Author Name Disambiguation

Chetanya Rastogi, Prabhat Agarwal, Shreya Singh

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[875] arXiv:2312.08566 (cross-list from cs.AI) [pdf, html, other]

Title: Learning adaptive planning representations with natural language guidance

Lionel Wong, Jiayuan Mao, Pratyusha Sharma, Zachary S. Siegel, Jiahai Feng, Noa Korneev, Joshua B. Tenenbaum, Jacob Andreas

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[876] arXiv:2312.08676 (cross-list from cs.SD) [pdf, other]

Title: SEF-VC: Speaker Embedding Free Zero-Shot Voice Conversion with Cross Attention

Junjie Li, Yiwei Guo, Xie Chen, Kai Yu

Comments: 5 pages, 2 figures, accepted to ICASSP 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[877] arXiv:2312.08725 (cross-list from cs.LG) [pdf, html, other]

Title: A Comparative Analysis of Fine-Tuned LLMs and Few-Shot Learning of LLMs for Financial Sentiment Analysis

Sorouralsadat Fatemi, Yuheng Hu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[878] arXiv:2312.08793 (cross-list from cs.LG) [pdf, html, other]

Title: Forbidden Facts: An Investigation of Competing Objectives in Llama-2

Tony T. Wang, Miles Wang, Kaivalya Hariharan, Nir Shavit

Comments: Accepted to the ATTRIB and SoLaR workshops at NeurIPS 2023; (v3: clarified experimental details)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[879] arXiv:2312.08846 (cross-list from cs.LG) [pdf, html, other]

Title: TiMix: Text-aware Image Mixing for Effective Vision-Language Pre-training

Chaoya Jiang, Wei ye, Haiyang Xu, Qinghao Ye, Ming Yan, Ji Zhang, Shikun Zhang

Comments: Accepted on AAAI2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[880] arXiv:2312.08865 (cross-list from cs.CV) [pdf, html, other]

Title: Improving Cross-modal Alignment with Synthetic Pairs for Text-only Image Captioning

Zhiyue Liu, Jinyuan Liu, Fanrong Ma

Comments: AAAI2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[881] arXiv:2312.08926 (cross-list from cs.AI) [pdf, html, other]

Title: Modeling Complex Mathematical Reasoning via Large Language Model based MathAgent

Haoran Liao, Qinyi Du, Shaohua Hu, Hao He, Yanyan Xu, Jidong Tian, Yaohui Jin

Comments: There are unfair comparisons on miniF2F. This will be fixed in the future

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[882] arXiv:2312.08935 (cross-list from cs.AI) [pdf, other]

Title: Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations

Peiyi Wang, Lei Li, Zhihong Shao, R.X. Xu, Damai Dai, Yifei Li, Deli Chen, Y.Wu, Zhifang Sui

Comments: Add Step-by-Step reinforcement learning results

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[883] arXiv:2312.08995 (cross-list from cs.IR) [pdf, html, other]

Title: FrameFinder: Explorative Multi-Perspective Framing Extraction from News Headlines

Markus Reiter-Haas, Beate Klösch, Markus Hadler, Elisabeth Lex

Comments: Accepted for publication at CHIIR'24

Journal-ref: Proceedings of the 2024 ACM SIGIR Conference on Human Information Interaction and Retrieval

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[884] arXiv:2312.09040 (cross-list from cs.SD) [pdf, html, other]

Title: STaR: Distilling Speech Temporal Relation for Lightweight Speech Self-Supervised Learning Models

Kangwook Jang, Sungnyun Kim, Hoirin Kim

Comments: ICASSP 2024 Best Student Paper Awarded. Code URL: this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[885] arXiv:2312.09067 (cross-list from cs.CV) [pdf, html, other]

Title: Holodeck: Language Guided Generation of 3D Embodied AI Environments

Yue Yang, Fan-Yun Sun, Luca Weihs, Eli VanderBilt, Alvaro Herrasti, Winson Han, Jiajun Wu, Nick Haber, Ranjay Krishna, Lingjie Liu, Chris Callison-Burch, Mark Yatskar, Aniruddha Kembhavi, Christopher Clark

Comments: Published in CVPR 2024, 21 pages, 27 figures, 2 tables

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[886] arXiv:2312.09084 (cross-list from cs.NE) [pdf, html, other]

Title: Language Modeling on a SpiNNaker 2 Neuromorphic Chip

Khaleelulla Khan Nazeer, Mark Schöne, Rishav Mukherji, Bernhard Vogginger, Christian Mayr, David Kappel, Anand Subramoney

Subjects: Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL); Emerging Technologies (cs.ET); Machine Learning (cs.LG)

[887] arXiv:2312.09230 (cross-list from cs.LG) [pdf, other]

Title: Successor Heads: Recurring, Interpretable Attention Heads In The Wild

Rhys Gould, Euan Ong, George Ogden, Arthur Conmy

Comments: 12 main text pages, with appendix

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[888] arXiv:2312.09238 (cross-list from cs.AI) [pdf, html, other]

Title: Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft

Hao Li, Xue Yang, Zhaokai Wang, Xizhou Zhu, Jie Zhou, Yu Qiao, Xiaogang Wang, Hongsheng Li, Lewei Lu, Jifeng Dai

Comments: Accepted by CVPR2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[889] arXiv:2312.09241 (cross-list from cs.LG) [pdf, other]

Title: TinyGSM: achieving >80% on GSM8k with small language models

Bingbin Liu, Sebastien Bubeck, Ronen Eldan, Janardhan Kulkarni, Yuanzhi Li, Anh Nguyen, Rachel Ward, Yi Zhang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[890] arXiv:2312.09265 (cross-list from cs.SD) [pdf, html, other]

Title: Acoustic models of Brazilian Portuguese Speech based on Neural Transformers

Marcelo Matheus Gauy, Marcelo Finger

Comments: Under review at Journal of Brazilian Computer Society

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[891] arXiv:2312.09299 (cross-list from cs.LG) [pdf, html, other]

Title: Weight subcloning: direct initialization of transformers using larger pretrained ones

Mohammad Samragh, Mehrdad Farajtabar, Sachin Mehta, Raviteja Vemulapalli, Fartash Faghri, Devang Naik, Oncel Tuzel, Mohammad Rastegari

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[892] arXiv:2312.09304 (cross-list from cs.LG) [pdf, html, other]

Title: Well-calibrated Confidence Measures for Multi-label Text Classification with a Large Number of Labels

Lysimachos Maltoudoglou, Andreas Paisios, Ladislav Lenc, Jiří Martínek, Pavel Král, Harris Papadopoulos

Journal-ref: Pattern Recognition, Volume 122, February 2022

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[893] arXiv:2312.09411 (cross-list from cs.LG) [pdf, html, other]

Title: OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators

Tianyi Chen, Tianyu Ding, Zhihui Zhu, Zeyu Chen, HsiangTao Wu, Ilya Zharkov, Luming Liang

Comments: 39 pages. Due to the page dim limitation, the full appendix is attached here this https URL. Recommend to zoom-in for finer details. arXiv admin note: text overlap with arXiv:2305.18030

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[894] arXiv:2312.09430 (cross-list from eess.SP) [pdf, other]

Title: Deep Representation Learning for Open Vocabulary Electroencephalography-to-Text Decoding

Hamza Amrani, Daniela Micucci, Paolo Napoletano

Comments: 12 pages, 5 figures, preprint

Subjects: Signal Processing (eess.SP); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[895] arXiv:2312.09494 (cross-list from cs.CR) [pdf, html, other]

Title: No-Skim: Towards Efficiency Robustness Evaluation on Skimming-based Language Models

Shengyao Zhang, Mi Zhang, Xudong Pan, Min Yang

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[896] arXiv:2312.09508 (cross-list from cs.IR) [pdf, html, other]

Title: IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languages

Saiful Haq, Ashutosh Sharma, Pushpak Bhattacharyya

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[897] arXiv:2312.09572 (cross-list from eess.AS) [pdf, html, other]

Title: IR-UWB Radar-Based Contactless Silent Speech Recognition of Vowels, Consonants, Words, and Phrases

Sunghwa Lee, Younghoon Shin, Myungjong Kim, Jiwon Seo

Comments: Submitted to IEEE Access

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[898] arXiv:2312.09601 (cross-list from cs.CR) [pdf, html, other]

Title: Binary Code Summarization: Benchmarking ChatGPT/GPT-4 and Other Large Language Models

Xin Jin, Jonathan Larson, Weiwei Yang, Zhiqiang Lin

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG); Software Engineering (cs.SE)

[899] arXiv:2312.09625 (cross-list from cs.CV) [pdf, html, other]

Title: Weakly-Supervised 3D Visual Grounding based on Visual Language Alignment

Xiaoxu Xu, Yitian Yuan, Qiudan Zhang, Wenhui Wu, Zequn Jie, Lin Ma, Xu Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[900] arXiv:2312.10078 (cross-list from cs.HC) [pdf, html, other]

Title: Early ChatGPT User Portrait through the Lens of Data

Yuyang Deng, Ni Zhao, Xin Huang

Comments: 6 pages, 5 figures, 2023 IEEE International Conference on Big Data (BigData), to be published

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)