Computation and Language

Authors and titles for October 2022

[1301] arXiv:2210.10436 (cross-list from cs.AI) [pdf, other]

Title: LightEA: A Scalable, Robust, and Interpretable Entity Alignment Framework via Three-view Label Propagation

Xin Mao, Wenting Wang, Yuanbin Wu, Man Lan

Comments: 15 pages; Accepted by EMNLP2022 (Main Conf)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1302] arXiv:2210.10584 (cross-list from cs.IR) [pdf, other]

Title: Enhanced vectors for top-k document retrieval in Question Answering

Mohammed Hammad

Comments: Year-2019

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1303] arXiv:2210.10634 (cross-list from cs.IR) [pdf, other]

Title: RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses

Honglei Zhuang, Zhen Qin, Rolf Jagerman, Kai Hui, Ji Ma, Jing Lu, Jianmo Ni, Xuanhui Wang, Michael Bendersky

Comments: 13 pages

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1304] arXiv:2210.10695 (cross-list from cs.IR) [pdf, other]

Title: Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking

Tim Baumgärtner, Leonardo F. R. Ribeiro, Nils Reimers, Iryna Gurevych

Comments: Accepted at EMNLP 2022

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1305] arXiv:2210.10820 (cross-list from cs.CV) [pdf, other]

Title: VTC: Improving Video-Text Retrieval with User Comments

Laura Hanu, James Thewlis, Yuki M. Asano, Christian Rupprecht

Comments: Accepted paper at the European Conference on Computer Vision (ECCV) 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1306] arXiv:2210.10879 (cross-list from cs.LG) [pdf, other]

Title: G-Augment: Searching for the Meta-Structure of Data Augmentation Policies for ASR

Gary Wang, Ekin D.Cubuk, Andrew Rosenberg, Shuyang Cheng, Ron J. Weiss, Bhuvana Ramabhadran, Pedro J. Moreno, Quoc V. Le, Daniel S. Park

Comments: 6 pages, accepted at SLT 2022. Updated with copyright

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1307] arXiv:2210.10914 (cross-list from cs.CV) [pdf, other]

Title: Prophet Attention: Predicting Attention with Future Attention for Image Captioning

Fenglin Liu, Xuancheng Ren, Xian Wu, Wei Fan, Yuexian Zou, Xu Sun

Comments: Accepted by NeurIPS 2020

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1308] arXiv:2210.10994 (cross-list from cs.AI) [pdf, other]

Title: MBTI Personality Prediction for Fictional Characters Using Movie Scripts

Yisi Sang, Xiangyang Mou, Mo Yu, Dakuo Wang, Jing Li, Jeffrey Stanton

Comments: paper accepted to EMNLP 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1309] arXiv:2210.11065 (cross-list from cs.CV) [pdf, other]

Title: MovieCLIP: Visual Scene Recognition in Movies

Digbalay Bose, Rajat Hebbar, Krishna Somandepalli, Haoyang Zhang, Yin Cui, Kree Cole-McLaughlin, Huisheng Wang, Shrikanth Narayanan

Comments: Accepted to 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2023). Project website with supplemental material: this https URL. Revised version with updated author affiliations

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[1310] arXiv:2210.11109 (cross-list from cs.CV) [pdf, other]

Title: Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation

Yu Zhao, Jianguo Wei, Zhichao Lin, Yueheng Sun, Meishan Zhang, Min Zhang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1311] arXiv:2210.11233 (cross-list from cs.AI) [pdf, other]

Title: Context-driven Visual Object Recognition based on Knowledge Graphs

Sebastian Monka, Lavdim Halilaj, Achim Rettinger

Comments: ISWC 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Symbolic Computation (cs.SC)

[1312] arXiv:2210.11253 (cross-list from cs.CV) [pdf, other]

Title: Image Semantic Relation Generation

Mingzhe Du

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1313] arXiv:2210.11416 (cross-list from cs.LG) [pdf, other]

Title: Scaling Instruction-Finetuned Language Models

Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, Dasha Valter, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Zhao, Yanping Huang, Andrew Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei

Comments: Public checkpoints: this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1314] arXiv:2210.11612 (cross-list from stat.AP) [pdf, other]

Title: Searching for a higher power in the human evaluation of MT

Johnny Tian-Zheng Wei, Tom Kocmi, Christian Federmann

Comments: WMT 2022

Subjects: Applications (stat.AP); Computation and Language (cs.CL)

[1315] arXiv:2210.11618 (cross-list from cs.LG) [pdf, other]

Title: Multitasking Models are Robust to Structural Failure: A Neural Model for Bilingual Cognitive Reserve

Giannis Daras, Negin Raoof, Zoi Gkalitsiou, Alexandros G. Dimakis

Comments: Accepted at NeurIPS 2022. 22 pages, 11 Figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1316] arXiv:2210.11630 (cross-list from cs.HC) [pdf, other]

Title: Using Large Language Models to Enhance Programming Error Messages

Juho Leinonen, Arto Hellas, Sami Sarsa, Brent Reeves, Paul Denny, James Prather, Brett A. Becker

Comments: 7 pages, accepted for publication at SIGCSE TS 2023

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

[1317] arXiv:2210.11794 (cross-list from cs.LG) [pdf, other]

Title: Diffuser: Efficient Transformers with Multi-hop Attention Diffusion for Long Sequences

Aosong Feng, Irene Li, Yuang Jiang, Rex Ying

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1318] arXiv:2210.11929 (cross-list from cs.CV) [pdf, other]

Title: LiteVL: Efficient Video-Language Learning with Enhanced Spatial-Temporal Modeling

Dongsheng Chen, Chaofan Tao, Lu Hou, Lifeng Shang, Xin Jiang, Qun Liu

Comments: 13 pages, 6 figures, accepted by EMNLP 2022 main conference

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1319] arXiv:2210.12040 (cross-list from cs.LG) [pdf, other]

Title: Neuro-Symbolic Causal Reasoning Meets Signaling Game for Emergent Semantic Communications

Christo Kurisummoottil Thomas, Walid Saad

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Information Theory (cs.IT)

[1320] arXiv:2210.12112 (cross-list from cs.CV) [pdf, other]

Title: Describing Sets of Images with Textual-PCA

Oded Hupert, Idan Schwartz, Lior Wolf

Comments: Accepted to Findings of EMNLP'22

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1321] arXiv:2210.12214 (cross-list from cs.SD) [pdf, other]

Title: Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generation

Thien Nguyen, Nathalie Tran, Liuhui Deng, Thiago Fraga da Silva, Matthew Radzihovsky, Roger Hsiao, Henry Mason, Stefan Braun, Erik McDermott, Dogan Can, Pawel Swietojanski, Lyan Verwimp, Sibel Oyman, Tresi Arvizo, Honza Silovsky, Arnab Ghoshal, Mathieu Martel, Bharat Ram Ambati, Mohamed Ali

Comments: 5 pages, 1 figure, submitted to ICASSP 2023, *: equal contributions

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1322] arXiv:2210.12217 (cross-list from cs.AI) [pdf, other]

Title: Entailer: Answering Questions with Faithful and Truthful Chains of Reasoning

Oyvind Tafjord, Bhavana Dalvi Mishra, Peter Clark

Comments: accepted at EMNLP 2022. arXiv admin note: substantial text overlap with arXiv:2204.13074

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1323] arXiv:2210.12444 (cross-list from cs.CV) [pdf, other]

Title: Weakly-Supervised Temporal Article Grounding

Long Chen, Yulei Niu, Brian Chen, Xudong Lin, Guangxing Han, Christopher Thomas, Hammad Ayyubi, Heng Ji, Shih-Fu Chang

Comments: EMNLP 2022, this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1324] arXiv:2210.12485 (cross-list from cs.AI) [pdf, other]

Title: DANLI: Deliberative Agent for Following Natural Language Instructions

Yichi Zhang, Jianing Yang, Jiayi Pan, Shane Storks, Nikhil Devraj, Ziqiao Ma, Keunwoo Peter Yu, Yuwei Bao, Joyce Chai

Comments: Accepted in EMNLP 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1325] arXiv:2210.12487 (cross-list from cs.AI) [pdf, other]

Title: MetaLogic: Logical Reasoning Explanations with Fine-Grained Structure

Yinya Huang, Hongming Zhang, Ruixin Hong, Xiaodan Liang, Changshui Zhang, Dong Yu

Comments: To appear at the main conference of EMNLP 2022

Journal-ref: EMNLP 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Logic in Computer Science (cs.LO)

[1326] arXiv:2210.12511 (cross-list from cs.AI) [pdf, other]

Title: DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents

Ziqiao Ma, Ben VanDerPloeg, Cristian-Paul Bara, Huang Yidong, Eui-In Kim, Felix Gervits, Matthew Marge, Joyce Chai

Comments: Findings of EMNLP, 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

[1327] arXiv:2210.12530 (cross-list from cs.LG) [pdf, other]

Title: LMPriors: Pre-Trained Language Models as Task-Specific Priors

Kristy Choi, Chris Cundy, Sanjari Srivastava, Stefano Ermon

Comments: First two authors contributed equally

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1328] arXiv:2210.12874 (cross-list from cs.LG) [pdf, other]

Title: Global Contrastive Batch Sampling via Optimization on Sample Permutations

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

Comments: ICML 2023; 21 pages, 7 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1329] arXiv:2210.13016 (cross-list from cs.LG) [pdf, other]

Title: Cards Against AI: Predicting Humor in a Fill-in-the-blank Party Game

Dan Ofer, Dafna Shahaf

Comments: Conditionally accepted in EMNLP 2022 short findings. 5 pages

Journal-ref: https://aclanthology.org/2022.findings-emnlp.394

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); General Literature (cs.GL)

[1330] arXiv:2210.13076 (cross-list from cs.CV) [pdf, other]

Title: Towards Unifying Reference Expression Generation and Comprehension

Duo Zheng, Tao Kong, Ya Jing, Jiaan Wang, Xiaojie Wang

Comments: Accepted to EMNLP 2022 (main conference)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1331] arXiv:2210.13189 (cross-list from eess.AS) [pdf, other]

Title: Can Visual Context Improve Automatic Speech Recognition for an Embodied Agent?

Pradip Pramanick, Chayan Sarkar

Comments: Accepted in EMNLP '22

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)

[1332] arXiv:2210.13238 (cross-list from q-bio.QM) [pdf, other]

Title: Multimodal Model with Text and Drug Embeddings for Adverse Drug Reaction Classification

Andrey Sakhovskiy, Elena Tutubalina

Comments: This paper is accepted to Journal of Biomedical Informatics

Journal-ref: Journal of Biomedical Informatics, Volume 135, 2022, 104182, ISSN 1532-0464

Subjects: Quantitative Methods (q-bio.QM); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1333] arXiv:2210.13382 (cross-list from cs.LG) [pdf, html, other]

Title: Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task

Kenneth Li, Aspen K. Hopkins, David Bau, Fernanda Viégas, Hanspeter Pfister, Martin Wattenberg

Comments: ICLR 2023 oral (notable-top-5%): this https URL ; code: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1334] arXiv:2210.13459 (cross-list from cs.LG) [pdf, other]

Title: Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation

Dongkyu Lee, Ka Chun Cheung, Nevin L. Zhang

Comments: EMNLP 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1335] arXiv:2210.13526 (cross-list from q-bio.NC) [pdf, other]

Title: Computational Inference in Cognitive Science: Operational, Societal and Ethical Considerations

Baihan Lin

Subjects: Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[1336] arXiv:2210.13623 (cross-list from cs.AI) [pdf, other]

Title: Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlook

Baihan Lin

Comments: To appear in Expert Systems with Applications. Accompanying INTERSPEECH 2022 Tutorial on the same topic. Including latest advancements in large language models (LLMs)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1337] arXiv:2210.13626 (cross-list from cs.CV) [pdf, other]

Title: VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge

Sahithya Ravi, Aditya Chinchure, Leonid Sigal, Renjie Liao, Vered Shwartz

Comments: Accepted at WACV 2023. For code and supplementary material, see this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1338] arXiv:2210.13700 (cross-list from eess.AS) [pdf, other]

Title: Does Joint Training Really Help Cascaded Speech Translation?

Viet Anh Khoa Tran, David Thulke, Yingbo Gao, Christian Herold, Hermann Ney

Comments: Accepted to EMNLP 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1339] arXiv:2210.13729 (cross-list from cs.AI) [pdf, other]

Title: Hybrid Reinforced Medical Report Generation with M-Linear Attention and Repetition Penalty

Wenting Xu, Zhenghua Xu, Junyang Chen, Chang Qi, Thomas Lukasiewicz

Comments: This paper is current under peer-review in IEEE TNNLS

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1340] arXiv:2210.13803 (cross-list from cs.SD) [pdf, other]

Title: Adapitch: Adaption Multi-Speaker Text-to-Speech Conditioned on Pitch Disentangling with Untranscribed Data

Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by MSN2022, The 18th International Conference on Mobility, Sensing and Networking

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1341] arXiv:2210.13805 (cross-list from cs.SD) [pdf, other]

Title: Improving Speech Representation Learning via Speech-level and Phoneme-level Masking Approach

Xulong Zhang, Jianzong Wang, Ning Cheng, Kexin Zhu, Jing Xiao

Comments: Accepted by MSN2022, The 18th International Conference on Mobility, Sensing and Networking

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1342] arXiv:2210.13811 (cross-list from cs.SD) [pdf, other]

Title: MetaSpeech: Speech Effects Switch Along with Environment for Metaverse

Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by AI2OT2022, The Third International Workshop on Artificial Intelligence Applications in Internet of Things

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1343] arXiv:2210.13918 (cross-list from cs.LG) [pdf, other]

Title: Differentially Private Language Models for Secure Data Sharing

Justus Mattern, Zhijing Jin, Benjamin Weggenmann, Bernhard Schoelkopf, Mrinmaya Sachan

Comments: Accepted at EMNLP 2022

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1344] arXiv:2210.13942 (cross-list from cs.LG) [pdf, other]

Title: Entity Divider with Language Grounding in Multi-Agent Reinforcement Learning

Ziluo Ding, Wanpeng Zhang, Junpeng Yue, Xiangjun Wang, Tiejun Huang, Zongqing Lu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[1345] arXiv:2210.13979 (cross-list from cs.LG) [pdf, other]

Title: Meta-learning Pathologies from Radiology Reports using Variance Aware Prototypical Networks

Arijit Sehanobish, Kawshik Kannan, Nabila Abraham, Anasuya Das, Benjamin Odry

Comments: EMNLP'22 Industry Track. Extended Abstract presented at Machine Learning for Health (ML4H) symposium 2022, November 28th, 2022, New Orleans, United States & Virtual, this http URL, 16 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1346] arXiv:2210.14037 (cross-list from cs.LG) [pdf, other]

Title: Revisiting Softmax for Uncertainty Approximation in Text Classification

Andreas Nugaard Holm, Dustin Wright, Isabelle Augenstein

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1347] arXiv:2210.14395 (cross-list from cs.CV) [pdf, other]

Title: IMU2CLIP: Multimodal Contrastive Learning for IMU Motion Sensors from Egocentric Videos and Text

Seungwhan Moon, Andrea Madotto, Zhaojiang Lin, Alireza Dirafzoon, Aparajita Saraf, Amy Bearman, Babak Damavandi

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1348] arXiv:2210.14406 (cross-list from eess.AS) [pdf, other]

Title: RedPen: Region- and Reason-Annotated Dataset of Unnatural Speech

Kyumin Park, Keon Lee, Daeyoung Kim, Dongyeop Kang

Comments: Submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[1349] arXiv:2210.14593 (cross-list from cs.LG) [pdf, other]

Title: Scaling Laws Beyond Backpropagation

Matthew J. Filipovich, Alessandro Cappelli, Daniel Hesslow, Julien Launay

Comments: I Can't Believe It's Not Better Workshop, NeurIPS 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[1350] arXiv:2210.14596 (cross-list from cs.AI) [pdf, other]

Title: Scaling Knowledge Graphs for Automating AI of Digital Twins

Joern Ploennigs, Konstantinos Semertzidis, Fabio Lorenzi, Nandana Mihindukulasooriya

Comments: Accepted at ISWC 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)