Computation and Language

Authors and titles for January 2022

[251] arXiv:2201.09377 [pdf, other]

Title: An Application of Pseudo-Log-Likelihoods to Natural Language Scoring

Darren Abramson, Ali Emami

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[252] arXiv:2201.09518 [pdf, other]

Title: Synthetic Books

Varvara Guljajeva

Comments: 7 pages, 5 figures

Journal-ref: ARTECH 2021

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[253] arXiv:2201.09523 [pdf, other]

Title: BTPK-based interpretable method for NER tasks based on Talmudic Public Announcement Logic

Yulin Chen, Beishui Liao, Bruno Bentzen, Bo Yuan, Zelai Yao, Haixiao Chi, Dov Gabbay

Comments: 10 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[254] arXiv:2201.09651 [pdf, other]

Title: Artefact Retrieval: Overview of NLP Models with Knowledge Base Access

Vilém Zouhar, Marius Mosbach, Debanjali Biswas, Dietrich Klakow

Comments: 11 pages of main content, 7 pages of appendix; presented at AKBC CSRR 2021

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[255] arXiv:2201.09680 [pdf, other]

Title: Relational Memory Augmented Language Models

Qi Liu, Dani Yogatama, Phil Blunsom

Comments: Accepted to TACL, pre MIT Press publication version

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[256] arXiv:2201.09696 [pdf, other]

Title: Unified Question Generation with Continual Lifelong Learning

Wei Yuan, Hongzhi Yin, Tieke He, Tong Chen, Qiufeng Wang, Lizhen Cui

Comments: Paper accepted in The Web Conference (WWW) 2022

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[257] arXiv:2201.09745 [pdf, other]

Title: Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks

Haoyu Dong, Zhoujun Cheng, Xinyi He, Mengyu Zhou, Anda Zhou, Fan Zhou, Ao Liu, Shi Han, Dongmei Zhang

Comments: Accepted by IJCAI'2022 survey track

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[258] arXiv:2201.09966 [pdf, other]

Title: Classification Of Fake News Headline Based On Neural Networks

Ke Yahan, Ruyi Qu, Lu Xiaoxia

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[259] arXiv:2201.09997 [pdf, other]

Title: Razmecheno: Named Entity Recognition from Digital Archive of Diaries "Prozhito"

Timofey Atnashev, Veronika Ganeeva, Roman Kazakov, Daria Matyash, Michael Sonkin, Ekaterina Voloshina, Oleg Serikov, Ekaterina Artemova

Comments: Submitted to LREC 2022

Subjects: Computation and Language (cs.CL)

[260] arXiv:2201.10005 [pdf, other]

Title: Text and Code Embeddings by Contrastive Pre-Training

Arvind Neelakantan, Tao Xu, Raul Puri, Alec Radford, Jesse Michael Han, Jerry Tworek, Qiming Yuan, Nikolas Tezak, Jong Wook Kim, Chris Hallacy, Johannes Heidecke, Pranav Shyam, Boris Power, Tyna Eloundou Nekoul, Girish Sastry, Gretchen Krueger, David Schnurr, Felipe Petroski Such, Kenny Hsu, Madeleine Thompson, Tabarak Khan, Toki Sherbakov, Joanne Jang, Peter Welinder, Lilian Weng

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[261] arXiv:2201.10066 [pdf, other]

Title: Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources

Angelina McMillan-Major, Zaid Alyafeai, Stella Biderman, Kimbo Chen, Francesco De Toni, Gérard Dupont, Hady Elsahar, Chris Emezue, Alham Fikri Aji, Suzana Ilić, Nurulaqilla Khamis, Colin Leong, Maraim Masoud, Aitor Soroa, Pedro Ortiz Suarez, Zeerak Talat, Daniel van Strien, Yacine Jernite

Comments: 8 pages plus appendix and references

Subjects: Computation and Language (cs.CL); Databases (cs.DB)

[262] arXiv:2201.10113 [pdf, other]

Title: Multimodal data matters: language model pre-training over structured and unstructured electronic health records

Sicen Liu, Xiaolong Wang, Yongshuai Hou, Ge Li, Hui Wang, Hui Xu, Yang Xiang, Buzhou Tang

Comments: 12 pages, 5 figures accepted for publication in the IEEE Journal of Biomedical and Health Informatics (J-BHI)

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[263] arXiv:2201.10262 [pdf, other]

Title: Do Transformers Encode a Foundational Ontology? Probing Abstract Classes in Natural Language

Mael Jullien, Marco Valentino, Andre Freitas

Subjects: Computation and Language (cs.CL)

[264] arXiv:2201.10274 [pdf, other]

Title: Multi-channel Attentive Graph Convolutional Network With Sentiment Fusion For Multimodal Sentiment Analysis

Luwei Xiao, Xingjiao Wu, Wen Wu, Jing Yang, Liang He

Subjects: Computation and Language (cs.CL)

[265] arXiv:2201.10376 [pdf, other]

Title: Modeling Multi-level Context for Informational Bias Detection by Contrastive Learning and Sentential Graph Network

Shijia Guo, Kenny Q. Zhu

Comments: 10 pages including bibliography

Subjects: Computation and Language (cs.CL)

[266] arXiv:2201.10422 [pdf, other]

Title: Language Generation for Broad-Coverage, Explainable Cognitive Systems

Marjorie McShane, Ivan Leon

Comments: Presented at The Ninth Advances in Cognitive Systems (ACS) Conference 2021 (arXiv:2201.06134)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[267] arXiv:2201.10430 [pdf, other]

Title: A Quantitative and Qualitative Analysis of Schizophrenia Language

Amal Alqahtani, Efsun Sarioglu Kay, Sardar Hamidian, Michael Compton, Mona Diab

Subjects: Computation and Language (cs.CL)

[268] arXiv:2201.10463 [pdf, other]

Title: Distantly supervised end-to-end medical entity extraction from electronic health records with human-level quality

Alexander Nesterov, Dmitry Umerenkov

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[269] arXiv:2201.10474 [pdf, other]

Title: Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection

Suchin Gururangan, Dallas Card, Sarah K. Dreier, Emily K. Gade, Leroy Z. Wang, Zeyu Wang, Luke Zettlemoyer, Noah A. Smith

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[270] arXiv:2201.10515 [pdf, other]

Title: Suicidal Ideation Detection on Social Media: A Review of Machine Learning Methods

Asma Abdulsalam, Areej Alhothali

Comments: 14 pages, 7 figures

Subjects: Computation and Language (cs.CL)

[271] arXiv:2201.10588 [pdf, other]

Title: Convex Polytope Modelling for Unsupervised Derivation of Semantic Structure for Data-efficient Natural Language Understanding

Jingyan Zhou, Xiaohan Feng, King Keung Wu, Helen Meng

Subjects: Computation and Language (cs.CL)

[272] arXiv:2201.10608 [pdf, other]

Title: DOM-LM: Learning Generalizable Representations for HTML Documents

Xiang Deng, Prashant Shiralkar, Colin Lockard, Binxuan Huang, Huan Sun

Subjects: Computation and Language (cs.CL)

[273] arXiv:2201.10618 [pdf, other]

Title: The ABBE Corpus: Animate Beings Being Emotional

Samira Zad, Joshuan Jimenez, Mark A. Finlayson

Comments: 9 pages, 1 figure

Subjects: Computation and Language (cs.CL)

[274] arXiv:2201.10707 [pdf, other]

Title: A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model

Xin Sun, Tao Ge, Shuming Ma, Jingjing Li, Furu Wei, Houfeng Wang

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[275] arXiv:2201.10716 [pdf, other]

Title: Neural Grapheme-to-Phoneme Conversion with Pre-trained Grapheme Models

Lu Dong, Zhi-Qiang Guo, Chao-Hong Tan, Ya-Jun Hu, Yuan Jiang, Zhen-Hua Ling

Comments: This paper is accepted by ICASSP2022

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[276] arXiv:2201.10792 [pdf, other]

Title: On the Effectiveness of Pinyin-Character Dual-Decoding for End-to-End Mandarin Chinese ASR

Zhao Yang, Dianwen Ng, Xiao Fu, Liping Han, Wei Xi, Rui Wang, Rui Jiang, Jizhong Zhao

Comments: submitted to INTERSPEECH 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[277] arXiv:2201.10797 [pdf, other]

Title: An Automated Question-Answering Framework Based on Evolution Algorithm

Sinan Tan, Hui Xue, Qiyu Ren, Huaping Liu, Jing Bai

Comments: In Proceedings of the AAAI 2019 Workshop (WS13) on Reasoning and Complex Question-Answering (RCQA-19) this https URL

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[278] arXiv:2201.10866 [pdf, other]

Title: CodeRetriever: Unimodal and Bimodal Contrastive Learning for Code Search

Xiaonan Li, Yeyun Gong, Yelong Shen, Xipeng Qiu, Hang Zhang, Bolun Yao, Weizhen Qi, Daxin Jiang, Weizhu Chen, Nan Duan

Comments: Accepted to EMNLP 2022 (main conference)

Subjects: Computation and Language (cs.CL); Software Engineering (cs.SE)

[279] arXiv:2201.10881 [pdf, other]

Title: The Norwegian Parliamentary Speech Corpus

Per Erik Solberg, Pablo Ortiz

Comments: 6 pages, submitted to LREC 2022

Journal-ref: LREC 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[280] arXiv:2201.10927 [pdf, other]

Title: Pair-Level Supervised Contrastive Learning for Natural Language Inference

Shu'ang Li, Xuming Hu, Li Lin, Lijie Wen

Comments: Accepted at ICASSP 2022

Subjects: Computation and Language (cs.CL)

[281] arXiv:2201.10986 [pdf, other]

Title: Twitter-Demographer: A Flow-based Tool to Enrich Twitter Data

Federico Bianchi, Vincenzo Cutrona, Dirk Hovy

Subjects: Computation and Language (cs.CL)

[282] arXiv:2201.11115 [pdf, other]

Title: CsFEVER and CTKFacts: Acquiring Czech data for fact verification

Herbert Ullrich, Jan Drchal, Martin Rýpar, Hana Vincourová, Václav Moravec

Comments: submitted to LREV journal for review, resubmission, changed title according to reviewer suggestion

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[283] arXiv:2201.11153 [pdf, other]

Title: Addressing Issues of Cross-Linguality in Open-Retrieval Question Answering Systems For Emergent Domains

Alon Albalak, Sharon Levy, William Yang Wang

Comments: 6 pages, 8 figures

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[284] arXiv:2201.11155 [pdf, other]

Title: Explainable Patterns for Distinction and Prediction of Moral Judgement on Reddit

Ion Stagkos Efstathiadis, Guilherme Paulino-Passos, Francesca Toni

Comments: 1st Workshop on Human and Machine Decisions (WHMD 2021) at NeurIPS 2021

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[285] arXiv:2201.11172 [pdf, other]

Title: Tackling data scarcity in speech translation using zero-shot multilingual machine translation techniques

Tu Anh Dinh, Danni Liu, Jan Niehues

Comments: 6 pages, 5 figures, accepted to IEEE ICASSP 2022. arXiv admin note: text overlap with arXiv:2107.06010

Journal-ref: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022, pp. 6222-6226

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[286] arXiv:2201.11176 [pdf, other]

Title: DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence

Wei Zhao, Michael Strube, Steffen Eger

Comments: EACL2023 Camera Ready

Subjects: Computation and Language (cs.CL)

[287] arXiv:2201.11258 [pdf, other]

Title: Learning How to Translate North Korean through South Korean

Hwichan Kim, Sangwhan Moon, Naoaki Okazaki, Mamoru Komachi

Comments: 8 pages, 1 figures, 8 tables

Subjects: Computation and Language (cs.CL)

[288] arXiv:2201.11294 [pdf, other]

Title: Highly Generalizable Models for Multilingual Hate Speech Detection

Neha Deshpande, Nicholas Farris, Vidhur Kumar

Subjects: Computation and Language (cs.CL)

[289] arXiv:2201.11312 [pdf, other]

Title: A Higher-Order Semantic Dependency Parser

Bin Li, Yunlong Fan, Yikemaiti Sataer, Zhiqiang Gao

Subjects: Computation and Language (cs.CL)

[290] arXiv:2201.11313 [pdf, other]

Title: Learning Deep Semantic Model for Code Search using CodeSearchNet Corpus

Chen Wu, Ming Yan

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[291] arXiv:2201.11332 [pdf, other]

Title: Ontology-enhanced Prompt-tuning for Few-shot Learning

Hongbin Ye, Ningyu Zhang, Shumin Deng, Xiang Chen, Hui Chen, Feiyu Xiong, Xi Chen, Huajun Chen

Comments: Accepted by WWW2022

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[292] arXiv:2201.11367 [pdf, other]

Title: Pan More Gold from the Sand: Refining Open-domain Dialogue Training with Noisy Self-Retrieval Generation

Yihe Wang, Yitong Li, Yasheng Wang, Fei Mi, Pingyi Zhou, Xin Wang, Jin Liu, Xin Jiang, Qun Liu

Comments: Accepted in COLING 2022

Subjects: Computation and Language (cs.CL)

[293] arXiv:2201.11374 [pdf, other]

Title: Systematic Investigation of Strategies Tailored for Low-Resource Settings for Low-Resource Dependency Parsing

Jivnesh Sandhan, Laxmidhar Behera, Pawan Goyal

Comments: Accepted at EACL2023 to be held in Croatia Europe

Subjects: Computation and Language (cs.CL)

[294] arXiv:2201.11391 [pdf, other]

Title: Prabhupadavani: A Code-mixed Speech Translation Data for 25 Languages

Jivnesh Sandhan, Ayush Daksh, Om Adideva Paranjay, Laxmidhar Behera, Pawan Goyal

Comments: The work is accepted at COLING22-SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature

Subjects: Computation and Language (cs.CL)

[295] arXiv:2201.11443 [pdf, other]

Title: Yes-Yes-Yes: Proactive Data Collection for ACL Rolling Review and Beyond

Nils Dycke, Ilia Kuznetsov, Iryna Gurevych

Comments: Accepted at Findings of EMNLP 2022

Subjects: Computation and Language (cs.CL)

[296] arXiv:2201.11473 [pdf, other]

Title: Reasoning Like Program Executors

Xinyu Pi, Qian Liu, Bei Chen, Morteza Ziyadi, Zeqi Lin, Qiang Fu, Yan Gao, Jian-Guang Lou, Weizhu Chen

Comments: To appear in EMNLP 2022 main conference. The first two authors contributed equally

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Symbolic Computation (cs.SC)

[297] arXiv:2201.11569 [pdf, other]

Title: Human Interpretation of Saliency-based Explanation Over Text

Hendrik Schuff, Alon Jacovi, Heike Adel, Yoav Goldberg, Ngoc Thang Vu

Comments: FAccT 2022

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[298] arXiv:2201.11576 [pdf, other]

Title: Grad2Task: Improved Few-shot Text Classification Using Gradients for Task Representation

Jixuan Wang, Kuan-Chieh Wang, Frank Rudzicz, Michael Brudno

Comments: NeurIPS 2021

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[299] arXiv:2201.11582 [pdf, other]

Title: GUDN: A novel guide network with label reinforcement strategy for extreme multi-label text classification

Qing Wang, Jia Zhu, Hongji Shu, Kwame Omono Asamoah, Jianyang Shi, Cong Zhou

Comments: 12 pages, 6 figures

Subjects: Computation and Language (cs.CL)

[300] arXiv:2201.11732 [pdf, other]

Title: IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages

Emanuele Bugliarello, Fangyu Liu, Jonas Pfeiffer, Siva Reddy, Desmond Elliott, Edoardo Maria Ponti, Ivan Vulić

Comments: ICML 2022

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)