-
LLMs as Meta-Reviewers' Assistants: A Case Study
Authors:
Eftekhar Hossain,
Sanjeev Kumar Sinha,
Naman Bansal,
Alex Knipper,
Souvika Sarkar,
John Salvador,
Yash Mahajan,
Sri Guttikonda,
Mousumi Akter,
Md. Mahadi Hassan,
Matthew Freestone,
Matthew C. Williams Jr.,
Dongji Feng,
Santu Karmaker
Abstract:
One of the most important yet onerous tasks in the academic peer-reviewing process is composing meta-reviews, which involves assimilating diverse opinions from multiple expert peers, formulating one's self-judgment as a senior expert, and then summarizing all these perspectives into a concise holistic overview to make an overall recommendation. This process is time-consuming and can be compromised…
▽ More
One of the most important yet onerous tasks in the academic peer-reviewing process is composing meta-reviews, which involves assimilating diverse opinions from multiple expert peers, formulating one's self-judgment as a senior expert, and then summarizing all these perspectives into a concise holistic overview to make an overall recommendation. This process is time-consuming and can be compromised by human factors like fatigue, inconsistency, missing tiny details, etc. Given the latest major developments in Large Language Models (LLMs), it is very compelling to rigorously study whether LLMs can help metareviewers perform this important task better. In this paper, we perform a case study with three popular LLMs, i.e., GPT-3.5, LLaMA2, and PaLM2, to assist meta-reviewers in better comprehending multiple experts perspectives by generating a controlled multi-perspective summary (MPS) of their opinions. To achieve this, we prompt three LLMs with different types/levels of prompts based on the recently proposed TELeR taxonomy. Finally, we perform a detailed qualitative study of the MPSs generated by the LLMs and report our findings.
△ Less
Submitted 8 February, 2025; v1 submitted 23 February, 2024;
originally announced February 2024.
-
A Finite State Transducer Based Morphological Analyzer of Maithili Language
Authors:
Raza Rahi,
Sumant Pushp,
Arif Khan,
Smriti Kumar Sinha
Abstract:
Morphological analyzers are the essential milestones for many linguistic applications like; machine translation, word sense disambiguation, spells checkers, and search engines etc. Therefore, development of an effective morphological analyzer has a greater impact on the computational recognition of a language. In this paper, we present a finite state transducer based inflectional morphological ana…
▽ More
Morphological analyzers are the essential milestones for many linguistic applications like; machine translation, word sense disambiguation, spells checkers, and search engines etc. Therefore, development of an effective morphological analyzer has a greater impact on the computational recognition of a language. In this paper, we present a finite state transducer based inflectional morphological analyzer for a resource poor language of India, known as Maithili. Maithili is an eastern Indo-Aryan language spoken in the eastern and northern regions of Bihar in India and the southeastern plains, known as tarai of Nepal. This work can be recognized as the first work towards the computational development of Maithili which may attract researchers around the country to up-rise the language to establish in computational world.
△ Less
Submitted 29 February, 2020;
originally announced March 2020.
-
Morphological Analysis of the Bishnupriya Manipuri Language using Finite State Transducers
Authors:
Nayan Jyoti Kalita,
Navanath Saharia,
Smriti Kumar Sinha
Abstract:
In this work we present a morphological analysis of Bishnupriya Manipuri language, an Indo-Aryan language spoken in the north eastern India. As of now, there is no computational work available for the language. Finite state morphology is one of the successful approaches applied in a wide variety of languages over the year. Therefore we adapted the finite state approach to analyse morphology of the…
▽ More
In this work we present a morphological analysis of Bishnupriya Manipuri language, an Indo-Aryan language spoken in the north eastern India. As of now, there is no computational work available for the language. Finite state morphology is one of the successful approaches applied in a wide variety of languages over the year. Therefore we adapted the finite state approach to analyse morphology of the Bishnupriya Manipuri language.
△ Less
Submitted 21 April, 2014;
originally announced April 2014.
-
Towards The Development of a Bishnupriya Manipuri Corpus
Authors:
Nayan Jyoti Kalita,
Navanath Saharia,
Smriti Kumar Sinha
Abstract:
For any deep computational processing of language we need evidences, and one such set of evidences is corpus. This paper describes the development of a text-based corpus for the Bishnupriya Manipuri language. A Corpus is considered as a building block for any language processing tasks. Due to the lack of awareness like other Indian languages, it is also studied less frequently. As a result the lan…
▽ More
For any deep computational processing of language we need evidences, and one such set of evidences is corpus. This paper describes the development of a text-based corpus for the Bishnupriya Manipuri language. A Corpus is considered as a building block for any language processing tasks. Due to the lack of awareness like other Indian languages, it is also studied less frequently. As a result the language still lacks a good corpus and basic language processing tools. As per our knowledge this is the first effort to develop a corpus for Bishnupriya Manipuri language.
△ Less
Submitted 11 December, 2013;
originally announced December 2013.
-
Development and Transcription of Assamese Speech Corpus
Authors:
Himangshu Sarma,
Navanath Saharia,
Utpal Sharma,
Smriti Kumar Sinha,
Mancha Jyoti Malakar
Abstract:
A balanced speech corpus is the basic need for any speech processing task. In this report we describe our effort on development of Assamese speech corpus. We mainly focused on some issues and challenges faced during development of the corpus. Being a less computationally aware language, this is the first effort to develop speech corpus for Assamese. As corpus development is an ongoing process, in…
▽ More
A balanced speech corpus is the basic need for any speech processing task. In this report we describe our effort on development of Assamese speech corpus. We mainly focused on some issues and challenges faced during development of the corpus. Being a less computationally aware language, this is the first effort to develop speech corpus for Assamese. As corpus development is an ongoing process, in this paper we report only the initial task.
△ Less
Submitted 27 September, 2013;
originally announced September 2013.
