Skip to main content

Showing 1–50 of 94 results for author: Thelwall, M

.
  1. arXiv:2506.13525  [pdf

    cs.DL

    Implicit and Explicit Research Quality Score Probabilities from ChatGPT

    Authors: Mike Thelwall, Yunhan Yang

    Abstract: The large language model (LLM) ChatGPT's quality scores for journal articles correlate more strongly with human judgements than some citation-based indicators in most fields. Averaging multiple ChatGPT scores improves the results, apparently leveraging its internal probability model. To leverage these probabilities, this article tests two novel strategies: requesting percentage likelihoods for sco… ▽ More

    Submitted 16 June, 2025; originally announced June 2025.

  2. arXiv:2506.07748  [pdf

    cs.DL

    Research quality evaluation by AI in the era of Large Language Models: Advantages, disadvantages, and systemic effects

    Authors: Mike Thelwall

    Abstract: Artificial Intelligence (AI) technologies like ChatGPT now threaten bibliometrics as the primary generators of research quality indicators. They are already used in at least one research quality evaluation system and evidence suggests that they are used informally by many peer reviewers. Since using bibliometrics to support research evaluation continues to be controversial, this article reviews th… ▽ More

    Submitted 9 June, 2025; originally announced June 2025.

  3. arXiv:2504.04464  [pdf

    cs.DL

    In which fields do ChatGPT 4o scores align better than citations with research quality?

    Authors: Mike Thelwall

    Abstract: Although citation-based indicators are widely used for research evaluation, they are not useful for recently published research, reflect only one of the three common dimensions of research quality, and have little value in some social sciences, arts and humanities. Large Language Models (LLMs) have been shown to address some of these weaknesses, with ChatGPT 4o-mini showing the most promising resu… ▽ More

    Submitted 6 April, 2025; originally announced April 2025.

  4. arXiv:2503.18215  [pdf

    cs.DL

    Can news and social media attention reduce the influence of problematic research?

    Authors: Er-Te Zheng, Hui-Zhen Fu, Xiaorui Jiang, Zhichao Fang, Mike Thelwall

    Abstract: News and social media are widely used to disseminate science, but do they also help raise awareness of problems in research? This study investigates whether high levels of news and social media attention might accelerate the retraction process and increase the visibility of retracted articles. To explore this, we analyzed 15,642 news mentions, 6,588 blog mentions, and 404,082 X mentions related to… ▽ More

    Submitted 23 March, 2025; originally announced March 2025.

    Comments: 29 pages

  5. arXiv:2502.18427  [pdf

    cs.DL

    Is OpenAlex Suitable for Research Quality Evaluation and Which Citation Indicator is Best?

    Authors: Mike Thelwall, Xiaorui Jiang

    Abstract: This article compares (1) citation analysis with OpenAlex and Scopus, testing their citation counts, document type/coverage and subject classifications and (2) three citation-based indicators: raw counts, (field and year) Normalised Citation Scores (NCS) and Normalised Log-transformed Citation Scores (NLCS). Methods (1&2): The indicators calculated from 28.6 million articles were compared through… ▽ More

    Submitted 25 February, 2025; originally announced February 2025.

  6. arXiv:2502.08171  [pdf

    cs.DL

    Estimating the quality of academic books from their descriptions with ChatGPT

    Authors: Mike Thelwall, Andrew Cox

    Abstract: Although indicators based on scholarly citations are widely used to support the evaluation of academic journals, alternatives are needed for scholarly book acquisitions. This article assesses the value of research quality scores from ChatGPT 4o-mini for 9,830 social sciences, arts, and humanities books from 2019 indexed in Scopus, based on their titles and descriptions but not their full texts. Al… ▽ More

    Submitted 12 February, 2025; originally announced February 2025.

    Comments: Journal of Academic Librarianship, to appear

  7. arXiv:2411.09984  [pdf

    cs.DL

    Journal Quality Factors from ChatGPT: More meaningful than Impact Factors?

    Authors: Mike Thelwall, Kayvan Kousha

    Abstract: Purpose: Journal Impact Factors and other citation-based indicators are widely used and abused to help select journals to publish in or to estimate the value of a published article. Nevertheless, citation rates primarily reflect scholarly impact rather than other quality dimensions, including societal impact, originality, and rigour. In contrast, Journal Quality Factors (JQFs) are average quality… ▽ More

    Submitted 6 December, 2024; v1 submitted 15 November, 2024; originally announced November 2024.

  8. arXiv:2411.09768  [pdf

    cs.DL

    Research evaluation with ChatGPT: Is it age, country, length, or field biased?

    Authors: Mike Thelwall, Zeyneb Kurt

    Abstract: Some research now suggests that ChatGPT can estimate the quality of journal articles from their titles and abstracts. This has created the possibility to use ChatGPT quality scores, perhaps alongside citation-based formulae, to support peer review for research evaluation. Nevertheless, ChatGPT's internal processes are effectively opaque, despite it writing a report to support its scores, and its b… ▽ More

    Submitted 14 November, 2024; originally announced November 2024.

  9. arXiv:2411.09763  [pdf

    cs.DL cs.CL

    Evaluating the Predictive Capacity of ChatGPT for Academic Peer Review Outcomes Across Multiple Platforms

    Authors: Mike Thelwall, Abdullah Yaghi

    Abstract: While previous studies have demonstrated that Large Language Models (LLMs) can predict peer review outcomes to some extent, this paper builds on that by introducing two new contexts and employing a more robust method - averaging multiple ChatGPT scores. The findings that averaging 30 ChatGPT predictions, based on reviewer guidelines and using only the submitted titles and abstracts, failed to pred… ▽ More

    Submitted 14 November, 2024; originally announced November 2024.

  10. Evaluating the quality of published medical research with ChatGPT

    Authors: Mike Thelwall, Xiaorui Jiang, Peter A. Bath

    Abstract: Estimating the quality of published research is important for evaluations of departments, researchers, and job candidates. Citation-based indicators sometimes support these tasks, but do not work for new articles and have low or moderate accuracy. Previous research has shown that ChatGPT can estimate the quality of research articles, with its scores correlating positively with an expert scores pro… ▽ More

    Submitted 3 March, 2025; v1 submitted 4 November, 2024; originally announced November 2024.

    Comments: Information Processing & Management (2025)

    Journal ref: Information Processing & Management, Volume 62, Issue 4, July 2025, 104123

  11. arXiv:2410.19948  [pdf

    cs.DL cs.AI

    Assessing the societal influence of academic research with ChatGPT: Impact case study evaluations

    Authors: Kayvan Kousha, Mike Thelwall

    Abstract: Academics and departments are sometimes judged by how their research has benefitted society. For example, the UK Research Excellence Framework (REF) assesses Impact Case Studies (ICS), which are five-page evidence-based claims of societal impacts. This study investigates whether ChatGPT can evaluate societal impact claims and therefore potentially support expert human assessors. For this, various… ▽ More

    Submitted 25 October, 2024; originally announced October 2024.

  12. arXiv:2409.16695  [pdf

    cs.DL

    In which fields can ChatGPT detect journal article quality? An evaluation of REF2021 results

    Authors: Mike Thelwall, Abdallah Yaghi

    Abstract: Time spent by academics on research quality assessment might be reduced if automated approaches can help. Whilst citation-based indicators have been extensively developed and evaluated for this, they have substantial limitations and Large Language Models (LLMs) like ChatGPT provide an alternative approach. This article assesses whether ChatGPT 4o-mini can be used to estimate the quality of journal… ▽ More

    Submitted 25 September, 2024; originally announced September 2024.

  13. arXiv:2408.06752  [pdf

    cs.DL cs.AI

    Evaluating Research Quality with Large Language Models: An Analysis of ChatGPT's Effectiveness with Different Settings and Inputs

    Authors: Mike Thelwall

    Abstract: Evaluating the quality of academic journal articles is a time consuming but critical task for national research evaluation exercises, appointments and promotion. It is therefore important to investigate whether Large Language Models (LLMs) can play a role in this process. This article assesses which ChatGPT inputs (full text without tables, figures and references; title and abstract; title only) p… ▽ More

    Submitted 29 November, 2024; v1 submitted 13 August, 2024; originally announced August 2024.

  14. arXiv:2407.00135  [pdf

    cs.DL

    Quantitative Methods in Research Evaluation Citation Indicators, Altmetrics, and Artificial Intelligence

    Authors: Mike Thelwall

    Abstract: This book critically analyses the value of citation data, altmetrics, and artificial intelligence to support the research evaluation of articles, scholars, departments, universities, countries, and funders. It introduces and discusses indicators that can support research evaluation and analyses their strengths and weaknesses as well as the generic strengths and weaknesses of the use of indicators… ▽ More

    Submitted 10 April, 2025; v1 submitted 28 June, 2024; originally announced July 2024.

    Comments: Book preprint

  15. arXiv:2403.16851  [pdf

    cs.DL cs.AI cs.CL cs.LG

    Can tweets predict article retractions? A comparison between human and LLM labelling

    Authors: Er-Te Zheng, Hui-Zhen Fu, Mike Thelwall, Zhichao Fang

    Abstract: Quickly detecting problematic research articles is crucial to safeguarding the integrity of scientific research. This study explores whether Twitter mentions of retracted articles can signal potential problems with the articles prior to their retraction, potentially serving as an early warning system for scholars. To investigate this, we analysed a dataset of 4,354 Twitter mentions associated with… ▽ More

    Submitted 9 December, 2024; v1 submitted 25 March, 2024; originally announced March 2024.

    Comments: 19 pages

  16. Can ChatGPT evaluate research quality?

    Authors: Mike Thelwall

    Abstract: Purpose: Assess whether ChatGPT 4.0 is accurate enough to perform research evaluations on journal articles to automate this time-consuming task. Design/methodology/approach: Test the extent to which ChatGPT-4 can assess the quality of journal articles using a case study of the published scoring guidelines of the UK Research Excellence Framework (REF) 2021 to create a research evaluation ChatGPT. T… ▽ More

    Submitted 8 February, 2024; originally announced February 2024.

    Journal ref: Journal of Data and Information Science, 9(2), 1-21

  17. arXiv:2307.15449  [pdf

    cs.DL

    Are Scopus journal field classifications ever misleading?

    Authors: Mike Thelwall, Stephen Pinfield

    Abstract: Journal field classifications in Scopus are used for citation-based indicators and by authors choosing appropriate journals to submit to. Whilst prior research has found that Scopus categories are occasionally misleading, it is not known how this varies for different journal types. In response, we assessed whether specialist, cross-field and general academic journals sometimes have publication pra… ▽ More

    Submitted 28 July, 2023; originally announced July 2023.

  18. arXiv:2212.08041  [pdf

    cs.CY cs.CL cs.GL cs.IR cs.LG

    Can REF output quality scores be assigned by AI? Experimental evidence

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt

    Abstract: This document describes strategies for using Artificial Intelligence (AI) to predict some journal article scores in future research assessment exercises. Five strategies have been assessed.

    Submitted 11 December, 2022; originally announced December 2022.

  19. arXiv:2212.07812  [pdf

    cs.DL

    Do bibliometrics introduce gender, institutional or interdisciplinary biases into research evaluations?

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt

    Abstract: Systematic evaluations of publicly funded research typically employ a combination of bibliometrics and peer review, but it is not known whether the bibliometric component introduces biases. This article compares three alternative mechanisms for scoring 73,612 UK Research Excellence Framework (REF) journal articles from all 34 field-based Units of Assessment (UoAs) 2014-17: peer review, field norma… ▽ More

    Submitted 11 December, 2022; originally announced December 2022.

  20. Do altmetric scores reflect article quality? Evidence from the UK Research Excellence Framework 2021

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt

    Abstract: Altmetrics are web-based quantitative impact or attention indicators for academic articles that have been proposed to supplement citation counts. This article reports the first assessment of the extent to which mature altmetrics from Altmetric.com and Mendeley associate with journal article quality. It exploits expert norm-referenced peer review scores from the UK Research Excellence Framework 202… ▽ More

    Submitted 11 December, 2022; originally announced December 2022.

    Journal ref: Journal of the Association for Information Science and Technology, 74(5), 582-593 (2023)

  21. arXiv:2212.06574  [pdf

    cs.DL cs.AI

    Artificial intelligence technologies to support research assessment: A review

    Authors: Kayvan Kousha, Mike Thelwall

    Abstract: This literature review identifies indicators that associate with higher impact or higher quality research from article text (e.g., titles, abstracts, lengths, cited references and readability) or metadata (e.g., the number of authors, international or domestic collaborations, journal impact factors and authors' h-index). This includes studies that used machine learning techniques to predict citati… ▽ More

    Submitted 11 December, 2022; originally announced December 2022.

  22. Is big team research fair in national research assessments? The case of the UK Research Excellence Framework 2021

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt

    Abstract: Collaborative research causes problems for research assessments because of the difficulty in fairly crediting its authors. Whilst splitting the rewards for an article amongst its authors has the greatest surface-level fairness, many important evaluations assign full credit to each author, irrespective of team size. The underlying rationales for this are labour reduction and the need to incentivise… ▽ More

    Submitted 11 December, 2022; originally announced December 2022.

    Journal ref: Journal of Data and Information Science, 8(1), 9-20 (2023)

  23. Why are co-authored academic articles more cited: Higher quality or larger audience?

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt

    Abstract: Co-authored articles tend to be more cited in many academic fields, but is this because they tend to be higher quality or is it an audience effect: increased awareness through multiple author networks? We address this unknown with the largest investigation yet into whether author numbers associate with research quality, using expert peer quality judgements for 122,331 non-review journal articles s… ▽ More

    Submitted 11 December, 2022; originally announced December 2022.

    Journal ref: Journal of the Association for Information Science and Technology, 74, 791-810 (2023)

  24. arXiv:2212.05420  [pdf

    cs.DL

    Terms in journal articles associating with high quality: Can qualitative research be world-leading?

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt

    Abstract: Purpose: Scholars often aim to conduct high quality research and their success is judged primarily by peer reviewers. Research quality is difficult for either group to identify, however, and misunderstandings can reduce the efficiency of the scientific enterprise. In response, we use a novel term association strategy to seek quantitative evidence of aspects of research that associate with high or… ▽ More

    Submitted 11 December, 2022; originally announced December 2022.

  25. In which fields do higher impact journals publish higher quality articles?

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt

    Abstract: The Journal Impact Factor and other indicators that assess the average citation rate of articles in a journal are consulted by many academics and research evaluators, despite initiatives against overreliance on them. Despite this, there is limited evidence about the extent to which journal impact indicators in any field relates to human judgements about the journals or their articles. In response,… ▽ More

    Submitted 11 December, 2022; originally announced December 2022.

  26. Is Research Funding Always Beneficial? A Cross-Disciplinary Analysis of UK Research 2014-20

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Cristina Font-Julián, Paul Wilson, Jonathan Levitt

    Abstract: The search for and management of external funding now occupies much valuable researcher time. Whilst funding is essential for some types of research and beneficial for others, it may also constrain academic choice and creativity. Thus, it is important to assess whether it is ever detrimental or unnecessary. Here we investigate whether funded research tends to be higher quality in all fields and fo… ▽ More

    Submitted 11 December, 2022; originally announced December 2022.

    Journal ref: Quantitative Science Studies, 4(2), 501-534 (2023)

  27. Which international co-authorships produce higher quality journal articles?

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt

    Abstract: International collaboration is sometimes encouraged in the belief that it generates higher quality research or is more capable of addressing societal problems. Nevertheless, while there is evidence that the journal articles of international teams tend to be more cited than average, perhaps from increased international audiences, there is no science-wide direct academic evidence of a connection bet… ▽ More

    Submitted 18 March, 2024; v1 submitted 11 December, 2022; originally announced December 2022.

    Comments: Journal of the American Society for Information Science and Technology

  28. In which fields are citations indicators of research quality?

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt

    Abstract: Citation counts are widely used as indicators of research quality to support or replace human peer review and for lists of top cited papers, researchers, and institutions. Nevertheless, the relationship between citations and research quality is poorly evidenced. We report the first large-scale science-wide academic evaluation of the relationship between research quality and citations (field normal… ▽ More

    Submitted 24 April, 2023; v1 submitted 11 December, 2022; originally announced December 2022.

    Journal ref: Journal of the Association for Information Science and Technology, 74(8), 941-953 (2023)

  29. Predicting article quality scores with machine learning: The UK Research Excellence Framework

    Authors: Mike Thelwall, Kayvan Kousha, Mahshid Abdoli, Emma Stuart, Meiko Makita, Paul Wilson, Jonathan Levitt, Petr Knoth, Matteo Cancellieri

    Abstract: National research evaluation initiatives and incentive schemes have previously chosen between simplistic quantitative indicators and time-consuming peer review, sometimes supported by bibliometrics. Here we assess whether artificial intelligence (AI) could provide a third alternative, estimating article quality using more multiple bibliometric and metadata inputs. We investigated this using provis… ▽ More

    Submitted 11 December, 2022; originally announced December 2022.

    Journal ref: Quantitative Science Studies, 4(2), 547-573 (2023)

  30. Is research with qualitative data more prevalent and impactful now? Interviews, case studies, focus groups and ethnographies

    Authors: Mike Thelwall, Tamara Nevill

    Abstract: Researchers, editors, educators and publishers need to understand the mix of research methods used in their field to guide decision making, with a current concern being that qualitative research is threatened by big data. Although there have been many studies of the prevalence of different methods within individual narrow fields, there have been no systematic studies across academia. In response,… ▽ More

    Submitted 24 April, 2021; originally announced April 2021.

    Comments: This is a preprint before refereeing of an accepted paper to appear in Library and Information Science Research. The data and figures and main findings are identical in the final version after refereeing. Library & Information Science Research (2021)

  31. arXiv:2104.09138  [pdf

    cs.DL cs.CY cs.SI

    Cures, Treatments and Vaccines for Covid-19: International differences in interest on Twitter

    Authors: Mike Thelwall

    Abstract: Since the Covid-19 pandemic is a global threat to health that few can fully escape, it has given a unique opportunity to study international reactions to a common problem. Such reactions can be partly obtained from public posts to Twitter, allowing investigations of changes in interest over time. This study analysed English-language Covid-19 tweets mentioning cures, treatments, or vaccines from 1… ▽ More

    Submitted 19 April, 2021; originally announced April 2021.

  32. arXiv:2103.14125  [pdf

    cs.DL cs.SI

    Can Twitter Give Insights into International Differences in Covid-19 Vaccination? Eight countries' English tweets to 21 March 2021

    Authors: Mike Thelwall

    Abstract: Vaccination programs may help the world to reduce or eliminate Covid-19. Information about them may help countries to design theirs more effectively, with important benefits for public health. This article investigates whether it is possible to get insights into national vaccination programmes from a quick international comparison of public comments on Twitter. For this, word association thematic… ▽ More

    Submitted 25 March, 2021; originally announced March 2021.

  33. arXiv:2102.04481  [pdf, other

    stat.ME cs.DL

    A Bayesian Hurdle Quantile Regression Model for Citation Analysis with Mass Points at Lower Values

    Authors: Marzieh Shahmandi, Paul Wilson, Mike Thelwall

    Abstract: Quantile regression presents a complete picture of the effects on the location, scale, and shape of the dependent variable at all points, not just the mean. We focus on two challenges for citation count analysis by quantile regression: discontinuity and substantial mass points at lower counts. A Bayesian hurdle quantile regression model for count data with a substantial mass point at zero was prop… ▽ More

    Submitted 10 July, 2021; v1 submitted 8 February, 2021; originally announced February 2021.

    Comments: Accepted in Quantitative Science Studies

  34. Exploring WorldCat Identities as an altmetric information source: A library catalog analysis experiment in the field of Scientometrics

    Authors: Daniel Torres-Salinas, Wenceslao Arroyo-Machado, Mike Thelwall

    Abstract: Assessing the impact of scholarly books is a difficult research evaluation problem. Library Catalog Analysis facilitates the quantitative study, at different levels, of the impact and diffusion of academic books based on data about their availability in libraries. The WorldCat global catalog collates data on library holdings, offering a range of tools including the novel WorldCat Identities. This… ▽ More

    Submitted 25 November, 2020; originally announced November 2020.

  35. arXiv:2006.07849  [pdf

    cs.DL cs.CL

    Pot, kettle: Nonliteral titles aren't (natural) science

    Authors: Mike Thelwall

    Abstract: Researchers may be tempted to attract attention through poetic titles for their publications, but would this be mistaken in some fields? Whilst poetic titles are known to be common in medicine, it is not clear whether the practice is widespread elsewhere. This article investigates the prevalence of poetic expressions in journal article titles 1996-2019 in 3.3 million articles from all 27 Scopus br… ▽ More

    Submitted 14 June, 2020; originally announced June 2020.

    Comments: Quantitative Science Studies, to appear

  36. arXiv:2006.03901  [pdf

    cs.DL

    Coronavirus research before 2020 is more relevant than ever, especially when interpreted for COVID-19

    Authors: Mike Thelwall

    Abstract: The speed with which biomedical researchers were able to identify and characterise COVID-19 was clearly due to prior research with other coronaviruses. Early epidemiological comparisons with two previous coronaviruses, Severe Acute Respiratory Syndrome (SARS) and Middle East Respiratory Syndrome (MERS), also made it easier to predict COVID-19's likely spread and lethality. This article assesses wh… ▽ More

    Submitted 6 June, 2020; originally announced June 2020.

  37. arXiv:2005.11512  [pdf

    cs.DL

    All downhill from the PhD? The typical impact trajectory of US academic careers

    Authors: Mike Thelwall, Ruth Fairclough

    Abstract: Within academia, mature researchers tend to be more senior, but do they also tend to write higher impact articles? This article assesses long-term publishing (16+ years) United States (US) researchers, contrasting them with shorter-term publishing researchers (1, 6 or 10 years). A long-term US researcher is operationalised as having a first Scopus-indexed journal article in exactly 2001 and one in… ▽ More

    Submitted 23 May, 2020; originally announced May 2020.

  38. Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations' COCI: a multidisciplinary comparison of coverage via citations

    Authors: Alberto Martín-Martín, Mike Thelwall, Enrique Orduna-Malea, Emilio Delgado López-Cózar

    Abstract: New sources of citation data have recently become available, such as Microsoft Academic, Dimensions, and the OpenCitations Index of CrossRef open DOI-to-DOI citations (COCI). Although these have been compared to the Web of Science (WoS), Scopus, or Google Scholar, there is no systematic evidence of their differences across subject categories. In response, this paper investigates 3,073,351 citation… ▽ More

    Submitted 30 January, 2021; v1 submitted 29 April, 2020; originally announced April 2020.

    Comments: 40 pages, 10 figures, 4 tables

    Journal ref: 2021. Scientometrics, 126(1), 871-906

  39. arXiv:2004.12159  [pdf

    cs.DL

    A gender equality paradox in academic publishing: Countries with a higher proportion of female first-authored journal articles have larger first author gender disparities between fields

    Authors: Mike Thelwall, Amalia Mas-Bleda

    Abstract: Current attempts to address the shortfall of female researchers in Science, Technology, Engineering and Mathematics (STEM) have not yet succeeded despite other academic subjects having female majorities. This article investigates the extent to which gender disparities are subject-wide or nation-specific by a first author gender comparison of 30 million articles from all 27 Scopus broad fields with… ▽ More

    Submitted 25 April, 2020; originally announced April 2020.

    Comments: Quantitative Science Studies, to appear

  40. arXiv:2004.10400  [pdf

    cs.DL

    COVID-19 publications: Database coverage, citations, readers, tweets, news, Facebook walls, Reddit posts

    Authors: Kayvan Kousha, Mike Thelwall

    Abstract: The COVID-19 pandemic requires a fast response from researchers to help address biological, medical and public health issues to minimize its impact. In this rapidly evolving context, scholars, professionals and the public may need to quickly identify important new studies. In response, this paper assesses the coverage of scholarly databases and impact indicators during 21 March to 18 April 2020. T… ▽ More

    Submitted 22 April, 2020; originally announced April 2020.

  41. arXiv:2004.02793  [pdf

    cs.DL cs.CY cs.HC

    A thematic analysis of highly retweeted early COVID -19 tweets: Consensus, information, dissent, and lockdown life

    Authors: Mike Thelwall, Saheeda Thelwall

    Abstract: Purpose: Public attitudes towards COVID-19 and social distancing are critical in reducing its spread. It is therefore important to understand public reactions and information dissemination in all major forms, including on social media. This article investigates important issues reflected on Twitter in the early stages of the public reaction to COVID-19. Design/methodology/approach: A thematic anal… ▽ More

    Submitted 2 October, 2020; v1 submitted 6 April, 2020; originally announced April 2020.

  42. arXiv:2003.11090  [pdf

    cs.DL cs.SI

    Covid-19 Tweeting in English: Gender Differences

    Authors: Mike Thelwall, Saheeda Thelwall

    Abstract: At the start of 2020, COVID-19 became the most urgent threat to global public health. Uniquely in recent times, governments have imposed partly voluntary, partly compulsory restrictions on the population to slow the spread of the virus. In this context, public attitudes and behaviors are vitally important for reducing the death rate. Analyzing tweets about the disease may therefore give insights i… ▽ More

    Submitted 24 March, 2020; originally announced March 2020.

  43. arXiv:1911.03379  [pdf

    cs.DL

    Does the use of open, non-anonymous peer review in scholarly publishing introduce bias? Evidence from the F1000 post-publication open peer review publishing model

    Authors: Mike Thelwall, Verena Weigert, Liz Allen, Zena Nyakoojo, Eleanor-Rose Papas

    Abstract: This study examines whether there is any evidence of bias in two areas of common critique of open, non-anonymous peer review - and used in the post-publication, peer review system operated by the open-access scholarly publishing platform F1000Research. First, is there evidence of bias where a reviewer based in a specific country assesses the work of an author also based in the same country? Second… ▽ More

    Submitted 8 November, 2019; originally announced November 2019.

    Comments: under review

  44. arXiv:1910.00789  [pdf

    cs.DL

    Academic collaboration rates and citation associations vary substantially between countries and fields

    Authors: Mike Thelwall, Nabeil Maflahi

    Abstract: Research collaboration is promoted by governments and research funders but if the relative prevalence and merits of collaboration vary internationally different national and disciplinary strategies may be needed to promote it. This study compares the team size and field normalised citation impact of research across all 27 Scopus broad fields in the ten countries with the most journal articles inde… ▽ More

    Submitted 2 October, 2019; originally announced October 2019.

    Comments: Thelwall, M. & Maflahi, N. (in press). Academic collaboration rates and citation associations vary substantially between countries and fields. Journal of the Association for Information Science and Technology

  45. arXiv:1909.02954  [pdf

    cs.DL

    Mendeley Reader Counts for US Computer Science Conference Papers and Journal articles

    Authors: Mike Thelwall

    Abstract: Although bibliometrics are normally applied to journal articles when used to support research evaluations, conference papers are at least as important in fast-moving computing-related fields. It is therefore important to assess the relative advantages of citations and altmetrics for computing conference papers to make an informed decision about which, if any, to use. This paper compares Scopus cit… ▽ More

    Submitted 6 September, 2019; originally announced September 2019.

    Comments: Quantitative Science Studies, to appear

  46. arXiv:1906.01849  [pdf

    cs.DL

    Large publishing consortia produce higher citation impact research but co-author contributions are hard to evaluate

    Authors: Mike Thelwall

    Abstract: This paper introduces a simple agglomerative clustering method to identify large publishing consortia with at least 20 authors and 80% shared authorship between articles. Based on Scopus journal articles 1996-2018, under these criteria, nearly all (88%) of the large consortia published research with citation impact above the world average, with the exceptions being mainly the newer consortia for w… ▽ More

    Submitted 5 June, 2019; originally announced June 2019.

    Comments: Quantitative Science Studies, to appear

  47. arXiv:1904.12919  [pdf

    cs.DL

    Female citation impact superiority 1996-2018 in six out of seven English-speaking nations

    Authors: Mike Thelwall

    Abstract: Efforts to combat continuing gender inequalities in academia need to be informed by evidence about where differences occur. Citations are relevant as potential evidence in appointment and promotion decisions, but it is unclear whether there have been historical gender differences in average citation impact that might explain the current shortfall of senior female academics. This study investigates… ▽ More

    Submitted 2 October, 2019; v1 submitted 29 April, 2019; originally announced April 2019.

    Comments: Thelwall, M. (in press). Female citation impact superiority 1996-2018 in six out of seven English-speaking nations. Journal of the Association for Information Science and Technology

  48. Should Citations be Counted Separately from Each Originating Section

    Authors: Mike Thelwall

    Abstract: Articles are cited for different purposes and differentiating between reasons when counting citations may therefore give finer-grained citation count information. Although identifying and aggregating the individual reasons for each citation may be impractical, recording the number of citations that originate from different article sections might illuminate the general reasons behind a citation cou… ▽ More

    Submitted 18 March, 2019; originally announced March 2019.

    Comments: Thelwall, M. (2019). Should citations be counted separately from each originating section? Journal of Informetrics

    Journal ref: Journal of Informetrics. 13(2), 658-678 (2019)

  49. The rhetorical structure of science? A multidisciplinary analysis of article headings

    Authors: Mike Thelwall

    Abstract: An effective structure helps an article to convey its core message. The optimal structure depends on the information to be conveyed and the expectations of the audience. In the current increasingly interdisciplinary era, structural norms can be confusing to the authors, reviewers and audiences of scientific articles. Despite this, no prior study has attempted to assess variations in the structure… ▽ More

    Submitted 11 March, 2019; originally announced March 2019.

    Comments: Thelwall, M. (2019). The rhetorical structure of science? A multidisciplinary analysis of article headings. Journal of Informetrics

    Journal ref: Journal of Informetrics. 13(3), 555-563 (2019)

  50. arXiv:1902.08746  [pdf

    cs.DL

    Can Google Scholar and Mendeley help to assess the scholarly impacts of dissertations?

    Authors: Kayvan Kousha, Mike Thelwall

    Abstract: Dissertations can be the single most important scholarly outputs of junior researchers. Whilst sets of journal articles are often evaluated with the help of citation counts from the Web of Science or Scopus, these do not index dissertations and so their impact is hard to assess. In response, this article introduces a new multistage method to extract Google Scholar citation counts for large collect… ▽ More

    Submitted 23 February, 2019; originally announced February 2019.

    Comments: Kousha, K. & Thelwall, M. (2019). Can Google Scholar and Mendeley help to assess the scholarly impacts of dissertations? Journal of Informetrics