-
Bibliometrics effects of a new item-by-item classification system based on reference reclassification
Authors:
Marcos Pena-Rocha,
Maria Rocio Gomez-Crisostomo,
Vicente Pablo Guerrero-Bote,
Felix de Moya-Anegon
Abstract:
This study presents a comparative analysis between two scientific document classification systems. The first system employs the Scopus journal-based assignment method, adapted to a fractional model, while the second system uses an item-by-item system based on reclassified references according to the origin of the citers. The study's results are divided into three different sections: the first invo…
▽ More
This study presents a comparative analysis between two scientific document classification systems. The first system employs the Scopus journal-based assignment method, adapted to a fractional model, while the second system uses an item-by-item system based on reclassified references according to the origin of the citers. The study's results are divided into three different sections: the first involves comparisons at the Scopus area level, the second examines comparisons at the category level, and the third tests various bibliometric indicators to identify the variations between the two systems. Highlighting the characteristics of the paper level system, it offers a reduction in the number of categories to which each document is assigned, achieving higher values of single-category assignment compared to the All Science Journal Classification (ASJC). When reclassifying areas and categories, the paper level system tends to accentuate differences at the extreme values, increasing the size of the largest categories and reducing that of the smallest ones. Moreover, the paper-by-paper system provides more homogeneous distributions in normalised impacts and adjusts values related to excellence more uniformly.
△ Less
Submitted 21 November, 2024; v1 submitted 31 October, 2024;
originally announced October 2024.
-
New paper-by-paper classification for Scopus based on references reclassified by the origin of the papers citing them
Authors:
Jesus M. Alvarez-Llorente,
Vicente P. Guerrero-Bote,
Felix de Moya-Anegon
Abstract:
A reference-based classification system for individual Scopus publications is presented which takes into account the categories of the papers citing those references instead of the journals in which those cited papers are published. It supports multiple assignments of up to 5 categories within the Scopus ASJC structure, but eliminates the Multidisciplinary Area and the miscellaneous categories, an…
▽ More
A reference-based classification system for individual Scopus publications is presented which takes into account the categories of the papers citing those references instead of the journals in which those cited papers are published. It supports multiple assignments of up to 5 categories within the Scopus ASJC structure, but eliminates the Multidisciplinary Area and the miscellaneous categories, and it allows for the reclassification of a greater number of publications (potentially 100%) than traditional reference-based systems. Twelve variants of the system were obtained by adjusting different parameters, which were applied to the more than 3.2 million citable papers from the active Scientific Journals in 2020 indexed in Scopus. The results were analyzed and compared with other classification systems such as the original journal-based Scopus ASJC, the 2-generation-reference based M3-AWC-0.8 (Álvarez-Llorente et al., 2024), and the corresponding authors' assignment based AAC (Álvarez-Llorente et al., 2023). The different variants obtained of the classification give results that improve those used as references in multiple scientometric fields. The variation called U1-F-0.8 seems especially promising due to its restraint in assigning multiple categories, consistency with reference classifications and the fact of applying normalization processes to avoid the overinfluence of articles that have a greater number of references.
△ Less
Submitted 20 February, 2025; v1 submitted 24 October, 2024;
originally announced October 2024.
-
New fractional classifications of papers based on two generations of references and on the ASJC Scopus scheme
Authors:
Jesus M. Alvarez Llorente,
Vicente P. Guerrero-Bote,
Felix de Moya-Anegon
Abstract:
This paper presents and evaluates a set of methods to classify individual Scopus publications using their references back to the second generation, where each publication can be assigned fractionally into up to five ASJC (All Science Journal Classifications) categories, excluding the Multidisciplinary area and the miscellaneous categories. Based on proposals by Glanzel et al. (1999a, 1999b, 2021),…
▽ More
This paper presents and evaluates a set of methods to classify individual Scopus publications using their references back to the second generation, where each publication can be assigned fractionally into up to five ASJC (All Science Journal Classifications) categories, excluding the Multidisciplinary area and the miscellaneous categories. Based on proposals by Glanzel et al. (1999a, 1999b, 2021), some additional parameters are established that allow different results to be obtained depending on how category membership is weighted or how the acceptance thresholds for multiple assignments are established. Various classifications are obtained, and then compared with each other, with the original ASJC Scopus journal classification, and with the AAC (Authors Assignation Collection) classification of a previous study (Alvarez-Llorente et al., 2023) in which the papers corresponding authors assign them the most appropriate categories. Classifications in which a high threshold is set for allowing assignments to multiple categories, combined with the use of first- and second-generation references and averaging over the number of references, provide the most promising results, improving over other reference-based reclassification proposals in terms of granularity, and over the Scopus classification itself in such aspects as the homogeneity of the publications assigned to a category. They also show greater coincidence with the AAC classification.
△ Less
Submitted 4 April, 2024;
originally announced April 2024.
-
Mapping the impact of papers on various status groups: A new excellence mapping tool based on citation and reader scores
Authors:
Lutz Bornmann,
Ruediger Mutz,
Robin Haunschild,
Felix de Moya-Anegon,
Mirko de Almeida Madeira Clemente,
Moritz Stefaner
Abstract:
In over five years, Bornmann, Stefaner, de Moya Anegon, and Mutz (2014) and Bornmann, Stefaner, de Moya Anegon, and Mutz (2014, 2015) have published several releases of the www.excellencemapping.net tool revealing (clusters of) excellent institutions worldwide based on citation data. With the new release, a completely revised tool has been published. It is not only based on citation data (bibliome…
▽ More
In over five years, Bornmann, Stefaner, de Moya Anegon, and Mutz (2014) and Bornmann, Stefaner, de Moya Anegon, and Mutz (2014, 2015) have published several releases of the www.excellencemapping.net tool revealing (clusters of) excellent institutions worldwide based on citation data. With the new release, a completely revised tool has been published. It is not only based on citation data (bibliometrics), but also Mendeley data (altmetrics). Thus, the institutional impact measurement of the tool has been expanded by focusing on additional status groups besides researchers such as students and librarians. Furthermore, the visualization of the data has been completely updated by improving the operability for the user and including new features such as institutional profile pages. In this paper, we describe the datasets for the current excellencemapping.net tool and the indicators applied. Furthermore, the underlying statistics for the tool and the use of the web application are explained.
△ Less
Submitted 18 March, 2021;
originally announced March 2021.
-
Bibliometric assessment of national scientific journals
Authors:
Henk F. Moed,
Felix de Moya-Anegon,
Vicente Guerrero-Bote,
Carmen Lopez-Illescas,
Myroslava Hladchenko
Abstract:
Nationally oriented scientific-scholarly journals are considered from a methodological-informetric viewpoint, analysing data extracted from Scimago Journal Rank based on Scopus. An operational definition is proposed of a journal's degree of national orientation based on the geographical distribution of its publishing or citing authors, and the role of international collaboration and a country's to…
▽ More
Nationally oriented scientific-scholarly journals are considered from a methodological-informetric viewpoint, analysing data extracted from Scimago Journal Rank based on Scopus. An operational definition is proposed of a journal's degree of national orientation based on the geographical distribution of its publishing or citing authors, and the role of international collaboration and a country's total publication output. A comprehensive analysis is presented of trends up until 2019 in national orientation and citation impact of national journals entering Scopus, extending outcomes in earlier studies. A method to analyse national journals of given countries is applied to the set of former USSR republics and Eastern and Central European states which were under socialism, distinguishing between domestic and foreign national journals. The possible influence is highlighted of factors related to a journal's access status, publication language and subject field, international scientific migration and collaboration, database coverage policies, the size of a national research community, historical-political factors and national research assessment and funding policies.
△ Less
Submitted 26 January, 2021;
originally announced January 2021.
-
Statistical relationships between corresponding authorship, international co-authorship and citation impact of national research systems
Authors:
Felix de Moya-Anegon,
Vicente P. Guerrero-Bote,
Carmen Lopez-Illescas,
Henk F. Moed
Abstract:
This paper presents a statistical analysis of the relationship between three science indicators applied in earlier bibliometric studies, namely research leadership based on corresponding authorship, international collaboration using international co-authorship data, and field-normalized citation impact. Indicators at the level of countries are extracted from the SIR database created by SCImago Res…
▽ More
This paper presents a statistical analysis of the relationship between three science indicators applied in earlier bibliometric studies, namely research leadership based on corresponding authorship, international collaboration using international co-authorship data, and field-normalized citation impact. Indicators at the level of countries are extracted from the SIR database created by SCImago Research Group from publication records indexed for Elsevier's Scopus. The relationship between authorship and citation-based indicators is found to be complex, as it reflects a country's phase of scientific development and the coverage policy of the database. Moreover, one should distinguish a genuine leadership effect from a purely statistical effect due to fractional counting. Further analyses at the level of institutions and qualitative validation studies are recommended.
△ Less
Submitted 5 June, 2020;
originally announced June 2020.
-
The citation impact of social sciences and humanities upon patentable technology
Authors:
Felix de Moya-Anegon,
Carmen Lopez-Illescas,
Vicente Guerrero-Bote,
Henk F. Moed
Abstract:
This paper examines the citation impact of papers published in scientific-scholarly journals upon patentable technology, as reflected in examiner- or inventor-given references in granted patents. It analyses data created by SCImago Research Group, linking PATSTAT's scientific non-patent references (SNPRs) to source documents indexed in Scopus. The frequency of patent citations to journal papers is…
▽ More
This paper examines the citation impact of papers published in scientific-scholarly journals upon patentable technology, as reflected in examiner- or inventor-given references in granted patents. It analyses data created by SCImago Research Group, linking PATSTAT's scientific non-patent references (SNPRs) to source documents indexed in Scopus. The frequency of patent citations to journal papers is calculated per discipline, year, institutional sector, journal subject category, and for "top" journals. PATSTAT/Scopus-based statistics are compared to those derived from Web of Science/USPTO linkage. A detailed assessment is presented of the technological impact of research publications in social sciences and humanities (SSH). Several subject fields perform well in terms of the number of citations from patents, especially Library & Information Science, Language & Linguistics, Education, and Law, but many of the most cited journals find themselves in the interface between SSH and biomedical or natural sciences. Analyses of the titles of citing patents and cited papers are presented that shed light upon the cognitive content of patent citations. It is proposed to develop more advanced indicators of citation impact of papers upon patents, and ways to combine citation counts with citation content and context analysis.
△ Less
Submitted 5 June, 2020;
originally announced June 2020.
-
Do journals flipping to Gold Open Access show an OA Citation or Publication Advantage?
Authors:
Nuria Bautista-Puig,
Carmen Lopez-Illescas,
Felix de Moya-Anegon,
Vicente Guerrero-Bote,
Henk F. Moed
Abstract:
The effects of Open Access (OA) upon journal performance are investigated. The key research question holds: How does the citation impact and publication output of journals switching ('flipping') from non-OA to Gold-OA develop after their switch to Gold-OA? A review is given of the literature, with an emphasis on studies dealing with flipping journals. Two study sets with 119 and 100 flipping journ…
▽ More
The effects of Open Access (OA) upon journal performance are investigated. The key research question holds: How does the citation impact and publication output of journals switching ('flipping') from non-OA to Gold-OA develop after their switch to Gold-OA? A review is given of the literature, with an emphasis on studies dealing with flipping journals. Two study sets with 119 and 100 flipping journals, derived from two different OA data sources (DOAJ and OAD), are compared with two control groups, one based on a standard bibliometric criterion, and a second controlling for a journal's national orientation. Comparing post-switch indicators with pre-switch ones in paired T-tests, evidence was obtained of an OA Citation advantage but not of an OA Publication Advantage. Shifts in the affiliation countries of publishing and citing authors are characterized in terms of countries' income class and geographical world region. Suggestions are made for qualitative follow-up studies to obtain more insight into OA flipping or reverse-flipping
△ Less
Submitted 18 May, 2020;
originally announced May 2020.
-
Are nationally oriented journals indexed in Scopus becoming more international? The effect of publication language and access modality
Authors:
Henk F. Moed,
Felix de Moya-Anegon,
Vicente Guerrero-Bote,
Carmen Lopez-Illescas
Abstract:
An exploratory, descriptive analysis is presented of the national orientation of scientific, scholarly journals as reflected in the affiliations of publishing or citing authors. It calculates for journals covered in Scopus an Index of National Orientation (INO), and analyses the distribution of INO values across disciplines and countries, and the correlation between INO values and journal impact f…
▽ More
An exploratory, descriptive analysis is presented of the national orientation of scientific, scholarly journals as reflected in the affiliations of publishing or citing authors. It calculates for journals covered in Scopus an Index of National Orientation (INO), and analyses the distribution of INO values across disciplines and countries, and the correlation between INO values and journal impact factors. The study did not find solid evidence that journal impact factors are good measures of journal internationality in terms of the geographical distribution of publishing or citing authors, as the relationship between a journal's national orientation and its citation impact is found to be inverse U-shaped. In addition, journals publishing in English are not necessarily internationally oriented in terms of the affiliations of publishing or citing authors; in social sciences and humanities also USA has their nationally oriented literatures. The paper examines the extent to which nationally oriented journals entering Scopus in earlier years, have become in recent years more international. It is found that in the study set about 40 per cent of such journals does reveal traces of internationalization, while the use of English as publication language and an Open Access (OA) status are important determinants.
△ Less
Submitted 18 February, 2020;
originally announced February 2020.
-
Categorization of an emerging discipline in the world publication system (SCOPUS): E-learning
Authors:
Gerardo Tibaná-Herrera,
María Teresa Fernández-Bajón,
Félix de Moya-Anegón
Abstract:
E-learning has been continuously present in current educational discourse, thanks to technological advances, learning methodologies and public or organizational policies, among other factors. However, despite its boom and dominance in various subject areas, this thematic does not yet exist in the world system of publications. Therefore, works in this thematic end up being published under related c…
▽ More
E-learning has been continuously present in current educational discourse, thanks to technological advances, learning methodologies and public or organizational policies, among other factors. However, despite its boom and dominance in various subject areas, this thematic does not yet exist in the world system of publications. Therefore, works in this thematic end up being published under related categories, particularly Education or categories within subject area Computer Science, thus fragmenting and make invisible the existing knowledge. This work is based on the hypothesis that the scientific communication of e-learning has a sufficient degree of cohesion to be considered as a thematic category in itself. From a bibliometric approach, its scientific production was analyzed, obtaining the bibliographic data of SCOPUS and SCImago, selecting its main descriptors and generating visualizations through VOSViewer with the mapping overlay technique, to represent its set and proximity. As a result, it was determined that a set of 219 publications show a high bibliometric interrelation among its articles and these are presented transversely between the social sciences, computer science and health. This set serves as a channel of scientific communication and structure of knowledge on the thematic and can therefore be considered as the basis for establishing the "e-learning" thematic category in the world system of scientific publications, contributing to the consolidation of the discipline, to its access and development by researchers.
△ Less
Submitted 16 October, 2017;
originally announced October 2017.
-
Aggregated journal-journal citation relations in Scopus and Web-of-Science matched and compared in terms of networks, maps, and interactive overlays
Authors:
Loet Leydesdorff,
Félix de Moya-Anegón,
Wouter de Nooy
Abstract:
We compare the network of aggregated journal-journal citation relations provided by the Journal Citation Reports (JCR) 2012 of the Science and Social Science Citation Indexes (SCI and SSCI) with similar data based on Scopus 2012. First, global maps were developed for the two sets separately; sets of documents can then be compared using overlays to both maps. Using fuzzy-string matching and ISSN nu…
▽ More
We compare the network of aggregated journal-journal citation relations provided by the Journal Citation Reports (JCR) 2012 of the Science and Social Science Citation Indexes (SCI and SSCI) with similar data based on Scopus 2012. First, global maps were developed for the two sets separately; sets of documents can then be compared using overlays to both maps. Using fuzzy-string matching and ISSN numbers, we were able to match 10,524 journal names between the two sets; that is, 96.4% of the 10,936 journals contained in JCR or 51.2% of the 20,554 journals covered by Scopus. Network analysis was then pursued on the set of journals shared between the two databases and the two sets of unique journals. Citations among the shared journals are more comprehensively covered in JCR than Scopus, so the network in JCR is denser and more connected than in Scopus. The ranking of shared journals in terms of indegree (that is, numbers of citing journals) or total citations is similar in both databases overall (Spearman's \r{ho} > 0.97), but some individual journals rank very differently. Journals that are unique to Scopus seem to be less important--they are citing shared journals rather than being cited by them--but the humanities are covered better in Scopus than in JCR.
△ Less
Submitted 14 June, 2014; v1 submitted 9 April, 2014;
originally announced April 2014.
-
Journal Maps, Interactive Overlays, and the Measurement of Interdisciplinarity on the Basis of Scopus Data (1996-2012)
Authors:
Loet Leydesdorff,
Félix de Moya-Anegón,
Vicente P. Guerrero-Bote
Abstract:
Using Scopus data, we construct a global map of science based on aggregated journal-journal citations from 1996-2012 (N of journals = 20,554). This base map enables users to overlay downloads from Scopus interactively. Using a single year (e.g., 2012), results can be compared with mappings based on the Journal Citation Reports at the Web-of-Science (N = 10,936). The Scopus maps are more detailed a…
▽ More
Using Scopus data, we construct a global map of science based on aggregated journal-journal citations from 1996-2012 (N of journals = 20,554). This base map enables users to overlay downloads from Scopus interactively. Using a single year (e.g., 2012), results can be compared with mappings based on the Journal Citation Reports at the Web-of-Science (N = 10,936). The Scopus maps are more detailed at both the local and global levels because of their greater coverage, including, for example, the arts and humanities. The base maps can be interactively overlaid with journal distributions in sets downloaded from Scopus, for example, for the purpose of portfolio analysis. Rao-Stirling diversity can be used as a measure of interdisciplinarity in the sets under study. Maps at the global and the local level, however, can be very different because of the different levels of aggregation involved. Two journals, for example, can both belong to the humanities in the global map, but participate in different specialty structures locally. The base map and interactive tools are available online (with instructions) at http://www.leydesdorff.net/scopus_ovl.
△ Less
Submitted 12 January, 2014; v1 submitted 18 October, 2013;
originally announced October 2013.
-
The new Excellence Indicator in the World Report of the SCImago Institutions Rankings 2011
Authors:
Lutz Bornmann,
Felix de Moya-Anegón,
Loet Leydesdorff
Abstract:
The new excellence indicator in the World Report of the SCImago Institutions Rankings (SIR) makes it possible to test differences in the ranking in terms of statistical significance. For example, at the 17th position of these rankings, UCLA has an output of 37,994 papers with an excellence indicator of 28.9. Stanford University follows at the 19th position with 37,885 papers and 29.1 excellence, a…
▽ More
The new excellence indicator in the World Report of the SCImago Institutions Rankings (SIR) makes it possible to test differences in the ranking in terms of statistical significance. For example, at the 17th position of these rankings, UCLA has an output of 37,994 papers with an excellence indicator of 28.9. Stanford University follows at the 19th position with 37,885 papers and 29.1 excellence, and z = - 0.607. The difference between these two institution thus is not statistically significant. We provide a calculator at http://www.leydesdorff.net/scimago11/scimago11.xls in which one can fill out this test for any two institutions and also for each institution on whether its score is significantly above or below expectation (assuming that 10% of the papers are for stochastic reasons in the top-10% set).
△ Less
Submitted 16 November, 2011; v1 submitted 11 October, 2011;
originally announced October 2011.
