-
Robust Evidence for Declining Disruptiveness: Assessing the Role of Zero-Backward-Citation Works
Authors:
Michael Park,
Erin Leahey,
Russell J. Funk
Abstract:
We respond to Holst et al.'s (HATWG) critique that the observed decline in scientific disruptiveness demonstrated in Park et al. (PLF) stems from including works with zero backward citations (0-bcites). Applying their own advocated dataset, metric, and exclusion criteria, we demonstrate statistically and practically significant declines in disruptiveness that equal major benchmark transformations…
▽ More
We respond to Holst et al.'s (HATWG) critique that the observed decline in scientific disruptiveness demonstrated in Park et al. (PLF) stems from including works with zero backward citations (0-bcites). Applying their own advocated dataset, metric, and exclusion criteria, we demonstrate statistically and practically significant declines in disruptiveness that equal major benchmark transformations in science. Notably, we show that HATWG's own regression model -- designed specifically to address their concerns about 0-bcite works -- reveals highly significant declines for both papers (p<0.001) and patents (p<0.001), a finding they neither acknowledge nor interpret. Their critique is undermined by methodological deficiencies, including reliance on visual inspection without statistical assessment, and severe data quality issues in their SciSciNet dataset, which contains nearly three times more 0-bcite papers than our original data. HATWG's departure from established scientometric practices -- notably their inclusion of document types and fields known for poor metadata quality -- invalidates their conclusions. Monte Carlo simulations and additional analyses using multiple disruptiveness measures across datasets further validate the robustness of the declining trend. Our findings collectively demonstrate that the observed decline in disruptiveness is not an artifact of 0-bcite works but represents a substantive change in scientific and technological innovation patterns.
△ Less
Submitted 28 February, 2025;
originally announced March 2025.
-
Scientific and technological knowledge grows linearly over time
Authors:
Huquan Kang,
Luoyi Fu,
Russell J. Funk,
Xinbing Wang,
Jiaxin Ding,
Shiyu Liang,
Jianghao Wang,
Lei Zhou,
Chenghu Zhou
Abstract:
The past few centuries have witnessed a dramatic growth in scientific and technological knowledge. However, the nature of that growth - whether exponential or otherwise - remains controversial, perhaps partly due to the lack of quantitative characterizations. We evaluated knowledge as a collective thinking structure, using citation networks as a representation, by examining extensive datasets that…
▽ More
The past few centuries have witnessed a dramatic growth in scientific and technological knowledge. However, the nature of that growth - whether exponential or otherwise - remains controversial, perhaps partly due to the lack of quantitative characterizations. We evaluated knowledge as a collective thinking structure, using citation networks as a representation, by examining extensive datasets that include 213 million publications (1800-2020) and 7.6 million patents (1976-2020). We found that knowledge - which we conceptualize as the reduction of uncertainty in a knowledge network - grew linearly over time in naturally formed citation networks that themselves expanded exponentially. Moreover, our results revealed inflection points in the growth of knowledge that often corresponded to important developments within fields, such as major breakthroughs, new paradigms, or the emergence of entirely new areas of study. Around these inflection points, knowledge may grow rapidly or exponentially on a local scale, although the overall growth rate remains linear when viewed globally. Previous studies concluding an exponential growth of knowledge may have focused primarily on these local bursts of rapid growth around key developments, leading to the misconception of a global exponential trend. Our findings help to reconcile the discrepancy between the perceived exponential growth and the actual linear growth of knowledge by highlighting the distinction between local and global growth patterns. Overall, our findings reveal major science development trends for policymaking, showing that producing knowledge is far more challenging than producing papers.
△ Less
Submitted 12 September, 2024;
originally announced September 2024.
-
Characterizing Physician Referral Networks with Ricci Curvature
Authors:
Jeremy Wayland,
Russel J. Funk,
Bastian Rieck
Abstract:
Identifying (a) systemic barriers to quality healthcare access and (b) key indicators of care efficacy in the United States remains a significant challenge. To improve our understanding of regional disparities in care delivery, we introduce a novel application of curvature, a geometrical-topological property of networks, to Physician Referral Networks. Our initial findings reveal that Forman-Ricci…
▽ More
Identifying (a) systemic barriers to quality healthcare access and (b) key indicators of care efficacy in the United States remains a significant challenge. To improve our understanding of regional disparities in care delivery, we introduce a novel application of curvature, a geometrical-topological property of networks, to Physician Referral Networks. Our initial findings reveal that Forman-Ricci and Ollivier-Ricci curvature measures, which are known for their expressive power in characterizing network structure, offer promising indicators for detecting variations in healthcare efficacy while capturing a range of significant regional demographic features. We also present APPARENT, an open-source tool that leverages Ricci curvature and other network features to examine correlations between regional Physician Referral Networks structure, local census data, healthcare effectiveness, and patient outcomes.
△ Less
Submitted 24 October, 2024; v1 submitted 27 August, 2024;
originally announced August 2024.
-
Serendipity in Science
Authors:
Pyung Nahm,
Raviv Murciano-Goroff,
Michael Park,
Russell J. Funk
Abstract:
Serendipity plays an important role in scientific discovery. Indeed, many of the most important breakthroughs, ranging from penicillin to the electric battery, have been made by scientists who were stimulated by a chance exposure to unsought but useful information. However, not all scientists are equally likely to benefit from such serendipitous exposure. Although scholars generally agree that sci…
▽ More
Serendipity plays an important role in scientific discovery. Indeed, many of the most important breakthroughs, ranging from penicillin to the electric battery, have been made by scientists who were stimulated by a chance exposure to unsought but useful information. However, not all scientists are equally likely to benefit from such serendipitous exposure. Although scholars generally agree that scientists with a prepared mind are most likely to benefit from serendipitous encounters, there is much less consensus over what precisely constitutes a prepared mind, with some research suggesting the importance of openness and others emphasizing the need for deep prior experience in a particular domain. In this paper, we empirically investigate the role of serendipity in science by leveraging a policy change that exogenously shifted the shelving location of journals in university libraries and subsequently exposed scientists to unsought scientific information. Using large-scale data on 2.4 million papers published in 9,750 journals by 520,000 scientists at 115 North American research universities, we find that scientists with greater openness are more likely to benefit from serendipitous encounters. Following the policy change, these scientists tended to cite less familiar and newer work, and ultimately published papers that were more innovative. By contrast, we find little effect on innovativeness for scientists with greater depth of experience, who, in our sample, tended to cite more familiar and older work following the policy change.
△ Less
Submitted 14 August, 2023;
originally announced August 2023.
-
Investigating writing style as a contributor to gender gaps in science and technology
Authors:
Kara Kedrick,
Ekaterina Levitskaya,
Russell J. Funk
Abstract:
A growing stream of research finds that scientific contributions are evaluated differently depending on the gender of the author. In this article, we consider whether gender differences in writing styles - how men and women communicate their work - may contribute to these observed gender gaps. We ground our investigation in a framework for characterizing the linguistic style of written text, with…
▽ More
A growing stream of research finds that scientific contributions are evaluated differently depending on the gender of the author. In this article, we consider whether gender differences in writing styles - how men and women communicate their work - may contribute to these observed gender gaps. We ground our investigation in a framework for characterizing the linguistic style of written text, with two sets of features - informational (i.e., features that emphasize facts) and involved (i.e., features that emphasize relationships). Using a large sample of academic papers and patents, we find significant differences in writing style by gender, with women using more involved features in their writing. Papers and patents with more involved features also tend to be cited more by women. Our findings suggest that scientific text is not devoid of personal character, which could contribute to bias in evaluation, thereby compromising the norm of universalism as a foundational principle of science.
△ Less
Submitted 25 June, 2024; v1 submitted 28 April, 2022;
originally announced April 2022.
-
Conceptual structure and the growth of scientific knowledge
Authors:
Kara Kedrick,
Ekaterina Levitskaya,
Russell J. Funk
Abstract:
How does scientific knowledge grow? This question has occupied a central place in the philosophy of science, stimulating heated debates, but yielding no clear consensus. Many explanations can be understood in terms of whether and how they view the expansion of knowledge as proceeding through the accretion of scientific concepts into larger conceptual structures. Here, we examine these views empiri…
▽ More
How does scientific knowledge grow? This question has occupied a central place in the philosophy of science, stimulating heated debates, but yielding no clear consensus. Many explanations can be understood in terms of whether and how they view the expansion of knowledge as proceeding through the accretion of scientific concepts into larger conceptual structures. Here, we examine these views empirically, performing a large-scale analysis of the physical and social sciences, spanning five decades. Using natural language processing techniques, we create semantic networks of concepts, wherein noun phrases become linked when used in the same paper abstract. For both the physical and social sciences, we observe increasingly rigid conceptual cores (i.e., densely connected sets of highly central nodes) accompanied by the proliferation of periphery concepts (i.e., sparsely connected nodes that are highly connected to the core). Subsequently, we examine the relationship between conceptual structure and the growth of scientific knowledge, finding that scientific works are more innovative in fields with cores that have higher conceptual churn and with larger cores. Furthermore, scientific consensus is associated with reduced conceptual churn and fewer conceptual cores. Overall, our findings suggest that while the organization of scientific concepts is important for the growth of knowledge, the mechanisms vary across time.
△ Less
Submitted 30 April, 2024; v1 submitted 20 April, 2022;
originally announced April 2022.
-
The Emergence of Higher-Order Structure in Scientific and Technological Knowledge Networks
Authors:
Thomas Gebhart,
Russell J. Funk
Abstract:
The growth of science and technology is a recombinative process, wherein new discoveries and inventions are built from prior knowledge. Yet relatively little is known about the manner in which scientific and technological knowledge develop and coalesce into larger structures that enable or constrain future breakthroughs. Network science has recently emerged as a framework for measuring the structu…
▽ More
The growth of science and technology is a recombinative process, wherein new discoveries and inventions are built from prior knowledge. Yet relatively little is known about the manner in which scientific and technological knowledge develop and coalesce into larger structures that enable or constrain future breakthroughs. Network science has recently emerged as a framework for measuring the structure and dynamics of knowledge. While helpful, existing approaches struggle to capture the global properties of the underlying networks, leading to conflicting observations about the nature of scientific and technological progress. We bridge this methodological gap using tools from algebraic topology to characterize the higher-order structure of knowledge networks in science and technology across scale. We observe rapid growth in the higher-order structure of knowledge in many scientific and technological fields. This growth is not observable using traditional network measures. We further demonstrate that the emergence of higher-order structure coincides with decline in lower-order structure, and has historically far outpaced the corresponding emergence of higher-order structure in scientific and technological collaboration networks. Up to a point, increases in higher-order structure are associated with better outcomes, as measured by the novelty and impact of papers and patents. However, the nature of science and technology produced under higher-order regimes also appears to be qualitatively different from that produced under lower-order ones, with the former exhibiting greater linguistic abstractness and greater tendencies for building upon prior streams of knowledge.
△ Less
Submitted 23 November, 2020; v1 submitted 28 September, 2020;
originally announced September 2020.
-
A Dynamic Network Approach to Breakthrough Innovation
Authors:
Russell J. Funk,
Jason Owen-Smith
Abstract:
This paper outlines a framework for the study of innovation that treats discoveries as additions to evolving networks. As inventions enter they expand or limit the reach of the ideas they build on by influencing how successive discoveries use those ideas. The approach is grounded in novel measures of the extent to which an innovation amplifies or disrupts the status quo. Those measures index the e…
▽ More
This paper outlines a framework for the study of innovation that treats discoveries as additions to evolving networks. As inventions enter they expand or limit the reach of the ideas they build on by influencing how successive discoveries use those ideas. The approach is grounded in novel measures of the extent to which an innovation amplifies or disrupts the status quo. Those measures index the effects inventions have on subsequent uses of prior discoveries. In so doing, they characterize a theoretically important but elusive feature of innovation. We validate our approach by showing it: (1) discriminates among innovations of similar impact in analyses of U.S. patents; (2) identifies discoveries that amplify and disrupt technology streams in select case studies; (3) implies disruptive patents decrease the use of their predecessors by 60% in difference-in-differences estimation; and, (4) yields novel findings in analyses of patenting at 110 U.S. universities.
△ Less
Submitted 14 December, 2012;
originally announced December 2012.