Showing 1–12 of 12 results for author: Shu, P

Fine-Tuning Open-Source Large Language Models to Improve Their Performance on Radiation Oncology Tasks: A Feasibility Study to Investigate Their Potential Clinical Applications in Radiation Oncology

Authors: Peilong Wang, Zhengliang Liu, Yiwei Li, Jason Holmes, Peng Shu, Lian Zhang, Xiang Li, Quanzheng Li, Brady S. Laughlin, Diego Santos Toesca, Sujay A. Vora, Samir H. Patel, Terence T. Sio, Tianming Liu, Wei Liu

Abstract: Background: The radiation oncology clinical practice involves many steps relying on the dynamic interplay of abundant text data. Large language models have displayed remarkable capabilities in processing complex text information. But their direct applications in specific fields like radiation oncology remain underexplored. Purpose: This study aims to investigate whether fine-tuning LLMs with dom… ▽ More Background: The radiation oncology clinical practice involves many steps relying on the dynamic interplay of abundant text data. Large language models have displayed remarkable capabilities in processing complex text information. But their direct applications in specific fields like radiation oncology remain underexplored. Purpose: This study aims to investigate whether fine-tuning LLMs with domain knowledge can improve the performance on Task (1) treatment regimen generation, Task (2) treatment modality selection (photon, proton, electron, or brachytherapy), and Task (3) ICD-10 code prediction in radiation oncology. Methods: Data for 15,724 patient cases were extracted. Cases where patients had a single diagnostic record, and a clearly identifiable primary treatment plan were selected for preprocessing and manual annotation to have 7,903 cases of the patient diagnosis, treatment plan, treatment modality, and ICD-10 code. Each case was used to construct a pair consisting of patient diagnostics details and an answer (treatment regimen, treatment modality, or ICD-10 code respectively) for the supervised fine-tuning of these three tasks. Open source LLaMA2-7B and Mistral-7B models were utilized for the fine-tuning with the Low-Rank Approximations method. Accuracy and ROUGE-1 score were reported for the fine-tuned models and original models. Clinical evaluation was performed on Task (1) by radiation oncologists, while precision, recall, and F-1 score were evaluated for Task (2) and (3). One-sided Wilcoxon signed-rank tests were used to statistically analyze the results. Results: Fine-tuned LLMs outperformed original LLMs across all tasks with p-value <= 0.001. Clinical evaluation demonstrated that over 60% of the fine-tuned LLMs-generated treatment regimens were clinically acceptable. Precision, recall, and F1-score showed improved performance of fine-tuned LLMs. △ Less

Submitted 28 January, 2025; originally announced January 2025.

Assessing Large Language Models in Mechanical Engineering Education: A Study on Mechanics-Focused Conceptual Understanding

Authors: Jie Tian, Jixin Hou, Zihao Wu, Peng Shu, Zhengliang Liu, Yujie Xiang, Beikang Gu, Nicholas Filla, Yiwei Li, Ning Liu, Xianyan Chen, Keke Tang, Tianming Liu, Xianqiao Wang

Abstract: This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a manually crafted exam encompassing 126 multiple-choice questions, spanning various aspects of mechanics courses, including Fluid Mechanics, Mechanical Vibration, Engin… ▽ More This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a manually crafted exam encompassing 126 multiple-choice questions, spanning various aspects of mechanics courses, including Fluid Mechanics, Mechanical Vibration, Engineering Statics and Dynamics, Mechanics of Materials, Theory of Elasticity, and Continuum Mechanics. Three LLMs, including ChatGPT (GPT-3.5), ChatGPT (GPT-4), and Claude (Claude-2.1), were subjected to evaluation against engineering faculties and students with or without mechanical engineering background. The findings reveal GPT-4's superior performance over the other two LLMs and human cohorts in answering questions across various mechanics topics, except for Continuum Mechanics. This signals the potential future improvements for GPT models in handling symbolic calculations and tensor analyses. The performances of LLMs were all significantly improved with explanations prompted prior to direct responses, underscoring the crucial role of prompt engineering. Interestingly, GPT-3.5 demonstrates improved performance with prompts covering a broader domain, while GPT-4 excels with prompts focusing on specific subjects. Finally, GPT-4 exhibits notable advancements in mitigating input bias, as evidenced by guessing preferences for humans. This study unveils the substantial potential of LLMs as highly knowledgeable assistants in both mechanical pedagogy and scientific research. △ Less

Submitted 13 January, 2024; originally announced January 2024.

Comments: 30 pages, 7 figures, and 1 table

RadOnc-GPT: A Large Language Model for Radiation Oncology

Authors: Zhengliang Liu, Peilong Wang, Yiwei Li, Jason Holmes, Peng Shu, Lian Zhang, Chenbin Liu, Ninghao Liu, Dajiang Zhu, Xiang Li, Quanzheng Li, Samir H. Patel, Terence T. Sio, Tianming Liu, Wei Liu

Abstract: This paper presents RadOnc-GPT, a large language model specialized for radiation oncology through advanced tuning methods. RadOnc-GPT was finetuned on a large dataset of radiation oncology patient records from the Mayo Clinic in Arizona. The model employs instruction tuning on three key tasks - generating radiotherapy treatment regimens, determining optimal radiation modalities, and providing diag… ▽ More This paper presents RadOnc-GPT, a large language model specialized for radiation oncology through advanced tuning methods. RadOnc-GPT was finetuned on a large dataset of radiation oncology patient records from the Mayo Clinic in Arizona. The model employs instruction tuning on three key tasks - generating radiotherapy treatment regimens, determining optimal radiation modalities, and providing diagnostic descriptions/ICD codes based on patient diagnostic details. Evaluations conducted by comparing RadOnc-GPT outputs to general large language model outputs showed higher ROUGE scores in these three tasks. The study demonstrated the potential of using large language models fine-tuned using domain-specific knowledge like RadOnc-GPT to achieve transformational capabilities in highly specialized healthcare fields such as radiation oncology. However, our model's clinical relevance requires confirmation, and it specializes in only the aforementioned three specific tasks and lacks broader applicability. Furthermore, its evaluation through ROUGE scores might not reflect the true semantic and clinical accuracy - challenges we intend to address in future research. △ Less

Submitted 5 November, 2023; v1 submitted 18 September, 2023; originally announced September 2023.

Artificial General Intelligence for Radiation Oncology

Authors: Chenbin Liu, Zhengliang Liu, Jason Holmes, Lu Zhang, Lian Zhang, Yuzhen Ding, Peng Shu, Zihao Wu, Haixing Dai, Yiwei Li, Dinggang Shen, Ninghao Liu, Quanzheng Li, Xiang Li, Dajiang Zhu, Tianming Liu, Wei Liu

Abstract: The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can process extensive texts and large vision models (LVMs) such as the Segment Anything Model (SAM) can process extensive imaging data to enhance the efficiency and precision of radiation therapy. This paper explores full-sp… ▽ More The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can process extensive texts and large vision models (LVMs) such as the Segment Anything Model (SAM) can process extensive imaging data to enhance the efficiency and precision of radiation therapy. This paper explores full-spectrum applications of AGI across radiation oncology including initial consultation, simulation, treatment planning, treatment delivery, treatment verification, and patient follow-up. The fusion of vision data with LLMs also creates powerful multimodal models that elucidate nuanced clinical patterns. Together, AGI promises to catalyze a shift towards data-driven, personalized radiation therapy. However, these models should complement human expertise and care. This paper provides an overview of how AGI can transform radiation oncology to elevate the standard of patient care in radiation oncology, with the key insight being AGI's ability to exploit multimodal clinical data at scale. △ Less

Submitted 5 September, 2023; originally announced September 2023.

Promoting information spreading by using contact memory

Authors: Lei Gao, Wei Wang, Panpan Shu, Hui Gao, Lidia A. Braunstein

Abstract: Promoting information spreading is a booming research topic in network science community. However, the exiting studies about promoting information spreading seldom took into account the human memory, which plays an important role in the spreading dynamics. In this paper we propose a non-Markovian information spreading model on complex networks, in which every informed node contacts a neighbor by u… ▽ More Promoting information spreading is a booming research topic in network science community. However, the exiting studies about promoting information spreading seldom took into account the human memory, which plays an important role in the spreading dynamics. In this paper we propose a non-Markovian information spreading model on complex networks, in which every informed node contacts a neighbor by using the memory of neighbor's accumulated contact numbers in the past. We systematically study the information spreading dynamics on uncorrelated configuration networks and a group of $22$ real-world networks, and find an effective contact strategy of promoting information spreading, i.e., the informed nodes preferentially contact neighbors with small number of accumulated contacts. According to the effective contact strategy, the high degree nodes are more likely to be chosen as the contacted neighbors in the early stage of the spreading, while in the late stage of the dynamics, the nodes with small degrees are preferentially contacted. We also propose a mean-field theory to describe our model, which qualitatively agrees well with the stochastic simulations on both artificial and real-world networks. △ Less

Submitted 19 March, 2017; originally announced March 2017.

Comments: 6 pages, 6 figures

Comprehensive routing strategy on multilayer networks

Authors: Lei Gao, Panpan Shu, Ming Tang, Wei Wang, Hui Gao

Abstract: Designing an efficient routing strategy is of great importance to alleviate traffic congestion in multilayer networks. In this work, we design an effective routing strategy for multilayer networks by comprehensively considering the roles of nodes' local structures in micro-level, as well as the macro-level differences in transmission speeds between different layers. Both numerical and analytical r… ▽ More Designing an efficient routing strategy is of great importance to alleviate traffic congestion in multilayer networks. In this work, we design an effective routing strategy for multilayer networks by comprehensively considering the roles of nodes' local structures in micro-level, as well as the macro-level differences in transmission speeds between different layers. Both numerical and analytical results indicate that our proposed routing strategy can reasonably redistribute the traffic load of the low speed layer to the high speed layer, and thus the traffic capacity of multilayer networks are significantly enhanced compared with the monolayer low speed networks. There is an optimal combination of macro- and micro-level control parameters at which can remarkably alleviate the congestion and thus maximize the traffic capacity for a given multilayer network. Moreover, we find that increasing the size and the average degree of the high speed layer can enhance the traffic capacity of multilayer networks more effectively. We finally verify that real-world network topology does not invalidate the results. The theoretical predictions agree well with the numerical simulations. △ Less

Submitted 19 January, 2017; originally announced January 2017.

Comments: 9 pages, 7 gigures

Journal ref: Phys. Rev. E 100, 012310 (2019)

Recovery rate affects the effective epidemic threshold with synchronous updating

Authors: Panpan Shu, Wei Wang, Ming Tang, Pengcheng Zhao, Yi-Cheng Zhang

Abstract: Accurate identification of effective epidemic threshold is essential for understanding epidemic dynamics on complex networks. The existing studies on the effective epidemic threshold of the susceptible-infected-removed (SIR) model generally assume that all infected nodes immediately recover after the infection process, which more or less does not conform to the realistic situation of disease. In t… ▽ More Accurate identification of effective epidemic threshold is essential for understanding epidemic dynamics on complex networks. The existing studies on the effective epidemic threshold of the susceptible-infected-removed (SIR) model generally assume that all infected nodes immediately recover after the infection process, which more or less does not conform to the realistic situation of disease. In this paper, we systematically study the effect of arbitrary recovery rate on the SIR spreading dynamics on complex networks. We derive the theoretical effective epidemic threshold and final outbreak size based on the edge-based compartmental theory. To validate the proposed theoretical predictions, extensive numerical experiments are implemented by using asynchronous and synchronous updating methods. When asynchronous updating method is used in simulations, recovery rate does not affect the final state of spreading dynamics. But with synchronous updating, we find that the effective epidemic threshold decreases with recovery rate, and final outbreak size increases with recovery rate. A good agreement between the theoretical predictions and numerical results are observed on both synthetic and real-world networks. Our results extend the existing theoretical studies, and help us to understand the phase transition with arbitrary recovery rate. △ Less

Submitted 5 February, 2016; originally announced February 2016.

Comments: 7 pages, 4 figures

Journal ref: Chaos 26, 063108 (2016)

Dynamics of social contagions with heterogeneous adoption thresholds: Crossover phenomena in phase transition

Authors: Wei Wang, Ming Tang, Panpan Shu, Zhen Wang

Abstract: Heterogeneous adoption thresholds exist widely in social contagions, but were always neglected in previous studies. We first propose a non-Markovian spreading threshold model with general adoption threshold distribution. In order to understand the effects of heterogeneous adoption thresholds quantitatively, an edge-based compartmental theory is developed for the proposed model. We use a binary spr… ▽ More Heterogeneous adoption thresholds exist widely in social contagions, but were always neglected in previous studies. We first propose a non-Markovian spreading threshold model with general adoption threshold distribution. In order to understand the effects of heterogeneous adoption thresholds quantitatively, an edge-based compartmental theory is developed for the proposed model. We use a binary spreading threshold model as a specific example, in which some individuals have a low adoption threshold (i.e., activists) while the remaining ones hold a relatively high adoption threshold (i.e., bigots), to demonstrate that heterogeneous adoption thresholds markedly affect the final adoption size and phase transition. Interestingly, the first-order, second-order and hybrid phase transitions can be found in the system. More importantly, there are two different kinds of crossover phenomena in phase transition for distinct values of bigots' adoption threshold: a change from first-order or hybrid phase transition to the second-order phase transition. The theoretical predictions based on the suggested theory agree very well with the results of numerical simulations. △ Less

Submitted 10 September, 2015; originally announced September 2015.

Report number: New J. Phys.18 013029 (2016)

Dynamics of social contagions with limited contact capacity

Authors: Wei Wang, Panpan Shu, Yu-Xiao Zhu, Ming Tang, Yi-Cheng Zhang

Abstract: Individuals are always limited by some inelastic resources, such as time and energy, which restrict them to dedicate to social interaction and limit their contact capacity. Contact capacity plays an important role in dynamics of social contagions, which so far has eluded theoretical analysis. In this paper, we first propose a non-Markovian model to understand the effects of contact capacity on soc… ▽ More Individuals are always limited by some inelastic resources, such as time and energy, which restrict them to dedicate to social interaction and limit their contact capacity. Contact capacity plays an important role in dynamics of social contagions, which so far has eluded theoretical analysis. In this paper, we first propose a non-Markovian model to understand the effects of contact capacity on social contagions, in which each individual can only contact and transmit the information to a finite number of neighbors. We then develop a heterogeneous edge-based compartmental theory for this model, and a remarkable agreement with simulations is obtained. Through theory and simulations, we find that enlarging the contact capacity makes the network more fragile to behavior spreading. Interestingly, we find that both the continuous and discontinuous dependence of the final adoption size on the information transmission probability can arise. And there is a crossover phenomenon between the two types of dependence. More specifically, the crossover phenomenon can be induced by enlarging the contact capacity only when the degree exponent is above a critical degree exponent, while the the final behavior adoption size always grows continuously for any contact capacity when degree exponent is below the critical degree exponent. △ Less

Submitted 27 July, 2015; v1 submitted 15 May, 2015; originally announced May 2015.

Comments: 8 pages, 6 figures

Report number: CHAOS 25, 103102 (2015)

Preferential imitation of vaccinating behavior can invalidate the targeted subsidy on complex network

Authors: Hai-Feng Zhang, Pan-Pan Shu, Ming Tang, Michael Small

Abstract: We consider the effect of inducement to vaccinate during the spread of an infectious disease on complex networks. Suppose that public resources are finite and that only a small proportion of individuals can be vaccinated freely (complete subsidy), for the remainder of the population vaccination is a voluntary behavior --- and each vaccinated individual carries a perceived cost. We ask whether the… ▽ More We consider the effect of inducement to vaccinate during the spread of an infectious disease on complex networks. Suppose that public resources are finite and that only a small proportion of individuals can be vaccinated freely (complete subsidy), for the remainder of the population vaccination is a voluntary behavior --- and each vaccinated individual carries a perceived cost. We ask whether the classical targeted subsidy strategy is definitely better than the random strategy: does targeting subsidy at individuals perceived to be with the greatest risk actually help? With these questions, we propose a model to investigate the \emph{interaction effects} of the subsidy policies and individuals responses when facing subsidy policies on the epidemic dynamics on complex networks. In the model, a small proportion of individuals are freely vaccinated according to either the targeted or random subsidy policy, the remainder choose to vaccinate (or not) based on voluntary principle and update their vaccination decision via an imitation rule. Our findings show that the targeted strategy is only advantageous when individuals prefer to imitate the subsidized individuals' strategy. Otherwise, the effect of the targeted policy is worse than the random immunization, since individuals preferentially select non-subsidized individuals as the imitation objects. More importantly, we find that under the targeted subsidy policy, increasing the proportion of subsidized individuals may increase the final epidemic size. We further define social cost as the sum of the costs of vaccination and infection, and study how each of the two policies affect the social cost. Our result shows that there exist some optimal intermediate regions leading to the minimal social cost. △ Less

Submitted 27 March, 2015; originally announced March 2015.

Comments: 8 pages, 7 figures

Simulated identification of epidemic threshold on finite-size networks

Authors: Panpan Shu, Wei Wang, Ming Tang, Younghae Do

Abstract: Epidemic threshold is one of the most important features of the epidemic dynamics. Through a lot of numerical simulations in classic Susceptible-Infected-Recovered (SIR) and Susceptible-Infected-Susceptible (SIS) models on various types of networks, we study the simulated identification of epidemic thresholds on finite-size networks. We confirm that the susceptibility measure goes awry for the SIR… ▽ More Epidemic threshold is one of the most important features of the epidemic dynamics. Through a lot of numerical simulations in classic Susceptible-Infected-Recovered (SIR) and Susceptible-Infected-Susceptible (SIS) models on various types of networks, we study the simulated identification of epidemic thresholds on finite-size networks. We confirm that the susceptibility measure goes awry for the SIR model due to the bimodal distribution of outbreak sizes near the critical point, while the simulated thresholds of the SIS and SIR models can be accurately determined by analyzing the peak of the epidemic variability. We further verify the accuracy of theoretical predictions derived by the heterogeneous mean-field theory (HMF) and the quenched mean-field theory (QMF), by comparing them with the simulated threshold of the SIR model obtained from the variability measure. The results show that the HMF prediction agrees very well with the simulated threshold, except the case that the networks are disassortive, in which the QMF prediction is more close to the simulated threshold. △ Less

Submitted 15 October, 2014; v1 submitted 2 October, 2014; originally announced October 2014.

Comments: 14 pages, 5 figures

Effects of Weak Ties on Epidemic Predictability in Community Networks

Authors: Panpan Shu, Ming Tang, Kai Gong, Ying Liu

Abstract: Weak ties play a significant role in the structures and the dynamics of community networks. Based on the susceptible-infected model in contact process, we study numerically how weak ties influence the predictability of epidemic dynamics. We first investigate the effects of different kinds of weak ties on the variabilities of both the arrival time and the prevalence of disease, and find that the br… ▽ More Weak ties play a significant role in the structures and the dynamics of community networks. Based on the susceptible-infected model in contact process, we study numerically how weak ties influence the predictability of epidemic dynamics. We first investigate the effects of different kinds of weak ties on the variabilities of both the arrival time and the prevalence of disease, and find that the bridgeness with small degree can enhance the predictability of epidemic spreading. Once weak ties are settled, compared with the variability of arrival time, the variability of prevalence displays a diametrically opposed changing trend with both the distance of the initial seed to the bridgeness and the degree of the initial seed. More specifically, the further distance and the larger degree of the initial seed can induce the better predictability of arrival time and the worse predictability of prevalence. Moreover, we discuss the effects of weak tie number on the epidemic variability. As community strength becomes very strong, which is caused by the decrease of weak tie number, the epidemic variability will change dramatically. Compared with the case of hub seed and random seed, the bridgenss seed can result in the worst predictability of arrival time and the best predictability of prevalence. These results show that the variability of arrival time always marks a complete reversal trend of that of prevalence, which implies it is impossible to predict epidemic spreading in the early stage of outbreaks accurately. △ Less

Submitted 4 July, 2012; originally announced July 2012.

Comments: 8 pages, 6 figures

MSC Class: 65Zxx; 82Dxx