-
Consensus statement on the credibility assessment of ML predictors
Authors:
Alessandra Aldieri,
Thiranja Prasad Babarenda Gamage,
Antonino Amedeo La Mattina,
Yi Li,
Axel Loewe,
Francesco Pappalardo,
Marco Viceconti Italy
Abstract:
The rapid integration of machine learning (ML) predictors into in silico medicine has revolutionized the estimation of quantities of interest (QIs) that are otherwise challenging to measure directly. However, the credibility of these predictors is critical, especially when they inform high-stakes healthcare decisions. This position paper presents a consensus statement developed by experts within t…
▽ More
The rapid integration of machine learning (ML) predictors into in silico medicine has revolutionized the estimation of quantities of interest (QIs) that are otherwise challenging to measure directly. However, the credibility of these predictors is critical, especially when they inform high-stakes healthcare decisions. This position paper presents a consensus statement developed by experts within the In Silico World Community of Practice. We outline twelve key statements forming the theoretical foundation for evaluating the credibility of ML predictors, emphasizing the necessity of causal knowledge, rigorous error quantification, and robustness to biases. By comparing ML predictors with biophysical models, we highlight unique challenges associated with implicit causal knowledge and propose strategies to ensure reliability and applicability. Our recommendations aim to guide researchers, developers, and regulators in the rigorous assessment and deployment of ML predictors in clinical and biomedical contexts.
△ Less
Submitted 30 January, 2025;
originally announced January 2025.
-
ICPR 2024 Competition on Multiple Sclerosis Lesion Segmentation -- Methods and Results
Authors:
Alessia Rondinella,
Francesco Guarnera,
Elena Crispino,
Giulia Russo,
Clara Di Lorenzo,
Davide Maimone,
Francesco Pappalardo,
Sebastiano Battiato
Abstract:
This report summarizes the outcomes of the ICPR 2024 Competition on Multiple Sclerosis Lesion Segmentation (MSLesSeg). The competition aimed to develop methods capable of automatically segmenting multiple sclerosis lesions in MRI scans. Participants were provided with a novel annotated dataset comprising a heterogeneous cohort of MS patients, featuring both baseline and follow-up MRI scans acquire…
▽ More
This report summarizes the outcomes of the ICPR 2024 Competition on Multiple Sclerosis Lesion Segmentation (MSLesSeg). The competition aimed to develop methods capable of automatically segmenting multiple sclerosis lesions in MRI scans. Participants were provided with a novel annotated dataset comprising a heterogeneous cohort of MS patients, featuring both baseline and follow-up MRI scans acquired at different hospitals. MSLesSeg focuses on developing algorithms that can independently segment multiple sclerosis lesions of an unexamined cohort of patients. This segmentation approach aims to overcome current benchmarks by eliminating user interaction and ensuring robust lesion detection at different timepoints, encouraging innovation and promoting methodological advances.
△ Less
Submitted 10 October, 2024;
originally announced October 2024.
-
Multiple Sclerosis disease: a computational approach for investigating its drug interactions
Authors:
Simone Pernice,
Marco Beccuti,
Greta Romano,
Marzio Pennisi,
Alessandro Maglione,
Santina Cutrupi,
Francesco Pappalardo,
Lorenzo Capra,
Giuliana Franceschinis,
Massimiliano De Pierro,
Gianfranco Balbo,
Francesca Cordero,
Raffaele Calogero
Abstract:
Multiple Sclerosis (MS) is a chronic and potentially highly disabling disease that can cause permanent damage and deterioration of the central nervous system. In Europe it is the leading cause of non-traumatic disabilities in young adults, since more than 700,000 EU people suffer from MS. Although recent studies on MS pathophysiology have been provided, MS remains a challenging disease. In this co…
▽ More
Multiple Sclerosis (MS) is a chronic and potentially highly disabling disease that can cause permanent damage and deterioration of the central nervous system. In Europe it is the leading cause of non-traumatic disabilities in young adults, since more than 700,000 EU people suffer from MS. Although recent studies on MS pathophysiology have been provided, MS remains a challenging disease. In this context, thanks to recent advances in software and hardware technologies, computational models and computer simulations are becoming appealing research tools to support scientists in the study of such disease. Thus, motivated by this consideration we propose in this paper a new model to study the evolution of MS in silico, and the effects of the administration of Daclizumab drug, taking into account also spatiality and temporality of the involved phenomena. Moreover, we show how the intrinsic symmetries of the system can be exploited to drastically reduce the complexity of its analysis.
△ Less
Submitted 1 June, 2020;
originally announced June 2020.
-
In Silico Trial to test COVID-19 candidate vaccines: a case study with UISS platform
Authors:
Giulia Russo,
Marzio Pennisi,
Marco Viceconti,
Francesco Pappalardo
Abstract:
SARS-CoV-2 is a severe respiratory infection that infects humans. Its outburst entitled it as a pandemic emergence. To get a grip on this, outbreak specific preventive and therapeutic interventions are urgently needed. It must be said that, until now, there are no existing vaccines for coronaviruses. To promptly and rapidly respond to pandemic events, the application of in silico trials can be use…
▽ More
SARS-CoV-2 is a severe respiratory infection that infects humans. Its outburst entitled it as a pandemic emergence. To get a grip on this, outbreak specific preventive and therapeutic interventions are urgently needed. It must be said that, until now, there are no existing vaccines for coronaviruses. To promptly and rapidly respond to pandemic events, the application of in silico trials can be used for designing and testing medicines against SARS-CoV-2 and speed-up the vaccine discovery pipeline, predicting any therapeutic failure and minimizing undesired effects. Here, we present an in silico platform that showed to be in very good agreement with the latest literature in predicting SARS- CoV-2 dynamics and related immune system host response. Moreover, it has been used to predict the outcome of one of the latest suggested approach to design an effective vaccine, based on monoclonal antibody. UISS is then potentially ready to be used as an in silico trial platform to predict the outcome of vaccination strategy against SARS-CoV-2.
△ Less
Submitted 5 May, 2020;
originally announced May 2020.
-
Generation of digital patients for the simulation of tuberculosis with UISS-TB
Authors:
Marzio Pennisi,
Miguel A. Juarez,
Giulia Russo,
Marco Viceconti,
Francesco Pappalardo
Abstract:
EC funded STriTuVaD project aims to test, through a phase IIb clinical trial, two of the most advanced therapeutic vaccines against tuberculosis. In parallel, we have extended the Universal Immune System Simulator to include all relevant determinants of such clinical trial, to establish its predictive accuracy against the individual patients recruited in the trial, to use it to generate digital pa…
▽ More
EC funded STriTuVaD project aims to test, through a phase IIb clinical trial, two of the most advanced therapeutic vaccines against tuberculosis. In parallel, we have extended the Universal Immune System Simulator to include all relevant determinants of such clinical trial, to establish its predictive accuracy against the individual patients recruited in the trial, to use it to generate digital patients and predict their response to the HRT being tested, and to combine them to the observations made on physical patients using a new in silico-augmented clinical trial approach that uses a Bayesian adaptive design. This approach, where found effective could drastically reduce the cost of innovation in this critical sector of public healthcare. One of the most challenging task is to develop a methodology to reproduce biological diversity of the subjects that have to be simulated, i.e., provide an appropriate strategy for the generation of libraries of digital patients. This has been achieved through the the creation of the initial immune system repertoire in a stochastic way, and though the identification of a "vector of features" that combines both biological and pathophysiological parameters that personalize the digital patient to reproduce the physiology and the pathophysiology of the subject.
△ Less
Submitted 27 October, 2019;
originally announced October 2019.
-
Gene expression and pathway bioinformatics analysis detect a potential predictive value of MAP3K8 in thyroid cancer progression
Authors:
Valentina Di Salvatore,
Fiorenza Gianì,
Giulia Russo,
Marzio Pennisi,
Pasqualino Malandrino,
Francesco Frasca,
Francesco Pappalardo
Abstract:
Thyroid cancer is the commonest endocrine malignancy. Mutation in the BRAF serine/threonine kinase is the most frequent genetic alteration in thyroid cancer. Target therapy for advanced and poorly differentiated thyroid carcinomas include BRAF pathway inhibitors. Here, we evaluated the role of MAP3K8 expression as a potential driver of resistance to BRAF inhibition in thyroid cancer. By analyzing…
▽ More
Thyroid cancer is the commonest endocrine malignancy. Mutation in the BRAF serine/threonine kinase is the most frequent genetic alteration in thyroid cancer. Target therapy for advanced and poorly differentiated thyroid carcinomas include BRAF pathway inhibitors. Here, we evaluated the role of MAP3K8 expression as a potential driver of resistance to BRAF inhibition in thyroid cancer. By analyzing Gene Expression Omnibus data repository, across all thyroid cancer histotypes, we found that MAP3K8 is up-regulated in poorly differentiated thyroid carcinomas and its expression is related to a stem cell like phenotype and a poorer prognosis and survival. Taken together these data unravel a novel mechanism for thyroid cancer progression and chemo-resistance and confirm previous results obtained in cultured thyroid cancer stem cells
△ Less
Submitted 26 October, 2019;
originally announced October 2019.
-
POSITION PAPER: Credibility of In Silico Trial Technologies: A Theoretical Framing
Authors:
Marco Viceconti,
Miguel A. Juárez,
Cristina Curreli,
Marzio Pennisi,
Giulia Russo,
Francesco Pappalardo
Abstract:
Different research communities have developed various approaches to assess the credibility of predictive models. Each approach usually works well for a specific type of model, and under some epistemic conditions that are normally satisfied within that specific research domain. Some regulatory agencies recently started to consider evidences of safety and efficacy on new medical products obtained us…
▽ More
Different research communities have developed various approaches to assess the credibility of predictive models. Each approach usually works well for a specific type of model, and under some epistemic conditions that are normally satisfied within that specific research domain. Some regulatory agencies recently started to consider evidences of safety and efficacy on new medical products obtained using computer modelling and simulation (which is referred to as In Silico Trials); this has raised the attention in the computational medicine research community on the regulatory science aspects of this emerging discipline. But this poses a foundational problem: in the domain of biomedical research the use of computer modelling is relatively recent, without a widely accepted epistemic framing for problem of model credibility. Also, because of the inherent complexity of living organisms, biomedical modellers tend to use a variety of modelling methods, sometimes mixing them in the solution of a single problem. In such context merely adopting credibility approaches developed within other research community might not be appropriate. In this position paper we propose a theoretical framing for the problem of assessing the credibility of a predictive models for In Silico Trials, which accounts for the epistemic specificity of this research field and is general enough to be used for different type of models.
△ Less
Submitted 24 October, 2019; v1 submitted 10 September, 2019;
originally announced September 2019.
