Scorecards for Synthetic Medical Data Evaluation and Reporting
Authors:
Ghada Zamzmi,
Adarsh Subbaswamy,
Elena Sizikova,
Edward Margerrison,
Jana Delfino,
Aldo Badano
Abstract:
Although interest in synthetic medical data (SMD) for training and testing AI methods is growing, the absence of a standardized framework to evaluate its quality and applicability hinders its wider adoption. Here, we outline an evaluation framework designed to meet the unique requirements of medical applications, and introduce SMD Card, which can serve as comprehensive reports that accompany artif…
▽ More
Although interest in synthetic medical data (SMD) for training and testing AI methods is growing, the absence of a standardized framework to evaluate its quality and applicability hinders its wider adoption. Here, we outline an evaluation framework designed to meet the unique requirements of medical applications, and introduce SMD Card, which can serve as comprehensive reports that accompany artificially generated datasets. This card provides a transparent and standardized framework for evaluating and reporting the quality of synthetic data, which can benefit SMD developers, users, and regulators, particularly for AI models using SMD in regulatory submissions.
△ Less
Submitted 3 December, 2024; v1 submitted 16 June, 2024;
originally announced June 2024.