Foundation Models in Medical Imaging -- A Review and Outlook
Authors:
Vivien van Veldhuizen,
Vanessa Botha,
Chunyao Lu,
Melis Erdal Cesur,
Kevin Groot Lipman,
Edwin D. de Jong,
Hugo Horlings,
Clárisa I. Sanchez,
Cees G. M. Snoek,
Lodewyk Wessels,
Ritse Mann,
Eric Marcus,
Jonas Teuwen
Abstract:
Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features that can later be adapted to specific clinical tasks with little additional supervision. In this review, we examine how FMs are being developed and applied in pa…
▽ More
Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features that can later be adapted to specific clinical tasks with little additional supervision. In this review, we examine how FMs are being developed and applied in pathology, radiology, and ophthalmology, drawing on evidence from over 150 studies. We explain the core components of FM pipelines, including model architectures, self-supervised learning methods, and strategies for downstream adaptation. We also review how FMs are being used in each imaging domain and compare design choices across applications. Finally, we discuss key challenges and open questions to guide future research.
△ Less
Submitted 16 June, 2025; v1 submitted 10 June, 2025;
originally announced June 2025.
