Multimodal, Multi-Disease Medical Imaging Foundation Model (MerMED-FM)
Authors:
Yang Zhou,
Chrystie Wan Ning Quek,
Jun Zhou,
Yan Wang,
Yang Bai,
Yuhe Ke,
Jie Yao,
Laura Gutierrez,
Zhen Ling Teo,
Darren Shu Jeng Ting,
Brian T. Soetikno,
Christopher S. Nielsen,
Tobias Elze,
Zengxiang Li,
Linh Le Dinh,
Lionel Tim-Ee Cheng,
Tran Nguyen Tuan Anh,
Chee Leong Cheng,
Tien Yin Wong,
Nan Liu,
Iain Beehuat Tan,
Tony Kiat Hon Lim,
Rick Siow Mong Goh,
Yong Liu,
Daniel Shu Wei Ting
Abstract:
Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training these models typically requires large, labour-intensive, well-labelled datasets. We developed MerMED-FM, a state-of-the-art multimodal, multi-specialty foundatio…
▽ More
Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training these models typically requires large, labour-intensive, well-labelled datasets. We developed MerMED-FM, a state-of-the-art multimodal, multi-specialty foundation model trained using self-supervised learning and a memory module. MerMED-FM was trained on 3.3 million medical images from over ten specialties and seven modalities, including computed tomography (CT), chest X-rays (CXR), ultrasound (US), pathology patches, color fundus photography (CFP), optical coherence tomography (OCT) and dermatology images. MerMED-FM was evaluated across multiple diseases and compared against existing foundational models. Strong performance was achieved across all modalities, with AUROCs of 0.988 (OCT); 0.982 (pathology); 0.951 (US); 0.943 (CT); 0.931 (skin); 0.894 (CFP); 0.858 (CXR). MerMED-FM has the potential to be a highly adaptable, versatile, cross-specialty foundation model that enables robust medical imaging interpretation across diverse medical disciplines.
△ Less
Submitted 30 June, 2025;
originally announced July 2025.
Social network analysis of Staphylococcus aureus carriage in a general youth population
Authors:
Dina Benedicte Stensen,
Rafael Adolfo Nozal Cañadas,
Lars Småbrekke,
Karina Olsen,
Christopher Sivert Nielsen,
Kristian Svendsen,
Anne Merethe Hanssen,
Johanna Sollid,
Gunnar Skov Simonsen,
Lars Ailo Bongo,
Anne-Sofie Furberg
Abstract:
Staphylococcus aureus nasal carriage increases risk of infection and has been associated with lifestyle behavior and biological host characteristics. We used social network analysis to evaluate whether contacts have the same S. aureus genotype, or whether contagiousness is an indirect effect of contacts sharing the same lifestyle or characteristics.
The Fit Futures 1 study collected data on soci…
▽ More
Staphylococcus aureus nasal carriage increases risk of infection and has been associated with lifestyle behavior and biological host characteristics. We used social network analysis to evaluate whether contacts have the same S. aureus genotype, or whether contagiousness is an indirect effect of contacts sharing the same lifestyle or characteristics.
The Fit Futures 1 study collected data on social contact among 1038 first level students in the same high school district in Norway. S. aureus persistent carriage was determined from two nasal swab cultures and genotype from spa-typing of a positive throat swab culture. Bootstrap, t-tests, logistic regression, and autocorrelation were used to evaluate social network influence on host risk factors and S. aureus carriage.
Both persistent carriage and spa-type were transmitted in the social network (p<0.001). The probability of carriage increased by 3.7% and 5.0% for each additional S. aureus positive friend, in univariable regression and multivariable autocorrelation analysis respectively. Male sex was associated with a 15% lower risk of transmission compared to women, although the prevalence of carriage was higher for men (36% versus 24%). Medium physical activity, medium and high alcohol-use, and normal-weight students had higher number of contacts, and increased risk of transmission (p<0.002).
We demonstrate direct social transmission of S. aureus in a general youth population. Lifestyle factors are associated with risk of transmission suggesting indirect social group effects from having more similar environmental exposures. The predominance in carriage is determined by sex-specific predisposing host characteristics as social transmission is less frequent than in females. Better understanding of how social interactions influence S. aureus carriage dynamics in the population is important for developing new preventive measures.
△ Less
Submitted 17 February, 2022;
originally announced February 2022.
