CEHR-XGPT: A Scalable Multi-Task Foundation Model for Electronic Health Records
Authors:
Chao Pang,
Jiheum Park,
Xinzhuo Jiang,
Nishanth Parameshwar Pavinkurve,
Krishna S. Kalluri,
Shalmali Joshi,
Noémie Elhadad,
Karthik Natarajan
Abstract:
Electronic Health Records (EHRs) provide a rich, longitudinal view of patient health and hold significant potential for advancing clinical decision support, risk prediction, and data-driven healthcare research. However, most artificial intelligence (AI) models for EHRs are designed for narrow, single-purpose tasks, limiting their generalizability and utility in real-world settings. Here, we presen…
▽ More
Electronic Health Records (EHRs) provide a rich, longitudinal view of patient health and hold significant potential for advancing clinical decision support, risk prediction, and data-driven healthcare research. However, most artificial intelligence (AI) models for EHRs are designed for narrow, single-purpose tasks, limiting their generalizability and utility in real-world settings. Here, we present CEHR-XGPT, a general-purpose foundation model for EHR data that unifies three essential capabilities - feature representation, zero-shot prediction, and synthetic data generation - within a single architecture. To support temporal reasoning over clinical sequences, CEHR-XGPT incorporates a novel time-token-based learning framework that explicitly encodes patients' dynamic timelines into the model structure. CEHR-XGPT demonstrates strong performance across all three tasks and generalizes effectively to external datasets through vocabulary expansion and fine-tuning. Its versatility enables rapid model development, cohort discovery, and patient outcome forecasting without the need for task-specific retraining.
△ Less
Submitted 5 September, 2025; v1 submitted 3 September, 2025;
originally announced September 2025.
CEHR-GPT: Generating Electronic Health Records with Chronological Patient Timelines
Authors:
Chao Pang,
Xinzhuo Jiang,
Nishanth Parameshwar Pavinkurve,
Krishna S. Kalluri,
Elise L. Minto,
Jason Patterson,
Linying Zhang,
George Hripcsak,
Gamze Gürsoy,
Noémie Elhadad,
Karthik Natarajan
Abstract:
Synthetic Electronic Health Records (EHR) have emerged as a pivotal tool in advancing healthcare applications and machine learning models, particularly for researchers without direct access to healthcare data. Although existing methods, like rule-based approaches and generative adversarial networks (GANs), generate synthetic data that resembles real-world EHR data, these methods often use a tabula…
▽ More
Synthetic Electronic Health Records (EHR) have emerged as a pivotal tool in advancing healthcare applications and machine learning models, particularly for researchers without direct access to healthcare data. Although existing methods, like rule-based approaches and generative adversarial networks (GANs), generate synthetic data that resembles real-world EHR data, these methods often use a tabular format, disregarding temporal dependencies in patient histories and limiting data replication. Recently, there has been a growing interest in leveraging Generative Pre-trained Transformers (GPT) for EHR data. This enables applications like disease progression analysis, population estimation, counterfactual reasoning, and synthetic data generation. In this work, we focus on synthetic data generation and demonstrate the capability of training a GPT model using a particular patient representation derived from CEHR-BERT, enabling us to generate patient sequences that can be seamlessly converted to the Observational Medical Outcomes Partnership (OMOP) data format.
△ Less
Submitted 5 May, 2024; v1 submitted 6 February, 2024;
originally announced February 2024.
