Quantifying Diagnostic Signal Decay in Dementia: A National Study of Medicare Hospitalization Data
Authors:
Federica Spoto,
Jiazi Tian,
Jonas Hügel,
Daniel T. Ortega,
Christine S. Ritchie,
Deborah Blacker,
Francesca Dominici,
Chirag J. Patel,
Daniel Mork,
Hossein Estiri
Abstract:
Background: Artificial intelligence (AI) models in healthcare depend on the fidelity of diagnostic data, yet the quality of such data is often compromised by variability in clinical documentation practices. In dementia, a condition already prone to diagnostic ambiguity, this variability may introduce systematic distortion into claims-based research and AI model development.
Methods: We analyzed…
▽ More
Background: Artificial intelligence (AI) models in healthcare depend on the fidelity of diagnostic data, yet the quality of such data is often compromised by variability in clinical documentation practices. In dementia, a condition already prone to diagnostic ambiguity, this variability may introduce systematic distortion into claims-based research and AI model development.
Methods: We analyzed Medicare Part A hospitalization data from 2016-2018 to examine patterns of dementia-related ICD-10 code utilization across more than 3,000 U.S. counties. Using a clinically informed classification of 17 ICD-10 codes grouped into five diagnostic categories, we applied the transitive Sequential Pattern Mining (tSPM+) algorithm to model temporal usage structures. We then used matrix similarity methods to compare local diagnostic patterns to national norms and fit multivariable linear regressions to identify county-level demographic and structural correlates of divergence.
Findings: We found substantial geographic and demographic variation in dementia-related diagnostic code usage. Non-specific codes were dominant nationwide, while Alzheimer's disease and vascular dementia codes showed pronounced variability. Temporal sequence analysis revealed consistent transitions from specific to non-specific codes, which suggest degradation of diagnostic specificity over time. Counties with higher proportions of rural residents, Medicaid-eligible patients, and Black or Hispanic dementia patients demonstrated significantly lower similarity to national usage patterns. Our model explained 38% of the variation in local-to-national diagnostic alignment.
△ Less
Submitted 17 June, 2025;
originally announced June 2025.
Evaluating GPT's Capability in Identifying Stages of Cognitive Impairment from Electronic Health Data
Authors:
Yu Leng,
Yingnan He,
Colin Magdamo,
Ana-Maria Vranceanu,
Christine S. Ritchie,
Shibani S. Mukerji,
Lidia M. V. R. Moura,
John R. Dickson,
Deborah Blacker,
Sudeshna Das
Abstract:
Identifying cognitive impairment within electronic health records (EHRs) is crucial not only for timely diagnoses but also for facilitating research. Information about cognitive impairment often exists within unstructured clinician notes in EHRs, but manual chart reviews are both time-consuming and error-prone. To address this issue, our study evaluates an automated approach using zero-shot GPT-4o…
▽ More
Identifying cognitive impairment within electronic health records (EHRs) is crucial not only for timely diagnoses but also for facilitating research. Information about cognitive impairment often exists within unstructured clinician notes in EHRs, but manual chart reviews are both time-consuming and error-prone. To address this issue, our study evaluates an automated approach using zero-shot GPT-4o to determine stage of cognitive impairment in two different tasks. First, we evaluated the ability of GPT-4o to determine the global Clinical Dementia Rating (CDR) on specialist notes from 769 patients who visited the memory clinic at Massachusetts General Hospital (MGH), and achieved a weighted kappa score of 0.83. Second, we assessed GPT-4o's ability to differentiate between normal cognition, mild cognitive impairment (MCI), and dementia on all notes in a 3-year window from 860 Medicare patients. GPT-4o attained a weighted kappa score of 0.91 in comparison to specialist chart reviews and 0.96 on cases that the clinical adjudicators rated with high confidence. Our findings demonstrate GPT-4o's potential as a scalable chart review tool for creating research datasets and assisting diagnosis in clinical settings in the future.
△ Less
Submitted 13 February, 2025;
originally announced February 2025.
