Foundation Models to Unlock Real-World Evidence from Nationwide Medical Claims
Not on the map. Why?
Abstract (arXiv)
Evidence derived from large-scale real-world data (RWD) is increasingly informing regulatory evaluation and healthcare decision-making. Administrative claims provide population-scale, longitudinal records of healthcare utilization, expenditure, and detailed coding of diagnoses, procedures, and medications, yet their potential as a substrate for healthcare foundation models remains largely unexplored. Here we present ReClaim, a generative transformer trained from scratch on 43.8 billion medical events from more than 200 million enrollees in the MarketScan claims data spanning 2008-2022. ReClaim models longitudinal trajectories across diagnoses, procedures, medications, and expenditure, and was scaled to 140 million, 700 million, and 1.7 billion parameters. Across over 1,000 disease-onset prediction tasks, ReClaim achieved a mean AUC of 75.6%, substantially outperforming disease-specific LightGBM (66.3%) and the transformer-based Delphi model (69.4%), with the largest gains for rare diseases. These advantages held across retrospective and prospective evaluations and in external validation on two independent datasets. Performance improved monotonically with scale, and post-training added 13.8 percentage points over pre-training alone. Beyond disease prediction, ReClaim captured financial outcomes and improved real-world evidence (RWE) analyses: for healthcare expenditure forecasting it increased explained variance from 0.28 to 0.37 relative to LightGBM, and in a target trial emulation it reduced systematic bias by 72% on average relative to Delphi. Together, these results establish administrative claims as a scalable substrate for healthcare foundation models and show that learned representations generalize across time periods and data sources, supporting disease surveillance, expenditure forecasting, and RWE generation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
12 of 31 references.
References · 12
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
- 2019BEHRT: Transformer for Electronic Health Recordscited by 258
- 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 101
- 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 85
- 2023MOTOR: A Time-To-Event Foundation Model For Structured Medical Recordscited by 75
- 2024Zero Shot Health Trajectory Prediction Using Transformercited by 74
- 2023Event Stream GPT: A Data Pre-processing and Modeling Library for Generative, Pre-trained Transformers over Continuous-time Sequences of Complex Eventscited by 46
- 2025Generative Medical Event Models Improve with Scalecited by 24
- 2024CEHR-GPT: Generating Electronic Health Records with Chronological Patient Timelinescited by 22
- 2025Exploring Scaling Laws for EHR Foundation Modelscited by 10
- 2025FoMoH: A clinically meaningful foundation model evaluation for structured electronic health recordscited by 6
- 2024Introducing the Large Medical Model: State of the art healthcare cost and risk prediction with transformers trained on patient event sequencescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.