mlsanityData to 7 Oct 2026

Foundation Models to Unlock Real-World Evidence from Nationwide Medical Claims

arXiv 2605.02740 ↗First posted 4 May 2026cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Evidence derived from large-scale real-world data (RWD) is increasingly informing regulatory evaluation and healthcare decision-making. Administrative claims provide population-scale, longitudinal records of healthcare utilization, expenditure, and detailed coding of diagnoses, procedures, and medications, yet their potential as a substrate for healthcare foundation models remains largely unexplored. Here we present ReClaim, a generative transformer trained from scratch on 43.8 billion medical events from more than 200 million enrollees in the MarketScan claims data spanning 2008-2022. ReClaim models longitudinal trajectories across diagnoses, procedures, medications, and expenditure, and was scaled to 140 million, 700 million, and 1.7 billion parameters. Across over 1,000 disease-onset prediction tasks, ReClaim achieved a mean AUC of 75.6%, substantially outperforming disease-specific LightGBM (66.3%) and the transformer-based Delphi model (69.4%), with the largest gains for rare diseases. These advantages held across retrospective and prospective evaluations and in external validation on two independent datasets. Performance improved monotonically with scale, and post-training added 13.8 percentage points over pre-training alone. Beyond disease prediction, ReClaim captured financial outcomes and improved real-world evidence (RWE) analyses: for healthcare expenditure forecasting it increased explained variance from 0.28 to 0.37 relative to LightGBM, and in a target trial emulation it reduced systematic bias by 72% on average relative to Delphi. Together, these results establish administrative claims as a scalable substrate for healthcare foundation models and show that learned representations generalize across time periods and data sources, supporting disease surveillance, expenditure forecasting, and RWE generation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

12 of 31 references.

References · 12

  1. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
  2. 2019BEHRT: Transformer for Electronic Health Recordscited by 258
  3. 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 101
  4. 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 85
  5. 2023MOTOR: A Time-To-Event Foundation Model For Structured Medical Recordscited by 75
  6. 2024Zero Shot Health Trajectory Prediction Using Transformercited by 74
  7. 2023Event Stream GPT: A Data Pre-processing and Modeling Library for Generative, Pre-trained Transformers over Continuous-time Sequences of Complex Eventscited by 46
  8. 2025Generative Medical Event Models Improve with Scalecited by 24
  9. 2024CEHR-GPT: Generating Electronic Health Records with Chronological Patient Timelinescited by 22
  10. 2025Exploring Scaling Laws for EHR Foundation Modelscited by 10
  11. 2025FoMoH: A clinically meaningful foundation model evaluation for structured electronic health recordscited by 6
  12. 2024Introducing the Large Medical Model: State of the art healthcare cost and risk prediction with transformers trained on patient event sequencescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.