mlsanityData to 7 Oct 2026

Repeated-Measure Leakage, Distribution Shift, and Reliability under Partial Observation in Patient World Models

arXiv 2610.04778 ↗First posted 3 Oct 2026cs.LGcited by 0

On the map: World models → Medical and surgical world models

Abstract (arXiv)

Patient world models are increasingly proposed for longitudinal prediction, intervention-aware reasoning, and clinical-trial simulation. Causal or clinical intervention validity is distinct from predictive generalization and reliability; before making stronger claims, the underlying predictive state should generalize across patients, survive realistic shifts and missing observations, and expose failure through meaningful reliability signals. We evaluate these prerequisites in a deliberately narrow setting: short-horizon digital-biomarker forecasting from PhysioNet GaitPDB, comprising 165 participants, 306 recordings, and 51,129 context-future pairs. Using persistence, ridge, MLP, GRU, Transformer, and a compact JEPA-style predictor, we build an evaluation ladder that progressively removes raw temporal overlap, same-recording familiarity, and same-patient familiarity before testing unseen-patient generalization. For GRU, NMSE rises from 0.1227 under random-window splitting to 0.1393 after eliminating raw train-test overlap and to 0.1961 under patient holdout. Among 54 participants with repeated recordings, exposure to a different recording from the same patient improves GRU NMSE from 0.2177 to 0.1556, while a recording-excluded identity hypothesis is not supported at the participant level. Under participant-held-out evaluation, MLP and Transformer are statistically indistinguishable. Study shift, a four-times-longer prediction gap, and partial observation further degrade performance; under 50% temporal masking, Transformer NMSE rises to 0.611 while MC-dropout predictive variance falls. We do not claim a longitudinal or intervention-aware simulator. Instead, the results support a prerequisite evaluation stack of patient separation, repeated-measure controls, shift, missingness, and uncertainty validation before stronger patient-world-model claims are trusted.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. First posted on arXiv 3 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Same Predictions, Different Harms: Causal Auditing of Patient World Models
  2. 2026Patient, Place, Prior (P3): What Counts as Personalization in Medical World Models?
  3. 2026CalTwin: Towards Calibrated, Shift-Robust Medical World Models via Fisher-Information Regularisation
  4. 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation
  5. 2026ChronoMedicalWorld: A Medical World Model for Learning Patient Trajectories from Longitudinal Care Data
  6. 2026Intervention-Aware Clinical World Model for Post-Op Outcome Forecasting in Cardiology
  7. 2026EHRWorld: A Patient-Centric Medical World Model for Long-Horizon Clinical Trajectories
  8. 2026Simulating clinical interventions with a generative multimodal model of human physiology