Repeated-Measure Leakage, Distribution Shift, and Reliability under Partial Observation in Patient World Models
On the map: World models → Medical and surgical world models
Abstract (arXiv)
Patient world models are increasingly proposed for longitudinal prediction, intervention-aware reasoning, and clinical-trial simulation. Causal or clinical intervention validity is distinct from predictive generalization and reliability; before making stronger claims, the underlying predictive state should generalize across patients, survive realistic shifts and missing observations, and expose failure through meaningful reliability signals. We evaluate these prerequisites in a deliberately narrow setting: short-horizon digital-biomarker forecasting from PhysioNet GaitPDB, comprising 165 participants, 306 recordings, and 51,129 context-future pairs. Using persistence, ridge, MLP, GRU, Transformer, and a compact JEPA-style predictor, we build an evaluation ladder that progressively removes raw temporal overlap, same-recording familiarity, and same-patient familiarity before testing unseen-patient generalization. For GRU, NMSE rises from 0.1227 under random-window splitting to 0.1393 after eliminating raw train-test overlap and to 0.1961 under patient holdout. Among 54 participants with repeated recordings, exposure to a different recording from the same patient improves GRU NMSE from 0.2177 to 0.1556, while a recording-excluded identity hypothesis is not supported at the participant level. Under participant-held-out evaluation, MLP and Transformer are statistically indistinguishable. Study shift, a four-times-longer prediction gap, and partial observation further degrade performance; under 50% temporal masking, Transformer NMSE rises to 0.611 while MC-dropout predictive variance falls. We do not claim a longitudinal or intervention-aware simulator. Instead, the results support a prerequisite evaluation stack of patient separation, repeated-measure controls, shift, missingness, and uncertainty validation before stronger patient-world-model claims are trusted.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. First posted on arXiv 3 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Same Predictions, Different Harms: Causal Auditing of Patient World Models
- 2026Patient, Place, Prior (P3): What Counts as Personalization in Medical World Models?
- 2026CalTwin: Towards Calibrated, Shift-Robust Medical World Models via Fisher-Information Regularisation
- 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation
- 2026ChronoMedicalWorld: A Medical World Model for Learning Patient Trajectories from Longitudinal Care Data
- 2026Intervention-Aware Clinical World Model for Post-Op Outcome Forecasting in Cardiology
- 2026EHRWorld: A Patient-Centric Medical World Model for Long-Horizon Clinical Trajectories
- 2026Simulating clinical interventions with a generative multimodal model of human physiology