# CalTwin: Towards Calibrated, Shift-Robust Medical World Models via Fisher-Information Regularisation

arXiv: https://arxiv.org/abs/2607.26752 · HTML: https://mlsanity.com/paper/2607.26752/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Placed in Medical and surgical world models, one of 11 directions in World models.
- Builds on 8 of its 14 references that are in the map.
- First posted on arXiv 29 Jul 2026.

## Placed in

- World models / [Medical and surgical world models](https://mlsanity.com/wm/medical-and-surgical-world-models/)

## Builds on (most cited first, 8 of 8)

- [On Calibration of Modern Neural Networks](https://mlsanity.com/paper/1706.04599/) (2017)
- [Overcoming catastrophic forgetting in neural networks](https://mlsanity.com/paper/1612.00796/) (2016)
- [Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift](https://mlsanity.com/paper/1906.02530/) (2019)
- [Generative AI-Driven Human Digital Twin in IoT-Healthcare: A Comprehensive Survey](https://mlsanity.com/paper/2401.13699/) (2024)
- [Beyond Generative AI: World Models for Clinical Prediction, Counterfactuals, and Planning](https://mlsanity.com/paper/2511.16333/) (2025)
- [Confidence-calibrated covariate shift correction for few-shot classification in Vision-Language Models](https://mlsanity.com/paper/2502.07847/) (2025)
- [Causal Covariate Shift Correction using Fisher information penalty](https://mlsanity.com/paper/2502.15756/) (2025)
- [Mitigating covariate shift in non-colocated data with learned parameter priors](https://mlsanity.com/paper/2411.06499/) (2024)

## Built on by (most cited first, 1 of 1)

- [Generated Context versus Governed State: Functional Conditions for Accountable Longitudinal Clinical Reasoning](https://mlsanity.com/paper/2608.14804/) (2026)

## Abstract (arXiv)

Medical world models aim to learn a latent state of patient or organ physiology and a transition function that forecasts how that state evolves under interventions, supporting downstream tasks from imaging-based diagnosis to digital-twin treatment planning. Two failure modes threaten the reliability of such models in clinical deployment: (i)~covariate shift, because training data are fragmented across hospitals, scanners, and time, so the feature distribution seen by the latent-dynamics predictor differs across fragments and from the distribution at deployment; and (ii)~confidence misalignment, because multi-step forecasts are often overconfident exactly where clinical risk is highest. We argue that both problems admit a unified treatment via a single lightweight regularisation objective, CalTwin, which combines a Fisher-Information-based shift penalty adapted from our prior work on fragmented covariate-shift remediation~citekhan2025mitigating,khan2025causal with a Confidence Misalignment Penalty adapted from our prior work on calibrated vision-language classification~citekhan2025confidence, applied here to a GRU-based medical world model's latent transition predictor. We derive the combined objective, establish which proof steps transfer from the classification setting without modification and which require adaptation, and evaluate it on the PhysioNet 2019 Sepsis Challenge, treating the two hospital systems as sequential training fragments and the unseen system as an out-of-distribution test. CalTwin reduces OOD next-step latent-state MSE by 9.1% relative to the no-penalty baseline (FIM penalty alone accounts for 7.0%); the ECE reduction from the Confidence Misalignment Penalty is real but small (0.7% for CalTwin, 1.3% for CMP alone).
