Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planning
On the map: World models → Medical and surgical world models
Abstract (arXiv)
Providing effective treatment and making informed clinical decisions are essential goals of modern medicine and clinical care. We are interested in simulating disease dynamics for clinical decision-making, leveraging recent advances in large generative models. To this end, we introduce the Medical World Model (MeWM), the first world model in medicine that visually predicts future disease states based on clinical decisions. MeWM comprises (i) vision-language models to serve as policy models, and (ii) tumor generative models as dynamics models. The policy model generates action plans, such as clinical treatments, while the dynamics model simulates tumor progression or regression under given treatment conditions. Building on this, we propose the inverse dynamics model that applies survival analysis to the simulated post-treatment tumor, enabling the evaluation of treatment efficacy and the selection of the optimal clinical action plan. As a result, the proposed MeWM simulates disease dynamics by synthesizing post-treatment tumors, with state-of-the-art specificity in Turing tests evaluated by radiologists. Simultaneously, its inverse dynamics model outperforms medical-specialized GPTs in optimizing individualized treatment protocols across all metrics. Notably, MeWM improves clinical decision-making for interventional physicians, boosting F1-score in selecting the optimal TACE protocol by 13%, paving the way for future integration of medical world models as the second readers.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 48 of its 80 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
48 of 80 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
36 more
- 2018World Modelscited by 1,513
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 555
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 509
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 274
- 2024Navigation World Modelscited by 272
- 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
- 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 237
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
- 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
- 2022Masked World Models for Visual Controlcited by 170
- 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
- 2023Video Language Planningcited by 162
- 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
- 2024Towards Generalizable Tumor Synthesiscited by 65
- 2023Label-Free Liver Tumor Segmentationcited by 56
- 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 55
- 2024Large Language Models for Medicine: A Surveycited by 38
- 2020Label-Free Segmentation of COVID-19 Lesions in Lung CTcited by 37
- 2024Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomographycited by 31
- 2024Cross-conditioned Diffusion Model for Medical Image to Image Translationcited by 26
- 2024Grounding Video Models to Actions through Goal Conditioned Explorationcited by 26
- 2024From Pixel to Cancer: Cellular Automata in Computed Tomographycited by 20
- 2024Text-Driven Tumor Synthesiscited by 13
- 2024Generative World Explorercited by 12
- 2024Addressing Asynchronicity in Clinical Multimodal Fusion via Individualized Chest X-ray Generationcited by 6
- 2020DeepPrognosis: Preoperative Prediction of Pancreatic Cancer Survival and Surgical Margin via Contrast-Enhanced CT Imagingcited by 3
- 2023Deep Learning for Cancer Prognosis Prediction Using Portrait Photos by StyleGAN Embeddingcited by 2
Built on by
Citing papers per year: 2025: 10; 2026: 24.
34 papers.
Sort:
By area:
- 20253D and 4D World Modeling: A Surveycited by 67
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 36
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applicationscited by 10
- 2025Beyond Generative AI: World Models for Clinical Prediction, Counterfactuals, and Planningcited by 9
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2025CLARITY: Medical World Model for Guiding Treatment Decisions by Simulating Context-Aware Disease Trajectoriescited by 6
- 2026Brain-WM: Brain Glioblastoma World Modelcited by 5
- 2026A Definition and Roadmap for World Modelscited by 5
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Modelscited by 4
- 2026MRI Contrast Enhancement Kinetics World Modelcited by 4
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generationcited by 4
22 more
- 2026Medical world models: representing medical states, modelling clinical dynamics and guiding intervention policiescited by 4
- 2026DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registrationcited by 4
- 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translationcited by 4
- 2025Generative AI for Healthcare: Fundamentals, Challenges, and Perspectivescited by 3
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancementcited by 3
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applicationscited by 3
- 2025X-WIN: Building Chest Radiograph World Model via Predictive Sensingcited by 2
- 2026Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAscited by 2
- 2025CECT-Mamba: a Hierarchical Contrast-enhanced-aware Model for Pancreatic Tumor Subtyping from Multi-phase CECTcited by 1
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Modelcited by 1
- 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamicscited by 1
- 2025ShapeKitcited by 0
- 2026MicroVerse: A Preliminary Exploration Toward a Micro-World Simulationcited by 0
- 2026EyeWorld: A Generative World Model of Ocular State and Dynamicscited by 0
- 2026Distilling Photon-Counting CT into Routine Chest CT through Clinically Validated Degradation Modelingcited by 0
- 20263D MRI Image Pretraining via Controllable 2D Slice Navigation Taskcited by 0
- 2026HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulationcited by 0
- 2026Physiological World Models for Human State Transitionscited by 0
- 2026Generalized Biomedicine Discoverycited by 0
- 2026Repeated-Measure Leakage, Distribution Shift, and Reliability under Partial Observation in Patient World Modelscited by 0
- 2026Patient, Place, Prior (P3): What Counts as Personalization in Medical World Models?cited by 0
- 2026PatientWM: Towards Generalizable Clinical World Models via Unified Patient Statescited by 0
- 2026PatientWM: Towards Generalizable Clinical World Models via Unified Patient States12 Oct 2026
- 2026Patient, Place, Prior (P3): What Counts as Personalization in Medical World Models?6 Oct 2026
- 2026Repeated-Measure Leakage, Distribution Shift, and Reliability under Partial Observation in Patient World Models3 Oct 2026
- 2026Generalized Biomedicine Discovery9 Sep 2026
- 2026Physiological World Models for Human State Transitions15 Aug 2026
- 2026HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulation13 Aug 2026
- 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation28 Jul 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
- 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics18 Jun 2026
- 2026DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration17 Jun 2026
- 2026Medical world models: representing medical states, modelling clinical dynamics and guiding intervention policies15 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
22 more
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Model1 Jun 2026
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications28 May 2026
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generation9 May 2026
- 20263D MRI Image Pretraining via Controllable 2D Slice Navigation Task7 May 2026
- 2026Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAs24 Apr 2026
- 2026Distilling Photon-Counting CT into Routine Chest CT through Clinically Validated Degradation Modeling8 Apr 2026
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Study23 Mar 2026
- 2026EyeWorld: A Generative World Model of Ocular State and Dynamics14 Mar 2026
- 2026Brain-WM: Brain Glioblastoma World Model8 Mar 2026
- 2026MicroVerse: A Preliminary Exploration Toward a Micro-World Simulation28 Feb 2026
- 2026MRI Contrast Enhancement Kinetics World Model22 Feb 2026
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models21 Jan 2026
- 2025CLARITY: Medical World Model for Guiding Treatment Decisions by Simulating Context-Aware Disease Trajectories8 Dec 2025
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancement8 Dec 2025
- 2025Beyond Generative AI: World Models for Clinical Prediction, Counterfactuals, and Planning20 Nov 2025
- 2025X-WIN: Building Chest Radiograph World Model via Predictive Sensing18 Nov 2025
- 2025Generative AI for Healthcare: Fundamentals, Challenges, and Perspectives28 Oct 2025
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Data16 Oct 2025
- 2025CECT-Mamba: a Hierarchical Contrast-enhanced-aware Model for Pancreatic Tumor Subtyping from Multi-phase CECT16 Sep 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications1 Aug 2025
- 2025ShapeKit30 Jun 2025
- 20253D and 4D World Modeling: A Surveycited by 67
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 36
- 2025Beyond Generative AI: World Models for Clinical Prediction, Counterfactuals, and Planningcited by 9
- 2025CLARITY: Medical World Model for Guiding Treatment Decisions by Simulating Context-Aware Disease Trajectoriescited by 6
- 2026Brain-WM: Brain Glioblastoma World Modelcited by 5
- 2026A Definition and Roadmap for World Modelscited by 5
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Modelscited by 4
- 2026Medical world models: representing medical states, modelling clinical dynamics and guiding intervention policiescited by 4
- 2026DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registrationcited by 4
- 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translationcited by 4
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applicationscited by 3
- 2026Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAscited by 2
12 most cited of 19 All 19 (JSON)
- 2026PatientWM: Towards Generalizable Clinical World Models via Unified Patient States12 Oct 2026
- 2026Patient, Place, Prior (P3): What Counts as Personalization in Medical World Models?6 Oct 2026
- 2026Repeated-Measure Leakage, Distribution Shift, and Reliability under Partial Observation in Patient World Models3 Oct 2026
- 2026Physiological World Models for Human State Transitions15 Aug 2026
- 2026HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulation13 Aug 2026
- 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation28 Jul 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
- 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics18 Jun 2026
- 2026DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration17 Jun 2026
- 2026Medical world models: representing medical states, modelling clinical dynamics and guiding intervention policies15 Jun 2026
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications28 May 2026
- 2026Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAs24 Apr 2026
12 newest of 19 All 19 (JSON)
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2026MRI Contrast Enhancement Kinetics World Modelcited by 4
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generationcited by 4
- 2025Generative AI for Healthcare: Fundamentals, Challenges, and Perspectivescited by 3
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancementcited by 3
- 2025X-WIN: Building Chest Radiograph World Model via Predictive Sensingcited by 2
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Modelcited by 1
- 2025ShapeKitcited by 0
- 2026MicroVerse: A Preliminary Exploration Toward a Micro-World Simulationcited by 0
- 2026Distilling Photon-Counting CT into Routine Chest CT through Clinically Validated Degradation Modelingcited by 0
- 20263D MRI Image Pretraining via Controllable 2D Slice Navigation Taskcited by 0
- 2026Generalized Biomedicine Discoverycited by 0
- 2026Generalized Biomedicine Discovery9 Sep 2026
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Model1 Jun 2026
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generation9 May 2026
- 20263D MRI Image Pretraining via Controllable 2D Slice Navigation Task7 May 2026
- 2026Distilling Photon-Counting CT into Routine Chest CT through Clinically Validated Degradation Modeling8 Apr 2026
- 2026MicroVerse: A Preliminary Exploration Toward a Micro-World Simulation28 Feb 2026
- 2026MRI Contrast Enhancement Kinetics World Model22 Feb 2026
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancement8 Dec 2025
- 2025X-WIN: Building Chest Radiograph World Model via Predictive Sensing18 Nov 2025
- 2025Generative AI for Healthcare: Fundamentals, Challenges, and Perspectives28 Oct 2025
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Data16 Oct 2025
- 2025ShapeKit30 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025Mechanistic Learning with Guided Diffusion Models to Predict Spatio-Temporal Brain Tumor Growth
- 2026From Static Risk to Dynamic Trajectories: Toward World-Model-Inspired Clinical Prediction
- 2026Adaptive Chemotherapy Control under Tumor Heterogeneity via Reinforcement Learning
- 2025Pre to Post-Treatment Glioblastoma MRI Prediction using a Latent Diffusion Model
- 2026Towards World Models in Biomedical Research
- 2026Contextual Invertible World Models: A Neuro-Symbolic Agentic Framework for Colorectal Cancer Drug Response
- 2026An Agentic Generative Large Language Model for Treatment Planning of Colorectal Cancer
- 2026Enhancing Personalized Bladder Cancer Treatment Through Reinforcement Learning: A Recurrent Patient State Transition Decision Support Framework