mlsanityData to 14 Oct 2026

Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planning

arXiv 2506.02327 ↗First posted 2 Jun 2025cs.CVcited by 34

On the map: World models → Medical and surgical world models

Abstract (arXiv)

Providing effective treatment and making informed clinical decisions are essential goals of modern medicine and clinical care. We are interested in simulating disease dynamics for clinical decision-making, leveraging recent advances in large generative models. To this end, we introduce the Medical World Model (MeWM), the first world model in medicine that visually predicts future disease states based on clinical decisions. MeWM comprises (i) vision-language models to serve as policy models, and (ii) tumor generative models as dynamics models. The policy model generates action plans, such as clinical treatments, while the dynamics model simulates tumor progression or regression under given treatment conditions. Building on this, we propose the inverse dynamics model that applies survival analysis to the simulated post-treatment tumor, enabling the evaluation of treatment efficacy and the selection of the optimal clinical action plan. As a result, the proposed MeWM simulates disease dynamics by synthesizing post-treatment tumors, with state-of-the-art specificity in Turing tests evaluated by radiologists. Simultaneously, its inverse dynamics model outperforms medical-specialized GPTs in optimizing individualized treatment protocols across all metrics. Notably, MeWM improves clinical decision-making for interventional physicians, boosting F1-score in selecting the optimal TACE protocol by 13%, paving the way for future integration of medical world models as the second readers.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 48 of its 80 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

48 of 80 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023Segment Anythingcited by 8,234
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024GPT-4o System Cardcited by 4,588
  8. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  12. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
36 more
  1. 2018World Modelscited by 1,513
  2. 2023Mastering Diverse Domains through World Modelscited by 1,253
  3. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  4. 2024Genie: Generative Interactive Environmentscited by 747
  5. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  6. 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 555
  7. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
  8. 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 509
  9. 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
  10. 2022DayDreamer: World Models for Physical Robot Learningcited by 400
  11. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 274
  12. 2024Navigation World Modelscited by 272
  13. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
  14. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
  15. 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 237
  16. 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
  17. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
  18. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
  19. 2022Masked World Models for Visual Controlcited by 170
  20. 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
  21. 2023Video Language Planningcited by 162
  22. 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
  23. 2024Towards Generalizable Tumor Synthesiscited by 65
  24. 2023Label-Free Liver Tumor Segmentationcited by 56
  25. 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 55
  26. 2024Large Language Models for Medicine: A Surveycited by 38
  27. 2020Label-Free Segmentation of COVID-19 Lesions in Lung CTcited by 37
  28. 2024Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomographycited by 31
  29. 2024Cross-conditioned Diffusion Model for Medical Image to Image Translationcited by 26
  30. 2024Grounding Video Models to Actions through Goal Conditioned Explorationcited by 26
  31. 2024From Pixel to Cancer: Cellular Automata in Computed Tomographycited by 20
  32. 2024Text-Driven Tumor Synthesiscited by 13
  33. 2024Generative World Explorercited by 12
  34. 2024Addressing Asynchronicity in Clinical Multimodal Fusion via Individualized Chest X-ray Generationcited by 6
  35. 2020DeepPrognosis: Preoperative Prediction of Pancreatic Cancer Survival and Surgical Margin via Contrast-Enhanced CT Imagingcited by 3
  36. 2023Deep Learning for Cancer Prognosis Prediction Using Portrait Photos by StyleGAN Embeddingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 24.

34 papers.

Sort:

By area:

  1. 20253D and 4D World Modeling: A Surveycited by 67
  2. 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 36
  3. 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
  4. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applicationscited by 10
  5. 2025Beyond Generative AI: World Models for Clinical Prediction, Counterfactuals, and Planningcited by 9
  6. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
  7. 2025CLARITY: Medical World Model for Guiding Treatment Decisions by Simulating Context-Aware Disease Trajectoriescited by 6
  8. 2026Brain-WM: Brain Glioblastoma World Modelcited by 5
  9. 2026A Definition and Roadmap for World Modelscited by 5
  10. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Modelscited by 4
  11. 2026MRI Contrast Enhancement Kinetics World Modelcited by 4
  12. 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generationcited by 4
22 more
  1. 2026Medical world models: representing medical states, modelling clinical dynamics and guiding intervention policiescited by 4
  2. 2026DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registrationcited by 4
  3. 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translationcited by 4
  4. 2025Generative AI for Healthcare: Fundamentals, Challenges, and Perspectivescited by 3
  5. 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancementcited by 3
  6. 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applicationscited by 3
  7. 2025X-WIN: Building Chest Radiograph World Model via Predictive Sensingcited by 2
  8. 2026Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAscited by 2
  9. 2025CECT-Mamba: a Hierarchical Contrast-enhanced-aware Model for Pancreatic Tumor Subtyping from Multi-phase CECTcited by 1
  10. 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Modelcited by 1
  11. 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamicscited by 1
  12. 2025ShapeKitcited by 0
  13. 2026MicroVerse: A Preliminary Exploration Toward a Micro-World Simulationcited by 0
  14. 2026EyeWorld: A Generative World Model of Ocular State and Dynamicscited by 0
  15. 2026Distilling Photon-Counting CT into Routine Chest CT through Clinically Validated Degradation Modelingcited by 0
  16. 20263D MRI Image Pretraining via Controllable 2D Slice Navigation Taskcited by 0
  17. 2026HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulationcited by 0
  18. 2026Physiological World Models for Human State Transitionscited by 0
  19. 2026Generalized Biomedicine Discoverycited by 0
  20. 2026Repeated-Measure Leakage, Distribution Shift, and Reliability under Partial Observation in Patient World Modelscited by 0
  21. 2026Patient, Place, Prior (P3): What Counts as Personalization in Medical World Models?cited by 0
  22. 2026PatientWM: Towards Generalizable Clinical World Models via Unified Patient Statescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Mechanistic Learning with Guided Diffusion Models to Predict Spatio-Temporal Brain Tumor Growth
  2. 2026From Static Risk to Dynamic Trajectories: Toward World-Model-Inspired Clinical Prediction
  3. 2026Adaptive Chemotherapy Control under Tumor Heterogeneity via Reinforcement Learning
  4. 2025Pre to Post-Treatment Glioblastoma MRI Prediction using a Latent Diffusion Model
  5. 2026Towards World Models in Biomedical Research
  6. 2026Contextual Invertible World Models: A Neuro-Symbolic Agentic Framework for Colorectal Cancer Drug Response
  7. 2026An Agentic Generative Large Language Model for Treatment Planning of Colorectal Cancer
  8. 2026Enhancing Personalized Bladder Cancer Treatment Through Reinforcement Learning: A Recurrent Patient State Transition Decision Support Framework