A radiographic world model for clinical reasoning and evidence generation
Not on the map. Why?
Abstract (arXiv)
Medical imaging artificial intelligence (AI) is commonly developed as separate mappings from radiographs to diagnostic outputs or from clinical descriptions to generated images, although both arise from the same underlying radiographic state. A world-model formulation instead seeks to learn an internal representation of this state that can support both clinical readout and conditional simulation of radiographic observations. Here we introduce MedDream, a radiographic world model that learns a shared continuous latent state from paired chest radiograph-text observations for diagnostic reasoning and report-conditioned evidence generation. MedDream was pretrained on 2.65 million leakage-controlled chest radiograph-text pairs curated from 4.40 million candidates. Across eight clinical datasets and two independent reader cohorts, MedDream outperformed leading diagnostic and generative comparators. For diagnostic reasoning, MedDream showed strong generalization across disease recognition, label-scarce adaptation, severity assessment, and localization, while MedDream-supported review increased mean resident concordance with independent radiologist consensus from 56.3% to 63.0%. For evidence generation, MedDream produced radiographs that preserved clinically relevant pathology and improved downstream performance on held-out real data, with synthetic augmentation increasing external VinDr-CXR macro-AUROC from 76.4% to 81.4%. More importantly, conditioning generation on prespecified subgroup performance gaps enabled targeted evidence construction, increasing weighted F1 by 3.1 percentage points in Asian patients, whereas matched-volume unguided augmentation decreased it by 2.3 points. These findings establish radiographic world models as a path toward medical AI that learns clinically meaningful internal states for interpreting, simulating, and constructing evidence for clinical use.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 53 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
32 of 53 references.
References · 32
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2020What Makes for Good Views for Contrastive Learning?cited by 846
- 2024Autoregressive Image Generation without Vector Quantizationcited by 651
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
- 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 309
- 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 239
20 more
- 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 227
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiologycited by 149
- 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
- 2024Exploring scalable medical image encoders beyond text supervisioncited by 132
- 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 106
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
- 2024Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Modelscited by 69
- 2023LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generationcited by 57
- 2024A Multimodal Vision Foundation Model for Clinical Dermatologycited by 50
- 2025BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literaturecited by 34
- 2025USP: Unified Self-Supervised Pretraining for Image Generation and Understandingcited by 24
- 2025MedVAE: Efficient Automated Interpretation of Medical Images with Large-Scale Generalizable Autoencoderscited by 22
- 2025MergeVQ: A Unified Framework for Visual Generation and Representation with Disentangled Token Merging and Quantizationcited by 12
- 2024Generative AI Enables Medical Image Segmentation in Ultra Low-Data Regimescited by 8
- 2024A multi-modal vision-language model for generalizable annotation-free pathology localizationcited by 7
- 2025A Generative Foundation Model for Chest Radiographycited by 5
- 2024Autoregressive Image Diffusion: Generation of Image Sequence and Application in MRIcited by 4
- 2024FairDiffusion: Enhancing Equity in Latent Diffusion Models via Fair Bayesian Perturbationcited by 4
- 2026UniX: Unifying Autoregression and Diffusion for Chest X-Ray Understanding and Generationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation
- 2026Vision-language models for chest radiography do not always need the image
- 2026A Vision-language Framework for Comparative Reasoning in Radiology
- 2026RadDiff: Describing Differences in Radiology Image Sets with Natural Language
- 2026CheXthought: A global multimodal dataset of clinical chain-of-thought reasoning and visual attention for chest X-ray interpretation
- 2025CheXWorld: Exploring Image World Modeling for Radiograph Representation Learning
- 2025RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows
- 2025Reason Like a Radiologist: Chain-of-Thought and Reinforcement Learning for Verifiable Report Generation