SliceWorld: A Predictive and Controllable World-State Model for CT Report Generation
Not on the map. Why?
Abstract (arXiv)
CT report generation (CTRG) requires models to summarize three-dimensional anatomical context and pathological findings from hundreds of axial slices. Existing methods typically learn a direct image-to-text mapping, providing limited mechanisms for modeling how CT evidence evolves across slices or how reports respond to controlled changes in latent lesion-related factors. We propose SliceWorld, a CT-specific world-state framework that treats an axial CT scan as an ordered sequence along the z-axis. SliceWorld encodes prefix CT evidence into factor-aware latent states containing anatomy, lesion, and uncertainty components, and projects these states into world tokens used for multi-step future-slice feature prediction, lesion-factor intervention, and LLM-based report generation. The model is first pretrained on CT slice sequences with predictive, factor-aware, and counterfactual objectives, and is then fine-tuned on paired CT-report data. Experiments on M3D-Cap and CT-RATE show that SliceWorld improves natural language generation metrics and clinically oriented automatic evaluation. Further analyses demonstrate multi-horizon future-slice prediction, measurable factor alignment, reduced-slice robustness, and selective lesion-sensitive report modulation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
27 of 39 references.
References · 27
- 2025Qwen3 Technical Reportcited by 8,195
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2018World Modelscited by 1,444
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
- 2020Generating Radiology Reports via Memory-driven Transformercited by 363
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2022Cross-modal Memory Networks for Radiology Report Generationcited by 183
15 more
- 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 154
- 2024Merlin: A Computed Tomography Vision-Language Foundation Model and Datasetcited by 97
- 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
- 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
- 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
- 2024Large Language Model with Region-guided Referring and Grounding for CT Report Generationcited by 27
- 2025CheXWorld: Exploring Image World Modeling for Radiograph Representation Learningcited by 18
- 2023A Systematic Review of Deep Learning-based Research on Radiology Report Generationcited by 14
- 2023Improving Image Captioning via Predicting Structured Conceptscited by 12
- 2025CT-GRAPH: Hierarchical Graph Attention Network for Anatomy-Guided CT Report Generationcited by 8
- 2024R2Gen-Mamba: A Selective State Space Model for Radiology Report Generationcited by 7
- 2025Scaling Self-Supervised and Cross-Modal Pretraining for Volumetric CT Transformerscited by 6
- 2024MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancementcited by 4
- 2025Recurrent Visual Feature Extraction and Stereo Attentions for CT Report Generationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.