mlsanityData to 7 Oct 2026

SliceWorld: A Predictive and Controllable World-State Model for CT Report Generation

arXiv 2605.24371 ↗First posted 23 May 2026cs.CV cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

CT report generation (CTRG) requires models to summarize three-dimensional anatomical context and pathological findings from hundreds of axial slices. Existing methods typically learn a direct image-to-text mapping, providing limited mechanisms for modeling how CT evidence evolves across slices or how reports respond to controlled changes in latent lesion-related factors. We propose SliceWorld, a CT-specific world-state framework that treats an axial CT scan as an ordered sequence along the z-axis. SliceWorld encodes prefix CT evidence into factor-aware latent states containing anatomy, lesion, and uncertainty components, and projects these states into world tokens used for multi-step future-slice feature prediction, lesion-factor intervention, and LLM-based report generation. The model is first pretrained on CT slice sequences with predictive, factor-aware, and counterfactual objectives, and is then fine-tuned on paired CT-report data. Experiments on M3D-Cap and CT-RATE show that SliceWorld improves natural language generation metrics and clinically oriented automatic evaluation. Further analyses demonstrate multi-horizon future-slice prediction, measurable factor alignment, reduced-slice robustness, and selective lesion-sensitive report modulation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

27 of 39 references.

References · 27

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  5. 2018World Modelscited by 1,444
  6. 2023Mastering Diverse Domains through World Modelscited by 1,193
  7. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
  8. 2020Generating Radiology Reports via Memory-driven Transformercited by 363
  9. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  10. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
  11. 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
  12. 2022Cross-modal Memory Networks for Radiology Report Generationcited by 183
15 more
  1. 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
  2. 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 154
  3. 2024Merlin: A Computed Tomography Vision-Language Foundation Model and Datasetcited by 97
  4. 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
  5. 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
  6. 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
  7. 2024Large Language Model with Region-guided Referring and Grounding for CT Report Generationcited by 27
  8. 2025CheXWorld: Exploring Image World Modeling for Radiograph Representation Learningcited by 18
  9. 2023A Systematic Review of Deep Learning-based Research on Radiology Report Generationcited by 14
  10. 2023Improving Image Captioning via Predicting Structured Conceptscited by 12
  11. 2025CT-GRAPH: Hierarchical Graph Attention Network for Anatomy-Guided CT Report Generationcited by 8
  12. 2024R2Gen-Mamba: A Selective State Space Model for Radiology Report Generationcited by 7
  13. 2025Scaling Self-Supervised and Cross-Modal Pretraining for Volumetric CT Transformerscited by 6
  14. 2024MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancementcited by 4
  15. 2025Recurrent Visual Feature Extraction and Stereo Attentions for CT Report Generationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.