mlsanityData to 7 Oct 2026

CT2Rep: Automated Radiology Report Generation for 3D Medical Imaging

arXiv 2403.06801 ↗First posted 11 Mar 2024eess.IV cs.CVcited by 96

Not on the map. Why?

Cited by 29 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Medical imaging plays a crucial role in diagnosis, with radiology reports serving as vital documentation. Automating report generation has emerged as a critical need to alleviate the workload of radiologists. While machine learning has facilitated report generation for 2D medical imaging, extending this to 3D has been unexplored due to computational complexity and data scarcity. We introduce the first method to generate radiology reports for 3D medical imaging, specifically targeting chest CT volumes. Given the absence of comparable methods, we establish a baseline using an advanced 3D vision encoder in medical imaging to demonstrate our method's effectiveness, which leverages a novel auto-regressive causal transformer. Furthermore, recognizing the benefits of leveraging information from previous visits, we augment CT2Rep with a cross-attention-based multi-modal fusion module and hierarchical memory, enabling the incorporation of longitudinal multimodal data. Access our code at https://github.com/ibrahimethemhamamci/CT2Rep

Key facts. Cited by 96 papers in the map (data through 7 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 11 Mar 2024.

Builds on

19 of 30 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021ViViT: A Video Vision Transformercited by 1,610
  3. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  4. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  5. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  6. 2020Generating Radiology Reports via Memory-driven Transformercited by 363
  7. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  8. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 236
  9. 2017On the Automatic Generation of Medical Imaging Reportscited by 215
  10. 2019Large Memory Layers with Product Keyscited by 120
  11. 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generationcited by 114
  12. 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
7 more
  1. 2020Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumescited by 66
  2. 2022Cross-modal Prototype Driven Network for Radiology Report Generationcited by 58
  3. 2023Utilizing Longitudinal Chest X-Rays and Reports to Pre-Fill Radiology Reportscited by 34
  4. 2021A Systematic Collection of Medical Image Datasets for Deep Learningcited by 29
  5. 2021GaNDLF: A Generally Nuanced Deep Learning Framework for Scalable End-to-End Clinical Workflows in Medical Imagingcited by 25
  6. 2023Diffusion-Based Hierarchical Multi-Label Object Detection to Analyze Panoramic Dental X-rayscited by 18
  7. 2023DENTEX: Dental Enumeration and Tooth Pathosis Detection Benchmark for Panoramic X-raycited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 16; 2025: 36; 2026: 44.

96 papers.

Sort:

By area:

  1. 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
  2. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 108
  3. 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
  4. 2025Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysiscited by 44
  5. 2025Enhanced Contrastive Learning with Multi-view Longitudinal Data for Chest X-ray Report Generationcited by 39
  6. 2025RadGPT: Constructing 3D Image-Text Tumor Datasetscited by 34
  7. 2025Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planningcited by 31
  8. 2024Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generationcited by 30
  9. 2024Large Language Model with Region-guided Referring and Grounding for CT Report Generationcited by 27
  10. 20253D-RAD: A Comprehensive 3D Radiology Med-VQA Dataset with Multi-Temporal Analysis and Diverse Diagnostic Taskscited by 24
  11. 2025CT-Agent: A Multimodal-LLM Agent for 3D CT Radiology Question Answeringcited by 20
  12. 2025Better Tokens for Better 3D: Advancing Vision-Language Modeling in 3D Medical Imagingcited by 20
38 more
  1. 2024SurGen: Text-Guided Diffusion Model for Surgical Video Generationcited by 19
  2. 2024Overview of the First Shared Task on Clinical Text Generation: RRG24 and "Discharge Me!"cited by 19
  3. 2024Read Like a Radiologist: Efficient Vision-Language Model for 3D Medical Imaging Interpretationcited by 18
  4. 20243D-CT-GPT: Generating 3D Radiology Reports through Integration of Large Vision-Language Modelscited by 15
  5. 2024Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Modelcited by 15
  6. 2025Are Vision Language Models Ready for Clinical Diagnosis? A 3D Medical Benchmark for Tumor-centric Visual Question Answeringcited by 14
  7. 2024A Survey of Medical Vision-and-Language Applications and Their Techniquescited by 11
  8. 2025Learning Segmentation from Radiology Reportscited by 11
  9. 2024CT-AGRG: Automated Abnormality-Guided Report Generation from 3D Chest CT Volumescited by 10
  10. 2025PriorRG: Prior-Guided Contrastive Pre-training and Coarse-to-Fine Decoding for Chest X-ray Report Generationcited by 9
  11. 2026OmniCT: Towards a Unified Slice-Volume LVLM for Comprehensive CT Analysiscited by 9
  12. 2024Argus: Benchmarking and Enhancing Vision-Language Models for 3D Radiology Report Generationcited by 8
  13. 2025CT-GRAPH: Hierarchical Graph Attention Network for Anatomy-Guided CT Report Generationcited by 8
  14. 2025Scaling Artificial Intelligence for Multi-Tumor Early Detection with More Reports, Fewer Maskscited by 8
  15. 2025Toward a Vision-Language Foundation Model for Medical Data: Multimodal Dataset and Benchmarks for Vietnamese PET/CT Report Generationcited by 7
  16. 2025CRG Score: A Distribution-Aware Clinical Metric for Radiology Report Generationcited by 6
  17. 2025PET2Rep: Towards Vision-Language Model-Drived Automated Radiology Report Generation for Positron Emission Tomographycited by 6
  18. 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Modelscited by 6
  19. 2024Med-PMC: Medical Personalized Multi-modal Consultation with a Proactive Ask-First-Observe-Next Paradigmcited by 5
  20. 2025CTFlow: Video-Inspired Latent Flow Matching for 3D CT Synthesiscited by 5
  21. 2024MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancementcited by 4
  22. 2026U-VLM: Hierarchical Vision Language Modeling for Report Generationcited by 4
  23. 2026RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiologycited by 4
  24. 2025Exploring the Design Space of 3D MLLMs for CT Report Generationcited by 3
  25. 2025RAU: Reference-based Anatomical Understanding with Vision Language Modelscited by 3
  26. 2025Structured Spectral Graph Representation Learning for Multi-label Abnormality Analysis from 3D CT Scanscited by 3
  27. 2025PETAR: Localized Findings Generation with Mask-Aware Vision-Language Modeling for PET Automated Reportingcited by 3
  28. 2026Beyond the Embedding Bottleneck: Adaptive Retrieval-Augmented 3D CT Report Generationcited by 3
  29. 2026Enhancing Fine-Grained Spatial Grounding in 3D CT Report Generation via Discriminative Guidancecited by 3
  30. 2026MARCH: Multi-Agent Radiology Clinical Hierarchy for CT Report Generationcited by 3
  31. 2026Generating Reports or Repeating Templates? Measuring and Mitigating Template Collapse in 3D CT Report Generationcited by 3
  32. 2026Medical world models: representing medical states, modelling clinical dynamics and guiding intervention policiescited by 3
  33. 2025Abn-BLIP: Abnormality-aligned Bootstrapping Language-Image Pre-training for Pulmonary Embolism Diagnosis and Report Generation from CTPAcited by 2
  34. 2025ModernBERT is More Efficient than Conventional BERT for Chest CT Findings Classification in Japanese Radiology Reportscited by 2
  35. 2025Imitating Radiological Scrolling: A Global-Local Attention Model for 3D Chest CT Volumes Multi-Label Anomaly Classificationcited by 2
  36. 2025Recurrent Visual Feature Extraction and Stereo Attentions for CT Report Generationcited by 2
  37. 2025Structured Spectral Graph Learning for Anomaly Classification in 3D Chest CT Scanscited by 2
  38. 2025Vision-Language Models for Automated 3D PET/CT Report Generationcited by 2

50 most cited of 96 All 96 (JSON)