mlsanityData to 7 Oct 2026

Interactive and Explainable Region-guided Radiology Report Generation

arXiv 2304.08295 ↗First posted 17 Apr 2023cs.CV cs.CL cs.LGcited by 139

Not on the map. Why?

Cited by 20 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The automatic generation of radiology reports has the potential to assist radiologists in the time-consuming task of report writing. Existing methods generate the full report from image-level features, failing to explicitly focus on anatomical regions in the image. We propose a simple yet effective region-guided report generation model that detects anatomical regions and then describes individual, salient regions to form the final report. While previous methods generate reports without the possibility of human intervention and with limited explainability, our method opens up novel clinical use cases through additional interactive capabilities and introduces a high degree of transparency and explainability. Comprehensive experiments demonstrate our method's effectiveness in report generation, outperforming previous state-of-the-art models, and highlight its interactive capabilities. The code and checkpoints are available at https://github.com/ttanida/rgrg .

Key facts. Cited by 139 papers in the map (data through 7 Oct 2026). Builds on 39 of its 66 references that are in the map. First posted on arXiv 17 Apr 2023.

Builds on

39 of 66 references.

References · 39

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  7. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  8. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  9. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  10. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  11. 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
  12. 2014Show and Tell: A Neural Image Caption Generatorcited by 877
27 more
  1. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
  2. 2020Generating Radiology Reports via Memory-driven Transformercited by 363
  3. 2019Meshed-Memory Transformer for Image Captioningcited by 343
  4. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
  5. 2016Image Captioning with Semantic Attentioncited by 260
  6. 2017On the Automatic Generation of Medical Imaging Reportscited by 215
  7. 2022Cross-modal Memory Networks for Radiology Report Generationcited by 183
  8. 2015DenseCap: Fully Convolutional Localization Networks for Dense Captioningcited by 176
  9. 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 160
  10. 2020When Radiology Report Generation Meets Knowledge Graphcited by 144
  11. 2018Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generationcited by 141
  12. 2018TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-rayscited by 139
  13. 2020Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generationcited by 139
  14. 2019Clinically Accurate Chest X-Ray Report Generationcited by 138
  15. 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 93
  16. 2021Chest ImaGenome Dataset for Clinical Reasoningcited by 89
  17. 2020Say As You Wish: Fine-grained Control of Image Caption Generation with Abstract Scene Graphscited by 87
  18. 2021Contrastive Attention for Automatic Chest X-ray Report Generationcited by 71
  19. 2018Show, Control and Tell: A Framework for Generating Controllable and Grounded Captionscited by 65
  20. 2022AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generationcited by 65
  21. 2020Show, Describe and Conclude: On Exploiting the Structure Information of Chest X-Ray Reportscited by 58
  22. 2020DARE: Data Augmented Relation Extraction with GPT-2cited by 43
  23. 2021Progressive Transformer-Based Generation of Radiology Reportscited by 43
  24. 2019Context and Attribute Grounded Dense Captioningcited by 31
  25. 2019Encoder-Agnostic Adaptation for Conditional Language Generationcited by 27
  26. 2018Intention Oriented Image Captions with Guiding Objectscited by 20
  27. 2020Inspecting state of the art performance and NLP metrics in image-based medical report generationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 13; 2024: 55; 2025: 42; 2026: 29.

139 papers.

Sort:

By area:

  1. 2023Towards Generalist Biomedical AIcited by 286
  2. 2024MAIRA-2: Grounded Radiology Report Generationcited by 140
  3. 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 111
  4. 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
  5. 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 92
  6. 2023MAIRA-1: A specialised large multimodal model for radiology report generationcited by 72
  7. 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
  8. 2024MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imagingcited by 45
  9. 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
  10. 2025Enhanced Contrastive Learning with Multi-view Longitudinal Data for Chest X-ray Report Generationcited by 39
  11. 2024CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Datasetcited by 33
  12. 2024HERGen: Elevating Radiology Report Generation with Longitudinal Datacited by 32
38 more
  1. 2024Libra: Leveraging Temporal Images for Biomedical Radiology Analysiscited by 29
  2. 2024GEMeX: A Large-Scale, Groundable, and Explainable Medical VQA Benchmark for Chest X-ray Diagnosiscited by 28
  3. 2024Large Language Model with Region-guided Referring and Grounding for CT Report Generationcited by 27
  4. 2024Interpretable Bilingual Multimodal Large Language Model for Diverse Biomedical Taskscited by 24
  5. 2024ReXrank: A Public Leaderboard for AI-Powered Radiology Report Generationcited by 24
  6. 2025RadVLM: A Multitask Conversational Vision-Language Model for Radiologycited by 24
  7. 2025ReXGradient-160K: A Large-Scale Publicly Available Dataset of Chest Radiographs with Free-text Reportscited by 24
  8. 2023Controllable Chest X-Ray Report Generation from Longitudinal Representationscited by 23
  9. 2024An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generationcited by 23
  10. 2023RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoningcited by 22
  11. 2023Complex Organ Mask Guided Radiology Report Generationcited by 22
  12. 2023The Impact of Imperfect XAI on Human-AI Decision-Makingcited by 21
  13. 2025Better Tokens for Better 3D: Advancing Vision-Language Modeling in 3D Medical Imagingcited by 20
  14. 2024ChEX: Interactive Localization and Region Description in Chest X-rayscited by 18
  15. 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlookscited by 18
  16. 2024Multimodal Large Language Model driven Radiology Report Generation with Clinical Knowledge Enhancementcited by 16
  17. 2024A Survey on Trustworthiness in Foundation Models for Medical Image Analysiscited by 16
  18. 2024M4CXR: Exploring Multi-task Potentials of Multi-modal Large Language Models for Chest X-ray Interpretationcited by 16
  19. 2024RadFlag: A Black-Box Hallucination Detection Method for Medical Vision Language Modelscited by 16
  20. 2023Learning A Multi-Task Transformer Via Unified And Customized Instruction Tuning For Chest Radiograph Interpretationcited by 14
  21. 2023A Systematic Review of Deep Learning-based Research on Radiology Report Generationcited by 14
  22. 2024Structural Entities Extraction and Patient Indications Incorporation for Chest X-ray Report Generationcited by 14
  23. 2023Consensus, dissensus and synergy between clinicians and specialist foundation models in radiology report generationcited by 12
  24. 2024LaPA: Latent Prompt Assist Model For Medical Visual Question Answeringcited by 12
  25. 2025UniMedVL: Unifying Medical Multimodal Understanding and Generation through Observation-Knowledge-Analysiscited by 12
  26. 2024Memory-based Cross-modal Semantic Alignment Network for Radiology Report Generationcited by 11
  27. 2024R2GenCSR: Mining Contextual and Residual Information for LLMs-based Radiology Report Generationcited by 11
  28. 2024FactCheXcker: Mitigating Measurement Hallucinations in Chest X-ray Report Generation Modelscited by 11
  29. 2025Activating Associative Disease-Aware Vision Token Memory for LLM-Based X-ray Report Generationcited by 11
  30. 2024Factual Serialization Enhancement: A Key Innovation for Chest X-ray Report Generationcited by 10
  31. 2024CT-AGRG: Automated Abnormality-Guided Report Generation from 3D Chest CT Volumescited by 10
  32. 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretationcited by 10
  33. 2024ReXErr: Synthesizing Clinically Meaningful Errors in Diagnostic Radiology Reportscited by 9
  34. 2025DART: Disease-aware Image-Text Alignment and Self-correcting Re-alignment for Trustworthy Radiology Report Generationcited by 9
  35. 2024Contrastive Learning with Counterfactual Explanations for Radiology Report Generationcited by 8
  36. 2025Lunguage: A Benchmark for Structured and Sequential Chest X-ray Interpretationcited by 8
  37. 2025CT-GRAPH: Hierarchical Graph Attention Network for Anatomy-Guided CT Report Generationcited by 8
  38. 2024Pre-training on High Definition X-ray Images: An Experimental Studycited by 7

50 most cited of 139 All 139 (JSON)