mlsanityData to 7 Oct 2026

MAIRA-2: Grounded Radiology Report Generation

arXiv 2406.04449 ↗First posted 6 Jun 2024cs.CL cs.CVcited by 140

Not on the map. Why?

Cited by 46 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Radiology reporting is a complex task requiring detailed medical image understanding and precise language generation, for which generative multimodal models offer a promising solution. However, to impact clinical practice, models must achieve a high level of both verifiable performance and utility. We augment the utility of automated report generation by incorporating localisation of individual findings on the image - a task we call grounded report generation - and enhance performance by incorporating realistic reporting context as inputs. We design a novel evaluation framework (RadFact) leveraging the logical inference capabilities of large language models (LLMs) to quantify report correctness and completeness at the level of individual sentences, while supporting the new task of grounded reporting. We develop MAIRA-2, a large radiology-specific multimodal model designed to generate chest X-ray reports with and without grounding. MAIRA-2 achieves state of the art on existing report generation benchmarks and establishes the novel task of grounded report generation.

Key facts. Cited by 140 papers in the map (data through 7 Oct 2026). Builds on 50 of its 80 references that are in the map. First posted on arXiv 6 Jun 2024.

Builds on

50 of 80 references.

References · 50

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  7. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  8. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  9. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  10. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  11. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
  12. 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
38 more
  1. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  2. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
  3. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
  4. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
  5. 2023Towards Generalist Biomedical AIcited by 286
  6. 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
  7. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 236
  8. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
  9. 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 139
  10. 2019Clinically Accurate Chest X-Ray Report Generationcited by 138
  11. 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
  12. 2021UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modelingcited by 122
  13. 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generationcited by 114
  14. 2023METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokenscited by 98
  15. 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
  16. 2022Improving the Factual Correctness of Radiology Report Generation with Semantic Rewardscited by 82
  17. 2024A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretationcited by 79
  18. 2023MAIRA-1: A specialised large multimodal model for radiology report generationcited by 72
  19. 2019Automatic Radiology Report Generation based on Multi-view Image Fusion and Medical Concept Enrichmentcited by 60
  20. 2024Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluationcited by 51
  21. 2022Improving Radiology Report Generation Systems by Removing Hallucinated References to Non-existent Priorscited by 48
  22. 2024Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiologycited by 45
  23. 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
  24. 2023Multimodal Image-Text Matching Improves Retrieval-based Chest X-Ray Report Generationcited by 37
  25. 2024MedVersa: A Generalist Foundation Model for Medical Image Interpretationcited by 37
  26. 2023Utilizing Longitudinal Chest X-Rays and Reports to Pre-Fill Radiology Reportscited by 34
  27. 2023Medical Phrase Grounding with Region-Phrase Context Contrastive Alignmentcited by 32
  28. 2023Exploring the Boundaries of GPT-4 in Radiologycited by 31
  29. 2023Controllable Chest X-Ray Report Generation from Longitudinal Representationscited by 23
  30. 2024ChEX: Interactive Localization and Region Description in Chest X-rayscited by 18
  31. 2023DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generationcited by 16
  32. 2024LLM-RadJudge: Achieving Radiologist-Level Evaluation for X-Ray Report Generationcited by 14
  33. 2023Visual Grounding of Whole Radiology Reports for 3D CT Imagescited by 13
  34. 2024Are Machines Better at Complex Reasoning? Unveiling Human-Machine Inference Gaps in Entailment Verificationcited by 13
  35. 2024Uncertainty-aware Medical Diagnostic Phrase Identification and Groundingcited by 13
  36. 2023Pragmatic Radiology Report Generationcited by 12
  37. 2024Weakly Supervised Object Detection in Chest X-Rays with Differentiable ROI Proposal Networks and Soft ROI Poolingcited by 5
  38. 2023Extrinsically-Focused Evaluation of Omissions in Medical Summarizationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 18; 2025: 65; 2026: 57.

140 papers.

Sort:

By area:

  1. 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflowcited by 71
  2. 2025Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Keycited by 64
  3. 2024MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imagingcited by 45
  4. 2024PadChest-GR: A Bilingual Chest X-ray Dataset for Grounded Radiology Report Generationcited by 35
  5. 2025RadGPT: Constructing 3D Image-Text Tumor Datasetscited by 34
  6. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 34
  7. 2024CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Datasetcited by 33
  8. 2024Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generationcited by 30
  9. 2024Large Language Model with Region-guided Referring and Grounding for CT Report Generationcited by 27
  10. 2024Interpretable Bilingual Multimodal Large Language Model for Diverse Biomedical Taskscited by 24
  11. 2024ReXrank: A Public Leaderboard for AI-Powered Radiology Report Generationcited by 24
  12. 2025RadVLM: A Multitask Conversational Vision-Language Model for Radiologycited by 24
38 more
  1. 2025ReXGradient-160K: A Large-Scale Publicly Available Dataset of Chest Radiographs with Free-text Reportscited by 24
  2. 2024An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generationcited by 23
  3. 2025Comprehensive language-image pre-training for 3D medical image understandingcited by 20
  4. 2024M4CXR: Exploring Multi-task Potentials of Multi-modal Large Language Models for Chest X-ray Interpretationcited by 16
  5. 2025Multimodal Large Language Models for Medicine: A Comprehensive Surveycited by 16
  6. 2025ReXGroundingCT: A 3D Chest CT Dataset for Segmentation of Findings from Free-Text Reportscited by 16
  7. 2024On Subjective Uncertainty Quantification and Calibration in Natural Language Generationcited by 14
  8. 2024FactCheXcker: Mitigating Measurement Hallucinations in Chest X-ray Report Generation Modelscited by 11
  9. 2025Activating Associative Disease-Aware Vision Token Memory for LLM-Based X-ray Report Generationcited by 11
  10. 2025CoCa-CXR: Contrastive Captioners Learn Strong Temporal Structures for Chest X-Ray Vision-Language Understandingcited by 11
  11. 2025Bringing CLIP to the Clinic: Dynamic Soft Labels and Negation-Aware Learning for Medical Analysiscited by 10
  12. 2025OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoningcited by 10
  13. 2025Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Reviewcited by 9
  14. 2025AOR: Anatomical Ontology-Guided Reasoning for Medical Large Multimodal Model in Chest X-Ray Interpretationcited by 8
  15. 2025MedSG-Bench: A Benchmark for Medical Image Sequences Groundingcited by 8
  16. 2025Lunguage: A Benchmark for Structured and Sequential Chest X-ray Interpretationcited by 8
  17. 2025PRISM2: Unlocking Multi-Modal General Pathology AI with Clinical Dialoguecited by 8
  18. 2025RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflowscited by 8
  19. 2026CRIMSON: A Clinically-Grounded LLM-Based Metric for Generative Radiology Report Evaluationcited by 8
  20. 2026Can Jev Judge Radiology Reports? Evaluating a System One Model for Clinical Factualitycited by 8
  21. 2024Uncovering Knowledge Gaps in Radiology Report Generation Models through Knowledge Graphscited by 7
  22. 2024SLaVA-CXR: Small Language and Vision Assistant for Chest X-ray Report Automationcited by 7
  23. 2024MAIRA-Seg: Enhancing Radiology Report Generation with Segmentation-Aware Multimodal Large Language Modelscited by 7
  24. 2025DDaTR: Dynamic Difference-aware Temporal Residual Network for Longitudinal Radiology Report Generationcited by 7
  25. 2025Foundation Models in Medical Imaging: A Review and Outlookcited by 7
  26. 2025CXRAgent: Director-Orchestrated Multi-Stage Reasoning for Chest X-Ray Interpretationcited by 7
  27. 2024VoxelPrompt: A Vision Agent for End-to-End Medical Image Analysiscited by 6
  28. 2025Scaling Up Biomedical Vision-Language Models: Fine-Tuning, Instruction Tuning, and Multi-Modal Learningcited by 6
  29. 2025Region-Aware Multimodal Large Language Model via SlowFast Tokenization and Pseudo-Mask Guidance for 3D CT Report Generationcited by 6
  30. 2025A Chain of Diagnosis Framework for Accurate and Explainable Radiology Report Generationcited by 6
  31. 2025MM-DINOv2: Adapting Foundation Models for Multi-Modal Medical Image Analysiscited by 6
  32. 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicinecited by 5
  33. 2025CXReasonBench: A Benchmark for Evaluating Structured Diagnostic Reasoning in Chest X-rayscited by 5
  34. 2025MOTOR: Multimodal Optimal Transport via Grounded Retrieval in Medical Visual Question Answeringcited by 5
  35. 2025AURA: A Multi-Modal Medical Agent for Understanding, Reasoning & Annotationcited by 5
  36. 2025S-RRG-Bench: Structured Radiology Report Generation with Fine-Grained Evaluation Frameworkcited by 5
  37. 2025Toward Clinically Explainable AI for Medical Diagnosis: A Foundation Model with Human-Compatible Reasoning via Reinforcement Learningcited by 5
  38. 20253DReasonKnee: Advancing Grounded Reasoning in Medical Vision Language Modelscited by 5

50 most cited of 140 All 140 (JSON)