MAC-RRG: Iterative Multi-Agent Collaboration for X-ray Radiology Report Generation
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Despite the remarkable progress of LLM-based and knowledge graph-augmented Radiology Report Generation (RRG) methods, existing techniques still suffer from inherent defects. Conventional LLM-only models lack structured medical prior knowledge, resulting in frequent medical hallucinations and low diagnostic interpretability. Current knowledge graph-enhanced schemes adopt static one-round knowledge fusion with single-source knowledge, incapable of dynamic knowledge updating according to generation feedback. This paper proposes a novel Multi-Agent Collaborative iterative framework for X-ray Radiology Report Generation, termed MAC-RRG. Inspired by multi-agent technology, our framework constructs a closed-loop optimization paradigm based on task decoupling and collaborative reasoning. Specifically, the framework first generates a preliminary radiology report from input X-ray images via a vision encoder and a basic LLM. Subsequently, a multimodal knowledge graph (MM-KG) agent mines structured disease correlation and anatomical knowledge from medical knowledge graphs, while an auxiliary knowledge agent extracts unstructured domain knowledge from public medical databases. The multi-source knowledge acquired by dual agents is fused and embedded to guide the LLM in iteratively refining the initial report. Extensive quantitative and qualitative experiments on mainstream X-ray RRG datasets, including IU X-ray, MIMIC, and CheXpert Plus, fully verify the superiority of our proposed method. The source code and pre-trained models have been released on https://github.com/Event-AHU/Medical_Image_Analysis
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 45 of its 64 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
45 of 64 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2019Publicly Available Clinical BERT Embeddingscited by 995
- 2020Generating Radiology Reports via Memory-driven Transformercited by 363
33 more
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
- 2017On the Automatic Generation of Medical Imaging Reportscited by 215
- 2022Cross-modal Memory Networks for Radiology Report Generationcited by 183
- 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 160
- 2020When Radiology Report Generation Meets Knowledge Graphcited by 144
- 2018Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generationcited by 141
- 2018TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-rayscited by 139
- 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generationcited by 114
- 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 111
- 2019Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generationcited by 101
- 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 100
- 2023METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokenscited by 98
- 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 92
- 2021Chest ImaGenome Dataset for Clinical Reasoningcited by 89
- 2022Competence-based Multimodal Curriculum Learning for Medical Report Generationcited by 74
- 2022AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generationcited by 65
- 2023KiUT: Knowledge-injected U-Transformer for Radiology Report Generationcited by 60
- 2022Cross-modal Prototype Driven Network for Radiology Report Generationcited by 58
- 2021Weakly Supervised Contrastive Learning for Chest X-Ray Report Generationcited by 39
- 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoningcited by 39
- 2020A Survey on Deep Learning and Explainability for Automatic Report Generation from Medical Imagescited by 35
- 2024CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Datasetcited by 33
- 2023Retrieval Augmented Chest X-Ray Report Generation using OpenAI GPT modelscited by 27
- 2023Fine-Grained Image-Text Alignment in Medical Imaging Enables Explainable Cyclic Image-Report Generationcited by 25
- 2023Cross-Modal Causal Intervention for Medical Report Generationcited by 14
- 2024R2GenCSR: Mining Contextual and Residual Information for LLMs-based Radiology Report Generationcited by 11
- 2024KARGEN: Knowledge-enhanced Automated Radiology Report Generation Using Large Language Modelscited by 6
- 2024Topicwise Separable Sentence Retrieval for Medical Report Generationcited by 5
- 2025MCA-RG: Enhancing LLMs with Medical Concept Alignment for Radiology Report Generationcited by 3
- 2024LaB-RAG: Label Boosted Retrieval Augmented Generation for Radiology Report Generationcited by 2
- 2025A Disease-Aware Dual-Stage Framework for Chest X-ray Report Generationcited by 2
- 2025RA-RRG: Multimodal Retrieval-Augmented Radiology Report Generation with Key Phrase Extractioncited by 1
- 2026Graph-Augmented Topological Internalization with Dual-Stream Classifiers for Medical Report Generationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025A Multimodal Multi-Agent Framework for Radiology Report Generation
- 2026CogRad: A Cognitively-Inspired Multi-Agent Framework for Radiology Report Generation
- 2025Medical AI Consensus: A Multi-Agent Framework for Radiology Report Generation and Evaluation
- 2026EviAgent: Evidence-Driven Agent for Radiology Report Generation
- 2026MARCH: Multi-Agent Radiology Clinical Hierarchy for CT Report Generation
- 2025CBM-RAG: Demonstrating Enhanced Interpretability in Radiology Report Generation with Multi-Agent RAG and Concept Bottleneck Models
- 2024Multimodal Large Language Model driven Radiology Report Generation with Clinical Knowledge Enhancement
- 2026Multi-Modal Multi-Agent Reinforcement Learning for Radiology Report Generation