XMedFusion: A Knowledge-Guided Multimodal Perception and Reasoning Framework for Autonomous Medical Systems
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Autonomous medical and robotic systems increasingly rely on intelligent perception and reasoning capabilities to interpret visual data and support clinical decision making. Radiology report generation represents a critical component of such automated diagnostic workflows, yet existing end-to-end multimodal models often suffer from weak visual grounding, resulting in unreliable interpretations and omission of subtle clinical findings. This paper presents XMedFusion, a modular AI framework designed as an intelligent perception and reasoning module for autonomous medical systems. The proposed framework decomposes visual information into coordinated functional components that emulate expert-driven analysis, including a visual perception agent that extracts image-grounded evidence, a knowledge graph construction agent that structures clinically relevant findings, and a retrieval-guided drafting process that ensures a consistent reporting structure. A synthesis agent iteratively integrates visual and structured evidence through reasoning-driven verification to produce reliable and interpretable diagnostic outputs. Experimental evaluation on a public chest radiograph dataset demonstrates significant improvements over baseline vision-language models, achieving gains from 0.0493 to 0.3359 in BLEU-1, 0.0863 to 0.2440 in ROUGE-L, and 0.0829 to 0.1708 in METEOR, along with substantial improvements in semantic evaluation metrics such as Consistency (2.38 to 7.80) and Accuracy (2.34 to 6.93). The results highlight the effectiveness of structured multi-agent perception and reasoning for enhancing robustness, transparency, and automation in intelligent medical imaging systems, enabling integration into autonomous healthcare and robotic diagnostic workflows.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 4 of its 21 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
4 of 21 references.
References · 4
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2025MedGemma Technical Reportcited by 398
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
- 2024Factual Serialization Enhancement: A Key Innovation for Chest X-ray Report Generationcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows
- 2024CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting
- 2025RadFabric: Agentic AI System with Reasoning Capability for Radiology
- 2026Route, Retrieve, Reflect, Repair: Self-Improving Agentic Framework for Visual Detection and Linguistic Reasoning in Medical Imaging
- 2025Reasoning Visual Language Model for Chest X-Ray Analysis
- 2025Toward Clinically Explainable AI for Medical Diagnosis: A Foundation Model with Human-Compatible Reasoning via Reinforcement Learning
- 2026MAC-RRG: Iterative Multi-Agent Collaboration for X-ray Radiology Report Generation
- 2025Medical AI Consensus: A Multi-Agent Framework for Radiology Report Generation and Evaluation