MKG-CARE: Case-Aware Reasoning with Multimodal Knowledge Graphs for Explainable Medical Image Diagnosis
Not on the map. Why?
Abstract (arXiv)
Medical image diagnosis has achieved significant progress with deep learning, yet existing methods often rely on isolated visual evidence and lack the ability to effectively leverage similar cases and external knowledge. In clinical practice, diagnosis is typically supported by similar historical cases and their associated symptoms. To explicitly model this evidence-based diagnostic process, we propose MKG-CARE, a framework that performs case-aware reasoning using multimodal knowledge graphs for explainable medical image diagnosis. Specifically, we construct a case-aware multimodal knowledge graph as a structured diagnostic memory, where diseases, images, and symptoms are hierarchically organized. Given an input image, MKG-CARE adaptively retrieves similar cases from this memory and extracts their corresponding case-centered subgraphs. We further introduce a knowledge propagation and injection mechanism, where an image-centric Graph Attention Network aggregates heterogeneous semantics within the retrieved case subgraphs, followed by bidirectional cross-modal attention to align and inject the aggregated case knowledge into visual representations. To mitigate retrieval noise, we design a confidence-calibrated decision refinement scheme that estimates each retrieved case's reliability from prediction confidence and sample similarity, and reweights its contribution to the final prediction for interpretable case-level evidence attribution. Extensive experiments on multiple medical imaging datasets demonstrate consistent improvements over strong baselines, while ablation and qualitative analyses validate the effectiveness and interpretability of our method. The code is available at https://github.com/lyxuan1022/MKG-CARE.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 40 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
13 of 40 references.
References · 13
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2017Graph Attention Networkscited by 8,854
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 211
- 2020PAD-UFES-20: a skin lesion dataset composed of patient data and clinical images collected from smartphonescited by 116
- 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptationcited by 112
- 2025CT-Agent: A Multimodal-LLM Agent for 3D CT Radiology Question Answeringcited by 20
- 2025EndoBench: A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysiscited by 13
- 2025MedTVT-R1: A Multimodal LLM Empowering Medical Reasoning and Diagnosiscited by 7
- 2025VAP-Diffusion: Enriching Descriptions with MLLMs for Enhanced Medical Image Generationcited by 2
1 more
Built on by
Not cited yet.