Graph-Augmented Topological Internalization with Dual-Stream Classifiers for Medical Report Generation
Not on the map. Why?
Abstract (arXiv)
Automated medical report generation, MRG, holds substantial value for alleviating radiologist workload and enhancing diagnostic efficiency. However, mainstream approaches typically treat diverse chest abnormalities as isolated classification targets. This paradigm often overlooks inherent disease co-occurrences and struggles to translate medical topological structures into explicit data correlations, constraining the model's reasoning capacity on complex or subtle lesions. To address this, we propose a Graph-Augmented Dual-Stream Medical Report Generation with Topological Internalization, GDMRG. Our framework introduces a Topological Knowledge Internalization module, TKI, which leverages a Graph Convolutional Network, GCN, to generate an explicit parameterized weight matrix based on global disease co-occurrence priors. This facilitates efficient topological knowledge injection without relying on external retrieval mechanisms. Building upon this, we construct a dual-stream classification system: the main branch generates discrete diagnostic prompts under topological constraints, while the auxiliary branch employs an asymmetric optimization strategy to dynamically calibrate decision boundaries for highly imbalanced samples. Concurrently, to establish a logical closed loop between diagnosis and visual grounding, we design a diagnostic-driven Diagnosis-Guided Spatial Attention, DGSA, that utilizes high-dimensional clinical semantics to recalibrate the visual encoder, mitigating feature hallucinations. Comprehensive experiments on the MIMIC-CXR dataset demonstrate that GDMRG achieves competitive clinical efficacy, CE, while maintaining natural language fluency. Furthermore, our model exhibits robust zero-shot generalization on the IU X-Ray dataset. In summary, this work presents an integrated and interpretable paradigm for medical report generation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 37 of its 53 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
37 of 53 references.
References · 37
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
25 more
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2020Long-tail learning via logit adjustmentcited by 618
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
- 2017On the Automatic Generation of Medical Imaging Reportscited by 216
- 2022Cross-modal Memory Networks for Radiology Report Generationcited by 185
- 2020When Radiology Report Generation Meets Knowledge Graphcited by 145
- 2018Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generationcited by 141
- 2020Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generationcited by 141
- 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 140
- 2018TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-rayscited by 139
- 2019Clinically Accurate Chest X-Ray Report Generationcited by 139
- 2023Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Imagescited by 128
- 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generationcited by 118
- 2023METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokenscited by 101
- 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 95
- 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 95
- 2021Radiology Report Generation with a Learned Knowledge Base and Multi-modal Alignmentcited by 73
- 2021Contrastive Attention for Automatic Chest X-ray Report Generationcited by 71
- 2019C2FNAS: Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentationcited by 50
- 2021Progressive Transformer-Based Generation of Radiology Reportscited by 43
- 2021RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reportingcited by 34
- 2022CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generationcited by 22
- 2023Cross-Modal Causal Intervention for Medical Report Generationcited by 15
- 2024Topicwise Separable Sentence Retrieval for Medical Report Generationcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.