GTA-Net: Cooperative Game Theory for Vision-Language Alignment in Chest X-Ray Report Generation
Not on the map. Why?
Abstract (arXiv)
Automated chest X-ray report generation requires precise cross-modal grounding to ensure clinically reliable descriptions. However, existing vision-language models rely on implicit attention mechanisms that fail to enforce explicit region-word correspondence and disease-level consistency. We propose Game-Theoretic Alignment Network (GTA-Net), a vision-language framework that formulates report generation as a cooperative game-theoretic alignment problem. The model introduces a BinaryGameAligner that models interactions between image regions and text tokens using similarity-based payoff matrices with Shapley-inspired importance weighting. To enforce clinical semantics, we further develop a Disease-Aware Ternary Aligner, which captures joint interactions among images, reports, and structured disease concepts. GTA-Net combines a Swin-based visual encoder with a LoRA-adapted large language model and is trained with a unified objective for generation and alignment. Experiments on CheXpertPlus and IU-XRay demonstrate state-of-the-art performance across standard generation metrics and improved clinical consistency, highlighting the effectiveness of explicit game-theoretic alignment for medical vision-language generation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 20 Jun 2026.
Builds on
12 of 24 references.
References · 12
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2020Generating Radiology Reports via Memory-driven Transformercited by 368
- 2018Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generationcited by 141
- 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 114
- 2021Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generationcited by 47
- 2025Activating Associative Disease-Aware Vision Token Memory for LLM-Based X-ray Report Generationcited by 13
- 2024A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Datacited by 6
- 2025R2GenKG: Hierarchical Multi-modal Knowledge Graph for LLM-based Radiology Report Generationcited by 4
- 2025EMRRG: Efficient Fine-Tuning Pre-trained X-ray Mamba Networks for Radiology Report Generationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RadZero: Similarity-Based Cross-Attention for Explainable Vision-Language Alignment in Chest X-ray with Zero-Shot Multi-Task Capability
- 2025Visual Alignment of Medical Vision-Language Models for Grounded Radiology Report Generation
- 2026DobicVLM: Aligning Chest X-Ray Report Generation with Clinically-Grounded Programmatic Rewards via Group Relative Policy Optimization
- 2025CheXPO-v2: Preference Optimization for Chest X-ray VLMs with Knowledge Graph Consistency
- 2024Grounded Knowledge-Enhanced Medical Vision-Language Pre-training for Chest X-Ray
- 2026CXRMate-2: Structured Multimodal Temporal Embeddings and Tractable Reinforcement Learning for Clinically Acceptable Chest X-ray Radiology Report Generation
- 2026PLRS-IC: A Dual-Calibration Framework for Chest X-Ray Vision-Language Alignment
- 2025VICCA: Visual Interpretation and Comprehension of Chest X-ray Anomalies in Generated Report Without Human Feedback