mlsanityData to 14 Oct 2026

LEAD: Layer-wise Expert-aligned Decoding for Faithful Radiology Report Generation

arXiv 2602.04617 ↗First posted 4 Feb 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Radiology Report Generation aims to produce accurate and coherent diagnostics from medical images. Although large vision-language models improve report fluency and accuracy, they still suffer from hallucinations by generating plausible pathological descriptions that are not supported by the input images. Existing methods primarily rely on external knowledge guidance to facilitate the alignment between generated text and visual information. However, these approaches often ignore the inherent decoding priors and vision-language alignment biases in pretrained models and lack robustness due to reliance on constructed guidance. In this paper, we propose Layer-wise Expert-aligned Decoding, a method that directly intervenes in the internal decoding process of large vision-language models. A pathology-specific expert module is designed to extract discriminative pathological features, which are then injected into each decoder layer through a gated mechanism. This architecture enables the large language model to progressively incorporate expert features during generation through a learned layer-wise gating function, thereby mitigating decoding biases and steering generation toward factual consistency. Experiments on multiple public datasets demonstrate that the proposed method improves clinical accuracy and factual consistency while maintaining competitive report generation quality.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 70 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

41 of 70 references.

References · 41

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  6. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  7. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  8. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  9. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  10. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 688
  11. 2023OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocationcited by 478
  12. 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 376
29 more
  1. 2020Generating Radiology Reports via Memory-driven Transformercited by 368
  2. 2024A Survey on Hallucination in Large Vision-Language Modelscited by 357
  3. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 337
  4. 2023Towards Generalist Biomedical AIcited by 289
  5. 2022Cross-modal Memory Networks for Radiology Report Generationcited by 185
  6. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 128
  7. 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 114
  8. 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 106
  9. 2023METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokenscited by 101
  10. 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 95
  11. 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 95
  12. 2022Cross-modal Prototype Driven Network for Radiology Report Generationcited by 59
  13. 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
  14. 2025Enhanced Contrastive Learning with Multi-view Longitudinal Data for Chest X-ray Report Generationcited by 42
  15. 2024CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Datasetcited by 35
  16. 2024Fact-Aware Multimodal Retrieval Augmentation for Accurate Medical Radiology Report Generationcited by 23
  17. 2022Attributed Abnormality Graph Embedding for Clinically Accurate X-Ray Report Generationcited by 17
  18. 2023A Systematic Review of Deep Learning-based Research on Radiology Report Generationcited by 14
  19. 2025Activating Associative Disease-Aware Vision Token Memory for LLM-Based X-ray Report Generationcited by 13
  20. 2025RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injectioncited by 13
  21. 2024R2GenCSR: Mining Contextual and Residual Information for LLMs-based Radiology Report Generationcited by 12
  22. 2025RadAlign: Advancing Radiology Report Generation with Vision-Language Concept Alignmentcited by 12
  23. 2025Rethinking Table Instruction Tuningcited by 10
  24. 2024SERPENT-VLM : Self-Refining Radiology Report Generation Using Vision Language Modelscited by 8
  25. 2024GPT-4V Cannot Generate Radiology Reports Yetcited by 7
  26. 2025A Chain of Diagnosis Framework for Accurate and Explainable Radiology Report Generationcited by 7
  27. 2025Text Reinforcement for Multimodal Time Series Forecastingcited by 7
  28. 2025Balanced Training Data Augmentation for Aspect-Based Sentiment Analysiscited by 5
  29. 2025Mixture of Decoding: An Attention-Inspired Adaptive Decoding Strategy to Mitigate Hallucinations in Large Vision-Language Modelscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Visual Alignment of Medical Vision-Language Models for Grounded Radiology Report Generation
  2. 2026Homogeneous Semantic Alignment and Hierarchical Expert Routing for Radiology Report Generation
  3. 2025MCA-RG: Enhancing LLMs with Medical Concept Alignment for Radiology Report Generation
  4. 2024TRRG: Towards Truthful Radiology Report Generation With Cross-modal Disease Clue Enhanced Large Language Model
  5. 2025Med-R2: Perception and Reflection-driven Complex Reasoning for Medical Report Generation
  6. 2024Multimodal Large Language Model driven Radiology Report Generation with Clinical Knowledge Enhancement
  7. 2026Learning to See Locally and Align Clinically with Pathology Semantics for Radiology Report Generation
  8. 2026CCS: Clinical Consensus Selection for Radiology Report Generation