mlsanityData to 14 Oct 2026

Enhancing Explainable Cardiac Diagnosis with Guide-Grounded Multimodal LLMs

arXiv 2607.20814 ↗First posted 23 Jul 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The electrocardiogram (ECG) is a cornerstone of cardiac as- sessment, yet clinical deployment of deep learning models remains con- strained by limited interpretability and the hallucination risk of large language models (LLMs). Existing CNN+Grad-CAM+multimodal LLM frameworks can generate ECG reports, but their explanations are often only weakly grounded in established diagnostic criteria, reducing trust- worthiness and reproducibility. We propose a guide-grounded multimodal framework that explicitly anchors report generation in curated clinical knowledge. A convolutional neural network (CNN) and Grad-CAM first produce class probabilities and class-specific heatmaps from 12-lead ECG images. In parallel, authoritative ECG textbooks and guideline materials are distilled offline into a structured ECG Interpretation Guide, which is injected as a fixed knowledge block for every sample. Conditioned on the ECG image, Grad-CAM overlay, CNN-derived fact pack, and the in- jected guide, a multimodal LLM generates structured diagnostic reports with guideline-consistent terminology and criteria usage. Experiments on the full PTB-XL test set demonstrate that guide grounding improves se- mantic quality and perceived consistency of generated reports while pre- serving competitive classification performance. In particular, our method increases the average BERTScore of generated impressions from 0.818 to 0.953 relative to a strong CNN+Grad-CAM+MLLM baseline, indicat- ing closer alignment with reference reports. These findings suggest that injecting a distilled interpretation guide into the multimodal prompting pipeline offers a practical pathway to reduce hallucinations and enhance the clinical plausibility of LLM-based ECG explanations, bringing ex- plainable cardiac diagnosis closer to real-world deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

15 of 25 references.

References · 15

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  7. 2016Densely Connected Convolutional Networkscited by 6,720
  8. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  9. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  10. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  11. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  12. 2020Deep Learning for ECG Analysis: Benchmarks and Insights from PTB-XLcited by 158
3 more
  1. 2017Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networkscited by 53
  2. 2024ECG-Chat: A Large ECG-Language Model for Cardiac Disease Diagnosiscited by 38
  3. 2024Teach Multimodal LLMs to Comprehend Electrocardiographic Imagescited by 28

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Physiology-Aware CNN and Zero-Shot Multimodal LLMs for ECG Image Classification: A Comparative Study
  2. 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Images
  3. 2026ECG Foundation Models and Medical LLMs for Agentic Cardiovascular Intelligence at the Edge: A Review and Outlook
  4. 2026ECG-LLM: Foundation Model for ECG-Based Cardiac Reasoning
  5. 2025Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment
  6. 2024De-biased Multimodal Electrocardiogram Analysis
  7. 2026ECG-Reasoning-Benchmark: A Benchmark for Evaluating Clinical Reasoning Capabilities in ECG Interpretation
  8. 2026ECGQuest: Benchmarking and Fine-Tuning Language Models for Electrocardiography