mlsanityData to 7 Oct 2026

FOCAL: Fine-Grained Optimal-Transport-Driven Contrastive Alignment of Language and ECGs with Waveform Enhancement

arXiv 2505.11939 ↗First posted 17 May 2025eess.SP cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Electrocardiograms (ECGs) are essential non-invasive tools for diagnosing cardiovascular diseases. While recent multimodal ECG-Report contrastive learning methods have shown promise for zero-shot ECG interpretation, they predominantly rely on global representations, failing to capture the fine-grained relationship between localized waveform patches and specific pathological tags. This limitation is further exacerbated by the fact that nearly 55% of standard clinical reports (e.g., in MIMIC-ECG) lack explicit waveform descriptions. In this paper, we propose FOCAL, a novel framework that achieves precise, fine-grained alignment between localized ECG segments and individual report tags via Optimal Transport. Furthermore, because fine-grained alignment at the tag level exacerbates the false negative problem among reports sharing common diagnoses, we introduce a semantic similarity matrix to guide the contrastive objective and correct misalignments. To address the scarcity of detailed waveform text, we introduce a coarse-to-fine enrichment pipeline that leverages Large Language Models (LLMs) to recover missing semantics, utilizing a coarse model verification step to rigorously filter out hallucinations. Extensive experiments across six datasets demonstrate that FOCAL establishes new state-of-the-art performance in zero-shot prediction and linear probing.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 50 references that are in the map. First posted on arXiv 17 May 2025.

Builds on

26 of 50 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  7. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  9. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  10. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  11. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  12. 2019Publicly Available Clinical BERT Embeddingscited by 995
14 more
  1. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  2. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
  3. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
  4. 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 170
  5. 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
  6. 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 66
  7. 2025Large-scale and Fine-grained Vision-language Pre-training for Enhanced CT Image Understandingcited by 53
  8. 2022Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformercited by 47
  9. 2023Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learningcited by 46
  10. 2024Modeling Caption Diversity in Contrastive Vision-Language Pretrainingcited by 42
  11. 2023ETP: Learning Transferable ECG Representations via ECG-Text Pre-trainingcited by 28
  12. 2024ECG Semantic Integrator (ESI): A Foundation ECG Model Pretrained with LLM-Enhanced Cardiological Textcited by 25
  13. 2024Boosting Masked ECG-Text Auto-Encoders as Discriminative Learnerscited by 16
  14. 2025MedFILIP: Medical Fine-grained Language-Image Pre-trainingcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care
  2. 2025HeartcareGPT: A Unified Multimodal ECG Suite for Dual Signal-Image Modeling and Understanding
  3. 2025Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment
  4. 2026ECGQuest: Benchmarking and Fine-Tuning Language Models for Electrocardiography
  5. 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Images
  6. 2026Holtercare-Bench: A Multimodal Benchmark for Evaluating Long-Term Dynamic ECG Analysis
  7. 2026Enhancing Explainable Cardiac Diagnosis with Guide-Grounded Multimodal LLMs
  8. 2025ECG-LLM -- training and evaluation of domain-specific large language models for electrocardiography