FOCAL: Fine-Grained Optimal-Transport-Driven Contrastive Alignment of Language and ECGs with Waveform Enhancement
Not on the map. Why?
Abstract (arXiv)
Electrocardiograms (ECGs) are essential non-invasive tools for diagnosing cardiovascular diseases. While recent multimodal ECG-Report contrastive learning methods have shown promise for zero-shot ECG interpretation, they predominantly rely on global representations, failing to capture the fine-grained relationship between localized waveform patches and specific pathological tags. This limitation is further exacerbated by the fact that nearly 55% of standard clinical reports (e.g., in MIMIC-ECG) lack explicit waveform descriptions. In this paper, we propose FOCAL, a novel framework that achieves precise, fine-grained alignment between localized ECG segments and individual report tags via Optimal Transport. Furthermore, because fine-grained alignment at the tag level exacerbates the false negative problem among reports sharing common diagnoses, we introduce a semantic similarity matrix to guide the contrastive objective and correct misalignments. To address the scarcity of detailed waveform text, we introduce a coarse-to-fine enrichment pipeline that leverages Large Language Models (LLMs) to recover missing semantics, utilizing a coarse model verification step to rigorously filter out hallucinations. Extensive experiments across six datasets demonstrate that FOCAL establishes new state-of-the-art performance in zero-shot prediction and linear probing.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 50 references that are in the map. First posted on arXiv 17 May 2025.
Builds on
26 of 50 references.
References · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2019Publicly Available Clinical BERT Embeddingscited by 995
14 more
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
- 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 170
- 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
- 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 66
- 2025Large-scale and Fine-grained Vision-language Pre-training for Enhanced CT Image Understandingcited by 53
- 2022Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformercited by 47
- 2023Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learningcited by 46
- 2024Modeling Caption Diversity in Contrastive Vision-Language Pretrainingcited by 42
- 2023ETP: Learning Transferable ECG Representations via ECG-Text Pre-trainingcited by 28
- 2024ECG Semantic Integrator (ESI): A Foundation ECG Model Pretrained with LLM-Enhanced Cardiological Textcited by 25
- 2024Boosting Masked ECG-Text Auto-Encoders as Discriminative Learnerscited by 16
- 2025MedFILIP: Medical Fine-grained Language-Image Pre-trainingcited by 8
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care
- 2025HeartcareGPT: A Unified Multimodal ECG Suite for Dual Signal-Image Modeling and Understanding
- 2025Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment
- 2026ECGQuest: Benchmarking and Fine-Tuning Language Models for Electrocardiography
- 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Images
- 2026Holtercare-Bench: A Multimodal Benchmark for Evaluating Long-Term Dynamic ECG Analysis
- 2026Enhancing Explainable Cardiac Diagnosis with Guide-Grounded Multimodal LLMs
- 2025ECG-LLM -- training and evaluation of domain-specific large language models for electrocardiography