mlsanityData to 14 Oct 2026

CLEF: Clinically-Guided Contrastive Learning for Electrocardiogram Foundation Models

arXiv 2512.02180 ↗First posted 1 Dec 2025cs.LG cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

The electrocardiogram (ECG) is a key diagnostic tool in cardiovascular health. Single-lead ECG recording is integrated into both clinical-grade and consumer wearables. While self-supervised pretraining of foundation models on unlabeled ECGs improves diagnostic performance, existing approaches do not incorporate domain knowledge from clinical metadata. We introduce a novel contrastive learning approach that utilizes an established clinical risk score to adaptively weight negative pairs: clinically-guided contrastive learning. It aligns the similarities of ECG embeddings with clinically meaningful differences between subjects, with an explicit mechanism to handle missing metadata. On 12-lead ECGs from 161K patients in the MIMIC-IV dataset, we pretrain single-lead ECG foundation models at three scales, collectively called CLEF, using only routinely collected metadata without requiring per-sample ECG annotations. We evaluate CLEF on 18 clinical classification and regression tasks across 7 held-out datasets, and benchmark against 5 foundation model baselines and 3 self-supervised algorithms. When pretrained on 12-lead ECG data and tested on lead-I data, CLEF outperforms self-supervised foundation model baselines: the medium-sized CLEF achieves average AUROC improvements of at least 2.6% in classification and average reductions in MAEs of at least 3.2% in regression. Comparing with existing self-supervised learning algorithms, CLEF improves the average AUROC by at least 1.8%. Moreover, when pretrained only on lead-I data for classification tasks, CLEF performs comparably to the state-of-the-art ECGFounder, which was trained in a supervised manner. Overall, CLEF enables more accurate and scalable single-lead ECG analysis, advancing remote health monitoring. Code and pretrained CLEF models are available at: github.com/Nokia-Bell-Labs/ecg-foundation-model.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 30 of its 80 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

30 of 80 references.

References · 30

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  3. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  4. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  5. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  6. 2020Contrastive Learning with Hard Negative Samplescited by 628
  7. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  8. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  9. 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 171
  10. 2019Automatic diagnosis of the 12-lead ECG using a deep neural networkcited by 164
  11. 2024ECG-FM: An Open Electrocardiogram Foundation Modelcited by 90
  12. 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
18 more
  1. 2021Self-supervised representation learning from 12-lead ECG datacited by 80
  2. 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 67
  3. 2020HOLMES: Health OnLine Model Ensemble Serving for Deep Learning Models in Intensive Care Unitscited by 45
  4. 2022Lead-agnostic Self-supervised Learning for Local and Global Representations of Electrocardiogramcited by 38
  5. 2025Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Modelcited by 36
  6. 2024An Electrocardiogram Foundation Model Built on over 10 Million Recordings with External Evaluation across Multiple Domainscited by 27
  7. 2025LSM-2: Learning from Incomplete Wearable Sensor Datacited by 23
  8. 2025Beyond Sensor Data: Foundation Models of Behavioral Data from Wearables Improve Health Predictionscited by 18
  9. 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applicationscited by 15
  10. 2023Rethinking Negative Pairs in Code Searchcited by 14
  11. 2019Icentia11K: An Unsupervised Representation Learning Dataset for Arrhythmia Subtype Discoverycited by 13
  12. 2022Analysis of Augmentations for Contrastive ECG Representation Learningcited by 12
  13. 2022Metadata-guided Consistency Learning for High Content Imagescited by 8
  14. 2020Geometrically Mappable Image Featurescited by 7
  15. 2023MVKT-ECG: Efficient Single-lead ECG Classification on Multi-Label Arrhythmia by Multi-View Knowledge Transferringcited by 5
  16. 2023Predicting Cardiovascular Disease Risk using Photoplethysmography and Deep Learningcited by 5
  17. 2022ECG for high-throughput screening of multiple diseases: Proof-of-concept using multi-diagnosis deep learning from population-based datasetscited by 4
  18. 2022A Wearable ECG Monitor for Deep Learning Based Real-Time Cardiovascular Disease Detectioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.