CLEF: Clinically-Guided Contrastive Learning for Electrocardiogram Foundation Models
Not on the map. Why?
Abstract (arXiv)
The electrocardiogram (ECG) is a key diagnostic tool in cardiovascular health. Single-lead ECG recording is integrated into both clinical-grade and consumer wearables. While self-supervised pretraining of foundation models on unlabeled ECGs improves diagnostic performance, existing approaches do not incorporate domain knowledge from clinical metadata. We introduce a novel contrastive learning approach that utilizes an established clinical risk score to adaptively weight negative pairs: clinically-guided contrastive learning. It aligns the similarities of ECG embeddings with clinically meaningful differences between subjects, with an explicit mechanism to handle missing metadata. On 12-lead ECGs from 161K patients in the MIMIC-IV dataset, we pretrain single-lead ECG foundation models at three scales, collectively called CLEF, using only routinely collected metadata without requiring per-sample ECG annotations. We evaluate CLEF on 18 clinical classification and regression tasks across 7 held-out datasets, and benchmark against 5 foundation model baselines and 3 self-supervised algorithms. When pretrained on 12-lead ECG data and tested on lead-I data, CLEF outperforms self-supervised foundation model baselines: the medium-sized CLEF achieves average AUROC improvements of at least 2.6% in classification and average reductions in MAEs of at least 3.2% in regression. Comparing with existing self-supervised learning algorithms, CLEF improves the average AUROC by at least 1.8%. Moreover, when pretrained only on lead-I data for classification tasks, CLEF performs comparably to the state-of-the-art ECGFounder, which was trained in a supervised manner. Overall, CLEF enables more accurate and scalable single-lead ECG analysis, advancing remote health monitoring. Code and pretrained CLEF models are available at: github.com/Nokia-Bell-Labs/ecg-foundation-model.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 30 of its 80 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
30 of 80 references.
References · 30
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2020Contrastive Learning with Hard Negative Samplescited by 628
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 171
- 2019Automatic diagnosis of the 12-lead ECG using a deep neural networkcited by 164
- 2024ECG-FM: An Open Electrocardiogram Foundation Modelcited by 90
- 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
18 more
- 2021Self-supervised representation learning from 12-lead ECG datacited by 80
- 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 67
- 2020HOLMES: Health OnLine Model Ensemble Serving for Deep Learning Models in Intensive Care Unitscited by 45
- 2022Lead-agnostic Self-supervised Learning for Local and Global Representations of Electrocardiogramcited by 38
- 2025Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Modelcited by 36
- 2024An Electrocardiogram Foundation Model Built on over 10 Million Recordings with External Evaluation across Multiple Domainscited by 27
- 2025LSM-2: Learning from Incomplete Wearable Sensor Datacited by 23
- 2025Beyond Sensor Data: Foundation Models of Behavioral Data from Wearables Improve Health Predictionscited by 18
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applicationscited by 15
- 2023Rethinking Negative Pairs in Code Searchcited by 14
- 2019Icentia11K: An Unsupervised Representation Learning Dataset for Arrhythmia Subtype Discoverycited by 13
- 2022Analysis of Augmentations for Contrastive ECG Representation Learningcited by 12
- 2022Metadata-guided Consistency Learning for High Content Imagescited by 8
- 2020Geometrically Mappable Image Featurescited by 7
- 2023MVKT-ECG: Efficient Single-lead ECG Classification on Multi-Label Arrhythmia by Multi-View Knowledge Transferringcited by 5
- 2023Predicting Cardiovascular Disease Risk using Photoplethysmography and Deep Learningcited by 5
- 2022ECG for high-throughput screening of multiple diseases: Proof-of-concept using multi-diagnosis deep learning from population-based datasetscited by 4
- 2022A Wearable ECG Monitor for Deep Learning Based Real-Time Cardiovascular Disease Detectioncited by 3
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Compact Latent Manifold Translation: A Parameter-Efficient Foundation Model for Cross-Modal and Cross-Frequency Physiological Signal Synthesiscited by 1
- 2026PRISM-CTG: A Foundation Model for Cardiotocography Analysis with Multi-View SSLcited by 0
- 2026CogAdapt: Adapting Clinical ECG Foundation Models for Wearable Cognitive Load Assessmentcited by 0
- 2026ADAPTOOD: Uncertainty-Aware Fine-Tuning for Out-of-Distribution ECG Time Series Modelscited by 0
- 2026FOUND-AF: Benchmarking ECG Foundation Models for Atrial Fibrillation Detectioncited by 0
- 2026LAEF: A Lead-Agnostic ECG Foundation Model Towards Point-of-Care Diagnosticscited by 0
- 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Modelscited by 0
- 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Models28 Sep 2026
- 2026LAEF: A Lead-Agnostic ECG Foundation Model Towards Point-of-Care Diagnostics4 Aug 2026
- 2026FOUND-AF: Benchmarking ECG Foundation Models for Atrial Fibrillation Detection4 Aug 2026
- 2026ADAPTOOD: Uncertainty-Aware Fine-Tuning for Out-of-Distribution ECG Time Series Models2 Jun 2026
- 2026CogAdapt: Adapting Clinical ECG Foundation Models for Wearable Cognitive Load Assessment21 May 2026
- 2026Compact Latent Manifold Translation: A Parameter-Efficient Foundation Model for Cross-Modal and Cross-Frequency Physiological Signal Synthesis13 May 2026
- 2026PRISM-CTG: A Foundation Model for Cardiotocography Analysis with Multi-View SSL9 Apr 2026