ECG-FM: An Open Electrocardiogram Foundation Model
Not on the map. Why?
Abstract (arXiv)
Conventional task-specific electrocardiogram (ECG) analysis models require large annotated datasets to train. Foundation models mitigate this burden by leveraging self-supervised pretraining; however, the scarcity of open-weight ECG foundation models hinders adoption and cross-study comparability. We present ECG-FM, an open foundation model for ECG analysis, and conduct a study using a dataset of 1.5 million ECGs. ECG-FM is a transformer-based model pretrained using a hybrid contrastive and generative self-supervised learning approach. Our downstream tasks include predicting reduced left ventricular ejection fraction (LVEF) and ECG interpretation labels, where we release a benchmark task on the MIMIC-IV-ECG dataset. We affirm that ECG-FM is robust, label-efficient, and functionally discriminative by showcasing data scaling experiments, performing a latent space analysis, and generating saliency maps. ECG-FM markedly outperforms task-specific models in the small-to-medium-scale data regime and demonstrates cross-dataset generalizability, achieving high AUROC on many clinically salient labels such as atrial fibrillation (0.996) and LVEF<=40% (0.929). We release our code, model weights, and benchmark task at https://github.com/bowang-lab/ECG-FM/.
Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). Builds on 11 of its 34 references that are in the map. First posted on arXiv 9 Aug 2024.
Builds on
11 of 34 references.
References · 11
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
- 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 170
- 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
- 2023Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encodingcited by 71
- 2022Lead-agnostic Self-supervised Learning for Local and Global Representations of Electrocardiogramcited by 38
- 2023Improving Pixel-based MIM by Reducing Wasted Modeling Capabilitycited by 24
- 2023Towards Enhancing Time Series Contrastive Learning: A Dynamic Bad Pair Mining Approachcited by 13
- 2023ECGBERT: Understanding Hidden Language of ECGs with Self-Supervised Representation Learningcited by 10
- 2024CREMA: A Contrastive Regularized Masked Autoencoder for Robust ECG Diagnostics across Clinical Domainscited by 8
Built on by
Citing papers per year: 2024: 8; 2025: 28; 2026: 53.
89 papers.
Sort:
By area:
- 2024PaPaGei: Open Foundation Models for Optical Physiological Signalscited by 64
- 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Imagescited by 35
- 2024An Electrocardiogram Foundation Model Built on over 10 Million Recordings with External Evaluation across Multiple Domainscited by 27
- 2024Zero-shot forecasting of chaotic systemscited by 25
- 2024Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecturecited by 17
- 2024Boosting Masked ECG-Text Auto-Encoders as Discriminative Learnerscited by 16
- 2025From Token to Rhythm: A Multi-Scale Approach for ECG-Language Pretrainingcited by 15
- 2025Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learningcited by 14
- 2024Beyond LoRA: Exploring Efficient Fine-Tuning Techniques for Time Series Foundational Modelscited by 10
- 2025OpenECG: Benchmarking ECG Foundation Models with Public 1.2 Million Recordscited by 10
- 2025CLEF: Clinically-Guided Contrastive Learning for Electrocardiogram Foundation Modelscited by 7
- 2025Benchmarking ECG FMs: A Reality Check Across Clinical Taskscited by 6
38 more
- 2024AnyECG: Foundational Models for Multitask Cardiac Analysis in Real-World Settingscited by 5
- 2025Knowledge-enhanced Multimodal ECG Representation Learning with Arbitrary-Lead Inputscited by 5
- 2025EchoingECG: An Electrocardiogram Cross-Modal Model for Echocardiogram Taskscited by 4
- 2025TolerantECG: A Foundation Model for Imperfect Electrocardiogramcited by 3
- 2026Learning Transferable Sensor Models via Language-Informed Pretrainingcited by 3
- 2026Physiology-Aware Masked Cross-Modal Reconstruction for Biosignal Representation Learningcited by 3
- 2026CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representationcited by 3
- 2025Sensing Cardiac Health Across Scenarios and Devices: A Multi-Modal Foundation Model Pretrained on Heterogeneous Data from 1.7 Million Individualscited by 2
- 2025QualityFM: a Multimodal Physiological Signal Foundation Model with Self-Distillation for Signal Quality Challenges in Critically Ill Patientscited by 2
- 2025ProbMed: A Probabilistic Framework for Medical Multimodal Bindingcited by 2
- 2025CODE-II: A large-scale dataset for artificial intelligence in ECG analysiscited by 2
- 2025An Electrocardiogram Multi-task Benchmark with Comprehensive Evaluations and Insightful Findingscited by 2
- 2026CARE-ECG: Causal Agent-based Reasoning for Explainable and Counterfactual ECG Interpretationcited by 2
- 2026ECG-WM: A Physiology-Informed ECG World Model for Clinical Intervention Simulationcited by 2
- 2024Generative AI in Medicinecited by 1
- 2025Fusion of ECG Foundation Model Embeddings to Improve Early Detection of Acute Coronary Syndromescited by 1
- 2025ExChanGeAI: An End-to-End Platform and Efficient Foundation Model for Electrocardiogram Analysis and Fine-tuningcited by 1
- 2025ICYM2I: The illusion of multimodal informativeness under missingnesscited by 1
- 2025Domain Knowledge is Power: Leveraging Physiological Priors for Self Supervised Representation Learning in Electrocardiographycited by 1
- 2025FoundationalECGNet: A Lightweight Foundational Model for ECG-based Multitask Cardiac Analysiscited by 1
- 2025BioX-Bridge: Model Bridging for Unsupervised Cross-Modal Knowledge Transfer across Biosignalscited by 1
- 2025ECG-RAMBA: Zero-Shot ECG Generalization by Morphology-Rhythm Disentanglement and Long-Range Modelingcited by 1
- 2026AnyECG: Evolved ECG Foundation Model for Holistic Health Profilingcited by 1
- 2026ECG-MoE: Mixture-of-Expert Electrocardiogram Foundation Modelcited by 1
- 2026A foundation model for electrodermal activity datacited by 1
- 2026Pretraining on Sleep Data Improves non-Sleep Biosignal Taskscited by 1
- 2026Biosignal Fingerprinting: A Cross-Modal PPG-ECG Foundation Modelcited by 1
- 2026Hierarchical Self-Supervised Representation Learning Framework for Multivariate Time Series Grounded in ECG Analysiscited by 1
- 2025Multimodal Latent Fusion of ECG Leads for Early Assessment of Pulmonary Hypertensioncited by 0
- 2025Bridging Performance Gaps for ECG Foundation Models: A Post-Training Strategycited by 0
- 2025Introducing Multimodal Paradigm for Learning Sleep Staging PSG via General-Purpose Modelcited by 0
- 2025Generalist vs Specialist Time Series Foundation Models: Investigating Potential Emergent Behaviors in Assessing Human Health Using PPG Signalscited by 0
- 2025EnECG: Efficient Ensemble Learning for Electrocardiogram Multi-task Foundation Modelcited by 0
- 2025A Dataset and Benchmarks for Atrial Fibrillation Detection from Electrocardiograms of Intensive Care Unit Patientscited by 0
- 2025Modeling Day-Long ECG Signals to Predict Heart Failure Risk with Explainable AIcited by 0
- 2026BEAT-Net: Injecting Biomimetic Spatio-Temporal Priors for Interpretable ECG Diagnosiscited by 0
- 2026Beat-ssl: Capturing Local ECG Morphology through Heartbeat-level Contrastive Learning with Soft Targetscited by 0
- 2026Looking Beyond Accuracy: A Holistic Benchmark of ECG Foundation Modelscited by 0
50 most cited of 89 All 89 (JSON)
- 2026Robust Transfer Learning for Paper ECG Recognition30 Sep 2026
- 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Models28 Sep 2026
- 2026TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care28 Sep 2026
- 2026BeatGraph: Self-Supervised Heartbeat Graphs for Infant ECG Representations from the Home Environment25 Sep 2026
- 2026A Hybrid CNN--State-Space--Attention Backbone with Joint-Embedding Predictive Pretraining for 12-Lead ECG Classification24 Sep 2026
- 2026When Does Unsupervised Learning Succeed or Fail? A PoS Perspective on Reconstruction-Based Anomaly Detection23 Sep 2026
- 2026TRACE: Tractable Routing Autoencoder for Clinical ECG20 Sep 2026
- 2026Leveraging Cardiac Imaging to Improve ECG-Based Detection of Chagas Disease in Resource-Constrained Settings8 Sep 2026
- 2026Large language models in medical time series analysis7 Sep 2026
- 2026Beat-Synchronous Tokenization for ECG Transformers31 Aug 2026
- 2026Holtercare-Bench: A Multimodal Benchmark for Evaluating Long-Term Dynamic ECG Analysis19 Aug 2026
- 2026Attributing Preprocessing Invariance in Spectral Foundation Models14 Aug 2026
38 more
- 2026CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representation13 Aug 2026
- 2026The Impact of Temporal Context Length and Encoding Strategies on Self-Supervised ECG Representation Learning13 Aug 2026
- 2026Diagnosing as Cardiologists Do: ECG Agents with Doctor-Grounded Priors for Clinical Reasoning Across Diseases and Populations10 Aug 2026
- 2026LAEF: A Lead-Agnostic ECG Foundation Model Towards Point-of-Care Diagnostics4 Aug 2026
- 2026PhysioBench: A Unified Benchmark for Physiological Signal Question Answering29 Jul 2026
- 2026ECG-InterpBench: Benchmarking the Interpretability of ECG Foundation Models with Matched-Scale Sparse Autoencoders29 Jul 2026
- 2026CADENCE: A Cardiac Atom Dictionary for Interpretable Neural Concept Extraction from ECG Foundation Models28 Jul 2026
- 2026Wolff-Parkinson-White Detection at 471:1 Class Imbalance: A Leakage-Controlled Study of the Data Bottleneck27 Jul 2026
- 2026Autoregressive EHR Foundation Models with Multimodal Inputs24 Jul 2026
- 2026NeuroECG: ECGFounder-Based Deep ECG Representation for EEG-Free Neurological Prognostication After Cardiac Arrest13 Jul 2026
- 2026Do ECG Foundation Models Transfer to Rare Cardiac Diseases? Evidence from Brugada Syndrome Detection3 Jul 2026
- 2026Hierarchical Self-Supervised Representation Learning Framework for Multivariate Time Series Grounded in ECG Analysis1 Jul 2026
- 2026Cohort-Anchored Foundation Models for Electronic Health Records: From Risk Scores to Auditable Peer Cohorts20 Jun 2026
- 2026Next-Token Prediction Learns Generalisable Representations of Sleep Physiology8 Jun 2026
- 2026Information-theoretic Multimodal Representation Learning for Electrocardiogram Signals26 May 2026
- 2026CogAdapt: Adapting Clinical ECG Foundation Models for Wearable Cognitive Load Assessment21 May 2026
- 2026ECG-WM: A Physiology-Informed ECG World Model for Clinical Intervention Simulation17 May 2026
- 2026How Do Electrocardiogram Models Scale?17 May 2026
- 2026Extending Pretrained 10-Second ECG Foundation Models to Longer Horizons16 May 2026
- 2026Toward World Modeling of Physiological Signals with Chaos-Theoretic Balancing and Latent Dynamics14 May 2026
- 2026Biosignal Fingerprinting: A Cross-Modal PPG-ECG Foundation Model10 May 2026
- 2026Pretraining on Sleep Data Improves non-Sleep Biosignal Tasks4 May 2026
- 2026Physiology-Aware Masked Cross-Modal Reconstruction for Biosignal Representation Learning1 May 2026
- 2026Domain-Adapted Fine-Tuning of ECG Foundation Models for Multi-Label Structural Heart Disease Screening25 Apr 2026
- 2026Towards Real-Time ECG and EMG Modeling on μNPUs20 Apr 2026
- 2026CARE-ECG: Causal Agent-based Reasoning for Explainable and Counterfactual ECG Interpretation12 Apr 2026
- 2026Sense Less, Infer More: Agentic Multimodal Transformers for Edge Medical Intelligence12 Apr 2026
- 2026Learning ECG Image Representations via Dual Physiological-Aware Alignments2 Apr 2026
- 2026From Foundation ECG Models to NISQ Learners: Distilling ECGFounder into a VQC Student28 Mar 2026
- 2026Learning Transferable Sensor Models via Language-Informed Pretraining12 Mar 2026
- 2026SignalMC-MED: A Multimodal Benchmark for Evaluating Biosignal Foundation Models on Single-Lead ECG and PPG10 Mar 2026
- 2026ECG-MoE: Mixture-of-Expert Electrocardiogram Foundation Model4 Mar 2026
- 2026Detecting Structural Heart Disease from Electrocardiograms via a Generalized Additive Model of Interpretable Foundation-Model Predictors3 Mar 2026
- 2026Benchmarking LLM Summaries of Multimodal Clinical Time Series for Remote Monitoring2 Mar 2026
- 2026A foundation model for electrodermal activity data20 Feb 2026
- 2026Position: Evaluation of ECG Representations Must Be Fixed19 Feb 2026
- 2026CAMEL: An ECG Language Model for Forecasting Cardiac Events17 Feb 2026
- 2026Looking Beyond Accuracy: A Holistic Benchmark of ECG Foundation Models29 Jan 2026
50 newest of 89 All 89 (JSON)
- 2024PaPaGei: Open Foundation Models for Optical Physiological Signalscited by 64
- 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Imagescited by 35
- 2024An Electrocardiogram Foundation Model Built on over 10 Million Recordings with External Evaluation across Multiple Domainscited by 27
- 2024Zero-shot forecasting of chaotic systemscited by 25
- 2024Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecturecited by 17
- 2024Boosting Masked ECG-Text Auto-Encoders as Discriminative Learnerscited by 16
- 2025From Token to Rhythm: A Multi-Scale Approach for ECG-Language Pretrainingcited by 15
- 2025Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learningcited by 14
- 2024Beyond LoRA: Exploring Efficient Fine-Tuning Techniques for Time Series Foundational Modelscited by 10
- 2025OpenECG: Benchmarking ECG Foundation Models with Public 1.2 Million Recordscited by 10
- 2025CLEF: Clinically-Guided Contrastive Learning for Electrocardiogram Foundation Modelscited by 7
- 2025Benchmarking ECG FMs: A Reality Check Across Clinical Taskscited by 6
12 most cited of 85 All 85 (JSON)
- 2026Robust Transfer Learning for Paper ECG Recognition30 Sep 2026
- 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Models28 Sep 2026
- 2026TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care28 Sep 2026
- 2026BeatGraph: Self-Supervised Heartbeat Graphs for Infant ECG Representations from the Home Environment25 Sep 2026
- 2026A Hybrid CNN--State-Space--Attention Backbone with Joint-Embedding Predictive Pretraining for 12-Lead ECG Classification24 Sep 2026
- 2026When Does Unsupervised Learning Succeed or Fail? A PoS Perspective on Reconstruction-Based Anomaly Detection23 Sep 2026
- 2026TRACE: Tractable Routing Autoencoder for Clinical ECG20 Sep 2026
- 2026Leveraging Cardiac Imaging to Improve ECG-Based Detection of Chagas Disease in Resource-Constrained Settings8 Sep 2026
- 2026Large language models in medical time series analysis7 Sep 2026
- 2026Beat-Synchronous Tokenization for ECG Transformers31 Aug 2026
- 2026Holtercare-Bench: A Multimodal Benchmark for Evaluating Long-Term Dynamic ECG Analysis19 Aug 2026
- 2026Attributing Preprocessing Invariance in Spectral Foundation Models14 Aug 2026
12 newest of 85 All 85 (JSON)