mlsanityData to 7 Oct 2026

ECG-FM: An Open Electrocardiogram Foundation Model

arXiv 2408.05178 ↗First posted 9 Aug 2024cs.LGcited by 89

Not on the map. Why?

Abstract (arXiv)

Conventional task-specific electrocardiogram (ECG) analysis models require large annotated datasets to train. Foundation models mitigate this burden by leveraging self-supervised pretraining; however, the scarcity of open-weight ECG foundation models hinders adoption and cross-study comparability. We present ECG-FM, an open foundation model for ECG analysis, and conduct a study using a dataset of 1.5 million ECGs. ECG-FM is a transformer-based model pretrained using a hybrid contrastive and generative self-supervised learning approach. Our downstream tasks include predicting reduced left ventricular ejection fraction (LVEF) and ECG interpretation labels, where we release a benchmark task on the MIMIC-IV-ECG dataset. We affirm that ECG-FM is robust, label-efficient, and functionally discriminative by showcasing data scaling experiments, performing a latent space analysis, and generating saliency maps. ECG-FM markedly outperforms task-specific models in the small-to-medium-scale data regime and demonstrates cross-dataset generalizability, achieving high AUROC on many clinically salient labels such as atrial fibrillation (0.996) and LVEF<=40% (0.929). We release our code, model weights, and benchmark task at https://github.com/bowang-lab/ECG-FM/.

Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). Builds on 11 of its 34 references that are in the map. First posted on arXiv 9 Aug 2024.

Builds on

11 of 34 references.

References · 11

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  2. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
  3. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
  4. 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 170
  5. 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
  6. 2023Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encodingcited by 71
  7. 2022Lead-agnostic Self-supervised Learning for Local and Global Representations of Electrocardiogramcited by 38
  8. 2023Improving Pixel-based MIM by Reducing Wasted Modeling Capabilitycited by 24
  9. 2023Towards Enhancing Time Series Contrastive Learning: A Dynamic Bad Pair Mining Approachcited by 13
  10. 2023ECGBERT: Understanding Hidden Language of ECGs with Self-Supervised Representation Learningcited by 10
  11. 2024CREMA: A Contrastive Regularized Masked Autoencoder for Robust ECG Diagnostics across Clinical Domainscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 28; 2026: 53.

89 papers.

Sort:

By area:

  1. 2024PaPaGei: Open Foundation Models for Optical Physiological Signalscited by 64
  2. 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Imagescited by 35
  3. 2024An Electrocardiogram Foundation Model Built on over 10 Million Recordings with External Evaluation across Multiple Domainscited by 27
  4. 2024Zero-shot forecasting of chaotic systemscited by 25
  5. 2024Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecturecited by 17
  6. 2024Boosting Masked ECG-Text Auto-Encoders as Discriminative Learnerscited by 16
  7. 2025From Token to Rhythm: A Multi-Scale Approach for ECG-Language Pretrainingcited by 15
  8. 2025Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learningcited by 14
  9. 2024Beyond LoRA: Exploring Efficient Fine-Tuning Techniques for Time Series Foundational Modelscited by 10
  10. 2025OpenECG: Benchmarking ECG Foundation Models with Public 1.2 Million Recordscited by 10
  11. 2025CLEF: Clinically-Guided Contrastive Learning for Electrocardiogram Foundation Modelscited by 7
  12. 2025Benchmarking ECG FMs: A Reality Check Across Clinical Taskscited by 6
38 more
  1. 2024AnyECG: Foundational Models for Multitask Cardiac Analysis in Real-World Settingscited by 5
  2. 2025Knowledge-enhanced Multimodal ECG Representation Learning with Arbitrary-Lead Inputscited by 5
  3. 2025EchoingECG: An Electrocardiogram Cross-Modal Model for Echocardiogram Taskscited by 4
  4. 2025TolerantECG: A Foundation Model for Imperfect Electrocardiogramcited by 3
  5. 2026Learning Transferable Sensor Models via Language-Informed Pretrainingcited by 3
  6. 2026Physiology-Aware Masked Cross-Modal Reconstruction for Biosignal Representation Learningcited by 3
  7. 2026CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representationcited by 3
  8. 2025Sensing Cardiac Health Across Scenarios and Devices: A Multi-Modal Foundation Model Pretrained on Heterogeneous Data from 1.7 Million Individualscited by 2
  9. 2025QualityFM: a Multimodal Physiological Signal Foundation Model with Self-Distillation for Signal Quality Challenges in Critically Ill Patientscited by 2
  10. 2025ProbMed: A Probabilistic Framework for Medical Multimodal Bindingcited by 2
  11. 2025CODE-II: A large-scale dataset for artificial intelligence in ECG analysiscited by 2
  12. 2025An Electrocardiogram Multi-task Benchmark with Comprehensive Evaluations and Insightful Findingscited by 2
  13. 2026CARE-ECG: Causal Agent-based Reasoning for Explainable and Counterfactual ECG Interpretationcited by 2
  14. 2026ECG-WM: A Physiology-Informed ECG World Model for Clinical Intervention Simulationcited by 2
  15. 2024Generative AI in Medicinecited by 1
  16. 2025Fusion of ECG Foundation Model Embeddings to Improve Early Detection of Acute Coronary Syndromescited by 1
  17. 2025ExChanGeAI: An End-to-End Platform and Efficient Foundation Model for Electrocardiogram Analysis and Fine-tuningcited by 1
  18. 2025ICYM2I: The illusion of multimodal informativeness under missingnesscited by 1
  19. 2025Domain Knowledge is Power: Leveraging Physiological Priors for Self Supervised Representation Learning in Electrocardiographycited by 1
  20. 2025FoundationalECGNet: A Lightweight Foundational Model for ECG-based Multitask Cardiac Analysiscited by 1
  21. 2025BioX-Bridge: Model Bridging for Unsupervised Cross-Modal Knowledge Transfer across Biosignalscited by 1
  22. 2025ECG-RAMBA: Zero-Shot ECG Generalization by Morphology-Rhythm Disentanglement and Long-Range Modelingcited by 1
  23. 2026AnyECG: Evolved ECG Foundation Model for Holistic Health Profilingcited by 1
  24. 2026ECG-MoE: Mixture-of-Expert Electrocardiogram Foundation Modelcited by 1
  25. 2026A foundation model for electrodermal activity datacited by 1
  26. 2026Pretraining on Sleep Data Improves non-Sleep Biosignal Taskscited by 1
  27. 2026Biosignal Fingerprinting: A Cross-Modal PPG-ECG Foundation Modelcited by 1
  28. 2026Hierarchical Self-Supervised Representation Learning Framework for Multivariate Time Series Grounded in ECG Analysiscited by 1
  29. 2025Multimodal Latent Fusion of ECG Leads for Early Assessment of Pulmonary Hypertensioncited by 0
  30. 2025Bridging Performance Gaps for ECG Foundation Models: A Post-Training Strategycited by 0
  31. 2025Introducing Multimodal Paradigm for Learning Sleep Staging PSG via General-Purpose Modelcited by 0
  32. 2025Generalist vs Specialist Time Series Foundation Models: Investigating Potential Emergent Behaviors in Assessing Human Health Using PPG Signalscited by 0
  33. 2025EnECG: Efficient Ensemble Learning for Electrocardiogram Multi-task Foundation Modelcited by 0
  34. 2025A Dataset and Benchmarks for Atrial Fibrillation Detection from Electrocardiograms of Intensive Care Unit Patientscited by 0
  35. 2025Modeling Day-Long ECG Signals to Predict Heart Failure Risk with Explainable AIcited by 0
  36. 2026BEAT-Net: Injecting Biomimetic Spatio-Temporal Priors for Interpretable ECG Diagnosiscited by 0
  37. 2026Beat-ssl: Capturing Local ECG Morphology through Heartbeat-level Contrastive Learning with Soft Targetscited by 0
  38. 2026Looking Beyond Accuracy: A Holistic Benchmark of ECG Foundation Modelscited by 0

50 most cited of 89 All 89 (JSON)