Do ECG Foundation Models Transfer to Rare Cardiac Diseases? Evidence from Brugada Syndrome Detection
Not on the map. Why?
Abstract (arXiv)
Background: Foundation models (FMs) trained on large-scale unlabeled physiological data have emerged as a promising paradigm for medical artificial intelligence. Their ability to capture clinically meaningful, transferable representations for rare diseases remains largely unproven. This study investigates whether FM pre-training provides genuine clinical generalization benefits beyond improved optimization for rare electrocardiographic (ECG) phenotypes. Methods: We systematically evaluated nine publicly available ECG FMs for Brugada syndrome detection on the BrSwiss cohort (294 patients, 87 cases) and the independent external HUCA cohort (363 patients, 76 cases), under three strategies (from-scratch training, linear probing, full fine-tuning) across several configurations, including a 3% data ablation and zero-shot cross-site transfers. Results: Pre-training was necessary for high-capacity architectures unable to converge from scratch (AUC gain up to 0.411, p < 0.05), but gave no significant gain for compact architectures already converged on labeled data alone. On full BrSwiss, the best fine-tuned FM (ECG-CPC, AUC = 0.962) only marginally exceeded the strongest supervised baseline (ECG-CPC from scratch, AUC = 0.932; p = 0.091). At matched training-set size, the data-efficiency advantage on BrSwiss-3% (AUC gain = 0.055, p < 0.01) did not replicate on HUCA. Under zero-shot cross-site transfer, FM-based pipelines did not generalize better than supervised baselines, all approaching chance-level performance. Conclusion: For Brugada syndrome detection, FM pre-training is mechanical rather than semantic, providing optimization stability rather than transferable clinical knowledge. These findings challenge the assumption that large-scale pre-training inherently encodes clinically meaningful representations, highlighting the central role of model architecture and data-domain alignment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
30 of 49 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
18 more
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2020Designing Network Design Spacescited by 954
- 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
- 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 170
- 2020Deep Learning for ECG Analysis: Benchmarks and Insights from PTB-XLcited by 158
- 2024ECG-FM: An Open Electrocardiogram Foundation Modelcited by 89
- 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
- 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 66
- 2020HOLMES: Health OnLine Model Ensemble Serving for Deep Learning Models in Intensive Care Unitscited by 45
- 2022Dist-PU: Positive-Unlabeled Learning from a Label Distribution Perspectivecited by 37
- 2024An Electrocardiogram Foundation Model Built on over 10 Million Recordings with External Evaluation across Multiple Domainscited by 27
- 2022Inflation of test accuracy due to data leakage in deep learning-based classification of OCT imagescited by 17
- 2024Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecturecited by 17
- 2025OpenECG: Benchmarking ECG Foundation Models with Public 1.2 Million Recordscited by 10
- 2025BenchECG and xECG: a benchmark and baseline for ECG foundation modelscited by 8
- 2025Benchmarking ECG FMs: A Reality Check Across Clinical Taskscited by 6
- 2025An Electrocardiogram Multi-task Benchmark with Comprehensive Evaluations and Insightful Findingscited by 2
Built on by
Not cited yet.