ECG-Soup: Harnessing Multi-Layer Synergy for ECG Foundation Models
Not on the map. Why?
Abstract (arXiv)
Transformer-based foundation models for Electrocardiograms (ECGs) have recently achieved impressive performance in many downstream applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 59 references that are in the map. First posted on arXiv 27 Aug 2025.
Builds on
35 of 59 references.
References · 35
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 675
- 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
- 2019Representation Degeneration Problem in Training Natural Language Generation Modelscited by 255
- 2024A Survey on Mixture of Experts in Large Language Modelscited by 237
- 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 171
- 2019Automatic diagnosis of the 12-lead ECG using a deep neural networkcited by 164
- 2020Deep Learning for ECG Analysis: Benchmarks and Insights from PTB-XLcited by 158
- 2022Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practicecited by 136
23 more
- 2020Self-supervised ECG Representation Learning for Emotion Recognitioncited by 99
- 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
- 2021Self-supervised representation learning from 12-lead ECG datacited by 80
- 2023Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggerscited by 72
- 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 67
- 2023Frozen Language Model Helps ECG Zero-Shot Learningcited by 62
- 2022Visual Query Tuning: Towards Effective Usage of Intermediate Representations for Parameter and Memory Efficient Transfer Learningcited by 57
- 2022Towards Understanding Mixture of Experts in Deep Learningcited by 52
- 2022Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformercited by 47
- 2021Vision Transformers with Patch Diversificationcited by 45
- 20213KG: Contrastive Learning of 12-Lead Electrocardiograms using Physiologically-Inspired Augmentationscited by 36
- 2023Mitigating Over-smoothing in Transformers via Regularized Nonlocal Functionalscited by 32
- 2023Analyzing Vision Transformers for Image Classification in Class Embedding Spacecited by 26
- 2022Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolutioncited by 22
- 2024Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecturecited by 19
- 2024Self-Supervised Pre-Training with Joint-Embedding Predictive Architecture Boosts ECG Classification Performancecited by 14
- 2021Real-Time Patient-Specific ECG Classification by 1D Self-Operational Neural Networkscited by 13
- 2023Towards Enhancing Time Series Contrastive Learning: A Dynamic Bad Pair Mining Approachcited by 13
- 2022Analysis of Augmentations for Contrastive ECG Representation Learningcited by 12
- 2022Global ECG Classification by Self-Operational Neural Networks with Feature Injectioncited by 9
- 2023Masked Transformer for Electrocardiogram Classificationcited by 7
- 2024A Multi-Resolution Mutual Learning Network for Multi-Label ECG Classificationcited by 4
- 2024Hierarchical Transformer for Electrocardiogram Diagnosiscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.