mlsanityData to 14 Oct 2026

ETP: Learning Transferable ECG Representations via ECG-Text Pre-training

arXiv 2309.07145 ↗First posted 6 Sep 2023eess.SP cs.AI cs.LGcited by 29

Not on the map. Why?

Abstract (arXiv)

In the domain of cardiovascular healthcare, the Electrocardiogram (ECG) serves as a critical, non-invasive diagnostic tool. Although recent strides in self-supervised learning (SSL) have been promising for ECG representation learning, these techniques often require annotated samples and struggle with classes not present in the fine-tuning stages. To address these limitations, we introduce ECG-Text Pre-training (ETP), an innovative framework designed to learn cross-modal representations that link ECG signals with textual reports. For the first time, this framework leverages the zero-shot classification task in the ECG domain. ETP employs an ECG encoder along with a pre-trained language model to align ECG signals with their corresponding textual reports. The proposed framework excels in both linear evaluation and zero-shot classification tasks, as demonstrated on the PTB-XL and CPSC2018 datasets, showcasing its ability for robust and generalizable cross-modal ECG feature learning.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 6 Sep 2023.

Builds on

19 of 24 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  7. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  8. 2020A Survey on Contrastive Self-supervised Learningcited by 554
  9. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
  10. 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 171
  11. 2021Self-supervised representation learning from 12-lead ECG datacited by 80
  12. 2023Frozen Language Model Helps ECG Zero-Shot Learningcited by 62
7 more
  1. 2023Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Biascited by 57
  2. 2023Generative Text-Guided 3D Vision-Language Pretraining for Unified Medical Image Segmentationcited by 47
  3. 2023M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimizationcited by 43
  4. 2023Learning Multiscale Consistency for Self-supervised Electron Microscopy Instance Segmentationcited by 16
  5. 2022A Personalized Zero-Shot ECG Arrhythmia Monitoring System: From Sparse Representation Based Domain Adaption to Energy Efficient Abnormal Beat Detection for Practical ECG Surveillancecited by 6
  6. 2023Spectral Cross-Domain Neural Network with Soft-adaptive Threshold Spectral Enhancementcited by 4
  7. 2022LETS-GZSL: A Latent Embedding Model for Time Series Generalized Zero Shot Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 11; 2025: 9; 2026: 6.

29 papers.

Sort:

By area:

  1. 2024Large Language Models for Time Series: A Surveycited by 114
  2. 2024LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inferencecited by 95
  3. 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
  4. 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 67
  5. 2023CLIP in Medical Imaging: A Surveycited by 40
  6. 2024SensorLLM: Aligning Large Language Models with Motion Sensors for Human Activity Recognitioncited by 38
  7. 2024D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Modelscited by 31
  8. 2024MEIT: Multimodal Electrocardiogram Instruction Tuning on Large Language Models for Report Generationcited by 29
  9. 2023IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-trainingcited by 23
  10. 2024Boosting Masked ECG-Text Auto-Encoders as Discriminative Learnerscited by 17
  11. 2023Utilizing Synthetic Data for Medical Vision-Language Pre-training: Bypassing the Need for Real Imagescited by 16
  12. 2025Out-of-Distribution Generalization in Time Series: A Surveycited by 16
17 more
  1. 2024Large Language Model-informed ECG Dual Attention Network for Heart Failure Risk Predictioncited by 8
  2. 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicinecited by 5
  3. 2025Knowledge-enhanced Multimodal ECG Representation Learning with Arbitrary-Lead Inputscited by 5
  4. 2024Enhancing Traffic Prediction with Textual Data Using Large Language Modelscited by 2
  5. 2025xLSTM-ECG: Multi-label ECG Classification via Feature Fusion with xLSTMcited by 2
  6. 2025FOCAL: Fine-Grained Optimal-Transport-Driven Contrastive Alignment of Language and ECGs with Waveform Enhancementcited by 2
  7. 2024Benchmarking Vision-Language Contrastive Methods for Medical Representation Learningcited by 1
  8. 2025A Shared Encoder Approach to Multimodal Representation Learningcited by 1
  9. 2025Enhancing Contrastive Learning-based Electrocardiogram Pretrained Model with Patient Memory Queuecited by 1
  10. 2025Application of Contrastive Learning on ECG Data: Evaluating Performance in Japanese and Classification with Around 100 Labelscited by 0
  11. 2025SpeechCT-CLIP: Distilling Text-Image Knowledge to Speech for Voice-Native Multimodal CT Analysiscited by 0
  12. 2026Position: Evaluation of ECG Representations Must Be Fixedcited by 0
  13. 2026CG-DMER: Hybrid Contrastive-Generative Framework for Disentangled Multimodal ECG Representation Learningcited by 0
  14. 2026Distribution-Aware Diffusion-LLM for Robust Ultra-Long-Term Time Series Forecastingcited by 0
  15. 2026EchoBridge: Long-Tail-Aware ECG-Echocardiography Text Alignment for Echocardiography-Derived Cardiac Findingscited by 0
  16. 2026Large language models in medical time series analysiscited by 0
  17. 2026HiPPT: Physiology-Grounded Wearable PPG Representation Learning via Multi-Scope Text Alignmentcited by 0