Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learning
Not on the map. Why?
Abstract (arXiv)
Electrocardiogram (ECG) signal is one of the most effective sources of information mainly employed for the diagnosis and prediction of cardiovascular diseases (CVDs) connected with the abnormalities in heart rhythm. Clearly, single modality ECG (i.e. time series) cannot convey its complete characteristics, thus, exploiting both time and time-frequency modalities in the form of time-series data and spectrogram is needed. Leveraging the cutting-edge self-supervised learning (SSL) technique on unlabeled data, we propose SSL-based multimodality ECG classification. Our proposed network follows SSL learning paradigm and consists of two modules corresponding to pre-stream task, and down-stream task, respectively. In the SSL-pre-stream task, we utilize self-knowledge distillation (KD) techniques with no labeled data, on various transformations and in both time and frequency domains. In the down-stream task, which is trained on labeled data, we propose a gate fusion mechanism to fuse information from multimodality.To evaluate the effectiveness of our approach, ten-fold cross validation on the 12-lead PhysioNet 2020 dataset has been conducted.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 18 of its 38 references that are in the map. First posted on arXiv 30 Sep 2022.
Builds on
18 of 38 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2016Colorful Image Colorizationcited by 1,113
- 2015Unsupervised Learning of Video Representations using LSTMscited by 434
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 430
- 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 170
- 2019Automatic diagnosis of the 12-lead ECG using a deep neural networkcited by 164
- 2016Learning Features by Watching Objects Movecited by 138
- 2021Self-supervised representation learning from 12-lead ECG datacited by 80
- 2017Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networkscited by 52
6 more
- 2021Deep Reinforcement Learning in Computer Vision: A Comprehensive Surveycited by 42
- 2021Intra-Inter Subject Self-supervised Learning for Multivariate Cardiac Signalscited by 35
- 2018Cross and Learn: Cross-Modal Self-Supervisioncited by 34
- 2021Deep reinforcement learning in medical imaging: A literature reviewcited by 34
- 2022SS-3DCapsNet: Self-supervised 3D Capsule Networks for Medical Segmentation on Less Labeled Datacited by 10
- 2021Self-Supervised Learning via multi-Transformation Classification for Action Recognitioncited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 2.
3 papers.