mlsanityData to 14 Oct 2026

Towards quantitative precision for ECG analysis: Leveraging state space models, self-supervision and patient metadata

arXiv 2308.15291 ↗First posted 29 Aug 2023eess.SP cs.LG stat.MLcited by 15

Not on the map. Why?

Abstract (arXiv)

Deep learning has emerged as the preferred modeling approach for automatic ECG analysis. In this study, we investigate three elements aimed at improving the quantitative accuracy of such systems. These components consistently enhance performance beyond the existing state-of-the-art, which is predominantly based on convolutional models. Firstly, we explore more expressive architectures by exploiting structured state space models (SSMs). These models have shown promise in capturing long-term dependencies in time series data. By incorporating SSMs into our approach, we not only achieve better performance, but also gain insights into long-standing questions in the field. Specifically, for standard diagnostic tasks, we find no advantage in using higher sampling rates such as 500Hz compared to 100Hz. Similarly, extending the input size of the model beyond 3 seconds does not lead to significant improvements. Secondly, we demonstrate that self-supervised learning using contrastive predictive coding can further improve the performance of SSMs. By leveraging self-supervision, we enable the model to learn more robust and representative features, leading to improved analysis accuracy. Lastly, we depart from synthetic benchmarking scenarios and incorporate basic demographic metadata alongside the ECG signal as input. This inclusion of patient metadata departs from the conventional practice of relying solely on the signal itself. Remarkably, this addition consistently yields positive effects on predictive performance. We firmly believe that all three components should be considered when developing next-generation ECG analysis algorithms.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 22 of its 44 references that are in the map. First posted on arXiv 29 Aug 2023.

Builds on

22 of 44 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  5. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  6. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  7. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
  8. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
  9. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
  10. 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
  11. 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 171
  12. 2019Automatic diagnosis of the 12-lead ECG using a deep neural networkcited by 164
10 more
  1. 2020Deep Learning for ECG Analysis: Benchmarks and Insights from PTB-XLcited by 158
  2. 2020Self-supervised ECG Representation Learning for Emotion Recognitioncited by 99
  3. 2021The Efficiency Misnomercited by 98
  4. 2021Self-supervised representation learning from 12-lead ECG datacited by 80
  5. 2020Subject-Aware Contrastive Learning for Biosignalscited by 76
  6. 20213KG: Contrastive Learning of 12-Lead Electrocardiograms using Physiologically-Inspired Augmentationscited by 36
  7. 2021Intra-Inter Subject Self-supervised Learning for Multivariate Cardiac Signalscited by 35
  8. 2022From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathologycited by 9
  9. 2022Advancing the State-of-the-Art for ECG Analysis through Structured State Space Modelscited by 9
  10. 2022A Dual-scale Lead-seperated Transformer With Lead-orthogonal Attention And Meta-information For Ecg Classificationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 5; 2024: 3; 2025: 5; 2026: 2.

15 papers.

Sort:

  1. 2023FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Corescited by 33
  2. 2024Enhancing clinical decision support with physiological waveforms -- a multimodal benchmark in emergency carecited by 15
  3. 2024Self-Supervised Pre-Training with Joint-Embedding Predictive Architecture Boosts ECG Classification Performancecited by 14
  4. 2025Generalizable deep learning for photoplethysmography-based blood pressure estimation -- A Benchmarking Studycited by 9
  5. 2023Scaling Representation Learning from Ubiquitous ECG with State-Space Modelscited by 7
  6. 2023S4Sleep: Elucidating the design space of deep-learning-based sleep stage classification modelscited by 7
  7. 2023Using explainable AI to investigate electrocardiogram changes during healthy aging -- from expert features to raw signalscited by 7
  8. 2025Benchmarking ECG FMs: A Reality Check Across Clinical Taskscited by 7
  9. 2024Abnormality Prediction and Forecasting of Laboratory Values from Electrocardiogram Signals Using Multimodal Deep Learningcited by 5
  10. 2023Prospects for AI-Enhanced ECG as a Unified Screening Tool for Cardiac and Non-Cardiac Conditions -- An Explorative Study in Emergency Carecited by 1
  11. 2025ExChanGeAI: An End-to-End Platform and Efficient Foundation Model for Electrocardiogram Analysis and Fine-tuningcited by 1
  12. 2025Data reuse enables cost-efficient randomized trials of medical AI modelscited by 1
3 more
  1. 2026A Multimodal Deep Learning Framework for Predicting ICU Deterioration: Integrating ECG Waveforms with Clinical Data and Clinician Benchmarkingcited by 1
  2. 2025Multi-Window Temporal Analysis for Enhanced Arrhythmia Classification: Leveraging Long-Range Dependencies in Electrocardiogram Signalscited by 0
  3. 2026Modality vs. Morphology: A Framework for Time Series Classification for Biological Signalscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Pretraining Strategies and Scaling for ECG Foundation Models: A Systematic Study
  2. 2026SL-S4Wave: Self-Supervised Learning of Physiological Waveforms with Structured State Space Models
  3. 2026The Impact of Temporal Context Length and Encoding Strategies on Self-Supervised ECG Representation Learning
  4. 2023Diffusion-based Conditional ECG Generation with Structured State Space Models
  5. 2024SSSD-ECG-nle: New Label Embeddings with Structured State-Space Models for ECG generation
  6. 2026ECG Foundation Models and Medical LLMs for Agentic Cardiovascular Intelligence at the Edge: A Review and Outlook
  7. 2026ECG-InterpBench: Benchmarking the Interpretability of ECG Foundation Models with Matched-Scale Sparse Autoencoders
  8. 2025ECG-aBcDe: Overcoming Model Dependence, Encoding ECG into a Universal Language for Any LLM