mlsanityData to 7 Oct 2026

Capturing Cardiac Cyclicity through Phase-Equivariant Self-Supervised Learning

arXiv 2608.21147 ↗First posted 21 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The cyclic structure of physiological processes offers a natural prior for self-supervised representation learning, and the cardiac cycle provides a particularly well-defined setting in which to exploit it. We derive a phase-equivariant self-supervised objective and introduce Winder, a joint-embedding architecture that organises representations into phase-invariant coordinates and phase-rotating harmonic subspaces. Its transport operator is fixed and closed-form, derived from the cycle's geometry rather than learned, and adds no parameters. Evaluated on PTB-XL under a frozen linear-probe protocol, Winder attains diagnostic accuracy within the range reported by state-of-the-art self-supervised methods at a ~1 M parameter footprint, while exhibiting phase-equivariant latent geometry. These findings demonstrate that explicitly encoding cardiac-phase symmetry can preserve diagnostically useful information while yielding a latent geometry that is legible, parameter-efficient, and directly tied to a measurable physiological quantity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 57 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

41 of 57 references.

References · 41

  1. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  2. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  3. 2018Towards a Definition of Disentangled Representationscited by 294
  4. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
  5. 2020Deep Learning for ECG Analysis: Benchmarks and Insights from PTB-XLcited by 158
  6. 2019Deep Scale-spaces: Equivariance Over Scalecited by 113
  7. 2024Unlocking State-Tracking in Linear RNNs Through Negative Eigenvaluescited by 97
  8. 2016Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflectionscited by 56
  9. 2022Unsupervised Learning of Group Invariant and Equivariant Representationscited by 38
  10. 2026When Does LeJEPA Learn a World Model?cited by 27
  11. 2022Equivariant Representation Learning via Class-Pose Decompositioncited by 17
  12. 2024Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecturecited by 17
29 more
  1. 2026Sub-JEPA: Subspace Gaussian Regularization for Stable End-to-End World Modelscited by 15
  2. 2024Self-Supervised Pre-Training with Joint-Embedding Predictive Architecture Boosts ECG Classification Performancecited by 14
  3. 2026VISReg: Variance-Invariance-Sketching Regularization for JEPA trainingcited by 14
  4. 2026Reverso: Efficient Time Series Foundation Models for Zero-shot Forecastingcited by 11
  5. 2026Subspace-Decomposed JEPAs: Disentangling Progression and Content in Latent World Modelscited by 11
  6. 2026Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representationscited by 8
  7. 2020Wavelet Networks: Scale-Translation Equivariant Learning From Raw Time-Seriescited by 5
  8. 2026SPHERE-JEPA: Spherical Prediction with Homogeneous Embeddingscited by 5
  9. 2025Rotary Masked Autoencoders are Versatile Learnerscited by 4
  10. 2026Towards a General Intelligence and Interface for Wearable Health Datacited by 4
  11. 2026Temporally Centered SIGReg Improves LeWorldModel Representations for Robot Policy Learningcited by 4
  12. 2025Learning with Category-Equivariant Architectures for Human Activity Recognitioncited by 3
  13. 2026Laya: A LeJEPA Approach to EEG via Latent Prediction over Reconstructioncited by 3
  14. 2026LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modelingcited by 3
  15. 2026LeNEPA: No-Augmentation Next-Latent Prediction for Time-Series Representation Learningcited by 3
  16. 2026CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representationcited by 3
  17. 2024The Rlign Algorithm for Enhanced Electrocardiogram Analysis through R-Peak Alignment for Explainable Classification and Clusteringcited by 2
  18. 2026Sonata: A Hybrid World Model for Inertial Kinematics under Clinical Data Scarcitycited by 2
  19. 2026ECG-WM: A Physiology-Informed ECG World Model for Clinical Intervention Simulationcited by 2
  20. 2026Foundation Models and Fine-Tuning: Toward a New Generation of Models for Time Series Forecastingcited by 2
  21. 2025Learning ECG Representations via Poly-Window Contrastive Learningcited by 1
  22. 2026Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAscited by 1
  23. 2026PHALAR: Phasors for Learned Musical Audio Representationscited by 1
  24. 2026HEPA: A Self-Supervised Horizon-Conditioned Event Predictive Architecture for Time Seriescited by 1
  25. 2026Olivia: Harmonizing Time Series Foundation Models with Power Spectral Densitycited by 1
  26. 2026Scale-Equivariant Generative Forecasting: Weight-Tied Dilated Convolutions, Wavelet Scattering Inputs, and Spectral-Consistency Training for Self-Similar Time Seriescited by 1
  27. 2026LVCG: Learning ECG Representations in the Latent Vectorcardiogram Spacecited by 1
  28. 2026Echo-POSED: Geometric Self-Distillation for Echocardiography Guidancecited by 1
  29. 2026Hierarchical Self-Supervised Representation Learning Framework for Multivariate Time Series Grounded in ECG Analysiscited by 1

Built on by

Not cited yet.