Capturing Cardiac Cyclicity through Phase-Equivariant Self-Supervised Learning
Not on the map. Why?
Abstract (arXiv)
The cyclic structure of physiological processes offers a natural prior for self-supervised representation learning, and the cardiac cycle provides a particularly well-defined setting in which to exploit it. We derive a phase-equivariant self-supervised objective and introduce Winder, a joint-embedding architecture that organises representations into phase-invariant coordinates and phase-rotating harmonic subspaces. Its transport operator is fixed and closed-form, derived from the cycle's geometry rather than learned, and adds no parameters. Evaluated on PTB-XL under a frozen linear-probe protocol, Winder attains diagnostic accuracy within the range reported by state-of-the-art self-supervised methods at a ~1 M parameter footprint, while exhibiting phase-equivariant latent geometry. These findings demonstrate that explicitly encoding cardiac-phase symmetry can preserve diagnostically useful information while yielding a latent geometry that is legible, parameter-efficient, and directly tied to a measurable physiological quantity.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 57 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
41 of 57 references.
References · 41
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2018Towards a Definition of Disentangled Representationscited by 294
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
- 2020Deep Learning for ECG Analysis: Benchmarks and Insights from PTB-XLcited by 158
- 2019Deep Scale-spaces: Equivariance Over Scalecited by 113
- 2024Unlocking State-Tracking in Linear RNNs Through Negative Eigenvaluescited by 97
- 2016Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflectionscited by 56
- 2022Unsupervised Learning of Group Invariant and Equivariant Representationscited by 38
- 2026When Does LeJEPA Learn a World Model?cited by 27
- 2022Equivariant Representation Learning via Class-Pose Decompositioncited by 17
- 2024Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecturecited by 17
29 more
- 2026Sub-JEPA: Subspace Gaussian Regularization for Stable End-to-End World Modelscited by 15
- 2024Self-Supervised Pre-Training with Joint-Embedding Predictive Architecture Boosts ECG Classification Performancecited by 14
- 2026VISReg: Variance-Invariance-Sketching Regularization for JEPA trainingcited by 14
- 2026Reverso: Efficient Time Series Foundation Models for Zero-shot Forecastingcited by 11
- 2026Subspace-Decomposed JEPAs: Disentangling Progression and Content in Latent World Modelscited by 11
- 2026Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representationscited by 8
- 2020Wavelet Networks: Scale-Translation Equivariant Learning From Raw Time-Seriescited by 5
- 2026SPHERE-JEPA: Spherical Prediction with Homogeneous Embeddingscited by 5
- 2025Rotary Masked Autoencoders are Versatile Learnerscited by 4
- 2026Towards a General Intelligence and Interface for Wearable Health Datacited by 4
- 2026Temporally Centered SIGReg Improves LeWorldModel Representations for Robot Policy Learningcited by 4
- 2025Learning with Category-Equivariant Architectures for Human Activity Recognitioncited by 3
- 2026Laya: A LeJEPA Approach to EEG via Latent Prediction over Reconstructioncited by 3
- 2026LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modelingcited by 3
- 2026LeNEPA: No-Augmentation Next-Latent Prediction for Time-Series Representation Learningcited by 3
- 2026CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representationcited by 3
- 2024The Rlign Algorithm for Enhanced Electrocardiogram Analysis through R-Peak Alignment for Explainable Classification and Clusteringcited by 2
- 2026Sonata: A Hybrid World Model for Inertial Kinematics under Clinical Data Scarcitycited by 2
- 2026ECG-WM: A Physiology-Informed ECG World Model for Clinical Intervention Simulationcited by 2
- 2026Foundation Models and Fine-Tuning: Toward a New Generation of Models for Time Series Forecastingcited by 2
- 2025Learning ECG Representations via Poly-Window Contrastive Learningcited by 1
- 2026Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAscited by 1
- 2026PHALAR: Phasors for Learned Musical Audio Representationscited by 1
- 2026HEPA: A Self-Supervised Horizon-Conditioned Event Predictive Architecture for Time Seriescited by 1
- 2026Olivia: Harmonizing Time Series Foundation Models with Power Spectral Densitycited by 1
- 2026Scale-Equivariant Generative Forecasting: Weight-Tied Dilated Convolutions, Wavelet Scattering Inputs, and Spectral-Consistency Training for Self-Similar Time Seriescited by 1
- 2026LVCG: Learning ECG Representations in the Latent Vectorcardiogram Spacecited by 1
- 2026Echo-POSED: Geometric Self-Distillation for Echocardiography Guidancecited by 1
- 2026Hierarchical Self-Supervised Representation Learning Framework for Multivariate Time Series Grounded in ECG Analysiscited by 1
Built on by
Not cited yet.