CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patients
Not on the map. Why?
Abstract (arXiv)
The healthcare industry generates troves of unlabelled physiological data. This data can be exploited via contrastive learning, a self-supervised pre-training method that encourages representations of instances to be similar to one another. We propose a family of contrastive learning methods, CLOCS, that encourages representations across space, time, textitand patients to be similar to one another. We show that CLOCS consistently outperforms the state-of-the-art methods, BYOL and SimCLR, when performing a linear evaluation of, and fine-tuning on, downstream tasks. We also show that CLOCS achieves strong generalization performance with only 25% of labelled training data. Furthermore, our training procedure naturally generates patient-specific representations that can be used to quantify patient-similarity.
Key facts. Cited by 170 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 11; 2023: 31; 2024: 40; 2025: 32; 2026: 43.
170 papers.
Sort:
By area:
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
- 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 113
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 97
- 2023Large-scale Training of Foundation Models for Wearable Biosignalscited by 89
- 2024ECG-FM: An Open Electrocardiogram Foundation Modelcited by 89
- 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
- 2021Self-supervised representation learning from 12-lead ECG datacited by 80
- 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 66
- 2024PaPaGei: Open Foundation Models for Optical Physiological Signalscited by 64
- 2023Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-Seriescited by 59
- 2024Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series Classificationcited by 53
- 2021MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretationcited by 52
38 more
- 2023ECG-QA: A Comprehensive Question Answering Dataset Combined With Electrocardiogramcited by 52
- 2023Soft Contrastive Learning for Time Seriescited by 49
- 2021Generating Synthetic Mixed-type Longitudinal Electronic Health Records for Artificial Intelligent Applicationscited by 47
- 2023TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoderscited by 42
- 2022Lead-agnostic Self-supervised Learning for Local and Global Representations of Electrocardiogramcited by 38
- 2024SleepFM: Multi-modal Representation Learning for Sleep Across Brain Activity, ECG and Respiratory Signalscited by 38
- 20213KG: Contrastive Learning of 12-Lead Electrocardiograms using Physiologically-Inspired Augmentationscited by 36
- 2022Contrastive Learning for Unsupervised Domain Adaptation of Time Seriescited by 36
- 2025Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Modelcited by 36
- 2021Intra-Inter Subject Self-supervised Learning for Multivariate Cardiac Signalscited by 35
- 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Imagescited by 35
- 2021Neighborhood Contrastive Learning Applied to Online Patient Monitoringcited by 32
- 2023ETP: Learning Transferable ECG Representations via ECG-Text Pre-trainingcited by 28
- 2022Beyond Just Vision: A Review on Self-Supervised Representation Learning on Multimodal and Temporal Datacited by 27
- 2024An Electrocardiogram Foundation Model Built on over 10 Million Recordings with External Evaluation across Multiple Domainscited by 27
- 2024ECG Semantic Integrator (ESI): A Foundation ECG Model Pretrained with LLM-Enhanced Cardiological Textcited by 25
- 2021Patient Contrastive Learning: a Performant, Expressive, and Practical Approach to ECG Modelingcited by 24
- 2025CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Modelcited by 23
- 2023Frequency-Aware Masked Autoencoders for Multimodal Pretraining on Biosignalscited by 22
- 2022COCOA: Cross Modality Contrastive Learning for Sensor Datacited by 21
- 2023T-Rep: Representation Learning for Time Series using Time-Embeddingscited by 19
- 2023REBAR: Retrieval-Based Reconstruction for Time-series Contrastive Learningcited by 19
- 2023Finding Order in Chaos: A Novel Data Augmentation Method for Time Series in Contrastive Learningcited by 18
- 2024Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecturecited by 17
- 2024RelCon: Relative Contrastive Learning for a Motion Foundation Model for Wearable Datacited by 17
- 2023Sequential Multi-Dimensional Self-Supervised Learning for Clinical Time Seriescited by 16
- 2024Boosting Masked ECG-Text Auto-Encoders as Discriminative Learnerscited by 16
- 2023Towards quantitative precision for ECG analysis: Leveraging state space models, self-supervision and patient metadatacited by 15
- 2024Wearable Accelerometer Foundation Models for Health via Knowledge Distillationcited by 15
- 2025From Token to Rhythm: A Multi-Scale Approach for ECG-Language Pretrainingcited by 15
- 2023Unlocking the diagnostic potential of electrocardiograms through information transfer from cardiac magnetic resonance imagingcited by 14
- 2024Self-Supervised Pre-Training with Joint-Embedding Predictive Architecture Boosts ECG Classification Performancecited by 14
- 2023Event-Based Contrastive Learning for Medical Time Seriescited by 13
- 2021Imbalance-Aware Self-Supervised Learning for 3D Radiomic Representationscited by 12
- 2021Contrastive Learning of Single-Cell Phenotypic Representations for Treatment Classificationcited by 12
- 2022Data Augmentation for Electrocardiogramscited by 12
- 2022Analysis of Augmentations for Contrastive ECG Representation Learningcited by 12
- 2021Contrastive Neural Processes for Self-Supervised Learningcited by 9
50 most cited of 170 All 170 (JSON)
- 2026Geometry-Conditioned Fixed-Scaffold Encoders for Time-Warp Robust Sequence Retrieval29 Sep 2026
- 2026DrafTS: Time-Aware Decomposition with Residual Correction for Time Series Modeling27 Sep 2026
- 2026BeatGraph: Self-Supervised Heartbeat Graphs for Infant ECG Representations from the Home Environment25 Sep 2026
- 2026A Hybrid CNN--State-Space--Attention Backbone with Joint-Embedding Predictive Pretraining for 12-Lead ECG Classification24 Sep 2026
- 2026TRACE: Tractable Routing Autoencoder for Clinical ECG20 Sep 2026
- 2026Beat-Synchronous Tokenization for ECG Transformers31 Aug 2026
- 2026Graph-Based Pseudo-multimodal Contrastive Learning for 12-Lead ECG Representations27 Aug 2026
- 2026CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representation13 Aug 2026
- 2026The Impact of Temporal Context Length and Encoding Strategies on Self-Supervised ECG Representation Learning13 Aug 2026
- 2026Take it Personally: The Limits of General SSL Representations for Real-Life PPG Emotion Detection3 Aug 2026
- 2026ECG-InterpBench: Benchmarking the Interpretability of ECG Foundation Models with Matched-Scale Sparse Autoencoders29 Jul 2026
- 2026CADENCE: A Cardiac Atom Dictionary for Interpretable Neural Concept Extraction from ECG Foundation Models28 Jul 2026
38 more
- 2026Failures Reveal What Metrics Miss: An Evidence-Driven Agent for Recursive Refinement of ECG Classifiers27 Jul 2026
- 2026Do ECG Foundation Models Transfer to Rare Cardiac Diseases? Evidence from Brugada Syndrome Detection3 Jul 2026
- 2026Patient-Aware Contrastive Learning Preserves Per-Patient Structure in RR-Interval Representations22 Jun 2026
- 2026SL-S4Wave: Self-Supervised Learning of Physiological Waveforms with Structured State Space Models18 Jun 2026
- 2026Next-Token Prediction Learns Generalisable Representations of Sleep Physiology8 Jun 2026
- 2026LVCG: Learning ECG Representations in the Latent Vectorcardiogram Space29 May 2026
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoring29 May 2026
- 2026Information-theoretic Multimodal Representation Learning for Electrocardiogram Signals26 May 2026
- 2026Divide and Contrast: Learning Robust Temporal Features without Augmentation20 May 2026
- 2026PACD-Net: Pseudo-Augmented Contrastive Distillation for Glycemic Control Estimation from SMBG20 May 2026
- 2026How Do Electrocardiogram Models Scale?17 May 2026
- 2026Extending Pretrained 10-Second ECG Foundation Models to Longer Horizons16 May 2026
- 2026VCR: Learning Valid Contextual Representation for Incomplete Wearable Signals13 May 2026
- 2026ECG-NAT: A Self-supervised Neighborhood Attention Transformer for Multi-lead Electrocardiogram Classification13 May 2026
- 2026Biosignal Fingerprinting: A Cross-Modal PPG-ECG Foundation Model10 May 2026
- 2026Cross-Subject Generalization for EEG Decoding: A Survey of Deep Learning Methods29 Apr 2026
- 2026Domain-Adapted Fine-Tuning of ECG Foundation Models for Multi-Label Structural Heart Disease Screening25 Apr 2026
- 2026OC-Distill: Ontology-aware Contrastive Learning with Cross-Modal Distillation for ICU Risk Prediction18 Apr 2026
- 2026CoRe-ECG: Advancing Self-Supervised Representation Learning for 12-Lead ECG via Contrastive and Reconstructive Synergy13 Apr 2026
- 2026Membership Inference Attacks Expose Participation Privacy in ECG Foundation Encoders12 Apr 2026
- 2026CARE-ECG: Causal Agent-based Reasoning for Explainable and Counterfactual ECG Interpretation12 Apr 2026
- 2026ADAPTive Input Training for Many-to-One Pre-Training on Time-Series Classification9 Apr 2026
- 2026Learning ECG Image Representations via Dual Physiological-Aware Alignments2 Apr 2026
- 2026RhythmBERT: A Self-Supervised Language Model Based on Latent Representations of ECG Waveforms for Heart Disease Detection26 Feb 2026
- 2026CG-DMER: Hybrid Contrastive-Generative Framework for Disentangled Multimodal ECG Representation Learning24 Feb 2026
- 2026Enhancing IMU-Based Online Handwriting Recognition via Contrastive Learning with Zero Inference Overhead4 Feb 2026
- 2026ECG-R1: Protocol-Guided and Modality-Agnostic MLLM for Reliable ECG Interpretation4 Feb 2026
- 2026Cross-Temporal Attention Fusion (CTAF) for Multimodal Physiological Signals in Self-Supervised Learning2 Feb 2026
- 2026Beat-ssl: Capturing Local ECG Morphology through Heartbeat-level Contrastive Learning with Soft Targets22 Jan 2026
- 2026Contrastive and Multi-Task Learning on Noisy Brain Signals with Nonlinear Dynamical Signatures13 Jan 2026
- 2026BEAT-Net: Injecting Biomimetic Spatio-Temporal Priors for Interpretable ECG Diagnosis12 Jan 2026
- 2025CLEF: Clinically-Guided Contrastive Learning for Electrocardiogram Foundation Models1 Dec 2025
- 2025PULSE: Privileged Knowledge Transfer from Rich to Deployable Sensors for Embodied Multi-Sensory Learning28 Oct 2025
- 2025Learning Without Augmenting: Unsupervised Time Series Representation Learning via Frame Projections26 Oct 2025
- 2025Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment24 Oct 2025
- 2025Symbol-Temporal Consistency Self-supervised Learning for Robust Time Series Classification24 Sep 2025
- 2025Self-Alignment Learning to Improve Myocardial Infarction Detection from Single-Lead ECG23 Sep 2025
- 2025ECG-aBcDe: Overcoming Model Dependence, Encoding ECG into a Universal Language for Any LLM16 Sep 2025
50 newest of 170 All 170 (JSON)
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
- 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 113
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 97
- 2023Large-scale Training of Foundation Models for Wearable Biosignalscited by 89
- 2024ECG-FM: An Open Electrocardiogram Foundation Modelcited by 89
- 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
- 2021Self-supervised representation learning from 12-lead ECG datacited by 80
- 2024Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancementcited by 66
- 2024PaPaGei: Open Foundation Models for Optical Physiological Signalscited by 64
- 2023Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-Seriescited by 59
- 2024Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series Classificationcited by 53
- 2021MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretationcited by 52
12 most cited of 167 All 167 (JSON)
- 2026Geometry-Conditioned Fixed-Scaffold Encoders for Time-Warp Robust Sequence Retrieval29 Sep 2026
- 2026DrafTS: Time-Aware Decomposition with Residual Correction for Time Series Modeling27 Sep 2026
- 2026BeatGraph: Self-Supervised Heartbeat Graphs for Infant ECG Representations from the Home Environment25 Sep 2026
- 2026A Hybrid CNN--State-Space--Attention Backbone with Joint-Embedding Predictive Pretraining for 12-Lead ECG Classification24 Sep 2026
- 2026TRACE: Tractable Routing Autoencoder for Clinical ECG20 Sep 2026
- 2026Beat-Synchronous Tokenization for ECG Transformers31 Aug 2026
- 2026Graph-Based Pseudo-multimodal Contrastive Learning for 12-Lead ECG Representations27 Aug 2026
- 2026CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representation13 Aug 2026
- 2026The Impact of Temporal Context Length and Encoding Strategies on Self-Supervised ECG Representation Learning13 Aug 2026
- 2026Take it Personally: The Limits of General SSL Representations for Real-Life PPG Emotion Detection3 Aug 2026
- 2026ECG-InterpBench: Benchmarking the Interpretability of ECG Foundation Models with Matched-Scale Sparse Autoencoders29 Jul 2026
- 2026CADENCE: A Cardiac Atom Dictionary for Interpretable Neural Concept Extraction from ECG Foundation Models28 Jul 2026
12 newest of 167 All 167 (JSON)