Improving Clinical Predictions through Unsupervised Time Series Representation Learning
Not on the map. Why?
Abstract (arXiv)
In this work, we investigate unsupervised representation learning on medical time series, which bears the promise of leveraging copious amounts of existing unlabeled data in order to eventually assist clinical decision making. By evaluating on the prediction of clinically relevant outcomes, we show that in a practical setting, unsupervised representation learning can offer clear performance benefits over end-to-end supervised architectures. We experiment with using sequence-to-sequence (Seq2Seq) models in two different ways, as an autoencoder and as a forecaster, and show that the best performance is achieved by a forecasting Seq2Seq model with an integrated attention mechanism, proposed here for the first time in the setting of unsupervised learning for medical time series.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 5; 2024: 1; 2025: 5; 2026: 1.
24 papers.
Sort:
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
- 2022Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusioncited by 96
- 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Reviewcited by 35
- 2021Neighborhood Contrastive Learning Applied to Online Patient Monitoringcited by 32
- 2022MHCCL: Masked Hierarchical Cluster-Wise Contrastive Learning for Multivariate Time Seriescited by 28
- 2023Reliable Generation of Privacy-preserving Synthetic Electronic Health Record Time Series via Diffusion Modelscited by 24
- 2023Generative modeling for time series via Schr"odinger bridgecited by 18
- 2023Unsupervised Representation Learning for Time Series: A Reviewcited by 14
- 2022On the Importance of Clinical Notes in Multi-modal Learning for EHR Datacited by 10
- 2025Deep Learning for Time Series Forecasting: A Surveycited by 10
- 2023Improving Time Series Encoding with Noise-Aware Self-Supervised Learning and an Efficient Encodercited by 5
- 2021Conditional Loss and Deep Euler Scheme for Time Series Generationcited by 4
12 more
- 2021A Self-Supervised Framework for Function Learning and Extrapolationcited by 2
- 2022Self-supervised Representation Learning on Electronic Health Records with Graph Kernel Infomaxcited by 2
- 2022Convolution-enhanced Evolving Attention Networkscited by 2
- 2021Improving Prediction of Low-Prior Clinical Events with Simultaneous General Patient-State Representation Learningcited by 1
- 2022Deep Normed Embeddings for Patient Representationcited by 1
- 2023Fully Embedded Time-Series Generative Adversarial Networkscited by 1
- 2024Learning to Select the Best Forecasting Tasks for Clinical Outcome Predictioncited by 0
- 2025Two-Stage Representation Learning for Analyzing Movement Behavior Dynamics in People Living with Dementiacited by 0
- 2025Analyzing Patient Daily Movement Behavior Dynamics Using Two-Stage Encoding Modelcited by 0
- 2025Borrowing From the Future: Enhancing Early Risk Assessment through Contrastive Learningcited by 0
- 2025MTS-DMAE: Dual-Masked Autoencoder for Unsupervised Multivariate Time Series Representation Learningcited by 0
- 2026SMart: A Multi-source Multi-phase Time Series Representation Transfer Frameworkcited by 0
- 2026SMart: A Multi-source Multi-phase Time Series Representation Transfer Framework2 Sep 2026
- 2025MTS-DMAE: Dual-Masked Autoencoder for Unsupervised Multivariate Time Series Representation Learning19 Sep 2025
- 2025Borrowing From the Future: Enhancing Early Risk Assessment through Contrastive Learning15 Aug 2025
- 2025Deep Learning for Time Series Forecasting: A Survey13 Mar 2025
- 2025Analyzing Patient Daily Movement Behavior Dynamics Using Two-Stage Encoding Model14 Feb 2025
- 2025Two-Stage Representation Learning for Analyzing Movement Behavior Dynamics in People Living with Dementia13 Feb 2025
- 2024Learning to Select the Best Forecasting Tasks for Clinical Outcome Prediction28 Jul 2024
- 2023Reliable Generation of Privacy-preserving Synthetic Electronic Health Record Time Series via Diffusion Models23 Oct 2023
- 2023Fully Embedded Time-Series Generative Adversarial Networks30 Aug 2023
- 2023Unsupervised Representation Learning for Time Series: A Review3 Aug 2023
- 2023Improving Time Series Encoding with Noise-Aware Self-Supervised Learning and an Efficient Encoder11 Jun 2023
- 2023Generative modeling for time series via Schr"odinger bridge11 Apr 2023
12 more
- 2022Convolution-enhanced Evolving Attention Networks16 Dec 2022
- 2022On the Importance of Clinical Notes in Multi-modal Learning for EHR Data6 Dec 2022
- 2022MHCCL: Masked Hierarchical Cluster-Wise Contrastive Learning for Multivariate Time Series2 Dec 2022
- 2022Self-supervised Representation Learning on Electronic Health Records with Graph Kernel Infomax1 Sep 2022
- 2022Deep Normed Embeddings for Patient Representation12 Apr 2022
- 2022Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusion8 Feb 2022
- 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Review7 Jul 2021
- 2021Improving Prediction of Low-Prior Clinical Events with Simultaneous General Patient-State Representation Learning28 Jun 2021
- 2021A Self-Supervised Framework for Function Learning and Extrapolation14 Jun 2021
- 2021Neighborhood Contrastive Learning Applied to Online Patient Monitoring9 Jun 2021
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Coding1 Jun 2021
- 2021Conditional Loss and Deep Euler Scheme for Time Series Generation10 Feb 2021
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
- 2022Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusioncited by 96
- 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Reviewcited by 35
- 2021Neighborhood Contrastive Learning Applied to Online Patient Monitoringcited by 32
- 2022MHCCL: Masked Hierarchical Cluster-Wise Contrastive Learning for Multivariate Time Seriescited by 28
- 2023Reliable Generation of Privacy-preserving Synthetic Electronic Health Record Time Series via Diffusion Modelscited by 24
- 2023Generative modeling for time series via Schr"odinger bridgecited by 18
- 2023Unsupervised Representation Learning for Time Series: A Reviewcited by 14
- 2022On the Importance of Clinical Notes in Multi-modal Learning for EHR Datacited by 10
- 2025Deep Learning for Time Series Forecasting: A Surveycited by 10
- 2023Improving Time Series Encoding with Noise-Aware Self-Supervised Learning and an Efficient Encodercited by 5
- 2021Conditional Loss and Deep Euler Scheme for Time Series Generationcited by 4
12 most cited of 24 All 24 (JSON)
- 2026SMart: A Multi-source Multi-phase Time Series Representation Transfer Framework2 Sep 2026
- 2025MTS-DMAE: Dual-Masked Autoencoder for Unsupervised Multivariate Time Series Representation Learning19 Sep 2025
- 2025Borrowing From the Future: Enhancing Early Risk Assessment through Contrastive Learning15 Aug 2025
- 2025Deep Learning for Time Series Forecasting: A Survey13 Mar 2025
- 2025Analyzing Patient Daily Movement Behavior Dynamics Using Two-Stage Encoding Model14 Feb 2025
- 2025Two-Stage Representation Learning for Analyzing Movement Behavior Dynamics in People Living with Dementia13 Feb 2025
- 2024Learning to Select the Best Forecasting Tasks for Clinical Outcome Prediction28 Jul 2024
- 2023Reliable Generation of Privacy-preserving Synthetic Electronic Health Record Time Series via Diffusion Models23 Oct 2023
- 2023Fully Embedded Time-Series Generative Adversarial Networks30 Aug 2023
- 2023Unsupervised Representation Learning for Time Series: A Review3 Aug 2023
- 2023Improving Time Series Encoding with Noise-Aware Self-Supervised Learning and an Efficient Encoder11 Jun 2023
- 2023Generative modeling for time series via Schr"odinger bridge11 Apr 2023
12 newest of 24 All 24 (JSON)