A Laplace diffusion-based transformer model for heart rate forecasting within daily activity context
Not on the map. Why?
Abstract (arXiv)
With the advent of wearable Internet of Things (IoT) devices, remote patient monitoring (RPM) emerged as a promising solution for managing heart failure. However, the heart rate can fluctuate significantly due to various factors, and without correlating it to the patient's actual physical activity, it becomes difficult to assess whether changes are significant. Although Artificial Intelligence (AI) models may enhance the accuracy and contextual understanding of remote heart rate monitoring, the integration of activity data is still rarely addressed. In this paper, we propose a Transformer model combined with a Laplace diffusion technique to model heart rate fluctuations driven by physical activity of the patient. Unlike prior models that treat activity as secondary, our approach conditions the entire modeling process on activity context using specialized embeddings and attention mechanisms to prioritize activity specific historical patents. The model captures both long-term patterns and activity-specific heart rate dynamics by incorporating contextualized embeddings and dedicated encoder. The Transformer model was validated on a real-world dataset collected from 29 patients over a 4-month period. Experimental results show that our model outperforms current state-of-the-art methods, achieving a 43% reduction in mean absolute error compared to the considered baseline models. Moreover, the coefficient of determination R2 is 0.97 indicating the model predicted heart rate is in strong agreement with actual heart rate values. These findings suggest that the proposed model is a practical and effective tool for supporting both healthcare providers and remote patient monitoring systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 62 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
27 of 62 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
- 2019BEHRT: Transformer for Electronic Health Recordscited by 263
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
15 more
- 2023Large language models in healthcare and medical domain: A reviewcited by 127
- 2022Deep Isolation Forest for Anomaly Detectioncited by 92
- 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 70
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 67
- 2024Time Series Modeling for Heart Rate Prediction: From ARIMA to Transformerscited by 35
- 2023A Comprehensive Overview and Comparative Analysis on Deep Learning Models: CNN, RNN, LSTM, GRUcited by 25
- 2023Transformers in Healthcare: A Surveycited by 17
- 2023A Transformer-based Diffusion Probabilistic Model for Heart Rate and Blood Pressure Forecasting in Intensive Care Unitcited by 14
- 2025A Survey on Diffusion Models for Anomaly Detectioncited by 13
- 2021An explainable Transformer-based deep learning model for the prediction of incident heart failurecited by 12
- 2023Assessing the capacity of a denoising diffusion probabilistic model to reproduce spatial contextcited by 7
- 2023Improving Diffusion Models for ECG Imputation with an Augmented Template Priorcited by 7
- 2021Transformer-Based Behavioral Representation Learning Enables Transfer Learning for Mobile Sensing in Small Datasetscited by 2
- 2024Multi-modal Heart Failure Risk Estimation based on Short ECG and Sampled Long-Term HRVcited by 1
- 2025New care pathways for supporting transitional care from hospitals to home using AI and personalized digital assistancecited by 1
Built on by
Not cited yet.