Multi-Scale and Multi-Modal Contrastive Learning Network for Biomedical Time Series
Not on the map. Why?
Abstract (arXiv)
Multi-modal biomedical time series (MBTS) data offers a holistic view of the physiological state, holding significant importance in various bio-medical applications. Owing to inherent noise and distribution gaps across different modalities, MBTS can be complex to model. Various deep learning models have been developed to learn representations of MBTS but still fall short in robustness due to the ignorance of modal-to-modal variations. This paper presents a multi-scale and multi-modal biomedical time series representation learning (MBSL) network with contrastive learning to migrate these variations. Firstly, MBTS is grouped based on inter-modal distances, then each group with minimum intra-modal variations can be effectively modeled by individual encoders. Besides, to enhance the multi-scale feature extraction (encoder), various patch lengths and mask ratios are designed to generate tokens with semantic information at different scales and diverse contextual perspectives respectively. Finally, cross-modal contrastive learning is proposed to maximize consistency among inter-modal groups, maintaining useful information and eliminating noises. Experiments against four bio-medical applications show that MBSL outperforms state-of-the-art models by 33.9% mean average errors (MAE) in respiration rate, by 13.8% MAE in exercise heart rate, by 1.41% accuracy in human activity recognition, and by 1.14% F1-score in obstructive sleep apnea-hypopnea syndrome.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 21 references that are in the map. First posted on arXiv 6 Dec 2023.
Builds on
16 of 21 references.
References · 16
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 471
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
- 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
- 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 101
- 2016Multi-Scale Convolutional Neural Networks for Time Series Classificationcited by 99
- 2022Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusioncited by 96
- 2023TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoderscited by 44
- 2014TROIKA: A General Framework for Heart Rate Monitoring Using Wrist-Type Photoplethysmographic Signals During Intensive Physical Exercisecited by 40
- 2022First De-Trend then Attend: Rethinking Attention for Time-Series Forecastingcited by 19
4 more
- 2022RRWaveNet: A Compact End-to-End Multi-Scale Residual CNN for Robust PPG Respiratory Rate Estimationcited by 8
- 2023A Co-training Approach for Noisy Time Series Learningcited by 8
- 2019RespNet: A deep learning model for extraction of respiration from photoplethysmogramcited by 6
- 2021ConCAD: Contrastive Learning-based Cross Attention for Sleep Apnea Detectioncited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.