Non-Contact Physiological Monitoring in Pediatric Intensive Care Units via Adaptive Masking and Self-Supervised Learning
Not on the map. Why?
Abstract (arXiv)
Continuous monitoring of vital signs in Pediatric Intensive Care Units (PICUs) is essential for early detection of clinical deterioration and effective clinical decision-making. However, contact-based sensors such as pulse oximeters may cause skin irritation, increase infection risk, and lead to patient discomfort. Remote photoplethysmography (rPPG) offers a contactless alternative to monitor heart rate using facial video, but remains underutilized in PICUs due to motion artifacts, occlusions, variable lighting, and domain shifts between laboratory and clinical data. We introduce a self-supervised pretraining framework for rPPG estimation in the PICU setting, based on a progressive curriculum strategy. The approach leverages the VisionMamba architecture and integrates an adaptive masking mechanism, where a lightweight Mamba-based controller assigns spatiotemporal importance scores to guide probabilistic patch sampling. This strategy dynamically increases reconstruction difficulty while preserving physiological relevance. To address the lack of labeled clinical data, we adopt a teacher-student distillation setup. A supervised expert model, trained on public datasets, provides latent physiological guidance to the student. The curriculum progresses through three stages: clean public videos, synthetic occlusion scenarios, and unlabeled videos from 500 pediatric patients. Our framework achieves a 42% reduction in mean absolute error relative to standard masked autoencoders and outperforms PhysFormer by 31%, reaching a final MAE of 3.2 bpm. Without explicit region-of-interest extraction, the model consistently attends to pulse-rich areas and demonstrates robustness under clinical occlusions and noise.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 69 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
43 of 69 references.
References · 43
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
31 more
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
- 2024VMamba: Visual State Space Modelcited by 955
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 495
- 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 286
- 2022Long Range Language Modeling via Gated State Spacescited by 265
- 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 235
- 2023Unmasked Teacher: Towards Training-Efficient Video Foundation Modelscited by 199
- 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretrainingcited by 179
- 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
- 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 133
- 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 126
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
- 2019RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representationcited by 104
- 2019Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancementcited by 86
- 2021The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Videocited by 66
- 2024MoE-Mamba: Efficient Selective State Space Models with Mixture of Expertscited by 60
- 2020Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learnercited by 58
- 2018VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Videocited by 57
- 2022Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 47
- 2023Non-Contrastive Unsupervised Learning of Physiological Signals from Videocited by 37
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
- 2023Contrast-Phys+: Unsupervised and Weakly-supervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 33
- 2021Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Losscited by 23
- 2022Facial Video-based Remote Physiological Measurement via Self-supervised Learningcited by 22
- 2024PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mambacited by 14
- 2022EVM-CNN: Real-Time Contactless Heart Rate Estimation from Facial Videocited by 10
- 2022TransPPG: Two-stream Transformer for Remote Heart Rate Estimatecited by 8
- 2022Instantaneous Physiological Estimation using Video Transformerscited by 5
- 2024PhySU-Net: Long Temporal Context Transformer for rPPG with Self-Supervised Pre-trainingcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Bootstrapping Vision-language Models for Self-supervised Remote Physiological Measurement
- 2024RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurement
- 2025Estimating Clinical Lab Test Result Trajectories from PPG using Physiological Foundation Model and Patient-Aware State Space Model -- a UNIPHY+ Approach
- 2023Hallucinated Heartbeats: Anomaly-Aware Remote Pulse Estimation
- 2026PhysFlow: Frequency Decoupled with Dual-Field Rectified Flow for Remote Photoplethysmography
- 2024PhysMamba: State Space Duality Model for Remote Physiological Measurement
- 2025TYrPPG: Uncomplicated and Enhanced Learning Capability rPPG for Remote Heart Rate Estimation
- 2026Rhythm-Structured Predictive Learning for Remote Photoplethysmography