FCUS-rPPG: A Fast-Converging Unsupervised Framework for Remote Photoplethysmography via Gradient Oscillation Suppression
Not on the map. Why?
Abstract (arXiv)
Remote photoplethysmography (rPPG) enables non-contact extraction of blood volume pulse (BVP) signals using consumer-grade cameras. Recent unsupervised rPPG methods learn BVP representations without requiring ground-truth physiological annotations, yet their optimization is often hindered by noisy and unstable gradients, resulting in slow convergence and limited cross-domain generalization. In this paper, we propose FCUS-rPPG, a fast-converging unsupervised rPPG framework with strong generalization capability. Motivated by the observation that BVP representations exhibit both multi-spectral covariation and low-dimensional manifold structure, we design a spectrally shared backbone that facilitates BVP feature disentanglement while improving optimization efficiency. To jointly enhance convergence stability and generalization performance, we further develop a unified optimization framework operating at the gradient, loss-landscape, and feature-representation levels. Specifically, a post-verification masking mechanism filters out misleading gradients according to the weak-amplitude physiological prior of BVP signals; a perturbation-based loss landscape smoothing strategy steers optimization toward more generalizable flat minima; and a noise-aware null-space regularization constrains feature updates to the orthogonal complement of the noise subspace, thereby mitigating noise-induced representation drift. Extensive experiments on five datasets demonstrate that FCUS-rPPG requires only one training epoch, whereas existing methods typically require tens to hundreds of epochs. Notably, FCUS-rPPG consistently achieves state-of-the-art (SOTA) performance in cross-dataset evaluations. This study provides an efficient and robust solution to the real-world deployment of unsupervised rPPG. The source code will be publicly available at https://github.com/JiaJieLee/FCUS-rPPG.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 55 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
29 of 55 references.
References · 29
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
- 2018Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervisioncited by 167
- 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
- 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 133
- 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 126
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
- 2019RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representationcited by 104
17 more
- 2020Video-based Remote Physiological Measurement via Cross-verified Feature Disentanglingcited by 78
- 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurementcited by 71
- 2021The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Videocited by 66
- 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 63
- 2020PulseGAN: Learning to generate realistic pulse waveforms in remote photoplethysmographycited by 59
- 2020Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learnercited by 58
- 2023MMPD: Multi-Domain Mobile Video Physiology Datasetcited by 55
- 2021Camera Measurement of Physiological Vital Signscited by 49
- 2022Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 47
- 2022SimPer: Simple Self-Supervised Learning of Periodic Targetscited by 44
- 2023Non-Contrastive Unsupervised Learning of Physiological Signals from Videocited by 37
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
- 2023Contrast-Phys+: Unsupervised and Weakly-supervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 33
- 2023Neuron Structure Modeling for Generalizable Remote Physiological Measurementcited by 29
- 2021Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Losscited by 23
- 2022Facial Video-based Remote Physiological Measurement via Self-supervised Learningcited by 22
- 2024Advancing Generalizable Remote Physiological Measurement through the Integration of Explicit and Implicit Prior Knowledgecited by 13
Built on by
Not cited yet.