mlsanityData to 7 Oct 2026

SFDA-rPPG: Source-Free Domain Adaptive Remote Physiological Measurement with Spatio-Temporal Consistency

arXiv 2409.12040 ↗First posted 18 Sep 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Remote Photoplethysmography (rPPG) is a non-contact method that uses facial video to predict changes in blood volume, enabling physiological metrics measurement. Traditional rPPG models often struggle with poor generalization capacity in unseen domains. Current solutions to this problem is to improve its generalization in the target domain through Domain Generalization (DG) or Domain Adaptation (DA). However, both traditional methods require access to both source domain data and target domain data, which cannot be implemented in scenarios with limited access to source data, and another issue is the privacy of accessing source domain data. In this paper, we propose the first Source-free Domain Adaptation benchmark for rPPG measurement (SFDA-rPPG), which overcomes these limitations by enabling effective domain adaptation without access to source domain data. Our framework incorporates a Three-Branch Spatio-Temporal Consistency Network (TSTC-Net) to enhance feature consistency across domains. Furthermore, we propose a new rPPG distribution alignment loss based on the Frequency-domain Wasserstein Distance (FWD), which leverages optimal transport to align power spectrum distributions across domains effectively and further enforces the alignment of the three branches. Extensive cross-domain experiments and ablation studies demonstrate the effectiveness of our proposed method in source-free domain adaptation settings. Our findings highlight the significant contribution of the proposed FWD loss for distributional alignment, providing a valuable reference for future research and applications. The source code is available at https://github.com/XieYiping66/SFDA-rPPG

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 23 of its 54 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

23 of 54 references.

References · 23

  1. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  2. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  3. 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 844
  4. 2020Universal Source-Free Domain Adaptationcited by 219
  5. 2015On Wasserstein Two Sample Testing and Related Families of Nonparametric Testscited by 165
  6. 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
  7. 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 133
  8. 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 126
  9. 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
  10. 2016Deep Label Distribution Learning with Label Ambiguitycited by 104
  11. 2019Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancementcited by 86
  12. 2020Maximum Density Divergence for Domain Adaptationcited by 76
11 more
  1. 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurementcited by 71
  2. 2021The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Videocited by 66
  3. 2023MMPD: Multi-Domain Mobile Video Physiology Datasetcited by 55
  4. 2017A Reproducible Study on Remote Heart Rate Measurementcited by 49
  5. 2019Region Mutual Information Loss for Semantic Segmentationcited by 49
  6. 2022Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 47
  7. 2020AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searchingcited by 39
  8. 2023Contrast-Phys+: Unsupervised and Weakly-supervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 33
  9. 2023Neuron Structure Modeling for Generalizable Remote Physiological Measurementcited by 29
  10. 2022Facial Video-based Remote Physiological Measurement via Self-supervised Learningcited by 22
  11. 2021Non-contact Atrial Fibrillation Detection from Face Videos by Learning Systolic Peakscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.