mlsanityData to 7 Oct 2026

Camera-Based Remote Physiology Sensing for Hundreds of Subjects Across Skin Tones

arXiv 2404.05003 ↗First posted 7 Apr 2024cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Remote photoplethysmography (rPPG) emerges as a promising method for non-invasive, convenient measurement of vital signs, utilizing the widespread presence of cameras. Despite advancements, existing datasets fall short in terms of size and diversity, limiting comprehensive evaluation under diverse conditions. This paper presents an in-depth analysis of the VitalVideo dataset, the largest real-world rPPG dataset to date, encompassing 893 subjects and 6 Fitzpatrick skin tones. Our experimentation with six unsupervised methods and three supervised models demonstrates that datasets comprising a few hundred subjects(i.e., 300 for UBFC-rPPG, 500 for PURE, and 700 for MMPD-Simple) are sufficient for effective rPPG model training. Our findings highlight the importance of diversity and consistency in skin tones for precise performance evaluation across different datasets.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 7 Apr 2024.

Builds on

15 of 31 references.

References · 15

  1. 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
  2. 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 133
  3. 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
  4. 2019Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancementcited by 86
  5. 2021The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Videocited by 66
  6. 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 63
  7. 2021Camera Measurement of Physiological Vital Signscited by 49
  8. 2022Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 47
  9. 2022SimPer: Simple Self-Supervised Learning of Periodic Targetscited by 44
  10. 2023Non-Contrastive Unsupervised Learning of Physiological Signals from Videocited by 37
  11. 2024Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformercited by 19
  12. 2020Advancing Non-Contact Vital Sign Measurement using Synthetic Avatarscited by 15
3 more
  1. 2023Camera-Based HRV Prediction for Remote Learning Environmentscited by 9
  2. 2022Federated Remote Physiological Measurement with Imperfect Datacited by 7
  3. 2023VitalVideos-Europe: A dataset of face videos with PPG and blood pressure ground truthscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.