Camera-Based Remote Physiology Sensing for Hundreds of Subjects Across Skin Tones
Not on the map. Why?
Abstract (arXiv)
Remote photoplethysmography (rPPG) emerges as a promising method for non-invasive, convenient measurement of vital signs, utilizing the widespread presence of cameras. Despite advancements, existing datasets fall short in terms of size and diversity, limiting comprehensive evaluation under diverse conditions. This paper presents an in-depth analysis of the VitalVideo dataset, the largest real-world rPPG dataset to date, encompassing 893 subjects and 6 Fitzpatrick skin tones. Our experimentation with six unsupervised methods and three supervised models demonstrates that datasets comprising a few hundred subjects(i.e., 300 for UBFC-rPPG, 500 for PURE, and 700 for MMPD-Simple) are sufficient for effective rPPG model training. Our findings highlight the importance of diversity and consistency in skin tones for precise performance evaluation across different datasets.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 7 Apr 2024.
Builds on
15 of 31 references.
References · 15
- 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
- 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 133
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
- 2019Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancementcited by 86
- 2021The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Videocited by 66
- 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 63
- 2021Camera Measurement of Physiological Vital Signscited by 49
- 2022Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 47
- 2022SimPer: Simple Self-Supervised Learning of Periodic Targetscited by 44
- 2023Non-Contrastive Unsupervised Learning of Physiological Signals from Videocited by 37
- 2024Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformercited by 19
- 2020Advancing Non-Contact Vital Sign Measurement using Synthetic Avatarscited by 15
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2024Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudescited by 6
- 2025Non-Contact Health Monitoring During Daily Personal Care Routinescited by 3
- 2025Exploring Reliable PPG Authentication on Smartwatches in Daily Scenarioscited by 1
- 2025M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settingscited by 1
- 2025M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings4 Nov 2025
- 2025Non-Contact Health Monitoring During Daily Personal Care Routines11 Jun 2025
- 2025Exploring Reliable PPG Authentication on Smartwatches in Daily Scenarios31 Mar 2025
- 2024Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes28 Sep 2024