# VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video

arXiv: https://arxiv.org/abs/1810.04927 · HTML: https://mlsanity.com/paper/1810.04927/

## Key facts

- Cited by 58 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 Oct 2018.

## Built on by (most cited first, 30 of 58)

- [The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Video](https://mlsanity.com/paper/2111.09748/) (2021)
- [MMPD: Multi-Domain Mobile Video Physiology Dataset](https://mlsanity.com/paper/2302.03840/) (2023)
- [Camera Measurement of Physiological Vital Signs](https://mlsanity.com/paper/2111.11547/) (2021)
- [Non-Contrastive Unsupervised Learning of Physiological Signals from Video](https://mlsanity.com/paper/2303.07944/) (2023)
- [rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurement](https://mlsanity.com/paper/2306.02301/) (2023)
- [SCAMPS: Synthetics for Camera Measurement of Physiological Signals](https://mlsanity.com/paper/2206.04197/) (2022)
- [Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videos](https://mlsanity.com/paper/2211.16922/) (2022)
- [Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Loss](https://mlsanity.com/paper/2107.07695/) (2021)
- [Image Enhancement for Remote Photoplethysmography in a Low-Light Environment](https://mlsanity.com/paper/2303.09336/) (2023)
- [The First Vision For Vitals (V4V) Challenge for Non-Contact Video-Based Physiological Estimation](https://mlsanity.com/paper/2109.10471/) (2021)
- [Deception Detection and Remote Physiological Monitoring: A Dataset and Baseline Experimental Results](https://mlsanity.com/paper/2106.06583/) (2021)
- [Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videos](https://mlsanity.com/paper/2308.07771/) (2023)
- [Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Loss](https://mlsanity.com/paper/2203.10882/) (2022)
- [Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurement](https://mlsanity.com/paper/2303.12059/) (2023)
- [egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Tasks](https://mlsanity.com/paper/2502.20879/) (2025)
- [Camera-Based HRV Prediction for Remote Learning Environments](https://mlsanity.com/paper/2305.04161/) (2023)
- [How Suboptimal is Training rPPG Models with Videos and Targets from Different Body Sites?](https://mlsanity.com/paper/2403.10582/) (2024)
- [TransPPG: Two-stream Transformer for Remote Heart Rate Estimate](https://mlsanity.com/paper/2201.10873/) (2022)
- [Assessment of Deep Learning-based Heart Rate Estimation using Remote Photoplethysmography under Different Illuminations](https://mlsanity.com/paper/2107.13193/) (2021)
- [Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimation](https://mlsanity.com/paper/2404.09378/) (2024)
- [Bi-TTA: Bidirectional Test-Time Adapter for Remote Physiological Measurement](https://mlsanity.com/paper/2409.17316/) (2024)
- [Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes](https://mlsanity.com/paper/2409.19223/) (2024)
- [MSPM: A Multi-Site Physiological Monitoring Dataset for Remote Pulse, Respiration, and Blood Pressure Estimation](https://mlsanity.com/paper/2402.02224/) (2024)
- [Resolve Domain Conflicts for Generalizable Remote Physiological Measurement](https://mlsanity.com/paper/2404.07855/) (2024)
- [Non-Contact Heart Rate Measurement from Deteriorated Videos](https://mlsanity.com/paper/2304.14789/) (2023)
- [PhySU-Net: Long Temporal Context Transformer for rPPG with Self-Supervised Pre-training](https://mlsanity.com/paper/2402.11913/) (2024)
- [PhysFlow: Skin tone transfer for remote heart rate estimation through conditional normalizing flows](https://mlsanity.com/paper/2407.21519/) (2024)
- [Semi-rPPG: Semi-Supervised Remote Physiological Measurement with Curriculum Pseudo-Labeling](https://mlsanity.com/paper/2502.03855/) (2025)
- [Phase-shifted remote photoplethysmography for estimating heart rate and blood pressure from facial video](https://mlsanity.com/paper/2401.04560/) (2024)
- [SiNC+: Adaptive Camera-Based Vitals with Unsupervised Learning of Periodic Signals](https://mlsanity.com/paper/2404.13449/) (2024)

## Abstract (arXiv)

Heart rate (HR) is an important physiological signal that reflects the physical and emotional activities of humans. Traditional HR measurements are mainly based on contact monitors, which are inconvenient and may cause discomfort for the subjects. Recently, methods have been proposed for remote HR estimation from face videos. However, most of the existing methods focus on well-controlled scenarios, their generalization ability into less-constrained scenarios are not known. At the same time, lacking large-scale databases has limited the use of deep representation learning methods in remote HR estimation. In this paper, we introduce a large-scale multi-modal HR database (named as VIPL-HR), which contains 2,378 visible light videos (VIS) and 752 near-infrared (NIR) videos of 107 subjects. Our VIPL-HR database also contains various variations such as head movements, illumination variations, and acquisition device changes. We also learn a deep HR estimator (named as RhythmNet) with the proposed spatial-temporal representation, which achieves promising results on both the public-domain and our VIPL-HR HR estimation databases. We would like to put the VIPL-HR database into the public domain.