Privacy-Preserving Remote Heart Rate Estimation from Facial Videos
Not on the map. Why?
Abstract (arXiv)
Remote Photoplethysmography (rPPG) is the process of estimating PPG from facial videos. While this approach benefits from contactless interaction, it is reliant on videos of faces, which often constitutes an important privacy concern. Recent research has revealed that deep learning techniques are vulnerable to attacks, which can result in significant data breaches making deep rPPG estimation even more sensitive. To address this issue, we propose a data perturbation method that involves extraction of certain areas of the face with less identity-related information, followed by pixel shuffling and blurring. Our experiments on two rPPG datasets (PURE and UBFC) show that our approach reduces the accuracy of facial recognition algorithms by over 60%, with minimal impact on rPPG extraction. We also test our method on three facial recognition datasets (LFW, CALFW, and AgeDB), where our approach reduced performance by nearly 50%. Our findings demonstrate the potential of our approach as an effective privacy-preserving solution for rPPG estimation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 27 of its 54 references that are in the map. First posted on arXiv 1 Jun 2023.
Builds on
27 of 54 references.
References · 27
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2015Fast R-CNNcited by 2,930
- 2016Deep Learning with Differential Privacycited by 2,682
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
- 2014Learning Face Representation from Scratchcited by 451
- 2018Deep Face Recognition: A Surveycited by 275
- 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 258
- 2017A Survey on Homomorphic Encryption Schemes: Theory and Implementationcited by 154
15 more
- 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
- 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 126
- 2020InstaHide: Instance-hiding Schemes for Private Distributed Learningcited by 90
- 2021CAFE: Catastrophic Data Leakage in Vertical Federated Learningcited by 76
- 2018Learning to Anonymize Faces for Privacy Preserving Action Detectioncited by 63
- 2020PulseGAN: Learning to generate realistic pulse waveforms in remote photoplethysmographycited by 59
- 2018Learnable Image Encryptioncited by 33
- 2018Encryption-then-Compression Systems using Grayscale-based Image Encryption for JPEG Imagescited by 33
- 2020Privacy Preserving Face Recognition Utilizing Differential Privacycited by 30
- 2022Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domaincited by 28
- 2020Block-wise Scrambled Image Recognition Using Adaptation Networkcited by 27
- 2021CapsField: Light Field-based Face and Expression Recognition in the Wild using Capsule Routingcited by 9
- 2021Depth as Attention for Face Representation Learningcited by 5
- 2021Teacher-Student Adversarial Depth Hallucination to Improve Face Recognitioncited by 4
- 2022A Jigsaw Puzzle Solver-based Attack on Block-wise Image Encryption for Privacy-preserving DNNscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 1.
4 papers.
- 2023Remote Heart Rate Monitoring in Smart Environments from Videos with Self-supervised Pre-trainingcited by 1
- 2025Editing Physiological Signals in Videos Using Latent Representationscited by 1
- 2024Multi-objective Feature Selection in Remote Health Monitoring Applicationscited by 0
- 2026Subject-Relative Micro-Motion and Sleep Dynamics for Near-Infrared Video Sleep Stagingcited by 0
- 2026Subject-Relative Micro-Motion and Sleep Dynamics for Near-Infrared Video Sleep Staging3 Sep 2026
- 2025Editing Physiological Signals in Videos Using Latent Representations29 Sep 2025
- 2024Multi-objective Feature Selection in Remote Health Monitoring Applications10 Jan 2024
- 2023Remote Heart Rate Monitoring in Smart Environments from Videos with Self-supervised Pre-training23 Oct 2023