rPPG-Toolbox: Deep Remote PPG Toolbox
Not on the map. Why?
Abstract (arXiv)
Camera-based physiological measurement is a fast growing field of computer vision. Remote photoplethysmography (rPPG) utilizes imaging devices (e.g., cameras) to measure the peripheral blood volume pulse (BVP) via photoplethysmography, and enables cardiac measurement via webcams and smartphones. However, the task is non-trivial with important pre-processing, modeling, and post-processing steps required to obtain state-of-the-art results. Replication of results and benchmarking of new models is critical for scientific progress; however, as with many other applications of deep learning, reliable codebases are not easy to find or use. We present a comprehensive toolbox, rPPG-Toolbox, that contains unsupervised and supervised rPPG models with support for public benchmark datasets, data augmentation, and systematic evaluation: urlhttps://github.com/ubicomplab/rPPG-Toolbox
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). Builds on 25 of its 69 references that are in the map. First posted on arXiv 3 Oct 2022.
Builds on
25 of 69 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
- 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 133
- 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 126
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
- 2019RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representationcited by 104
- 2019Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancementcited by 86
- 2020Video-based Remote Physiological Measurement via Cross-verified Feature Disentanglingcited by 78
- 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurementcited by 71
- 2021The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Videocited by 66
- 2020PulseGAN: Learning to generate realistic pulse waveforms in remote photoplethysmographycited by 59
13 more
- 2020Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learnercited by 58
- 2021Camera Measurement of Physiological Vital Signscited by 49
- 2022Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 47
- 2020Behavioral Use Licensing for Responsible AIcited by 46
- 2021TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detectioncited by 41
- 2022SCAMPS: Synthetics for Camera Measurement of Physiological Signalscited by 28
- 2019Analysis of CNN-based remote-PPG to understand limitations and sensitivitiescited by 19
- 2020Advancing Non-Contact Vital Sign Measurement using Synthetic Avatarscited by 15
- 2022Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Losscited by 12
- 2021Assessment of deep learning based blood pressure prediction from PPG and rPPG signalscited by 9
- 2019iPhys: An Open Non-Contact Imaging-Based Physiological Measurement Toolboxcited by 8
- 2022Federated Remote Physiological Measurement with Imperfect Datacited by 7
- 2019On the Vector Space in Photoplethysmography Imagingcited by 3
Built on by
Citing papers per year: 2023: 5; 2024: 15; 2025: 20; 2026: 23.
63 papers.
Sort:
By area:
- 2024RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attentioncited by 28
- 2024Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformercited by 19
- 2024PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mambacited by 14
- 2023BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurementscited by 13
- 2024FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensingcited by 13
- 2023Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurementcited by 11
- 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Taskscited by 11
- 2024How Suboptimal is Training rPPG Models with Videos and Targets from Different Body Sites?cited by 9
- 2024On the Standardization of Behavioral Use Clauses and Their Adoption for Responsible Licensing of AIcited by 7
- 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimationcited by 6
- 2024Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudescited by 6
- 2025PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoringcited by 6
38 more
- 2023CalibrationPhys: Self-supervised Video-based Heart and Respiratory Rate Measurements by Calibrating Between Multiple Camerascited by 5
- 2023Self-similarity Prior Distillation for Unsupervised Remote Physiological Measurementcited by 5
- 2024Camera-Based Remote Physiology Sensing for Hundreds of Subjects Across Skin Tonescited by 4
- 2025Gaze into the Heart: A Multi-View Video Dataset for rPPG and Health Biomarkers Estimationcited by 4
- 2025Semi-rPPG: Semi-Supervised Remote Physiological Measurement with Curriculum Pseudo-Labelingcited by 3
- 2025Non-Contact Health Monitoring During Daily Personal Care Routinescited by 3
- 2024Phase-shifted remote photoplethysmography for estimating heart rate and blood pressure from facial videocited by 2
- 2025Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Modelscited by 2
- 2025Memory-efficient Low-latency Remote Photoplethysmography through Temporal-Spatial State Space Dualitycited by 2
- 2025BeatFormer: Efficient motion-robust remote heart rate estimation through unsupervised spectral zoomed attention filterscited by 2
- 2024Refining Remote Photoplethysmography Architectures using CKA and Empirical Methodscited by 1
- 2024MHAD: Multimodal Home Activity Dataset with Multi-Angle Videos and Synchronized Physiological Signalscited by 1
- 2025Passive Heart Rate Monitoring During Smartphone Use in Everyday Lifecited by 1
- 2025Generalization of Video-Based Heart Rate Estimation Methods To Low Illumination and Elevated Heart Ratescited by 1
- 2025Robust and Generalizable Heart Rate Estimation via Deep Learning for Remote Photoplethysmography in Complex Scenarioscited by 1
- 2025Editing Physiological Signals in Videos Using Latent Representationscited by 1
- 2025M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settingscited by 1
- 2026ToTMNet: FFT-Accelerated Toeplitz Temporal Mixing Network for Lightweight Remote Photoplethysmographycited by 1
- 2026HOT: Harmonic-Constrained Optimal Transport for Remote Photoplethysmography Domain Adaptationcited by 1
- 2026rPPG-VQA: A Video Quality Assessment Framework for Unsupervised rPPG Trainingcited by 1
- 2026PhysFlow: Frequency Decoupled with Dual-Field Rectified Flow for Remote Photoplethysmographycited by 1
- 2023Pavlok-Nudge: A Feedback Mechanism for Atomic Behaviour Modification with Snoring Usecasecited by 0
- 2024GigaPevt: Multimodal Medical Assistantcited by 0
- 2024rFaceNet: An End-to-End Network for Enhanced Physiological Signal Extraction through Identity-Specific Facial Contourscited by 0
- 2024GVT2RPM: An Empirical Study for General Video Transformer Adaptation to Remote Physiological Measurementcited by 0
- 2025Efficient and Robust Multidimensional Attention in Remote Physiological Sensing through Target Signal Constrained Factorizationcited by 0
- 2025Exploring Remote Physiological Signal Measurement under Dynamic Lighting Conditions at Night: Dataset, Experiment, and Analysiscited by 0
- 2025Improving Autism Detection with Multimodal Behavioral Analysiscited by 0
- 2025Real-Time Mobile Video Analytics for Pre-arrival Emergency Medical Servicescited by 0
- 2025Adaptive Parameter Optimization for Robust Remote Photoplethysmographycited by 0
- 2025FacePhys: State of the Heart Learningcited by 0
- 2025Quality-Aware Framework for Video-Derived Respiratory Signalscited by 0
- 2026Facial Spatiotemporal Graphs: Leveraging the 3D Facial Surface for Remote Physiological Measurementcited by 0
- 2026VideoPulse: Neonatal heart rate and peripheral capillary oxygen saturation (SpO2) estimation from contact free videocited by 0
- 2026Uncertainty-quantified Pulse Signal Recovery from Facial Video using Regularized Stochastic Interpolantscited by 0
- 2026Video-based Heart Rate Estimation with Angle-guided ROI Optimization and Graph Signal Denoisingcited by 0
- 2026LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurementcited by 0
- 2026FCUS-rPPG: A Fast-Converging Unsupervised Framework for Remote Photoplethysmography via Gradient Oscillation Suppressioncited by 0
50 most cited of 63 All 63 (JSON)
- 2026FLOW: Feature-Level Optimal Warping for Generalized Remote Physiological Measurement30 Sep 2026
- 2026Pixel-wise Exposure for Highly Robust In-Vehicle Remote-PPG29 Sep 2026
- 2026Heartian: Physiology-Aware Relightable Gaussian Head Avatar22 Sep 2026
- 2026SeetaPsych v1.0: An Open-source Computer Vision Toolkit for Behavior-based Psychological Measurement17 Sep 2026
- 2026Beyond Ambiguous Visual Cues: Studying Physiological Disruptions and Cross-Modal Inconsistencies in Deepfake Videos11 Sep 2026
- 2026Beyond Contact Sensors: Deep learning with Pseudo-Labeling for remote Photoplethysmography9 Sep 2026
- 2026PhysVR: Vision-Language Model Guided Interference-aware Temporal Feature Refinement for Remote Physiological Measurement30 Aug 2026
- 2026Property-Specific Recoverability from Contact PPG to Camera rPPG under Heterogeneous Observation Conditions27 Aug 2026
- 2026EgoHRV: Continuous Heart Rate Variability Estimation from Egocentric Systems for Autonomic Response and Skill Assessment19 Aug 2026
- 2026CanonicalPhys: Pose-Robust Remote Photoplethysmography via Canonical-Space Priors17 Jul 2026
- 2026PhysFlow: Frequency Decoupled with Dual-Field Rectified Flow for Remote Photoplethysmography22 Jun 2026
- 2026StreamPPG: Low-Latency rPPG Estimation via Consistent Privileged Learning22 Jun 2026
38 more
- 2026MS-rPPG: Multi-spectral State Space Model for Remote Photoplethysmography in Driver Monitoring Systems19 Jun 2026
- 2026Fusion-E2Pulse: A Multimodal Event-RGB Fusion Network for Non-contact Pulse Wave Reconstruction14 Jun 2026
- 2026FCUS-rPPG: A Fast-Converging Unsupervised Framework for Remote Photoplethysmography via Gradient Oscillation Suppression2 Jun 2026
- 2026LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement22 May 2026
- 2026Video-based Heart Rate Estimation with Angle-guided ROI Optimization and Graph Signal Denoising13 Apr 2026
- 2026rPPG-VQA: A Video Quality Assessment Framework for Unsupervised rPPG Training13 Apr 2026
- 2026Uncertainty-quantified Pulse Signal Recovery from Facial Video using Regularized Stochastic Interpolants12 Apr 2026
- 2026HOT: Harmonic-Constrained Optimal Transport for Remote Photoplethysmography Domain Adaptation2 Apr 2026
- 2026VideoPulse: Neonatal heart rate and peripheral capillary oxygen saturation (SpO2) estimation from contact free video27 Feb 2026
- 2026Facial Spatiotemporal Graphs: Leveraging the 3D Facial Surface for Remote Physiological Measurement20 Jan 2026
- 2026ToTMNet: FFT-Accelerated Toeplitz Temporal Mixing Network for Lightweight Remote Photoplethysmography7 Jan 2026
- 2025Quality-Aware Framework for Video-Derived Respiratory Signals16 Dec 2025
- 2025FacePhys: State of the Heart Learning6 Dec 2025
- 2025Adaptive Parameter Optimization for Robust Remote Photoplethysmography26 Nov 2025
- 2025Real-Time Mobile Video Analytics for Pre-arrival Emergency Medical Services18 Nov 2025
- 2025M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings4 Nov 2025
- 2025Editing Physiological Signals in Videos Using Latent Representations29 Sep 2025
- 2025Improving Autism Detection with Multimodal Behavioral Analysis19 Sep 2025
- 2025Gaze into the Heart: A Multi-View Video Dataset for rPPG and Health Biomarkers Estimation25 Aug 2025
- 2025PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoring25 Jul 2025
- 2025BeatFormer: Efficient motion-robust remote heart rate estimation through unsupervised spectral zoomed attention filters20 Jul 2025
- 2025Robust and Generalizable Heart Rate Estimation via Deep Learning for Remote Photoplethysmography in Complex Scenarios10 Jul 2025
- 2025Exploring Remote Physiological Signal Measurement under Dynamic Lighting Conditions at Night: Dataset, Experiment, and Analysis6 Jul 2025
- 2025Non-Contact Health Monitoring During Daily Personal Care Routines11 Jun 2025
- 2025Efficient and Robust Multidimensional Attention in Remote Physiological Sensing through Target Signal Constrained Factorization11 May 2025
- 2025Memory-efficient Low-latency Remote Photoplethysmography through Temporal-Spatial State Space Duality2 Apr 2025
- 2025Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models21 Mar 2025
- 2025Generalization of Video-Based Heart Rate Estimation Methods To Low Illumination and Elevated Heart Rates11 Mar 2025
- 2025Passive Heart Rate Monitoring During Smartphone Use in Everyday Life4 Mar 2025
- 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Tasks28 Feb 2025
- 2025Semi-rPPG: Semi-Supervised Remote Physiological Measurement with Curriculum Pseudo-Labeling6 Feb 2025
- 2024FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensing3 Nov 2024
- 2024Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes28 Sep 2024
- 2024PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba18 Sep 2024
- 2024MHAD: Multimodal Home Activity Dataset with Multi-Angle Videos and Synchronized Physiological Signals14 Sep 2024
- 2024GVT2RPM: An Empirical Study for General Video Transformer Adaptation to Remote Physiological Measurement19 Jun 2024
- 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimation14 Apr 2024
- 2024Camera-Based Remote Physiology Sensing for Hundreds of Subjects Across Skin Tones7 Apr 2024
50 newest of 63 All 63 (JSON)
- 2024RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attentioncited by 28
- 2024Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformercited by 19
- 2023BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurementscited by 13
- 2024FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensingcited by 13
- 2023Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurementcited by 11
- 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Taskscited by 11
- 2024How Suboptimal is Training rPPG Models with Videos and Targets from Different Body Sites?cited by 9
- 2024On the Standardization of Behavioral Use Clauses and Their Adoption for Responsible Licensing of AIcited by 7
- 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimationcited by 6
- 2024Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudescited by 6
- 2025PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoringcited by 6
- 2023CalibrationPhys: Self-supervised Video-based Heart and Respiratory Rate Measurements by Calibrating Between Multiple Camerascited by 5
12 most cited of 62 All 62 (JSON)
- 2026FLOW: Feature-Level Optimal Warping for Generalized Remote Physiological Measurement30 Sep 2026
- 2026Pixel-wise Exposure for Highly Robust In-Vehicle Remote-PPG29 Sep 2026
- 2026Heartian: Physiology-Aware Relightable Gaussian Head Avatar22 Sep 2026
- 2026SeetaPsych v1.0: An Open-source Computer Vision Toolkit for Behavior-based Psychological Measurement17 Sep 2026
- 2026Beyond Ambiguous Visual Cues: Studying Physiological Disruptions and Cross-Modal Inconsistencies in Deepfake Videos11 Sep 2026
- 2026Beyond Contact Sensors: Deep learning with Pseudo-Labeling for remote Photoplethysmography9 Sep 2026
- 2026PhysVR: Vision-Language Model Guided Interference-aware Temporal Feature Refinement for Remote Physiological Measurement30 Aug 2026
- 2026Property-Specific Recoverability from Contact PPG to Camera rPPG under Heterogeneous Observation Conditions27 Aug 2026
- 2026EgoHRV: Continuous Heart Rate Variability Estimation from Egocentric Systems for Autonomic Response and Skill Assessment19 Aug 2026
- 2026CanonicalPhys: Pose-Robust Remote Photoplethysmography via Canonical-Space Priors17 Jul 2026
- 2026PhysFlow: Frequency Decoupled with Dual-Field Rectified Flow for Remote Photoplethysmography22 Jun 2026
- 2026StreamPPG: Low-Latency rPPG Estimation via Consistent Privileged Learning22 Jun 2026
12 newest of 62 All 62 (JSON)