AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching
Not on the map. Why?
Abstract (arXiv)
Remote photoplethysmography (rPPG), which aims at measuring heart activities without any contact, has great potential in many applications (e.g., remote healthcare). Existing end-to-end rPPG and heart rate (HR) measurement methods from facial videos are vulnerable to the less-constrained scenarios (e.g., with head movement and bad illumination). In this letter, we explore the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong end-to-end baseline (AutoHR) for remote HR measurement with neural architecture search (NAS). The proposed method includes three parts: 1) a powerful searched backbone with novel Temporal Difference Convolution (TDC), intending to capture intrinsic rPPG-aware clues between frames; 2) a hybrid loss function considering constraints from both time and frequency domains; and 3) spatio-temporal data augmentation strategies for better representation learning. Comprehensive experiments are performed on three benchmark datasets to show our superior performance on both intra- and cross-dataset testing.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 4; 2024: 13; 2025: 5; 2026: 5.
39 papers.
Sort:
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 120
- 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformercited by 48
- 2021TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detectioncited by 41
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
- 2024RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attentioncited by 30
- 2022Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videoscited by 26
- 2021Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Losscited by 24
- 2022Face2PPG: An unsupervised pipeline for blood volume pulse extraction from facescited by 22
- 2024RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurementcited by 20
- 2024Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformercited by 19
- 2023Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videoscited by 15
- 2022Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Losscited by 12
27 more
- 2022TransPPG: Two-stream Transformer for Remote Heart Rate Estimatecited by 8
- 2021A Central Difference Graph Convolutional Operator for Skeleton-Based Action Recognitioncited by 6
- 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimationcited by 6
- 2021Non-contact PPG Signal and Heart Rate Estimation with Multi-hierarchical Convolutional Networkcited by 5
- 2024SFDA-rPPG: Source-Free Domain Adaptive Remote Physiological Measurement with Spatio-Temporal Consistencycited by 4
- 2024PhySU-Net: Long Temporal Context Transformer for rPPG with Self-Supervised Pre-trainingcited by 3
- 2024Toward Motion Robustness: A masked attention regularization framework in remote photoplethysmographycited by 3
- 2024DD-rPPGNet: De-interfering and Descriptive Feature Learning for Unsupervised rPPG Estimationcited by 3
- 2025Reperio-rPPG: Relational Temporal Graph Neural Networks for Periodicity Learning in Remote Physiological Measurementcited by 3
- 2024Phase-shifted remote photoplethysmography for estimating heart rate and blood pressure from facial videocited by 2
- 2024Evaluation of Video-Based rPPG in Challenging Environments: Artifact Mitigation and Network Resiliencecited by 2
- 2024PhysMamba: State Space Duality Model for Remote Physiological Measurementcited by 2
- 2024UbiHR: Resource-efficient Long-range Heart Rate Sensing on Ubiquitous Devicescited by 2
- 2025Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Modelscited by 2
- 2026MVRD-Bench: Multi-View Learning and Benchmarking for Dynamic Remote Photoplethysmography under Occlusioncited by 2
- 2022DRNet: Decomposition and Reconstruction Network for Remote Physiological Measurementcited by 1
- 2022BYHE: A Simple Framework for Boosting End-to-end Video-based Heart Rate Measurement Networkcited by 1
- 2025Periodic-MAE: Periodic Video Masked Autoencoder for rPPG Estimationcited by 1
- 2025SkinMap: Weighted Full-Body Skin Segmentation for Robust Remote Photoplethysmographycited by 1
- 2026Intervention-Based Self-Supervised Learning: A Causal Probe Paradigm for Remote Photoplethysmographycited by 1
- 2022FastBVP-Net: a lightweight pulse extraction network for measuring heart rhythm via facial videoscited by 0
- 2023Training Robust Deep Physiological Measurement Models with Synthetic Video-based Datacited by 0
- 2024rFaceNet: An End-to-End Network for Enhanced Physiological Signal Extraction through Identity-Specific Facial Contourscited by 0
- 2025Ultra-Short rPPG Estimation via Periodicity Guidance and Signal Reconstructioncited by 0
- 2026VideoPulse: Neonatal heart rate and peripheral capillary oxygen saturation (SpO2) estimation from contact free videocited by 0
- 2026LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurementcited by 0
- 2026Illumination-Robust Camera-Based Heart-Rate Estimation for Physiological Sensing in Robotscited by 0
- 2026Illumination-Robust Camera-Based Heart-Rate Estimation for Physiological Sensing in Robots10 Jun 2026
- 2026LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement22 May 2026
- 2026Intervention-Based Self-Supervised Learning: A Causal Probe Paradigm for Remote Photoplethysmography26 Apr 2026
- 2026MVRD-Bench: Multi-View Learning and Benchmarking for Dynamic Remote Photoplethysmography under Occlusion24 Mar 2026
- 2026VideoPulse: Neonatal heart rate and peripheral capillary oxygen saturation (SpO2) estimation from contact free video27 Feb 2026
- 2025Reperio-rPPG: Relational Temporal Graph Neural Networks for Periodicity Learning in Remote Physiological Measurement8 Nov 2025
- 2025SkinMap: Weighted Full-Body Skin Segmentation for Robust Remote Photoplethysmography6 Oct 2025
- 2025Ultra-Short rPPG Estimation via Periodicity Guidance and Signal Reconstruction27 Jun 2025
- 2025Periodic-MAE: Periodic Video Masked Autoencoder for rPPG Estimation27 Jun 2025
- 2025Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models21 Mar 2025
- 2024UbiHR: Resource-efficient Long-range Heart Rate Sensing on Ubiquitous Devices25 Oct 2024
- 2024SFDA-rPPG: Source-Free Domain Adaptive Remote Physiological Measurement with Spatio-Temporal Consistency18 Sep 2024
27 more
- 2024PhysMamba: State Space Duality Model for Remote Physiological Measurement2 Aug 2024
- 2024DD-rPPGNet: De-interfering and Descriptive Feature Learning for Unsupervised rPPG Estimation31 Jul 2024
- 2024Toward Motion Robustness: A masked attention regularization framework in remote photoplethysmography9 Jul 2024
- 2024Evaluation of Video-Based rPPG in Challenging Environments: Artifact Mitigation and Network Resilience2 May 2024
- 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimation14 Apr 2024
- 2024RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurement9 Apr 2024
- 2024rFaceNet: An End-to-End Network for Enhanced Physiological Signal Extraction through Identity-Specific Facial Contours14 Mar 2024
- 2024RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attention20 Feb 2024
- 2024PhySU-Net: Long Temporal Context Transformer for rPPG with Self-Supervised Pre-training19 Feb 2024
- 2024Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformer7 Feb 2024
- 2024Phase-shifted remote photoplethysmography for estimating heart rate and blood pressure from facial video9 Jan 2024
- 2023Training Robust Deep Physiological Measurement Models with Synthetic Video-based Data9 Nov 2023
- 2023Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videos15 Aug 2023
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurement4 Jun 2023
- 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformer7 Feb 2023
- 2022Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videos30 Nov 2022
- 2022BYHE: A Simple Framework for Boosting End-to-end Video-based Heart Rate Measurement Network4 Jul 2022
- 2022FastBVP-Net: a lightweight pulse extraction network for measuring heart rhythm via facial videos25 Jun 2022
- 2022DRNet: Decomposition and Reconstruction Network for Remote Physiological Measurement12 Jun 2022
- 2022Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Loss21 Mar 2022
- 2022Face2PPG: An unsupervised pipeline for blood volume pulse extraction from faces8 Feb 2022
- 2022TransPPG: Two-stream Transformer for Remote Heart Rate Estimate26 Jan 2022
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer23 Nov 2021
- 2021A Central Difference Graph Convolutional Operator for Skeleton-Based Action Recognition13 Nov 2021
- 2021Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Loss16 Jul 2021
- 2021TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detection15 Apr 2021
- 2021Non-contact PPG Signal and Heart Rate Estimation with Multi-hierarchical Convolutional Network6 Apr 2021
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 120
- 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformercited by 48
- 2021TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detectioncited by 41
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
- 2024RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attentioncited by 30
- 2022Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videoscited by 26
- 2021Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Losscited by 24
- 2022Face2PPG: An unsupervised pipeline for blood volume pulse extraction from facescited by 22
- 2024RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurementcited by 20
- 2024Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformercited by 19
- 2023Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videoscited by 15
- 2022Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Losscited by 12
12 most cited of 39 All 39 (JSON)
- 2026Illumination-Robust Camera-Based Heart-Rate Estimation for Physiological Sensing in Robots10 Jun 2026
- 2026LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement22 May 2026
- 2026Intervention-Based Self-Supervised Learning: A Causal Probe Paradigm for Remote Photoplethysmography26 Apr 2026
- 2026MVRD-Bench: Multi-View Learning and Benchmarking for Dynamic Remote Photoplethysmography under Occlusion24 Mar 2026
- 2026VideoPulse: Neonatal heart rate and peripheral capillary oxygen saturation (SpO2) estimation from contact free video27 Feb 2026
- 2025Reperio-rPPG: Relational Temporal Graph Neural Networks for Periodicity Learning in Remote Physiological Measurement8 Nov 2025
- 2025SkinMap: Weighted Full-Body Skin Segmentation for Robust Remote Photoplethysmography6 Oct 2025
- 2025Ultra-Short rPPG Estimation via Periodicity Guidance and Signal Reconstruction27 Jun 2025
- 2025Periodic-MAE: Periodic Video Masked Autoencoder for rPPG Estimation27 Jun 2025
- 2025Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models21 Mar 2025
- 2024UbiHR: Resource-efficient Long-range Heart Rate Sensing on Ubiquitous Devices25 Oct 2024
- 2024SFDA-rPPG: Source-Free Domain Adaptive Remote Physiological Measurement with Spatio-Temporal Consistency18 Sep 2024
12 newest of 39 All 39 (JSON)