mlsanityData to 7 Oct 2026

Deep adaptative spectral zoom for improved remote heart rate estimation

arXiv 2403.06902 ↗First posted 11 Mar 2024cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Recent advances in remote heart rate measurement, motivated by data-driven approaches, have notably enhanced accuracy. However, these improvements primarily focus on recovering the rPPG signal, overlooking the implicit challenges of estimating the heart rate (HR) from the derived signal. While many methods employ the Fast Fourier Transform (FFT) for HR estimation, the performance of the FFT is inherently affected by a limited frequency resolution. In contrast, the Chirp-Z Transform (CZT), a generalization form of FFT, can refine the spectrum to the narrow-band range of interest for heart rate, providing improved frequential resolution and, consequently, more accurate estimation. This paper presents the advantages of employing the CZT for remote HR estimation and introduces a novel data-driven adaptive CZT estimator. The objective of our proposed model is to tailor the CZT to match the characteristics of each specific dataset sensor, facilitating a more optimal and accurate estimation of HR from the rPPG signal without compromising generalization across diverse datasets. This is achieved through a Sparse Matrix Optimization (SMO). We validate the effectiveness of our model through exhaustive evaluations on three publicly available datasets UCLA-rPPG, PURE, and UBFC-rPPG employing both intra- and cross-database performance metrics. The results reveal outstanding heart rate estimation capabilities, establishing the proposed approach as a robust and versatile estimator for any rPPG method.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 60 references that are in the map. First posted on arXiv 11 Mar 2024.

Builds on

20 of 60 references.

References · 20

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  4. 2021FNet: Mixing Tokens with Fourier Transformscited by 343
  5. 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
  6. 2019Rank consistent ordinal regression for neural networks with application to age estimationcited by 132
  7. 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 126
  8. 2019RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representationcited by 104
  9. 2019Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancementcited by 86
  10. 2019Real-time Facial Surface Geometry from Monocular Video on Mobile GPUscited by 72
  11. 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurementcited by 71
  12. 2020PulseGAN: Learning to generate realistic pulse waveforms in remote photoplethysmographycited by 59
8 more
  1. 2020Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learnercited by 58
  2. 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformercited by 46
  3. 2019Utilizing Deep Learning Towards Multi-modal Bio-sensing and Vision-based Affective Computingcited by 22
  4. 2021The First Vision For Vitals (V4V) Challenge for Non-Contact Video-Based Physiological Estimationcited by 19
  5. 2022Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Losscited by 12
  6. 2020Real-time Webcam Heart-Rate and Variability Estimation with Clean Ground Truth for Evaluationcited by 11
  7. 2021Non-contact PPG Signal and Heart Rate Estimation with Multi-hierarchical Convolutional Networkcited by 5
  8. 2019End-to-end facial and physiological model for Affective Computing and applicationscited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.