mlsanityData to 14 Oct 2026

DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks

arXiv 1805.07888 ↗First posted 21 May 2018cs.CV cs.HCcited by 154

Not on the map. Why?

Abstract (arXiv)

Non-contact video-based physiological measurement has many applications in health care and human-computer interaction. Practical applications require measurements to be accurate even in the presence of large head rotations. We propose the first end-to-end system for video-based measurement of heart and breathing rate using a deep convolutional network. The system features a new motion representation based on a skin reflection model and a new attention mechanism using appearance information to guide motion estimation, both of which enable robust measurement under heterogeneous lighting and major motions. Our approach significantly outperforms all current state-of-the-art methods on both RGB and infrared video datasets. Furthermore, it allows spatial-temporal distributions of physiological signals to be visualized via the attention mechanism.

Key facts. Cited by 154 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 18; 2022: 19; 2023: 24; 2024: 36; 2025: 31; 2026: 26.

154 papers.

Sort:

By area:

  1. 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 120
  2. 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurementcited by 73
  3. 2021The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Videocited by 66
  4. 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 64
  5. 2021Camera Measurement of Physiological Vital Signscited by 49
  6. 2022Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 48
  7. 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformercited by 48
  8. 2021TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detectioncited by 41
  9. 2023Non-Contrastive Unsupervised Learning of Physiological Signals from Videocited by 37
  10. 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
  11. 2023Contrast-Phys+: Unsupervised and Weakly-supervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 34
  12. 2023Neuron Structure Modeling for Generalizable Remote Physiological Measurementcited by 31
38 more
  1. 2024RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attentioncited by 30
  2. 2022SCAMPS: Synthetics for Camera Measurement of Physiological Signalscited by 28
  3. 2022Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videoscited by 26
  4. 2021Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Losscited by 24
  5. 2022Face2PPG: An unsupervised pipeline for blood volume pulse extraction from facescited by 22
  6. 2024GPT as Psychologist? Preliminary Evaluations for GPT-4V on Visual Affective Computingcited by 22
  7. 2024RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurementcited by 20
  8. 2021The First Vision For Vitals (V4V) Challenge for Non-Contact Video-Based Physiological Estimationcited by 19
  9. 2024Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformercited by 19
  10. 2023Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videoscited by 15
  11. 2024PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mambacited by 14
  12. 2024FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensingcited by 14
  13. 2023BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurementscited by 13
  14. 2024Advancing Generalizable Remote Physiological Measurement through the Integration of Explicit and Implicit Prior Knowledgecited by 13
  15. 2022Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Losscited by 12
  16. 2023Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurementcited by 11
  17. 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Taskscited by 11
  18. 2022Depression Recognition using Remote Photoplethysmography from Facial Videoscited by 10
  19. 2024PhysMLE: Generalizable and Priors-Inclusive Multi-task Remote Physiological Measurementcited by 10
  20. 2021Synthetic Data for Multi-Parameter Camera-Based Physiological Sensingcited by 9
  21. 2023Camera-Based HRV Prediction for Remote Learning Environmentscited by 9
  22. 2024How Suboptimal is Training rPPG Models with Videos and Targets from Different Body Sites?cited by 9
  23. 2022TransPPG: Two-stream Transformer for Remote Heart Rate Estimatecited by 8
  24. 2023BeliefPPG: Uncertainty-aware Heart Rate Estimation from PPG signals via Belief Propagationcited by 8
  25. 2025CardiacMamba: A Multimodal RGB-RF Fusion Framework with State Space Models for Remote Physiological Measurementcited by 8
  26. 2022Federated Remote Physiological Measurement with Imperfect Datacited by 7
  27. 2024DeepFace-Attention: Multimodal Face Biometrics for Attention Estimation with Application to e-Learningcited by 7
  28. 2025PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoringcited by 7
  29. 2021Non-contact Pain Recognition from Video Sequences with Remote Physiological Measurements Predictioncited by 6
  30. 2021Assessment of Deep Learning-based Heart Rate Estimation using Remote Photoplethysmography under Different Illuminationscited by 6
  31. 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimationcited by 6
  32. 2024Bi-TTA: Bidirectional Test-Time Adapter for Remote Physiological Measurementcited by 6
  33. 2025Remote Photoplethysmography in Real-World and Extreme Lighting Scenarioscited by 6
  34. 2021Non-contact PPG Signal and Heart Rate Estimation with Multi-hierarchical Convolutional Networkcited by 5
  35. 2021Remote Blood Oxygen Estimation From Videos Using Neural Networkscited by 5
  36. 2022Instantaneous Physiological Estimation using Video Transformerscited by 5
  37. 2023Full-Body Cardiovascular Sensing with Remote Photoplethysmographycited by 5
  38. 2023CalibrationPhys: Self-supervised Video-based Heart and Respiratory Rate Measurements by Calibrating Between Multiple Camerascited by 5

50 most cited of 154 All 154 (JSON)