mlsanityData to 7 Oct 2026

Camera Measurement of Physiological Vital Signs

arXiv 2111.11547 ↗First posted 22 Nov 2021cs.CV cs.LG eess.IVcited by 49

Not on the map. Why?

Abstract (arXiv)

The need for remote tools for healthcare monitoring has never been more apparent. Camera measurement of vital signs leverages imaging devices to compute physiological changes by analyzing images of the human body. Building on advances in optics, machine learning, computer vision and medicine these techniques have progressed significantly since the invention of digital cameras. This paper presents a comprehensive survey of camera measurement of physiological vital signs, describing they vital signs that can be measured and the computational techniques for doing so. I cover both clinical and non-clinical applications and the challenges that need to be overcome for these applications to advance from proofs-of-concept. Finally, I describe the current resources (datasets and code) available to the research community and provide a comprehensive webpage (https://cameravitals.github.io/) with links to these resource and a categorized list of all the papers referenced in this article.

Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). Builds on 30 of its 187 references that are in the map. First posted on arXiv 22 Nov 2021.

Builds on

30 of 187 references.

References · 30

  1. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  2. 2018Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervisioncited by 167
  3. 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
  4. 2019Single Image Portrait Relightingcited by 152
  5. 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 143
  6. 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 133
  7. 2019Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancementcited by 86
  8. 2020Video-based Remote Physiological Measurement via Cross-verified Feature Disentanglingcited by 78
  9. 2021The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Videocited by 66
  10. 2020DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythmscited by 65
  11. 2020PulseGAN: Learning to generate realistic pulse waveforms in remote photoplethysmographycited by 59
  12. 2020Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learnercited by 58
18 more
  1. 2018VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Videocited by 57
  2. 2017A Reproducible Study on Remote Heart Rate Measurementcited by 49
  3. 2018Learning-based Video Motion Magnificationcited by 43
  4. 2019Characterizing Bias in Classifiers using Generative Modelscited by 23
  5. 2021The First Vision For Vitals (V4V) Challenge for Non-Contact Video-Based Physiological Estimationcited by 19
  6. 2017Video Acceleration Magnificationcited by 16
  7. 2020Advancing Non-Contact Vital Sign Measurement using Synthetic Avatarscited by 15
  8. 2020Real-time Webcam Heart-Rate and Variability Estimation with Clean Ground Truth for Evaluationcited by 11
  9. 2021Synthetic Data for Multi-Parameter Camera-Based Physiological Sensingcited by 9
  10. 2019iPhys: An Open Non-Contact Imaging-Based Physiological Measurement Toolboxcited by 8
  11. 2016Can we still avoid automatic face detection?cited by 7
  12. 2021Overcoming Difficulty in Obtaining Dark-skinned Subjects for Remote-PPG by Synthetic Augmentationcited by 6
  13. 2020Diverse R-PPG: Camera-Based Heart Rate Estimation for Diverse Subject Skin-Tones and Scenescited by 5
  14. 2016Making a Case for Learning Motion Representations with Phasecited by 3
  15. 2019On the Vector Space in Photoplethysmography Imagingcited by 3
  16. 2020Multispectral Video Fusion for Non-contact Monitoring of Respiratory Rate and Apneacited by 3
  17. 2021Learning Higher-Order Dynamics in Video-Based Cardiac Measurementcited by 2
  18. 2016Non-contact hemodynamic imaging reveals the jugular venous pulse waveformcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 9; 2024: 17; 2025: 9; 2026: 9.

49 papers.

Sort:

  1. 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 63
  2. 2023MMPD: Multi-Domain Mobile Video Physiology Datasetcited by 55
  3. 2023Non-Contrastive Unsupervised Learning of Physiological Signals from Videocited by 37
  4. 2023Neuron Structure Modeling for Generalizable Remote Physiological Measurementcited by 29
  5. 2022SCAMPS: Synthetics for Camera Measurement of Physiological Signalscited by 28
  6. 2024RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attentioncited by 28
  7. 2022Facial Video-based Remote Physiological Measurement via Self-supervised Learningcited by 22
  8. 2024RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurementcited by 20
  9. 2024Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformercited by 19
  10. 2023BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurementscited by 13
  11. 2023Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurementcited by 11
  12. 2024How Suboptimal is Training rPPG Models with Videos and Targets from Different Body Sites?cited by 9
37 more
  1. 2023Synthetic Data in Healthcarecited by 8
  2. 2022Federated Remote Physiological Measurement with Imperfect Datacited by 7
  3. 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimationcited by 6
  4. 2024Bi-TTA: Bidirectional Test-Time Adapter for Remote Physiological Measurementcited by 6
  5. 2024Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudescited by 6
  6. 2024SympCam: Remote Optical Measurement of Sympathetic Arousalcited by 5
  7. 2024MSPM: A Multi-Site Physiological Monitoring Dataset for Remote Pulse, Respiration, and Blood Pressure Estimationcited by 4
  8. 2024SleepVST: Sleep Staging from Near-Infrared Video Signals using Pre-Trained Transformerscited by 4
  9. 2024Camera-Based Remote Physiology Sensing for Hundreds of Subjects Across Skin Tonescited by 4
  10. 2024Resolve Domain Conflicts for Generalizable Remote Physiological Measurementcited by 4
  11. 2023VitalVideos-Europe: A dataset of face videos with PPG and blood pressure ground truthscited by 3
  12. 2024Toward Motion Robustness: A masked attention regularization framework in remote photoplethysmographycited by 3
  13. 2025Non-Contact Health Monitoring During Daily Personal Care Routinescited by 3
  14. 2024SiNC+: Adaptive Camera-Based Vitals with Unsupervised Learning of Periodic Signalscited by 2
  15. 2024Continual Learning for Remote Physiological Measurement: Minimize Forgetting and Simplify Inferencecited by 2
  16. 2025Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Modelscited by 2
  17. 2025Memory-efficient Low-latency Remote Photoplethysmography through Temporal-Spatial State Space Dualitycited by 2
  18. 2023Hallucinated Heartbeats: Anomaly-Aware Remote Pulse Estimationcited by 1
  19. 2025Editing Physiological Signals in Videos Using Latent Representationscited by 1
  20. 2026ToTMNet: FFT-Accelerated Toeplitz Temporal Mixing Network for Lightweight Remote Photoplethysmographycited by 1
  21. 2026rPPG-VQA: A Video Quality Assessment Framework for Unsupervised rPPG Trainingcited by 1
  22. 2022On Developing Facial Stress Analysis and Expression Recognition Platformcited by 0
  23. 2023Training Robust Deep Physiological Measurement Models with Synthetic Video-based Datacited by 0
  24. 2024An AI-Enabled Framework Within Reach for Enhancing Healthcare Sustainability and Fairnesscited by 0
  25. 2024Bootstrapping Vision-language Models for Self-supervised Remote Physiological Measurementcited by 0
  26. 2025Estimating Blood Pressure with a Camera: An Exploratory Study of Ambulatory Patients with Cardiovascular Diseasecited by 0
  27. 2025Exploring Remote Physiological Signal Measurement under Dynamic Lighting Conditions at Night: Dataset, Experiment, and Analysiscited by 0
  28. 2025Adaptive Parameter Optimization for Robust Remote Photoplethysmographycited by 0
  29. 2025FacePhys: State of the Heart Learningcited by 0
  30. 20253D Blood Pulsation Mapscited by 0
  31. 2026Uncertainty-quantified Pulse Signal Recovery from Facial Video using Regularized Stochastic Interpolantscited by 0
  32. 2026FCUS-rPPG: A Fast-Converging Unsupervised Framework for Remote Photoplethysmography via Gradient Oscillation Suppressioncited by 0
  33. 2026Fusion-E2Pulse: A Multimodal Event-RGB Fusion Network for Non-contact Pulse Wave Reconstructioncited by 0
  34. 2026CanonicalPhys: Pose-Robust Remote Photoplethysmography via Canonical-Space Priorscited by 0
  35. 2026How Far Do Foundation Models Transfer to Infant Signals? A Cross-Dataset Transfer Audit with a Unified Need Ontologycited by 0
  36. 2026PhysVR: Vision-Language Model Guided Interference-aware Temporal Feature Refinement for Remote Physiological Measurementcited by 0
  37. 2026Subject-Relative Micro-Motion and Sleep Dynamics for Near-Infrared Video Sleep Stagingcited by 0