PhysVR: Vision-Language Model Guided Interference-aware Temporal Feature Refinement for Remote Physiological Measurement
Not on the map. Why?
Abstract (arXiv)
Remote photoplethysmography (rPPG) enables contactless physiological measurement from facial videos, yet its subtle pulse-related variations are easily affected by illumination variation, head motion, facial blur, and region-of-interest instability. Existing methods mainly suppress interference during feature learning, while whether the learned temporal features remain affected by interference and how to further suppress such interference before rPPG estimation are rarely examined. To address this limitation, we propose PhysVR, a vision-language model guided interference-aware temporal feature refinement framework for rPPG estimation. Specifically, a physiological backbone produces global temporal features and a coarse rPPG prediction, from which signal-derived physiological reliability evidence is constructed from local temporal characteristics. In parallel, a frozen vision-language model processes sampled facial frames under an interference-oriented prompt, and an evidence head extracts visual interference evidence from the VLM output. Temporal cross-attention integrates the physiological and visual evidence with the global temporal features to construct interference-aware temporal context. Guided by this context, a shared temporal correction unit performs general refinement, while four interference-specific experts selectively suppress different interference through adaptive routing. The refined temporal features are then used for final rPPG estimation. Extensive experiments on five public benchmarks demonstrate that PhysVR consistently outperforms representative methods under both intra-dataset and cross-dataset evaluation protocols.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 49 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
35 of 49 references.
References · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2025DINOv3cited by 1,414
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 237
- 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 154
- 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 134
- 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 128
23 more
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 120
- 2019RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representationcited by 105
- 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurementcited by 73
- 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 64
- 2020PulseGAN: Learning to generate realistic pulse waveforms in remote photoplethysmographycited by 60
- 2018VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Videocited by 58
- 2023MMPD: Multi-Domain Mobile Video Physiology Datasetcited by 57
- 2021Camera Measurement of Physiological Vital Signscited by 49
- 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformercited by 48
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
- 2023Neuron Structure Modeling for Generalizable Remote Physiological Measurementcited by 31
- 2024RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attentioncited by 30
- 2022Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videoscited by 26
- 2023Image Enhancement for Remote Photoplethysmography in a Low-Light Environmentcited by 23
- 2024RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurementcited by 20
- 2025PhysLLM: Harnessing Large Language Models for Cross-Modal Remote Physiological Sensingcited by 14
- 2022Depression Recognition using Remote Photoplethysmography from Facial Videoscited by 10
- 2025PHASE-Net: Physics-Grounded Harmonic Attention System for Efficient Remote Photoplethysmography Measurementcited by 10
- 2025Remote Photoplethysmography in Real-World and Extreme Lighting Scenarioscited by 6
- 2023Self-similarity Prior Distillation for Unsupervised Remote Physiological Measurementcited by 5
- 2024Continual Learning for Remote Physiological Measurement: Minimize Forgetting and Simplify Inferencecited by 2
- 2026rPPG-VQA: A Video Quality Assessment Framework for Unsupervised rPPG Trainingcited by 1
- 2026PhysFlow: Frequency Decoupled with Dual-Field Rectified Flow for Remote Photoplethysmographycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024PhysMamba: State Space Duality Model for Remote Physiological Measurement
- 2026Rhythm-Structured Predictive Learning for Remote Photoplethysmography
- 2024PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba
- 2026LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement
- 2024Bootstrapping Vision-language Models for Self-supervised Remote Physiological Measurement
- 2026Why Do VLMs Fail at Remote Physiological Measurement? Rethinking with Physiological Grounding and Numerical Alignment
- 2026CanonicalPhys: Pose-Robust Remote Photoplethysmography via Canonical-Space Priors
- 2026PhysAgent: A Multi-Agent Framework for Reliable Remote Heart Rate Estimation