mlsanityData to 7 Oct 2026

Intervention-Based Self-Supervised Learning: A Causal Probe Paradigm for Remote Photoplethysmography

arXiv 2605.00882 ↗First posted 26 Apr 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Remote Photoplethysmography (rPPG) enables convenient non-contact physiological measurement. Existing Self-Supervised Learning (SSL) methods commonly fall into a correlation trap: they tend to learn the most dominant periodic signals in the data, such as high-energy motion or illumination noise, rather than the faint, true rPPG signal, leading to poor model generalization. To address this, we propose a new SSL paradigm, Physiological Causal Probing (PCP), which treats the latent rPPG signal as the underlying physical source and the resulting pixel chrominance variations as its visual manifestation. Its core idea is to shift from passive correlation learning to active, precise intervention: it intervenes on the video based on a proposed rPPG hypothesis, and verifies whether the post-intervention changes match physical expectations. We propose the Interv-rPPG framework to implement PCP: an rPPG extractor named PhysMambaFormer hypothesizes the rPPG signal, while a Controllable Physiological Signal Editor conducts precise chrominance-domain interventions on videos based on this hypothesis. Interv-rPPG validates the physical realism of the hypothesis through `Falsifiability via Nulling' and `Axiomatic Equivariance'. Our editor achieves precise editing of the rPPG signal by intervening in the low-frequency chrominance components of the video. Our method improves both in-domain and cross-domain performance on challenging datasets such as VIPL-HR and MMPD. Furthermore, it surpasses the supervised baseline in complex cross-dataset settings, while remaining competitive on clean datasets where the intervention mechanism may introduce slight residual chrominance noise. Extensive experiments, including diagnostic analysis of nuisance sensitivity, demonstrate that the PCP paradigm effectively resists motion and illumination artifacts.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 68 references that are in the map. First posted on arXiv 26 Apr 2026.

Builds on

32 of 68 references.

References · 32

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  7. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
  8. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  9. 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
  10. 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 133
  11. 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 126
  12. 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
20 more
  1. 2019RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representationcited by 104
  2. 2019Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancementcited by 86
  3. 2021The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Videocited by 66
  4. 2020PulseGAN: Learning to generate realistic pulse waveforms in remote photoplethysmographycited by 59
  5. 2018VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Videocited by 57
  6. 2023MMPD: Multi-Domain Mobile Video Physiology Datasetcited by 55
  7. 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformercited by 46
  8. 2020AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searchingcited by 39
  9. 2023Non-Contrastive Unsupervised Learning of Physiological Signals from Videocited by 37
  10. 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
  11. 2023Contrast-Phys+: Unsupervised and Weakly-supervised Video-based Remote Physiological Measurement via Spatiotemporal Contrastcited by 33
  12. 2021Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Losscited by 23
  13. 2024PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mambacited by 14
  14. 2025PHASE-Net: Physics-Grounded Harmonic Attention System for Efficient Remote Photoplethysmography Measurementcited by 10
  15. 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulationcited by 7
  16. 2024SFDA-rPPG: Source-Free Domain Adaptive Remote Physiological Measurement with Spatio-Temporal Consistencycited by 4
  17. 2025Semi-rPPG: Semi-Supervised Remote Physiological Measurement with Curriculum Pseudo-Labelingcited by 3
  18. 2024SiNC+: Adaptive Camera-Based Vitals with Unsupervised Learning of Periodic Signalscited by 2
  19. 2022Hiding Your Signals: A Security Analysis of PPG-based Biometric Authenticationcited by 1
  20. 2025Editing Physiological Signals in Videos Using Latent Representationscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.