mlsanityData to 14 Oct 2026

CardiacMamba: Fair and Robust RGB-RF Fusion for Remote Heart Rate Estimation via State Space Modeling

arXiv 2608.15831 ↗First posted 16 Aug 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Remote photoplethysmography (rPPG) enables non-contact heart rate (HR) monitoring from facial videos, but RGB-only methods are vulnerable to illumination changes, motion artifacts, and skin-tone-dependent optical reflectance. We propose CardiacMamba, a fair and robust RGB-RF fusion framework that integrates optical facial cues and radio-frequency cardiac motion cues through state space modeling. CardiacMamba introduces a Temporal Difference Mamba Module (TDMM) to enhance subtle RF temporal variations, a bidirectional SSM-based interaction mechanism to align heterogeneous RGB-RF dynamics, and a Channel-wise Fast Fourier Transform (CFFT) module for channel-domain spectral refinement. On the EquiPleth dataset, CardiacMamba achieves state-of-the-art performance with 0.96 bpm MAE, 3.06 bpm RMSE, and 0.97 Pearson correlation, while reducing the observed light-dark skin-tone MAE gap to 0.26 bpm and maintaining robustness under RGB degradation and RF-missing conditions

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 16 Aug 2026.

Builds on

21 of 35 references.

References · 21

  1. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  2. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  3. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  4. 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 154
  5. 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 134
  6. 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 128
  7. 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 120
  8. 2020NAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofingcited by 105
  9. 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurementcited by 73
  10. 2021Deep Learning for Face Anti-Spoofing: A Surveycited by 65
  11. 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformercited by 48
  12. 2023Rethinking Vision Transformer and Masked Autoencoder in Multimodal Face Anti-Spoofingcited by 19
9 more
  1. 2025PhysLLM: Harnessing Large Language Models for Cross-Modal Remote Physiological Sensingcited by 14
  2. 2025PHASE-Net: Physics-Grounded Harmonic Attention System for Efficient Remote Photoplethysmography Measurementcited by 10
  3. 2025AU-LLM: Micro-Expression Action Unit Detection via Enhanced LLM-Based Feature Fusioncited by 7
  4. 2026AffectAgent: Collaborative Multi-Agent Reasoning for Retrieval-Augmented Multimodal Emotion Recognitioncited by 6
  5. 2026AULLM++: Structured-Token-Conditioned Large Language Models for Micro-Expression Action Unit Detectioncited by 4
  6. 2026AffectVerse: Emotional World Models for Multimodal Affective Computingcited by 3
  7. 2026PhysNeXt: Next-Generation Dual-Branch Structured Attention Fusion Network for Remote Photoplethysmography Measurementcited by 2
  8. 2026Intervention-Based Self-Supervised Learning: A Causal Probe Paradigm for Remote Photoplethysmographycited by 1
  9. 2026PhysAgent: A Multi-Agent Framework for Reliable Remote Heart Rate Estimationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025CardiacMamba: A Multimodal RGB-RF Fusion Framework with State Space Models for Remote Physiological Measurement
  2. 2024RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurement
  3. 2024PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba
  4. 2024PhysMamba: State Space Duality Model for Remote Physiological Measurement
  5. 2026Rhythm-Structured Predictive Learning for Remote Photoplethysmography
  6. 2026CanonicalPhys: Pose-Robust Remote Photoplethysmography via Canonical-Space Priors
  7. 2026MS-rPPG: Multi-spectral State Space Model for Remote Photoplethysmography in Driver Monitoring Systems
  8. 2025TYrPPG: Uncomplicated and Enhanced Learning Capability rPPG for Remote Heart Rate Estimation