mlsanityData to 7 Oct 2026

Heartian: Physiology-Aware Relightable Gaussian Head Avatar

arXiv 2609.28539 ↗First posted 22 Sep 2026cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Gaussian head avatars typically model intrinsic facial appearance as temporally static, omitting subtle cardiac-induced skin-color variation. We propose Heartian, a physiology-aware modulation framework that learns cardiac-cycle-dependent per-frame albedo modulation of facial skin-region Gaussians within a relightable head avatar to encode remote photoplethysmography (rPPG) signals. Using synchronized contact PPG supervision, Heartian models the prescribed cardiac waveform as the sum of two Gaussian functions and learns per-frame spatial residuals via a lightweight MLP. Across 152 stationary recordings from UBFC-rPPG, PURE, and MMPD, attribute-space recovery of the supplied signal achieves a pooled recording-level heart-rate MAE of 0.29 bpm and MAPE of 0.38%. The signals remain detectable after rendering by benchmark rPPG methods, with the best tested configuration - a motion-augmented TS-CAN decoder pretrained on UBFC-rPPG - recovering heart rate from the rendered MMPD avatars at 0.97 bpm MAE and 1.21% MAPE. Meanwhile, Heartian maintains reconstruction quality comparable to the baseline, with negligible average PSNR degradation of 0.005 dB. Overall, our work embeds recoverable rPPG signals as controllable material attributes to subject-specific Gaussian head avatars while retaining the reconstruction quality.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 16 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

9 of 16 references.

References · 9

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2020Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurementcited by 133
  3. 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
  4. 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 63
  5. 2023MMPD: Multi-Domain Mobile Video Physiology Datasetcited by 55
  6. 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 24
  7. 2024FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensingcited by 13
  8. 2023Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurementcited by 11
  9. 2021"Warm Bodies": A Post-Processing Technique for Animating Dynamic Blood Flow on Photos and Avatarscited by 2

Built on by

Not cited yet.