mlsanityData to 7 Oct 2026

Depth-Guided Metric-Aware Temporal Consistency for Monocular Video Human Mesh Recovery

arXiv 2602.04257 ↗First posted 4 Feb 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Monocular video human mesh recovery faces fundamental challenges in maintaining metric consistency and temporal stability due to inherent depth ambiguities and scale uncertainties. While existing methods rely primarily on RGB features and temporal smoothing, they struggle with depth ordering, scale drift, and occlusion-induced instabilities. We propose a comprehensive depth-guided framework that achieves metric-aware temporal consistency through three synergistic components: A Depth-Guided Multi-Scale Fusion module that adaptively integrates geometric priors with RGB features via confidence-aware gating; A Depth-guided Metric-Aware Pose and Shape (D-MAPS) estimator that leverages depth-calibrated bone statistics for scale-consistent initialization; A Motion-Depth Aligned Refinement (MoDAR) module that enforces temporal coherence through cross-modal attention between motion dynamics and geometric cues. Our method achieves superior results on three challenging benchmarks, demonstrating significant improvements in robustness against heavy occlusion and spatial accuracy while maintaining computational efficiency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 19 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

17 of 19 references.

References · 17

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2017Squeeze-and-Excitation Networkscited by 4,763
  3. 2021Vision Transformers for Dense Predictioncited by 1,789
  4. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  5. 2017End-to-end Recovery of Human Shape and Posecited by 883
  6. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  7. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
  8. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
  9. 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
  10. 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
  11. 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
  12. 2016Single-Image Depth Perception in the Wildcited by 179
5 more
  1. 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 162
  2. 2021Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimationcited by 62
  3. 2023Global-to-Local Modeling for Video-based 3D Human Pose and Shape Estimationcited by 46
  4. 2023Co-Evolution of Pose and Mesh for 3D Human Body Estimation from Videocited by 25
  5. 2024ARTS: Semi-Analytical Regressor using Disentangled Skeletal Representations for Human Mesh Recovery from Videoscited by 4

Built on by

Not cited yet.