Towards Geometry-Aware and Motion-Guided Video Human Mesh Recovery
On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models
Abstract (arXiv)
Existing video-based 3D Human Mesh Recovery (HMR) methods often produce physically implausible results, stemming from their reliance on flawed intermediate 3D pose anchors and their inability to effectively model complex spatiotemporal dynamics. To overcome these deep-rooted architectural problems, we introduce HMRMamba, a new paradigm for HMR that pioneers the use of Structured State Space Models (SSMs) for their efficiency and long-range modeling prowess. Our framework is distinguished by two core contributions. First, the Geometry-Aware Lifting Module, featuring a novel dual-scan Mamba architecture, creates a robust foundation for reconstruction. It directly grounds the 2D-to-3D pose lifting process with geometric cues from image features, producing a highly reliable 3D pose sequence that serves as a stable anchor. Second, the Motion-guided Reconstruction Network leverages this anchor to explicitly process kinematic patterns over time. By injecting this crucial temporal awareness, it significantly enhances the final mesh's coherence and robustness, particularly under occlusion and motion blur. Comprehensive evaluations on 3DPW, MPI-INF-3DHP, and Human3.6M benchmarks confirm that HMRMamba sets a new state-of-the-art, outperforming existing methods in both reconstruction accuracy and temporal consistency while offering superior computational efficiency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 37 of its 51 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
37 of 51 references.
Closest ancestors · 3
Same direction, newest first
- 2024Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network6 Aug
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba12 Jul
- 2024Motion Mamba: Efficient and Long Sequence Motion Generation12 Mar
Other references · 34
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
- 2024VMamba: Visual State Space Modelcited by 955
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
- 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2018Learning 3D Human Dynamics from Videocited by 315
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
22 more
- 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 235
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 162
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 20203D Human Motion Estimation via Motion Compression and Refinementcited by 98
- 2019Human Mesh Recovery from Monocular Images via a Skeleton-disentangled Representationcited by 87
- 2020Hierarchical Kinematic Human Mesh Recoverycited by 71
- 2021Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimationcited by 62
- 2022Capturing Humans in Motion: Temporal-Attentive 3D Human Pose and Shape Estimation from Monocular Videocited by 59
- 2021Conditional Directed Graph Convolution for 3D Human Pose Estimationcited by 52
- 2022A Survey on Metaverse: Fundamentals, Security, and Privacycited by 51
- 2023Global-to-Local Modeling for Video-based 3D Human Pose and Shape Estimationcited by 46
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2023Co-Evolution of Pose and Mesh for 3D Human Body Estimation from Videocited by 25
- 2021A Lightweight Graph Transformer Network for Human Mesh Reconstruction from 2D Human Posecited by 21
- 2024MobileMamba: Lightweight Multi-Receptive Visual Mamba Networkcited by 16
- 2024PoseMamba: Monocular 3D Human Pose Estimation with Bidirectional Global-Local Spatio-Temporal State Space Modelcited by 15
- 2023GATOR: Graph-Aware Transformer with Motion-Disentangled Regression for Human Mesh Recovery from a 2D Posecited by 4
- 2024ARTS: Semi-Analytical Regressor using Disentangled Skeletal Representations for Human Mesh Recovery from Videoscited by 4
- 2024RAWMamba: Unified sRGB-to-RAW De-rendering With State Space Modelcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery
- 2026OnlineHMR: Video-based Online World-Grounded Human Mesh Recovery
- 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstruction
- 2023DiffMesh: A Motion-aware Diffusion Framework for Human Mesh Recovery from Videos
- 2025Mocap-2-to-3: Multi-view Lifting for Monocular Motion Recovery with 2D Pretraining
- 2025A Structure-aware and Motion-adaptive Framework for 3D Human Pose Estimation with Mamba
- 2025HGMamba: Enhancing 3D Human Pose Estimation with a HyperGCN-Mamba Network
- 2025LieHMR: Autoregressive Human Mesh Recovery with SO(3) Diffusion