Monocular Models are Strong Learners for Multi-View Human Mesh Recovery
Not on the map. Why?
Abstract (arXiv)
Multi-view human mesh recovery (HMR) is broadly deployed in diverse domains where high accuracy and strong generalization are essential. Existing approaches can be broadly grouped into geometry-based and learning-based methods. However, geometry-based methods (e.g., triangulation) rely on cumbersome camera calibration, while learning-based approaches often generalize poorly to unseen camera configurations due to the lack of multi-view training data, limiting their performance in real-world scenarios. To enable calibration-free reconstruction that generalizes to arbitrary camera setups, we propose a training-free framework that leverages pretrained single-view HMR models as strong priors, eliminating the need for multi-view training data. Our method first constructs a robust and consistent multi-view initialization from single-view predictions, and then refines it via test-time optimization guided by multi-view consistency and anatomical constraints. Extensive experiments demonstrate state-of-the-art performance on standard benchmarks, surpassing multi-view models trained with explicit multi-view supervision.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 57 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
36 of 57 references.
References · 36
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
24 more
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 229
- 2020Whole-Body Human Pose Estimation in the Wildcited by 178
- 2019Learnable Triangulation of Human Posecited by 160
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 152
- 20233D Human Pose Estimation via Intuitive Physicscited by 100
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 93
- 2017Towards Accurate Markerless Human Shape and Pose Estimation over Timecited by 92
- 2017AI Challenger : A Large-scale Dataset for Going Deeper in Image Understandingcited by 73
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
- 2024CameraHMR: Aligning People with Perspectivecited by 64
- 2020NeuralAnnot: Neural Annotator for 3D Human Mesh Training Setscited by 62
- 2020AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wildcited by 40
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2019Shape-Aware Human Pose and Shape Reconstruction Using Multi-View Imagescited by 28
- 2022ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wildcited by 23
- 2023HuManiFlow: Ancestor-Conditioned Normalising Flows on SO(3) Manifolds for Human Pose and Shape Distribution Estimationcited by 23
- 2023Multiple View Geometry Transformers for 3D Human Pose Estimationcited by 19
- 2022Learnable human mesh triangulation for 3D human pose and shape estimationcited by 16
- 2020Multi-view Human Pose and Shape Estimation Using Learnable Volumetric Aggregationcited by 10
- 2023Delving Deep into Pixel Alignment Feature for Accurate Multi-view Human Mesh Recoverycited by 10
- 2024OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanicscited by 7
- 2024Human Mesh Recovery from Arbitrary Multi-view Imagescited by 5
- 2022Multi-view Human Body Mesh Translatorcited by 3
- 2024HeatFormer: A Neural Optimizer for Multiview Human Mesh Recoverycited by 2
Built on by
Not cited yet.