A Diagnostic Study of World-Space Human Recovery Under High Camera Dynamics
Not on the map. Why?
Abstract (arXiv)
Monocular world-space human recovery methods excel on current benchmarks, but these rarely include fast camera motion. We introduce the K-Pop stress test, broadcast dance videos that combine fast, large camera motion with dense multi-person choreography. Leading methods produce plausible per-frame meshes on these videos, yet their world-space trajectories drift far from the performers' stage positions. Through a systematic diagnosis, we show that the camera and human estimates each remain self-consistent, and that the drift appears when they are combined at mismatched scales. Each is recovered at its own scale, so a mismatch between the two can turn camera motion into human drift that grows with camera displacement and becomes severe in broadcast dance videos. We derive a closed-form correction that estimates this mismatch and applies one scale to all performers, removing the drift while keeping their relative positions in one shared world frame. It requires no retraining and works with existing backends. Combined with physical constraints, the correction yields stable world-space reconstruction for choreography modeling, scene editing, data generation, and virtual reshooting. Project page: https://chien90190.github.io/worldhmr-fastcam-website/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 84 of its 95 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
84 of 95 references.
References · 84
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
38 more
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
- 2016Direct Sparse Odometrycited by 485
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 337
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 307
- 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 295
- 2021Mesh Graphormercited by 265
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 218
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 205
- 2022Deep Patch Visual Odometrycited by 190
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 180
- 2017DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networkscited by 175
- 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
- 2021Mask2Former for Video Instance Segmentationcited by 171
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
- 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 163
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 153
- 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 142
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 142
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 135
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 134
- 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 114
- 2020TartanVO: A Generalizable Learning-based VOcited by 108
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
- 20233D Human Pose Estimation via Intuitive Physicscited by 103
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 101
50 most cited of 84 All 84 (JSON)
Built on by
Not cited yet.