Exploiting temporal context for 3D human pose estimation in the wild
Not on the map. Why?
Abstract (arXiv)
We present a bundle-adjustment-based algorithm for recovering accurate 3D human pose and meshes from monocular videos. Unlike previous algorithms which operate on single frames, we show that reconstructing a person over an entire sequence gives extra constraints that can resolve ambiguities. This is because videos often give multiple views of a person, yet the overall body shape does not change and 3D positions vary slowly. Our method improves not only on standard mocap-based datasets like Human 3.6M -- where we show quantitative improvements -- but also on challenging in-the-wild datasets such as Kinetics. Building upon our algorithm, we present a new dataset of more than 3 million frames of YouTube videos from Kinetics with automatically generated 3D poses and meshes. We show that retraining a single-frame 3D pose estimator on this data improves accuracy on both real-world and mocap data by evaluating on the 3DPW and HumanEVA datasets.
Key facts. Cited by 110 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 43; 2022: 21; 2023: 22; 2024: 14; 2025: 6; 2026: 4.
110 papers.
Sort:
By area:
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 153
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 142
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 135
- 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 114
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
38 more
- 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
- 2022TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinementcited by 70
- 2021Playing for 3D Human Recoverycited by 64
- 2021Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimationcited by 62
- 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
- 2021Towards unconstrained joint hand-object reconstruction from RGB videoscited by 58
- 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
- 2022Occluded Human Mesh Recoverycited by 54
- 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markerscited by 50
- 2023HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recoverycited by 49
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 48
- 2021Reconstructing 3D Human Pose by Watching Humans in the Mirrorcited by 47
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 47
- 2023ReFit: Recurrent Fitting Network for 3D Human Recoverycited by 47
- 2021Body Meshes as Pointscited by 45
- 20233D Human Mesh Estimation from Virtual Markerscited by 44
- 2023Generative Proxemics: A Prior for 3D Social Interaction from Imagescited by 43
- 2022D&D: Learning Human Dynamics from Dynamic Cameracited by 41
- 2021Probabilistic 3D Human Shape and Pose Estimation from Multiple Unconstrained Images in the Wildcited by 40
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 40
- 2021Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstructioncited by 39
- 2021Adversarial Parametric Pose Priorcited by 38
- 2022Learned Vertex Descent: A New Direction for 3D Human Model Fittingcited by 37
- 2021Task-Generic Hierarchical Human Motion Prior using VAEscited by 33
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generationcited by 32
- 2021AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wildcited by 30
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videoscited by 28
- 2021PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videoscited by 25
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptationcited by 24
- 2022BodySLAM: Joint Camera Localisation, Mapping, and Human Motion Trackingcited by 24
- 2024PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarioscited by 24
- 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDARcited by 23
- 2021Tracking People with 3D Representationscited by 22
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Drivingcited by 22
- 2021Revitalizing Optimization for 3D Human Pose and Shape Estimation: A Sparse Constrained Formulationcited by 19
- 2021Monocular 3D Multi-Person Pose Estimation by Integrating Top-Down and Bottom-Up Networkscited by 16
- 2022Occluded Human Body Capture with Self-Supervised Spatial-Temporal Motion Priorcited by 15
50 most cited of 110 All 110 (JSON)
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation25 Jun 2026
- 2026FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery14 May 2026
- 2026LAMP: Localization Aware Multi-camera People Tracking in Metric 3D World6 May 2026
- 2026DuoMo: Dual Motion Diffusion for World-Space Human Reconstruction3 Mar 2026
- 2025PressTrack-HMR: Pressure-Based Top-Down Multi-Person Global Human Mesh Recovery12 Nov 2025
- 2025UniHPR: Unified Human Pose Representation via Singular Value Contrastive Learning21 Oct 2025
- 2025PhysHMR: Learning Humanoid Control Policies from Vision for Physically Plausible Human Motion Reconstruction2 Oct 2025
- 2025VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusions9 Aug 2025
- 2025HumanMM: Global Human Motion Recovery from Multi-shot Videos10 Mar 2025
- 2025PI-HMR: Towards Robust In-bed Temporal Human Shape Reconstruction with Contact Pressure Sensing27 Feb 2025
- 2024Motion Diffusion-Guided 3D Global HMR from a Dynamic Camera15 Nov 2024
- 2024SPiKE: 3D Human Pose from Point Cloud Sequences3 Sep 2024
38 more
- 2024MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds1 Sep 2024
- 2024Occlusion-Aware 3D Motion Interpretation for Abnormal Behavior Detection23 Jul 2024
- 2024Pose Priors from Language Models6 May 2024
- 2024PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarios30 Apr 2024
- 20243D Human Pose Estimation with Occlusions: Introducing BlendMimic3D Dataset and GCN Refinement24 Apr 2024
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation23 Apr 2024
- 2024HumMUSS: Human Motion Understanding using State Space Models16 Apr 2024
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos5 Apr 2024
- 2024LPSNet: End-to-End Human Pose and Shape Estimation with Lensless Imaging2 Apr 2024
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos26 Mar 2024
- 2024RoHM: Robust Human Motion Reconstruction via Diffusion16 Jan 2024
- 2024STAF: 3D Human Mesh Recovery from Video with Spatio-Temporal Alignment Fusion3 Jan 2024
- 2023STRIDE: Single-video based Temporally Continuous Occlusion-Robust 3D Pose Estimation24 Dec 2023
- 2023UniHPE: Towards Unified Human Pose Estimation via Contrastive Learning24 Nov 2023
- 2023BundleMoCap: Efficient, Robust and Smooth Motion Capture from Sparse Multiview Videos21 Nov 2023
- 2023SwimXYZ: A large-scale dataset of synthetic swimming motions and videos6 Oct 2023
- 2023GloPro: Globally-Consistent Uncertainty-Aware 3D Human Pose Estimation & Tracking in the Wild19 Sep 2023
- 2023BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Tracking3 Sep 2023
- 2023ReFit: Recurrent Fitting Network for 3D Human Recovery22 Aug 2023
- 2023Coordinate Transformer: Achieving Single-stage Multi-person Mesh Recovery from Videos20 Aug 2023
- 2023Physics-Guided Human Motion Capture with Pose Probability Modeling19 Aug 2023
- 2023Body Knowledge and Uncertainty Modeling for Monocular 3D Human Body Reconstruction1 Aug 2023
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Video12 Jul 2023
- 2023Implicit 3D Human Mesh Recovery using Consistency with Pose and Shape from Unseen-view30 Jun 2023
- 2023Generative Proxemics: A Prior for 3D Social Interaction from Images15 Jun 2023
- 2023Motion-DVAE: Unsupervised learning for fast human motion denoising9 Jun 2023
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformers31 May 2023
- 2023Human Body Pose Estimation for Gait Identification: A Comprehensive Survey of Datasets and Models23 May 2023
- 2023HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recovery12 Apr 2023
- 20233D Human Mesh Estimation from Virtual Markers21 Mar 2023
- 2023Capturing the motion of every joint: 3D human pose and shape estimation with independent tokens1 Mar 2023
- 2023Decoupling Human and Camera Motion from Videos in the Wild24 Feb 2023
- 2023Capsules as viewpoint learners for human pose estimation13 Feb 2023
- 20233D Human Pose and Shape Estimation via HybrIK-Transformer9 Feb 2023
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Driving15 Dec 2022
- 2022Progressive Multi-view Human Mesh Recovery with Self-Supervision10 Dec 2022
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDAR30 Nov 2022
- 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmark28 Nov 2022
50 newest of 110 All 110 (JSON)
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 153
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 142
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 135
- 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 114
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
12 most cited of 109 All 109 (JSON)
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation25 Jun 2026
- 2026FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery14 May 2026
- 2026LAMP: Localization Aware Multi-camera People Tracking in Metric 3D World6 May 2026
- 2026DuoMo: Dual Motion Diffusion for World-Space Human Reconstruction3 Mar 2026
- 2025PressTrack-HMR: Pressure-Based Top-Down Multi-Person Global Human Mesh Recovery12 Nov 2025
- 2025UniHPR: Unified Human Pose Representation via Singular Value Contrastive Learning21 Oct 2025
- 2025PhysHMR: Learning Humanoid Control Policies from Vision for Physically Plausible Human Motion Reconstruction2 Oct 2025
- 2025VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusions9 Aug 2025
- 2025HumanMM: Global Human Motion Recovery from Multi-shot Videos10 Mar 2025
- 2025PI-HMR: Towards Robust In-bed Temporal Human Shape Reconstruction with Contact Pressure Sensing27 Feb 2025
- 2024Motion Diffusion-Guided 3D Global HMR from a Dynamic Camera15 Nov 2024
- 2024SPiKE: 3D Human Pose from Point Cloud Sequences3 Sep 2024
12 newest of 109 All 109 (JSON)