3D Human Motion Estimation via Motion Compression and Refinement
Not on the map. Why?
Abstract (arXiv)
We develop a technique for generating smooth and accurate 3D human pose and motion estimates from RGB video sequences. Our method, which we call Motion Estimation via Variational Autoencoder (MEVA), decomposes a temporal sequence of human motion into a smooth motion representation using auto-encoder-based motion compression and a residual representation learned through motion refinement. This two-step encoding of human motion captures human motion in two stages: a general human motion estimation step that captures the coarse overall motion, and a residual estimation that adds back person-specific motion details. Experiments show that our method produces both smooth and accurate 3D human pose and motion estimates.
Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 20; 2023: 22; 2024: 17; 2025: 8; 2026: 8.
98 papers.
Sort:
By area:
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
38 more
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 111
- 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 109
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
- 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 93
- 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
- 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
- 2022TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinementcited by 69
- 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
- 2021Playing for 3D Human Recoverycited by 63
- 2021Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimationcited by 62
- 2022Capturing Humans in Motion: Temporal-Attentive 3D Human Pose and Shape Estimation from Monocular Videocited by 59
- 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
- 2023Global-to-Local Modeling for Video-based 3D Human Pose and Shape Estimationcited by 46
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 46
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
- 2022D&D: Learning Human Dynamics from Dynamic Cameracited by 39
- 2021Task-Generic Hierarchical Human Motion Prior using VAEscited by 33
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 33
- 2023PSVT: End-to-End Multi-person 3D Pose and Shape Estimation with Progressive Video Transformerscited by 31
- 2022Embodied Scene-aware Human Pose Estimationcited by 28
- 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithmscited by 28
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videoscited by 27
- 2021Dynamic Multi-Person Mesh Recovery From Uncalibrated Multi-View Camerascited by 26
- 2023Co-Evolution of Pose and Mesh for 3D Human Body Estimation from Videocited by 25
- 2022FLAG3D: A 3D Fitness Activity Dataset with Language Instructioncited by 23
- 2023Cyclic Test-Time Adaptation on Monocular Video for 3D Human Mesh Reconstructioncited by 18
- 2024MultiPhys: Multi-Person Physics-aware 3D Motion Estimationcited by 18
- 2021Tracking People by Predicting 3D Appearance, Location & Posecited by 15
- 2022Occluded Human Body Capture with Self-Supervised Spatial-Temporal Motion Priorcited by 15
- 2022PoseBERT: A Generic Transformer Module for Temporal 3D Human Modelingcited by 15
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
- 2023VQ-HPS: Human Pose and Shape Estimation in a Vector-Quantized Latent Spacecited by 13
50 most cited of 98 All 98 (JSON)
- 2026BeyondRetarget: Learning Executable Humanoid Motions Directly from Monocular Video24 Sep 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026MoPO: Incorporating Motion Prior for Occluded Human Mesh Recovery11 May 2026
- 2026LAMP: Localization Aware Multi-camera People Tracking in Metric 3D World6 May 2026
- 2026Improving 3D Foot Motion Reconstruction in Markerless Monocular Human Motion Capture10 Mar 2026
- 2026Towards Geometry-Aware and Motion-Guided Video Human Mesh Recovery29 Jan 2026
- 2026Masked Modeling for Human Motion Recovery Under Occlusions22 Jan 2026
- 2025UniMo: Unifying 2D Video and 3D Human Motion with an Autoregressive Framework3 Dec 2025
- 2025WATCH: World-aware Allied Trajectory and pose reConstruction for Camera and Human4 Sep 2025
- 2025VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusions9 Aug 2025
- 2025Video Inference for Human Mesh Recovery with Vision Transformer11 Jul 2025
38 more
- 2025VirtualFencer: Generating Fencing Bouts based on Strategies Extracted from In-the-Wild Videos30 Jun 2025
- 2025PromptHMR: Promptable Human Mesh Recovery8 Apr 2025
- 2025HumanMM: Global Human Motion Recovery from Multi-shot Videos10 Mar 2025
- 2025Sixth-Sense: Self-Supervised Learning of Spatial Awareness of Humans from a Planar Lidar28 Feb 2025
- 2024Simultaneously Recovering Multi-Person Meshes and Multi-View Cameras with Human Semantics25 Dec 2024
- 2024A Plug-and-Play Physical Motion Restoration Approach for In-the-Wild High-Difficulty Motions23 Dec 2024
- 2024CUPS: Improving Human Pose-Shape Estimators with Conformalized Deep Uncertainty11 Dec 2024
- 2024Dual-Branch Graph Transformer Network for 3D Human Mesh Reconstruction from Video2 Dec 2024
- 2024Lifting Motion to the 3D World via 2D Diffusion27 Nov 2024
- 2024Social EgoMesh Estimation7 Nov 2024
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinates10 Sep 2024
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation29 Aug 2024
- 2024Occlusion-Aware 3D Motion Interpretation for Abnormal Behavior Detection23 Jul 2024
- 2024RemoCap: Disentangled Representation Learning for Motion Capture21 May 2024
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation23 Apr 2024
- 2024MultiPhys: Multi-Person Physics-aware 3D Motion Estimation18 Apr 2024
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos5 Apr 2024
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos26 Mar 2024
- 2024Using Motion Cues to Supervise Single-Frame Body Pose and Shape Estimation in Low Data Regimes5 Feb 2024
- 2024RoHM: Robust Human Motion Reconstruction via Diffusion16 Jan 2024
- 2024STAF: 3D Human Mesh Recovery from Video with Spatio-Temporal Alignment Fusion3 Jan 2024
- 2023SHARE: Single-view Human Adversarial REconstruction30 Dec 2023
- 2023VQ-HPS: Human Pose and Shape Estimation in a Vector-Quantized Latent Space13 Dec 2023
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion12 Dec 2023
- 2023Enhanced Spatio-Temporal Context for Temporally Consistent Robust 3D Human Motion Recovery from Monocular Videos20 Nov 2023
- 2023Temporal-Aware Refinement for Video-based Human Pose and Shape Recovery16 Nov 2023
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videos20 Oct 2023
- 2023Universal Humanoid Motion Representations for Physics-Based Control6 Oct 2023
- 20233DHR-Co: A Collaborative Test-time Refinement Framework for In-the-Wild 3D Human-Body Reconstruction Task2 Oct 2023
- 2023BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Tracking3 Sep 2023
- 2023Utilizing Task-Generic Motion Prior to Recover Full-Body Motion from Very Sparse Signals30 Aug 2023
- 2023PointHPS: Cascaded 3D Human Pose and Shape Estimation from Point Clouds28 Aug 2023
- 2023Co-Evolution of Pose and Mesh for 3D Human Body Estimation from Video20 Aug 2023
- 2023Physics-Guided Human Motion Capture with Pose Probability Modeling19 Aug 2023
- 2023Cyclic Test-Time Adaptation on Monocular Video for 3D Human Mesh Reconstruction12 Aug 2023
- 2023Implicit 3D Human Mesh Recovery using Consistency with Pose and Shape from Unseen-view30 Jun 2023
- 2023Motion-DVAE: Unsupervised learning for fast human motion denoising9 Jun 2023
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformers31 May 2023
50 newest of 98 All 98 (JSON)
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
12 most cited of 96 All 96 (JSON)
- 2026BeyondRetarget: Learning Executable Humanoid Motions Directly from Monocular Video24 Sep 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026MoPO: Incorporating Motion Prior for Occluded Human Mesh Recovery11 May 2026
- 2026LAMP: Localization Aware Multi-camera People Tracking in Metric 3D World6 May 2026
- 2026Improving 3D Foot Motion Reconstruction in Markerless Monocular Human Motion Capture10 Mar 2026
- 2026Masked Modeling for Human Motion Recovery Under Occlusions22 Jan 2026
- 2025UniMo: Unifying 2D Video and 3D Human Motion with an Autoregressive Framework3 Dec 2025
- 2025WATCH: World-aware Allied Trajectory and pose reConstruction for Camera and Human4 Sep 2025
- 2025VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusions9 Aug 2025
- 2025Video Inference for Human Mesh Recovery with Vision Transformer11 Jul 2025
- 2025VirtualFencer: Generating Fencing Bouts based on Strategies Extracted from In-the-Wild Videos30 Jun 2025
12 newest of 96 All 96 (JSON)