Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Video
Not on the map. Why?
Abstract (arXiv)
Despite the recent success of single image-based 3D human pose and shape estimation methods, recovering temporally consistent and smooth 3D human motion from a video is still challenging. Several video-based methods have been proposed; however, they fail to resolve the single image-based methods' temporal inconsistency issue due to a strong dependency on a static feature of the current frame. In this regard, we present a temporally consistent mesh recovery system (TCMR). It effectively focuses on the past and future frames' temporal information without being dominated by the current static feature. Our TCMR significantly outperforms previous video-based methods in temporal consistency with better per-frame 3D pose and shape accuracy. We also release the codes. For the demo video, see https://youtu.be/WB3nTnSQDII. For the codes, see https://github.com/hongsukchoi/TCMR_RELEASE.
Key facts. Cited by 162 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 26; 2023: 33; 2024: 37; 2025: 22; 2026: 26.
162 papers.
Sort:
By area:
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2021Mesh Graphormercited by 264
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
38 more
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
- 2022HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Networkcited by 95
- 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 93
- 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
- 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 64
- 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
- 2021Playing for 3D Human Recoverycited by 63
- 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 62
- 2022Capturing Humans in Motion: Temporal-Attentive 3D Human Pose and Shape Estimation from Monocular Videocited by 59
- 2023ReFit: Recurrent Fitting Network for 3D Human Recoverycited by 47
- 2023Global-to-Local Modeling for Video-based 3D Human Pose and Shape Estimationcited by 46
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 46
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 20233D Human Mesh Estimation from Virtual Markerscited by 44
- 2025GENMO: A GENeralist Model for Human MOtioncited by 43
- 2022D&D: Learning Human Dynamics from Dynamic Cameracited by 39
- 2025Human3R: Everyone Everywhere All at Oncecited by 35
- 2021Task-Generic Hierarchical Human Motion Prior using VAEscited by 33
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 33
- 2023PSVT: End-to-End Multi-person 3D Pose and Shape Estimation with Progressive Video Transformerscited by 31
- 2022HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidancecited by 29
- 2024Joint Reconstruction of 3D Human and Object via Contact-Based Refinement Transformercited by 29
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videoscited by 27
- 2024Towards Open Domain Text-Driven Synthesis of Multi-Person Motionscited by 27
- 2023Co-Evolution of Pose and Mesh for 3D Human Body Estimation from Videocited by 25
- 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
- 2022FLAG3D: A 3D Fitness Activity Dataset with Language Instructioncited by 23
- 2021A Lightweight Graph Transformer Network for Human Mesh Reconstruction from 2D Human Posecited by 21
- 2023Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimationcited by 21
- 2023RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Datasetcited by 18
- 2023Cyclic Test-Time Adaptation on Monocular Video for 3D Human Mesh Reconstructioncited by 18
- 2024MultiPhys: Multi-Person Physics-aware 3D Motion Estimationcited by 18
- 2024Synergistic Global-space Camera and Human Reconstruction from Videoscited by 17
- 2021Learning to Fit Morphable Modelscited by 16
- 2025BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videoscited by 16
- 2022H4D: Human 4D Modeling by Learning Neural Compositional Representationcited by 15
50 most cited of 162 All 162 (JSON)
- 2026BeyondRetarget: Learning Executable Humanoid Motions Directly from Monocular Video24 Sep 2026
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery20 Aug 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026HandFlow: Fully Generative 4D Hand Recovery with Flow Matching13 Jul 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation25 Jun 2026
- 2026TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutes24 Jun 2026
- 2026CalTennis: Large Multi-View Tennis Video Dataset and Benchmark of Monocular-to-3D Pose Estimation18 Jun 2026
- 2026TROPHIES: Temporal Reconstruction of Places, Humans, and Cameras from Multi-view Videos1 Jun 2026
- 2026SkelMo: Universal Skeletal Motion Generation for 3D Rigged Shapes1 Jun 2026
- 2026DanceHMR: Hand-Aware Whole-Body Human Mesh Recovery from Monocular Videos18 May 2026
- 2026FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery14 May 2026
38 more
- 2026MoPO: Incorporating Motion Prior for Occluded Human Mesh Recovery11 May 2026
- 2026Task-Oriented Communication for Human Action Understanding via Edge-Cloud Co-Inference8 May 2026
- 2026MoViD: View-Invariant 3D Human Pose Estimation via Motion-View Disentanglement29 Mar 2026
- 2026PAD-Hand: Physics-Aware Diffusion for Hand Motion Recovery27 Mar 2026
- 2026OnlineHMR: Video-based Online World-Grounded Human Mesh Recovery18 Mar 2026
- 2026SOMA: Unifying Parametric Human Body Models17 Mar 2026
- 2026End-to-End Spatial-Temporal Transformer for Real-time 4D HOI Reconstruction15 Mar 2026
- 2026Improving 3D Foot Motion Reconstruction in Markerless Monocular Human Motion Capture10 Mar 2026
- 2026DuoMo: Dual Motion Diffusion for World-Space Human Reconstruction3 Mar 2026
- 2026UniHand: A Unified Model for Diverse Controlled 4D Hand Motion Modeling25 Feb 2026
- 2026Depth-Guided Metric-Aware Temporal Consistency for Monocular Video Human Mesh Recovery4 Feb 2026
- 2026Hand3R: Online 4D Hand-Scene Reconstruction in the Wild3 Feb 2026
- 2026Towards Geometry-Aware and Motion-Guided Video Human Mesh Recovery29 Jan 2026
- 2026Masked Modeling for Human Motion Recovery Under Occlusions22 Jan 2026
- 2025MoCapAnything: Unified 3D Motion Capture for Arbitrary Skeletons from Monocular Videos11 Dec 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025Hyperbolic Space Learning Method Leveraging Temporal Motion Priors for Human Mesh Recovery21 Oct 2025
- 2025SPLite Hand: Sparsity-Aware Lightweight 3D Hand Pose Estimation18 Oct 2025
- 2025On the Use of Hierarchical Vision Foundation Models for Low-Cost Human Mesh Recovery and Pose Estimation14 Oct 2025
- 2025FastHMR: Accelerating Human Mesh Recovery via Token and Layer Merging with Diffusion Decoding13 Oct 2025
- 2025Human3R: Everyone Everywhere All at Once7 Oct 2025
- 20253D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review15 Sep 2025
- 2025WATCH: World-aware Allied Trajectory and pose reConstruction for Camera and Human4 Sep 2025
- 2025DyCrowd: Towards Dynamic Crowd Reconstruction from a Large-scene Video18 Aug 2025
- 2025Diffusion-based 3D Hand Motion Recovery with Intuitive Physics3 Aug 2025
- 2025Occlusion-robust Stylization for Drawing-based 3D Animation1 Aug 2025
- 2025Video Inference for Human Mesh Recovery with Vision Transformer11 Jul 2025
- 2025VirtualFencer: Generating Fencing Bouts based on Strategies Extracted from In-the-Wild Videos30 Jun 2025
- 2025Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Vision6 Jun 2025
- 2025GENMO: A GENeralist Model for Human MOtion2 May 2025
- 2025PromptHMR: Promptable Human Mesh Recovery8 Apr 2025
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image25 Mar 2025
- 2025Biomechanics-Guided Residual Approach to Generalizable Human Motion Generation and Estimation8 Mar 2025
- 2025PI-HMR: Towards Robust In-bed Temporal Human Shape Reconstruction with Contact Pressure Sensing27 Feb 2025
- 2025BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videos14 Jan 2025
- 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos6 Jan 2025
- 2024Optimizing Local-Global Dependencies for Accurate 3D Human Pose Estimation27 Dec 2024
- 2024A Plug-and-Play Physical Motion Restoration Approach for In-the-Wild High-Difficulty Motions23 Dec 2024
50 newest of 162 All 162 (JSON)
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Imagecited by 4
- 2025Biomechanics-Guided Residual Approach to Generalizable Human Motion Generation and Estimationcited by 1
- 2026HandFlow: Fully Generative 4D Hand Recovery with Flow Matchingcited by 1
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recoverycited by 1
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery20 Aug 2026
- 2026HandFlow: Fully Generative 4D Hand Recovery with Flow Matching13 Jul 2026
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image25 Mar 2025
- 2025Biomechanics-Guided Residual Approach to Generalizable Human Motion Generation and Estimation8 Mar 2025
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation29 Aug 2024
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2021Mesh Graphormercited by 264
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
12 most cited of 156 All 156 (JSON)
- 2026BeyondRetarget: Learning Executable Humanoid Motions Directly from Monocular Video24 Sep 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation25 Jun 2026
- 2026TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutes24 Jun 2026
- 2026CalTennis: Large Multi-View Tennis Video Dataset and Benchmark of Monocular-to-3D Pose Estimation18 Jun 2026
- 2026TROPHIES: Temporal Reconstruction of Places, Humans, and Cameras from Multi-view Videos1 Jun 2026
- 2026SkelMo: Universal Skeletal Motion Generation for 3D Rigged Shapes1 Jun 2026
- 2026DanceHMR: Hand-Aware Whole-Body Human Mesh Recovery from Monocular Videos18 May 2026
- 2026FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery14 May 2026
- 2026MoPO: Incorporating Motion Prior for Occluded Human Mesh Recovery11 May 2026
- 2026Task-Oriented Communication for Human Action Understanding via Edge-Cloud Co-Inference8 May 2026
12 newest of 156 All 156 (JSON)