3D human pose estimation in video with temporal convolutions and semi-supervised training
Not on the map. Why?
Abstract (arXiv)
In this work, we demonstrate that 3D poses in video can be effectively estimated with a fully convolutional model based on dilated temporal convolutions over 2D keypoints. We also introduce back-projection, a simple and effective semi-supervised training method that leverages unlabeled video data. We start with predicted 2D keypoints for unlabeled video, then estimate 3D poses and finally back-project to the input 2D keypoints. In the supervised setting, our fully-convolutional model outperforms the previous best result from the literature by 6 mm mean per-joint position error on Human3.6M, corresponding to an error reduction of 11%, and the model also shows significant improvements on HumanEva-I. Moreover, experiments with back-projection show that it comfortably outperforms previous state-of-the-art results in semi-supervised settings where labeled data is scarce. Code and models are available at https://github.com/facebookresearch/VideoPose3D
Key facts. Cited by 403 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 80; 2022: 72; 2023: 87; 2024: 61; 2025: 59; 2026: 44.
403 papers.
Sort:
By area:
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
- 2021Revisiting Skeleton-based Action Recognitioncited by 257
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
- 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 178
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 159
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 117
- 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 114
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
38 more
- 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 100
- 2021Learning Speech-driven 3D Conversational Gestures from Videocited by 98
- 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
- 2023Human Motion Generation: A Surveycited by 96
- 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 95
- 2021Exploiting Temporal Contexts with Strided Transformer for 3D Human Pose Estimationcited by 94
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 92
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 89
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 82
- 2022P-STMO: Pre-Trained Spatial Temporal Many-to-One Model for 3D Human Pose Estimationcited by 80
- 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 79
- 2021Neural Monocular 3D Human Motion Capture with Physical Awarenesscited by 71
- 2021Playing for 3D Human Recoverycited by 64
- 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
- 2021Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimationcited by 62
- 2023Learning Discriminative Representations for Skeleton Based Action Recognitioncited by 62
- 2022GFPose: Learning 3D Human Pose Prior with Gradient Fieldscited by 57
- 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
- 2021Conditional Directed Graph Convolution for 3D Human Pose Estimationcited by 52
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 50
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 47
- 2023Human Pose as Compositional Tokenscited by 45
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 40
- 2022Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projectioncited by 39
- 2022mRI: Multi-modal 3D Human Pose Estimation Dataset using mmWave, RGB-D, and Inertial Sensorscited by 38
- 2021Context Modeling in 3D Human Pose Estimation: A Unified Perspectivecited by 37
- 2022Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Videocited by 37
- 2021VPN++: Rethinking Video-Pose embeddings for understanding Activities of Daily Livingcited by 35
- 2021UNIK: A Unified Framework for Real-world Skeleton-based Action Recognitioncited by 35
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
- 2022Estimating Egocentric 3D Human Pose in the Wild with External Weak Supervisioncited by 34
- 2023Visual Tuningcited by 34
- 2024KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimationcited by 34
- 2021Task-Generic Hierarchical Human Motion Prior using VAEscited by 33
- 2021Test-Time Personalization with a Transformer for Human Pose Estimationcited by 33
- 2022Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformerscited by 33
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generationcited by 32
- 2022HuPR: A Benchmark for Human Pose Estimation Using Millimeter Wave Radarcited by 31
50 most cited of 403 All 403 (JSON)
- 2026Robust Real-Time Monocular Human Pose Estimation with Insole-Based Sensor Fusion14 Oct 2026
- 2026Kinematics-Induced Multimodal 3D Human Pose Estimation with Subject-Level Privacy2 Oct 2026
- 2026Retargeting Motions to Diverse Skeletons via Learnable Flattening29 Sep 2026
- 2026STA-TFM: Spatio-Temporal Aggregation Across Views TransForMer for Pose Estimation21 Sep 2026
- 2026Field Converter: Geometry-Initialized Temporal Residual Refinement for World-Grounded Player Pose Estimation from Soccer Broadcasts9 Sep 2026
- 2026Sound-based Multi-Person 3D Pose Estimation4 Sep 2026
- 2026CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image1 Sep 2026
- 2026MoSign: Challenge-Response Motion-Watermark Authentication for Anonymous Virtual-Reality Users30 Aug 2026
- 2026Markerless Pose Estimation for Resistance Training Technique Assessment25 Aug 2026
- 2026Efficient Human-Contact Representation for Human-Scene Interaction10 Aug 2026
- 2026Decoding Children's Gait Behavior1 Aug 2026
- 2026Classifying daily activities needs posture, reconstructing them needs motion14 Jul 2026
38 more
- 2026Pose-to-Biomechanics: Bridging 3D Human Pose Estimation and Biomechanical Attribute Prediction9 Jul 2026
- 2026Partial Skeleton Visibility for Action Recognition: A Constrained Field-of-View Approach1 Jul 2026
- 2026UNIEGO: Proxies as Mediators for Unified Egocentric Video Representation Learning18 Jun 2026
- 2026An Opticalmechanics Framework for Dynamic Estimation of Multibody Systems8 Jun 2026
- 2026IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation3 Jun 2026
- 2026Quantitative Movement Testing: Measuring Chronic Pain Patient Movements from a Single Smartphone Video1 Jun 2026
- 2026AIGaitor: Privacy-preserving and cloud-free motion analysis for everyone, using edge computing20 May 2026
- 2026Unsupervised 3D Human Pose Estimation via Conditional Multi-view Ancestral Sampling15 May 2026
- 2026VIMCAN: Visual-Inertial 3D Human Pose Estimation with Hybrid Mamba-Cross-Attention Network8 May 2026
- 2026LAMP: Localization Aware Multi-camera People Tracking in Metric 3D World6 May 2026
- 2026MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons30 Apr 2026
- 2026AnyLift: Scaling Motion Reconstruction from Internet Videos via 2D Diffusion20 Apr 2026
- 2026Dual-stream Spatio-Temporal GCN-Transformer Network for 3D Human Pose Estimation20 Apr 2026
- 2026A Dataset and Evaluation for Complex 4D Markerless Human Motion Capture14 Apr 2026
- 2026MuPPet: Multi-person 2D-to-3D Pose Lifting8 Apr 2026
- 2026Expanding mmWave Datasets for Human Pose Estimation with Unlabeled Data and LiDAR Datasets15 Mar 2026
- 2026PCFEx: Point Cloud Feature Extraction for Graph Neural Networks9 Mar 2026
- 2026Learning Context-Adaptive Motion Priors for Masked Motion Diffusion Models with Efficient Kinematic Attention Aggregation8 Mar 2026
- 2026Velocity and stroke rate reconstruction of canoe sprint team boats based on panned and zoomed video recordings26 Feb 2026
- 2026SIMSPINE: A Biomechanics-Aware Simulation Framework for 3D Spine Motion Annotation and Benchmarking24 Feb 2026
- 2026SEAL-pose: Enhancing 3D Human Pose Estimation via a Learned Loss for Structural Consistency23 Feb 2026
- 2026BigMaQ: A Big Macaque Motion and Animation Dataset Bridging Image and 3D Pose Representations23 Feb 2026
- 2026RPGD: RANSAC-P3P Gradient Descent for Extrinsic Calibration in 3D Human Pose Estimation14 Feb 2026
- 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequences13 Feb 2026
- 2026FMPose3D: monocular 3D pose estimation via flow matching5 Feb 2026
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models3 Feb 2026
- 2026Superman: Unifying Skeleton and Vision for Human Motion Perception and Generation2 Feb 2026
- 2026QuaMo: Quaternion Motions for Vision-based 3D Human Kinematics Capture27 Jan 2026
- 2026Flow Matching for Probabilistic Monocular 3D Human Pose Estimation23 Jan 2026
- 2026GazeD: Context-Aware Diffusion for Accurate 3D Gaze Estimation19 Jan 2026
- 2026UnrealPose: Leveraging Game Engine Kinematics for Large-Scale Synthetic Human Pose Data2 Jan 2026
- 2026RePose: A Real-Time 3D Human Pose Estimation and Biomechanical Analysis Framework for Rehabilitation2 Jan 2026
- 2025Lifelong Domain Adaptive 3D Human Pose Estimation29 Dec 2025
- 2025PoseMoE: Mixture-of-Experts Network for Monocular 3D Human Pose Estimation18 Dec 2025
- 2025FastDDHPose: Towards Unified, Efficient, and Disentangled 3D Human Pose Estimation16 Dec 2025
- 2025Refining Diffusion Models for Motion Synthesis with an Acceleration Loss to Generate Realistic IMU Data9 Dec 2025
- 2025Exploiting Spatiotemporal Properties for Efficient Event-Driven Human Pose Estimation6 Dec 2025
- 2025DreamPose3D: Hallucinative Diffusion with Prompt Learning for 3D Human Pose Estimation12 Nov 2025
50 newest of 403 All 403 (JSON)
- 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Modelcited by 29
- 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Modelscited by 23
- 20233DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editingcited by 15
- 2023Generative Approach for Probabilistic Human Mesh Recovery using Diffusion Modelscited by 14
- 2024Disentangled Diffusion-Based 3D Human Pose Estimation with Hierarchical Spatial and Temporal Denoisercited by 13
- 2023DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusioncited by 9
- 2024CHAMP: Conformalized 3D Human Multi-Hypothesis Pose Estimatorscited by 5
- 2025Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Modelscited by 5
- 2024PADS: Plug-and-Play 3D Human Pose Analysis via Diffusion Generative Modelingcited by 3
- 2026FMPose3D: monocular 3D pose estimation via flow matchingcited by 3
- 2024Di2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimationcited by 2
- 2026Flow Matching for Probabilistic Monocular 3D Human Pose Estimationcited by 2
12 most cited of 18 All 18 (JSON)
- 2026Unsupervised 3D Human Pose Estimation via Conditional Multi-view Ancestral Sampling15 May 2026
- 2026Learning Context-Adaptive Motion Priors for Masked Motion Diffusion Models with Efficient Kinematic Attention Aggregation8 Mar 2026
- 2026FMPose3D: monocular 3D pose estimation via flow matching5 Feb 2026
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models3 Feb 2026
- 2026Flow Matching for Probabilistic Monocular 3D Human Pose Estimation23 Jan 2026
- 2025Refining Diffusion Models for Motion Synthesis with an Acceleration Loss to Generate Realistic IMU Data9 Dec 2025
- 2025Efficient Diffusion-Based 3D Human Pose Estimation with Hierarchical Temporal Pruning29 Aug 2025
- 2025Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models18 Jun 2025
- 2025Diffusion Model-based Activity Completion for AI Motion Capture from Videos27 May 2025
- 2024CHAMP: Conformalized 3D Human Multi-Hypothesis Pose Estimators27 May 2024
- 2024Di2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimation27 May 2024
- 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Models8 May 2024
12 newest of 18 All 18 (JSON)
- 2024Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Networkcited by 12
- 2025HGMamba: Enhancing 3D Human Pose Estimation with a HyperGCN-Mamba Networkcited by 4
- 2025Mamba-Driven Topology Fusion for Monocular 3D Human Pose Estimationcited by 2
- 2025SasMamba: A Lightweight Structure-Aware Stride State Space Model for 3D Human Pose Estimationcited by 1
- 2026VIMCAN: Visual-Inertial 3D Human Pose Estimation with Hybrid Mamba-Cross-Attention Networkcited by 1
- 2026VIMCAN: Visual-Inertial 3D Human Pose Estimation with Hybrid Mamba-Cross-Attention Network8 May 2026
- 2025SasMamba: A Lightweight Structure-Aware Stride State Space Model for 3D Human Pose Estimation12 Nov 2025
- 2025Mamba-Driven Topology Fusion for Monocular 3D Human Pose Estimation27 May 2025
- 2025HGMamba: Enhancing 3D Human Pose Estimation with a HyperGCN-Mamba Network9 Apr 2025
- 2024Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network6 Aug 2024
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
- 2021Revisiting Skeleton-based Action Recognitioncited by 257
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
- 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 178
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 159
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 117
- 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 114
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
12 most cited of 377 All 377 (JSON)
- 2026Robust Real-Time Monocular Human Pose Estimation with Insole-Based Sensor Fusion14 Oct 2026
- 2026Kinematics-Induced Multimodal 3D Human Pose Estimation with Subject-Level Privacy2 Oct 2026
- 2026Retargeting Motions to Diverse Skeletons via Learnable Flattening29 Sep 2026
- 2026STA-TFM: Spatio-Temporal Aggregation Across Views TransForMer for Pose Estimation21 Sep 2026
- 2026Field Converter: Geometry-Initialized Temporal Residual Refinement for World-Grounded Player Pose Estimation from Soccer Broadcasts9 Sep 2026
- 2026Sound-based Multi-Person 3D Pose Estimation4 Sep 2026
- 2026CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image1 Sep 2026
- 2026MoSign: Challenge-Response Motion-Watermark Authentication for Anonymous Virtual-Reality Users30 Aug 2026
- 2026Markerless Pose Estimation for Resistance Training Technique Assessment25 Aug 2026
- 2026Efficient Human-Contact Representation for Human-Scene Interaction10 Aug 2026
- 2026Decoding Children's Gait Behavior1 Aug 2026
- 2026Classifying daily activities needs posture, reconstructing them needs motion14 Jul 2026
12 newest of 377 All 377 (JSON)