mlsanityData to 14 Oct 2026

Exploiting temporal information for 3D pose estimation

arXiv 1711.08585 ↗First posted 23 Nov 2017cs.CVcited by 89

Not on the map. Why?

Abstract (arXiv)

In this work, we address the problem of 3D human pose estimation from a sequence of 2D human poses. Although the recent success of deep networks has led many state-of-the-art methods for 3D pose estimation to train deep networks end-to-end to predict from images directly, the top-performing approaches have shown the effectiveness of dividing the task of 3D pose estimation into two steps: using a state-of-the-art 2D pose estimator to estimate the 2D pose from images and then mapping them into 3D space. They also showed that a low-dimensional representation like 2D locations of a set of joints can be discriminative enough to estimate 3D pose with high accuracy. However, estimation of 3D pose for individual frames leads to temporally incoherent estimates due to independent error in each frame causing jitter. Therefore, in this work we utilize the temporal information across a sequence of 2D joint locations to estimate a sequence of 3D poses. We designed a sequence-to-sequence network composed of layer-normalized LSTM units with shortcut connections connecting the input to the output on the decoder side and imposed temporal smoothness constraint during training. We found that the knowledge of temporal consistency improves the best reported result on Human3.6M dataset by approximately 12.2% and helps our network to recover temporally consistent 3D poses over a sequence of images even when the 2D pose detector fails.

Key facts. Cited by 89 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Nov 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 30; 2022: 22; 2023: 11; 2024: 14; 2025: 7; 2026: 5.

89 papers.

Sort:

By area:

  1. 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
  2. 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 159
  3. 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 114
  4. 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
  5. 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 100
  6. 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
  7. 2021Exploiting Temporal Contexts with Strided Transformer for 3D Human Pose Estimationcited by 94
  8. 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
  9. 2022P-STMO: Pre-Trained Spatial Temporal Many-to-One Model for 3D Human Pose Estimationcited by 80
  10. 2021Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimationcited by 62
  11. 2023Learning Discriminative Representations for Skeleton Based Action Recognitioncited by 62
  12. 2021Towards unconstrained joint hand-object reconstruction from RGB videoscited by 58
38 more
  1. 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
  2. 2021Conditional Directed Graph Convolution for 3D Human Pose Estimationcited by 52
  3. 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 50
  4. 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 47
  5. 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 40
  6. 2022Differentiable Dynamics for Articulated 3d Human Motion Reconstructioncited by 39
  7. 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
  8. 2024KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimationcited by 34
  9. 2021Task-Generic Hierarchical Human Motion Prior using VAEscited by 33
  10. 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generationcited by 32
  11. 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videoscited by 28
  12. 2022Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localizationcited by 25
  13. 2022Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimationcited by 25
  14. 2021Improving Robustness and Accuracy via Relative Information Encoding in 3D Human Pose Estimationcited by 18
  15. 2021Monocular 3D Multi-Person Pose Estimation by Integrating Top-Down and Bottom-Up Networkscited by 16
  16. 2022Occluded Human Body Capture with Self-Supervised Spatial-Temporal Motion Priorcited by 15
  17. 2021Weakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Networkcited by 13
  18. 2021Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videoscited by 13
  19. 2022Dual networks based 3D Multi-Person Pose Estimation from Monocular Videocited by 13
  20. 2023Proactive Multi-Camera Collaboration For 3D Human Pose Estimationcited by 13
  21. 2021FLEX: Extrinsic Parameters-free Multi-view 3D Human Motion Reconstructioncited by 11
  22. 2022CrossFormer: Cross Spatio-Temporal Transformer for 3D Human Pose Estimationcited by 11
  23. 2023Regular Splitting Graph Network for 3D Human Pose Estimationcited by 11
  24. 2021GraFormer: Graph Convolution Transformer for 3D Pose Estimationcited by 10
  25. 2022Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimationcited by 10
  26. 2022BKinD-3D: Self-Supervised 3D Keypoint Discovery from Multi-View Videoscited by 10
  27. 2023HSTFormer: Hierarchical Spatial-Temporal Transformers for 3D Human Pose Estimationcited by 9
  28. 2023DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusioncited by 9
  29. 20213D Human Pose Regression using Graph Convolutional Networkcited by 8
  30. 2021Higher-Order Implicit Fairing Networks for 3D Human Pose Estimationcited by 8
  31. 20213D Pose Estimation and Future Motion Prediction from 2D Imagescited by 8
  32. 2022AI and 6G into the Metaverse: Fundamentals, Challenges and Future Research Trendscited by 8
  33. 2021Deep Two-Stream Video Inference for Human Body Pose and Shape Estimationcited by 7
  34. 2021Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutionscited by 6
  35. 20223D Human Pose Estimation Using M"obius Graph Convolutional Networkscited by 6
  36. 2022IVT: An End-to-End Instance-guided Video Transformer for 3D Pose Estimationcited by 6
  37. 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Surveycited by 6
  38. 2023ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimationcited by 6

50 most cited of 89 All 89 (JSON)