mlsanityData to 14 Oct 2026

MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Video

arXiv 2203.00859 ↗First posted 2 Mar 2022cs.CVcited by 159

Not on the map. Why?

Abstract (arXiv)

Recent transformer-based solutions have been introduced to estimate 3D human pose from 2D keypoint sequence by considering body joints among all frames globally to learn spatio-temporal correlation. We observe that the motions of different joints differ significantly. However, the previous methods cannot efficiently model the solid inter-frame correspondence of each joint, leading to insufficient learning of spatial-temporal correlation. We propose MixSTE (Mixed Spatio-Temporal Encoder), which has a temporal transformer block to separately model the temporal motion of each joint and a spatial transformer block to learn inter-joint spatial correlation. These two blocks are utilized alternately to obtain better spatio-temporal feature encoding. In addition, the network output is extended from the central frame to entire frames of the input video, thereby improving the coherence between the input and output sequences. Extensive experiments are conducted on three benchmarks (Human3.6M, MPI-INF-3DHP, and HumanEva). The results show that our model outperforms the state-of-the-art approach by 10.9% P-MPJPE and 7.6% MPJPE. The code is available at https://github.com/JinluZhang1126/MixSTE.

Key facts. Cited by 159 papers in the map (data through 14 Oct 2026). Builds on 37 of its 59 references that are in the map. First posted on arXiv 2 Mar 2022.

Builds on

37 of 59 references.

References · 37

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2017Mask R-CNNcited by 7,277
  7. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  8. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
  9. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
  10. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
  11. 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 403
  12. 2017A simple yet effective baseline for 3d human pose estimationcited by 401
25 more
  1. 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
  2. 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
  3. 2017Integral Human Pose Regressioncited by 256
  4. 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 221
  5. 2019Semantic Graph Convolutional Networks for 3D Human Pose Regressioncited by 204
  6. 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
  7. 2020Epipolar Transformerscited by 117
  8. 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 115
  9. 2018Ordinal Depth Supervision for 3D Human Pose Estimationcited by 107
  10. 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 95
  11. 2021Exploiting Temporal Contexts with Strided Transformer for 3D Human Pose Estimationcited by 94
  12. 2017Exploiting temporal information for 3D pose estimationcited by 89
  13. 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 89
  14. 2020Motion Guided 3D Pose Estimation from Videoscited by 85
  15. 2021Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flowscited by 85
  16. 2020Cascaded deep monocular 3D human pose estimation with evolutionary training datacited by 80
  17. 2021Model-based 3D Hand Reconstruction via Self-Supervised Learningcited by 65
  18. 2021Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimationcited by 62
  19. 2020Pose-Guided Human Animation from a Single Image in the Wildcited by 53
  20. 2020Joint Hand-object 3D Reconstruction from a Single Image with Cross-branch Feature Fusioncited by 39
  21. 2021Context Modeling in 3D Human Pose Estimation: A Unified Perspectivecited by 37
  22. 2019Chirality Nets for Human Pose Regressioncited by 31
  23. 2019Trajectory Space Factorization for Deep Video-Based 3D Human Pose Estimationcited by 30
  24. 2015Direct Prediction of 3D Body Poses from Motion Compensated Sequencescited by 26
  25. 2017Recurrent 3D Pose Sequence Machinescited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 11; 2023: 41; 2024: 36; 2025: 48; 2026: 23.

159 papers.

Sort:

By area:

  1. 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
  2. 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 100
  3. 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 92
  4. 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 82
  5. 2023MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Networkcited by 64
  6. 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 47
  7. 2023Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modelingcited by 43
  8. 2024KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimationcited by 34
  9. 2022Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformerscited by 33
  10. 2022SkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-supervised Skeleton Action Recognitioncited by 29
  11. 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Modelcited by 29
  12. 2023SportsPose -- A Dynamic 3D sports pose datasetcited by 26
38 more
  1. 2023Co-Evolution of Pose and Mesh for 3D Human Body Estimation from Videocited by 25
  2. 2024HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observationscited by 25
  3. 2023Back to Optimization: Diffusion-based Zero-Shot 3D Human Pose Estimationcited by 24
  4. 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDARcited by 23
  5. 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimationcited by 23
  6. 20233D Human Pose Perception from Egocentric Stereo Videoscited by 23
  7. 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Modelscited by 23
  8. 2022GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimationcited by 21
  9. 20223D Vision with Transformers: A Surveycited by 21
  10. 2023Pose-Oriented Transformer with Uncertainty-Guided Refinement for 2D-to-3D Human Pose Estimationcited by 19
  11. 2023Global Adaptation meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimationcited by 19
  12. 2023Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capturecited by 18
  13. 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimationcited by 15
  14. 2024A Dual-Augmentor Framework for Domain Generalization in 3D Human Pose Estimationcited by 15
  15. 2025AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movementscited by 14
  16. 2024Attention-Propagation Network for Egocentric Heatmap to 3D Pose Liftingcited by 13
  17. 2024Disentangled Diffusion-Based 3D Human Pose Estimation with Hierarchical Spatial and Temporal Denoisercited by 13
  18. 2025CoMotion: Concurrent Multi-person 3D Motioncited by 13
  19. 2025InteractAnything: Zero-shot Human Object Interaction Synthesis via LLM Feedback and Object Affordance Parsingcited by 13
  20. 2023PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimationcited by 12
  21. 2024Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Networkcited by 12
  22. 2023Regular Splitting Graph Network for 3D Human Pose Estimationcited by 11
  23. 2023Towards Robust and Smooth 3D Multi-Person Pose Estimation from Monocular Videos in the Wildcited by 11
  24. 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimationcited by 11
  25. 2024Lifting Motion to the 3D World via 2D Diffusioncited by 11
  26. 2023Pose-aware Attention Network for Flexible Motion Retargeting by Body Partcited by 10
  27. 2023HSTFormer: Hierarchical Spatial-Temporal Transformers for 3D Human Pose Estimationcited by 9
  28. 2023DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusioncited by 9
  29. 2023Neuromorphic High-Frequency 3D Dancing Pose Estimation in Dynamic Environmentcited by 8
  30. 2023ActionPrompt: Action-Guided 3D Human Pose Estimation With Text and Pose Promptingcited by 8
  31. 2023Human Part-wise 3D Motion Context Learning for Sign Language Recognitioncited by 8
  32. 2025HiPART: Hierarchical Pose AutoRegressive Transformer for Occluded 3D Human Pose Estimationcited by 8
  33. 2023HopFIR: Hop-wise GraphFormer with Intragroup Joint Refinement for 3D Human Pose Estimationcited by 7
  34. 2023Unsupervised 3D Pose Estimation with Non-Rigid Structure-from-Motion Modelingcited by 7
  35. 2023Probabilistic Triangulation for Uncalibrated Multi-View 3D Human Pose Estimationcited by 7
  36. 2025Bring Your Rear Cameras for Egocentric 3D Human Pose Estimationcited by 7
  37. 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Surveycited by 6
  38. 2023ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimationcited by 6

50 most cited of 159 All 159 (JSON)