mlsanityData to 14 Oct 2026

Efficient Online Multi-Person 2D Pose Tracking with Recurrent Spatio-Temporal Affinity Fields

arXiv 1811.11975 ↗First posted 29 Nov 2018cs.CVcited by 32

Not on the map. Why?

Abstract (arXiv)

We present an online approach to efficiently and simultaneously detect and track the 2D pose of multiple people in a video sequence. We build upon Part Affinity Field (PAF) representation designed for static images, and propose an architecture that can encode and predict Spatio-Temporal Affinity Fields (STAF) across a video sequence. In particular, we propose a novel temporal topology cross-linked across limbs which can consistently handle body motions of a wide range of magnitudes. Additionally, we make the overall approach recurrent in nature, where the network ingests STAF heatmaps from previous frames and estimates those for the current frame. Our approach uses only online inference and tracking, and is currently the fastest and the most accurate bottom-up approach that is runtime invariant to the number of people in the scene and accuracy invariant to input frame rate of camera. Running at ~30 fps on a single GPU at single scale, it achieves highly competitive results on the PoseTrack benchmarks.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Nov 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 12; 2022: 8; 2023: 8; 2024: 3; 2025: 1.

32 papers.

Sort:

By area:

  1. 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
  2. 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 60
  3. 2021OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Associationcited by 55
  4. 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 50
  5. 2021SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videoscited by 40
  6. 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
  7. 2021Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Trackingcited by 37
  8. 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimationcited by 36
  9. 2022Temporal Feature Alignment and Mutual Information Maximization for Video-Based Human Pose Estimationcited by 24
  10. 20222D Human Pose Estimation: A Surveycited by 21
  11. 2021Rethinking Keypoint Representations: Modeling Keypoints and Poses as Objects for Multi-Person Human Pose Estimationcited by 20
  12. 2021Learning to Track Instances without Video Annotationscited by 18
20 more
  1. 2023Mutual Information-Based Temporal Difference Learning for Human Pose Estimation in Videocited by 17
  2. 2021TrouSPI-Net: Spatio-temporal attention on parallel atrous convolutions and U-GRUs for skeletal pedestrian crossing predictioncited by 13
  3. 2024Joint-Motion Mutual Learning for Pose Estimation in Videoscited by 7
  4. 2022Snipper: A Spatiotemporal Transformer for Simultaneous Multi-Person 3D Pose Estimation Tracking and Forecasting on a Video Snippetcited by 6
  5. 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Surveycited by 6
  6. 2021Capturing Detailed Deformations of Moving Human Bodiescited by 5
  7. 2024Human Modelling and Pose Estimation Overviewcited by 4
  8. 2022Learning to Estimate External Forces of Human Motion in Videocited by 3
  9. 2023A Gated Attention Transformer for Multi-Person Pose Trackingcited by 3
  10. 2023Improving Multi-Person Pose Tracking with A Confidence Networkcited by 3
  11. 2024DenseTrack: Drone-based Crowd Tracking via Density-aware Motion-appearance Synergycited by 3
  12. 2021Temporally Guided Articulated Hand Pose Tracking in Surgical Videoscited by 2
  13. 2021A Review on Human Pose Estimationcited by 1
  14. 2021Camera Motion Agnostic 3D Human Pose Estimationcited by 0
  15. 2022Koopman pose predictions for temporally consistent human walking estimationscited by 0
  16. 2022People Tracking and Re-Identifying in Distributed Contexts: Extension Study of PoseTReIDcited by 0
  17. 2022ErgoExplorer: Interactive Ergonomic Risk Assessment from Video Collectionscited by 0
  18. 2023Augmenting Vision-Based Human Pose Estimation with Rotation Matrixcited by 0
  19. 2023InceptionHuman: Controllable Prompt-to-NeRF for Photorealistic 3D Human Generationcited by 0
  20. 2025An End-to-End Framework for Video Multi-Person Pose Estimationcited by 0