mlsanityData to 14 Oct 2026

Detect-and-Track: Efficient Pose Estimation in Videos

arXiv 1712.09184 ↗First posted 26 Dec 2017cs.CVcited by 51

Not on the map. Why?

Abstract (arXiv)

This paper addresses the problem of estimating and tracking human body keypoints in complex, multi-person video. We propose an extremely lightweight yet highly effective approach that builds upon the latest advancements in human detection and video understanding. Our method operates in two-stages: keypoint estimation in frames or short clips, followed by lightweight tracking to generate keypoint predictions linked over the entire video. For frame-level pose estimation we experiment with Mask R-CNN, as well as our own proposed 3D extension of this model, which leverages temporal information over small clips to generate more robust frame predictions. We conduct extensive ablative experiments on the newly released multi-person video pose estimation benchmark, PoseTrack, to validate various design choices of our model. Our approach achieves an accuracy of 55.2% on the validation and 51.8% on the test set using the Multi-Object Tracking Accuracy (MOTA) metric, and achieves state of the art performance on the ICCV 2017 PoseTrack keypoint tracking challenge.

Key facts. Cited by 51 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Dec 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 19; 2022: 9; 2023: 12; 2024: 3; 2025: 4; 2026: 4.

51 papers.

Sort:

By area:

  1. 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
  2. 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 50
  3. 2021Body Meshes as Pointscited by 45
  4. 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
  5. 2021Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Trackingcited by 37
  6. 2021RGB-D Salient Object Detection via 3D Convolutional Neural Networkscited by 36
  7. 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimationcited by 36
  8. 2021Test-Time Personalization with a Transformer for Human Pose Estimationcited by 33
  9. 2021Supervision by Registration and Triangulation for Landmark Detectioncited by 30
  10. 2021ViPNAS: Efficient Video Pose Estimation via Neural Architecture Searchcited by 26
  11. 2023DriveTrack: A Benchmark for Long-Range Point Tracking in Real-World Videoscited by 25
  12. 2022Temporal Feature Alignment and Mutual Information Maximization for Video-Based Human Pose Estimationcited by 24
38 more
  1. 2022MonoTrack: Shuttle trajectory reconstruction from monocular badminton videocited by 24
  2. 2021Tracking People with 3D Representationscited by 22
  3. 20222D Human Pose Estimation: A Surveycited by 21
  4. 2021Learning to Track Instances without Video Annotationscited by 18
  5. 2023Mutual Information-Based Temporal Difference Learning for Human Pose Estimation in Videocited by 17
  6. 2021Tracking People by Predicting 3D Appearance, Location & Posecited by 15
  7. 2025CoMotion: Concurrent Multi-person 3D Motioncited by 13
  8. 2021Classification of Abnormal Hand Movement for Aiding in Autism Detection: Machine Learning Studycited by 10
  9. 2024Video-Based Human Pose Regression via Decoupled Space-Time Aggregationcited by 10
  10. 2023You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perceptioncited by 9
  11. 2021Relation-Based Associative Joint Location for Human Pose Estimation in Videoscited by 7
  12. 2023Lightweight Super-Resolution Head for Human Pose Estimationcited by 7
  13. 2024Joint-Motion Mutual Learning for Pose Estimation in Videoscited by 7
  14. 2022Snipper: A Spatiotemporal Transformer for Simultaneous Multi-Person 3D Pose Estimation Tracking and Forecasting on a Video Snippetcited by 6
  15. 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Surveycited by 6
  16. 2023Deep Learning Approaches for Seizure Video Analysis: A Reviewcited by 6
  17. 2021SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimationcited by 5
  18. 2022A Temporal Densely Connected Recurrent Network for Event-based Human Pose Estimationcited by 5
  19. 2023Active Transfer Learning for Efficient Video-Specific Human Pose Estimationcited by 4
  20. 2024Human Modelling and Pose Estimation Overviewcited by 4
  21. 2023A Gated Attention Transformer for Multi-Person Pose Trackingcited by 3
  22. 2023Improving Multi-Person Pose Tracking with A Confidence Networkcited by 3
  23. 2021Benchmarking Deep Trackers on Aerial Videoscited by 2
  24. 2021Image Feature Information Extraction for Interest Point Detection: A Reviewcited by 2
  25. 2023A Survey of Advanced Computer Vision Techniques for Sportscited by 2
  26. 2026Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Trackingcited by 2
  27. 2021Self-Attentive 3D Human Pose and Shape Estimation from Videoscited by 1
  28. 2021A Review on Human Pose Estimationcited by 1
  29. 2022SmartDet: Context-Aware Dynamic Control of Edge Task Offloading for Mobile Object Detectioncited by 1
  30. 2026SportSkills: Physical Skill Learning from Sports Instructional Videoscited by 1
  31. 2021Unsupervised Noisy Tracklet Person Re-identificationcited by 0
  32. 2022Training Free Graph Neural Networks for Graph Matchingcited by 0
  33. 2022Szloca: towards a framework for full 3D tracking through a single camera in context of interactive artscited by 0
  34. 2023MMC: Multi-Modal Colorization of Images using Textual Descriptionscited by 0
  35. 2025ReynoldsFlow: Physics-Inspired Spatiotemporal Flow Representation for Video Understandingcited by 0
  36. 2025VirtualFencer: Generating Fencing Bouts based on Strategies Extracted from In-the-Wild Videoscited by 0
  37. 2025An End-to-End Framework for Video Multi-Person Pose Estimationcited by 0
  38. 2026Beyond Static Frames: Temporal Aggregate-and-Restore Vision Transformer for Human Pose Estimationcited by 0

50 most cited of 51 All 51 (JSON)