PoseTrack: A Benchmark for Human Pose Estimation and Tracking
Not on the map. Why?
Abstract (arXiv)
Human poses and motions are important cues for analysis of videos with people and there is strong evidence that representations based on body pose are highly effective for a variety of tasks such as activity recognition, content retrieval and social signal processing. In this work, we aim to further advance the state of the art by establishing "PoseTrack", a new large-scale benchmark for video-based human pose estimation and articulated tracking, and bringing together the community of researchers working on visual human analysis. The benchmark encompasses three competition tracks focusing on i) single-frame multi-person pose estimation, ii) multi-person pose estimation in videos, and iii) multi-person articulated tracking. To facilitate the benchmark and challenge we collect, annotate and release a new %large-scale benchmark dataset that features videos with multiple people labeled with person tracks and articulated pose. A centralized evaluation server is provided to allow participants to evaluate on a held-out test set. We envision that the proposed benchmark will stimulate productive research both by providing a large and representative training dataset as well as providing a platform to objectively evaluate and compare the proposed methods. The benchmark is freely accessible at https://posetrack.net.
Key facts. Cited by 173 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 36; 2022: 39; 2023: 40; 2024: 23; 2025: 21; 2026: 14.
173 papers.
Sort:
By area:
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 199
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 154
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
- 2021Multi-Person Extreme Motion Predictioncited by 74
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 68
38 more
- 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
- 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 64
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2021Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimationcited by 62
- 2022Capturing Humans in Motion: Temporal-Attentive 3D Human Pose and Shape Estimation from Monocular Videocited by 59
- 2023UniHCP: A Unified Model for Human-Centric Perceptionscited by 59
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
- 2022Human-Aware Object Placement for Visual Environment Reconstructioncited by 56
- 2021OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Associationcited by 55
- 2022APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Trackingcited by 55
- 2023DECO: Dense Estimation of 3D Human-Scene Contact In The Wildcited by 54
- 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52
- 2021Deep Dual Consecutive Network for Human Pose Estimationcited by 51
- 2022Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formatscited by 50
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2023SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environmentscited by 47
- 2023Global-to-Local Modeling for Video-based 3D Human Pose and Shape Estimationcited by 46
- 2021Body Meshes as Pointscited by 45
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2023HumanBench: Towards General Human-centric Perception with Projector Assisted Pretrainingcited by 38
- 2021Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Trackingcited by 37
- 2022Pose for Everything: Towards Category-Agnostic Pose Estimationcited by 36
- 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimationcited by 36
- 2022Self-Supervised Learning via Maximum Entropy Codingcited by 33
- 2023RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimationcited by 33
- 2022LiDARCap: Long-range Marker-less 3D Human Motion Capture with LiDAR Point Cloudscited by 32
- 2023PSVT: End-to-End Multi-person 3D Pose and Shape Estimation with Progressive Video Transformerscited by 31
- 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 31
- 2021Multi-Instance Pose Networks: Rethinking Top-Down Pose Estimationcited by 30
- 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithmscited by 28
- 2023CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactionscited by 27
- 2021ViPNAS: Efficient Video Pose Estimation via Neural Architecture Searchcited by 26
- 2022Efficient Human Pose Estimation via 3D Event Point Cloudcited by 25
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Trackingcited by 25
- 2022Temporal Feature Alignment and Mutual Information Maximization for Video-Based Human Pose Estimationcited by 24
- 2023ChimpACT: A Longitudinal Dataset for Understanding Chimpanzee Behaviorscited by 24
- 2024HumanRefiner: Benchmarking Abnormal Human Generation and Refining with Coarse-to-fine Pose-Reversible Guidancecited by 24
- 2022ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wildcited by 23
50 most cited of 173 All 173 (JSON)
- 2026DETRAM: End-to-end DEtection, Tracking and Recovery of HumAn Meshes10 Jul 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026Fine-grained Human Motion Understanding with Language Models18 Jun 2026
- 2026Reliability-Aware Prototype Calibration for Frozen Pose-Flow Video Anomaly Detection18 Jun 2026
- 2026Evaluation of Pose Estimation Systems for Sign Language Translation27 Apr 2026
- 2026BarbieGait: An Identity-Consistent Synthetic Human Dataset with Versatile Cloth-Changing for Gait Recognition14 Apr 2026
- 2026Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capture1 Apr 2026
- 2026PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Models30 Mar 2026
- 2026NCSTR: Node-Centric Decoupled Spatio-Temporal Reasoning for Video-based Human Pose Estimation20 Mar 2026
- 2026RAM: Recover Any 3D Human Motion in-the-Wild20 Mar 2026
- 2026OpenT2M: No-frill Motion Generation with Open-source,Large-scale, High-quality Data19 Mar 2026
- 2026Multi-Person Pose Estimation Evaluation Using Optimal Transportation and Improved Pose Matching11 Mar 2026
38 more
- 2026Beyond Static Frames: Temporal Aggregate-and-Restore Vision Transformer for Human Pose Estimation6 Mar 2026
- 2026Superman: Unifying Skeleton and Vision for Human Motion Perception and Generation2 Feb 2026
- 2025Multimodal Evaluation of Russian-language Architectures19 Nov 2025
- 2025End-to-End Multi-Person Pose Estimation with Pose-Aware Video Transformer17 Nov 2025
- 2025On the Use of Hierarchical Vision Foundation Models for Low-Cost Human Mesh Recovery and Pose Estimation14 Oct 2025
- 2025High-Resolution Spatiotemporal Modeling with Global-Local State Space Models for Video-Based Human Pose Estimation13 Oct 2025
- 2025Paving the Way Towards Kinematic Assessment Using Monocular Video: A Preclinical Benchmark of State-of-the-Art Deep-Learning-Based 3D Human Pose Estimators Against Inertial Sensors in Daily Living Activities2 Oct 2025
- 2025An End-to-End Framework for Video Multi-Person Pose Estimation1 Sep 2025
- 2025DiffPose-Animal: A Language-Conditioned Diffusion Framework for Animal Pose Estimation12 Aug 2025
- 2025Being-M0.5: A Real-Time Controllable Vision-Language-Motion Model11 Aug 2025
- 2025Joint angle based learning to refine kinematic human pose estimation15 Jul 2025
- 2025Video Inference for Human Mesh Recovery with Vision Transformer11 Jul 2025
- 2025STAR-Pose: Efficient Low-Resolution Video Human Pose Estimation via Spatial-Temporal Adaptive Super-Resolution19 Jun 2025
- 2025LGM-Pose: A Lightweight Global Modeling Network for Real-time Human Pose Estimation5 Jun 2025
- 2025ReaMOT: A Benchmark and Framework for Reasoning-based Multi-Object Tracking26 May 2025
- 2025PoseBH: Prototypical Multi-Dataset Training Beyond Human Pose Estimation23 May 2025
- 2025CoMotion: Concurrent Multi-person 3D Motion16 Apr 2025
- 2025Reconstructing Humans with a Biomechanically Accurate Skeleton27 Mar 2025
- 2025Multi-Grained Feature Pruning for Video-Based Human Pose Estimation7 Mar 2025
- 2025SurgPose: a Dataset for Articulated Robotic Surgical Tool Pose Estimation and Tracking17 Feb 2025
- 2025Toward Efficient Generalization in 3D Human Pose Estimation via a Canonical Domain Approach27 Jan 2025
- 2025Survey on Hand Gesture Recognition from Visual Input21 Jan 2025
- 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimation16 Jan 2025
- 2024EasyVis2: A Real Time Multi-view 3D Visualization System for Laparoscopic Surgery Training Enhanced by a Deep Neural Network YOLOv8-Pose21 Dec 2024
- 2024ShotVL: Human-Centric Highlight Frame Retrieval via Language Queries17 Dec 2024
- 2024CUPS: Improving Human Pose-Shape Estimators with Conformalized Deep Uncertainty11 Dec 2024
- 2024Large Language Model Benchmarks in Medical Tasks28 Oct 2024
- 2024AlphaChimp: Tracking and Behavior Recognition of Chimpanzees22 Oct 2024
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2024Learning Humanoid Locomotion over Challenging Terrain4 Oct 2024
- 2024PoseAdapt: Sustainable Human Pose Estimation via Continual Learning Benchmarks and Toolkit30 Sep 2024
- 2024Joint-Motion Mutual Learning for Pose Estimation in Videos5 Aug 2024
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimation10 Jul 2024
- 2024HumanRefiner: Benchmarking Abnormal Human Generation and Refining with Coarse-to-fine Pose-Reversible Guidance9 Jul 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanics14 Jun 2024
- 2024Beyond Traditional Single Object Tracking: A Survey16 May 2024
- 2024HumMUSS: Human Motion Understanding using State Space Models16 Apr 2024
50 newest of 173 All 173 (JSON)
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimationcited by 36
- 2024HumanRefiner: Benchmarking Abnormal Human Generation and Refining with Coarse-to-fine Pose-Reversible Guidancecited by 24
- 2024DINTR: Tracking via Diffusion-based Interpolationcited by 1
- 2026PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Modelscited by 0
- 2026PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Models30 Mar 2026
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2024HumanRefiner: Benchmarking Abnormal Human Generation and Refining with Coarse-to-fine Pose-Reversible Guidance9 Jul 2024
- 2024Score-Guided Diffusion for 3D Human Recovery14 Mar 2024
- 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimation31 Jul 2023
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug 2022
- 2025Multimodal Evaluation of Russian-language Architecturescited by 1
- 2025Multimodal Evaluation of Russian-language Architectures19 Nov 2025
- 2023Social Motion Prediction with Cognitive Hierarchiescited by 8
- 2023Social Motion Prediction with Cognitive Hierarchies8 Nov 2023
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 199
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 154
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
- 2021Multi-Person Extreme Motion Predictioncited by 74
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 68
- 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
12 most cited of 163 All 163 (JSON)
- 2026DETRAM: End-to-end DEtection, Tracking and Recovery of HumAn Meshes10 Jul 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026Fine-grained Human Motion Understanding with Language Models18 Jun 2026
- 2026Reliability-Aware Prototype Calibration for Frozen Pose-Flow Video Anomaly Detection18 Jun 2026
- 2026Evaluation of Pose Estimation Systems for Sign Language Translation27 Apr 2026
- 2026BarbieGait: An Identity-Consistent Synthetic Human Dataset with Versatile Cloth-Changing for Gait Recognition14 Apr 2026
- 2026Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capture1 Apr 2026
- 2026NCSTR: Node-Centric Decoupled Spatio-Temporal Reasoning for Video-based Human Pose Estimation20 Mar 2026
- 2026RAM: Recover Any 3D Human Motion in-the-Wild20 Mar 2026
- 2026OpenT2M: No-frill Motion Generation with Open-source,Large-scale, High-quality Data19 Mar 2026
- 2026Multi-Person Pose Estimation Evaluation Using Optimal Transportation and Improved Pose Matching11 Mar 2026
- 2026Beyond Static Frames: Temporal Aggregate-and-Restore Vision Transformer for Human Pose Estimation6 Mar 2026
12 newest of 163 All 163 (JSON)