IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation
Not on the map. Why?
Abstract (arXiv)
High-quality dynamic human pose annotation equips AI with precise motion kinematics to enable human behavior mastery, yet remains labor-intensive and time-consuming. Current annotation tools either lack temporal correction propagation or fail in multi-person scenarios, necessitating excessive manual intervention. In this paper, we introduce IMPose, an interactive tool for multi-person dynamic pose annotation. It features a dual-level tracking mechanism that propagates one-frame multi-person pose corrections from annotators across entire videos. The keypoint-level ensures corrections temporal propagation via sequential modeling, while the instance-level employs keypoint-aware embedding with relative positional encoding to maintain multi-person cross-frame consistency. To further improve robustness, IMPose maintains historical pose and instance cues in a trajectory bank, which enhances long-range temporal association and stabilizes annotation in challenging cases such as occlusion and motion blur. By converting sparse human corrections into dense and coherent pose trajectories, our framework significantly reduces repeated manual refinement across frames. Extensive experiments show that IMPose consistently achieves a strong accuracy efficiency trade off under different interaction budgets, demonstrating particular advantages in low click annotation settings. IMPose achieves high precision annotation with high efficiency, requiring only 27 clicks per 1,050 frame video on 3DPW and 3 clicks per tracklet per 84-frame on PoseTrack21. We further expand PoseTrack21 with 188K pose instances (3.55M keypoints) at a minimal cost of 10 annotators in 10 hours. The annotation tool, codes, and extended dataset will be open-sourced.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 39 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
32 of 39 references.
References · 32
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
- 2020Rescaling Egocentric Visioncited by 529
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 401
20 more
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2016Associative Embedding: End-to-End Learning for Joint Detection and Groupingcited by 211
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 199
- 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 139
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2019PifPaf: Composite Fields for Human Pose Estimationcited by 120
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2018Pose Flow: Efficient Online Pose Trackingcited by 80
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2017Detect-and-Track: Efficient Pose Estimation in Videoscited by 51
- 2018PoseFix: Model-agnostic General Human Pose Refinement Networkcited by 47
- 2016PoseTrack: Joint Multi-Person Pose Estimation and Trackingcited by 44
- 2022Poseur: Direct Human Pose Regression with Transformerscited by 43
- 2023Bridging the Gap Between End-to-end and Non-End-to-end Multi-Object Trackingcited by 20
- 2023Neural Interactive Keypoint Detectioncited by 12
- 2024Video-Based Human Pose Regression via Decoupled Space-Time Aggregationcited by 10
- 2025Causal-Inspired Multitask Learning for Video-Based Human Pose Estimationcited by 5
- 2025High-Resolution Spatiotemporal Modeling with Global-Local State Space Models for Video-Based Human Pose Estimationcited by 4
- 2023A Gated Attention Transformer for Multi-Person Pose Trackingcited by 3
Built on by
Not cited yet.