mlsanityData to 7 Oct 2026

RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose

arXiv 2303.07399 ↗First posted 13 Mar 2023cs.CVcited by 170

Not on the map. Why?

Abstract (arXiv)

Recent studies on 2D pose estimation have achieved excellent performance on public benchmarks, yet its application in the industrial community still suffers from heavy model parameters and high latency. In order to bridge this gap, we empirically explore key factors in pose estimation including paradigm, model architecture, training strategy, and deployment, and present a high-performance real-time multi-person pose estimation framework, RTMPose, based on MMPose. Our RTMPose-m achieves 75.8% AP on COCO with 90+ FPS on an Intel i7-11700 CPU and 430+ FPS on an NVIDIA GTX 1660 Ti GPU, and RTMPose-l achieves 67.0% AP on COCO-WholeBody with 130+ FPS. To further evaluate RTMPose's capability in critical real-time applications, we also report the performance after deploying on the mobile device. Our RTMPose-s achieves 72.2% AP on COCO with 70+ FPS on a Snapdragon 865 chip, outperforming existing open-source libraries. Code and models are released at https://github.com/open-mmlab/mmpose/tree/1.x/projects/rtmpose.

Key facts. Cited by 170 papers in the map (data through 7 Oct 2026). Builds on 53 of its 66 references that are in the map. First posted on arXiv 13 Mar 2023.

Builds on

53 of 66 references.

References · 53

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  7. 2020End-to-End Object Detection with Transformerscited by 7,384
  8. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  9. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  10. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  11. 2018YOLOv3: An Incremental Improvementcited by 2,652
  12. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
38 more
  1. 2020GLU Variants Improve Transformercited by 1,724
  2. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  3. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  4. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
  5. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  6. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  7. 2021Video Swin Transformercited by 1,090
  8. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  9. 2021Multiscale Vision Transformerscited by 896
  10. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
  11. 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
  12. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
  13. 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
  14. 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
  15. 2018CrowdPose: Efficient Crowded Scenes Pose Estimation and A New Benchmarkcited by 214
  16. 2016Associative Embedding: End-to-End Learning for Joint Detection and Groupingcited by 211
  17. 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 199
  18. 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 192
  19. 2022Transformer Quality in Linear Timecited by 189
  20. 2020Whole-Body Human Pose Estimation in the Wildcited by 178
  21. 2019Distribution-Aware Coordinate Representation for Human Pose Estimationcited by 165
  22. 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
  23. 2020TransPose: Keypoint Localization via Transformercited by 126
  24. 2021AP-10K: A Benchmark for Animal Pose Estimation in the Wildcited by 123
  25. 2019PifPaf: Composite Fields for Human Pose Estimationcited by 120
  26. 2015DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimationcited by 117
  27. 2020BlazePose: On-device Real-time Body Pose trackingcited by 112
  28. 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
  29. 2021TokenPose: Learning Keypoint Tokens for Human Pose Estimationcited by 106
  30. 2021Pose Recognition with Cascade Transformerscited by 99
  31. 2021Lite-HRNet: A Lightweight High-Resolution Networkcited by 91
  32. 2019The Devil is in the Details: Delving into Unbiased Data Processing for Human Pose Estimationcited by 79
  33. 2017AI Challenger : A Large-scale Dataset for Going Deeper in Image Understandingcited by 73
  34. 2020Rethinking the Heatmap Regression for Bottom-up Human Pose Estimationcited by 69
  35. 2021SimCC: a Simple Coordinate Classification Perspective for Human Pose Estimationcited by 68
  36. 2020Learning Delicate Local Representations for Multi-Person Pose Estimationcited by 65
  37. 2020Differentiable Hierarchical Graph Grouping for Multi-Person Pose Estimationcited by 52
  38. 2022Poseur: Direct Human Pose Regression with Transformerscited by 43

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 9; 2024: 30; 2025: 67; 2026: 64.

170 papers.

Sort:

By area:

  1. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  2. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  3. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
  4. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  5. 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
  6. 2025Uni-Sign: Toward Unified Sign Language Understanding at Scalecited by 55
  7. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
  8. 2026Ultralytics YOLO26: Unified Real-Time End-to-End Vision Modelscited by 47
  9. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  10. 2023RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimationcited by 33
  11. 2025HOIGen-1M: A Large-scale Dataset for Human-Object Interaction Video Generationcited by 26
  12. 2024Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Modelscited by 24
38 more
  1. 2023Hulk: A Universal Knowledge Translator for Human-Centric Taskscited by 22
  2. 2023X-Pose: Detecting Any Keypointscited by 21
  3. 2025InterActHuman: Multi-Concept Human Animation with Layout-Aligned Audio Conditionscited by 20
  4. 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimationcited by 18
  5. 2024AniClipart: Clipart Animation with Text-to-Video Priorscited by 17
  6. 2024Bi-KVIL: Keypoints-based Visual Imitation Learning of Bimanual Manipulation Taskscited by 16
  7. 2024MMVP: A Multimodal MoCap Dataset with Vision and Pressure Sensorscited by 16
  8. 2024AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movementscited by 15
  9. 2024The BabyView dataset: High-resolution egocentric videos of infants' and young children's everyday experiencescited by 15
  10. 2024Multimodal Cross-Domain Few-Shot Learning for Egocentric Action Recognitioncited by 14
  11. 2025AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movementscited by 14
  12. 2025DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Priorcited by 13
  13. 2024HumanRig: Learning Automatic Rigging for Humanoid Character in a Large Scale Datasetcited by 12
  14. 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Frameworkcited by 12
  15. 2023SHaRPose: Sparse High-Resolution Representation for Human Pose Estimationcited by 11
  16. 2025HiBug2: Efficient and Interpretable Error Slice Discovery for Comprehensive Model Debuggingcited by 11
  17. 2025Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translationcited by 11
  18. 2024Holistic-Motion2D: Scalable Whole-body Human Motion Generation in 2D Spacecited by 10
  19. 2024Diffusion Models are Efficient Data Generators for Human Mesh Recoverycited by 8
  20. 2024Estimating Ego-Body Pose from Doubly Sparse Egocentric Video Datacited by 8
  21. 2024COAP: Memory-Efficient Training with Correlation-Aware Gradient Projectioncited by 8
  22. 2025H-MoRe: Learning Human-centric Motion Representation for Action Analysiscited by 8
  23. 2023Ins-HOI: Instance Aware Human-Object Interactions Recoverycited by 7
  24. 2024Evaluating Text-to-Image Generative Models: An Empirical Study on Human Image Synthesiscited by 7
  25. 2024High Quality Human Image Animation using Regional Supervision and Motion Blur Conditioncited by 7
  26. 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimationcited by 6
  27. 2024Which Viewpoint Shows it Best? Language for Weakly Supervising View Selection in Multi-view Instructional Videoscited by 6
  28. 2025TT3D: Table Tennis 3D Reconstructioncited by 5
  29. 2025Finger Pose Estimation for Under-screen Fingerprint Sensorcited by 5
  30. 2024DIR-BHRNet: A Lightweight Network for Real-time Vision-based Multi-person Pose Estimation on Smartphonescited by 4
  31. 2024SEDS: Semantically Enhanced Dual-Stream Encoder for Sign Language Retrievalcited by 4
  32. 2025SGA-INTERACT: A 3D Skeleton-based Benchmark for Group Activity Understanding in Modern Basketball Tacticcited by 4
  33. 2025TrackID3x3: A Dataset and Algorithm for Multi-Player Tracking with Identification and Pose Estimation in 3x3 Basketball Full-court Videoscited by 4
  34. 2025ReVision: Refining Video Diffusion with Explicit 3D Motion Modelingcited by 4
  35. 2025CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Trackingcited by 4
  36. 2025HyperMotionX: The Dataset and Benchmark with DiT-Based Pose-Guided Human Image Animation of Complex Motionscited by 4
  37. 2025Kineo: Calibration-Free Metric Motion Capture From Sparse RGB Camerascited by 4
  38. 2025DreaMontage: Arbitrary Frame-Guided One-Shot Video Generationcited by 4

50 most cited of 170 All 170 (JSON)