OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
Not on the map. Why?
Cited by 76 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Realtime multi-person 2D pose estimation is a key component in enabling machines to have an understanding of people in images and videos. In this work, we present a realtime approach to detect the 2D pose of multiple people in an image. The proposed method uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn to associate body parts with individuals in the image. This bottom-up system achieves high accuracy and realtime performance, regardless of the number of people in the image. In previous work, PAFs and body part location estimation were refined simultaneously across training stages. We demonstrate that a PAF-only refinement rather than both PAF and body part location refinement results in a substantial increase in both runtime performance and accuracy. We also present the first combined body and foot keypoint detector, based on an internal annotated foot dataset that we have publicly released. We show that the combined detector not only reduces the inference time compared to running them sequentially, but also maintains the accuracy of each component individually. This work has culminated in the release of OpenPose, the first open-source realtime system for multi-person 2D pose detection, including body, foot, hand, and facial keypoints.
Key facts. Cited by 1,161 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 233; 2022: 232; 2023: 219; 2024: 183; 2025: 165; 2026: 129.
1,161 papers.
Sort:
By area:
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2021Revisiting Skeleton-based Action Recognitioncited by 256
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
38 more
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 199
- 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 177
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022Latent Image Animator: Learning to Animate Images via Latent Space Navigationcited by 172
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 152
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 150
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2023Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generationcited by 128
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
- 2023Drivable 3D Gaussian Avatarscited by 120
- 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
- 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 113
- 2022Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generationcited by 106
- 20213D Human Action Representation Learning via Cross-View Consistency Pursuitcited by 105
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2022VideoDex: Learning Dexterity from Internet Videoscited by 101
- 2023EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modelingcited by 101
- 20233D Human Pose Estimation via Intuitive Physicscited by 100
- 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 99
- 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
- 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 93
- 2025Controllable Video Generation: A Surveycited by 93
- 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90
- 2021NPMs: Neural Parametric Models for 3D Deformable Shapescited by 89
50 most cited of 1,161 All 1,161 (JSON)
- 2026Neural Networks for Temporal Pattern Recognition and Dynamic Arm Gesture Speed Estimation for Robot Control8 Oct 2026
- 2026Training-Free Hold-Usage Detection in Sport Climbing with Foundation Pose Models24 Sep 2026
- 2026Isolated Sign Language Recognition for Icelandic Sign Language: Experiments in a Low-resource Setting22 Sep 2026
- 2026SignGPT: Toward LLM-Mediated Sign Language Interaction through Gloss-Free Translation and Generation18 Sep 2026
- 2026GenStream: Semantic Streaming Framework for Generative Reconstruction of Human-centric Media16 Sep 2026
- 2026Cross-Domain Inference for Human Localization: Applying Wi-Fi RSSI Data to CSI-Trained Models15 Sep 2026
- 2026SignMimic: Robust High-Quality Sign Language Motion Generation via Human-Shape-Oblivious Pose Transfer Guidance12 Sep 2026
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026Recovering Biomechanical Signals from Missing Keypoints Using Temporal Interpolation in Monocular Gait Analysis9 Sep 2026
- 2026SoftRerank: Hierarchical Soft Fusion with Candidate-Label Reranking for Long-Tailed Micro-Action Recognition8 Sep 2026
- 2026Frame-Synchronous Hand Gesture Detection by Projected Winding Order7 Sep 2026
- 2026A Black-Box Adversarial Attack on Human Pose Estimation and Keypoint-Based Action Recognition Models7 Sep 2026
38 more
- 2026Sound-based Multi-Person 3D Pose Estimation4 Sep 2026
- 2026FlowVVTON: Flow-Guided Mask-Free Video Virtual Try-On31 Aug 2026
- 2026FISICA: A Deployed Service for Plantar-Pressure and Posture Assessment with Ontology-Grounded Recommendation29 Aug 2026
- 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editing26 Aug 2026
- 2026Skeleton-based Zero-Shot Spatio-Temporal Action Localization via Weakly-Supervised Pretraining26 Aug 2026
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures20 Aug 2026
- 2026VideoRun2D Demo: Markerless Body Tracking for Biomechanical Analysis of Running19 Aug 2026
- 2026NeuroPath: Brain-Inspired Dual-Pathway Graph Convolutional Networks for Skeleton-Based Action Recognition18 Aug 2026
- 2026CAS-FD: Contact-Aware Temporal Sampling for Single-View Foul vs Dive Recognition17 Aug 2026
- 2026Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervision17 Aug 2026
- 2026Topology-Unified 2D Pose Estimation across Intact, Residual and Prosthetic Limbs13 Aug 2026
- 2026Promptable Animal Pose Tracking Across Species5 Aug 2026
- 2026Multi-View Face and Gesture Animation with Dynamic Gaussians5 Aug 2026
- 2026TransSLR: A Lightweight Transformer for Sign Language Recognition3 Aug 2026
- 2026Decoding Children's Gait Behavior1 Aug 2026
- 2026A Vision-Language Framework for Measuring Social Life on Sidewalks31 Jul 2026
- 2026SAGE-Yoga: Multi-Cue Learning for Yoga Pose Classification and Joint-Level Correction28 Jul 2026
- 2026Weight and Height Estimation from a Single Human Image Captured in the Wild28 Jul 2026
- 2026Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detection28 Jul 2026
- 2026FST.ai 2.5: Explainable and Uncertainty-Aware AI for Olympic and Para-Taekwondo Decision Support, Athlete Digital Twins, and Federation-Scale Analytics18 Jul 2026
- 2026Unsupervised Keypoints for Real-Time Fall Detection: Comparative Analysis Under Real-world Conditions with Predictive Bandwidth Reduction16 Jul 2026
- 2026Physics-Informed Diffusion for Biomechanically Plausible 3D Sign Language Generation16 Jul 2026
- 2026TAMF-VTON: Texture-Aware Mask-Free Virtual Try-On via High-Fidelity Image Synthesis16 Jul 2026
- 2026MultiAnimate: A Unified Framework for Controllable Multi-Character Animation15 Jul 2026
- 2026Let RGB Be the Language of Vision14 Jul 2026
- 2026Q-BridgeNet: A Quantization Network for Cross-Lingual Sign Language Translation13 Jul 2026
- 20263D FaceShell: Attribute Transfer in 3D Face Avatars as a VLM Defense Mechanism9 Jul 2026
- 2026Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing7 Jul 2026
- 2026From Open Loop to Closed Loop: A Test-Time Iterative Optimization Framework for Reference-Consistent Image Generation6 Jul 2026
- 2026A non-invasive video-based method for individual identification of wildlife using gait dynamics5 Jul 2026
- 2026ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation4 Jul 2026
- 2026Seeing Through WiFi: Lightweight Human Pose Estimation with Dynamic Kernel Attention3 Jul 2026
- 2026Patient-Specific Articulated Digital Twins from a Single Full-Body CT Scan2 Jul 2026
- 2026GKDT: General Keypoint Detection Transformer1 Jul 2026
- 2026Rethinking the Role of Feature Engineering and Learning Strategies in Few-Shot Hidden Emotion Recognition30 Jun 2026
- 2026SICAGE: Speaker-Independent Culture-Aware Gesture Generation using TED4C-L Dataset29 Jun 2026
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animation26 Jun 2026
- 2026ModaFlow: Modality-Aware Flow Matching for High-Fidelity Virtual Try-On26 Jun 2026
50 newest of 1,161 All 1,161 (JSON)
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
- 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 150
- 2023Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generationcited by 128
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
- 2023LooseControl: Lifting ControlNet for Generalized Depth Conditioningcited by 68
- 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
- 2023Readout Guidance: Learning Control from Diffusion Featurescited by 52
12 most cited of 76 All 76 (JSON)
- 2026Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervision17 Aug 2026
- 2026Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing7 Jul 2026
- 2026ModaFlow: Modality-Aware Flow Matching for High-Fidelity Virtual Try-On26 Jun 2026
- 2026TeleMorpher: Toward Robust Simultaneous Motion-Location Editing18 Jun 2026
- 2026Geometry-Conditioned Diffusion for Occlusion-Robust In-Bed Pose Estimation26 Apr 2026
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation7 Apr 2026
- 2026PHAC: Promptable Human Amodal Completion16 Mar 2026
- 2026TRACE: Structure-Aware Character Encoding for Robust and Generalizable Document Watermarking13 Mar 2026
- 2026Learning Context-Adaptive Motion Priors for Masked Motion Diffusion Models with Efficient Kinematic Attention Aggregation8 Mar 2026
- 2025AnchorHOI: Zero-shot Generation of 4D Human-Object Interaction via Anchor-based Prior Distillation16 Dec 2025
- 2025Blur2Sharp: Human Novel Pose and View Synthesis with Generative Prior Refinement9 Dec 2025
- 2025Canvas-to-Image: Compositional Image Generation with Multimodal Controls26 Nov 2025
12 newest of 76 All 76 (JSON)
- 2024HumanVLM: Foundation for Human-Scene Vision-Language Modelcited by 8
- 2025Can Vision Language Models Understand Mimed Actions?cited by 2
- 2024Ask, Pose, Unite: Scaling Data Acquisition for Close Interactions with Vision Language Modelscited by 1
- 2026ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translationcited by 0
- 2026ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation4 Jul 2026
- 2025Can Vision Language Models Understand Mimed Actions?17 Jun 2025
- 2024HumanVLM: Foundation for Human-Scene Vision-Language Model5 Nov 2024
- 2024Ask, Pose, Unite: Scaling Data Acquisition for Close Interactions with Vision Language Models1 Oct 2024
- 2025Embodied AI Agents: Modeling the Worldcited by 57
- 2025Embodied AI Agents: Modeling the World27 Jun 2025
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2021Revisiting Skeleton-based Action Recognitioncited by 256
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
12 most cited of 1,073 All 1,073 (JSON)
- 2026Neural Networks for Temporal Pattern Recognition and Dynamic Arm Gesture Speed Estimation for Robot Control8 Oct 2026
- 2026Training-Free Hold-Usage Detection in Sport Climbing with Foundation Pose Models24 Sep 2026
- 2026Isolated Sign Language Recognition for Icelandic Sign Language: Experiments in a Low-resource Setting22 Sep 2026
- 2026SignGPT: Toward LLM-Mediated Sign Language Interaction through Gloss-Free Translation and Generation18 Sep 2026
- 2026GenStream: Semantic Streaming Framework for Generative Reconstruction of Human-centric Media16 Sep 2026
- 2026Cross-Domain Inference for Human Localization: Applying Wi-Fi RSSI Data to CSI-Trained Models15 Sep 2026
- 2026SignMimic: Robust High-Quality Sign Language Motion Generation via Human-Shape-Oblivious Pose Transfer Guidance12 Sep 2026
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026Recovering Biomechanical Signals from Missing Keypoints Using Temporal Interpolation in Monocular Gait Analysis9 Sep 2026
- 2026SoftRerank: Hierarchical Soft Fusion with Candidate-Label Reranking for Long-Tailed Micro-Action Recognition8 Sep 2026
- 2026Frame-Synchronous Hand Gesture Detection by Projected Winding Order7 Sep 2026
- 2026A Black-Box Adversarial Attack on Human Pose Estimation and Keypoint-Based Action Recognition Models7 Sep 2026
12 newest of 1,073 All 1,073 (JSON)