The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person Pose Estimation
Not on the map. Why?
Abstract (arXiv)
We introduce CenterGroup, an attention-based framework to estimate human poses from a set of identity-agnostic keypoints and person center predictions in an image. Our approach uses a transformer to obtain context-aware embeddings for all detected keypoints and centers and then applies multi-head attention to directly group joints into their corresponding person centers. While most bottom-up methods rely on non-learnable clustering at inference, CenterGroup uses a fully differentiable attention mechanism that we train end-to-end together with our keypoint detector. As a result, our method obtains state-of-the-art performance with up to 2.5x faster inference time than competing bottom-up methods. Our code is available at https://github.com/dvl-tum/center-group .
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 55 of its 71 references that are in the map. First posted on arXiv 11 Oct 2021.
Builds on
55 of 71 references.
References · 55
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2017Mask R-CNNcited by 7,277
- 2016Layer Normalizationcited by 5,669
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
38 more
- 2019Objects as Pointscited by 1,175
- 2017Mixed Precision Trainingcited by 1,156
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2018Image Transformercited by 772
- 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
- 2020End-to-End Video Instance Segmentation with Transformerscited by 443
- 2020MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformerscited by 355
- 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
- 2016RMPE: Regional Multi-person Pose Estimationcited by 340
- 2018Everybody Dance Nowcited by 315
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 307
- 2017Integral Human Pose Regressioncited by 256
- 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
- 2018End-to-End Dense Video Captioning with Masked Transformercited by 214
- 2018CrowdPose: Efficient Crowded Scenes Pose Estimation and A New Benchmarkcited by 214
- 2016Associative Embedding: End-to-End Learning for Joint Detection and Groupingcited by 212
- 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
- 2019Distribution-Aware Coordinate Representation for Human Pose Estimationcited by 165
- 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 163
- 2018PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Modelcited by 133
- 2017Towards Accurate Multi-person Pose Estimation in the Wildcited by 131
- 2019PifPaf: Composite Fields for Human Pose Estimationcited by 120
- 2015DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimationcited by 117
- 2020Epipolar Transformerscited by 117
- 2016DeeperCut: A Deeper, Stronger, and Faster Multi-Person Pose Estimation Modelcited by 96
- 2019Single-Stage Multi-Person Pose Machinescited by 95
- 2019The Devil is in the Details: Delving into Unbiased Data Processing for Human Pose Estimationcited by 79
- 2017Multi-Context Attention for Human Pose Estimationcited by 66
- 2020Learning Delicate Local Representations for Multi-Person Pose Estimationcited by 65
- 2020Point-Set Anchors for Object Detection, Instance Segmentation and Pose Estimationcited by 57
- 2020Differentiable Hierarchical Graph Grouping for Multi-Person Pose Estimationcited by 52
- 2016Human pose estimation via Convolutional Part Heatmap Regressioncited by 51
- 2018MultiPoseNet: Fast Multi-Person Pose Estimation using Pose Residual Networkcited by 47
- 2018PoseFix: Model-agnostic General Human Pose Refinement Networkcited by 47
- 2019Multi-Person Pose Estimation with Enhanced Channel-wise and Spatial Informationcited by 35
- 2020Graph-PCNN: Two Stage Human Pose Estimation with Graph Pose Refinementcited by 33
- 2016ArtTrack: Articulated Multi-person Tracking in the Wildcited by 27
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 8; 2023: 4; 2024: 4; 2025: 1.
18 papers.
Sort:
- 2022DETRs with Hybrid Matchingcited by 150
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Trackingcited by 25
- 2021Rethinking Keypoint Representations: Modeling Keypoints and Poses as Objects for Multi-Person Human Pose Estimationcited by 20
- 2022QueryPose: Sparse Multi-Person Pose Regression via Spatial-Aware Part-Level Querycited by 13
- 2023Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguitycited by 13
- 2022Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimationcited by 10
- 2024Video-Based Human Pose Regression via Decoupled Space-Time Aggregationcited by 10
- 2023Keypoint-Augmented Self-Supervised Learning for Medical Image Segmentation with Limited Annotationcited by 7
- 2022NIMBLE: A Non-rigid Hand Model with Bones and Musclescited by 6
- 2022AdaptivePose++: A Powerful Single-Stage Network for Multi-Person Pose Regressioncited by 6
- 2022Bottom-Up 2D Pose Estimation via Dual Anatomical Centers for Small-Scale Personscited by 5
- 2023LAMP: Leveraging Language Prompts for Multi-person Pose Estimationcited by 4
6 more
- 2024Human Modelling and Pose Estimation Overviewcited by 4
- 2024DHRNet: A Dual-Path Hierarchical Relation Network for Multi-Person Pose Estimationcited by 2
- 2024GatedUniPose: A Novel Approach for Pose Estimation Combining UniRepLKNet and Gated Convolutioncited by 1
- 2022Mutual Adaptive Reasoning for Monocular 3D Multi-Person Pose Estimationcited by 0
- 2023Hybrid model for Single-Stage Multi-Person Pose Estimationcited by 0
- 2025Keypoints as Dynamic Centroids for Unified Human Pose and Segmentationcited by 0
- 2025Keypoints as Dynamic Centroids for Unified Human Pose and Segmentation17 May 2025
- 2024GatedUniPose: A Novel Approach for Pose Estimation Combining UniRepLKNet and Gated Convolution12 Sep 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024DHRNet: A Dual-Path Hierarchical Relation Network for Multi-Person Pose Estimation22 Apr 2024
- 2024Video-Based Human Pose Regression via Decoupled Space-Time Aggregation29 Mar 2024
- 2023Keypoint-Augmented Self-Supervised Learning for Medical Image Segmentation with Limited Annotation2 Oct 2023
- 2023LAMP: Leveraging Language Prompts for Multi-person Pose Estimation21 Jul 2023
- 2023Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguity13 Jun 2023
- 2023Hybrid model for Single-Stage Multi-Person Pose Estimation2 May 2023
- 2022QueryPose: Sparse Multi-Person Pose Regression via Spatial-Aware Part-Level Query15 Dec 2022
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Tracking20 Oct 2022
- 2022AdaptivePose++: A Powerful Single-Stage Network for Multi-Person Pose Regression8 Oct 2022
6 more
- 2022Bottom-Up 2D Pose Estimation via Dual Anatomical Centers for Small-Scale Persons25 Aug 2022
- 2022Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimation29 Jul 2022
- 2022DETRs with Hybrid Matching26 Jul 2022
- 2022Mutual Adaptive Reasoning for Monocular 3D Multi-Person Pose Estimation16 Jul 2022
- 2022NIMBLE: A Non-rigid Hand Model with Bones and Muscles9 Feb 2022
- 2021Rethinking Keypoint Representations: Modeling Keypoints and Poses as Objects for Multi-Person Human Pose Estimation16 Nov 2021
- 2022DETRs with Hybrid Matchingcited by 150
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Trackingcited by 25
- 2021Rethinking Keypoint Representations: Modeling Keypoints and Poses as Objects for Multi-Person Human Pose Estimationcited by 20
- 2022QueryPose: Sparse Multi-Person Pose Regression via Spatial-Aware Part-Level Querycited by 13
- 2023Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguitycited by 13
- 2022Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimationcited by 10
- 2024Video-Based Human Pose Regression via Decoupled Space-Time Aggregationcited by 10
- 2023Keypoint-Augmented Self-Supervised Learning for Medical Image Segmentation with Limited Annotationcited by 7
- 2022NIMBLE: A Non-rigid Hand Model with Bones and Musclescited by 6
- 2022AdaptivePose++: A Powerful Single-Stage Network for Multi-Person Pose Regressioncited by 6
- 2022Bottom-Up 2D Pose Estimation via Dual Anatomical Centers for Small-Scale Personscited by 5
- 2023LAMP: Leveraging Language Prompts for Multi-person Pose Estimationcited by 4
12 most cited of 18 All 18 (JSON)
- 2025Keypoints as Dynamic Centroids for Unified Human Pose and Segmentation17 May 2025
- 2024GatedUniPose: A Novel Approach for Pose Estimation Combining UniRepLKNet and Gated Convolution12 Sep 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024DHRNet: A Dual-Path Hierarchical Relation Network for Multi-Person Pose Estimation22 Apr 2024
- 2024Video-Based Human Pose Regression via Decoupled Space-Time Aggregation29 Mar 2024
- 2023Keypoint-Augmented Self-Supervised Learning for Medical Image Segmentation with Limited Annotation2 Oct 2023
- 2023LAMP: Leveraging Language Prompts for Multi-person Pose Estimation21 Jul 2023
- 2023Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguity13 Jun 2023
- 2023Hybrid model for Single-Stage Multi-Person Pose Estimation2 May 2023
- 2022QueryPose: Sparse Multi-Person Pose Regression via Spatial-Aware Part-Level Query15 Dec 2022
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Tracking20 Oct 2022
- 2022AdaptivePose++: A Powerful Single-Stage Network for Multi-Person Pose Regression8 Oct 2022
12 newest of 18 All 18 (JSON)