Learning Delicate Local Representations for Multi-Person Pose Estimation
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel method called Residual Steps Network (RSN). RSN aggregates features with the same spatial size (Intra-level features) efficiently to obtain delicate local representations, which retain rich low-level spatial information and result in precise keypoint localization. Additionally, we observe the output features contribute differently to final performance. To tackle this problem, we propose an efficient attention mechanism - Pose Refine Machine (PRM) to make a trade-off between local and global representations in output features and further refine the keypoint locations. Our approach won the 1st place of COCO Keypoint Challenge 2019 and achieves state-of-the-art results on both COCO and MPII benchmarks, without using extra training data and pretrained model. Our single model achieves 78.6 on COCO test-dev, 93.0 on MPII test dataset. Ensembled models achieve 79.2 on COCO test-dev, 77.1 on COCO test-challenge dataset. The source code is publicly available for further research at https://github.com/caiyuanhao1998/RSN/
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 18; 2023: 11; 2024: 14; 2025: 5.
65 papers.
Sort:
By area:
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
- 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstructioncited by 110
- 2021TokenPose: Learning Keypoint Tokens for Human Pose Estimationcited by 106
- 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
- 2021SimCC: a Simple Coordinate Classification Perspective for Human Pose Estimationcited by 68
- 2022Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstructioncited by 67
- 2022HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imagingcited by 66
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
- 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
- 2021Deep Dual Consecutive Network for Human Pose Estimationcited by 51
38 more
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2023Human Pose as Compositional Tokenscited by 45
- 2022Flow-Guided Sparse Transformer for Video Deblurringcited by 43
- 2022Poseur: Direct Human Pose Regression with Transformerscited by 43
- 2021TFPose: Direct Human Pose Estimation with Transformerscited by 42
- 2021FCPose: Fully Convolutional Multi-Person Pose Estimation with Dynamic Instance-Aware Convolutionscited by 34
- 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Trainingcited by 29
- 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Resultscited by 26
- 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmarkcited by 24
- 20222D Human Pose Estimation: A Surveycited by 21
- 2021The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person Pose Estimationcited by 18
- 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimationcited by 18
- 2023Mutual Information-Based Temporal Difference Learning for Human Pose Estimation in Videocited by 17
- 2021InsPose: Instance-Aware Networks for Single-Stage Multi-Person Pose Estimationcited by 13
- 2022Efficient Mirror Detection via Multi-level Heterogeneous Learningcited by 13
- 2022Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimationcited by 10
- 2022ConfLab: A Data Collection Concept, Dataset, and Benchmark for Machine Analysis of Free-Standing Social Interactions in the Wildcited by 9
- 2021Location-Sensitive Visual Recognition with Cross-IOU Losscited by 8
- 2024Video2Reward: Generating Reward Function from Videos for Legged Robot Behavior Learningcited by 8
- 2023Lightweight Super-Resolution Head for Human Pose Estimationcited by 7
- 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Surveycited by 6
- 2023SniffyArt: The Dataset of Smelling Personscited by 6
- 2021SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimationcited by 5
- 2023Human Body Pose Estimation for Gait Identification: A Comprehensive Survey of Datasets and Modelscited by 5
- 2024PoseBench: Benchmarking the Robustness of Pose Estimation Models under Corruptionscited by 4
- 2024Human Modelling and Pose Estimation Overviewcited by 4
- 2022DPIT: Dual-Pipeline Integrated Transformer for Human Pose Estimationcited by 3
- 2023Bias-Compensated Integral Regression for Human Pose Estimationcited by 3
- 2023PaRK-Detect: Towards Efficient Multi-Task Satellite Imagery Road Extraction via Patch-Wise Keypoints Detectioncited by 2
- 2024Recoverable Anonymization for Pose Estimation: A Privacy-Enhancing Approachcited by 2
- 2024The Influence of Faulty Labels in Data Sets on Human Pose Estimationcited by 2
- 2024Adaptive Multi-Modal Control of Digital Human Hand Synthesis Using a Region-Aware Cycle Losscited by 2
- 2021Orderly Dual-Teacher Knowledge Distillation for Lightweight Human Pose Estimationcited by 1
- 2021FasterPose: A Faster Simple Baseline for Human Pose Estimationcited by 1
- 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recoverycited by 1
- 2024LanePtrNet: Revisiting Lane Detection as Point Voting and Grouping on Curvescited by 1
- 2024G3R: Generating Rich and Fine-grained mmWave Radar Data from 2D Videos for Generalized Gesture Recognitioncited by 1
- 2025VISUALCENT: Visual Human Analysis using Dynamic Centroid Representationcited by 1
50 most cited of 65 All 65 (JSON)
- 2025Keypoints as Dynamic Centroids for Unified Human Pose and Segmentation17 May 2025
- 2025VISUALCENT: Visual Human Analysis using Dynamic Centroid Representation26 Apr 2025
- 2025Incremental Object Keypoint Learning26 Mar 2025
- 2025Learning semantical dynamics and spatiotemporal collaboration for human pose estimation in video15 Feb 2025
- 2025Refinement Module based on Parse Graph for Human Pose Estimation19 Jan 2025
- 2024Video2Reward: Generating Reward Function from Videos for Legged Robot Behavior Learning7 Dec 2024
- 2024HRPVT: High-Resolution Pyramid Vision Transformer for medium and small-scale human pose estimation29 Oct 2024
- 2024Adaptive Multi-Modal Control of Digital Human Hand Synthesis Using a Region-Aware Cycle Loss13 Sep 2024
- 2024The Influence of Faulty Labels in Data Sets on Human Pose Estimation5 Sep 2024
- 2024Recoverable Anonymization for Pose Estimation: A Privacy-Enhancing Approach1 Sep 2024
- 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation11 Jul 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
38 more
- 2024PoseBench: Benchmarking the Robustness of Pose Estimation Models under Corruptions20 Jun 2024
- 2024Can Dense Connectivity Benefit Outlier Detection? An Odyssey with NAS4 Jun 2024
- 2024G3R: Generating Rich and Fine-grained mmWave Radar Data from 2D Videos for Generalized Gesture Recognition23 Apr 2024
- 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Results22 Apr 2024
- 2024LanePtrNet: Revisiting Lane Detection as Point Voting and Grouping on Curves8 Mar 2024
- 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recovery25 Jan 2024
- 2024Mutual Distillation Learning For Person Re-Identification12 Jan 2024
- 2023SniffyArt: The Dataset of Smelling Persons20 Nov 2023
- 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Survey19 Oct 2023
- 2023Lightweight Super-Resolution Head for Human Pose Estimation31 Jul 2023
- 2023Human Body Pose Estimation for Gait Identification: A Comprehensive Survey of Datasets and Models23 May 2023
- 2023Global Relation Modeling and Refinement for Bottom-Up Human Pose Estimation27 Mar 2023
- 2023Human Pose as Compositional Tokens21 Mar 2023
- 2023Mutual Information-Based Temporal Difference Learning for Human Pose Estimation in Video15 Mar 2023
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose13 Mar 2023
- 2023PaRK-Detect: Towards Efficient Multi-Task Satellite Imagery Road Extraction via Patch-Wise Keypoints Detection26 Feb 2023
- 2023Bias-Compensated Integral Regression for Human Pose Estimation25 Jan 2023
- 2023E3Pose: Energy-Efficient Edge-assisted Multi-camera System for Multi-human 3D Pose Estimation21 Jan 2023
- 2022ViTPose++: Vision Transformer for Generic Body Pose Estimation7 Dec 2022
- 2022Efficient Mirror Detection via Multi-level Heterogeneous Learning28 Nov 2022
- 2022DPIT: Dual-Pipeline Integrated Transformer for Human Pose Estimation2 Sep 2022
- 2022Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimation29 Jul 2022
- 2022Lightweight Human Pose Estimation Using Heatmap-Weighting Loss21 May 2022
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging20 May 2022
- 2022ConfLab: A Data Collection Concept, Dataset, and Benchmark for Machine Analysis of Free-Standing Social Interactions in the Wild10 May 2022
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation26 Apr 2022
- 2022BTranspose: Bottleneck Transformers for Human Pose Estimation with Self-Supervised Pre-Training21 Apr 2022
- 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstruction17 Apr 2022
- 20222D Human Pose Estimation: A Survey15 Apr 2022
- 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Training6 Apr 2022
- 2022Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction9 Mar 2022
- 2022HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging4 Mar 2022
- 2022Towards Simple and Accurate Human Pose Estimation with Stair Network18 Feb 2022
- 2022Poseur: Direct Human Pose Regression with Transformers19 Jan 2022
- 2022Flow-Guided Sparse Transformer for Video Deblurring6 Jan 2022
- 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmark3 Jan 2022
- 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction15 Nov 2021
- 2021The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person Pose Estimation11 Oct 2021
50 newest of 65 All 65 (JSON)
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
- 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstructioncited by 110
- 2021TokenPose: Learning Keypoint Tokens for Human Pose Estimationcited by 106
- 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
- 2021SimCC: a Simple Coordinate Classification Perspective for Human Pose Estimationcited by 68
- 2022Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstructioncited by 67
- 2022HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imagingcited by 66
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
- 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
- 2021Deep Dual Consecutive Network for Human Pose Estimationcited by 51
12 most cited of 64 All 64 (JSON)
- 2025Keypoints as Dynamic Centroids for Unified Human Pose and Segmentation17 May 2025
- 2025VISUALCENT: Visual Human Analysis using Dynamic Centroid Representation26 Apr 2025
- 2025Incremental Object Keypoint Learning26 Mar 2025
- 2025Learning semantical dynamics and spatiotemporal collaboration for human pose estimation in video15 Feb 2025
- 2025Refinement Module based on Parse Graph for Human Pose Estimation19 Jan 2025
- 2024Video2Reward: Generating Reward Function from Videos for Legged Robot Behavior Learning7 Dec 2024
- 2024HRPVT: High-Resolution Pyramid Vision Transformer for medium and small-scale human pose estimation29 Oct 2024
- 2024The Influence of Faulty Labels in Data Sets on Human Pose Estimation5 Sep 2024
- 2024Recoverable Anonymization for Pose Estimation: A Privacy-Enhancing Approach1 Sep 2024
- 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation11 Jul 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024PoseBench: Benchmarking the Robustness of Pose Estimation Models under Corruptions20 Jun 2024
12 newest of 64 All 64 (JSON)