ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wild
Not on the map. Why?
Abstract (arXiv)
This paper investigates the task of 2D whole-body human pose estimation, which aims to localize dense landmarks on the entire human body including body, feet, face, and hands. We propose a single-network approach, termed ZoomNet, to take into account the hierarchical structure of the full human body and solve the scale variation of different body parts. We further propose a neural architecture search framework, termed ZoomNAS, to promote both the accuracy and efficiency of whole-body pose estimation. ZoomNAS jointly searches the model architecture and the connections between different sub-modules, and automatically allocates computational complexity for searched sub-modules. To train and evaluate ZoomNAS, we introduce the first large-scale 2D human whole-body dataset, namely COCO-WholeBody V1.0, which annotates 133 keypoints for in-the-wild images. Extensive experiments demonstrate the effectiveness of ZoomNAS and the significance of COCO-WholeBody V1.0.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 88 of its 144 references that are in the map. First posted on arXiv 23 Aug 2022.
Builds on
88 of 144 references.
References · 88
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2018DARTS: Differentiable Architecture Searchcited by 1,798
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
38 more
- 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,101
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 943
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2018Regularized Evolution for Image Classifier Architecture Searchcited by 909
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 787
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 673
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
- 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
- 2017Progressive Neural Architecture Searchcited by 487
- 2018FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Searchcited by 485
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
- 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
- 2016RMPE: Regional Multi-person Pose Estimationcited by 340
- 2016Convolutional Pose Machinescited by 325
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 2015WIDER FACE: A Face Detection Benchmarkcited by 298
- 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
- 2021Mesh Graphormercited by 265
- 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
- 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
- 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
- 2019Universally Slimmable Networks and Improved Training Techniquescited by 221
- 2018CrowdPose: Efficient Crowded Scenes Pose Estimation and A New Benchmarkcited by 214
- 2016Associative Embedding: End-to-End Learning for Joint Detection and Groupingcited by 212
- 20193D Hand Shape and Pose from Images in the Wildcited by 190
- 2020BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Modelscited by 188
- 2020Whole-Body Human Pose Estimation in the Wildcited by 178
- 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
- 2019Distribution-Aware Coordinate Representation for Human Pose Estimationcited by 165
- 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
- 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
- 2018Look at Boundary: A Boundary-Aware Face Alignment Algorithmcited by 138
- 2018PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Modelcited by 133
- 2017Towards Accurate Multi-person Pose Estimation in the Wildcited by 131
50 most cited of 88 All 88 (JSON)
Built on by
Citing papers per year: 2023: 5; 2024: 11; 2025: 2; 2026: 5.
23 papers.
Sort:
By area:
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 59
- 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimationcited by 19
- 2023Unsupervised Keypoints from Pretrained Diffusion Modelscited by 15
- 2024MotionBank: A Large-scale Video Motion Benchmark with Disentangled Rule-based Annotationscited by 14
- 2024TCFormer: Visual Recognition via Token Clustering Transformercited by 12
- 2023You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perceptioncited by 9
- 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimationcited by 6
- 2024Motion Capture from Inertial and Vision Sensorscited by 4
11 more
- 2024UniFS: Universal Few-shot Instance Perception with Point Representationscited by 2
- 2026KPM-Bench: A Kinematic Parsing Motion Benchmark for Fine-grained Motion-centric Video Understandingcited by 2
- 2024PAFUSE: Part-based Diffusion for 3D Whole-Body Pose Estimationcited by 1
- 2026CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimationcited by 1
- 2024Automated Patient Positioning with Learned 3D Hand Gesturescited by 0
- 2024Y-MAP-Net: Real-time depth, normals, segmentation, multi-label captioning and 2D human pose in RGB imagescited by 0
- 2025Two-Stream Spatial-Temporal Transformer Framework for Person Identification via Natural Conversational Keypointscited by 0
- 2025AI-Based Stroke Rehabilitation Domiciliary Assessment System with ST_GCN Attentioncited by 0
- 2026Gesture Matters: Pedestrian Gesture Recognition for AVs Through Skeleton Pose Evaluationcited by 0
- 2026Improving 3D Foot Motion Reconstruction in Markerless Monocular Human Motion Capturecited by 0
- 2026Monocular Models are Strong Learners for Multi-View Human Mesh Recoverycited by 0
- 2026Monocular Models are Strong Learners for Multi-View Human Mesh Recovery20 Mar 2026
- 2026Improving 3D Foot Motion Reconstruction in Markerless Monocular Human Motion Capture10 Mar 2026
- 2026CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation10 Mar 2026
- 2026KPM-Bench: A Kinematic Parsing Motion Benchmark for Fine-grained Motion-centric Video Understanding19 Feb 2026
- 2026Gesture Matters: Pedestrian Gesture Recognition for AVs Through Skeleton Pose Evaluation9 Feb 2026
- 2025AI-Based Stroke Rehabilitation Domiciliary Assessment System with ST_GCN Attention27 Sep 2025
- 2025Two-Stream Spatial-Temporal Transformer Framework for Person Identification via Natural Conversational Keypoints28 Feb 2025
- 2024Y-MAP-Net: Real-time depth, normals, segmentation, multi-label captioning and 2D human pose in RGB images15 Nov 2024
- 2024MotionBank: A Large-scale Video Motion Benchmark with Disentangled Rule-based Annotations17 Oct 2024
- 2024Sapiens: Foundation for Human Vision Models22 Aug 2024
- 2024Motion Capture from Inertial and Vision Sensors23 Jul 2024
- 2024Automated Patient Positioning with Learned 3D Hand Gestures20 Jul 2024
11 more
- 2024TCFormer: Visual Recognition via Token Clustering Transformer16 Jul 2024
- 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimation15 Jul 2024
- 2024PAFUSE: Part-based Diffusion for 3D Whole-Body Pose Estimation14 Jul 2024
- 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation11 Jul 2024
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimation10 Jul 2024
- 2024UniFS: Universal Few-shot Instance Perception with Point Representations30 Apr 2024
- 2023You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perception9 Dec 2023
- 2023Unsupervised Keypoints from Pretrained Diffusion Models29 Nov 2023
- 2023Effective Whole-body Pose Estimation with Two-stages Distillation29 Jul 2023
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset3 Jul 2023
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose13 Mar 2023
- 2023Unsupervised Keypoints from Pretrained Diffusion Modelscited by 15
- 2023Unsupervised Keypoints from Pretrained Diffusion Models29 Nov 2023
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 59
- 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimationcited by 19
- 2024MotionBank: A Large-scale Video Motion Benchmark with Disentangled Rule-based Annotationscited by 14
- 2024TCFormer: Visual Recognition via Token Clustering Transformercited by 12
- 2023You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perceptioncited by 9
- 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimationcited by 6
- 2024Motion Capture from Inertial and Vision Sensorscited by 4
- 2024UniFS: Universal Few-shot Instance Perception with Point Representationscited by 2
12 most cited of 22 All 22 (JSON)
- 2026Monocular Models are Strong Learners for Multi-View Human Mesh Recovery20 Mar 2026
- 2026Improving 3D Foot Motion Reconstruction in Markerless Monocular Human Motion Capture10 Mar 2026
- 2026CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation10 Mar 2026
- 2026KPM-Bench: A Kinematic Parsing Motion Benchmark for Fine-grained Motion-centric Video Understanding19 Feb 2026
- 2026Gesture Matters: Pedestrian Gesture Recognition for AVs Through Skeleton Pose Evaluation9 Feb 2026
- 2025AI-Based Stroke Rehabilitation Domiciliary Assessment System with ST_GCN Attention27 Sep 2025
- 2025Two-Stream Spatial-Temporal Transformer Framework for Person Identification via Natural Conversational Keypoints28 Feb 2025
- 2024Y-MAP-Net: Real-time depth, normals, segmentation, multi-label captioning and 2D human pose in RGB images15 Nov 2024
- 2024MotionBank: A Large-scale Video Motion Benchmark with Disentangled Rule-based Annotations17 Oct 2024
- 2024Sapiens: Foundation for Human Vision Models22 Aug 2024
- 2024Motion Capture from Inertial and Vision Sensors23 Jul 2024
- 2024Automated Patient Positioning with Learned 3D Hand Gestures20 Jul 2024
12 newest of 22 All 22 (JSON)