AP-10K: A Benchmark for Animal Pose Estimation in the Wild
Not on the map. Why?
Abstract (arXiv)
Accurate animal pose estimation is an essential step towards understanding animal behavior, and can potentially benefit many downstream applications, such as wildlife conservation. Previous works only focus on specific animals while ignoring the diversity of animal species, limiting the generalization ability. In this paper, we propose AP-10K, the first large-scale benchmark for mammal animal pose estimation, to facilitate the research in animal pose estimation. AP-10K consists of 10,015 images collected and filtered from 23 animal families and 54 species following the taxonomic rank and high-quality keypoint annotations labeled and checked manually. Based on AP-10K, we benchmark representative pose estimation models on the following three tracks: (1) supervised learning for animal pose estimation, (2) cross-domain transfer learning from human pose estimation to animal pose estimation, and (3) intra- and inter-family domain generalization for unseen animals. The experimental results provide sound empirical evidence on the superiority of learning from diverse animals species in terms of both accuracy and generalization ability. It opens new directions for facilitating future research in animal pose estimation. AP-10k is publicly available at https://github.com/AlexTheBad/AP10K.
Key facts. Cited by 123 papers in the map (data through 7 Oct 2026). Builds on 26 of its 66 references that are in the map. First posted on arXiv 28 Aug 2021.
Builds on
26 of 66 references.
References · 26
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Mask R-CNNcited by 7,259
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
14 more
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 766
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
- 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
- 2018Rethinking ImageNet Pre-trainingcited by 376
- 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
- 2018CrowdPose: Efficient Crowded Scenes Pose Estimation and A New Benchmarkcited by 214
- 2016Associative Embedding: End-to-End Learning for Joint Detection and Groupingcited by 211
- 2015Semi-supervised Sequence Learningcited by 198
- 2020Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Thingscited by 110
- 2019Cross-Domain Adaptation for Animal Pose Estimationcited by 108
- 2018Pose2Seg: Detection Free Human Instance Segmentationcited by 107
- 2019Pretraining boosts out-of-domain robustness for pose estimationcited by 47
- 2018Glimpse Clouds: Human Activity Recognition from Unstructured Feature Pointscited by 33
- 2020Towards High Performance Human Keypoint Detectioncited by 20
Built on by
Citing papers per year: 2021: 1; 2022: 21; 2023: 19; 2024: 25; 2025: 32; 2026: 25.
123 papers.
Sort:
By area:
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 136
- 2022ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyondcited by 117
- 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 102
- 2023Telling Left from Right: Identifying Geometry-Aware Semantic Correspondencecited by 85
- 2024TAPVid-3D: A Benchmark for Tracking Any Point in 3Dcited by 69
- 2025Detect Anything via Next Point Predictioncited by 66
- 2022MAFW: A Large-scale, Multi-modal, Compound Affective Database for Dynamic Facial Expression Recognition in the Wildcited by 65
- 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
- 2022APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Trackingcited by 55
38 more
- 2022Shape-Guided Diffusion with Inside-Outside Attentioncited by 45
- 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 43
- 2022SuperAnimal pretrained pose estimation models for behavioral analysiscited by 38
- 2022AnimalTrack: A Benchmark for Multi-Animal Tracking in the Wildcited by 37
- 2022Pose for Everything: Towards Category-Agnostic Pose Estimationcited by 36
- 2024Position: Measure Dataset Diversity, Don't Just Claim Itcited by 26
- 2022CLAMP: Prompt-based Contrastive Learning for Connecting Language and Animal Posecited by 25
- 2023ChimpACT: A Longitudinal Dataset for Understanding Chimpanzee Behaviorscited by 24
- 2024OmniControlNet: Dual-stage Integration for Conditional Image Generationcited by 24
- 2023X-Pose: Detecting Any Keypointscited by 21
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activationscited by 20
- 2022Object Localization under Single Coarse Point Supervisioncited by 18
- 20233D-POP -- An automated annotation approach to facilitate markerless 2D-3D tracking of freely moving birds with marker-based motion capturecited by 18
- 2023A Graph-Based Approach for Category-Agnostic Pose Estimationcited by 16
- 2022Data Representativity for Machine Learning and AI Systemscited by 15
- 2024AutoMMLab: Automatically Generating Deployable Models from Language Instructions for Computer Vision Taskscited by 14
- 2023ScarceNet: Animal Pose Estimation with Scarce Annotationscited by 13
- 2025Do It Yourself: Learning Semantic Correspondence from Pseudo-Labelscited by 13
- 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglementcited by 13
- 2025MATCHA:Towards Matching Anythingcited by 12
- 2021RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning?cited by 11
- 2024EgoPet: Egomotion and Interaction Data from an Animal's Perspectivecited by 11
- 2022OpenApePose: a database of annotated ape photographs for pose estimationcited by 10
- 2023Open-Vocabulary Animal Keypoint Detection with Semantic-feature Matchingcited by 10
- 2024Computer Vision for Primate Behavior Analysis in the Wildcited by 10
- 2024CapeX: Category-Agnostic Pose Estimation from Textual Point Explanationcited by 9
- 2022Hierarchical Few-Shot Object Detection: Problem, Benchmark and Methodcited by 8
- 2023Enhancing Visual Grounding and Generalization: A Multi-Task Cycle Training Approach for Vision-Language Modelscited by 8
- 2023APTv2: Benchmarking Animal Pose Estimation and Tracking with a Large-scale Dataset and Beyondcited by 8
- 2024Eye-for-an-eye: Appearance Transfer with Semantic Correspondence in Diffusion Modelscited by 8
- 2025Fine-Grained Zero-Shot Object Detectioncited by 8
- 2025Web-Scale Collection of Video Data for 4D Animal Reconstructioncited by 8
- 2022Multi-view Tracking, Re-ID, and Social Network Analysis of a Flock of Visually Similar Birds in an Outdoor Aviarycited by 7
- 2023UniAP: Towards Universal Animal Perception in Vision via Few-shot Learningcited by 7
- 2022Prior-Aware Synthetic Data to the Rescue: Animal Pose Estimation with Very Limited Real Datacited by 6
- 2023Synthetic Data-based Detection of Zebras in Drone Imagerycited by 6
- 2023SPAC-Net: Synthetic Pose-aware Animal ControlNet for Enhanced Pose Estimationcited by 6
- 2024Chameleon: A Data-Efficient Generalist for Dense Visual Prediction in the Wildcited by 6
50 most cited of 123 All 123 (JSON)
- 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animals29 Sep 2026
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking28 Sep 2026
- 2026Kernel-Based Steering of CLIP with Vision-Language Model Preferences26 Sep 2026
- 2026ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding24 Sep 2026
- 2026Diffusion Trajectory Modeling for Semantic Correspondence14 Sep 2026
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026Promptable Animal Pose Tracking Across Species5 Aug 2026
- 2026Subtoken Vision Transformer for Fine-grained Recognition10 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026BAT3R: Bootstrapping Articulated 3D Reconstruction from 2D Image Collections4 Jul 2026
- 2026Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulation3 Jul 2026
- 2026GKDT: General Keypoint Detection Transformer1 Jul 2026
38 more
- 2026Quo Vadis, Visual In-Context Learning? A Unified Benchmark Across Domains and Tasks9 Jun 2026
- 2026SOCO: Benchmarking Semantic Object Correspondence in Vision Foundation Models29 May 2026
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence28 May 2026
- 2026AnyAct: Towards Human Reenactment of Character Motion From Video15 May 2026
- 2026GenCape: Structure-Inductive Generative Modeling for Category-Agnostic Pose Estimation13 May 2026
- 2026MARCO: Navigating the Unseen Space of Semantic Correspondence20 Apr 2026
- 2026CHIRP dataset: towards long-term, individual-level, behavioral monitoring of bird populations in the wild26 Mar 2026
- 2026RatSeizure: A Benchmark and Saliency-Context Transformer for Rat Seizure Localization25 Mar 2026
- 2026BioVITA: Biological Dataset, Model, and Benchmark for Visual-Textual-Acoustic Alignment25 Mar 2026
- 2026FSMC-Pose: Frequency and Spatial Fusion with Multiscale Self-calibration for Cattle Mounting Pose Estimation17 Mar 2026
- 2026Shape-of-You: Fused Gromov-Wasserstein Optimal Transport for Semantic Correspondence in-the-Wild12 Mar 2026
- 2026BigMaQ: A Big Macaque Motion and Animation Dataset Bridging Image and 3D Pose Representations23 Feb 2026
- 2026NeuralFur: Animal Fur Reconstruction From Multi-View Images18 Jan 2026
- 2025Web-Scale Collection of Video Data for 4D Animal Reconstruction3 Nov 2025
- 2025DogMo: A Large-Scale Multi-View RGB-D Dataset for 4D Canine Motion Recovery28 Oct 2025
- 2025Talking Points: Describing and Localizing Pixels16 Oct 2025
- 2025Detect Anything via Next Point Prediction14 Oct 2025
- 2025An uncertainty-aware framework for data-efficient multi-view animal pose estimation10 Oct 2025
- 2025Towards Geometry-Grounded Dense Semantic Matching with VGGT Priors25 Sep 2025
- 2025Parse Graph-Based Visual-Language Interaction for Human Pose Estimation9 Sep 2025
- 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglement2 Sep 2025
- 2025Performance is not All You Need: Sustainability Considerations for Algorithms24 Aug 2025
- 2025Advances and Trends in the 3D Reconstruction of the Shape and Motion of Animals22 Aug 2025
- 2025DiffPose-Animal: A Language-Conditioned Diffusion Framework for Animal Pose Estimation12 Aug 2025
- 2025Dynamic Pattern Alignment Learning for Pretraining Lightweight Human-Centric Vision Models10 Aug 2025
- 2025AnimalClue: Recognizing Animals by their Traces27 Jul 2025
- 2025Unsupervised Monocular 3D Keypoint Discovery from Multi-View Diffusion Priors16 Jul 2025
- 2025KptLLM++: Towards Generic Keypoint Comprehension with Large Language Model15 Jul 2025
- 2025Fine-Grained Zero-Shot Object Detection14 Jul 2025
- 2025Animal behavioral analysis and neural encoding with transformer-based self-supervised pretraining13 Jul 2025
- 2025UniMC: Taming Diffusion Transformer for Unified Keypoint-Guided Multi-Class Image Generation3 Jul 2025
- 2025Rethink Sparse Signals for Pose-guided Text-to-image Generation26 Jun 2025
- 2025Do It Yourself: Learning Semantic Correspondence from Pseudo-Labels5 Jun 2025
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activations24 May 2025
- 2025Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance23 May 2025
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baseline23 May 2025
- 2025PoseBH: Prototypical Multi-Dataset Training Beyond Human Pose Estimation23 May 2025
- 2025AP-CAP: Advancing High-Quality Data Synthesis for Animal Pose Estimation via a Controllable Image Generation Pipeline1 Apr 2025
50 newest of 123 All 123 (JSON)
- 2022Shape-Guided Diffusion with Inside-Outside Attentioncited by 45
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activationscited by 20
- 2024Eye-for-an-eye: Appearance Transfer with Semantic Correspondence in Diffusion Modelscited by 8
- 2025UniMC: Taming Diffusion Transformer for Unified Keypoint-Guided Multi-Class Image Generationcited by 2
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondencecited by 1
- 2025Unsupervised Monocular 3D Keypoint Discovery from Multi-View Diffusion Priorscited by 0
- 2026Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulationcited by 0
- 2026Diffusion Trajectory Modeling for Semantic Correspondencecited by 0
- 2026Diffusion Trajectory Modeling for Semantic Correspondence14 Sep 2026
- 2026Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulation3 Jul 2026
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence28 May 2026
- 2025Unsupervised Monocular 3D Keypoint Discovery from Multi-View Diffusion Priors16 Jul 2025
- 2025UniMC: Taming Diffusion Transformer for Unified Keypoint-Guided Multi-Class Image Generation3 Jul 2025
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activations24 May 2025
- 2024Eye-for-an-eye: Appearance Transfer with Semantic Correspondence in Diffusion Models11 Jun 2024
- 2022Shape-Guided Diffusion with Inside-Outside Attention1 Dec 2022
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 136
- 2023Enhancing Visual Grounding and Generalization: A Multi-Task Cycle Training Approach for Vision-Language Modelscited by 8
- 2024KptLLM: Unveiling the Power of Large Language Model for Keypoint Comprehensioncited by 5
- 2024CapeLLM: Support-Free Category-Agnostic Pose Estimation with Multimodal Large Language Modelscited by 2
- 2025KptLLM++: Towards Generic Keypoint Comprehension with Large Language Modelcited by 0
- 2025Talking Points: Describing and Localizing Pixelscited by 0
- 2026Kernel-Based Steering of CLIP with Vision-Language Model Preferencescited by 0
- 2026Kernel-Based Steering of CLIP with Vision-Language Model Preferences26 Sep 2026
- 2025Talking Points: Describing and Localizing Pixels16 Oct 2025
- 2025KptLLM++: Towards Generic Keypoint Comprehension with Large Language Model15 Jul 2025
- 2024CapeLLM: Support-Free Category-Agnostic Pose Estimation with Multimodal Large Language Models11 Nov 2024
- 2024KptLLM: Unveiling the Power of Large Language Model for Keypoint Comprehension4 Nov 2024
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks12 Jun 2024
- 2023Enhancing Visual Grounding and Generalization: A Multi-Task Cycle Training Approach for Vision-Language Models21 Nov 2023
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
- 2022ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyondcited by 117
- 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 102
- 2023Telling Left from Right: Identifying Geometry-Aware Semantic Correspondencecited by 85
- 2024TAPVid-3D: A Benchmark for Tracking Any Point in 3Dcited by 69
- 2025Detect Anything via Next Point Predictioncited by 66
- 2022MAFW: A Large-scale, Multi-modal, Compound Affective Database for Dynamic Facial Expression Recognition in the Wildcited by 65
- 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
- 2022APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Trackingcited by 55
- 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 43
12 most cited of 106 All 106 (JSON)
- 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animals29 Sep 2026
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking28 Sep 2026
- 2026ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding24 Sep 2026
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026Promptable Animal Pose Tracking Across Species5 Aug 2026
- 2026Subtoken Vision Transformer for Fine-grained Recognition10 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026BAT3R: Bootstrapping Articulated 3D Reconstruction from 2D Image Collections4 Jul 2026
- 2026GKDT: General Keypoint Detection Transformer1 Jul 2026
- 2026Quo Vadis, Visual In-Context Learning? A Unified Benchmark Across Domains and Tasks9 Jun 2026
- 2026SOCO: Benchmarking Semantic Object Correspondence in Vision Foundation Models29 May 2026
- 2026AnyAct: Towards Human Reenactment of Character Motion From Video15 May 2026
12 newest of 106 All 106 (JSON)