DiffPose-Animal: A Language-Conditioned Diffusion Framework for Animal Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Animal pose estimation is a fundamental task in computer vision, with growing importance in ecological monitoring, behavioral analysis, and intelligent livestock management. Compared to human pose estimation, animal pose estimation is more challenging due to high interspecies morphological diversity, complex body structures, and limited annotated data. In this work, we introduce DiffPose-Animal, a novel diffusion-based framework for top-down animal pose estimation. Unlike traditional heatmap regression methods, DiffPose-Animal reformulates pose estimation as a denoising process under the generative framework of diffusion models. To enhance semantic guidance during keypoint generation, we leverage large language models (LLMs) to extract both global anatomical priors and local keypoint-wise semantics based on species-specific prompts. These textual priors are encoded and fused with image features via cross-attention modules to provide biologically meaningful constraints throughout the denoising process. Additionally, a diffusion-based keypoint decoder is designed to progressively refine pose predictions, improving robustness to occlusion and annotation sparsity. Extensive experiments on public animal pose datasets demonstrate the effectiveness and generalization capability of our method, especially under challenging scenarios with diverse species, cluttered backgrounds, and incomplete keypoints.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 47 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
36 of 47 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024GPT-4o System Cardcited by 4,588
- 2022Video Diffusion Modelscited by 2,305
24 more
- 2023Consistency Modelscited by 1,822
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
- 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 207
- 2018Markerless tracking of user-defined features with deep learningcited by 206
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
- 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2021AP-10K: A Benchmark for Animal Pose Estimation in the Wildcited by 123
- 2015DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimationcited by 117
- 2019Cross-Domain Adaptation for Animal Pose Estimationcited by 108
- 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 103
- 2021SimCC: a Simple Coordinate Classification Perspective for Human Pose Estimationcited by 68
- 2019Learning from Synthetic Animalscited by 65
- 2021From Synthetic to Real: Unsupervised Domain Adaptation for Animal Pose Estimationcited by 48
- 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 44
- 2023RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimationcited by 34
- 2023DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embeddingcited by 22
- 2023ScarceNet: Animal Pose Estimation with Scarce Annotationscited by 13
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025AP-CAP: Advancing High-Quality Data Synthesis for Animal Pose Estimation via a Controllable Image Generation Pipeline
- 2025Probabilistic Prompt Distribution Learning for Animal Pose Estimation
- 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformer
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models
- 2022DiffPose: Toward More Reliable 3D Pose Estimation
- 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces
- 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimation
- 2026BehaviorVLM: Unified Finetuning-Free Behavioral Understanding with Vision-Language Reasoning