mlsanityData to 14 Oct 2026

DiffPose-Animal: A Language-Conditioned Diffusion Framework for Animal Pose Estimation

arXiv 2508.08783 ↗First posted 12 Aug 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Animal pose estimation is a fundamental task in computer vision, with growing importance in ecological monitoring, behavioral analysis, and intelligent livestock management. Compared to human pose estimation, animal pose estimation is more challenging due to high interspecies morphological diversity, complex body structures, and limited annotated data. In this work, we introduce DiffPose-Animal, a novel diffusion-based framework for top-down animal pose estimation. Unlike traditional heatmap regression methods, DiffPose-Animal reformulates pose estimation as a denoising process under the generative framework of diffusion models. To enhance semantic guidance during keypoint generation, we leverage large language models (LLMs) to extract both global anatomical priors and local keypoint-wise semantics based on species-specific prompts. These textual priors are encoded and fused with image features via cross-attention modules to provide biologically meaningful constraints throughout the denoising process. Additionally, a diffusion-based keypoint decoder is designed to progressively refine pose predictions, improving robustness to occlusion and annotation sparsity. Extensive experiments on public animal pose datasets demonstrate the effectiveness and generalization capability of our method, especially under challenging scenarios with diverse species, cluttered backgrounds, and incomplete keypoints.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 47 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

36 of 47 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  10. 2022Scalable Diffusion Models with Transformerscited by 6,054
  11. 2024GPT-4o System Cardcited by 4,588
  12. 2022Video Diffusion Modelscited by 2,305
24 more
  1. 2023Consistency Modelscited by 1,822
  2. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  3. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
  4. 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
  5. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
  6. 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
  7. 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
  8. 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
  9. 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 207
  10. 2018Markerless tracking of user-defined features with deep learningcited by 206
  11. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
  12. 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
  13. 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
  14. 2021AP-10K: A Benchmark for Animal Pose Estimation in the Wildcited by 123
  15. 2015DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimationcited by 117
  16. 2019Cross-Domain Adaptation for Animal Pose Estimationcited by 108
  17. 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 103
  18. 2021SimCC: a Simple Coordinate Classification Perspective for Human Pose Estimationcited by 68
  19. 2019Learning from Synthetic Animalscited by 65
  20. 2021From Synthetic to Real: Unsupervised Domain Adaptation for Animal Pose Estimationcited by 48
  21. 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 44
  22. 2023RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimationcited by 34
  23. 2023DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embeddingcited by 22
  24. 2023ScarceNet: Animal Pose Estimation with Scarce Annotationscited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025AP-CAP: Advancing High-Quality Data Synthesis for Animal Pose Estimation via a Controllable Image Generation Pipeline
  2. 2025Probabilistic Prompt Distribution Learning for Animal Pose Estimation
  3. 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformer
  4. 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models
  5. 2022DiffPose: Toward More Reliable 3D Pose Estimation
  6. 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces
  7. 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimation
  8. 2026BehaviorVLM: Unified Finetuning-Free Behavioral Understanding with Vision-Language Reasoning