mlsanityData to 7 Oct 2026

SAM 3D Animal: Promptable Animal 3D Reconstruction from Images in the Wild

arXiv 2605.07604 ↗First posted 8 May 2026cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

3D animal reconstruction in the wild remains challenging due to large species variation, frequent occlusions, and the prevalence of multi-animal scenes, while existing methods predominantly focus on single-animal settings. We present SAM 3D Animal, the first promptable framework for multi-animal 3D reconstruction from a single image. Built on the SMAL+ parametric animal model, our method jointly reconstructs multiple instances and supports flexible prompts in the form of keypoints and masks which enable more reliable disambiguation in crowded and occluded scenes. To train such a model, we further introduce Herd3D, a multi-animal 3D dataset containing over 5K images, designed to increase diversity in species, interactions, and occlusion patterns. Experiments on the Animal3D, APTv2, and Animal Kingdom datasets show that our framework achieves state-of-the-art results over both existing model-based and model-free methods, demonstrating a scalable and effective solution for prompt-driven animal 3D reconstruction in the wild.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

42 of 51 references.

References · 42

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2020End-to-End Object Detection with Transformerscited by 7,384
  4. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  5. 2017End-to-end Recovery of Human Shape and Posecited by 883
  6. 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
  7. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
  8. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
  9. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
  10. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
  11. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
  12. 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 111
30 more
  1. 2019Cross-Domain Adaptation for Animal Pose Estimationcited by 108
  2. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
  3. 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 102
  4. 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
  5. 2020Shape and Viewpoint without Keypointscited by 92
  6. 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
  7. 2020Who Left the Dogs Out? 3D Animal Reconstruction with Expectation Maximization in the Loopcited by 81
  8. 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
  9. 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 65
  10. 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
  11. 2024Learning the 3D Fauna of the Webcited by 58
  12. 2022APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Trackingcited by 55
  13. 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
  14. 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 43
  15. 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 37
  16. 2021De-rendering the World's Revolutionary Artefactscited by 28
  17. 2024AniMer: Animal Pose and Shape Estimation Using Family Aware Transformercited by 20
  18. 2021hSMAL: Detailed Horse Shape and Pose Reconstruction for Motion Pattern Recognitioncited by 18
  19. 2021A Novel Dataset for Keypoint Detection of quadruped Animals from Imagescited by 18
  20. 2023SAOR: Single-View Articulated Object Reconstructioncited by 15
  21. 2024SAT-HMR: Real-Time Multi-Person 3D Mesh Estimation via Scale-Adaptive Tokenscited by 15
  22. 2024AWOL: Analysis WithOut synthesis using Languagecited by 12
  23. 2024Generative Zoocited by 12
  24. 2025SAM-Body4D: Training-Free 4D Human Body Mesh Recovery from Videoscited by 8
  25. 2024Reconstructing Animals and the Wildcited by 7
  26. 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformercited by 7
  27. 20264DEquine: Disentangling Motion and Appearance for 4D Equine Reconstruction from Monocular Videocited by 2
  28. 2026AnyLift: Scaling Motion Reconstruction from Internet Videos via 2D Diffusioncited by 2
  29. 2026Monocular Mesh Recovery and Body Measurement of Female Saanen Goatscited by 1
  30. 2026SMAL-pets: SMAL Based Avatars of Pets from Single Imagecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.