SAM 3D Animal: Promptable Animal 3D Reconstruction from Images in the Wild
Not on the map. Why?
Abstract (arXiv)
3D animal reconstruction in the wild remains challenging due to large species variation, frequent occlusions, and the prevalence of multi-animal scenes, while existing methods predominantly focus on single-animal settings. We present SAM 3D Animal, the first promptable framework for multi-animal 3D reconstruction from a single image. Built on the SMAL+ parametric animal model, our method jointly reconstructs multiple instances and supports flexible prompts in the form of keypoints and masks which enable more reliable disambiguation in crowded and occluded scenes. To train such a model, we further introduce Herd3D, a multi-animal 3D dataset containing over 5K images, designed to increase diversity in species, interactions, and occlusion patterns. Experiments on the Animal3D, APTv2, and Animal Kingdom datasets show that our framework achieves state-of-the-art results over both existing model-based and model-free methods, demonstrating a scalable and effective solution for prompt-driven animal 3D reconstruction in the wild.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
42 of 51 references.
References · 42
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 111
30 more
- 2019Cross-Domain Adaptation for Animal Pose Estimationcited by 108
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
- 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 102
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
- 2020Shape and Viewpoint without Keypointscited by 92
- 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
- 2020Who Left the Dogs Out? 3D Animal Reconstruction with Expectation Maximization in the Loopcited by 81
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
- 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 65
- 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
- 2024Learning the 3D Fauna of the Webcited by 58
- 2022APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Trackingcited by 55
- 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
- 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 43
- 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 37
- 2021De-rendering the World's Revolutionary Artefactscited by 28
- 2024AniMer: Animal Pose and Shape Estimation Using Family Aware Transformercited by 20
- 2021hSMAL: Detailed Horse Shape and Pose Reconstruction for Motion Pattern Recognitioncited by 18
- 2021A Novel Dataset for Keypoint Detection of quadruped Animals from Imagescited by 18
- 2023SAOR: Single-View Articulated Object Reconstructioncited by 15
- 2024SAT-HMR: Real-Time Multi-Person 3D Mesh Estimation via Scale-Adaptive Tokenscited by 15
- 2024AWOL: Analysis WithOut synthesis using Languagecited by 12
- 2024Generative Zoocited by 12
- 2025SAM-Body4D: Training-Free 4D Human Body Mesh Recovery from Videoscited by 8
- 2024Reconstructing Animals and the Wildcited by 7
- 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformercited by 7
- 20264DEquine: Disentangling Motion and Appearance for 4D Equine Reconstruction from Monocular Videocited by 2
- 2026AnyLift: Scaling Motion Reconstruction from Internet Videos via 2D Diffusioncited by 2
- 2026Monocular Mesh Recovery and Body Measurement of Female Saanen Goatscited by 1
- 2026SMAL-pets: SMAL Based Avatars of Pets from Single Imagecited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.