Birds of a Feather: Capturing Avian Shape Models from Images
Not on the map. Why?
Abstract (arXiv)
Animals are diverse in shape, but building a deformable shape model for a new species is not always possible due to the lack of 3D data. We present a method to capture new species using an articulated template and images of that species. In this work, we focus mainly on birds. Although birds represent almost twice the number of species as mammals, no accurate shape model is available. To capture a novel species, we first fit the articulated template to each training sample. By disentangling pose and shape, we learn a shape space that captures variation both among species and within each species from image evidence. We learn models of multiple species from the CUB dataset, and contribute new species-specific and multi-species shape models that are useful for downstream reconstruction tasks. Using a low-dimensional embedding, we show that our learned 3D shape space better reflects the phylogenetic relationships among birds than learned perceptual features.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 31 of its 64 references that are in the map. First posted on arXiv 19 May 2021.
Builds on
31 of 64 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Fast R-CNNcited by 2,930
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
19 more
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
- 2018Video Based Reconstruction of 3D People Modelscited by 237
- 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
- 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
- 2018Detailed Human Avatars from Monocular Videocited by 109
- 2019Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"cited by 106
- 2017Towards Accurate Markerless Human Shape and Pose Estimation over Timecited by 92
- 2020Shape and Viewpoint without Keypointscited by 92
- 2020Who Left the Dogs Out? 3D Animal Reconstruction with Expectation Maximization in the Loopcited by 81
- 2014Category-Specific Object Reconstruction from a Single Imagecited by 56
- 2020Implicit Mesh Reconstruction from Unannotated Image Collectionscited by 49
- 20203D Bird Reconstruction: a Dataset, Model, and Shape Recovery from a Single Viewcited by 40
- 2015Sparse Representation for 3D Shape Estimation: A Convex Relaxation Approachcited by 16
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 2; 2024: 10; 2025: 7; 2026: 6.
30 papers.
Sort:
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 129
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2024Learning the 3D Fauna of the Webcited by 58
- 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videoscited by 26
- 2024AniMer: Animal Pose and Shape Estimation Using Family Aware Transformercited by 20
- 2024AWOL: Analysis WithOut synthesis using Languagecited by 12
- 2024Generative Zoocited by 12
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfercited by 9
- 2025Web-Scale Collection of Video Data for 4D Animal Reconstructioncited by 8
- 2022Multi-view Tracking, Re-ID, and Social Network Analysis of a Flock of Visually Similar Birds in an Outdoor Aviarycited by 7
18 more
- 2024Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Imagescited by 7
- 2024Reconstructing Animals and the Wildcited by 7
- 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformercited by 7
- 20254D-Animal: Freely Reconstructing Animatable 3D Animals from Videoscited by 6
- 2025OG-Gaussian: Occupancy Based Street Gaussians for Autonomous Drivingcited by 5
- 2025Model-based Metric 3D Shape and Motion Reconstruction of Wild Bottlenose Dolphins in Drone-Shot Videoscited by 4
- 2025DogMo: A Large-Scale Multi-View RGB-D Dataset for 4D Canine Motion Recoverycited by 4
- 2026NeuralFur: Animal Fur Reconstruction From Multi-View Imagescited by 4
- 2024Towards Multi-Modal Animal Pose Estimation: A Survey and In-Depth Analysiscited by 2
- 2022Learning-based Monocular 3D Reconstruction of Birds: A Contemporary Surveycited by 1
- 2024CLHOP: Combined Audio-Video Learning for Horse 3D Pose and Shape Estimationcited by 1
- 2024Temporally-consistent 3D Reconstruction of Birdscited by 1
- 2026BigMaQ: A Big Macaque Motion and Animation Dataset Bridging Image and 3D Pose Representationscited by 1
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptationcited by 1
- 2026Kirin: Animal Motion Generation from In-the-Wild Videocited by 1
- 2025Not All Birds Look The Same: Identity-Preserving Generation For Birdscited by 0
- 2026Progressive Pose-Guided 4D Animal Reconstruction from Monocular Videocited by 0
- 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animalscited by 0
- 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animals29 Sep 2026
- 2026Kirin: Animal Motion Generation from In-the-Wild Video1 Sep 2026
- 2026Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video30 Jun 2026
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation1 Jun 2026
- 2026BigMaQ: A Big Macaque Motion and Animation Dataset Bridging Image and 3D Pose Representations23 Feb 2026
- 2026NeuralFur: Animal Fur Reconstruction From Multi-View Images18 Jan 2026
- 2025Not All Birds Look The Same: Identity-Preserving Generation For Birds4 Dec 2025
- 2025Web-Scale Collection of Video Data for 4D Animal Reconstruction3 Nov 2025
- 2025DogMo: A Large-Scale Multi-View RGB-D Dataset for 4D Canine Motion Recovery28 Oct 2025
- 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformer1 Aug 2025
- 20254D-Animal: Freely Reconstructing Animatable 3D Animals from Videos14 Jul 2025
- 2025Model-based Metric 3D Shape and Motion Reconstruction of Wild Bottlenose Dolphins in Drone-Shot Videos22 Apr 2025
18 more
- 2025OG-Gaussian: Occupancy Based Street Gaussians for Autonomous Driving20 Feb 2025
- 2024Generative Zoo11 Dec 2024
- 2024AniMer: Animal Pose and Shape Estimation Using Family Aware Transformer1 Dec 2024
- 2024Reconstructing Animals and the Wild27 Nov 2024
- 2024Towards Multi-Modal Animal Pose Estimation: A Survey and In-Depth Analysis12 Oct 2024
- 2024Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Images4 Oct 2024
- 2024Temporally-consistent 3D Reconstruction of Birds24 Aug 2024
- 2024CLHOP: Combined Audio-Video Learning for Horse 3D Pose and Shape Estimation1 Jul 2024
- 2024AWOL: Analysis WithOut synthesis using Language3 Apr 2024
- 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videos25 Mar 2024
- 2024Learning the 3D Fauna of the Web4 Jan 2024
- 2023GART: Gaussian Articulated Template Models27 Nov 2023
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfer26 Jul 2023
- 2022Multi-view Tracking, Re-ID, and Social Network Analysis of a Flock of Visually Similar Birds in an Outdoor Aviary1 Dec 2022
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstruction27 Oct 2022
- 2022Learning-based Monocular 3D Reconstruction of Birds: A Contemporary Survey10 Jul 2022
- 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Information29 Mar 2022
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservation25 Oct 2021
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 129
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2024Learning the 3D Fauna of the Webcited by 58
- 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videoscited by 26
- 2024AniMer: Animal Pose and Shape Estimation Using Family Aware Transformercited by 20
- 2024AWOL: Analysis WithOut synthesis using Languagecited by 12
- 2024Generative Zoocited by 12
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfercited by 9
- 2025Web-Scale Collection of Video Data for 4D Animal Reconstructioncited by 8
- 2022Multi-view Tracking, Re-ID, and Social Network Analysis of a Flock of Visually Similar Birds in an Outdoor Aviarycited by 7
12 most cited of 30 All 30 (JSON)
- 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animals29 Sep 2026
- 2026Kirin: Animal Motion Generation from In-the-Wild Video1 Sep 2026
- 2026Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video30 Jun 2026
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation1 Jun 2026
- 2026BigMaQ: A Big Macaque Motion and Animation Dataset Bridging Image and 3D Pose Representations23 Feb 2026
- 2026NeuralFur: Animal Fur Reconstruction From Multi-View Images18 Jan 2026
- 2025Not All Birds Look The Same: Identity-Preserving Generation For Birds4 Dec 2025
- 2025Web-Scale Collection of Video Data for 4D Animal Reconstruction3 Nov 2025
- 2025DogMo: A Large-Scale Multi-View RGB-D Dataset for 4D Canine Motion Recovery28 Oct 2025
- 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformer1 Aug 2025
- 20254D-Animal: Freely Reconstructing Animatable 3D Animals from Videos14 Jul 2025
- 2025Model-based Metric 3D Shape and Motion Reconstruction of Wild Bottlenose Dolphins in Drone-Shot Videos22 Apr 2025
12 newest of 30 All 30 (JSON)