Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Images
Not on the map. Why?
Abstract (arXiv)
In recent years, 3D parametric animal models have been developed to aid in estimating 3D shape and pose from images and video. While progress has been made for humans, it's more challenging for animals due to limited annotated data. To address this, we introduce the first method using synthetic data generation and disentanglement to learn to regress 3D shape and pose. Focusing on horses, we use text-based texture generation and a synthetic data pipeline to create varied shapes, poses, and appearances, learning disentangled spaces. Our method, Dessie, surpasses existing 3D horse reconstruction methods and generalizes to other large animals like zebras, cows, and deer. See the project website at: urlhttps://celiali.github.io/Dessie/.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 64 of its 84 references that are in the map. First posted on arXiv 4 Oct 2024.
Builds on
64 of 84 references.
References · 64
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2015Fast R-CNNcited by 2,930
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
38 more
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2018Learning 3D Human Dynamics from Videocited by 315
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 195
- 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 152
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2020Self-supervised Single-view 3D Reconstruction via Semantic Consistencycited by 127
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 111
- 2019Cross-Domain Adaptation for Animal Pose Estimationcited by 108
- 2019Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"cited by 106
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 93
- 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
- 2020Who Left the Dogs Out? 3D Animal Reconstruction with Expectation Maximization in the Loopcited by 81
- 2020Articulation-aware Canonical Surface Mappingcited by 80
- 2019Unsupervised Part-Based Disentangling of Object Shape and Appearancecited by 67
- 2019Learning from Synthetic Animalscited by 65
- 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 65
- 2020Unsupervised Shape and Pose Disentanglement for 3D Meshescited by 61
- 2024Learning the 3D Fauna of the Webcited by 58
- 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
- 2021From Synthetic to Real: Unsupervised Domain Adaptation for Animal Pose Estimationcited by 48
- 2019Pretraining boosts out-of-domain robustness for pose estimationcited by 47
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 3.
7 papers.
- 2024DualPM: Dual Posed-Canonical Point Maps for 3D Shape and Pose Reconstructioncited by 10
- 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformercited by 7
- 2025Model-based Metric 3D Shape and Motion Reconstruction of Wild Bottlenose Dolphins in Drone-Shot Videoscited by 4
- 2025TwoSquared: 4D Generation from 2D Image Pairscited by 3
- 20264DEquine: Disentangling Motion and Appearance for 4D Equine Reconstruction from Monocular Videocited by 2
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptationcited by 1
- 2026GenMatter: Perceiving Physical Objects with Generative Matter Modelscited by 0
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation1 Jun 2026
- 2026GenMatter: Perceiving Physical Objects with Generative Matter Models24 Apr 2026
- 20264DEquine: Disentangling Motion and Appearance for 4D Equine Reconstruction from Monocular Video10 Mar 2026
- 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformer1 Aug 2025
- 2025Model-based Metric 3D Shape and Motion Reconstruction of Wild Bottlenose Dolphins in Drone-Shot Videos22 Apr 2025
- 2025TwoSquared: 4D Generation from 2D Image Pairs17 Apr 2025
- 2024DualPM: Dual Posed-Canonical Point Maps for 3D Shape and Pose Reconstruction5 Dec 2024