4DEquine: Disentangling Motion and Appearance for 4D Equine Reconstruction from Monocular Video
Not on the map. Why?
Abstract (arXiv)
4D reconstruction of equine family (e.g. horses) from monocular video is important for animal welfare. Previous mainstream 4D animal reconstruction methods require joint optimization of motion and appearance over a whole video, which is time-consuming and sensitive to incomplete observation. In this work, we propose a novel framework called 4DEquine by disentangling the 4D reconstruction problem into two sub-problems: dynamic motion reconstruction and static appearance reconstruction. For motion, we introduce a simple yet effective spatio-temporal transformer with a post-optimization stage to regress smooth and pixel-aligned pose and shape sequences from video. For appearance, we design a novel feed-forward network that reconstructs a high-fidelity, animatable 3D Gaussian avatar from as few as a single image. To assist training, we create a large-scale synthetic motion dataset, VarenPoser, which features high-quality surface motions and diverse camera trajectories, as well as a synthetic appearance dataset, VarenTex, comprising realistic multi-view images generated through multi-view diffusion. While training only on synthetic datasets, 4DEquine achieves state-of-the-art performance on real-world APT36K and AiM datasets, demonstrating the superiority of 4DEquine and our new datasets for both geometry and appearance reconstruction. Comprehensive ablation studies validate the effectiveness of both the motion and appearance reconstruction network. Project page: https://luoxue-star.github.io/4DEquine_Project_Page/.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 50 of its 61 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
50 of 61 references.
References · 50
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2020Point Transformercited by 1,470
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2025Qwen-Image Technical Reportcited by 1,044
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
38 more
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
- 2023Tracking Everything Everywhere All at Oncecited by 193
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 116
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
- 2019Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"cited by 106
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 94
- 2025St4RTrack: Simultaneous 4D Reconstruction and Tracking in the Worldcited by 89
- 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
- 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
- 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
- 2024Learning the 3D Fauna of the Webcited by 59
- 2022APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Trackingcited by 56
- 2023Reconstructing Animatable Categories from Videoscited by 47
- 2022Temporally Consistent Transformers for Video Generationcited by 44
- 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 38
- 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesiscited by 33
- 2022Hi-LASSIE: High-Fidelity Articulated Shape and Skeleton Discovery from Sparse Image Ensemblecited by 31
- 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videoscited by 26
- 2025UniTEX: Universal High Fidelity Generative Texturing for 3D Shapescited by 23
- 2023Ponymation: Learning Articulated 3D Animal Motions from Unlabeled Online Videoscited by 21
- 2024AniMer: Animal Pose and Shape Estimation Using Family Aware Transformercited by 20
- 2021hSMAL: Detailed Horse Shape and Pose Reconstruction for Motion Pattern Recognitioncited by 18
- 2024AWOL: Analysis WithOut synthesis using Languagecited by 12
- 2024Generative Zoocited by 12
- 2024DualPM: Dual Posed-Canonical Point Maps for 3D Shape and Pose Reconstructioncited by 11
- 2025Web-Scale Collection of Video Data for 4D Animal Reconstructioncited by 9
- 2024Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Imagescited by 7
- 2025AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformercited by 7
- 20254D-Animal: Freely Reconstructing Animatable 3D Animals from Videoscited by 6
- 2024Multi-Scale Temporal Transformer For Speech Emotion Recognitioncited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.