mlsanityData to 14 Oct 2026

Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video

arXiv 2607.00157 ↗First posted 30 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reconstructing 4D animals from monocular videos is challenging due to large inter-species variation, complex articulations, and the lack of reliable templates. Existing approaches typically rely on either strict category-specific priors that restrict generalization, or unconstrained generative models that sacrifice input fidelity. To bridge this gap, we present a progressive test-time optimization framework built on 3D Gaussian Splatting for high-fidelity 4D animal reconstruction from a single video. Our key insight is that a coarse shape prior suffices when coupled with a progressive strategy that disentangles articulated pose from non-rigid deformation. Specifically, we employ a symmetry-aware temporal encoding that exploits bilateral cues while absorbing camera estimation drift and a part-conditioned deformation mechanism guided by learnable part anchors and a learnable skinning field. Extensive experiments demonstrate that our approach generalizes robustly across diverse species, achieving superior geometric accuracy, temporal consistency, and visual fidelity compared to existing baselines, even under severe prior mismatch.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 49 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

41 of 49 references.

References · 41

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  4. 2018Demystifying MMD GANscited by 1,293
  5. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  6. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  7. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  8. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  9. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  10. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
  11. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
  12. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
29 more
  1. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
  2. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
  3. 2020Self-supervised Single-view 3D Reconstruction via Semantic Consistencycited by 127
  4. 2023GART: Gaussian Articulated Template Modelscited by 121
  5. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 116
  6. 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
  7. 2019Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"cited by 106
  8. 2020Articulation-aware Canonical Surface Mappingcited by 81
  9. 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 66
  10. 2019Canonical Surface Mapping via Geometric Cycle Consistencycited by 63
  11. 2024Learning the 3D Fauna of the Webcited by 59
  12. 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
  13. 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
  14. 2024Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian Splattingcited by 49
  15. 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generationcited by 48
  16. 2023Reconstructing Animatable Categories from Videoscited by 47
  17. 20203D Bird Reconstruction: a Dataset, Model, and Shape Recovery from a Single Viewcited by 40
  18. 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 38
  19. 2022CASA: Category-agnostic Skeletal Animal Reconstructioncited by 35
  20. 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesiscited by 33
  21. 2022Hi-LASSIE: High-Fidelity Articulated Shape and Skeleton Discovery from Sparse Image Ensemblecited by 31
  22. 2021Birds of a Feather: Capturing Avian Shape Models from Imagescited by 30
  23. 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videoscited by 26
  24. 2023SAOR: Single-View Articulated Object Reconstructioncited by 16
  25. 2025Hybrid 3D-4D Gaussian Splatting for Fast Dynamic Scene Representationcited by 13
  26. 2025Splat4D: Diffusion-Enhanced 4D Gaussian Splatting for Temporally and Spatially Consistent Content Creationcited by 9
  27. 2023APTv2: Benchmarking Animal Pose Estimation and Tracking with a Large-scale Dataset and Beyondcited by 8
  28. 2025PAD3R: Pose-Aware Dynamic 3D Reconstruction from Casual Videoscited by 7
  29. 2025Spline Deformation Fieldcited by 3

Built on by

Not cited yet.