mlsanityData to 14 Oct 2026

C3DAG: Controlled 3D Animal Generation using 3D pose guidance

arXiv 2406.07742 ↗First posted 11 Jun 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advancements in text-to-3D generation have demonstrated the ability to generate high quality 3D assets. However while generating animals these methods underperform, often portraying inaccurate anatomy and geometry. Towards ameliorating this defect, we present C3DAG, a novel pose-Controlled text-to-3D Animal Generation framework which generates a high quality 3D animal consistent with a given pose. We also introduce an automatic 3D shape creator tool, that allows dynamic pose generation and modification via a web-based tool, and that generates a 3D balloon animal using simple geometries. A NeRF is then initialized using this 3D shape using depth-controlled SDS. In the next stage, the pre-trained NeRF is fine-tuned using quadruped-pose-controlled SDS. The pipeline that we have developed not only produces geometrically and anatomically consistent results, but also renders highly controlled 3D animals, unlike prior methods which do not allow fine-grained pose control.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 37 references that are in the map. First posted on arXiv 11 Jun 2024.

Builds on

33 of 37 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  6. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  7. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  9. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
  10. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  11. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  12. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
21 more
  1. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  2. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
  3. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
  4. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  5. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  6. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
  7. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  8. 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
  9. 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
  10. 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 110
  11. 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 103
  12. 2023ATT3D: Amortized Text-to-3D Object Synthesiscited by 87
  13. 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
  14. 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
  15. 2017Improved Adversarial Systems for 3D Object Generation and Reconstructioncited by 66
  16. 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 66
  17. 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
  18. 2024Learning the 3D Fauna of the Webcited by 59
  19. 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
  20. 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 38
  21. 2021A Novel Dataset for Keypoint Detection of quadruped Animals from Imagescited by 19

Built on by

Not cited yet.