C3DAG: Controlled 3D Animal Generation using 3D pose guidance
Not on the map. Why?
Abstract (arXiv)
Recent advancements in text-to-3D generation have demonstrated the ability to generate high quality 3D assets. However while generating animals these methods underperform, often portraying inaccurate anatomy and geometry. Towards ameliorating this defect, we present C3DAG, a novel pose-Controlled text-to-3D Animal Generation framework which generates a high quality 3D animal consistent with a given pose. We also introduce an automatic 3D shape creator tool, that allows dynamic pose generation and modification via a web-based tool, and that generates a 3D balloon animal using simple geometries. A NeRF is then initialized using this 3D shape using depth-controlled SDS. In the next stage, the pre-trained NeRF is fine-tuned using quadruped-pose-controlled SDS. The pipeline that we have developed not only produces geometrically and anatomically consistent results, but also renders highly controlled 3D animals, unlike prior methods which do not allow fine-grained pose control.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 37 references that are in the map. First posted on arXiv 11 Jun 2024.
Builds on
33 of 37 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
21 more
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 110
- 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 103
- 2023ATT3D: Amortized Text-to-3D Object Synthesiscited by 87
- 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 2017Improved Adversarial Systems for 3D Object Generation and Reconstructioncited by 66
- 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 66
- 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
- 2024Learning the 3D Fauna of the Webcited by 59
- 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
- 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 38
- 2021A Novel Dataset for Keypoint Detection of quadruped Animals from Imagescited by 19
Built on by
Not cited yet.