ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in zero-shot text-to-3D generation have revolutionized 3D content creation by enabling direct synthesis from textual descriptions. While state-of-the-art methods leverage 3D Gaussian Splatting with score distillation to enhance multi-view rendering through pre-trained text-to-image (T2I) models, they suffer from inherent prior view biases in T2I priors. These biases lead to inconsistent 3D generation, particularly manifesting as the multi-face Janus problem, where objects exhibit conflicting features across views. To address this fundamental challenge, we propose ConsDreamer, a novel method that mitigates view bias by refining both the conditional and unconditional terms in the score distillation process: (1) a View Disentanglement Module (VDM) that eliminates viewpoint biases in conditional prompts by decoupling irrelevant view components and injecting precise view control; and (2) a similarity-based partial order loss that enforces geometric consistency in the unconditional term by aligning cosine similarities with azimuth relationships. Extensive experiments demonstrate that ConsDreamer can be seamlessly integrated into various 3D representations and score distillation paradigms, effectively mitigating the multi-face Janus problem.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 44 of its 53 references that are in the map. First posted on arXiv 3 Apr 2025.
Builds on
44 of 53 references.
References · 44
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
32 more
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
- 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
- 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
- 2023Noise-Free Score Distillationcited by 99
- 2024DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Samplingcited by 72
- 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 69
- 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
- 2024Score Distillation via Reparametrized DDIMcited by 41
- 2023Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generationcited by 32
- 2023Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Priorcited by 32
- 2024ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillationcited by 27
- 2024Hyper-3DG: Text-to-3D Gaussian Generation via Hypergraphcited by 22
- 2024Connecting Consistency Distillation to Score Distillation for Text-to-3D Generationcited by 18
- 2024A Survey On Text-to-3D Contents Generation In The Wildcited by 14
- 2020SOFA-Net: Second-Order and First-order Attention Network for Crowd Countingcited by 9
- 2024Dreamer XL: Towards High-Resolution Text-to-3D Generation via Trajectory Score Matchingcited by 9
- 2024GSEditPro: 3D Gaussian Splatting Editing with Attention-based Progressive Localizationcited by 7
- 2024Text-to-3D Generation by 2D Editingcited by 3
- 2024ExactDreamer: High-Fidelity Text-to-3D Content Creation via Exact Score Matchingcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.