mlsanityData to 7 Oct 2026

DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusion

arXiv 2403.17237 ↗First posted 25 Mar 2024cs.CV cs.AI cs.GRcited by 12

Not on the map. Why?

Abstract (arXiv)

We present DreamPolisher, a novel Gaussian Splatting based method with geometric guidance, tailored to learn cross-view consistency and intricate detail from textual descriptions. While recent progress on text-to-3D generation methods have been promising, prevailing methods often fail to ensure view-consistency and textural richness. This problem becomes particularly noticeable for methods that work with text input alone. To address this, we propose a two-stage Gaussian Splatting based approach that enforces geometric consistency among views. Initially, a coarse 3D generation undergoes refinement via geometric optimization. Subsequently, we use a ControlNet driven refiner coupled with the geometric consistency term to improve both texture fidelity and overall consistency of the generated 3D asset. Empirical evaluations across diverse textual prompts spanning various object categories demonstrate the efficacy of DreamPolisher in generating consistent and realistic 3D objects, aligning closely with the semantics of the textual instructions.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 52 of its 54 references that are in the map. First posted on arXiv 25 Mar 2024.

Builds on

52 of 54 references.

References · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,276
38 more
  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  7. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  8. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  9. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  10. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  11. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  12. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  13. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  14. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  15. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  16. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  17. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  18. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  19. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  20. 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
  21. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  22. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  23. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  24. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  25. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
  26. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  27. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  28. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  29. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
  30. 2023Text-to-3D using Gaussian Splattingcited by 299
  31. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  32. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  33. 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
  34. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  35. 2023Text-to-3D with Classifier Score Distillationcited by 127
  36. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
  37. 2023Noise-Free Score Distillationcited by 99
  38. 2022REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answeringcited by 58

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 7; 2025: 5.

12 papers.

  1. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  2. 2024ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillationcited by 27
  3. 2024Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabricationcited by 19
  4. 2025LL3M: Large Language 3D Modelerscited by 18
  5. 2024Rethinking Visual Prompting for Multimodal Large Language Models with External Knowledgecited by 13
  6. 2024OccFusion: Rendering Occluded Humans with Generative Diffusion Priorscited by 8
  7. 2025Digital Twin Generation from Visual Data: A Surveycited by 7
  8. 2025IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generationcited by 6
  9. 2024Olympus: A Universal Task Router for Computer Vision Taskscited by 4
  10. 2024Hybrid Fourier Score Distillation for Efficient One Image to 3D Object Generationcited by 2
  11. 2025Bridging Geometry-Coherent Text-to-3D Generation with Multi-View Diffusion Priors and Gaussian Splattingcited by 1
  12. 2025DreamComposer++: Empowering Diffusion Models with Multi-View Conditions for 3D Content Generationcited by 1