mlsanityData to 7 Oct 2026

Bridging Geometry-Coherent Text-to-3D Generation with Multi-View Diffusion Priors and Gaussian Splatting

arXiv 2505.04262 ↗First posted 7 May 2025cs.CVcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Score Distillation Sampling (SDS) leverages pretrained 2D diffusion models to advance text-to-3D generation but neglects multi-view correlations, being prone to geometric inconsistencies and multi-face artifacts in the generated 3D content. In this work, we propose Coupled Score Distillation (CSD), a framework that couples multi-view joint distribution priors to ensure geometrically consistent 3D generation while enabling the stable and direct optimization of 3D Gaussian Splatting. Specifically, by reformulating the optimization as a multi-view joint optimization problem, we derive an effective optimization rule that effectively couples multi-view priors to guide optimization across different viewpoints while preserving the diversity of generated 3D assets. Additionally, we propose a framework that directly optimizes 3D Gaussian Splatting (3D-GS) with random initialization to generate geometrically consistent 3D content. We further employ a deformable tetrahedral grid, initialized from 3D-GS and refined through CSD, to produce high-quality, refined meshes. Quantitative and qualitative experimental results demonstrate the efficiency and competitive quality of our approach.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 58 of its 71 references that are in the map. First posted on arXiv 7 May 2025.

Builds on

58 of 71 references.

Closest ancestors · 26

Same direction, newest first

  1. 2025Hyper3D: Efficient 3D Representation via Hybrid Triplane and Octree Feature for Enhanced 3D Shape Variational Auto-Encoders13 Mar
  2. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion7 Nov
  3. 2024Vista3D: Unravel the 3D Darkside of a Single Image18 Sep
  4. 2024FlowDreamer: Exploring High Fidelity Text-to-3D Generation via Rectified Flow9 Aug
  5. 2024DreamLCM: Towards High-Quality Text-to-3D Generation via Latent Consistency Model6 Aug
  6. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
  7. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image30 May
  8. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
  9. 2024Dreamer XL: Towards High-Resolution Text-to-3D Generation via Trajectory Score Matching18 May
  10. 2024Hash3D: Training-free Acceleration for 3D Generation9 Apr
  11. 2023PI3D: Efficient Text-to-3D Generation with Pseudo-Image Diffusion14 Dec
  12. 2023DreamControl: Control-Based Text-to-3D Generation with 3D Self-Prior11 Dec
14 more
  1. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
  2. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior25 Oct
  3. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  4. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models12 Oct
  5. 2023Large-Vocabulary 3D Diffusion Model with Transformer14 Sep
  6. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
  7. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  8. 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance30 May
  9. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  10. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  11. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  12. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Views29 Nov
  13. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  14. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 32

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  9. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  11. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  12. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
20 more
  1. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  3. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  4. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  5. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  6. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  7. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  8. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  9. 2018Do Deep Generative Models Know What They Don't Know?cited by 443
  10. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  11. 2023Text-to-3D using Gaussian Splattingcited by 299
  12. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  13. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
  14. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  15. 2021Point-Based Neural Rendering with Per-View Optimizationcited by 188
  16. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  17. 2024DreamReward: Text-to-3D Generation with Human Preferencecited by 56
  18. 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
  19. 2024A Comprehensive Survey on 3D Content Generationcited by 28
  20. 2024DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusioncited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modeling
  2. 2024JointDreamer: Ensuring Geometry Consistency and Text Congruence in Text-to-3D Generation via Joint Score Distillation
  3. 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Prior
  4. 2024DreamMapping: High-Fidelity Text-to-3D Generation via Variational Distribution Mapping
  5. 2025Advancing Text-to-3D Generation with Linearized Lookahead Variational Score Distillation
  6. 2025Walking the Schr"odinger Bridge: A Direct Trajectory for Text-to-3D Generation
  7. 2024Retrieval-Augmented Score Distillation for Text-to-3D Generation
  8. 2024PlacidDreamer: Advancing Harmony in Text-to-3D Generation