Connecting Consistency Distillation to Score Distillation for Text-to-3D Generation
Not on the map. Why?
Abstract (arXiv)
Although recent advancements in text-to-3D generation have significantly improved generation quality, issues like limited level of detail and low fidelity still persist, which requires further improvement. To understand the essence of those issues, we thoroughly analyze current score distillation methods by connecting theories of consistency distillation to score distillation. Based on the insights acquired through analysis, we propose an optimization framework, Guided Consistency Sampling (GCS), integrated with 3D Gaussian Splatting (3DGS) to alleviate those issues. Additionally, we have observed the persistent oversaturation in the rendered views of generated 3D assets. From experiments, we find that it is caused by unwanted accumulated brightness in 3DGS during optimization. To mitigate this issue, we introduce a Brightness-Equalized Generation (BEG) scheme in 3DGS rendering. Experimental results demonstrate that our approach generates 3D assets with more details and higher fidelity than state-of-the-art methods. The codes are released at https://github.com/LMozart/ECCV2024-GCS-BEG.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 48 of its 55 references that are in the map. First posted on arXiv 18 Jul 2024.
Builds on
48 of 55 references.
References · 48
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023Consistency Modelscited by 1,822
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
36 more
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2023Adversarial Diffusion Distillationcited by 759
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2013A survey of the Schr"odinger problem and some of its connections with optimal transportcited by 292
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
- 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2023Text-to-3D with Classifier Score Distillationcited by 128
- 2014On the relation between optimal transport and Schr"odinger bridges: A stochastic control viewpointcited by 99
- 2023Noise-Free Score Distillationcited by 99
- 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesiscited by 63
- 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
- 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
- 2024FlashTex: Fast Relightable Mesh Texturing with LightControlNetcited by 56
- 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
- 2024Trajectory Consistency Distillation: Improved Latent Consistency Distillation by Semi-Linear Consistency Function with Trajectory Mappingcited by 46
- 2024Rethinking Score Distillation as a Bridge Between Image Distributionscited by 38
- 2023Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splattingcited by 20
- 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Textcited by 16
- 2023DANI-Net: Uncalibrated Photometric Stereo by Differentiable Shadow Handling, Anisotropic Reflectance Modeling, and Neural Inverse Renderingcited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 11; 2026: 5.
18 papers.
Sort:
By area:
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modelingcited by 14
- 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Datacited by 7
- 2025DiMeR: Disentangled Mesh Reconstruction Modelcited by 6
- 2025SegmentDreamer: Towards High-fidelity Text-to-3D Synthesis with Segmented Consistency Trajectory Distillationcited by 5
- 2025Understanding, Accelerating, and Improving MeanFlow Trainingcited by 4
- 2025ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generationcited by 3
- 2025Walking the Schr"odinger Bridge: A Direct Trajectory for Text-to-3D Generationcited by 3
- 2024Redefining <Creative> in Dictionary: Towards an Enhanced Semantic Understanding of Creative Generationcited by 2
- 2026Preference Score Distillation: Leveraging 2D Rewards to Align Text-to-3D Generation with Human Preferencecited by 2
- 2026Text-Image Conditioned 3D Generationcited by 2
6 more
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuningcited by 1
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representationscited by 1
- 2025Debiasing Diffusion Priors via 3D Attention for Consistent Gaussian Splattingcited by 1
- 2026Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Trainingcited by 0
- 2026Post-Hoc Guidance for Consistency Models by Joint Flow Distribution Learningcited by 0
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillationcited by 0
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillation20 May 2026
- 2026Post-Hoc Guidance for Consistency Models by Joint Flow Distribution Learning10 Apr 2026
- 2026Text-Image Conditioned 3D Generation22 Mar 2026
- 2026Preference Score Distillation: Leveraging 2D Rewards to Align Text-to-3D Generation with Human Preference2 Mar 2026
- 2026Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Training6 Jan 2026
- 2025Debiasing Diffusion Priors via 3D Attention for Consistent Gaussian Splatting8 Dec 2025
- 2025Understanding, Accelerating, and Improving MeanFlow Training24 Nov 2025
- 2025Walking the Schr"odinger Bridge: A Direct Trajectory for Text-to-3D Generation6 Nov 2025
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representations28 Sep 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025SegmentDreamer: Towards High-fidelity Text-to-3D Synthesis with Segmented Consistency Trajectory Distillation7 Jul 2025
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuning17 May 2025
6 more
- 2025DiMeR: Disentangled Mesh Reconstruction Model24 Apr 2025
- 2025ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generation3 Apr 2025
- 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data27 Mar 2025
- 2025VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modeling20 Mar 2025
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis25 Nov 2024
- 2024Redefining <Creative> in Dictionary: Towards an Enhanced Semantic Understanding of Creative Generation31 Oct 2024
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
- 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Datacited by 7
- 2025Walking the Schr"odinger Bridge: A Direct Trajectory for Text-to-3D Generationcited by 3
- 2024Redefining <Creative> in Dictionary: Towards an Enhanced Semantic Understanding of Creative Generationcited by 2
- 2026Preference Score Distillation: Leveraging 2D Rewards to Align Text-to-3D Generation with Human Preferencecited by 2
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuningcited by 1
- 2025Debiasing Diffusion Priors via 3D Attention for Consistent Gaussian Splattingcited by 1
- 2026Post-Hoc Guidance for Consistency Models by Joint Flow Distribution Learningcited by 0
- 2026Post-Hoc Guidance for Consistency Models by Joint Flow Distribution Learning10 Apr 2026
- 2026Preference Score Distillation: Leveraging 2D Rewards to Align Text-to-3D Generation with Human Preference2 Mar 2026
- 2025Debiasing Diffusion Priors via 3D Attention for Consistent Gaussian Splatting8 Dec 2025
- 2025Walking the Schr"odinger Bridge: A Direct Trajectory for Text-to-3D Generation6 Nov 2025
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuning17 May 2025
- 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data27 Mar 2025
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis25 Nov 2024
- 2024Redefining <Creative> in Dictionary: Towards an Enhanced Semantic Understanding of Creative Generation31 Oct 2024
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modelingcited by 14
- 2025DiMeR: Disentangled Mesh Reconstruction Modelcited by 6
- 2025SegmentDreamer: Towards High-fidelity Text-to-3D Synthesis with Segmented Consistency Trajectory Distillationcited by 5
- 2025Understanding, Accelerating, and Improving MeanFlow Trainingcited by 4
- 2025ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generationcited by 3
- 2026Text-Image Conditioned 3D Generationcited by 2
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representationscited by 1
- 2026Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Trainingcited by 0
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillationcited by 0
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillation20 May 2026
- 2026Text-Image Conditioned 3D Generation22 Mar 2026
- 2026Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Training6 Jan 2026
- 2025Understanding, Accelerating, and Improving MeanFlow Training24 Nov 2025
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representations28 Sep 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025SegmentDreamer: Towards High-fidelity Text-to-3D Synthesis with Segmented Consistency Trajectory Distillation7 Jul 2025
- 2025DiMeR: Disentangled Mesh Reconstruction Model24 Apr 2025
- 2025ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generation3 Apr 2025
- 2025VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modeling20 Mar 2025