mlsanityData to 7 Oct 2026

VividDreamer: Invariant Score Distillation For Hyper-Realistic Text-to-3D Generation

arXiv 2407.09822 ↗First posted 13 Jul 2024cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

This paper presents Invariant Score Distillation (ISD), a novel method for high-fidelity text-to-3D generation. ISD aims to tackle the over-saturation and over-smoothing problems in Score Distillation Sampling (SDS). In this paper, SDS is decoupled into a weighted sum of two components: the reconstruction term and the classifier-free guidance term. We experimentally found that over-saturation stems from the large classifier-free guidance scale and over-smoothing comes from the reconstruction term. To overcome these problems, ISD utilizes an invariant score term derived from DDIM sampling to replace the reconstruction term in SDS. This operation allows the utilization of a medium classifier-free guidance scale and mitigates the reconstruction-related errors, thus preventing the over-smoothing and over-saturation of results. Extensive experiments demonstrate that our method greatly enhances SDS and produces realistic 3D objects through single-stage optimization.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 53 of its 62 references that are in the map. First posted on arXiv 13 Jul 2024.

Builds on

53 of 62 references.

References · 53

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  10. 2022Classifier-Free Diffusion Guidancecited by 5,717
  11. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  12. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
38 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  4. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  5. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  10. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  11. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  12. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  13. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  14. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  15. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  16. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  17. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  18. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  19. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  20. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  21. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  22. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  23. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  24. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  25. 2023Text-to-3D using Gaussian Splattingcited by 299
  26. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  27. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  28. 2024A Survey on 3D Gaussian Splattingcited by 221
  29. 2017Parallel WaveNet: Fast High-Fidelity Speech Synthesiscited by 214
  30. 2023Scalable 3D Captioning with Pretrained Modelscited by 201
  31. 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
  32. 2023Text-to-3D with Classifier Score Distillationcited by 127
  33. 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 123
  34. 2023Noise-Free Score Distillationcited by 99
  35. 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
  36. 2024DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models (Exemplified as A Video Agent)cited by 56
  37. 2024DreamReward: Text-to-3D Generation with Human Preferencecited by 56
  38. 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splattingcited by 33

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 9; 2026: 2.

15 papers.

Sort:

By area:

  1. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
  2. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  3. 2024PersonalVideo: High ID-Fidelity Video Customization without Dynamic and Semantic Degradationcited by 29
  4. 2025PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Modelscited by 18
  5. 2024InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillationcited by 12
  6. 2025Layout2Scene: 3D Semantic Layout Guided Scene Generation via Geometry and Appearance Diffusion Priorscited by 10
  7. 2025DynamicID: Zero-Shot Multi-ID Image Personalization with Flexible Facial Editabilitycited by 10
  8. 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Datacited by 7
  9. 2025Rethinking Score Distilling Sampling for 3D Editing and Generationcited by 7
  10. 2025From Trial to Triumph: Advancing Long Video Understanding via Visual Context Sample Scaling and Self-reward Alignmentcited by 6
  11. 2025SegmentDreamer: Towards High-fidelity Text-to-3D Synthesis with Segmented Consistency Trajectory Distillationcited by 5
  12. 2025Distilling Multi-view Diffusion Models into 3D Generatorscited by 3
3 more
  1. 2026Variation-aware Flexible 3D Gaussian Editingcited by 2
  2. 2025Target-Balanced Score Distillationcited by 0
  3. 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024A Quantitative Evaluation of Score Distillation Sampling Based Text-to-3D
  2. 2025Text-to-3D Generation using Jensen-Shannon Score Distillation
  3. 2024JointDreamer: Ensuring Geometry Consistency and Text Congruence in Text-to-3D Generation via Joint Score Distillation
  4. 2025Harnessing the Power of Training-Free Techniques in Text-to-2D Generation for Text-to-3D Generation via Score Distillation Sampling
  5. 2024ModeDreamer: Mode Guiding Score Distillation for Text-to-3D Generation using Reference Image Prompts
  6. 2025Advancing Text-to-3D Generation with Linearized Lookahead Variational Score Distillation
  7. 2024VividDreamer: Towards High-Fidelity and Efficient Text-to-3D Generation
  8. 2024Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modeling