mlsanityData to 14 Oct 2026

Dream-in-Style: Text-to-3D Generation Using Stylized Score Distillation

arXiv 2406.18581 ↗First posted 5 Jun 2024cs.CV cs.GRcited by 4

Not on the map. Why?

Abstract (arXiv)

We present a method to generate 3D objects in styles. Our method takes a text prompt and a style reference image as input and reconstructs a neural radiance field to synthesize a 3D model with the content aligning with the text prompt and the style following the reference image. To simultaneously generate the 3D object and perform style transfer in one go, we propose a stylized score distillation loss to guide a text-to-3D optimization process to output visually plausible geometry and appearance. Our stylized score distillation is based on a combination of an original pretrained text-to-image model and its modified sibling with the key and value features of self-attention layers manipulated to inject styles from the reference image. Comparisons with state-of-the-art methods demonstrated the strong visual performance of our method, further supported by the quantitative results from our user study.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 66 of its 93 references that are in the map. First posted on arXiv 5 Jun 2024.

Builds on

66 of 93 references.

References · 66

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  6. 2022Classifier-Free Diffusion Guidancecited by 5,847
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  10. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  11. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
38 more
  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  2. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  4. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  5. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  7. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  9. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  10. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  11. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  12. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  13. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  14. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  15. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  16. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  17. 2017Unsupervised Image-to-Image Translation Networkscited by 603
  18. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  19. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  20. 2023Zero-shot Image-to-Image Translationcited by 505
  21. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
  22. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  23. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
  24. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
  25. 2023Style Aligned Image Generation via Shared Attentioncited by 216
  26. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  27. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
  28. 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
  29. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  30. 2017Neural Style Transfer: A Reviewcited by 199
  31. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
  32. 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
  33. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
  34. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  35. 2022ARF: Artistic Radiance Fieldscited by 147
  36. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  37. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  38. 2017Visual Attribute Transfer through Deep Image Analogycited by 123

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.

  1. 2024TV-3DG: Mastering Text-to-3D Customized Generation with Visual Promptcited by 8
  2. 2025StyleMe3D: Stylization with Disentangled Priors by Multiple Encoders on 3D Gaussianscited by 6
  3. 2025Stable Score Distillationcited by 3
  4. 2026SIC3D: Style Image Conditioned Text-to-3D Gaussian Splatting Generationcited by 0