mlsanityData to 7 Oct 2026

DreamBooth3D: Subject-Driven Text-to-3D Generation

arXiv 2303.13508 ↗First posted 23 Mar 2023cs.CV cs.AI cs.GRcited by 235

Not on the map. Why?

Cited by 98 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present DreamBooth3D, an approach to personalize text-to-3D generative models from as few as 3-6 casually captured images of a subject. Our approach combines recent advances in personalizing text-to-image models (DreamBooth) with text-to-3D generation (DreamFusion). We find that naively combining these methods fails to yield satisfactory subject-specific 3D assets due to personalized text-to-image models overfitting to the input viewpoints of the subject. We overcome this through a 3-stage optimization strategy where we jointly leverage the 3D consistency of neural radiance fields together with the personalization capability of text-to-image models. Our method can produce high-quality, subject-specific 3D assets with text-driven modifications such as novel poses, colors and attributes that are not seen in any of the input images of the subject.

Key facts. Cited by 235 papers in the map (data through 7 Oct 2026). Builds on 45 of its 48 references that are in the map. First posted on arXiv 23 Mar 2023.

Builds on

45 of 48 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  8. 2022Generative Adversarial Networkscited by 5,603
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  10. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
33 more
  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  2. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  5. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  6. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  7. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  9. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  10. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  11. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  12. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  13. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  14. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  15. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  16. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  17. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  18. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  19. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  20. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  21. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  22. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  23. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  24. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  25. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  26. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  27. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
  28. 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
  29. 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
  30. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
  31. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
  32. 2019Pixel2Mesh++: Multi-View 3D Mesh Generation via Deformationcited by 103
  33. 2021On the Frequency Bias of Generative Modelscited by 60

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 79; 2024: 97; 2025: 46; 2026: 13.

235 papers.

Sort:

By area:

  1. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  3. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  4. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  5. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  6. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  7. 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 396
  8. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  9. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  10. 2023Text-to-3D using Gaussian Splattingcited by 299
  11. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  12. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
38 more
  1. 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 240
  2. 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
  3. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  4. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  5. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  6. 2023WonderJourney: Going from Anywhere to Everywherecited by 157
  7. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  8. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 151
  9. 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
  10. 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
  11. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  12. 2023Delta Denoising Scorecited by 120
  13. 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
  14. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 113
  15. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  16. 2024StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Renderingcited by 107
  17. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  18. 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 104
  19. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  20. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  21. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  22. 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
  23. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
  24. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 86
  25. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
  26. 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
  27. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
  28. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
  29. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 75
  30. 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
  31. 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 72
  32. 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
  33. 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesiscited by 63
  34. 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
  35. 2024Advances in 3D Generation: A Surveycited by 62
  36. 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
  37. 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 62
  38. 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61

50 most cited of 235 All 235 (JSON)