mlsanityData to 14 Oct 2026

ATT3D: Amortized Text-to-3D Object Synthesis

arXiv 2306.07349 ↗First posted 6 Jun 2023cs.LG cs.AI cs.CVcited by 87

Not on the map. Why?

Cited by 26 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Text-to-3D modelling has seen exciting progress by combining generative text-to-image models with image-to-3D methods like Neural Radiance Fields. DreamFusion recently achieved high-quality results but requires a lengthy, per-prompt optimization to create 3D objects. To address this, we amortize optimization over text prompts by training on many prompts simultaneously with a unified model, instead of separately. With this, we share computation across a prompt set, training in less time than per-prompt optimization. Our framework - Amortized text-to-3D (ATT3D) - enables knowledge-sharing between prompts to generalize to unseen setups and smooth interpolations between text for novel assets and simple animations.

Key facts. Cited by 87 papers in the map (data through 14 Oct 2026). Builds on 61 of its 73 references that are in the map. First posted on arXiv 6 Jun 2023.

Builds on

61 of 73 references.

References · 61

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2022Classifier-Free Diffusion Guidancecited by 5,847
  11. 2022Generative Adversarial Networkscited by 5,627
  12. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
38 more
  1. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  3. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  4. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  5. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  6. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  8. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  10. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  11. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  12. 2020Meta-Learning in Neural Networks: A Surveycited by 950
  13. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  14. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  15. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  16. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  17. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
  18. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  19. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  20. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  21. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  22. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  23. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  24. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  25. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  26. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  27. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  28. 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
  29. 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
  30. 2021Learning to Optimize: A Primer and A Benchmarkcited by 208
  31. 2023Text-To-4D Dynamic Scene Generationcited by 205
  32. 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
  33. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
  34. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  35. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  36. 2018Inference Suboptimality in Variational Autoencoderscited by 132
  37. 2018Graph HyperNetworks for Neural Architecture Searchcited by 132
  38. 2022Variable Bitrate Neural Fieldscited by 117

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 17; 2024: 52; 2025: 16; 2026: 2.

87 papers.

Sort:

By area:

  1. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  2. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  3. 2023Text-to-3D using Gaussian Splattingcited by 299
  4. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  5. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  6. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  7. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  8. 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Imagecited by 111
  9. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  10. 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
  11. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 87
  12. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
38 more
  1. 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
  2. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  3. 2024Advances in 3D Generation: A Surveycited by 63
  4. 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 60
  5. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  6. 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
  7. 2024AGG: Amortized Generative 3D Gaussians for Single Image to 3Dcited by 53
  8. 2023Instant3D: Instant Text-to-3D Generationcited by 45
  9. 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 45
  10. 2024SceneTeller: Language-to-3D Scene Generationcited by 43
  11. 2024LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesiscited by 39
  12. 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 37
  13. 2023Taming Mode Collapse in Score Distillation for Text-to-3D Generationcited by 36
  14. 2024Online Adaptation of Language Models with a Memory of Amortized Contextscited by 35
  15. 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
  16. 2024View Selection for 3D Captioning via Diffusion Rankingcited by 32
  17. 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3Dcited by 28
  18. 2024ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillationcited by 27
  19. 2024HexaGen3D: StableDiffusion is just one step away from Fast and Diverse Text-to-3D Generationcited by 21
  20. 2024BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesiscited by 20
  21. 2024AToM: Amortized Text-to-Mesh using 2D Diffusioncited by 18
  22. 2024Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representationcited by 17
  23. 2024PLA4D: Pixel-Level Alignments for Text-to-4D Gaussian Splattingcited by 15
  24. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 15
  25. 2026Addressable Memory for Video World Modelscited by 15
  26. 2024A Survey On Text-to-3D Contents Generation In The Wildcited by 14
  27. 2024Instant 3D Human Avatar Generation using Image Diffusion Modelscited by 14
  28. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generationcited by 14
  29. 2023HyperFields: Towards Zero-Shot Generation of NeRFs from Textcited by 13
  30. 2024Text-to-3D Shape Generationcited by 13
  31. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  32. 2024Localized Gaussian Splatting Editing with Contextual Awarenesscited by 13
  33. 2024FlexiDreamer: Single Image-to-3D Generation with FlexiCubescited by 12
  34. 2024AWOL: Analysis WithOut synthesis using Languagecited by 12
  35. 2024Flex3D: Feed-Forward 3D Generation with Flexible Reconstruction Model and Input View Curationcited by 12
  36. 2024GT23D-Bench: A Comprehensive General Text-to-3D Generation Benchmarkcited by 12
  37. 2025Neural Radiance Fields for the Real World: A Surveycited by 12
  38. 2024Edify 3D: Scalable High-Quality 3D Asset Generationcited by 10

50 most cited of 87 All 87 (JSON)