mlsanityData to 14 Oct 2026

T3Bench: Benchmarking Current Progress in Text-to-3D Generation

arXiv 2310.02977 ↗First posted 4 Oct 2023cs.CV cs.CL cs.LGcited by 57

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recent methods in text-to-3D leverage powerful pretrained diffusion models to optimize NeRF. Notably, these methods are able to produce high-quality 3D scenes without training on 3D data. Due to the open-ended nature of the task, most studies evaluate their results with subjective case studies and user experiments, thereby presenting a challenge in quantitatively addressing the question: How has current progress in Text-to-3D gone so far? In this paper, we introduce T3Bench, the first comprehensive text-to-3D benchmark containing diverse text prompts of three increasing complexity levels that are specially designed for 3D generation. To assess both the subjective quality and the text alignment, we propose two automatic metrics based on multi-view images produced by the 3D contents. The quality metric combines multi-view text-image scores and regional convolution to detect quality and view inconsistency. The alignment metric uses multi-view captioning and GPT-4 evaluation to measure text-3D consistency. Both metrics closely correlate with different dimensions of human judgments, providing a paradigm for efficiently evaluating text-to-3D models. The benchmarking results, shown in Fig. 1, reveal performance differences among an extensive 10 prevalent text-to-3D methods. Our analysis further highlights the common struggles for current methods on generating surroundings and multi-object scenes, as well as the bottleneck of leveraging 2D guidance for 3D generation. Our project page is available at: https://t3bench.com.

Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 35 of its 47 references that are in the map. First posted on arXiv 4 Oct 2023.

Builds on

35 of 47 references.

Closest ancestors · 10

Same direction, newest first

  1. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  2. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  4. 2023TextMesh: Generation of Realistic 3D Meshes From Text Prompts24 Apr
  5. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  6. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar
  7. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec
  8. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  10. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  9. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  12. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
13 more
  1. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  2. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  4. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  5. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  6. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  7. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  8. 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
  9. 2023Scalable 3D Captioning with Pretrained Modelscited by 203
  10. 2023Benchmarking Foundation Models with Language-Model-as-an-Examinercited by 172
  11. 2023HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Modelscited by 95
  12. 2023DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Modelcited by 43
  13. 2023MMPI: a Flexible Radiance Field Representation by Multiple Multi-plane Images Blendingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 20; 2025: 19; 2026: 15.

57 papers.

Sort:

By area:

  1. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  2. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
  3. 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
  4. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
  5. 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 50
  6. 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
  7. 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
  8. 2024Text-to-Image Rectified Flow as Plug-and-Play Priorscited by 38
  9. 2024Prometheus: 3D-Aware Latent Diffusion Models for Feed-Forward Text-to-3D Scene Generationcited by 34
  10. 2024View Selection for 3D Captioning via Diffusion Rankingcited by 32
  11. 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 32
  12. 2024ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillationcited by 27
38 more
  1. 2024VP3D: Unleashing 2D Visual Prompt for Text-to-3D Generationcited by 25
  2. 2023Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splattingcited by 20
  3. 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Priorcited by 20
  4. 2024Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representationcited by 17
  5. 2025Eval3D: Interpretable and Fine-grained Evaluation for 3D Generationcited by 16
  6. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 15
  7. 2024A Survey On Text-to-3D Contents Generation In The Wildcited by 14
  8. 2025VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modelingcited by 14
  9. 2024GT23D-Bench: A Comprehensive General Text-to-3D Generation Benchmarkcited by 12
  10. 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Modelscited by 12
  11. 2025Text-to-3D by Stitching a Multi-view Reconstruction Network to a Video Generatorcited by 11
  12. 2024CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussianscited by 10
  13. 2024DreamMesh: Jointly Manipulating and Texturing Triangle Meshes for Text-to-3D Generationcited by 9
  14. 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 9
  15. 2024Benchmarking and Learning Multi-Dimensional Quality Evaluator for Text-to-3D Generationcited by 8
  16. 20254D-Bench: Benchmarking Multi-modal Large Language Models for 4D Object Understandingcited by 8
  17. 2025Flash Sculptor: Modular 3D Worlds from Objectscited by 5
  18. 2023MetaDreamer: Efficient Text-to-3D Creation With Disentangling Geometry and Texturecited by 3
  19. 2025PlantDreamer: Achieving Realistic 3D Plant Models with Diffusion-Guided Gaussian Splattingcited by 3
  20. 2025Hi3DEval: Advancing 3D Generation Evaluation with Hierarchical Validitycited by 3
  21. 2025Towards Fine-Grained Text-to-3D Quality Assessment: A Benchmark and A Two-Stage Rank-Learning Metriccited by 3
  22. 2025TRIM: Scalable 3D Gaussian Diffusion Inference with Temporal and Spatial Trimmingcited by 3
  23. 2024COMOGen: A Controllable Text-to-3D Multi-object Generation Frameworkcited by 2
  24. 2025AnchorDS: Anchoring Dynamic Sources for Semantically Consistent Text-to-3D Generationcited by 2
  25. 2026SldprtNet: A Large-Scale Multimodal Dataset for CAD Generation in Language-Driven 3D Designcited by 2
  26. 2026DB-3DME: From Dataset to Benchmark for Human-aligned Automatic 3D Mesh Evaluationcited by 2
  27. 2025CoherenDream: Boosting Holistic Text Coherence in 3D Generation via Multimodal Large Language Models Feedbackcited by 1
  28. 2025Point Cloud Compression and Objective Quality Assessment: A Surveycited by 1
  29. 2026Shape of Thought: Progressive Object Assembly via Visual Chain-of-Thoughtcited by 1
  30. 2026RelaxFlow: Text-Driven Amodal 3D Generationcited by 1
  31. 2026Cog2Gen3D: Sculpturing 3D Semantic-Geometric Cognition for 3D Generationcited by 1
  32. 2026Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenescited by 1
  33. 2024A Quantitative Evaluation of Score Distillation Sampling Based Text-to-3Dcited by 0
  34. 2024Brain3D: Generating 3D Objects from fMRIcited by 0
  35. 2025Text-guided Synthetic Geometric Augmentation for Zero-shot 3D Understandingcited by 0
  36. 2025RapidMV: Leveraging Spatio-Angular Representations for Efficient and Consistent Text-to-Multi-View Synthesiscited by 0
  37. 2025SplatFont3D: Structure-Aware Text-to-3D Artistic Font Generation with Part-Level Style Controlcited by 0
  38. 2026ForgeDreamer: Industrial Text-to-3D Generation with Multi-Expert LoRA and Cross-View Hypergraphcited by 0

50 most cited of 57 All 57 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generation
  2. 2025Dive3D: Diverse Distillation-based Text-to-3D Generation via Score Implicit Matching
  3. 2024JointDreamer: Ensuring Geometry Consistency and Text Congruence in Text-to-3D Generation via Joint Score Distillation
  4. 2024VividDreamer: Towards High-Fidelity and Efficient Text-to-3D Generation
  5. 2024BoostDream: Efficient Refining for High-Quality Text-to-3D Generation from Multi-View Diffusion
  6. 2024Grounded Compositional and Diverse Text-to-3D with Pretrained Multi-View Diffusion Model
  7. 2023PI3D: Efficient Text-to-3D Generation with Pseudo-Image Diffusion
  8. 2023X-Dreamer: Creating High-quality 3D Content by Bridging the Domain Gap Between Text-to-2D and Text-to-3D Generation