mlsanityData to 7 Oct 2026

A Comprehensive Survey on 3D Content Generation

arXiv 2402.01166 ↗First posted 2 Feb 2024cs.CV cs.AIcited by 28

Not on the map. Why?

Abstract (arXiv)

Recent years have witnessed remarkable advances in artificial intelligence generated content(AIGC), with diverse input modalities, e.g., text, image, video, audio and 3D. The 3D is the most close visual modality to real-world 3D environment and carries enormous knowledge. The 3D content generation shows both academic and practical values while also presenting formidable technical challenges. This review aims to consolidate developments within the burgeoning domain of 3D content generation. Specifically, a new taxonomy is proposed that categorizes existing approaches into three types: 3D native generative methods, 2D prior-based 3D generative methods, and hybrid 3D generative methods. The survey covers approximately 60 papers spanning the major techniques. Besides, we discuss limitations of current 3D content generation techniques, and point out open challenges as well as promising directions for future work. Accompanied with this survey, we have established a project website where the resources on 3D content generation research are provided. The project page is available at https://github.com/hitcslj/Awesome-AIGC-3D.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 62 of its 68 references that are in the map. First posted on arXiv 2 Feb 2024.

Builds on

62 of 68 references.

References · 62

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  4. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  5. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  7. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  8. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  9. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  10. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  11. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  12. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
38 more
  1. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  2. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  3. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  4. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  5. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  6. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  7. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  8. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  9. 2023Text-to-3D using Gaussian Splattingcited by 299
  10. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  11. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  12. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  13. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  14. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  15. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
  16. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  17. 2023Text-To-4D Dynamic Scene Generationcited by 204
  18. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  19. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
  20. 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
  21. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  22. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
  23. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 151
  24. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  25. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
  26. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  27. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 113
  28. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  29. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  30. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  31. 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
  32. 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidancecited by 79
  33. 2023NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Modelscited by 76
  34. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 75
  35. 2020Deep Learning for Procedural Content Generationcited by 73
  36. 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
  37. 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
  38. 2020SofGAN: A Portrait Image Generator with Dynamic Stylingcited by 65

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 10; 2025: 16; 2026: 2.

28 papers.

Sort:

By area:

  1. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
  2. 2024Diffusion Model-Based Video Editing: A Surveycited by 44
  3. 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
  4. 20253D Scene Generation: A Surveycited by 24
  5. 2024A Survey On Text-to-3D Contents Generation In The Wildcited by 13
  6. 2024STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargetingcited by 13
  7. 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
  8. 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 11
  9. 2024Text2Robot: Evolutionary Robot Design from Text Descriptionscited by 8
  10. 2024Benchmarking and Learning Multi-Dimensional Quality Evaluator for Text-to-3D Generationcited by 7
  11. 2025Rethinking Score Distilling Sampling for 3D Editing and Generationcited by 7
  12. 2024Geometric Algebra Planes: Convex Implicit Neural Volumescited by 5
16 more
  1. 2025Residual Primitive Fitting of 3D Shapes with SuperFrustacited by 5
  2. 2025Walking the Schr"odinger Bridge: A Direct Trajectory for Text-to-3D Generationcited by 3
  3. 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
  4. 2024Improving Viewpoint Consistency in 3D Generation via Structure Feature and CLIP Guidancecited by 2
  5. 2025SuperCarver: Texture-Consistent 3D Geometry Super-Resolution for High-Fidelity Surface Detail Generationcited by 2
  6. 2025STP4D: Spatio-Temporal-Prompt Consistent Modeling for Text-to-4D Gaussian Splattingcited by 2
  7. 2025Bridging Geometry-Coherent Text-to-3D Generation with Multi-View Diffusion Priors and Gaussian Splattingcited by 1
  8. 2025Point Cloud Compression and Objective Quality Assessment: A Surveycited by 1
  9. 2025Structural Energy-Guided Sampling for View-Consistent Text-to-3Dcited by 1
  10. 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Frameworkcited by 1
  11. 2024Any-to-3D Generation via Hybrid Diffusion Supervisioncited by 0
  12. 2025A Mixed-Primitive-based Gaussian Splatting Method for Surface Reconstructioncited by 0
  13. 2025Enhancing Novel View Synthesis from extremely sparse views with SfM-free 3D Gaussian Splatting Frameworkcited by 0
  14. 2025Mesh RAG: Retrieval Augmentation for Autoregressive Mesh Generationcited by 0
  15. 2025S2AM3D: Scale-controllable Part Segmentation of 3D Point Cloudscited by 0
  16. 2026IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoningcited by 0