mlsanityData to 7 Oct 2026

Advances in 3D Generation: A Survey

arXiv 2401.17807 ↗First posted 31 Jan 2024cs.CV cs.GRcited by 62

Not on the map. Why?

Abstract (arXiv)

Generating 3D models lies at the core of computer graphics and has been the focus of decades of research. With the emergence of advanced neural representations and generative models, the field of 3D content generation is developing rapidly, enabling the creation of increasingly high-quality and diverse 3D models. The rapid growth of this field makes it difficult to stay abreast of all recent developments. In this survey, we aim to introduce the fundamental methodologies of 3D generation methods and establish a structured roadmap, encompassing 3D representation, generation methods, datasets, and corresponding applications. Specifically, we introduce the 3D representations that serve as the backbone for 3D generation. Furthermore, we provide a comprehensive overview of the rapidly growing literature on generation methods, categorized by the type of algorithmic paradigms, including feedforward generation, optimization-based generation, procedural generation, and generative novel view synthesis. Lastly, we discuss available datasets, applications, and open challenges. We hope this survey will help readers explore this exciting topic and foster further advancements in the field of 3D content generation.

Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). Builds on 348 of its 419 references that are in the map. First posted on arXiv 31 Jan 2024.

Builds on

348 of 419 references.

References · 348

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2013Auto-Encoding Variational Bayescited by 3,980
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  10. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  11. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
38 more
  1. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  6. 2022Video Diffusion Modelscited by 2,280
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  8. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  9. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  10. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  11. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  12. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  13. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  14. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  15. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  16. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  17. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  18. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  19. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  20. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  21. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  22. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  23. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  24. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  25. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  26. 2021Transformers in Vision: A Surveycited by 1,009
  27. 2022Diffusion Models in Vision: A Surveycited by 1,008
  28. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  29. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  30. 2020Neural Sparse Voxel Fieldscited by 959
  31. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  32. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  33. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  34. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  35. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  36. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  37. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  38. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708

50 most cited of 348 All 348 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 22; 2025: 26; 2026: 14.

62 papers.

Sort:

By area:

  1. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  2. 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 100
  3. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
  4. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 76
  5. 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
  6. 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignmentcited by 45
  7. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  8. 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
  9. 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
  10. 20253D Scene Generation: A Surveycited by 24
  11. 2024Collaborative Control for Geometry-Conditioned PBR Image Generationcited by 22
  12. 2025RealRAG: Retrieval-augmented Realistic Image Generation via Self-reflective Contrastive Learningcited by 20
38 more
  1. 2025Generative AI for Film Creation: A Survey of Recent Advancescited by 17
  2. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
  3. 2024A Survey On Text-to-3D Contents Generation In The Wildcited by 13
  4. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  5. 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
  6. 2025Neural Radiance Fields for the Real World: A Surveycited by 12
  7. 2025Data Synthesis with Diverse Styles for Face Recognition via 3DMM-Guided Diffusioncited by 12
  8. 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 11
  9. 2025Drive Any Mesh: 4D Latent Diffusion for Mesh Deformation from Videocited by 11
  10. 2024X-Ray: A Sequential 3D Representation For Generationcited by 9
  11. 2025MVPainter: Accurate and Detailed 3D Texture Generation via Multi-View Diffusion with Geometric Controlcited by 7
  12. 2024LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Controlcited by 6
  13. 2025Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functionscited by 6
  14. 2025Detecting Visual Information Manipulation Attacks in Augmented Reality: A Multimodal Semantic Reasoning Approachcited by 6
  15. 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Trainingcited by 5
  16. 2025LLM-to-Phy3D: Physically Conform Online 3D Object Generation with LLMscited by 4
  17. 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
  18. 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLMcited by 3
  19. 2024SeMv-3D: Towards Concurrency of Semantic and Multi-view Consistency in General Text-to-3D Generationcited by 2
  20. 2024Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priorscited by 2
  21. 2024Towards a Training Free Approach for 3D Scene Editingcited by 2
  22. 2025SuperCarver: Texture-Consistent 3D Geometry Super-Resolution for High-Fidelity Surface Detail Generationcited by 2
  23. 2025Towards Fine-Grained Text-to-3D Quality Assessment: A Benchmark and A Two-Stage Rank-Learning Metriccited by 2
  24. 2025LoG3D: Ultra-High-Resolution 3D Shape Modeling via Local-to-Global Partitioningcited by 2
  25. 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
  26. 2026EZBlender: Efficient 3D Editing with Plan-and-ReAct Agentcited by 2
  27. 2024Multi-view X-ray Image Synthesis with Multiple Domain Disentanglement from CT Scanscited by 1
  28. 2024FreeGaussian: Annotation-free Control of Articulated Objects via 3D Gaussian Splats with Flow Derivativescited by 1
  29. 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Frameworkcited by 1
  30. 2025Objectness Similarity: Capturing Object-Level Fidelity in 3D Scene Evaluationcited by 1
  31. 2025RecurGS: Interactive Scene Modeling via Discrete-State Recurrent Gaussian Fusioncited by 1
  32. 2026Benchmarking Vision-Language Models under Contradictory Virtual Content Attacks in Augmented Realitycited by 1
  33. 2026Embody4D: A Generalist Data Engine for Embodied 4D World Modelingcited by 1
  34. 2026GTA: Advancing Image-to-3D World Generation via Geometry Then Appearance Video Diffusioncited by 1
  35. 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimationcited by 1
  36. 2024MVLLaVA: An Intelligent Agent for Unified and Flexible Novel View Synthesiscited by 0
  37. 2024Pomo3D: 3D-Aware Portrait Accessorizing and Morecited by 0
  38. 2024Navigate Complex Physical Worlds via Geometrically Constrained LLMcited by 0

50 most cited of 62 All 62 (JSON)