Progress and Prospects in 3D Generative AI: A Technical Overview including 3D human
Not on the map. Why?
Abstract (arXiv)
While AI-generated text and 2D images continue to expand its territory, 3D generation has gradually emerged as a trend that cannot be ignored. Since the year 2023 an abundant amount of research papers has emerged in the domain of 3D generation. This growth encompasses not just the creation of 3D objects, but also the rapid development of 3D character and motion generation. Several key factors contribute to this progress. The enhanced fidelity in stable diffusion, coupled with control methods that ensure multi-view consistency, and realistic human models like SMPL-X, contribute synergistically to the production of 3D models with remarkable consistency and near-realistic appearances. The advancements in neural network-based 3D storing and rendering models, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), have accelerated the efficiency and realism of neural rendered models. Furthermore, the multimodality capabilities of large language models have enabled language inputs to transcend into human motion outputs. This paper aims to provide a comprehensive overview and summary of the relevant papers published mostly during the latter half year of 2023. It will begin by discussing the AI generated object models in 3D, followed by the generated 3D human models, and finally, the generated 3D human motions, culminating in a conclusive summary and a vision for the future.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 52 references that are in the map. First posted on arXiv 5 Jan 2024.
Builds on
23 of 52 references.
References · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
11 more
- 2021Editing Conditional Radiance Fieldscited by 222
- 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 102
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
- 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Modelscited by 79
- 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
- 2023Global-correlated 3D-decoupling Transformer for Clothed Avatar Reconstructioncited by 42
- 2023NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Cloudscited by 41
- 2022One-shot Implicit Animatable Avatars with Model-based Priorscited by 38
- 2023Plan, Posture and Go: Towards Open-World Text-to-Motion Generationcited by 26
- 2023Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Modelscited by 20
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Recent Advances in 3D Object and Scene Generation: A Survey
- 2025HuGeDiff: 3D Human Generation via Diffusion with Gaussian Splatting
- 20253D Scene Generation: A Survey
- 2024Report on Methods and Applications for Crafting 3D Humans ↗
- 2024Challenges and Opportunities in 3D Content Generation
- 2023Breathing New Life into 3D Assets with Generative Repainting
- 2024A Survey On Text-to-3D Contents Generation In The Wild
- 2024Bringing Objects to Life: training-free 4D generation from 3D objects through view consistent noise