mlsanityData to 14 Oct 2026

3DGen: Triplane Latent Diffusion for Textured Mesh Generation

arXiv 2303.05371 ↗First posted 9 Mar 2023cs.CV cs.GRcited by 183

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Latent diffusion models for image generation have crossed a quality threshold which enabled them to achieve mass adoption. Recently, a series of works have made advancements towards replicating this success in the 3D domain, introducing techniques such as point cloud VAE, triplane representation, neural implicit surfaces and differentiable rendering based training. We take another step along this direction, combining these developments in a two-step pipeline consisting of 1) a triplane VAE which can learn latent representations of textured meshes and 2) a conditional diffusion model which generates the triplane features. For the first time this architecture allows conditional and unconditional generation of high quality textured or untextured 3D meshes across multiple diverse categories in a few seconds on a single GPU. It outperforms previous work substantially on image-conditioned and unconditional generation on mesh quality as well as texture generation. Furthermore, we demonstrate the scalability of our model to large datasets for increased quality and diversity. We will release our code and trained models.

Key facts. Cited by 183 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 37 of its 39 references that are in the map. First posted on arXiv 9 Mar 2023.

Builds on

37 of 39 references.

Closest ancestors · 8

Same direction, newest first

  1. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec
  2. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  3. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion12 Dec
  4. 20223D Neural Field Generation using Triplane Diffusion30 Nov
  5. 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functions24 Nov
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  7. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
  8. 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar

Other references · 29

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 2022Classifier-Free Diffusion Guidancecited by 5,847
  7. 2022Generative Adversarial Networkscited by 5,627
  8. 2013Auto-Encoding Variational Bayescited by 4,053
  9. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  10. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  11. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  12. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
17 more
  1. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  2. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  3. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
  4. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  5. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  6. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  7. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  8. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  9. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  10. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  11. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  12. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  13. 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 93
  14. 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
  15. 2022ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Modelcited by 62
  16. 2022Understanding Pure CLIP Guidance for Voxel Grid NeRF Modelscited by 56
  17. 2022GenSDF: Two-Stage Learning of Generalizable Signed Distance Functionscited by 30

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 50; 2024: 86; 2025: 36; 2026: 11.

183 papers.

Sort:

By area:

  1. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  2. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  3. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  4. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  5. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  6. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  7. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  8. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  9. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  10. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  11. 2023Text-to-3D using Gaussian Splattingcited by 299
  12. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
38 more
  1. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
  2. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  3. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  4. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
  5. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  6. 2023Scalable 3D Captioning with Pretrained Modelscited by 203
  7. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
  8. 2025Native and Compact Structured Latents for 3D Generationcited by 175
  9. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  10. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 158
  11. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  12. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
  13. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113
  14. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  15. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
  16. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 100
  17. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
  18. 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
  19. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 87
  20. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  21. 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
  22. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Modelscited by 79
  23. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
  24. 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
  25. 2024Not All Noises Are Created Equally:Diffusion Noise Selection and Optimizationcited by 71
  26. 2024Towards Realistic Scene Generation with LiDAR Diffusion Modelscited by 69
  27. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  28. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  29. 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
  30. 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 63
  31. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
  32. 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
  33. 2024DreamReward: Text-to-3D Generation with Human Preferencecited by 56
  34. 2024LT3SD: Latent Trees for 3D Scene Diffusioncited by 55
  35. 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 54
  36. 2024DiffGS: Functional Gaussian Splatting Diffusioncited by 51
  37. 2023AutoDecoding Latent 3D Diffusion Modelscited by 50
  38. 2023Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusioncited by 50

50 most cited of 183 All 183 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Single Mesh Diffusion Models with Field Latents for Texture Generation
  2. 2025MeshGen: Generating PBR Textured Mesh with Render-Enhanced Auto-Encoder and Generative Data Augmentation
  3. 2025DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshes
  4. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers
  5. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assets
  6. 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priors
  7. 2024V3D: Video Diffusion Models are Effective 3D Generators
  8. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation