mlsanityData to 14 Oct 2026

Edify 3D: Scalable High-Quality 3D Asset Generation

arXiv 2411.07135 ↗First posted 11 Nov 2024cs.CV cs.AI cs.GRcited by 10

Not on the map. Why?

Abstract (arXiv)

We introduce Edify 3D, an advanced solution designed for high-quality 3D asset generation. Our method first synthesizes RGB and surface normal images of the described object at multiple viewpoints using a diffusion model. The multi-view observations are then used to reconstruct the shape, texture, and PBR materials of the object. Our method can generate high-quality 3D assets with detailed geometry, clean shape topologies, high-resolution textures, and materials within 2 minutes of runtime.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 61 of its 78 references that are in the map. First posted on arXiv 11 Nov 2024.

Builds on

61 of 78 references.

References · 61

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2023GPT-4 Technical Reportcited by 18,396
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  10. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  12. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
38 more
  1. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  4. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  5. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  6. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  7. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  8. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  9. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  10. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  11. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  12. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  13. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
  14. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  15. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  16. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  17. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  18. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
  19. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  20. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  21. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  22. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  23. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  24. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  25. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  26. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  27. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
  28. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  29. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  30. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 183
  31. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  32. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  33. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 158
  34. 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 139
  35. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  36. 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 95
  37. 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
  38. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 1.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Boosting 3D Object Generation through PBR Materials
  2. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusion
  3. 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion
  4. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation
  5. 2026Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Design
  6. 2024Structured 3D Latents for Scalable and Versatile 3D Generation
  7. 2024Edify Image: High-Quality Image Generation with Pixel Space Laplacian Diffusion Models
  8. 2025SViM3D: Stable Video Material Diffusion for Single Image 3D Generation