Edify 3D: Scalable High-Quality 3D Asset Generation
Not on the map. Why?
Abstract (arXiv)
We introduce Edify 3D, an advanced solution designed for high-quality 3D asset generation. Our method first synthesizes RGB and surface normal images of the described object at multiple viewpoints using a diffusion model. The multi-view observations are then used to reconstruct the shape, texture, and PBR materials of the object. Our method can generate high-quality 3D assets with detailed geometry, clean shape topologies, high-resolution textures, and materials within 2 minutes of runtime.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 61 of its 78 references that are in the map. First posted on arXiv 11 Nov 2024.
Builds on
61 of 78 references.
References · 61
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023GPT-4 Technical Reportcited by 18,396
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
38 more
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
- 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 183
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
- 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 158
- 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 139
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 95
- 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 1.
10 papers.
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 99
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 95
- 2024MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Datacited by 21
- 2025MeshPad: Interactive Sketch-Conditioned Artist-Reminiscent Mesh Generation and Editingcited by 7
- 2025SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materialscited by 5
- 20253D-Generalist: Self-Improving Vision-Language-Action Models for Crafting 3D Worldscited by 3
- 2025Voxify3D: Pixel Art Meets Volumetric Renderingcited by 3
- 2025View2CAD: Reconstructing View-Centric CAD Models from Single RGB-D Scanscited by 1
- 2026G-MAD: A Game-Based Data Generation Framework for Multi-View RGB-T Aerial Object Detectioncited by 0
- 2026G-MAD: A Game-Based Data Generation Framework for Multi-View RGB-T Aerial Object Detection22 Jul 2026
- 2025Voxify3D: Pixel Art Meets Volumetric Rendering8 Dec 2025
- 20253D-Generalist: Self-Improving Vision-Language-Action Models for Crafting 3D Worlds9 Jul 2025
- 2025SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materials17 Apr 2025
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyond15 Apr 2025
- 2025View2CAD: Reconstructing View-Centric CAD Models from Single RGB-D Scans5 Apr 2025
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridging28 Mar 2025
- 2025MeshPad: Interactive Sketch-Conditioned Artist-Reminiscent Mesh Generation and Editing3 Mar 2025
- 2025Cosmos World Foundation Model Platform for Physical AI7 Jan 2025
- 2024MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Data18 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2024Boosting 3D Object Generation through PBR Materials
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusion
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion
- 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation
- 2026Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Design
- 2024Structured 3D Latents for Scalable and Versatile 3D Generation
- 2024Edify Image: High-Quality Image Generation with Pixel Space Laplacian Diffusion Models
- 2025SViM3D: Stable Video Material Diffusion for Single Image 3D Generation