mlsanityData to 7 Oct 2026

Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materials

arXiv 2407.02445 ↗First posted 2 Jul 2024cs.CV cs.AI cs.GRcited by 66

Not on the map. Why?

Abstract (arXiv)

We present Meta 3D AssetGen (AssetGen), a significant advancement in text-to-3D generation which produces faithful, high-quality meshes with texture and material control. Compared to works that bake shading in the 3D object's appearance, AssetGen outputs physically-based rendering (PBR) materials, supporting realistic relighting. AssetGen generates first several views of the object with factored shaded and albedo appearance channels, and then reconstructs colours, metalness and roughness in 3D, using a deferred shading loss for efficient supervision. It also uses a sign-distance function to represent 3D shape more reliably and introduces a corresponding loss for direct shape supervision. This is implemented using fused kernels for high memory efficiency. After mesh extraction, a texture refinement transformer operating in UV space significantly improves sharpness and details. AssetGen achieves 17% improvement in Chamfer Distance and 40% in LPIPS over the best concurrent work for few-view reconstruction, and a human preference of 72% over the best industry competitors of comparable speed, including those that support PBR. Project page with generated assets: https://assetgen.github.io

Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). Builds on 100 of its 121 references that are in the map. First posted on arXiv 2 Jul 2024.

Builds on

100 of 121 references.

References · 100

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  10. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  12. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
38 more
  1. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  2. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  4. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  5. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  6. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  7. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  8. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  9. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  10. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  11. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  12. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  13. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  14. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  15. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  16. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  17. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  18. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  19. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  20. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 446
  21. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  22. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  23. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  24. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  25. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  26. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  27. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  28. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  29. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  30. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
  31. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  32. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
  33. 2021Neural RGB-D Surface Reconstructioncited by 312
  34. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  35. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  36. 2023Text-to-3D using Gaussian Splattingcited by 299
  37. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  38. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283

50 most cited of 100 All 100 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 16; 2025: 38; 2026: 12.

66 papers.

Sort:

By area:

  1. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  2. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
  3. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
  4. 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 62
  5. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
  6. 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 40
  7. 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
  8. 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
  9. 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 34
  10. 2024IDArb: Intrinsic Decomposition for Arbitrary Number of Input Views and Illuminationscited by 21
  11. 2026ShapeR: Robust Conditional 3D Shape Generation from Casual Capturescited by 19
  12. 2025AnyCam: Learning to Recover Camera Poses and Intrinsics from Casual Videoscited by 18
38 more
  1. 2025IntrinsiX: High-Quality PBR Generation using Image Priorscited by 18
  2. 2024Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representationcited by 17
  3. 2025UnCommon Objects in 3Dcited by 17
  4. 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fieldscited by 16
  5. 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusioncited by 15
  6. 2025VertexRegen: Mesh Generation with Continuous Level of Detailcited by 14
  7. 2024Flex3D: Feed-Forward 3D Generation with Flexible Reconstruction Model and Input View Curationcited by 12
  8. 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodingscited by 10
  9. 2025Gen3DEval: Using vLLMs for Automatic Evaluation of Generated 3D Objectscited by 10
  10. 2025ART: Articulated Reconstruction Transformercited by 9
  11. 2025MuMA: 3D PBR Texturing via Multi-Channel Multi-View Generation and Agentic Post-Processingcited by 8
  12. 2025MeshRipple: Structured Autoregressive Generation of Artist-Meshescited by 8
  13. 2026World Reconstruction From Inconsistent Viewscited by 8
  14. 2024DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Modelcited by 7
  15. 2024ARM: Appearance Reconstruction Model for Relightable 3D Generationcited by 7
  16. 2024MARVEL-40M+: Multi-Level Visual Elaboration for High-Fidelity Text-to-3D Content Creationcited by 7
  17. 2025SViM3D: Stable Video Material Diffusion for Single Image 3D Generationcited by 7
  18. 2024Multi-scale Latent Point Consistency Models for 3D Shape Generationcited by 6
  19. 2025MeshPad: Interactive Sketch-Conditioned Artist-Reminiscent Mesh Generation and Editingcited by 6
  20. 2025SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materialscited by 5
  21. 2025OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Controlcited by 5
  22. 2024Speech to Reality: On-Demand Production using Natural Language, 3D Generative AI, and Discrete Robotic Assemblycited by 4
  23. 2025PBR-SR: Mesh PBR Texture Super Resolution from 2D Image Priorscited by 4
  24. 2025GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherencecited by 4
  25. 2025LaFiTe: A Generative Latent Field for 3D Native Texturingcited by 4
  26. 2025ePBR: Extended PBR Materials in Image Synthesiscited by 3
  27. 2025SaLF: Sparse Local Fields for Multi-Sensor Rendering in Real-Timecited by 3
  28. 2025CraftMesh: High-Fidelity Generative Mesh Manipulation via Poisson Seamless Fusioncited by 3
  29. 2024HybridMQA: Exploring Geometry-Texture Interactions for Colored Mesh Quality Assessmentcited by 2
  30. 2025Twinner: Shining Light on Digital Twins in a Few Snapscited by 2
  31. 2025PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Modelscited by 2
  32. 2025Large Material Gaussian Model for Relightable 3D Generationcited by 2
  33. 2025A Generalizable Light Transport 3D Embedding for Global Illuminationcited by 2
  34. 2025AnchorDS: Anchoring Dynamic Sources for Semantically Consistent Text-to-3D Generationcited by 2
  35. 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windowscited by 2
  36. 2025PBR3DGen: A VLM-guided Mesh Generation with High-quality PBR Texturecited by 1
  37. 2025MoReMouse: Monocular Reconstruction of Laboratory Mousecited by 1
  38. 2025Dream-to-Recon: Monocular 3D Reconstruction with Diffusion-Depth Distillation from Single Imagescited by 1

50 most cited of 66 All 66 (JSON)