mlsanityData to 7 Oct 2026

InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models

arXiv 2404.07191 ↗First posted 10 Apr 2024cs.CVcited by 421

Not on the map. Why?

Cited by 83 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present InstantMesh, a feed-forward framework for instant 3D mesh generation from a single image, featuring state-of-the-art generation quality and significant training scalability. By synergizing the strengths of an off-the-shelf multiview diffusion model and a sparse-view reconstruction model based on the LRM architecture, InstantMesh is able to create diverse 3D assets within 10 seconds. To enhance the training efficiency and exploit more geometric supervisions, e.g, depths and normals, we integrate a differentiable iso-surface extraction module into our framework and directly optimize on the mesh representation. Experimental results on public datasets demonstrate that InstantMesh significantly outperforms other latest image-to-3D baselines, both qualitatively and quantitatively. We release all the code, weights, and demo of InstantMesh, with the intention that it can make substantial contributions to the community of 3D generative AI and empower both researchers and content creators.

Key facts. Cited by 421 papers in the map (data through 7 Oct 2026). Builds on 64 of its 67 references that are in the map. First posted on arXiv 10 Apr 2024.

Builds on

64 of 67 references.

References · 64

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  7. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  8. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  9. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  12. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
38 more
  1. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  2. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  3. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  4. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  5. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  6. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  7. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  8. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  9. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  10. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  11. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  12. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  13. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  14. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  15. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  16. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  17. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  18. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  19. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  20. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  21. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  22. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  23. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  24. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  25. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  26. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  27. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  28. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
  29. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  30. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  31. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
  32. 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
  33. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  34. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
  35. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 181
  36. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  37. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  38. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 107; 2025: 174; 2026: 140.

421 papers.

Sort:

By area:

  1. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  2. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  3. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  4. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  5. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
  6. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
  7. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
  8. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
  9. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 105
  10. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
  11. 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 102
  12. 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 100
38 more
  1. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  2. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
  3. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
  4. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
  5. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
  6. 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 87
  7. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
  8. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
  9. 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
  10. 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 74
  11. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 71
  12. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  13. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
  14. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  15. 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 65
  16. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
  17. 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
  18. 2024Animate3D: Animating Any 3D Model with Multi-view Video Diffusioncited by 55
  19. 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
  20. 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
  21. 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
  22. 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 49
  23. 2024GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulationcited by 48
  24. 2024PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidancecited by 47
  25. 2025Any6D: Model-free 6D Pose Estimation of Novel Objectscited by 47
  26. 2024Vision-based Manipulation from Single Human Video with Open-World Object Graphscited by 46
  27. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
  28. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
  29. 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 43
  30. 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 43
  31. 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Imagescited by 41
  32. 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
  33. 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 40
  34. 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
  35. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
  36. 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 39
  37. 2024SAR3D: Autoregressive 3D Object Generation and Understanding via Multi-scale 3D VQVAEcited by 38
  38. 2025TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencingcited by 38

50 most cited of 421 All 421 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025FlashMesh: Faster and Better Autoregressive Mesh Synthesis via Structured Speculation
  2. 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusion
  3. 2025Native and Compact Structured Latents for 3D Generation
  4. 2023TextMesh: Generation of Realistic 3D Meshes From Text Prompts
  5. 2026PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Models
  6. 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior
  7. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers
  8. 2025GEN3D: Generating Domain-Free 3D Scenes from a Single Image