mlsanityData to 7 Oct 2026

CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model

arXiv 2403.05034 ↗First posted 8 Mar 2024cs.CV cs.LGcited by 214

Not on the map. Why?

Cited by 59 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Feed-forward 3D generative models like the Large Reconstruction Model (LRM) have demonstrated exceptional generation speed. However, the transformer-based methods do not leverage the geometric priors of the triplane component in their architecture, often leading to sub-optimal quality given the limited size of 3D data and slow training. In this work, we present the Convolutional Reconstruction Model (CRM), a high-fidelity feed-forward single image-to-3D generative model. Recognizing the limitations posed by sparse 3D data, we highlight the necessity of integrating geometric priors into network design. CRM builds on the key observation that the visualization of triplane exhibits spatial correspondence of six orthographic images. First, it generates six orthographic view images from a single input image, then feeds these images into a convolutional U-Net, leveraging its strong pixel-level alignment capabilities and significant bandwidth to create a high-resolution triplane. CRM further employs Flexicubes as geometric representation, facilitating direct end-to-end optimization on textured meshes. Overall, our model delivers a high-fidelity textured mesh from an image in just 10 seconds, without any test-time optimization.

Key facts. Cited by 214 papers in the map (data through 7 Oct 2026). Builds on 63 of its 70 references that are in the map. First posted on arXiv 8 Mar 2024.

Builds on

63 of 70 references.

References · 63

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  8. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
  1. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  2. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  5. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  6. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  7. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  8. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  9. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  10. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  11. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  12. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  13. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  14. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  15. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  16. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  17. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
  18. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  19. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  20. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  21. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  22. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
  23. 2023Text-to-3D using Gaussian Splattingcited by 299
  24. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  25. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  26. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  27. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  28. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
  29. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  30. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
  31. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 181
  32. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
  33. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  34. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  35. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  36. 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 138
  37. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  38. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 100; 2025: 74; 2026: 40.

214 papers.

Sort:

By area:

  1. 2025Qwen-Image Technical Reportcited by 973
  2. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  3. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  4. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
  5. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
  6. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
  7. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
  8. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
  9. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
  10. 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 102
  11. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  12. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
38 more
  1. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
  2. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
  3. 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 87
  4. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
  5. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
  6. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 76
  7. 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
  8. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 71
  9. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  10. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
  11. 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
  12. 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 62
  13. 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
  14. 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
  15. 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 49
  16. 2024GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulationcited by 48
  17. 2024PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidancecited by 47
  18. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
  19. 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Imagescited by 41
  20. 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
  21. 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 40
  22. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
  23. 2024Vidu4D: Single Generated Video to High-Fidelity 4D Reconstruction with Dynamic Gaussian Surfelscited by 38
  24. 2024SAR3D: Autoregressive 3D Object Generation and Understanding via Multi-scale 3D VQVAEcited by 38
  25. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cyclecited by 36
  26. 2024MVD-Fusion: Single-view 3D via Depth-consistent Multi-view Generationcited by 35
  27. 2024GeoLRM: Geometry-Aware Large Reconstruction Model for High-Quality 3D Gaussian Generationcited by 35
  28. 2024Img2CAD: Conditioned 3D CAD Model Generation from Single Image with Structured Visual Geometrycited by 35
  29. 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 34
  30. 2024EasyHOI: Unleashing the Power of Large Models for Reconstructing Hand-Object Interactions in the Wildcited by 33
  31. 2024Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstructioncited by 32
  32. 2024Omni-Scene: Omni-Gaussian Representation for Ego-Centric Sparse-View Scene Reconstructioncited by 32
  33. 2024Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusioncited by 31
  34. 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 30
  35. 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Modelcited by 27
  36. 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 27
  37. 2024AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animationcited by 25
  38. 2024Diffusion2: Dynamic 3D Content Generation via Score Composition of Video and Multi-view Diffusion Modelscited by 24

50 most cited of 214 All 214 (JSON)