mlsanityData to 7 Oct 2026

One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization

arXiv 2306.16928 ↗First posted 29 Jun 2023cs.CV cs.AI cs.ROcited by 555

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion models but suffer from lengthy optimization time, 3D inconsistency results, and poor geometry. In this work, we propose a novel method that takes a single image of any object as input and generates a full 360-degree 3D textured mesh in a single feed-forward pass. Given a single image, we first use a view-conditioned 2D diffusion model, Zero123, to generate multi-view images for the input view, and then aim to lift them up to 3D space. Since traditional reconstruction methods struggle with inconsistent multi-view predictions, we build our 3D reconstruction module upon an SDF-based generalizable neural surface reconstruction method and propose several critical training strategies to enable the reconstruction of 360-degree meshes. Without costly optimizations, our method reconstructs 3D shapes in significantly less time than existing methods. Moreover, our method favors better geometry, generates more 3D consistent results, and adheres more closely to the input image. We evaluate our approach on both synthetic data and in-the-wild images and demonstrate its superiority in terms of both mesh quality and runtime. In addition, our approach can seamlessly support the text-to-3D task by integrating with off-the-shelf text-to-image diffusion models.

Key facts. Cited by 555 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 90 of its 101 references that are in the map. First posted on arXiv 29 Jun 2023.

Builds on

90 of 101 references.

Closest ancestors · 15

Same direction, newest first

  1. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
  2. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  4. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar
  5. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generation9 Mar
  6. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  7. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec
  8. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  9. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors6 Dec
  10. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  11. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Views29 Nov
  12. 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functions24 Nov
3 more
  1. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  2. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  3. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 75

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Segment Anythingcited by 8,158
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  9. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  10. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  12. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
38 more
  1. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  2. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  3. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  4. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  5. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  6. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
  7. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  8. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  9. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  10. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  11. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  12. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  13. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  14. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  15. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  16. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  17. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  18. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  19. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  20. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
  21. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  22. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  23. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
  24. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  25. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  26. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
  27. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  28. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  29. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  30. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  31. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
  32. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  33. 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183
  34. 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
  35. 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 183
  36. 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
  37. 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
  38. 2019Pix2Vox: Context-aware 3D Reconstruction from Single and Multi-view Imagescited by 164

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 82; 2024: 249; 2025: 152; 2026: 72.

555 papers.

Sort:

By area:

  1. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  2. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  3. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  4. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  5. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  6. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  7. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  8. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  9. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  10. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  11. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  12. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
38 more
  1. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  2. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  3. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  4. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  5. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  6. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  7. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  8. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
  9. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  10. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  11. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
  12. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
  13. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  14. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  15. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  16. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  17. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
  18. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
  19. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  20. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
  21. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
  22. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  23. 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
  24. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 113
  25. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
  26. 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
  27. 2023TADA! Text to Animatable Digital Avatarscited by 109
  28. 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Imagecited by 109
  29. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  30. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  31. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  32. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
  33. 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 102
  34. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
  35. 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 100
  36. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  37. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  38. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99

50 most cited of 555 All 555 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Single Image to Textured 3D Object Generation in Frequency Domain: From Theory to Pipeline
  2. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors
  3. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models
  4. 2024LDM: Large Tensorial SDF Model for Textured Mesh Generation
  5. 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images
  6. 2024Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusion
  7. 2024Coherent 3D Scene Diffusion From a Single RGB Image
  8. 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective