mlsanityData to 7 Oct 2026

One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion

arXiv 2311.07885 ↗First posted 14 Nov 2023cs.CV cs.AI cs.GRcited by 283

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recent advancements in open-world 3D object generation have been remarkable, with image-to-3D methods offering superior fine-grained control over their text-to-3D counterparts. However, most existing models fall short in simultaneously providing rapid generation speeds and high fidelity to input images - two features essential for practical applications. In this paper, we present One-2-3-45++, an innovative method that transforms a single image into a detailed 3D textured mesh in approximately one minute. Our approach aims to fully harness the extensive knowledge embedded in 2D diffusion models and priors from valuable yet limited 3D data. This is achieved by initially finetuning a 2D diffusion model for consistent multi-view image generation, followed by elevating these images to 3D with the aid of multi-view conditioned 3D native diffusion models. Extensive experimental evaluations demonstrate that our method can produce high-quality, diverse 3D assets that closely mirror the original input image. Our project webpage: https://sudo-ai-3d.github.io/One2345plus_page.

Key facts. Cited by 283 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 82 of its 89 references that are in the map. First posted on arXiv 14 Nov 2023.

Builds on

82 of 89 references.

Closest ancestors · 28

Same direction, newest first

  1. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  2. 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesis12 Oct
  3. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models4 Oct
  4. 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priors29 Sep
  5. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
  6. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  7. 2023Points-to-3D: Bridging the Gap between Sparse Points and Shape-Controllable Text-to-3D Generation26 Jul
  8. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
  9. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
  10. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  11. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models5 Apr
  12. 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Images29 Mar
16 more
  1. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
  2. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  3. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar
  4. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  5. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar
  6. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generation9 Mar
  7. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  8. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
  9. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec
  10. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  11. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors6 Dec
  12. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  13. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Views29 Nov
  14. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  15. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  16. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 54

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  7. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  8. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  10. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  11. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  12. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
38 more
  1. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  2. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  3. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  4. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  5. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  6. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  7. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  8. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  9. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  10. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  11. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
  12. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  13. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  14. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  15. 2023Text-to-3D using Gaussian Splattingcited by 299
  16. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  17. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  18. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
  19. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  20. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  21. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
  22. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  23. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
  24. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
  25. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  26. 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183
  27. 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
  28. 2019Pix2Vox: Context-aware 3D Reconstruction from Single and Multi-view Imagescited by 164
  29. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  30. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
  31. 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
  32. 2022Is Attention All That NeRF Needs?cited by 113
  33. 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
  34. 2017MarrNet: 3D Shape Reconstruction via 2.5D Sketchescited by 108
  35. 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
  36. 2023Multiview Compressive Coding for 3D Reconstructioncited by 71
  37. 2022ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformerscited by 70
  38. 2022VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstructioncited by 61

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 12; 2024: 123; 2025: 96; 2026: 52.

283 papers.

Sort:

By area:

  1. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  2. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  3. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  4. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  5. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  6. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  7. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  8. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  9. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  10. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  11. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  12. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
38 more
  1. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  2. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
  3. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  4. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
  5. 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
  6. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
  7. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
  8. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
  9. 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
  10. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
  11. 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 100
  12. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  13. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  14. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
  15. 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
  16. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
  17. 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 87
  18. 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 81
  19. 2023Free3D: Consistent Novel View Synthesis without 3D Representationcited by 72
  20. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  21. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
  22. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  23. 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 65
  24. 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
  25. 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
  26. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  27. 2024DreamReward: Text-to-3D Generation with Human Preferencecited by 56
  28. 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 56
  29. 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
  30. 2024SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priorscited by 53
  31. 2024Point-SAM: Promptable 3D Segmentation Model for Point Cloudscited by 49
  32. 2024GenXD: Generating Any 3D and 4D Scenescited by 49
  33. 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 49
  34. 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignmentcited by 45
  35. 2023Pyramid Diffusion for Fine 3D Large Scene Generationcited by 44
  36. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
  37. 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generationcited by 44
  38. 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Imagescited by 41

50 most cited of 283 All 283 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Single Image to Textured 3D Object Generation in Frequency Domain: From Theory to Pipeline
  2. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image
  3. 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image
  4. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation
  5. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cycle
  6. 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priors
  7. 2024Hi3D: Pursuing High-Resolution Image-to-3D Generation with Video Diffusion Models
  8. 2024MVDiff: Scalable and Flexible Multi-View Diffusion for 3D Object Reconstruction from Single-View