mlsanityData to 14 Oct 2026

RealFusion: 360deg Reconstruction of Any Object from a Single Image

arXiv 2302.10663 ↗First posted 21 Feb 2023cs.CV cs.AI cs.LGcited by 306

Not on the map. Why?

Cited by 121 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We consider the problem of reconstructing a full 360deg photographic model of an object from a single image of it. We do so by fitting a neural radiance field to the image, but find this problem to be severely ill-posed. We thus take an off-the-self conditional image generator based on diffusion and engineer a prompt that encourages it to "dream up" novel views of the object. Using an approach inspired by DreamFields and DreamFusion, we fuse the given input view, the conditional prior, and other regularizers in a final, consistent reconstruction. We demonstrate state-of-the-art reconstruction results on benchmark images when compared to prior methods for monocular 3D reconstruction of objects. Qualitatively, our reconstructions provide a faithful match of the input view and a plausible extrapolation of its appearance and 3D shape, including to the side of the object not visible in the image.

Key facts. Cited by 306 papers in the map (data through 14 Oct 2026). Builds on 52 of its 64 references that are in the map. First posted on arXiv 21 Feb 2023.

Builds on

52 of 64 references.

References · 52

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  9. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  11. 2022Classifier-Free Diffusion Guidancecited by 5,847
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,288
38 more
  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  2. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  8. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  9. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  10. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  11. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  12. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  13. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  14. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  15. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
  16. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  17. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
  18. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
  19. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  20. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 544
  21. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  22. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  23. 2022Novel View Synthesis with Diffusion Modelscited by 300
  24. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  25. 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
  26. 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
  27. 2022Learning Fast Samplers for Diffusion Models by Differentiating Through Sample Qualitycited by 182
  28. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  29. 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
  30. 2019Seeing What a GAN Cannot Generatecited by 148
  31. 20163D Shape Induction from 2D Views of Multiple Objectscited by 121
  32. 2020Pix2Vox++: Multi-scale Context-aware 3D Object Reconstruction from Single and Multiple Imagescited by 79
  33. 2022ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformerscited by 70
  34. 2020SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Imagescited by 68
  35. 2021Unsupervised Learning of 3D Object Categories from Videos in the Wildcited by 67
  36. 2021Shelf-Supervised Mesh Prediction in the Wildcited by 65
  37. 2022AutoRF: Learning 3D Object Radiance Fields from Single View Observationscited by 59
  38. 2022Pre-train, Self-train, Distill: A simple recipe for Supersizing 3D Reconstructioncited by 26

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 114; 2024: 119; 2025: 54; 2026: 19.

306 papers.

Sort:

By area:

  1. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  2. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  4. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  5. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  6. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  7. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  8. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  9. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  10. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  11. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  12. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
38 more
  1. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  2. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  3. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  4. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  5. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  6. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
  7. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
  8. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  9. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  10. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  11. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
  12. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 125
  13. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 123
  14. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  15. 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 116
  16. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
  17. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113
  18. 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
  19. 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Imagecited by 111
  20. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  21. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
  22. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  23. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  24. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 100
  25. 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesiscited by 99
  26. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 95
  27. 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 95
  28. 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 95
  29. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  30. 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
  31. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89
  32. 2023ATT3D: Amortized Text-to-3D Object Synthesiscited by 87
  33. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 87
  34. 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
  35. 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
  36. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Modelscited by 79
  37. 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
  38. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 76

50 most cited of 306 All 306 (JSON)