mlsanityData to 14 Oct 2026

SyncDreamer: Generating Multiview-consistent Images from a Single-view Image

arXiv 2309.03453 ↗First posted 7 Sep 2023cs.CV cs.AI cs.GRcited by 645

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

In this paper, we present a novel diffusion model called that generates multiview-consistent images from a single-view image. Using pretrained large-scale 2D diffusion models, recent work Zero123 demonstrates the ability to generate plausible novel views from a single-view image of an object. However, maintaining consistency in geometry and colors for the generated images remains a challenge. To address this issue, we propose a synchronized multiview diffusion model that models the joint probability distribution of multiview images, enabling the generation of multiview-consistent images in a single reverse process. SyncDreamer synchronizes the intermediate states of all the generated images at every step of the reverse process through a 3D-aware feature attention mechanism that correlates the corresponding features across different views. Experiments show that SyncDreamer generates images with high consistency across different views, thus making it well-suited for various 3D generation tasks such as novel-view-synthesis, text-to-3D, and image-to-3D.

Key facts. Cited by 645 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 89 of its 99 references that are in the map. First posted on arXiv 7 Sep 2023.

Builds on

89 of 99 references.

Closest ancestors · 42

Same direction, newest first

  1. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  2. 2023HoloFusion: Towards Photo-realistic 3D Generative Modeling28 Aug
  3. 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesis22 Aug
  4. 2023HD-Fusion: Detailed Text-to-3D Generation Leveraging Multiple Noise Estimation30 Jul
  5. 2023Points-to-3D: Bridging the Gap between Sparse Points and Shape-Controllable Text-to-3D Generation26 Jul
  6. 2023AutoDecoding Latent 3D Diffusion Models7 Jul
  7. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
  8. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
  9. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation21 Jun
  10. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data13 Jun
  11. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusions8 Jun
  12. 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Views6 Jun
30 more
  1. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  2. 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction24 May
  3. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields19 May
  4. 2023TextMesh: Generation of Realistic 3D Meshes From Text Prompts24 Apr
  5. 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models21 Apr
  6. 2023NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models19 Apr
  7. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction13 Apr
  8. 2023Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Images13 Apr
  9. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models5 Apr
  10. 20233D-aware Image Generation using 2D Diffusion Models31 Mar
  11. 2023Consistent View Synthesis with Pose-Guided Diffusion Models30 Mar
  12. 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Images29 Mar
  13. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
  14. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  15. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  16. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar
  17. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generation9 Mar
  18. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
  19. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  20. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion12 Dec
  21. 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Models12 Dec
  22. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors6 Dec
  23. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusion2 Dec
  24. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  25. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Views29 Nov
  26. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  27. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation17 Nov
  28. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  29. 2022Novel View Synthesis with Diffusion Models6 Oct
  30. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  10. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  12. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
35 more
  1. 2022Diffusion Models in Vision: A Surveycited by 1,015
  2. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  3. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  4. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  5. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  6. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  7. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  8. 2021Neural Fields in Visual Computing and Beyondcited by 540
  9. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
  10. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  11. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  12. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  13. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
  14. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  15. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
  16. 2020State of the Art on Neural Renderingcited by 278
  17. 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
  18. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  19. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  20. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
  21. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 199
  22. 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 180
  23. 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 177
  24. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  25. 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
  26. 2020Self-supervised Single-view 3D Reconstruction via Semantic Consistencycited by 127
  27. 2022Generalizable Patch-Based Neural Renderingcited by 122
  28. 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
  29. 2022Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstructioncited by 94
  30. 2023Anything-3D: Towards Single-view Anything Reconstruction in the Wildcited by 92
  31. 20233D generation on ImageNetcited by 47
  32. 2023DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Modelcited by 43
  33. 2018Learning View Priors for Single-view 3D Reconstructioncited by 35
  34. 2023VQ3D: Learning a 3D-Aware Generative Model on ImageNetcited by 32
  35. 20233D-aware Conditional Image Synthesiscited by 24

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 56; 2024: 270; 2025: 191; 2026: 128.

645 papers.

Sort:

By area:

  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  3. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  4. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  5. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  6. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  7. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  8. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  9. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  10. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
  11. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  12. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
38 more
  1. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  2. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  3. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  4. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  5. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
  6. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
  7. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
  8. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  9. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  10. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  11. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
  12. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
  13. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  14. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  15. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  16. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
  17. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
  18. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 139
  19. 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 137
  20. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 135
  21. 2024Recent Advances in 3D Gaussian Splattingcited by 131
  22. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 123
  23. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  24. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  25. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  26. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
  27. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 114
  28. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
  29. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  30. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  31. 20243D Gaussian as a New Era: A Surveycited by 104
  32. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  33. 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
  34. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
  35. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 100
  36. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 100
  37. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 98
  38. 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 95

50 most cited of 645 All 645 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation
  2. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models
  3. 2025DreamComposer++: Empowering Diffusion Models with Multi-View Conditions for 3D Content Generation
  4. 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesis
  5. 2025WAVE: Warp-Based View Guidance for Consistent Novel View Synthesis Using a Single Image
  6. 2023DreamComposer: Controllable 3D Object Generation via Multi-View Conditions
  7. 2024BoostDream: Efficient Refining for High-Quality Text-to-3D Generation from Multi-View Diffusion
  8. 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusion