Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We report Zero123++, an image-conditioned diffusion model for generating 3D-consistent multi-view images from a single input view. To take full advantage of pretrained 2D generative priors, we develop various conditioning and training schemes to minimize the effort of finetuning from off-the-shelf image diffusion models such as Stable Diffusion. Zero123++ excels in producing high-quality, consistent multi-view images from a single image, overcoming common issues like texture degradation and geometric misalignment. Furthermore, we showcase the feasibility of training a ControlNet on Zero123++ for enhanced control over the generation process. The code is available at https://github.com/SUDO-AI-3D/zero123plus.
Key facts. Cited by 521 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 20 of its 26 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
20 of 26 references.
Closest ancestors · 7
Same direction, newest first
- 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priors29 Sep
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
- 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2023Efficient Diffusion Training via Min-SNR Weighting Strategycited by 246
1 more
- 2023On the Importance of Noise Scheduling for Diffusion Modelscited by 194
Built on by
Citing papers per year: 2023: 26; 2024: 213; 2025: 194; 2026: 88.
521 papers.
Sort:
By area:
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
38 more
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 139
- 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
- 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 135
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 132
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 114
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
- 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 100
- 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 100
- 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 95
- 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 95
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
- 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89
- 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
- 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
- 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
- 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 65
- 2024Advances in 3D Generation: A Surveycited by 63
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
50 most cited of 521 All 521 (JSON)
- 2026ShoeFit: A New Dataset and Dual-image-stream DiT Framework for Virtual Footwear Try-On13 Oct 2026
- 2026UniForge3D: Joint 3D Reconstruction and Generation in a Shared Anchor-Guided Space11 Oct 2026
- 2026MATE4D: Matrix-Guided Editable 4D Generation from a Single Image8 Oct 2026
- 2026NAMVIS: Next-Scale Autoregressive Multi-View Image Synthesis3 Oct 2026
- 2026SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation1 Oct 2026
- 2026HierGF: Hierarchical Gaussian Fields via Geometry-perception Message Passing for Sparse-view 3D Reconstruction1 Oct 2026
- 2026TaoTex: Boosting Texture Detail Fidelity for Native 3D Material Generation28 Sep 2026
- 2026VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis27 Sep 2026
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026GSComplete: Gaussian Splat Completion with 2D Diffusion Priors8 Sep 2026
- 2026PLSR: Progressive and Localized Super-Resolution of 3D Objects via Localized Latent Voxel Diffusion6 Sep 2026
- 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time3 Sep 2026
38 more
- 2026CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling1 Sep 2026
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026SceneReGen: Generative Reconstruction of 3D Scenes from a Single Image25 Aug 2026
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion21 Aug 2026
- 2026GenRec: Knowing Where to Reconstruct and Where to Generate18 Aug 2026
- 2026Owner3D: Ownership-Guided Style Writing for Training-Free Localized 3D Stylization14 Aug 2026
- 2026Marrying Optimal Transport and ODEs for Unified Continuous-Time 4D Reconstruction and Tracking10 Aug 2026
- 2026DreamStyle3D: Efficient 3D Stylized Asset Generation via Dual-Attention Disentanglement27 Jul 2026
- 2026Fashion-3DLR: A Controllable 3D Garment Generation Using Pairwise Fashion Elements for Intelligent Design25 Jul 2026
- 20263D-GIMP: When 3D Gaussian Inpainting Meets PatchMatch22 Jul 2026
- 2026Importance-Aware OBS Pruning for Diffusion Models22 Jul 2026
- 2026RealSkin: Spatio-Spectral Partial Neural Adjoint Maps for Image-to-3D Attribute Transfer14 Jul 2026
- 2026Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Model13 Jul 2026
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flow12 Jul 2026
- 2026SceneFrom3D: Geometry-Conditioned Outdoor 3D Scene Generation via View Scheduling with Object-Level Control5 Jul 2026
- 2026Global Pose Control for Generative View Synthesis in Normalized Object Coordinate Space2 Jul 2026
- 2026Alignment Is All You Need For X-to-4D Generation2 Jul 2026
- 2026Variance Reduction on the Camera Axis: Multi-View Score Distillation for 3D29 Jun 2026
- 2026GeoFace: Consistent Multi-View Face Generation with Geometry-Constrained Diffusion26 Jun 2026
- 2026MM-TRELLIS: Point-Cloud Guided Multi-Modal 3D Vehicle Generation in Autonomous Driving23 Jun 2026
- 20263DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesis23 Jun 2026
- 2026φ-Scene: Physically Grounded Image-to-3D Scene Reconstruction19 Jun 2026
- 2026FrozenDrive: Zero-Shot Text-Guided Driving Scene Generation and Data Augmentation with Parameter-Free Frozen Diffusion Model18 Jun 2026
- 2026RAVA: Retrieval-Augmented Viewpoint Alignment for Subject-Driven Image Generation16 Jun 2026
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible11 Jun 2026
- 2026VideoMDM: Towards 3D Human Motion Generation From 2D Supervision11 Jun 2026
- 2026GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priors7 Jun 2026
- 2026Stream3D: Sequential Multi-View 3D Generation via Evidential Memory20 May 2026
- 2026Sketch2MinSurf: Vision-Language Guided Generation of Editable Minimal Surfaces from Hand-Drawn Sketches20 May 2026
- 2026Landscape-Awareness for Geometric View Diffusion Model19 May 2026
- 2026GeoFlow: Enforcing Implicit Geometric Consistency in Video Generation18 May 2026
- 2026DecoRec: Decomposed 3D Scene Reconstruction from Single-View Images via Object-Level Diffusion16 May 2026
- 2026R-DMesh: Video-Guided 3D Animation via Rectified Dynamic Mesh Flow13 May 2026
- 2026GeoQuery: Geometry-Query Diffusion for Sparse-View Reconstruction12 May 2026
- 2026Generative 3D Gaussians with Learned Density Control8 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026Velox: Learning Representations of 4D Geometry and Appearance6 May 2026
- 2026Pose-Aware Diffusion for 3D Generation1 May 2026
50 newest of 521 All 521 (JSON)
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
- 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
12 most cited of 203 All 203 (JSON)
- 2026VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis27 Sep 2026
- 2026GSComplete: Gaussian Splat Completion with 2D Diffusion Priors8 Sep 2026
- 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time3 Sep 2026
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026GenRec: Knowing Where to Reconstruct and Where to Generate18 Aug 2026
- 2026Marrying Optimal Transport and ODEs for Unified Continuous-Time 4D Reconstruction and Tracking10 Aug 2026
- 2026Fashion-3DLR: A Controllable 3D Garment Generation Using Pairwise Fashion Elements for Intelligent Design25 Jul 2026
- 20263D-GIMP: When 3D Gaussian Inpainting Meets PatchMatch22 Jul 2026
- 2026Importance-Aware OBS Pruning for Diffusion Models22 Jul 2026
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flow12 Jul 2026
- 2026Alignment Is All You Need For X-to-4D Generation2 Jul 2026
- 2026Variance Reduction on the Camera Axis: Multi-View Score Distillation for 3D29 Jun 2026
12 newest of 203 All 203 (JSON)
- 2024SAR3D: Autoregressive 3D Object Generation and Understanding via Multi-scale 3D VQVAEcited by 39
- 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 38
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generationcited by 16
- 2025CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligencecited by 10
- 2025MVGBench: Comprehensive Benchmark for Multi-view Generation Modelscited by 9
- 2025Concept Regions Matter: Benchmarking CLIP with a New Cluster-Importance Approachcited by 3
- 2025MMPart: Harnessing Multi-Modal Large Language Models for Part-Aware 3D Generationcited by 1
- 2025CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligence14 Dec 2025
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generation26 Nov 2025
- 2025Concept Regions Matter: Benchmarking CLIP with a New Cluster-Importance Approach17 Nov 2025
- 2025MMPart: Harnessing Multi-Modal Large Language Models for Part-Aware 3D Generation20 Sep 2025
- 2025MVGBench: Comprehensive Benchmark for Multi-view Generation Models11 Jun 2025
- 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understanding2 Jun 2025
- 2024SAR3D: Autoregressive 3D Object Generation and Understanding via Multi-scale 3D VQVAE25 Nov 2024
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 139
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
12 most cited of 298 All 298 (JSON)
- 2026ShoeFit: A New Dataset and Dual-image-stream DiT Framework for Virtual Footwear Try-On13 Oct 2026
- 2026UniForge3D: Joint 3D Reconstruction and Generation in a Shared Anchor-Guided Space11 Oct 2026
- 2026MATE4D: Matrix-Guided Editable 4D Generation from a Single Image8 Oct 2026
- 2026NAMVIS: Next-Scale Autoregressive Multi-View Image Synthesis3 Oct 2026
- 2026SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation1 Oct 2026
- 2026HierGF: Hierarchical Gaussian Fields via Geometry-perception Message Passing for Sparse-view 3D Reconstruction1 Oct 2026
- 2026TaoTex: Boosting Texture Detail Fidelity for Native 3D Material Generation28 Sep 2026
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026PLSR: Progressive and Localized Super-Resolution of 3D Objects via Localized Latent Voxel Diffusion6 Sep 2026
- 2026CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling1 Sep 2026
- 2026SceneReGen: Generative Reconstruction of 3D Scenes from a Single Image25 Aug 2026
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion21 Aug 2026
12 newest of 298 All 298 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction
- 2022Novel View Synthesis with Diffusion Models
- 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data
- 2023State of the Art on Diffusion Models for Visual Computing
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
- 2023Efficient-3DiM: Learning a Generalizable Single-image Novel-view Synthesizer in One Day
- 2024Diffusion Models in Low-Level Vision: A Survey
- 2024A Simple Approach to Unifying Diffusion-based Conditional Generation