MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion
Not on the map. Why?
Cited by 89 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
This paper introduces MVDiffusion, a simple yet effective method for generating consistent multi-view images from text prompts given pixel-to-pixel correspondences (e.g., perspective crops from a panorama or multi-view images given depth maps and poses). Unlike prior methods that rely on iterative image warping and inpainting, MVDiffusion simultaneously generates all images with a global awareness, effectively addressing the prevalent error accumulation issue. At its core, MVDiffusion processes perspective images in parallel with a pre-trained text-to-image diffusion model, while integrating novel correspondence-aware attention layers to facilitate cross-view interactions. For panorama generation, while only trained with 10k panoramas, MVDiffusion is able to generate high-resolution photorealistic images for arbitrary texts or extrapolate one perspective image to a 360-degree view. For multi-view depth-to-image generation, MVDiffusion demonstrates state-of-the-art performance for texturing a scene mesh.
Key facts. Cited by 210 papers in the map (data through 7 Oct 2026). Builds on 41 of its 51 references that are in the map. First posted on arXiv 3 Jul 2023.
Builds on
41 of 51 references.
References · 41
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
29 more
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2017Neural Discrete Representation Learningcited by 4,650
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2016Improved Techniques for Training GANscited by 2,938
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2018Pros and Cons of GAN Evaluation Measurescited by 224
- 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
- 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
Built on by
Citing papers per year: 2023: 37; 2024: 76; 2025: 67; 2026: 30.
210 papers.
Sort:
By area:
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
- 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
- 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
38 more
- 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesiscited by 84
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
- 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
- 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illuminationcited by 67
- 2024MultiDiff: Consistent Novel View Synthesis from a Single Imagecited by 67
- 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusioncited by 65
- 2024Controlling Space and Time with Diffusion Modelscited by 65
- 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
- 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Modelscited by 57
- 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
- 2023ControlRoom3D: Room Generation using Semantic Proxy Roomscited by 54
- 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
- 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
- 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 50
- 2023Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusioncited by 50
- 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
- 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
- 2023Instant3D: Instant Text-to-3D Generationcited by 45
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 42
- 2024SceneCraft: Layout-Guided 3D Scene Generationcited by 40
- 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 39
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
- 2024MVD-Fusion: Single-view 3D via Depth-consistent Multi-view Generationcited by 35
- 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generationcited by 35
- 2023HiFi-123: Towards High-fidelity One Image to 3D Content Generationcited by 34
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
- 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
- 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 30
- 20243D-SceneDreamer: Text-Driven 3D-Consistent Scene Generationcited by 29
50 most cited of 210 All 210 (JSON)
- 2026StreetDiff: Multi-view Street Scenes Generation via Cross-view Consistent Multi-view Stable Diffusion with Structure Prompts9 Sep 2026
- 2026Linear Fusion MultiDiffusion for Fast Training-Free Spherical Panorama Generation2 Sep 2026
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transport13 Aug 2026
- 2026Enhancing In-context Panoramic Generation via Geometric-aware Pretraining9 Jul 2026
- 2026CGGS: Consistency-Augmented Geometric Gaussian Splatting for Ego-Centric 3D Scene Generation4 Jul 2026
- 2026PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation2 Jul 2026
- 2026Restore3D: Breathing Life into Broken Objects with Shape and Texture Restoration1 Jul 2026
- 2026Variance Reduction on the Camera Axis: Multi-View Score Distillation for 3D29 Jun 2026
- 2026Variational Test-time Optimization for Diffusion Synchronization14 Jun 2026
- 2026TextHOI-3D: Text-to-3D Hand-Object Interaction via Discrete Multi-View Generation and Joint Mesh Optimization10 Jun 2026
- 2026Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment5 Jun 2026
- 2026DVSM: Decoder-only View Synthesis Model Done Right28 May 2026
38 more
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion25 May 2026
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speed22 May 2026
- 2026PanoWorld: A Generative Spatial World Model for Consistent Whole-House Panorama Synthesis18 May 2026
- 2026DecoRec: Decomposed 3D Scene Reconstruction from Single-View Images via Object-Level Diffusion16 May 2026
- 2026CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coverage15 May 2026
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2026Beyond Thinking: Imagining in 360^circ for Humanoid Visual Search9 May 2026
- 2026Camera Control for Text-to-Image Generation via Learning Viewpoint Tokens21 Apr 2026
- 2026Geo-EVS: Geometry-Conditioned Extrapolative View Synthesis for Autonomous Driving8 Apr 2026
- 2026PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis6 Apr 2026
- 2026WorldMesh: Generating Navigable Multi-Room 3D Scenes via Mesh-Conditioned Image Diffusion24 Mar 2026
- 2026World Reconstruction From Inconsistent Views17 Mar 2026
- 2026Scene Generation at Absolute Scale: Utilizing Semantic and Geometric Guidance From Text for Accurate and Interpretable 3D Indoor Scene Generation14 Mar 2026
- 2026SemanticNVS: Improving Semantic Scene Understanding in Generative Novel View Synthesis23 Feb 2026
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketching12 Feb 2026
- 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation3 Feb 2026
- 2026AnchoredDream: Zero-Shot 360deg Indoor Scene Generation from a Single View via Geometric Grounding23 Jan 2026
- 2026Rotate Your Character: Revisiting Video Diffusion Models for High-Quality 3D Character Generation9 Jan 2026
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstruction31 Dec 2025
- 2025SE360: Semantic Edit in 360^circ Panoramas via Hierarchical Data Construction23 Dec 2025
- 2025MatLat: Material Latent Space for PBR Texture Generation19 Dec 2025
- 2025An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenes15 Dec 2025
- 2025StereoSpace: Depth-Free Synthesis of Stereo Geometry via End-to-End Diffusion in a Canonical Space11 Dec 2025
- 2025JoPano: Unified Panorama Generation via Joint Modeling7 Dec 2025
- 2025MVRoom: Controllable 3D Indoor Scene Generation with Multi-View Diffusion Models3 Dec 2025
- 2025InStyle: Instant Appearance Stylization of 3D Shapes3 Dec 2025
- 2025TEXTRIX: Latent Attribute Grid for Native Texture Generation and Beyond2 Dec 2025
- 2025Inverse Rendering for High-Genus Surface Meshes from Multi-View Images24 Nov 2025
- 2025Neural Geometry Image-Based Representations with Optimal Transport (OT)24 Nov 2025
- 2025WorldGen: From Text to Traversable and Interactive 3D Worlds20 Nov 2025
- 2025B-Rep Distance Functions (BR-DF): How to Represent a B-Rep Model by Volumetric Distance Functions?18 Nov 2025
- 2025DiffSwap++: 3D Latent-Controlled Diffusion for Identity-Preserving Face Swapping4 Nov 2025
- 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image3 Nov 2025
- 2025MagicView: Multi-View Consistent Identity Customization via Priors-Guided In-Context Learning31 Oct 2025
- 2025OmniX: From Unified Panoramic Generation and Perception to Graphics-Ready 3D Scenes30 Oct 2025
- 2025AutoScape: Geometry-Consistent Long-Horizon Scene Generation23 Oct 2025
- 2025Seed3D 1.0: From Images to High-Fidelity Simulation-Ready 3D Assets22 Oct 2025
- 2025RayPose: Ray Bundling Diffusion for Template Views in Unseen 6D Object Pose Estimation21 Oct 2025
50 newest of 210 All 210 (JSON)
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
- 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesiscited by 84
- 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
- 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illuminationcited by 67
12 most cited of 89 All 89 (JSON)
- 2026StreetDiff: Multi-view Street Scenes Generation via Cross-view Consistent Multi-view Stable Diffusion with Structure Prompts9 Sep 2026
- 2026Variance Reduction on the Camera Axis: Multi-View Score Distillation for 3D29 Jun 2026
- 2026Variational Test-time Optimization for Diffusion Synchronization14 Jun 2026
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion25 May 2026
- 2026PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis6 Apr 2026
- 2026World Reconstruction From Inconsistent Views17 Mar 2026
- 2026Scene Generation at Absolute Scale: Utilizing Semantic and Geometric Guidance From Text for Accurate and Interpretable 3D Indoor Scene Generation14 Mar 2026
- 2026SemanticNVS: Improving Semantic Scene Understanding in Generative Novel View Synthesis23 Feb 2026
- 2026Rotate Your Character: Revisiting Video Diffusion Models for High-Quality 3D Character Generation9 Jan 2026
- 2025MVRoom: Controllable 3D Indoor Scene Generation with Multi-View Diffusion Models3 Dec 2025
- 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image3 Nov 2025
- 2025AutoScape: Geometry-Consistent Long-Horizon Scene Generation23 Oct 2025
12 newest of 89 All 89 (JSON)
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
- 2024DriveScape: Towards High-Resolution Controllable Multi-View Driving Video Generationcited by 22
- 2024Physical Informed Driving World Modelcited by 12
- 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generationcited by 8
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 2
- 2026PanoWorld: A Generative Spatial World Model for Consistent Whole-House Panorama Synthesiscited by 2
- 2026PanoWorld: A Generative Spatial World Model for Consistent Whole-House Panorama Synthesis18 May 2026
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation3 Feb 2026
- 2024Physical Informed Driving World Model11 Dec 2024
- 2024DriveScape: Towards High-Resolution Controllable Multi-View Driving Video Generation9 Sep 2024
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homes11 Dec 2023
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
- 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
- 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusioncited by 65
- 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
- 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Modelscited by 57
12 most cited of 115 All 115 (JSON)
- 2026Linear Fusion MultiDiffusion for Fast Training-Free Spherical Panorama Generation2 Sep 2026
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transport13 Aug 2026
- 2026Enhancing In-context Panoramic Generation via Geometric-aware Pretraining9 Jul 2026
- 2026CGGS: Consistency-Augmented Geometric Gaussian Splatting for Ego-Centric 3D Scene Generation4 Jul 2026
- 2026PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation2 Jul 2026
- 2026Restore3D: Breathing Life into Broken Objects with Shape and Texture Restoration1 Jul 2026
- 2026TextHOI-3D: Text-to-3D Hand-Object Interaction via Discrete Multi-View Generation and Joint Mesh Optimization10 Jun 2026
- 2026Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment5 Jun 2026
- 2026DVSM: Decoder-only View Synthesis Model Done Right28 May 2026
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speed22 May 2026
- 2026DecoRec: Decomposed 3D Scene Reconstruction from Single-View Images via Object-Level Diffusion16 May 2026
- 2026CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coverage15 May 2026
12 newest of 115 All 115 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Model
- 2024One Diffusion to Generate Them All
- 2024SpotDiffusion: A Fast Approach For Seamless Panorama Generation Over Time
- 2024MVDiff: Scalable and Flexible Multi-View Diffusion for 3D Object Reconstruction from Single-View
- 2025MVCustom: Multi-View Customized Diffusion via Geometric Latent Rendering and Completion
- 2024Multi-view Image Prompted Multi-view Diffusion for Improved 3D Generation
- 2025PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignment
- 2024MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusion