mlsanityData to 7 Oct 2026

SPAD : Spatially Aware Multiview Diffusers

arXiv 2402.05235 ↗First posted 7 Feb 2024cs.CVcited by 62

Not on the map. Why?

Cited by 25 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present SPAD, a novel approach for creating consistent multi-view images from text prompts or single images. To enable multi-view generation, we repurpose a pretrained 2D diffusion model by extending its self-attention layers with cross-view interactions, and fine-tune it on a high quality subset of Objaverse. We find that a naive extension of the self-attention proposed in prior work (e.g. MVDream) leads to content copying between views. Therefore, we explicitly constrain the cross-view attention based on epipolar geometry. To further enhance 3D consistency, we utilize Plucker coordinates derived from camera rays and inject them as positional encoding. This enables SPAD to reason over spatial proximity in 3D well. In contrast to recent works that can only generate views at fixed azimuth and elevation, SPAD offers full camera control and achieves state-of-the-art results in novel view synthesis on unseen objects from the Objaverse and Google Scanned Objects datasets. Finally, we demonstrate that text-to-3D generation using SPAD prevents the multi-face Janus issue. See more details at our webpage: https://yashkant.github.io/spad

Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). Builds on 93 of its 110 references that are in the map. First posted on arXiv 7 Feb 2024.

Builds on

93 of 110 references.

References · 93

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
38 more
  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  2. 2013Auto-Encoding Variational Bayescited by 3,980
  3. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2016Improved Techniques for Training GANscited by 2,938
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  8. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  10. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  11. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  12. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  13. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  14. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  15. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  16. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  17. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  18. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  19. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  20. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  21. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  22. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  23. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  24. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  25. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  26. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  27. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  28. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  29. 2023Emergent Correspondence from Image Diffusioncited by 437
  30. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  31. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  32. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  33. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  34. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  35. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  36. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  37. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  38. 2022Novel View Synthesis with Diffusion Modelscited by 299

50 most cited of 93 All 93 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 28; 2025: 28; 2026: 6.

62 papers.

Sort:

By area:

  1. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  2. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
  3. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  4. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  5. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
  6. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
  7. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
  8. 2024GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warpingcited by 72
  9. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  10. 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 49
  11. 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
  12. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
38 more
  1. 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
  2. 2024MVD-Fusion: Single-view 3D via Depth-consistent Multi-view Generationcited by 35
  3. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  4. 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Modelscited by 30
  5. 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
  6. 2024Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attentioncited by 24
  7. 2025Pippo: High-Resolution Multi-View Humans from a Single Imagecited by 20
  8. 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generationcited by 19
  9. 2024Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representationcited by 17
  10. 2025Zero4D: Training-Free 4D Video Generation From Single Video Using Off-the-Shelf Video Diffusioncited by 15
  11. 2026Vista4D: Video Reshooting with 4D Point Cloudscited by 15
  12. 2025VideoPanda: Video Panoramic Diffusion with Multi-view Attentioncited by 13
  13. 2024MvDrag3D: Drag-based Creative 3D Editing via Multi-view Generation-Reconstruction Priorscited by 12
  14. 2024NVComposer: Boosting Generative Novel View Synthesis with Multiple Sparse and Unposed Imagescited by 12
  15. 2025Exo2EgoSyn: Unlocking Foundation Video Generation Models for Exocentric-to-Egocentric Video Synthesiscited by 12
  16. 2024GT23D-Bench: A Comprehensive General Text-to-3D Generation Benchmarkcited by 11
  17. 2024HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Modelcited by 9
  18. 2025Auto-Regressively Generating Multi-View Consistent Imagescited by 9
  19. 2025MVGBench: Comprehensive Benchmark for Multi-view Generation Modelscited by 9
  20. 2024Multi-View Large Reconstruction Model via Geometry-Aware Positional Encoding and Attentioncited by 6
  21. 2024Direct and Explicit 3D Generation from a Single Imagecited by 6
  22. 2025LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusioncited by 6
  23. 2024Bootstrap3D: Improving Multi-view Diffusion Model with Synthetic Datacited by 5
  24. 2025CoreEditor: Correspondence-constrained Diffusion for Consistent 3D Editingcited by 5
  25. 2024Pixel-Aligned Multi-View Generation with Depth Guided Decodercited by 4
  26. 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
  27. 2025Perspective-aware 3D Gaussian Inpainting with Multi-view Consistencycited by 3
  28. 2024SeMv-3D: Towards Concurrency of Semantic and Multi-view Consistency in General Text-to-3D Generationcited by 2
  29. 2024Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse Viewscited by 2
  30. 2025MD-ProjTex: Texturing 3D Shapes with Multi-Diffusion Projectioncited by 2
  31. 2025Refining Few-Step Text-to-Multiview Diffusion via Reinforcement Learningcited by 2
  32. 2025Neural USD: An object-centric framework for iterative editing and controlcited by 2
  33. 2025LumiTex: Towards High-Fidelity PBR Texture Generation with Illumination Contextcited by 2
  34. 2025GimbalDiffusion: Gravity-Aware Camera Control for Video Generationcited by 2
  35. 2025StereoSpace: Depth-Free Synthesis of Stereo Geometry via End-to-End Diffusion in a Canonical Spacecited by 2
  36. 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generationcited by 1
  37. 2025EscherNet++: Simultaneous Amodal Completion and Scalable View Synthesis through Masked Fine-Tuning and Enhanced Feed-Forward 3D Reconstructioncited by 1
  38. 2025MVRoom: Controllable 3D Indoor Scene Generation with Multi-View Diffusion Modelscited by 1

50 most cited of 62 All 62 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Synthesizing Consistent Novel Views via 3D Epipolar Attention without Re-Training
  2. 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstruction
  3. 2025CAMEO: Correspondence-Attention Alignment for Multi-View Diffusion Models
  4. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models
  5. 2026Enhancing Novel View Synthesis via Geometry Grounded Set Diffusion
  6. 2024MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusion
  7. 2024Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors
  8. 2026Spackle: Completing Large View Single Image NVS with Adaptive Gaussians