mlsanityData to 14 Oct 2026

PanoDiffusion: 360-degree Panorama Outpainting via Diffusion

arXiv 2307.03177 ↗First posted 6 Jul 2023cs.CVcited by 51

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Generating complete 360-degree panoramas from narrow field of view images is ongoing research as omnidirectional RGB data is not readily available. Existing GAN-based approaches face some barriers to achieving higher quality output, and have poor generalization performance over different mask types. In this paper, we present our 360-degree indoor RGB-D panorama outpainting model using latent diffusion models (LDM), called PanoDiffusion. We introduce a new bi-modal latent diffusion structure that utilizes both RGB and depth panoramic data during training, which works surprisingly well to outpaint depth-free RGB images during inference. We further propose a novel technique of introducing progressive camera rotations during each diffusion denoising step, which leads to substantial improvement in achieving panorama wraparound consistency. Results show that our PanoDiffusion not only significantly outperforms state-of-the-art methods on RGB-D panorama outpainting by producing diverse well-structured results for different types of masks, but can also synthesize high-quality depth panoramas to provide realistic 3D indoor models.

Key facts. Cited by 51 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 29 of its 44 references that are in the map. First posted on arXiv 6 Jul 2023.

Builds on

29 of 44 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model9 Dec
  2. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan

Other references · 27

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2016Improved Techniques for Training GANscited by 2,970
  4. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  5. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  6. 2018Generative Image Inpainting with Contextual Attentioncited by 580
  7. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 434
  8. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
  9. 2021Generating Images with Sparse Representationscited by 266
  10. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
  11. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  12. 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
15 more
  1. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
  2. 2020Non-Local Spatial Propagation Network for Depth Completioncited by 195
  3. 2019Pluralistic Image Completioncited by 162
  4. 2017Learning to Predict Indoor Illumination from a Single Imagecited by 161
  5. 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
  6. 2018Depth Estimation via Affinity Learned with Convolutional Spatial Propagation Networkcited by 110
  7. 2019Deep Parametric Indoor Lighting Estimationcited by 83
  8. 2018T2Net: Synthetic-to-Realistic Translation for Solving Single-Image Depth Estimation Taskscited by 70
  9. 2019Neural Illumination: Lighting Prediction for Indoor Environmentscited by 58
  10. 2020HDR Environment Map Estimation for Real-Time Augmented Realitycited by 47
  11. 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creationcited by 47
  12. 2021Bridging Global Context Interactions for High-Fidelity Image Completioncited by 40
  13. 2022BlobGAN: Spatially Disentangled Scene Representationscited by 35
  14. 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
  15. 2017Joint Layout Estimation and Global Multi-View Registration for Indoor Reconstructioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 9; 2025: 24; 2026: 17.

51 papers.

Sort:

By area:

  1. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
  2. 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 58
  3. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  4. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
  5. 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generationcited by 35
  6. 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 24
  7. 20253D Scene Generation: A Surveycited by 24
  8. 2025DiT360: High-Fidelity Panoramic Image Generation via Hybrid Trainingcited by 24
  9. 2024PanoFree: Tuning-Free Holistic Multi-view Image Generation with Cross-view Self-Guidancecited by 18
  10. 2025Beyond the Frame: Generating 360 Panoramic Videos from Perspective Videoscited by 16
  11. 2025VideoPanda: Video Panoramic Diffusion with Multi-view Attentioncited by 13
  12. 2025What Makes for Text to 360-degree Panorama Generation with Stable Diffusion?cited by 13
38 more
  1. 2025DreamCube: 3D Panorama Generation via Multi-plane Synchronizationcited by 12
  2. 2025Panorama Generation From NFoV Image Done Rightcited by 11
  3. 2025Omni2: Unifying Omnidirectional Image Generation and Editing in an Omni Modelcited by 9
  4. 2025Conditional Panoramic Image Generation via Masked Autoregressive Modelingcited by 9
  5. 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusioncited by 7
  6. 2026360Anything: Geometry-Free Lifting of Images and Videos to 360degcited by 7
  7. 2024CamFreeDiff: Camera-free Image to Panorama Generation with Diffusion Modelcited by 5
  8. 2024OmniDrag: Enabling Motion Control for Omnidirectional Image-to-Video Generationcited by 5
  9. 2024PanoLlama: Generating Endless and Coherent Panoramas with Next-Token-Prediction LLMscited by 4
  10. 2025OmniX: From Unified Panoramic Generation and Perception to Graphics-Ready 3D Scenescited by 4
  11. 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
  12. 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
  13. 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffoldcited by 4
  14. 2025Constructing a 3D Scene from a Single Imagecited by 3
  15. 2025Look Beyond: Two-Stage Scene View Generation via Panorama and Video Diffusioncited by 3
  16. 2025Self-Evolving 3D Scene Generation from a Single Imagecited by 3
  17. 2026PanoWorld: A Generative Spatial World Model for Consistent Whole-House Panorama Synthesiscited by 3
  18. 2024PanoDreamer: Optimization-Based Single Image to 360 3D Scene With Diffusioncited by 2
  19. 2025DreamAnywhere: Object-Centric Panoramic 3D Scene Generationcited by 2
  20. 2025SE360: Semantic Edit in 360^circ Panoramas via Hierarchical Data Constructioncited by 2
  21. 2023Increasing diversity of omni-directional images generated from single image using cGAN based on MLPMixercited by 1
  22. 2025SparsyFed: Sparse Adaptive Federated Trainingcited by 1
  23. 2026Map2World: Segment Map Conditioned Text to 3D World Generationcited by 1
  24. 2026CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coveragecited by 1
  25. 2024FaithFill: Faithful Inpainting for Object Completion Using a Single Reference Imagecited by 0
  26. 2025Generative Panoramic Image Stitchingcited by 0
  27. 2025HDR Environment Map Estimation with Latent Diffusion Modelscited by 0
  28. 2025JoPano: Unified Panorama Generation via Joint Modelingcited by 0
  29. 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completioncited by 0
  30. 2026Stepper: Stepwise Immersive Scene Generation with Multiview Panoramascited by 0
  31. 2026LatentHDR: Decoupling Exposure from Diffusion via Conditional Latent-to-Latent Mapping for Text/Image-to-Panoramic HDRcited by 0
  32. 2026PanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splattingcited by 0
  33. 2026SHERPA: Seam-aware Harmonized ERP Adaptation for Open-Domain 360^circ Panorama Generationcited by 0
  34. 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesiscited by 0
  35. 2026Interpretable Human-Label-Free Deep Learning for Real-Bogus Classification with Uncertainty Quantificationcited by 0
  36. 2026Enhancing In-context Panoramic Generation via Geometric-aware Pretrainingcited by 0
  37. 2026Mover360: Controllable Object Manipulation in 360deg Panoramic Imagescited by 0
  38. 2026MUGEN: Interactive Panoramic World Exploration via Camera Controlcited by 0

50 most cited of 51 All 51 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023360-Degree Panorama Generation from Few Unregistered NFoV Images
  2. 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Models
  3. 2023Customizing 360-Degree Panoramas through Text-to-Image Diffusion Models
  4. 2023LDM3D-VR: Latent Diffusion Model for 3D VR
  5. 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Models
  6. 2025SphereDiff: Tuning-free 360deg Static and Dynamic Panorama Generation via Spherical Latent Representation
  7. 2024SpotDiffusion: A Fast Approach For Seamless Panorama Generation Over Time
  8. 2024StereoDiffusion: Training-Free Stereo Image Generation Using Latent Diffusion Models