Multi-Scale Diffusion: Enhancing Spatial Layout in High-Resolution Panoramic Image Generation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Diffusion models have recently gained recognition for generating diverse and high-quality content, especially in image synthesis. These models excel not only in creating fixed-size images but also in producing panoramic images. However, existing methods often struggle with spatial layout consistency when producing high-resolution panoramas due to the lack of guidance on the global image layout. This paper introduces the Multi-Scale Diffusion (MSD), an optimized framework that extends the panoramic image generation framework to multiple resolution levels. Our method leverages gradient descent techniques to incorporate structural information from low-resolution images into high-resolution outputs. Through comprehensive qualitative and quantitative evaluations against prior work, we demonstrate that our approach significantly improves the coherence of high-resolution panorama generation.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 34 of its 40 references that are in the map. First posted on arXiv 24 Oct 2024.
Builds on
34 of 40 references.
Closest ancestors · 6
Same direction, newest first
- 2024HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions21 Jul
- 2024TwinDiffusion: Enhancing Coherence and Efficiency in Panoramic Image Generation with Diffusion Models30 Apr
- 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Models22 Nov
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusions8 Jun
- 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2020Denoising Diffusion Implicit Modelscited by 9,718
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,028
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,213
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,023
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,564
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,339
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,000
- 2017Neural Discrete Representation Learningcited by 4,680
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,323
16 more
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,141
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,751
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,585
- 2018Demystifying MMD GANscited by 1,277
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 926
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 532
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 473
- 2023Emergent Correspondence from Image Diffusioncited by 440
- 2022Blended Latent Diffusioncited by 432
- 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 324
- 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generationcited by 257
- 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Modelcited by 145
- 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Modelscited by 127
- 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 106
- 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
- 2023Mixture of Diffusers for scene composition and high resolution image generationcited by 56
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 2.
4 papers.
- 2025Conditional Panoramic Image Generation via Masked Autoregressive Modelingcited by 9
- 2024PanoLlama: Generating Endless and Coherent Panoramas with Next-Token-Prediction LLMscited by 4
- 2026Accelerating Diffusion Decoders via Multi-Scale Sampling and One-Step Distillationcited by 0
- 2026Linear Fusion MultiDiffusion for Fast Training-Free Spherical Panorama Generationcited by 0
- 2026Linear Fusion MultiDiffusion for Fast Training-Free Spherical Panorama Generation2 Sep 2026
- 2026Accelerating Diffusion Decoders via Multi-Scale Sampling and One-Step Distillation20 Mar 2026
- 2025Conditional Panoramic Image Generation via Masked Autoregressive Modeling22 May 2025
- 2024PanoLlama: Generating Endless and Coherent Panoramas with Next-Token-Prediction LLMs24 Nov 2024
Similar, not cited
Close in wording, no citation either way
- 2024SpotDiffusion: A Fast Approach For Seamless Panorama Generation Over Time
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusion
- 2025What Makes for Text to 360-degree Panorama Generation with Stable Diffusion?
- 2025TanDiT: Tangent-Plane Diffusion Transformer for High-Quality 360deg Panorama Generation
- 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance
- 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generation
- 2023Customizing 360-Degree Panoramas through Text-to-Image Diffusion Models
- 2024Merging and Splitting Diffusion Paths for Semantically Coherent Panoramas