mlsanityData to 7 Oct 2026

TwinDiffusion: Enhancing Coherence and Efficiency in Panoramic Image Generation with Diffusion Models

arXiv 2404.19475 ↗First posted 30 Apr 2024cs.CVcited by 5

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Diffusion models have emerged as effective tools for generating diverse and high-quality content. However, their capability in high-resolution image generation, particularly for panoramic images, still faces challenges such as visible seams and incoherent transitions. In this paper, we propose TwinDiffusion, an optimized framework designed to address these challenges through two key innovations: the Crop Fusion for quality enhancement and the Cross Sampling for efficiency optimization. We introduce a training-free optimizing stage to refine the similarity of adjacent image areas, as well as an interleaving sampling strategy to yield dynamic patches during the cropping process. A comprehensive evaluation is conducted to compare TwinDiffusion with the prior works, considering factors including coherence, fidelity, compatibility, and efficiency. The results demonstrate the superior performance of our approach in generating seamless and coherent panoramas, setting a new standard in quality and efficiency for panoramic image generation.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 39 of its 46 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

39 of 46 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024Taming Stable Diffusion for Text to 360deg Panorama Image Generation11 Apr
  2. 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Models22 Nov
  3. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models20 Oct
  4. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
  5. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion12 Dec
  6. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2016Improved Techniques for Training GANscited by 2,938
  12. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
21 more
  1. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  2. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  3. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  4. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  5. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  6. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  7. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  8. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  9. 2022Blended Latent Diffusioncited by 430
  10. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
  11. 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
  12. 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 216
  13. 2023Diffusion Model is an Effective Planner and Data Synthesizer for Multi-Task Reinforcement Learningcited by 114
  14. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
  15. 2023Mixture of Diffusers for scene composition and high resolution image generationcited by 56
  16. 2022Efficient Diffusion Models for Vision: A Surveycited by 50
  17. 2022How Much is Enough? A Study on Diffusion Times in Score-based Generative Modelscited by 35
  18. 2024T-Stitch: Accelerating Sampling in Pre-Trained Diffusion Models with Trajectory Stitchingcited by 32
  19. 2023Dance with You: The Diversity Controllable Dancer Generation via Diffusion Modelscited by 17
  20. 2023Optimal Linear Subspace Search: Learning to Construct Fast and High-Quality Schedulers for Diffusion Modelscited by 12
  21. 2022Image Super-Resolution With Deep Variational Autoencoderscited by 11

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 3.

5 papers.

  1. 2024Multi-Scale Diffusion: Enhancing Spatial Layout in High-Resolution Panoramic Image Generationcited by 4
  2. 2024PanoLlama: Generating Endless and Coherent Panoramas with Next-Token-Prediction LLMscited by 4
  3. 2025LeakyCLIP: Extracting Training Data from CLIPcited by 4
  4. 2025PanoDiff-SR: Synthesizing Dental Panoramic Radiographs using Diffusion and Super-resolutioncited by 2
  5. 2025InfiniteDiffusion: Bridging Learned Fidelity and Procedural Utility for Open-World Terrain Generationcited by 1

Similar, not cited

Close in wording, no citation either way

  1. 2024SpotDiffusion: A Fast Approach For Seamless Panorama Generation Over Time
  2. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusions
  3. 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusion
  4. 2024Merging and Splitting Diffusion Paths for Semantically Coherent Panoramas
  5. 2023Customizing 360-Degree Panoramas through Text-to-Image Diffusion Models
  6. 2025TanDiT: Tangent-Plane Diffusion Transformer for High-Quality 360deg Panorama Generation
  7. 2025DreamCube: 3D Panorama Generation via Multi-plane Synchronization
  8. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion