mlsanityData to 14 Oct 2026

360PanT: Training-Free Text-Driven 360-Degree Panorama-to-Panorama Translation

arXiv 2409.08397 ↗First posted 12 Sep 2024cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Preserving boundary continuity in the translation of 360-degree panoramas remains a significant challenge for existing text-driven image-to-image translation methods. These methods often produce visually jarring discontinuities at the translated panorama's boundaries, disrupting the immersive experience. To address this issue, we propose 360PanT, a training-free approach to text-based 360-degree panorama-to-panorama translation with boundary continuity. Our 360PanT achieves seamless translations through two key components: boundary continuity encoding and seamless tiling translation with spatial control. Firstly, the boundary continuity encoding embeds critical boundary continuity information of the input 360-degree panorama into the noisy latent representation by constructing an extended input image. Secondly, leveraging this embedded noisy latent representation and guided by a target prompt, the seamless tiling translation with spatial control enables the generation of a translated image with identical left and right halves while adhering to the extended input's structure and semantic layout. This process ensures a final translated 360-degree panorama with seamless boundary continuity. Experimental results on both real-world and synthesized datasets demonstrate the effectiveness of our 360PanT in translating 360-degree panoramas. Code is available at hrefhttps://github.com/littlewhitesea/360PanThttps://github.com/littlewhitesea/360PanT.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 37 of its 44 references that are in the map. First posted on arXiv 12 Sep 2024.

Builds on

37 of 44 references.

References · 37

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  10. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  11. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  12. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
25 more
  1. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  2. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  3. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  4. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
  5. 2017Unsupervised Image-to-Image Translation Networkscited by 603
  6. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
  7. 2023Zero-shot Image-to-Image Translationcited by 505
  8. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  9. 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
  10. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
  11. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
  12. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
  13. 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
  14. 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
  15. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 110
  16. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 103
  17. 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
  18. 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
  19. 2020TSIT: A Simple and Versatile Framework for Image-to-Image Translationcited by 64
  20. 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
  21. 2023Customizing 360-Degree Panoramas through Text-to-Image Diffusion Modelscited by 47
  22. 2023Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generationcited by 33
  23. 2020Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approachcited by 29
  24. 2022Text2Light: Zero-Shot Text-Driven HDR Panorama Generationcited by 24
  25. 2023Conditional 360-degree Image Synthesis for Immersive Indoor Scene Decorationcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.