360PanT: Training-Free Text-Driven 360-Degree Panorama-to-Panorama Translation
Not on the map. Why?
Abstract (arXiv)
Preserving boundary continuity in the translation of 360-degree panoramas remains a significant challenge for existing text-driven image-to-image translation methods. These methods often produce visually jarring discontinuities at the translated panorama's boundaries, disrupting the immersive experience. To address this issue, we propose 360PanT, a training-free approach to text-based 360-degree panorama-to-panorama translation with boundary continuity. Our 360PanT achieves seamless translations through two key components: boundary continuity encoding and seamless tiling translation with spatial control. Firstly, the boundary continuity encoding embeds critical boundary continuity information of the input 360-degree panorama into the noisy latent representation by constructing an extended input image. Secondly, leveraging this embedded noisy latent representation and guided by a target prompt, the seamless tiling translation with spatial control enables the generation of a translated image with identical left and right halves while adhering to the extended input's structure and semantic layout. This process ensures a final translated 360-degree panorama with seamless boundary continuity. Experimental results on both real-world and synthesized datasets demonstrate the effectiveness of our 360PanT in translating 360-degree panoramas. Code is available at hrefhttps://github.com/littlewhitesea/360PanThttps://github.com/littlewhitesea/360PanT.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 37 of its 44 references that are in the map. First posted on arXiv 12 Sep 2024.
Builds on
37 of 44 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
25 more
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2017Unsupervised Image-to-Image Translation Networkscited by 603
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 110
- 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 103
- 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
- 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
- 2020TSIT: A Simple and Versatile Framework for Image-to-Image Translationcited by 64
- 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
- 2023Customizing 360-Degree Panoramas through Text-to-Image Diffusion Modelscited by 47
- 2023Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generationcited by 33
- 2020Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approachcited by 29
- 2022Text2Light: Zero-Shot Text-Driven HDR Panorama Generationcited by 24
- 2023Conditional 360-degree Image Synthesis for Immersive Indoor Scene Decorationcited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPEcited by 2
- 2025A Survey on Text-Driven 360-Degree Panorama Generationcited by 0
- 2026Probing CLIP's Comprehension of 360-Degree Textual and Visual Semanticscited by 0
- 2026Mover360: Controllable Object Manipulation in 360deg Panoramic Imagescited by 0
- 2026Mover360: Controllable Object Manipulation in 360deg Panoramic Images24 Aug 2026
- 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE30 Jun 2026
- 2026Probing CLIP's Comprehension of 360-Degree Textual and Visual Semantics27 Apr 2026
- 2025A Survey on Text-Driven 360-Degree Panorama Generation20 Feb 2025