SE360: Semantic Edit in 360^circ Panoramas via Hierarchical Data Construction
Not on the map. Why?
Abstract (arXiv)
While instruction-based image editing is emerging, extending it to 360^circ panoramas introduces additional challenges. Existing methods often produce implausible results in both equirectangular projections (ERP) and perspective views. To address these limitations, we propose SE360, a novel framework for multi-condition guided object editing in 360^circ panoramas. At its core is a novel coarse-to-fine autonomous data generation pipeline without manual intervention. This pipeline leverages a Vision-Language Model (VLM) and adaptive projection adjustment for hierarchical analysis, ensuring the holistic segmentation of objects and their physical context. The resulting data pairs are both semantically meaningful and geometrically consistent, even when sourced from unlabeled panoramas. Furthermore, we introduce a cost-effective, two-stage data refinement strategy to improve data realism and mitigate model overfitting to erase artifacts. Based on the constructed dataset, we train a Transformer-based diffusion model to allow flexible object editing guided by text, mask, or reference image in 360^circ panoramas. Our experiments demonstrate that our method outperforms existing methods in both visual quality and semantic accuracy.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 25 of its 59 references that are in the map. First posted on arXiv 23 Dec 2025.
Builds on
25 of 59 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
13 more
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
- 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 51
- 2024Paint by Inpaint: Learning to Add Image Objects by Removing Them Firstcited by 39
- 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generationcited by 35
- 2023Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generationcited by 33
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
- 2024InsightEdit: Towards Better Instruction Following for Image Editingcited by 17
- 2024Taming Stable Diffusion for Text to 360deg Panorama Image Generationcited by 12
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2022HORIZON: High-Resolution Semantically Controlled Panorama Synthesis
- 2026CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling
- 2026Toward 360-Degree Indoor Panorama Editing via Tuning-Free Diffusion Model with Refocusing Cross-Attention
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama World
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360deg
- 2026SeamEdit: A Black-Box VLM-Agnostic Pipeline for Large-Image Semantic Editing
- 2025Edit360: 2D Image Edits to 3D Assets from Any Angle
- 2026SHERPA: Seam-aware Harmonized ERP Adaptation for Open-Domain 360^circ Panorama Generation