mlsanityData to 14 Oct 2026

Omni2: Unifying Omnidirectional Image Generation and Editing in an Omni Model

arXiv 2504.11379 ↗First posted 15 Apr 2025cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

360circ omnidirectional images (ODIs) have gained considerable attention recently, and are widely used in various virtual reality (VR) and augmented reality (AR) applications. However, capturing such images is expensive and requires specialized equipment, making ODI synthesis increasingly important. While common 2D image generation and editing methods are rapidly advancing, these models struggle to deliver satisfactory results when generating or editing ODIs due to the unique format and broad 360circ Field-of-View (FoV) of ODIs. To bridge this gap, we construct textbftextitAny2Omni, the first comprehensive ODI generation-editing dataset comprises 60,000+ training data covering diverse input conditions and up to 9 ODI generation and editing tasks. Built upon Any2Omni, we propose an textbfunderlineOmni model for textbfunderlineOmni-directional image generation and editing (textbftextitOmni2), with the capability of handling various ODI generation and editing tasks under diverse input conditions using one model. Extensive experiments demonstrate the superiority and effectiveness of the proposed Omni2 model for both the ODI generation and editing tasks. Both the Any2Omni dataset and the Omni2 model are publicly available at: https://github.com/IntMeGroup/Omni2.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 30 of its 53 references that are in the map. First posted on arXiv 15 Apr 2025.

Builds on

30 of 53 references.

References · 30

  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2016Improved Techniques for Training GANscited by 2,970
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  6. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  7. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  8. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  9. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  10. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
  11. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  12. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
18 more
  1. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
  2. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
  3. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
  4. 2017Learning to Predict Indoor Illumination from a Single Imagecited by 161
  5. 2023Inst-Inpaint: Instructing to Remove Objects with Diffusion Modelscited by 66
  6. 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 58
  7. 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 51
  8. 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creationcited by 47
  9. 2024Perceptual Video Quality Assessment: A Surveycited by 43
  10. 2023360-Degree Panorama Generation from Few Unregistered NFoV Imagescited by 42
  11. 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
  12. 2022Confusing Image Quality Assessment: Towards Better Augmented Reality Experiencecited by 32
  13. 2024DreamOmni: Unified Image Generation and Editingcited by 30
  14. 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
  15. 2022Text2Light: Zero-Shot Text-Driven HDR Panorama Generationcited by 24
  16. 2024AIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Imagescited by 16
  17. 2022PanoDepth: A Two-Stage Approach for Monocular Omnidirectional Depth Estimationcited by 9
  18. 2022HiMODE: A Hybrid Monocular Omnidirectional Depth Estimation Modelcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 3.

9 papers.