Omni2: Unifying Omnidirectional Image Generation and Editing in an Omni Model
Not on the map. Why?
Abstract (arXiv)
360circ omnidirectional images (ODIs) have gained considerable attention recently, and are widely used in various virtual reality (VR) and augmented reality (AR) applications. However, capturing such images is expensive and requires specialized equipment, making ODI synthesis increasingly important. While common 2D image generation and editing methods are rapidly advancing, these models struggle to deliver satisfactory results when generating or editing ODIs due to the unique format and broad 360circ Field-of-View (FoV) of ODIs. To bridge this gap, we construct textbftextitAny2Omni, the first comprehensive ODI generation-editing dataset comprises 60,000+ training data covering diverse input conditions and up to 9 ODI generation and editing tasks. Built upon Any2Omni, we propose an textbfunderlineOmni model for textbfunderlineOmni-directional image generation and editing (textbftextitOmni2), with the capability of handling various ODI generation and editing tasks under diverse input conditions using one model. Extensive experiments demonstrate the superiority and effectiveness of the proposed Omni2 model for both the ODI generation and editing tasks. Both the Any2Omni dataset and the Omni2 model are publicly available at: https://github.com/IntMeGroup/Omni2.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 30 of its 53 references that are in the map. First posted on arXiv 15 Apr 2025.
Builds on
30 of 53 references.
References · 30
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2016Improved Techniques for Training GANscited by 2,970
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
18 more
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
- 2017Learning to Predict Indoor Illumination from a Single Imagecited by 161
- 2023Inst-Inpaint: Instructing to Remove Objects with Diffusion Modelscited by 66
- 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 58
- 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 51
- 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creationcited by 47
- 2024Perceptual Video Quality Assessment: A Surveycited by 43
- 2023360-Degree Panorama Generation from Few Unregistered NFoV Imagescited by 42
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
- 2022Confusing Image Quality Assessment: Towards Better Augmented Reality Experiencecited by 32
- 2024DreamOmni: Unified Image Generation and Editingcited by 30
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
- 2022Text2Light: Zero-Shot Text-Driven HDR Panorama Generationcited by 24
- 2024AIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Imagescited by 16
- 2022PanoDepth: A Two-Stage Approach for Monocular Omnidirectional Depth Estimationcited by 9
- 2022HiMODE: A Hybrid Monocular Omnidirectional Depth Estimation Modelcited by 6
Built on by
Citing papers per year: 2025: 6; 2026: 3.
9 papers.
- 2025DiT360: High-Fidelity Panoramic Image Generation via Hybrid Trainingcited by 24
- 2025MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restorationcited by 12
- 2025ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?cited by 12
- 2025Conditional Panoramic Image Generation via Masked Autoregressive Modelingcited by 9
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360degcited by 7
- 2025GeoX-Bench: Benchmarking Cross-View Geo-Localization and Pose Estimation Capabilities of Large Multimodal Modelscited by 5
- 2025Quality Assessment and Distortion-aware Saliency Prediction for AI-Generated Omnidirectional Imagescited by 2
- 2026Enhancing In-context Panoramic Generation via Geometric-aware Pretrainingcited by 0
- 2026Mover360: Controllable Object Manipulation in 360deg Panoramic Imagescited by 0
- 2026Mover360: Controllable Object Manipulation in 360deg Panoramic Images24 Aug 2026
- 2026Enhancing In-context Panoramic Generation via Geometric-aware Pretraining9 Jul 2026
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360deg22 Jan 2026
- 2025GeoX-Bench: Benchmarking Cross-View Geo-Localization and Pose Estimation Capabilities of Large Multimodal Models17 Nov 2025
- 2025DiT360: High-Fidelity Panoramic Image Generation via Hybrid Training13 Oct 2025
- 2025ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?13 Oct 2025
- 2025MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restoration9 Oct 2025
- 2025Quality Assessment and Distortion-aware Saliency Prediction for AI-Generated Omnidirectional Images27 Jun 2025
- 2025Conditional Panoramic Image Generation via Masked Autoregressive Modeling22 May 2025