Imagine360: Immersive 360 Video Generation from Perspective Anchor
Not on the map. Why?
Abstract (arXiv)
360^circ videos offer a hyper-immersive experience that allows the viewers to explore a dynamic scene from full 360 degrees. To achieve more user-friendly and personalized content creation in 360^circ video format, we seek to lift standard perspective videos into 360^circ equirectangular videos. To this end, we introduce Imagine360, the first perspective-to-360^circ video generation framework that creates high-quality 360^circ videos with rich and diverse motion patterns from video anchors. Imagine360 learns fine-grained spherical visual and motion patterns from limited 360^circ video data with several key designs. 1) Firstly we adopt the dual-branch design, including a perspective and a panorama video denoising branch to provide local and global constraints for 360^circ video generation, with motion module and spatial LoRA layers fine-tuned on extended web 360^circ videos. 2) Additionally, an antipodal mask is devised to capture long-range motion dependencies, enhancing the reversed camera motion between antipodal pixels across hemispheres. 3) To handle diverse perspective video inputs, we propose elevation-aware designs that adapt to varying video masking due to changing elevations across frames. Extensive experiments show Imagine360 achieves superior graphics quality and motion coherence among state-of-the-art 360^circ video generation methods. We believe Imagine360 holds promise for advancing personalized, immersive 360^circ video creation.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 35 of its 43 references that are in the map. First posted on arXiv 4 Dec 2024.
Builds on
35 of 43 references.
References · 35
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Segment Anythingcited by 8,158
- 2024GPT-4o System Cardcited by 4,467
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
- 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 166
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
23 more
- 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2019Boundless: Generative Adversarial Networks for Image Extensioncited by 62
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 56
- 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
- 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
- 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
- 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
- 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creationcited by 47
- 2023Customizing 360-Degree Panoramas through Text-to-Image Diffusion Modelscited by 47
- 2023360-Degree Panorama Generation from Few Unregistered NFoV Imagescited by 42
- 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
- 2023Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generationcited by 33
- 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptationcited by 29
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
- 2022PanoFlow: Learning 360deg Optical Flow for Surrounding Temporal Understandingcited by 26
- 2022Cross-View Panorama Image Synthesiscited by 26
- 2023Hierarchical Masked 3D Diffusion Model for Video Outpaintingcited by 25
- 2023PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentationcited by 18
- 2024VidPanos: Generative Panoramic Videos from Casual Panning Videoscited by 11
- 2024Geometry Fidelity for Spherical Imagescited by 9
- 2024Panonut360: A Head and Eye Tracking Dataset for Panoramic Videocited by 5
Built on by
Citing papers per year: 2025: 13; 2026: 14.
27 papers.
Sort:
By area:
- 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 33
- 20253D Scene Generation: A Surveycited by 24
- 2025PanoWan: Lifting Diffusion Video Generation Models to 360deg with Latitude/Longitude-aware Mechanismscited by 22
- 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generationcited by 15
- 2025Beyond the Frame: Generating 360 Panoramic Videos from Perspective Videoscited by 14
- 2025Conditional Panoramic Image Generation via Masked Autoregressive Modelingcited by 9
- 2025Leader360V: The Large-scale, Real-world 360 Video Dataset for Multi-task Learning in Diverse Environmentcited by 8
- 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Videocited by 8
- 2025CamPVG: Camera-Controlled Panoramic Video Generation with Epipolar-Aware Diffusioncited by 7
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusioncited by 7
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360degcited by 7
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
15 more
- 2025AnimateScene: Camera-controllable Animation in Any Scenecited by 3
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Modelscited by 3
- 2026PanoWorld: Real-World Panoramic Generationcited by 3
- 2025PanoLora: Bridging Perspective and Panoramic Video Generation with LoRA Adaptationcited by 2
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 2
- 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPEcited by 2
- 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Modelscited by 1
- 2026PanoSAM2: Lightweight Distortion- and Memory-aware Adaptions of SAM2 for 360 Video Object Segmentationcited by 1
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Videocited by 1
- 2025A Survey on Text-Driven 360-Degree Panorama Generationcited by 0
- 2025JoPano: Unified Panorama Generation via Joint Modelingcited by 0
- 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completioncited by 0
- 2026PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memorycited by 0
- 2026Can 4D Foundation Models Remember?cited by 0
- 2026MUGEN: Interactive Panoramic World Exploration via Camera Controlcited by 0
- 2026MUGEN: Interactive Panoramic World Exploration via Camera Control29 Sep 2026
- 2026Can 4D Foundation Models Remember?17 Sep 2026
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video13 Sep 2026
- 2026PanoWorld: Real-World Panoramic Generation10 Jul 2026
- 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE30 Jun 2026
- 2026PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory15 Jun 2026
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion25 May 2026
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Models12 Apr 2026
- 2026PanoSAM2: Lightweight Distortion- and Memory-aware Adaptions of SAM2 for 360 Video Object Segmentation9 Apr 2026
- 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generation31 Mar 2026
- 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completion24 Mar 2026
15 more
- 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Video4 Mar 2026
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360deg22 Jan 2026
- 2025JoPano: Unified Panorama Generation via Joint Modeling7 Dec 2025
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion29 Sep 2025
- 2025CamPVG: Camera-Controlled Panoramic Video Generation with Epipolar-Aware Diffusion24 Sep 2025
- 2025PanoLora: Bridging Perspective and Panoramic Video Generation with LoRA Adaptation14 Sep 2025
- 2025Matrix-3D: Omnidirectional Explorable 3D World Generation11 Aug 2025
- 2025AnimateScene: Camera-controllable Animation in Any Scene8 Aug 2025
- 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Models30 Jun 2025
- 2025Leader360V: The Large-scale, Real-world 360 Video Dataset for Multi-task Learning in Diverse Environment17 Jun 2025
- 2025PanoWan: Lifting Diffusion Video Generation Models to 360deg with Latitude/Longitude-aware Mechanisms28 May 2025
- 2025Conditional Panoramic Image Generation via Masked Autoregressive Modeling22 May 2025
- 20253D Scene Generation: A Survey8 May 2025
- 2025Beyond the Frame: Generating 360 Panoramic Videos from Perspective Videos10 Apr 2025
- 2025A Survey on Text-Driven 360-Degree Panorama Generation20 Feb 2025
- 20253D Scene Generation: A Surveycited by 24
- 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Videocited by 8
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusioncited by 7
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Modelscited by 3
- 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPEcited by 2
- 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completioncited by 0
- 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE30 Jun 2026
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion25 May 2026
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Models12 Apr 2026
- 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completion24 Mar 2026
- 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Video4 Mar 2026
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion29 Sep 2025
- 20253D Scene Generation: A Survey8 May 2025
- 2026PanoWorld: Real-World Panoramic Generationcited by 3
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 2
- 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Modelscited by 1
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Videocited by 1
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video13 Sep 2026
- 2026PanoWorld: Real-World Panoramic Generation10 Jul 2026
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Models30 Jun 2025
- 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 33
- 2025PanoWan: Lifting Diffusion Video Generation Models to 360deg with Latitude/Longitude-aware Mechanismscited by 22
- 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generationcited by 15
- 2025Beyond the Frame: Generating 360 Panoramic Videos from Perspective Videoscited by 14
- 2025Conditional Panoramic Image Generation via Masked Autoregressive Modelingcited by 9
- 2025Leader360V: The Large-scale, Real-world 360 Video Dataset for Multi-task Learning in Diverse Environmentcited by 8
- 2025CamPVG: Camera-Controlled Panoramic Video Generation with Epipolar-Aware Diffusioncited by 7
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360degcited by 7
- 2025AnimateScene: Camera-controllable Animation in Any Scenecited by 3
- 2025PanoLora: Bridging Perspective and Panoramic Video Generation with LoRA Adaptationcited by 2
- 2026PanoSAM2: Lightweight Distortion- and Memory-aware Adaptions of SAM2 for 360 Video Object Segmentationcited by 1
- 2025A Survey on Text-Driven 360-Degree Panorama Generationcited by 0
12 most cited of 16 All 16 (JSON)
- 2026MUGEN: Interactive Panoramic World Exploration via Camera Control29 Sep 2026
- 2026Can 4D Foundation Models Remember?17 Sep 2026
- 2026PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory15 Jun 2026
- 2026PanoSAM2: Lightweight Distortion- and Memory-aware Adaptions of SAM2 for 360 Video Object Segmentation9 Apr 2026
- 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generation31 Mar 2026
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360deg22 Jan 2026
- 2025JoPano: Unified Panorama Generation via Joint Modeling7 Dec 2025
- 2025CamPVG: Camera-Controlled Panoramic Video Generation with Epipolar-Aware Diffusion24 Sep 2025
- 2025PanoLora: Bridging Perspective and Panoramic Video Generation with LoRA Adaptation14 Sep 2025
- 2025Matrix-3D: Omnidirectional Explorable 3D World Generation11 Aug 2025
- 2025AnimateScene: Camera-controllable Animation in Any Scene8 Aug 2025
- 2025Leader360V: The Large-scale, Real-world 360 Video Dataset for Multi-task Learning in Diverse Environment17 Jun 2025
12 newest of 16 All 16 (JSON)