mlsanityData to 7 Oct 2026

Imagine360: Immersive 360 Video Generation from Perspective Anchor

arXiv 2412.03552 ↗First posted 4 Dec 2024cs.CVcited by 27

Not on the map. Why?

Abstract (arXiv)

360^circ videos offer a hyper-immersive experience that allows the viewers to explore a dynamic scene from full 360 degrees. To achieve more user-friendly and personalized content creation in 360^circ video format, we seek to lift standard perspective videos into 360^circ equirectangular videos. To this end, we introduce Imagine360, the first perspective-to-360^circ video generation framework that creates high-quality 360^circ videos with rich and diverse motion patterns from video anchors. Imagine360 learns fine-grained spherical visual and motion patterns from limited 360^circ video data with several key designs. 1) Firstly we adopt the dual-branch design, including a perspective and a panorama video denoising branch to provide local and global constraints for 360^circ video generation, with motion module and spatial LoRA layers fine-tuned on extended web 360^circ videos. 2) Additionally, an antipodal mask is devised to capture long-range motion dependencies, enhancing the reversed camera motion between antipodal pixels across hemispheres. 3) To handle diverse perspective video inputs, we propose elevation-aware designs that adapt to varying video masking due to changing elevations across frames. Extensive experiments show Imagine360 achieves superior graphics quality and motion coherence among state-of-the-art 360^circ video generation methods. We believe Imagine360 holds promise for advancing personalized, immersive 360^circ video creation.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 35 of its 43 references that are in the map. First posted on arXiv 4 Dec 2024.

Builds on

35 of 43 references.

References · 35

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2023Segment Anythingcited by 8,158
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  7. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  8. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  9. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  10. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  11. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 166
  12. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
23 more
  1. 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
  2. 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
  3. 2019Boundless: Generative Adversarial Networks for Image Extensioncited by 62
  4. 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
  5. 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 56
  6. 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
  7. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  8. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
  9. 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
  10. 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creationcited by 47
  11. 2023Customizing 360-Degree Panoramas through Text-to-Image Diffusion Modelscited by 47
  12. 2023360-Degree Panorama Generation from Few Unregistered NFoV Imagescited by 42
  13. 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
  14. 2023Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generationcited by 33
  15. 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptationcited by 29
  16. 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
  17. 2022PanoFlow: Learning 360deg Optical Flow for Surrounding Temporal Understandingcited by 26
  18. 2022Cross-View Panorama Image Synthesiscited by 26
  19. 2023Hierarchical Masked 3D Diffusion Model for Video Outpaintingcited by 25
  20. 2023PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentationcited by 18
  21. 2024VidPanos: Generative Panoramic Videos from Casual Panning Videoscited by 11
  22. 2024Geometry Fidelity for Spherical Imagescited by 9
  23. 2024Panonut360: A Head and Eye Tracking Dataset for Panoramic Videocited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 13; 2026: 14.

27 papers.

Sort:

By area:

  1. 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 33
  2. 20253D Scene Generation: A Surveycited by 24
  3. 2025PanoWan: Lifting Diffusion Video Generation Models to 360deg with Latitude/Longitude-aware Mechanismscited by 22
  4. 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generationcited by 15
  5. 2025Beyond the Frame: Generating 360 Panoramic Videos from Perspective Videoscited by 14
  6. 2025Conditional Panoramic Image Generation via Masked Autoregressive Modelingcited by 9
  7. 2025Leader360V: The Large-scale, Real-world 360 Video Dataset for Multi-task Learning in Diverse Environmentcited by 8
  8. 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Videocited by 8
  9. 2025CamPVG: Camera-Controlled Panoramic Video Generation with Epipolar-Aware Diffusioncited by 7
  10. 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusioncited by 7
  11. 2026360Anything: Geometry-Free Lifting of Images and Videos to 360degcited by 7
  12. 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
15 more
  1. 2025AnimateScene: Camera-controllable Animation in Any Scenecited by 3
  2. 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Modelscited by 3
  3. 2026PanoWorld: Real-World Panoramic Generationcited by 3
  4. 2025PanoLora: Bridging Perspective and Panoramic Video Generation with LoRA Adaptationcited by 2
  5. 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 2
  6. 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPEcited by 2
  7. 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Modelscited by 1
  8. 2026PanoSAM2: Lightweight Distortion- and Memory-aware Adaptions of SAM2 for 360 Video Object Segmentationcited by 1
  9. 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Videocited by 1
  10. 2025A Survey on Text-Driven 360-Degree Panorama Generationcited by 0
  11. 2025JoPano: Unified Panorama Generation via Joint Modelingcited by 0
  12. 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completioncited by 0
  13. 2026PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memorycited by 0
  14. 2026Can 4D Foundation Models Remember?cited by 0
  15. 2026MUGEN: Interactive Panoramic World Exploration via Camera Controlcited by 0