mlsanityData to 14 Oct 2026

MUGEN: Interactive Panoramic World Exploration via Camera Control

arXiv 2609.38077 ↗First posted 29 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Interactive panoramic video generation aims to synthesize immersive 360textdegree videos that remain visually coherent while following user-specified camera trajectories during exploration. However, progress is limited by a coupled data-and-model gap: existing panoramic video datasets are often short, weakly annotated, or lack camera trajectories, while existing camera-controlled video generation models are designed for perspective videos and do not directly support panoramic geometry. In this paper, we introduce MUGEN and Wan360 to address these limitations. MUGEN is a large-scale real-world panoramic video dataset tailored to interactive 360-degree world exploration, comprising over 1,300 hours of at least 4K panoramic videos with rich semantic and geometric annotations. Built on MUGEN, we further present Wan360, a camera-controllable interactive panoramic video generation model. Panoramic videos are commonly represented by EquiRectangular Projection (ERP), which unfolds a spherical 360-degree view into a rectangular frame with cyclic longitude seams and pole distortions. To this end, Wan360 introduces three parameter-free ERP-aware components: periodic longitude RoPE for seam-consistent positional encoding, ERP-aware padding for reducing boundary artifacts, and random roll yaw for consistent learning. For camera control, Wan360 uses a panoramic Pl"ucker embedding that represents camera motion with ERP rays rather than perspective pinhole rays. Experiments show that MUGEN serves as a data foundation for panoramic world exploration, and that Wan360 enables high-quality, temporally coherent, camera-controllable 360-degree video generation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 46 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

40 of 46 references.

References · 40

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  5. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  6. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  7. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
  8. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
  9. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  10. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
  11. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
  12. 2026Advancing Open-source World Modelscited by 154
28 more
  1. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  2. 2025Sekai: A Video Dataset towards World Explorationcited by 67
  3. 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 58
  4. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
  5. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  6. 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 51
  7. 2024Imagine360: Immersive 360 Video Generation from Perspective Anchorcited by 29
  8. 2024DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenescited by 24
  9. 2024From an Image to a Scene: Learning to Imagine the World from a Million 360 Videoscited by 23
  10. 2025PanoWan: Lifting Diffusion Video Generation Models to 360deg with Latitude/Longitude-aware Mechanismscited by 23
  11. 2024GenEx: Generating an Explorable Worldcited by 21
  12. 2023PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentationcited by 18
  13. 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generationcited by 16
  14. 2025VideoPanda: Video Panoramic Diffusion with Multi-view Attentioncited by 13
  15. 2023360VOT: A New Benchmark Dataset for Omnidirectional Visual Object Trackingcited by 11
  16. 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Reportcited by 11
  17. 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Videocited by 10
  18. 2025Conditional Panoramic Image Generation via Masked Autoregressive Modelingcited by 9
  19. 2024360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videoscited by 8
  20. 2025Leader360V: The Large-scale, Real-world 360 Video Dataset for Multi-task Learning in Diverse Environmentcited by 8
  21. 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstructioncited by 8
  22. 2025CamPVG: Camera-Controlled Panoramic Video Generation with Epipolar-Aware Diffusioncited by 8
  23. 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusioncited by 7
  24. 2021A Survey on 360-Degree Video: Coding, Quality of Experience and Streamingcited by 6
  25. 2025PanFlow: Decoupled Motion Control for Panoramic Video Generationcited by 6
  26. 2026AlayaWorld: Long-Horizon and Playable Video World Generationcited by 6
  27. 2026AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)cited by 6
  28. 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Videocited by 3

Built on by

Not cited yet.