SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Language-guided panoramic video generation benefits various downstream applications, such as interactive 3D scene exploration, virtual reality experiences, and embodied agent training. Existing panoramic generators follow predefined trajectories, and interactive world models act through low-level actions in perspective views. We propose SPW-Nav, a streaming panoramic world model that understands movement instructions and streams one minute of 2K 360-degree video in real time from a single panorama. SPW-Nav interprets each instruction in the previously generated panorama as camera motion. Spherical rotation decoupling applies rotation exactly on the sphere, pose-aligned conditioning keeps translation inputs bounded over long streams, and a multi-term memory with a few-step generator continues the scene as instructions change. We also build SPW-NavSet, panoramic videos with camera trajectories and verified instructions. Driven by language, SPW-Nav outperforms prior panoramic generators in camera-following accuracy and video quality, and supports on-the-fly instruction switching.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. First posted on arXiv 6 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigation
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling
- 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Models
- 2026PanoWorld: Real-World Panoramic Generation
- 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation
- 2026Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion