mlsanityData to 14 Oct 2026

A 3D Isovist World Model -- Revealing a City's Unseen Geometry and Its Emergent Cross-City Signature

arXiv 2606.03609 ↗First posted 2 Jun 2026cs.RO cs.LGcited by 0

On the map: World models → World models for navigation

Abstract (arXiv)

Embodied agents that navigate cities rely on world models that predict how their surroundings will change as they move. But for navigation, what matters is not what the buildings look like; it is where the agent can go. Most world models nonetheless predict appearance, learning how a scene looks rather than the space an agent can move through. Those that do target geometry, such as bird's-eye-view occupancy grids, flatten the three-dimensional environment onto a ground plane, discarding the above-ground and multi-level structure that shapes real navigation. What is missing is a predictive target that captures the navigable geometry an agent actually traverses, without photometric entanglement and without collapsing the third dimension. Our key idea is to model the open volume between buildings, the negative space, encoded as a 3D isovist: a spherical visibility-depth map recording the distance to the nearest surface in every direction. We introduce an embodied world model that predicts the next isovist from a short history of past isovists and a movement action. The prediction is formulated as a depth residual so the decoder inherits sharp building edges, trained with self-rollout scheduled sampling to keep corrupted context on the geometry manifold, and equipped with a persistent latent bird's-eye-view spatial map for cross-path consistency. Our central finding is emergent and unexpected: a single city-blind model trained on Manhattan and Paris develops a cross-city spatial signature, with city identity linearly decodable from its temporal latents far above single-frame baselines, so the signature lives in the learned dynamics rather than in appearance. The representation is lightweight, interpretable, and reproducible, offering a geometric substrate for spatial reasoning in embodied AI, robotics, and urban analysis, released with an open dataset and pipeline.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 6 of its 37 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

6 of 37 references.

References · 6

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  2. 2018World Modelscited by 1,513
  3. 2023Mastering Diverse Domains through World Modelscited by 1,253
  4. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  5. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  6. 2024GenAD: Generalized Predictive Model for Autonomous Drivingcited by 150

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021Pathdreamer: A World Model for Indoor Navigation
  2. 2026360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agents
  3. 2025From 2D to 3D Cognition: A Brief Survey of General World Models
  4. 2025Imaginative World Modeling with Scene Graphs for Embodied Agent Navigation
  5. 2025Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigation
  6. 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigation
  7. 2026How Far Are Large Multimodal Models from Human-Level Spatial Action? A Benchmark for Goal-Oriented Embodied Navigation in Urban Airspace
  8. 2026G2WAM: World Action Models for Efficient and Geometry Grounded Image-Goal Navigation