mlsanityData to 14 Oct 2026

OccWAM: Occupancy World-Action Models with Joint Scene-to-Ego Flow Matching

arXiv 2610.17688 ↗First posted 13 Oct 2026cs.ROcited by 0

On the map: World models → World models for autonomous driving

also in 2 more
Abstract (arXiv)

Occupancy world models provide a structured, metric representation of future driving scenes, making them a promising basis for end-to-end autonomous driving. However, existing occupancy-aware planners typically couple occupancy prediction and action generation through either hierarchical coupling or parallel multi-task learning. Hierarchical methods use occupancy either as a fully predicted future preceding action generation or as an action-conditioned rollout for trajectory evaluation, whereas parallel multi-task methods predict occupancy alongside planning through a separate branch or auxiliary objective. These interfaces retain either an explicit generation order or a role asymmetry, limiting reciprocal interaction between world prediction and action generation during trajectory formation. We propose OccWAM, an occupancy-native world-action model that jointly generates dense future occupancy and continuous ego trajectories via flow matching conditioned on scene representations. Building on this joint formulation, we introduce scene-to-ego world-action flow matching, a two-stage formulation. The first stage predicts scene-centric occupancy together with an absolute ego trajectory, providing a stable representation of future scene evolution. The same predicted world is then re-indexed into the future ego frames induced by the initial trajectory, where ego motion is represented through adjacent pose increments and a second joint flow refines ego-centric occupancy and motion for action-aligned planning. Unlike video-based world-action models, OccWAM preserves explicit semantic geometry for direct planning reasoning without pixel synthesis. Extensive experiments on Bench2Drive and nuScenes demonstrate state-of-the-art performance in closed-loop driving, open-loop planning, and future occupancy prediction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. First posted on arXiv 13 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving
  2. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving
  3. 2025COME: Adding Scene-Centric Forecasting Control to Occupancy World Model
  4. 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Model
  5. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
  6. 2026CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations
  7. 2026OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model
  8. 2026GEM: Gaussian Evolution Model for Occupancy Forecasting and Motion Planning