SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
World models (WMs) have demonstrated strong potential for end-to-end autonomous driving by learning predictive representations of future scene dynamics. However, generating future videos during inference introduces substantial computational overhead, leading many recent driving WMs to adopt a single front camera as input for efficient deployment. This design restricts spatial coverage in safety-critical maneuvers such as lane changes, merges, and turns. To address this limitation, we propose SV-WAM, a surround-view world-action model (WAM) that preserves full six-camera observations while maintaining efficient inference. SV-WAM leverages future-video prediction as dense training supervision for action learning within a shared generative model, rather than as an inference-time output. At the core of this design is an action-centered causal mask that prevents action tokens from attending to future-video tokens during joint action-video denoising. Consequently, the video branch can be discarded at deployment, enabling efficient action-only planning. Furthermore, we introduce a differentiable drivable-area compliance regularizer that penalizes vehicle-footprint corners approaching or crossing drivable boundaries, improving planning safety and boundary awareness. Extensive experiments on the closed-loop NAVSIMv2 benchmark and the open-loop nuScenes benchmark demonstrate that SV-WAM achieves state-of-the-art planning performance with low inference latency and competitive zero-shot transfer capability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 6 of its 45 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
6 of 45 references.
Closest ancestors · 4
Same direction, newest first
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoning14 May
- 2026DriveVA: Video Action Models are Zero-Shot Drivers5 Apr
- 2024Doe-1: Closed-Loop Autonomous Driving with Large World Model12 Dec
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
Other references · 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
- 2026ReWorld: Representation Learning for World Action Models
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation
- 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
- 2026DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving