mlsanityData to 14 Oct 2026

ReWAM: Reciprocal World Action Models for Interactive Autonomous Driving

arXiv 2609.39245 ↗First posted 30 Sep 2026cs.ROcited by 0

On the map: World models → World models for autonomous driving also fits: World models for navigation

also in 1 more
Abstract (arXiv)

In interactive scenarios, an autonomous driving system is required to generate ego actions under the influence of other agents' behaviors. Existing World Action Models (WAMs) typically model other agents as components of the world model rather than as decision-makers that fundamentally shape the action of the ego agent, which impairs their performance in dense interaction scenarios. We introduce Reciprocal World Action Models (ReWAM), a game-theoretic world action modeling framework that captures the reciprocal influence between the ego agent and other agents by representing them as conditional responders whose actions are mutually influenced. We instantiate this framework with a Level-k response hierarchy, where role-specific ego and other action DiTs exchange compact strategy tokens through cross-agent attention while remaining grounded in a shared representation of the future driving world. To learn the response policy of the ego agent from demonstrations, we formulate expert actions as samples from the best response distribution and jointly optimize the entire hierarchy using conditional flow matching. Our framework is evaluated on the NAVSIM dataset and achieves state-of-the-art performance compared to baselines. The improvement is particularly significant in interactive scenarios, validating that modeling reciprocal responses provides a more effective foundation for interaction-aware world action generation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 16 of its 55 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

16 of 55 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026Learning Vision-Language-Action World Models for Autonomous Driving10 Apr
  2. 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving25 Mar
  3. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation16 Mar

Other references · 13

  1. 2026World Action Models are Zero-shot Policiescited by 465
  2. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  3. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
  4. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
  5. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
  6. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 139
  7. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 118
  8. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policiescited by 52
  9. 2025VLM-E2E: Enhancing End-to-End Autonomous Driving with Multimodal Driver Attention Fusioncited by 20
  10. 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planningcited by 17
  11. 2026FLARE: Learning Future-Aware Latent Representations from Vision-Language Models for Autonomous Drivingcited by 10
  12. 2026ReWorld: Multi-Dimensional Reward Modeling for Embodied World Modelscited by 8
1 more
  1. 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulationcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Driving
  2. 2025Beyond Simulation: Benchmarking World Models for Planning and Causality in Autonomous Driving
  3. 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving
  4. 2021Learning to drive from a world on rails
  5. 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving
  6. 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Driving
  7. 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
  8. 2026ProDrive: Proactive Planning for Autonomous Driving via Ego-Environment Co-Evolution