MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Driving
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Autonomous driving involves coupled decision-making and scene evolution under multi-mode uncertainty. To capture this coupling and uncertainty, we introduce MM-Future, a world-action model that generates multiple paired scene-action hypotheses and models bidirectional interaction within each pair. Each hypothesis is initialized from a structured action prior and an independent future scene source, which are then co-evolved through a modality-aware diffusion Transformer. To support efficient multi-mode rollout, MM-Future compresses multi-view video into planning-oriented representations, dubbed MM-Tokens. Finally, a future-conditioned proposal scorer ranks trajectory candidates by shared history context and their paired predicted future. On NAVSIM navtest, MM-Future achieves 94.0 PDMS and 91.5 EPDMS, while attaining a 32.3 HD-Score in zero-shot closed-loop evaluation on HUGSIM. Ablations show consistent improvements over both single-mode and action-only variants, validating the benefit of multi-mode joint world-action modeling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 23 of its 55 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
23 of 55 references.
Closest ancestors · 13
Same direction, newest first
- 2026UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generation6 Jul
- 2026ForgeDrive: Bidirectional Cross-Conditioning for Unified Visual-Action Generation in Autonomous Driving30 Jun
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving15 Jun
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation14 Jun
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving29 May
- 2026DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving27 May
- 2026SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation23 May
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May
- 2026DriveVA: Video Action Models are Zero-Shot Drivers5 Apr
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving25 Mar
- 2026DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Driving20 Mar
- 2026UniDWM: Towards a Unified Driving World Model via Multifaceted Representation Learning2 Feb
1 more
Other references · 10
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2025Generalized Trajectory Scoring for End-to-end Multimodal Planningcited by 63
- 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Drivingcited by 52
- 2026SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Drivingcited by 21
- 2026DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Drivingcited by 18
- 2026CLOVER: Closed-Loop Value Estimation and Ranking for End-to-End Autonomous Driving Planningcited by 9
- 2026The DAWN of World-Action Interactive Modelscited by 7
- 2026Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learningcited by 3
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
- 2026UniTeD: Unified Temporal Diffusion for Joint Perception and Planning in Autonomous Drivingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
- 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving
- 2026SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving
- 2026BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving
- 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers
- 2025Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution