# MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Driving

arXiv: https://arxiv.org/abs/2609.20377 · HTML: https://mlsanity.com/paper/2609.20377/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Placed in World models for autonomous driving, one of 11 directions in World models.
- Builds on 23 of its 55 references that are in the map.
- First posted on arXiv 17 Sep 2026.

## Placed in

- World models / [World models for autonomous driving](https://mlsanity.com/wm/world-models-for-autonomous-driving/)
- End-to-end autonomous driving / [Generative simulation for driving](https://mlsanity.com/driving/generative-simulation-for-driving/)

## Builds on (most cited first, 23 of 23)

- [Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillation](https://mlsanity.com/paper/2406.06978/) (2024)
- [Generalized Trajectory Scoring for End-to-end Multimodal Planning](https://mlsanity.com/paper/2506.06664/) (2025)
- [DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Driving](https://mlsanity.com/paper/2512.07745/) (2025)
- [Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving](https://mlsanity.com/paper/2603.24581/) (2026)
- [SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Driving](https://mlsanity.com/paper/2603.29163/) (2026)
- [DriveVA: Video Action Models are Zero-Shot Drivers](https://mlsanity.com/paper/2604.04198/) (2026)
- [DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Driving](https://mlsanity.com/paper/2602.14577/) (2026)
- [DriveFuture: Future-Aware Latent World Models for Autonomous Driving](https://mlsanity.com/paper/2605.09701/) (2026)
- [DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving](https://mlsanity.com/paper/2605.28544/) (2026)
- [CLOVER: Closed-Loop Value Estimation and Ranking for End-to-End Autonomous Driving Planning](https://mlsanity.com/paper/2605.15120/) (2026)
- [Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation](https://mlsanity.com/paper/2606.15869/) (2026)
- [UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generation](https://mlsanity.com/paper/2607.05133/) (2026)
- [The DAWN of World-Action Interactive Models](https://mlsanity.com/paper/2605.11550/) (2026)
- [GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving](https://mlsanity.com/paper/2606.16274/) (2026)
- [Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learning](https://mlsanity.com/paper/2606.05645/) (2026)
- [UniDWM: Towards a Unified Driving World Model via Multifaceted Representation Learning](https://mlsanity.com/paper/2602.01536/) (2026)
- [Map-World: Masked Action planning and Path-Integral World Model for Autonomous Driving](https://mlsanity.com/paper/2511.20156/) (2025)
- [DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Driving](https://mlsanity.com/paper/2603.19675/) (2026)
- [SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation](https://mlsanity.com/paper/2605.24354/) (2026)
- [IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving](https://mlsanity.com/paper/2605.31476/) (2026)
- [Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving](https://mlsanity.com/paper/2606.22913/) (2026)
- [ForgeDrive: Bidirectional Cross-Conditioning for Unified Visual-Action Generation in Autonomous Driving](https://mlsanity.com/paper/2606.31226/) (2026)
- [UniTeD: Unified Temporal Diffusion for Joint Perception and Planning in Autonomous Driving](https://mlsanity.com/paper/2606.25736/) (2026)

## Built on by (most cited first, 1 of 1)

- [FPD-Drive: Future Policy Distillation for End-to-End Autonomous Driving](https://mlsanity.com/paper/2610.13232/) (2026)

## Abstract (arXiv)

Autonomous driving involves coupled decision-making and scene evolution under multi-mode uncertainty. To capture this coupling and uncertainty, we introduce MM-Future, a world-action model that generates multiple paired scene-action hypotheses and models bidirectional interaction within each pair. Each hypothesis is initialized from a structured action prior and an independent future scene source, which are then co-evolved through a modality-aware diffusion Transformer. To support efficient multi-mode rollout, MM-Future compresses multi-view video into planning-oriented representations, dubbed MM-Tokens. Finally, a future-conditioned proposal scorer ranks trajectory candidates by shared history context and their paired predicted future. On NAVSIM navtest, MM-Future achieves 94.0 PDMS and 91.5 EPDMS, while attaining a 32.3 HD-Score in zero-shot closed-loop evaluation on HUGSIM. Ablations show consistent improvements over both single-mode and action-only variants, validating the benefit of multi-mode joint world-action modeling.