AffordDrive3D: Affordance-Aware World-Action Modeling with Spatial Understanding
On the map: World models → World models for autonomous driving
Abstract (arXiv)
World-action models have recently improved autonomous driving by jointly learning future scene prediction and trajectory generation. Most existing approaches model the future primarily through RGB appearance, and recent works have begun to incorporate geometric prediction to improve spatial understanding. However, dense geometry describes the spatial layout of the entire scene without indicating which parts are most relevant to the ego vehicle's action. For driving, the model must also identify and anticipate where it can safely move and which regions may pose collision risks. Jointly modeling action-relevant regions and future geometry can provide the policy with both driving-relevant cues and their corresponding spatial structure. We therefore propose AffordDrive3D, an affordance- and geometry-aware world-action model that jointly learns future action-relevant regions and spatial structure. In order to capture the scene semantics and driving context needed for driving affordance prediction, we build AffordDrive3D on a VLM backbone to forecast drivable areas and collision-critical regions that directly affect ego motion, while predicting future geometry from RGB world-model latents. On NAVSIM, AffordDrive3D achieves state-of-the-art performance with 91.3 PDMS and 89.9 EPDMS, demonstrating the effectiveness of jointly modeling future affordances and geometry for trajectory planning. Project Page: https://afforddrive3d.github.io/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 26 of its 52 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
26 of 52 references.
Closest ancestors · 11
Same direction, newest first
- 2026SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving3 Sep
- 2026GeoWAM: Visual Geometry World Action Models for Autonomous Driving24 Aug
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving21 Aug
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving7 Aug
- 2026GeoWorldAD: Geometry World Action Model for Autonomous Driving20 Jul
- 2026OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model29 Jun
- 2026DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving27 May
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May
- 2026Learning Vision-Language-Action World Models for Autonomous Driving10 Apr
- 2026ResWorld: Temporal Residual World Model for End-to-End Autonomous Driving11 Feb
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
Other references · 15
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mambacited by 87
- 2025Generalized Trajectory Scoring for End-to-end Multimodal Planningcited by 67
- 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Drivingcited by 56
- 2025UniFuture: A 4D Driving World Model for Future Generation and Perceptioncited by 22
- 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planningcited by 17
- 2025Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorercited by 16
- 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understandingcited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VGGTWorld-VLA: Intent-Conditioned 3D World Evolution for Autonomous Driving
- 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction
- 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generation
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
- 2026HERMES++: Toward a Unified Driving World Model for 3D Scene Understanding and Generation
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving
- 2025GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Control