VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector Graphs
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Closed-loop evaluation of autonomous-driving policies requires interactive simulation beyond log replay. However, existing generative world models often degrade in closed loop due to (i) history-free initialization that mismatches policy inputs, (ii) multi-step sampling latency that violates real-time budgets, and (iii) compounding kinematic infeasibility over long horizons. We propose VectorWorld, a streaming world model that incrementally generates ego-centric 64 m× 64m lane--agent vector-graph tiles during rollout. VectorWorld aligns initialization with history-conditioned policies by producing a policy-compatible interaction state via a motion-aware gated VAE. It enables real-time outpainting via solver-free one-step masked completion with an edge-gated relational DiT trained with interval-conditioned MeanFlow and JVP-based large-step supervision. To stabilize long-horizon rollouts, we introduce DeltaSim, a physics-aligned non-ego (NPC) policy with hybrid discrete--continuous actions and differentiable kinematic logit shaping. On Waymo open motion and nuPlan, VectorWorld improves map-structure fidelity and initialization validity, and supports stable, real-time 1km+ closed-loop rollouts (hrefhttps://github.com/jiangchaokang/VectorWorldcode).
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 34 of its 37 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
34 of 37 references.
Closest ancestors · 6
Same direction, newest first
- 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Model27 Jun
- 2025MaskGWM: A Generalizable Driving World Model with Video Mask Reconstruction17 Feb
- 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
- 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research12 Oct
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learning26 Sep
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 28
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2023Consistency Modelscited by 1,778
- 2018World Modelscited by 1,444
16 more
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2024One Step Diffusion via Shortcut Modelscited by 373
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2024Improving the Training of Rectified Flowscited by 106
- 2022TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarioscited by 104
- 2023Language Conditioned Traffic Generationcited by 86
- 2022Symphony: Learning Realistic and Diverse Agents for Autonomous Driving Simulationcited by 61
- 2023Trajeglish: Traffic Modeling as Next-Token Predictioncited by 59
- 2024SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rolloutcited by 47
- 2024WcDT: World-centric Diffusion Transformer for Traffic Scene Generationcited by 31
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environmentscited by 27
- 2023DriveSceneGen: Generating Diverse and Realistic Driving Scenarios from Scratchcited by 26
- 2024CtRL-Sim: Reactive and Controllable Driving Agents with Offline Reinforcement Learningcited by 26
- 2024Causal Composition Diffusion Model for Closed-loop Traffic Generationcited by 22
- 2025Long-term Traffic Simulation with Interleaved Autoregressive Motion and Scenario Generationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation
- 2021Learning to drive from a world on rails
- 2025Beyond Simulation: Benchmarking World Models for Planning and Causality in Autonomous Driving
- 2026AutoWorld: Learning Multi-Agent Traffic Simulation with Self-Supervised World Models
- 2026ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving
- 2024Imagine-2-Drive: Leveraging High-Fidelity World Models via Multi-Modal Diffusion Policies
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving