mlsanityData to 7 Oct 2026

VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector Graphs

arXiv 2603.17652 ↗First posted 18 Mar 2026cs.RO cs.CVcited by 1

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Closed-loop evaluation of autonomous-driving policies requires interactive simulation beyond log replay. However, existing generative world models often degrade in closed loop due to (i) history-free initialization that mismatches policy inputs, (ii) multi-step sampling latency that violates real-time budgets, and (iii) compounding kinematic infeasibility over long horizons. We propose VectorWorld, a streaming world model that incrementally generates ego-centric 64 m× 64m lane--agent vector-graph tiles during rollout. VectorWorld aligns initialization with history-conditioned policies by producing a policy-compatible interaction state via a motion-aware gated VAE. It enables real-time outpainting via solver-free one-step masked completion with an edge-gated relational DiT trained with interval-conditioned MeanFlow and JVP-based large-step supervision. To stabilize long-horizon rollouts, we introduce DeltaSim, a physics-aligned non-ego (NPC) policy with hybrid discrete--continuous actions and differentiable kinematic logit shaping. On Waymo open motion and nuPlan, VectorWorld improves map-structure fidelity and initialization validity, and supports stable, real-time 1km+ closed-loop rollouts (hrefhttps://github.com/jiangchaokang/VectorWorldcode).

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 34 of its 37 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

34 of 37 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Model27 Jun
  2. 2025MaskGWM: A Generalizable Driving World Model with Video Mask Reconstruction17 Feb
  3. 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
  4. 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research12 Oct
  5. 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learning26 Sep
  6. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun

Other references · 28

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2022Flow Matching for Generative Modelingcited by 5,426
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  9. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  10. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  11. 2023Consistency Modelscited by 1,778
  12. 2018World Modelscited by 1,444
16 more
  1. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  2. 2025Mean Flows for One-step Generative Modelingcited by 524
  3. 2024One Step Diffusion via Shortcut Modelscited by 373
  4. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  5. 2024Improving the Training of Rectified Flowscited by 106
  6. 2022TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarioscited by 104
  7. 2023Language Conditioned Traffic Generationcited by 86
  8. 2022Symphony: Learning Realistic and Diverse Agents for Autonomous Driving Simulationcited by 61
  9. 2023Trajeglish: Traffic Modeling as Next-Token Predictioncited by 59
  10. 2024SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rolloutcited by 47
  11. 2024WcDT: World-centric Diffusion Transformer for Traffic Scene Generationcited by 31
  12. 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environmentscited by 27
  13. 2023DriveSceneGen: Generating Diverse and Realistic Driving Scenarios from Scratchcited by 26
  14. 2024CtRL-Sim: Reactive and Controllable Driving Agents with Offline Reinforcement Learningcited by 26
  15. 2024Causal Composition Diffusion Model for Closed-loop Traffic Generationcited by 22
  16. 2025Long-term Traffic Simulation with Interleaved Autoregressive Motion and Scenario Generationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving
  2. 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation
  3. 2021Learning to drive from a world on rails
  4. 2025Beyond Simulation: Benchmarking World Models for Planning and Causality in Autonomous Driving
  5. 2026AutoWorld: Learning Multi-Agent Traffic Simulation with Self-Supervised World Models
  6. 2026ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving
  7. 2024Imagine-2-Drive: Leveraging High-Fidelity World Models via Multi-Modal Diffusion Policies
  8. 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving