mlsanityData to 7 Oct 2026

CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Driving

arXiv 2609.34749 ↗First posted 28 Sep 2026cs.CV cs.AIcited by 0

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Real-world driving is inherently multi-agent, yet most existing driving world models generate observations from a single ego vehicle. Independently extending them to multiple vehicles does not ensure that different agents observe a consistent shared world. We present CoDrive, a cross-vehicle, multi-view driving video generation framework that jointly generates observations of vehicles sharing the same dynamic scene with precise camera-trajectory control. CoDrive interleaves local self-attention, which models spatiotemporal dependencies among the views of each vehicle, with global self-attention, which enables information exchange and consistency modeling across vehicles. To explicitly encode their spatial relationships, all camera trajectories are represented in a shared world coordinate system and injected into the attention layers through projective relative positional encoding. We further adopt a progressive mixed-task training strategy that combines large-scale real-world single-agent data with synthetic cross-agent interaction data, allowing the model to benefit from real-world appearance distributions while learning cross-agent consistency from simulation. For systematic evaluation, we introduce CoDrive-Bench, a benchmark covering real and synthetic multi-vehicle scenarios and evaluating trajectory controllability, scene geometry consistency, and instance-level consistency. Experiments show that CoDrive improves trajectory controllability and cross-agent geometric and instance consistency while maintaining competitive visual quality.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 34 of its 59 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

34 of 59 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026CausalDrive: Real-time Causal World Models for Autonomous Driving13 Jun
  2. 2026Toward Physically Consistent Driving Video World Models under Challenging Trajectories25 Mar
  3. 2025OmniNWM: Omniscient Driving Navigation World Models21 Oct
  4. 2024DriveScape: Towards High-Resolution Controllable Multi-View Driving Video Generation9 Sep
  5. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep

Other references · 29

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  4. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  5. 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
  6. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
  7. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 174
  8. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
  9. 2025HunyuanVideo 1.5 Technical Reportcited by 148
  10. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
  11. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 86
  12. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
17 more
  1. 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion modelcited by 75
  2. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Modelcited by 58
  3. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
  4. 2026Solaris: Building a Multiplayer Video World Model in Minecraftcited by 38
  5. 2024DiVE: DiT-based Video Generation with Enhanced Controlcited by 31
  6. 2024UniMLVG: Unified Framework for Multi-view Long Video Generation with Comprehensive Control Capabilities for Autonomous Drivingcited by 27
  7. 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Modelscited by 19
  8. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 15
  9. 2026Multiplayer Interactive World Models with Representation Autoencoderscited by 14
  10. 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Modelscited by 10
  11. 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Playerscited by 10
  12. 2026ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modelingcited by 9
  13. 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Datacited by 8
  14. 2026Prisma-World: Camera-Controllable Multi-Agent Video World Modelcited by 8
  15. 2025SafeMVDrive: Multi-view Safety-Critical Driving Video Synthesis in the Real World Domaincited by 6
  16. 2026ActionParty: Multi-Subject Action Binding in Generative Video Gamescited by 4
  17. 2026V2VCrafter: Consistent Street-View Image Generation Across Vehiclescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OmniDrive: An LLM-Choreographed Multi-Agent World Model with Unified Latent Co-Compression for Multi-View Driving Video Generation
  2. 2026FAR-Drive: Frame-AutoRegressive Video Generation in Closed-Loop Autonomous Driving
  3. 2026X-World: Controllable Ego-Centric Multi-Camera World Models for Scalable End-to-End Driving
  4. 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
  5. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
  6. 2026Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Driving
  7. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving
  8. 2024Mitigating Covariate Shift in Imitation Learning for Autonomous Vehicles Using Latent Space Generative World Models