mlsanityData to 7 Oct 2026

M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streaming

arXiv 2607.14005 ↗First posted 15 Jul 2026cs.CV cs.ROcited by 1

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Driving-world generation has emerged as a core capability for scalable autonomous-driving simulation, yet existing methods remain limited in object-level controllability and long-horizon stability. We present M4World, a Multi-view and Multimodal generative driving world model that synthesizes future surround-view video streams and synchronized LiDAR scans while supporting interactive object Manipulation and stable Minute-long streaming. Fine-grained object manipulation is realized through a flexible conditioning interface that supports explicit control over both the spatial layout and visual appearance of individual objects. Stable minute-long streaming, on the other hand, is achieved through a multi-stage training framework that enables online causal generation in only four denoising steps while maintaining coherent world dynamics throughout extended rollouts. Building on these components, we introduce an efficient few-clip post-training as well as a suite of visual reference-conditioned generation models, preserving general generation ability while allowing rare-case customization for long-tail controllability. To assess controllability beyond realism, we further introduce an automated VLM-based judging pipeline that evaluates scene-level condition adherence, view-wise object controllability, and cross-view object consistency. Comprehensive experiments show that M4World consistently delivers high generation quality, precise controllability, and stable minute-long streaming. Together with downstream long-tail augmentation and scene editing, these results demonstrate the potential of M4World for controllable, scalable driving simulation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 24 of its 77 references that are in the map. First posted on arXiv 15 Jul 2026.

Builds on

24 of 77 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation2 Jun
  2. 2026Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Driving18 May
  3. 2026HorizonDrive: Self-Corrective Autoregressive World Model for Long-horizon Driving Simulation12 May
  4. 2026X-World: Controllable Ego-Centric Multi-Camera World Models for Scalable End-to-End Driving20 Mar
  5. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
  6. 2025Uni-Gaussians: Unifying Camera and Lidar Simulation with Gaussians for Dynamic Driving Scenarios11 Mar
  7. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep

Other references · 17

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  5. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  6. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  7. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  8. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  9. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
  10. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  11. 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
  12. 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 80
5 more
  1. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 25
  2. 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Modelscited by 19
  3. 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 13
  4. 2026ParkGaussian: Surround-view 3D Gaussian Splatting for Autonomous Parkingcited by 7
  5. 2025ExtraGS: Geometric-Aware Trajectory Extrapolation with Uncertainty-Guided Generative Priorscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026HelloWorld: Towards Practical Applications of Generative Driving World Models
  2. 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation
  3. 2025STAGE: A Stream-Centric Generative World Model for Long-Horizon Driving-Scene Simulation
  4. 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllability
  5. 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving
  6. 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
  7. 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Control
  8. 2026FAR-Drive: Frame-AutoRegressive Video Generation in Closed-Loop Autonomous Driving