mlsanityData to 14 Oct 2026

HelloWorld: Towards Practical Applications of Generative Driving World Models

arXiv 2609.28931 ↗First posted 24 Sep 2026cs.CVcited by 0

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Driving world models provide a promising route toward scalable counterfactual data generation and interactive simulation beyond recorded driving logs. Realizing this potential requires a system that can generalize across diverse scenes, respond faithfully to prescribed controls, generate coherent multi-sensor observations, and operate efficiently under repeated inference. We present HelloWorld, a 2B driving world model system designed around these requirements. HelloWorld progressively specializes broad visual and motion priors from heterogeneous video data into controllable driving generation using ego pose, HD maps, and 3D boxes. A block-causal generation interface, together with adaptation to self-generated context, aligns the model with sequential simulation. The system further supports synchronized seven-camera RGB generation and conditional LiDAR synthesis, and is distilled toward few-step inference for efficient deployment. Experiments evaluate visual quality, control fidelity, cross-view consistency, robustness under repeated generation, inference efficiency, and LiDAR synthesis. Together, HelloWorld provides a unified framework for scalable driving data generation and interactive simulation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 40 of its 43 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

40 of 43 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026HorizonDrive: Self-Corrective Autoregressive World Model for Long-horizon Driving Simulation12 May
  2. 2026UniDriveDreamer: A Single-Stage Multimodal World Model for Autonomous Driving2 Feb
  3. 2025OmniNWM: Omniscient Driving Navigation World Models21 Oct
  4. 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
  5. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
  6. 2025MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous Driving20 Mar
  7. 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT27 Dec
  8. 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
  9. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  10. 2024GenAD: Generalized Predictive Model for Autonomous Driving14 Mar
  11. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
  12. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
2 more
  1. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
  2. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving18 Sep

Other references · 26

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2023Consistency Modelscited by 1,822
  5. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  6. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  7. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  8. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  9. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  10. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  11. 2025VACE: All-in-One Video Creation and Editingcited by 479
  12. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
14 more
  1. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
  2. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 168
  3. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 106
  4. 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 106
  5. 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
  6. 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
  7. 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 92
  8. 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 51
  9. 2026Infinite Worlds with Versatile Interactionscited by 48
  10. 2025DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generationcited by 40
  11. 2024DiVE: DiT-based Video Generation with Enhanced Controlcited by 31
  12. 2026L3DR: 3D-aware LiDAR Diffusion and Rectificationcited by 3
  13. 2026FAR-Drive: Frame-AutoRegressive Video Generation in Closed-Loop Autonomous Drivingcited by 3
  14. 2026Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Drivingcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streaming
  2. 2026X-World: Controllable Ego-Centric Multi-Camera World Models for Scalable End-to-End Driving
  3. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
  4. 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation
  5. 2025SimWorld: A Unified Benchmark for Simulator-Conditioned Scene Generation via World Model
  6. 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
  7. 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving
  8. 2025Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistency