Is Your Driving World Model an All-Around Player?
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Today's driving world models can generate remarkably realistic dash-cam videos, yet no single model excels universally. Some generate photorealistic textures but violate basic physics; others maintain geometric consistency but fail when subjected to closed-loop planning. This disconnect exposes a critical gap: the field evaluates how real generated worlds appear, but rarely whether they behave realistically. We introduce WorldLens, a unified benchmark that measures world-model fidelity across the full spectrum, from pixel quality and 4D geometry to closed-loop driving and human perceptual alignment, through five complementary aspects and 24 standardized dimensions. Our evaluation of six representative models reveals that no existing approach dominates across all axes: texture-rich models violate geometry, geometry-aware models lack behavioral fidelity, and even the strongest performers achieve only 2-3 out of 10 on human realism ratings. To bridge algorithmic metrics with human perception, we further contribute WorldLens-26K, a 26,808-entry human-annotated preference dataset pairing numerical scores with textual rationales, and WorldLens-Agent, a vision-language evaluator distilled from these judgments that enables scalable, explainable auto-assessment. Together, the benchmark, dataset, and agent form a unified ecosystem for assessing generated worlds not merely by visual appeal, but by physical and behavioral fidelity.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 33 of its 36 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
33 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
Other references · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024Depth Anything V2cited by 1,422
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
19 more
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2021TransReID: Transformer-based Object Re-Identificationcited by 435
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
- 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
- 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
- 20253D and 4D World Modeling: A Surveycited by 67
- 2025DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generationcited by 40
- 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenescited by 35
- 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Associationcited by 33
- 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real Worldcited by 23
- 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllabilitycited by 20
- 2024Cross-video Identity Correlating for Person Re-identification Pre-trainingcited by 8
- 2025RLGF: Reinforcement Learning with Geometric Feedback for Autonomous Driving Video Generationcited by 5
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026VOICE: A Vision-Omics Foundation Model Integrating Direct and Retrieval-Based Prediction of In-situ Single-Cell Gene Expressioncited by 1
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRIcited by 1
- 2026Quo Vadis, World Modeling?cited by 0
- 2026LIBERO-MAX: Do Robot Policies Adapt When the World Changes?cited by 0
- 2026DeepJEPA: Scaling World Models from Withincited by 0
- 2026VITAL: From Visual Motion to Precise Actioncited by 0
- 2026VITAL: From Visual Motion to Precise Action14 Oct 2026
- 2026DeepJEPA: Scaling World Models from Within30 Sep 2026
- 2026LIBERO-MAX: Do Robot Policies Adapt When the World Changes?29 Sep 2026
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRI28 Aug 2026
- 2026VOICE: A Vision-Omics Foundation Model Integrating Direct and Retrieval-Based Prediction of In-situ Single-Cell Gene Expression8 Aug 2026
- 2026Quo Vadis, World Modeling?3 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
- 2024Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A Survey
- 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Tasks
- 2026GeoWAM: Visual Geometry World Action Models for Autonomous Driving
- 2026VehDyn: A Driving World Model Benchmark for Vehicle Dynamics
- 2025SimWorld: A Unified Benchmark for Simulator-Conditioned Scene Generation via World Model
- 2025WorldModelBench: Judging Video Generation Models As World Models
- 2026What-If World: A Causal Benchmark for General World Models in Embodied Scenarios