mlsanityData to 14 Oct 2026

Infrastructure-Centric World Models: Bridging Temporal Depth and Spatial Breadth for Roadside Perception

arXiv 2604.17651 ↗First posted 19 Apr 2026cs.CV cs.ROcited by 1

On the map: World models → World models for autonomous driving

Abstract (arXiv)

World models, generative AI systems that simulate how environments evolve, are transforming autonomous driving, yet all existing approaches adopt an ego-vehicle perspective, leaving the infrastructure viewpoint unexplored. We argue that infrastructure-centric world models offer a fundamentally complementary capability: the bird's-eye, multi-sensor, persistent viewpoint that roadside systems uniquely possess. Central to our thesis is a spatio-temporal complementarity: fixed roadside sensors excel at temporal depth, accumulating long-term behavioral distributions including rare safety-critical events, while vehicle-borne sensors excel at spatial breadth, sampling diverse scenes across large road networks. This paper presents a vision for Infrastructure-centric World Models (I-WM) in three phases: (I) generative scene understanding with quality-aware uncertainty propagation, (II) physics-informed predictive dynamics with multi-agent counterfactual reasoning, and (III) collaborative world models for V2X communication via latent space alignment. We propose a dual-layer architecture, annotation-free perception as a multi-modal data engine feeding end-to-end generative world models, with a phased sensor strategy from LiDAR through 4D radar and signal phase data to event cameras. We establish a taxonomy of driving world model paradigms, position I-WM relative to LeCun's JEPA, Li Fei-Fei's spatial intelligence, and VLA architectures, and introduce Infrastructure VLA (I-VLA) as a novel unification of roadside perception, language commands, and traffic control actions. Our vision builds upon existing multi-LiDAR pipelines and identifies open-source foundations for each phase, providing a path toward infrastructure that understands and anticipates traffic.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 13 of its 54 references that are in the map. First posted on arXiv 19 Apr 2026.

Builds on

13 of 54 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026ResWorld: Temporal Residual World Model for End-to-End Autonomous Driving11 Feb
  2. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  3. 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Survey14 Feb
  4. 2025A Survey of World Models for Autonomous Driving20 Jan
  5. 2024CarDreamer: Open-Source Learning Platform for World Model based Autonomous Driving15 May
  6. 2024World Models for Autonomous Driving: An Initial Survey5 Mar
  7. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep

Other references · 6

  1. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  2. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  3. 2026Advancing Open-source World Modelscited by 154
  4. 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 54
  5. 2024UrbanWorld: An Urban World Model for 3D City Generationcited by 24
  6. 2023Vehicle-to-Everything Cooperative Perception for Autonomous Drivingcited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challenges
  2. 2026V2X-WAM: A Cooperative World Action Model for End-to-End Autonomous Driving
  3. 2026Roadside-Cooperative Autonomous Driving: From Data Platform to Vision-Language End-to-End Reasoning
  4. 2026Multi-Agent Embodied Autonomous Driving (MAEAD): From V2X Information Exchange to Shared World Models
  5. 2026Unleashing the Capabilities of Large Vision-Language Models for Intelligent Perception of Roadside Infrastructure
  6. 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving
  7. 2026AutoWorld: Learning Multi-Agent Traffic Simulation with Self-Supervised World Models
  8. 2026UniDWM: Towards a Unified Driving World Model via Multifaceted Representation Learning