mlsanityData to 14 Oct 2026

InfraWorld: Motion-Aware World Modeling for Roadside 4D Occupancy Forecasting

arXiv 2610.14544 ↗First posted 10 Oct 2026cs.CVcited by 0

On the map: World models → World models for autonomous driving

Abstract (arXiv)

Roadside 4D occupancy forecasting predicts future semantic occupancy in a fixed infrastructure coordinate system. Roadside scenes are globally structured yet locally evolving, requiring comprehensive scene-level context while precisely modeling sparse localized motion. However, existing forecasting paradigms struggle to tackle both requirements. To address this limitation, we propose InfraWorld, a world model formulating roadside occupancy forecasting as selective state evolution. InfraWorld maintains a dense BEV state for the complete scene and persistent motion queries for moving regions, assigning complementary states to global context and local dynamics. Specifically, we propose Dynamic Query Initiation (DQI) to initialize queries in regions supported by motion in the observed history. During rollout, the dense state is updated through Long--Short Temporal Fusion (LST), which combines short-term adjacent-frame continuity with long-term motion trends to preserve stable context while capturing scene evolution. Motion-Aware Query Injection (MAQI) then refines the queries and injects confidence-weighted query information into corresponding BEV tokens, enabling targeted dynamic updates without perturbing global context. Together, InfraWorld concentrates predictive capacity on evolving traffic regions. Extensive experiments on the InfraOcc and Occ3D--nus datasets demonstrate that InfraWorld achieves state-of-the-art performance for roadside 4D occupancy forecasting while retaining its effectiveness under ego-centric settings. Code will be released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 29 of its 30 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

29 of 30 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025SparseWorld: A Flexible, Adaptive, and Efficient 4D Occupancy World Model Powered by Sparse and Dynamic Queries20 Oct
  2. 2025OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Framework21 Feb
  3. 2024An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training18 Dec
  4. 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Model14 Oct
  5. 2024RenderWorld: World Model with Self-Supervised 3D Label17 Sep
  6. 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving5 Sep
  7. 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving26 Aug
  8. 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving7 May
  9. 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applications29 Nov
  10. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
  11. 2023UniWorld: Autonomous Driving Pre-training via World Models14 Aug
  12. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving27 Apr
2 more
  1. 2023Point Cloud Forecasting as a Proxy for 4D Occupancy Forecasting25 Feb
  2. 2022Differentiable Raycasting for Self-supervised Occupancy Forecasting4 Oct

Other references · 15

  1. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  2. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  3. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
  4. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
  5. 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
  6. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 106
  7. 2022Rope3D: TheRoadside Perception Dataset for Autonomous Driving and Monocular 3D Object Detection Taskcited by 81
  8. 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Drivingcited by 78
  9. 2024TUMTraf V2X Cooperative Perception Datasetcited by 67
  10. 2024V2X-Real: a Large-Scale Dataset for Vehicle-to-Everything Cooperative Perceptioncited by 66
  11. 2024RCooper: A Real-world Large-scale Dataset for Roadside Cooperative Perceptioncited by 38
  12. 2025Occ-LLM: Enhancing Autonomous Driving with Occupancy-Based Large Language Modelscited by 28
3 more
  1. 2025STCOcc: Sparse Spatial-Temporal Cascade Renovation for 3D Occupancy and Scene Flow Predictioncited by 23
  2. 2024FSF-Net: Enhance 4D Occupancy Forecasting with Coarse BEV Scene Flow for Autonomous Drivingcited by 6
  3. 2026InfraOcc: An Infrastructure Occupancy Benchmark with Static-to-Dynamic Reasoningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations
  2. 2025OccStress: Stress-Testing the 4D Occupancy Forecasting Chain
  3. 2026GEM: Gaussian Evolution Model for Occupancy Forecasting and Motion Planning
  4. 2025OccTENS: 3D Occupancy World Model via Temporal Next-Scale Prediction
  5. 2025I2-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecasting
  6. 2025Vision-Centric 4D Occupancy Forecasting and Planning via Implicit Residual World Models
  7. 2025COME: Adding Scene-Centric Forecasting Control to Occupancy World Model
  8. 2026ForecastOcc: Vision-based Semantic Occupancy Forecasting