mlsanityData to 7 Oct 2026

SparseWorld: A Flexible, Adaptive, and Efficient 4D Occupancy World Model Powered by Sparse and Dynamic Queries

arXiv 2510.17482 ↗First posted 20 Oct 2025cs.CV cs.AIcited by 10

On the map: World models → World models for autonomous driving

Abstract (arXiv)

Semantic occupancy has emerged as a powerful representation in world models for its ability to capture rich spatial semantics. However, most existing occupancy world models rely on static and fixed embeddings or grids, which inherently limit the flexibility of perception. Moreover, their ``in-place classification" over grids exhibits a potential misalignment with the dynamic and continuous nature of real scenarios. In this paper, we propose SparseWorld, a novel 4D occupancy world model that is flexible, adaptive, and efficient, powered by sparse and dynamic queries. We propose a Range-Adaptive Perception module, in which learnable queries are modulated by the ego vehicle states and enriched with temporal-spatial associations to enable extended-range perception. To effectively capture the dynamics of the scene, we design a State-Conditioned Forecasting module, which replaces classification-based forecasting with regression-guided formulation, precisely aligning the dynamic queries with the continuity of the 4D environment. In addition, We specifically devise a Temporal-Aware Self-Scheduling training strategy to enable smooth and efficient training. Extensive experiments demonstrate that SparseWorld achieves state-of-the-art performance across perception, forecasting, and planning tasks. Comprehensive visualizations and ablation studies further validate the advantages of SparseWorld in terms of flexibility, adaptability, and efficiency.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 30 of its 38 references that are in the map. First posted on arXiv 20 Oct 2025.

Builds on

30 of 38 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Driving11 Feb
  2. 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Model14 Oct
  3. 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving5 Sep
  4. 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving26 Aug
  5. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  6. 2023Visual Point Cloud Forecasting enables Scalable Autonomous Driving29 Dec
  7. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
  8. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving27 Apr
  9. 2023Point Cloud Forecasting as a Proxy for 4D Occupancy Forecasting25 Feb

Other references · 21

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2018World Modelscited by 1,444
  4. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  5. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 365
  6. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  7. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  8. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
  9. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
  10. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
  11. 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
  12. 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidancecited by 138
9 more
  1. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
  2. 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 126
  3. 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
  4. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
  5. 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 94
  6. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  7. 2024CVT-Occ: Cost Volume Temporal Fusion for 3D Occupancy Predictioncited by 23
  8. 2024ProtoOcc: Accurate, Efficient 3D Occupancy Prediction Using Dual Branch Encoder-Prototype Query Decodercited by 17
  9. 2024Deep Height Decoupling for Precise Vision-based 3D Occupancy Predictioncited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 8.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025OccTENS: 3D Occupancy World Model via Temporal Next-Scale Prediction
  2. 2024Spatiotemporal Decoupling for Efficient Vision-Based Occupancy Forecasting
  3. 2026CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations
  4. 2025Occupancy World Model for Robots
  5. 2024UnO: Unsupervised Occupancy Fields for Perception and Forecasting
  6. 2024An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training
  7. 2025AGO: Adaptive Grounding for Open World 3D Occupancy Prediction
  8. 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Prediction