OccSim: Multi-kilometer Simulation with Long-horizon Occupancy World Models
On the map: World models → World models for autonomous driving
Abstract (arXiv)
Data-driven autonomous driving simulation has long been constrained by its heavy reliance on pre-recorded driving logs or spatial priors, such as HD maps. This fundamental dependency severely limits scalability, restricting open-ended generation capabilities to the finite scale of existing collected datasets. To break this bottleneck, we present OccSim, the first occupancy world model-driven 3D simulator. OccSim obviates the requirement for continuous logs or HD maps; conditioned only on a single initial frame and a sequence of future ego-actions, it can stably generate over 3,000 continuous frames, enabling the continuous construction of large-scale 3D occupancy maps spanning over 4 kilometers for simulation. This represents an >80x improvement in stable generation length over previous state-of-the-art occupancy world models. OccSim is powered by two modules: W-DiT based static occupancy world model and the Layout Generator. W-DiT handles the ultra-long-horizon generation of static environments by explicitly introducing known rigid transformations in architecture design, while the Layout Generator populates the dynamic foreground with reactive agents based on the synthesized road topology. With these designs, OccSim can synthesize massive, diverse simulation streams. Extensive experiments demonstrate its downstream utility: data collected directly from OccSim can pre-train 4D semantic occupancy forecasting models to achieve up to 67% zero-shot performance on unseen data, outperforming previous asset-based simulator by 11%. When scaling the OccSim dataset to 5x the size, the zero-shot performance increases to about 74%, while the improvement over asset-based simulators expands to 22.1%.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 44 of its 45 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
44 of 45 references.
Closest ancestors · 17
Same direction, newest first
- 2025I2-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecasting12 Jul
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
- 2025COME: Adding Scene-Centric Forecasting Control to Occupancy World Model16 Jun
- 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
- 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT27 Dec
- 2024InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Models5 Dec
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec
- 2024DynamicCity: Large-Scale 4D Occupancy Generation from Dynamic Scenes23 Oct
- 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Model14 Oct
- 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving5 Sep
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
5 more
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving27 Apr
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
- 2017CARLA: An Open Urban Driving Simulator10 Nov
Other references · 27
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2017Neural Discrete Representation Learningcited by 4,650
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
15 more
- 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
- 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 80
- 2018On Offline Evaluation of Vision-based Driving Modelscited by 62
- 2022Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real worldcited by 56
- 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Modelcited by 56
- 2024SemCity: Semantic Scene Generation with Triplane Diffusioncited by 53
- 2024DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulationcited by 34
- 2025Mem2Ego: Empowering Vision-Language Models with Global-to-Ego Memory for Long-Horizon Embodied Navigationcited by 30
- 2024SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Trafficcited by 27
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environmentscited by 27
- 2025UniOcc: A Unified Benchmark for Occupancy Forecasting and Prediction in Autonomous Drivingcited by 27
- 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllabilitycited by 20
- 2024LiDAR-GS:Real-time LiDAR Re-Simulation using Gaussian Splattingcited by 15
- 2025Towards foundational LiDAR world models with efficient latent flow matchingcited by 10
- 2025SplatCo: Structure-View Collaborative Gaussian Splatting for Detail-Preserving Rendering of Large-Scale Unbounded Scenescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Driving
- 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving
- 2024An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training
- 2025OccTENS: 3D Occupancy World Model via Temporal Next-Scale Prediction
- 2026OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model
- 2025Delta-Triplane Transformers as Occupancy World Models
- 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyond
- 2026OccDirector: Language-Guided Behavior and Interaction Generation in 4D Occupancy Space