CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
This letter proposes CascadeOcc, a novel occupancy world model that prioritizes intrinsic structural hierarchy over extrinsic auxiliary modalities for autonomous driving. Occupancy world models -- forecasting the future driving environment and planning the driving trajectory -- effectively bridge perception and planning, but current approaches often heavily rely on external modalities or large language models, failing to fully exploit the inherent structural potential of occupancy representations themselves. To enhance representational capacity for complex 3D scenes, we integrate a cascaded Vector Quantized (VQ) mechanism into an autoregressive framework. Following a coarse-to-fine principle, CascadeOcc progressively refines fine-grained details from global structures through a multi-scale architecture. Additionally, we incorporate a TimeMixer to capture multi-scale temporal dependencies, establishing a dual-hierarchy mechanism in both space and time. Experimental results on 4D occupancy forecasting and motion planning benchmarks demonstrate that CascadeOcc achieves superior performance among vision-centric approaches, validating that optimizing inherent representations is a powerful alternative to relying on external foundation models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 28 of its 31 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
28 of 31 references.
Closest ancestors · 4
Same direction, newest first
- 2024RenderWorld: World Model with Self-Supervised 3D Label17 Sep
- 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving5 Sep
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving27 Apr
Other references · 24
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2017Neural Discrete Representation Learningcited by 4,712
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2015Sequence Level Training with Recurrent Neural Networkscited by 576
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
12 more
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 221
- 2023Scene as Occupancycited by 209
- 2022SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimationcited by 76
- 2021Full Surround Monodepth from Multiple Camerascited by 41
- 2023R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Camerascited by 39
- 2025Occ-LLM: Enhancing Autonomous Driving with Occupancy-Based Large Language Modelscited by 28
- 2024FSF-Net: Enhance 4D Occupancy Forecasting with Coarse BEV Scene Flow for Autonomous Drivingcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving
- 2024An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training
- 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Driving
- 2026OccWAM: Occupancy World-Action Models with Joint Scene-to-Ego Flow Matching
- 2026GEM: Gaussian Evolution Model for Occupancy Forecasting and Motion Planning
- 2025OccTENS: 3D Occupancy World Model via Temporal Next-Scale Prediction
- 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Model
- 2026ForecastOcc: Vision-based Semantic Occupancy Forecasting