Delta-Triplane Transformers as Occupancy World Models
On the map: World models → World models for autonomous driving
Abstract (arXiv)
Occupancy World Models (OWMs) aim to predict future scenes via 3D voxelized representations of the environment to support intelligent motion planning. Existing approaches typically generate full future occupancy states from VAE-style latent encodings, which can be computationally expensive and redundant. We propose Delta-Triplane Transformers (DTT), a novel 4D OWM for autonomous driving, that introduces two key innovations: (1) a triplane based representation that encodes 3D occupancy more compactly than previous approaches, and (2) an incremental prediction strategy for OWM that models em changes in occupancy rather than dealing with full states. The core insight is that changes in the compact 3D latent space are naturally sparser and easier to model, enabling higher accuracy with a lighter-weight architecture. Building on this representation, DTT extracts multi-scale motion features from historical data and iteratively predict future triplane deltas. These deltas are combined with past states to decode future occupancy and ego-motion trajectories. Extensive experiments demonstrate that DTT delivers a 1.44× speedup (26 FPS) over the state of the art, improves mean IoU to 30.85, and reduces the mean absolute planning error to 1.0 meters. Demo videos are provided in the supplementary material.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 48 of its 59 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
48 of 59 references.
Closest ancestors · 14
Same direction, newest first
- 2025OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Framework21 Feb
- 2024Spatiotemporal Decoupling for Efficient Vision-Based Occupancy Forecasting21 Nov
- 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Model14 Oct
- 2024RenderWorld: World Model with Self-Supervised 3D Label17 Sep
- 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving5 Sep
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2024GenAD: Generative End-to-End Autonomous Driving18 Feb
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
- 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applications29 Nov
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
- 2023ADriver-I: A General World Model for Autonomous Driving22 Nov
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving27 Apr
2 more
Other references · 34
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017Neural Discrete Representation Learningcited by 4,650
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2018World Modelscited by 1,444
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 365
22 more
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
- 2021End-to-end Interpretable Neural Motion Plannercited by 240
- 2023Scene as Occupancycited by 208
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
- 2023SCPNet: Semantic Scene Completion on Point Cloudcited by 80
- 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
- 2023Text2Performer: Text-Driven Human Video Generationcited by 53
- 2024SemCity: Semantic Scene Generation with Triplane Diffusioncited by 53
- 2021Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networkscited by 42
- 2023PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awarenesscited by 42
- 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 36
- 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
- 2025Occ-LLM: Enhancing Autonomous Driving with Occupancy-Based Large Language Modelscited by 27
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Drivingcited by 21
- 2023TriVol: Point Cloud Rendering via Triple Volumescited by 16
- 2024Tri2-plane: Thinking Head Avatar via Feature Pyramidcited by 16
- 2020MoNet: Motion-based Point Cloud Prediction Networkcited by 14
- 2024TriNeRFLet: A Wavelet Based Triplane NeRF Representationcited by 8
Built on by
Citing papers per year: 2025: 4; 2026: 1.
5 papers.
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 65
- 20253D and 4D World Modeling: A Surveycited by 64
- 2025LongDWM: Cross-Granularity Distillation for Building a Long-Term Driving World Modelcited by 9
- 2025SparseWorld-TC: Trajectory-Conditioned Sparse Occupancy World Modelcited by 3
- 2026LiAuto-GeoX: Efficient Grounded Driving Transformercited by 0
- 2026LiAuto-GeoX: Efficient Grounded Driving Transformer4 Jun 2026
- 2025SparseWorld-TC: Trajectory-Conditioned Sparse Occupancy World Model27 Nov 2025
- 2025A Comprehensive Survey on World Models for Embodied AI19 Oct 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025LongDWM: Cross-Granularity Distillation for Building a Long-Term Driving World Model2 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving
- 2024An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training
- 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Driving
- 2026CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations
- 2026OccSim: Multi-kilometer Simulation with Long-horizon Occupancy World Models
- 2025OccStress: Stress-Testing the 4D Occupancy Forecasting Chain
- 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Driving
- 2026OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model