mlsanityData to 7 Oct 2026

Delta-Triplane Transformers as Occupancy World Models

arXiv 2503.07338 ↗First posted 10 Mar 2025cs.RO cs.AIcited by 5

On the map: World models → World models for autonomous driving

Abstract (arXiv)

Occupancy World Models (OWMs) aim to predict future scenes via 3D voxelized representations of the environment to support intelligent motion planning. Existing approaches typically generate full future occupancy states from VAE-style latent encodings, which can be computationally expensive and redundant. We propose Delta-Triplane Transformers (DTT), a novel 4D OWM for autonomous driving, that introduces two key innovations: (1) a triplane based representation that encodes 3D occupancy more compactly than previous approaches, and (2) an incremental prediction strategy for OWM that models em changes in occupancy rather than dealing with full states. The core insight is that changes in the compact 3D latent space are naturally sparser and easier to model, enabling higher accuracy with a lighter-weight architecture. Building on this representation, DTT extracts multi-scale motion features from historical data and iteratively predict future triplane deltas. These deltas are combined with past states to decode future occupancy and ego-motion trajectories. Extensive experiments demonstrate that DTT delivers a 1.44× speedup (26 FPS) over the state of the art, improves mean IoU to 30.85, and reduces the mean absolute planning error to 1.0 meters. Demo videos are provided in the supplementary material.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 48 of its 59 references that are in the map. First posted on arXiv 10 Mar 2025.

Builds on

48 of 59 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Framework21 Feb
  2. 2024Spatiotemporal Decoupling for Efficient Vision-Based Occupancy Forecasting21 Nov
  3. 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Model14 Oct
  4. 2024RenderWorld: World Model with Self-Supervised 3D Label17 Sep
  5. 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving5 Sep
  6. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  7. 2024GenAD: Generative End-to-End Autonomous Driving18 Feb
  8. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
  9. 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applications29 Nov
  10. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
  11. 2023ADriver-I: A General World Model for Autonomous Driving22 Nov
  12. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving27 Apr
2 more
  1. 2023Point Cloud Forecasting as a Proxy for 4D Occupancy Forecasting25 Feb
  2. 2022Differentiable Raycasting for Self-supervised Occupancy Forecasting4 Oct

Other references · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  6. 2018World Modelscited by 1,444
  7. 2022Planning-oriented Autonomous Drivingcited by 1,068
  8. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  9. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  10. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  11. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  12. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 365
22 more
  1. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  2. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
  3. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  4. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  5. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
  6. 2021End-to-end Interpretable Neural Motion Plannercited by 240
  7. 2023Scene as Occupancycited by 208
  8. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
  9. 2023SCPNet: Semantic Scene Completion on Point Cloudcited by 80
  10. 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
  11. 2023Text2Performer: Text-Driven Human Video Generationcited by 53
  12. 2024SemCity: Semantic Scene Generation with Triplane Diffusioncited by 53
  13. 2021Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networkscited by 42
  14. 2023PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awarenesscited by 42
  15. 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 36
  16. 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
  17. 2025Occ-LLM: Enhancing Autonomous Driving with Occupancy-Based Large Language Modelscited by 27
  18. 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Drivingcited by 21
  19. 2023TriVol: Point Cloud Rendering via Triple Volumescited by 16
  20. 2024Tri2-plane: Thinking Head Avatar via Feature Pyramidcited by 16
  21. 2020MoNet: Motion-based Point Cloud Prediction Networkcited by 14
  22. 2024TriNeRFLet: A Wavelet Based Triplane NeRF Representationcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving
  2. 2024An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training
  3. 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Driving
  4. 2026CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations
  5. 2026OccSim: Multi-kilometer Simulation with Long-horizon Occupancy World Models
  6. 2025OccStress: Stress-Testing the 4D Occupancy Forecasting Chain
  7. 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Driving
  8. 2026OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model