UniDWM: Towards a Unified Driving World Model via Multifaceted Representation Learning
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Achieving reliable and efficient planning in complex driving environments requires a model that can reason over the scene's geometry, appearance, and dynamics. We present UniDWM, a unified driving world model that advances autonomous driving through multifaceted representation learning. UniDWM constructs a structure- and dynamic-aware latent world representation that serves as a physically grounded state space, enabling consistent reasoning across perception, prediction, and planning. Specifically, a joint reconstruction pathway learns to recover the scene's structure, including geometry and visual texture, while a collaborative generation framework leverages a conditional diffusion transformer to forecast future world evolution within the latent space. Furthermore, we show that our UniDWM can be deemed as a variation of VAE, which provides theoretical guidance for the multifaceted representation learning. Extensive experiments demonstrate the effectiveness of UniDWM in trajectory planning, 4D reconstruction and generation, highlighting the potential of multifaceted world representations as a foundation for unified driving intelligence. The code will be publicly available at https://github.com/Say2L/UniDWM.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 38 of its 43 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
38 of 43 references.
Closest ancestors · 8
Same direction, newest first
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
- 2025DriveX: Omni Scene Modeling for Learning Generalizable World Knowledge in Autonomous Driving25 May
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
- 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT27 Dec
- 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
Other references · 30
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
18 more
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 20243D Reconstruction with Spatial Memorycited by 269
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 227
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 214
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 209
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Drivingcited by 168
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
- 2015Modelling Uncertainty in Deep Learning for Camera Relocalizationcited by 133
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Drivingcited by 125
- 2017InfoVAE: Information Maximizing Variational Autoencoderscited by 124
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
- 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 90
- 2025Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Drivingcited by 84
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Driving
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
- 2026Orbis 2: A Hierarchical World Model for Driving
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
- 2026ReDrive: Shaping Representations with World Modeling for End-to-End Driving
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving
- 2026GeoWAM: Visual Geometry World Action Models for Autonomous Driving