MORE: Learning Motion-Oriented Registers for Driving World Models and Planning
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
By predicting future states, latent world models provide rich self-supervision for end-to-end driving, but often inherit dense features from pretrained visual encoders as their world-state interface. This creates a mismatch: visual pretraining produces information-rich, spatially dense features, but their adaptation for motion-conditioned world modeling and planning is deferred to downstream training. The dense grid also makes future prediction more computationally expensive as visual resolution increases. We therefore argue that video pretraining should directly learn state representations suited to downstream world modeling and planning, rather than relying on downstream training to adapt inherited visual features. We propose ***MORE***, a V-JEPA framework that learns **M**otion-**O**riented **RE**gisters during video pretraining as a shared state interface for driving world models and planning. MORE injects temporally aligned ego motion into a small set of registers and uses them as the sole context for masked patch prediction, channeling dense patch-level supervision through a compact state bottleneck. A complementary blockwise register-masking objective further shapes predictive structure in the register space. During downstream training, the same register space defines the future states predicted by the world model and provides shared scene memory for trajectory generation and scoring. On NAVSIM-v2, MORE outperforms the state of the art by 1.6 in EPDMS, while achieving superior efficiency with only 1/10 the inference latency of DriveLaW. These results support learning the state interface for world modeling and planning directly during video pretraining.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 56 of its 59 references that are in the map. First posted on arXiv 10 Oct 2026.
Builds on
56 of 59 references.
Closest ancestors · 21
Same direction, newest first
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoning14 May
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving11 May
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May
- 2026ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving3 Apr
- 2026DreamerAD: Efficient Reinforcement Learning via Latent World Model for Autonomous Driving25 Mar
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving25 Mar
- 2026ResWorld: Temporal Residual World Model for End-to-End Autonomous Driving11 Feb
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
- 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving World29 Dec
- 2025WorldRFT: Latent World Model Planning with Reinforcement Fine-Tuning for Autonomous Driving22 Dec
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
9 more
- 2025DriveX: Omni Scene Modeling for Learning Generalizable World Knowledge in Autonomous Driving25 May
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec
- 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving26 Aug
- 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving7 May
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 35
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
23 more
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baselinecited by 248
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 190
- 2025Pseudo-Simulation for Autonomous Drivingcited by 150
- 2025Unified Vision-Language-Action Modelcited by 134
- 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 117
- 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 96
- 2025ARTEMIS: Autoregressive End-to-End Trajectory Planning with Mixture of Experts for Autonomous Drivingcited by 67
- 2025Generalized Trajectory Scoring for End-to-end Multimodal Planningcited by 67
- 2026Driving on Registerscited by 44
- 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?cited by 43
- 2025iPad: Iterative Proposal-centric End-to-End Autonomous Drivingcited by 42
- 2026SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Drivingcited by 38
- 2025From Forecasting to Planning: Policy World Model for Collaborative State-Action Predictioncited by 33
- 2026Drive-JEPA: Video JEPA Meets Multimodal Trajectory Distillation for End-to-End Drivingcited by 30
- 2026SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Drivingcited by 26
- 2025WAM-Flow: Parallel Coarse-to-Fine Motion Planning via Discrete Flow Matching for Autonomous Drivingcited by 16
- 2026The DAWN of World-Action Interactive Modelscited by 8
- 2026Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learningcited by 4
- 2026RISE: Adaptive Imagination for World Action Modelscited by 4
- 2026NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Drivingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ReDrive: Shaping Representations with World Modeling for End-to-End Driving
- 2026Orbis 2: A Hierarchical World Model for Driving
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
- 2026ForeDrive: Foresight-Guided End-to-End Autonomous Driving with a Planning-Relevant Latent World Model
- 2026ReWorld: Representation Learning for World Action Models
- 2026SimVTA: Simulation-Grounded Video-Trajectory Alignment for Driving World Action Models
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving