Auto-JEPA: A Latent World Model of Continuous Intent for End-to-End Autonomous Driving
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Existing autonomous-driving world models typically perform dense prediction of future videos, occupancy states, BEV representations, or agent motion. We argue that planning need not reconstruct the complete future world, but only focus on scene features that affect future ego action. Based on this perspective, we propose Auto-JEPA, an action-oriented latent world model that learns continuous future driving intent through joint-embedding prediction. Given visual observations, egomotion history, and navigation commands, Auto-JEPA predicts an intent embedding aligned with the latent representation of the future ego trajectory. The predicted intent retrieves executable trajectories from a fixed trajectory memory, which are then ranked by a scene-conditioned candidate selection module. Auto-JEPA keeps the visual encoder frozen, requires no explicit perception annotations, and uses no learned trajectory generator. By optimizing only task-specific modules for trajectory representation, intent prediction, and candidate selection, Auto-JEPA achieves 91.3 PDMS on NAVSIM v1 and 89.1 EPDMS on NAVSIM v2. Semantic occlusion experiments show that masking dynamic-agent regions induces an average intent change 2.97x that of equal-area random masking. Moreover, occluding vehicles that affect future driving substantially changes the predicted intent and selected trajectory, whereas both remain essentially unchanged when non-influential vehicles are occluded. These results show that future-intent prediction encourages the model to focus on planning-relevant visual features and supports high-quality planning without dense future-world modeling.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 25 of its 29 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
25 of 29 references.
Closest ancestors · 10
Same direction, newest first
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
- 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2023Visual Point Cloud Forecasting enables Scalable Autonomous Driving29 Dec
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
Other references · 15
- 2017Attention Is All You Needcited by 59,932
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 93
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
3 more
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026DA-WAM: Decision-Aligned Future Latents for Driving World Modelscited by 3
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Drivingcited by 0
- 2026ReDrive: Shaping Representations with World Modeling for End-to-End Drivingcited by 0
- 2026AD-E2E-JEPA: A Joint-Embedding Predictive Architecture For End-to-End Autonomous Drivingcited by 0
- 2026AD-E2E-JEPA: A Joint-Embedding Predictive Architecture For End-to-End Autonomous Driving28 Sep 2026
- 2026ReDrive: Shaping Representations with World Modeling for End-to-End Driving27 Sep 2026
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving24 Sep 2026
- 2026DA-WAM: Decision-Aligned Future Latents for Driving World Models19 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving
- 2025MTR-VP: Towards End-to-End Trajectory Planning through Context-Driven Image Encoding and Multiple Trajectory Prediction
- 2026ReWorld: Representation Learning for World Action Models
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving
- 2025DAP: A Discrete-token Autoregressive Planner for Autonomous Driving
- 2026MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Driving
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving