mlsanityData to 7 Oct 2026

Geographic Diversity Beats Data Volume for Cross-Domain Generalization in Zero-Label JEPA Driving World Models

arXiv 2607.04500 ↗First posted 5 Jul 2026cs.CVcited by 0

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Self-supervised latent world models can assign a surprise score to driving scenarios without any human labels. A natural follow-up question is whether such a model, trained on driving data from one geographic region, can generalize its notion of complexity to unseen cities and sensor configurations. We study this question through a controlled transfer experiment: we train JEPA-based world models on nuPlan data (Pittsburgh, Boston, Singapore) and evaluate zero-shot on held-out Argoverse 2 validation scenarios from Miami and Austin. We find that models trained on geographically diverse data generalize significantly better than models trained on equal amounts of single-geography data. In a matched-scale ablation at 63,000 scenarios per condition (n=3 seeds each), combined training reduces mean surprise score by 16.5% relative to nuPlan-only training (0.228 +/- 0.015 vs 0.273 +/- 0.008). Notably, training on 200,000 AV2-only scenarios (3x more data from one geography) still produces higher surprise (0.264) than the combined 63K model, suggesting that geographic diversity is a stronger predictor of cross-domain generalization than raw data volume.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 9 of its 13 references that are in the map. First posted on arXiv 5 Jul 2026.

Builds on

9 of 13 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
  2. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun

Other references · 7

  1. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  2. 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 150
  3. 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
  4. 2022Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervisioncited by 80
  5. 2024WayveScenes101: A Dataset and Benchmark for Novel View Synthesis in Autonomous Drivingcited by 13
  6. 2026SkyJEPA: Learning Long-Horizon World Models for Zero-Shot Sim-to-Real Control of Quadrotorscited by 9
  7. 2026Zero-Label Driving Scenario Complexity Detection via Joint Embedding Predictive Architecturecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representations
  2. 2023Learning to Drive Anywhere
  3. 2026Orbis 2: A Hierarchical World Model for Driving
  4. 2026GeoDrive-Bench: Benchmarking Region-Specific Multimodal Reasoning in Autonomous Driving
  5. 2021Towards Learning Generalizable Driving Policies from Restricted Latent Representations
  6. 2026HEAT: Heterogeneous End-to-End Autonomous Driving via Trajectory-Guided World Models
  7. 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challenges
  8. 2025A Survey of World Models for Autonomous Driving