mlsanityData to 14 Oct 2026

ARC-Bench: Closed-Loop Replanning Masks Broken Action Ranking in Frozen JEPA World Models

arXiv 2609.05461 ↗First posted 12 Aug 2026cs.AI cs.LG cs.ROcited by 0

On the map: World models → Latent predictive world models

Abstract (arXiv)

Reward-free latent world models plan by scoring candidate actions with distances in a frozen latent space: an action is preferred if its predicted future embedding lands closer to the goal embedding. This silently assumes that latent closeness is action-rankable, i.e., that ordering candidates by latent distance agrees with ordering them by true cost. We audit this assumption directly. We introduce ARC-Bench, a no-leak, fixed-candidate protocol that measures whether frozen JEPA-style objectives rank candidate actions correctly, and apply it to official released JEPA-WM checkpoints across navigation and manipulation-style control. The assumption fails, severely and structurally: on the official manipulation audits the top-scored candidate is almost always suboptimal, and the same inversion appears in the maze domains. A controlled visual-backbone extension shows that the defect persists when DINOv2 is replaced by video-pretrained V-JEPA 1 and V-JEPA 2 encoders at ViT-L/ViT-G scale. Provenance, undertraining, matched-budget backbone controls, and metric-circularity controls rule out trivial explanations. We then explain why this defect has stayed invisible: closed-loop replanning masks it. When we reduce the planner's replanning frequency, success collapses in both a navigation and a manipulation domain, and the episodes rescued by frequent replanning are enriched for severe first-plan ranking failures in the PointMaze first-plan diagnostic. Closed-loop success rates therefore systematically overstate the rankability of frozen latent representations. ARC-Bench supplies the measurement, and the masking mechanism the explanation, for methods that adapt, amortize, or replan around latent-space planners without directly auditing released JEPA-WM action rankability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 10 of its 16 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

10 of 16 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026AdaJEPA: An Adaptive Latent World Model30 Jun
  2. 2026AdaReP:Adaptive Re-Planning under Model Mismatch for Neural World-Model Predictive Control22 Jun
  3. 2026World Model Control by Trajectory Reachability Metrics21 May
  4. 2026Latent Geometry Beyond Search: Amortizing Planning in World Models9 May
  5. 2026Temporal Straightening for Latent Planning12 Mar
  6. 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?30 Dec
  7. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov

Other references · 3

  1. 2023Mastering Diverse Domains through World Modelscited by 1,253
  2. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  3. 2025Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Modelscited by 89

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Toward Physically Grounded JEPA World Models for Goal-Conditioned Robotic Planning
  2. 2026INTACT: Isomorphic Intent-to-Action Learning for Search-Free World Models
  3. 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents
  4. 2026LRC-JEPA: Disentangling Dynamics and Residual Context for Efficient World Models
  5. 2026Delta-JEPA: Learning Action-Sensitive World Models via Latent Difference Decoding
  6. 2026Qantara: Bridge-Flow Training for Multi-Paradigm JEPA Control
  7. 2026JEPA-WAM: Connecting Generated Visual Instructions to World Action Models through JEPA Latent Representations
  8. 2026D-JEPA: A Decision-Aligned Latent World Model