mlsanityData to 14 Oct 2026

Action from Adjacent Set in Physical Space Outperforms the Best Prediction in World Models

arXiv 2607.23602 ↗First posted 26 Jul 2026cs.RO cs.AI cs.LGcited by 2

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Controllers based on sampling and latent world models assign a predicted terminal cost to each candidate action sequence, choose the minimum, execute its first action block, and replan. This rule can fail even when the terminal cost perfectly and accurately reflects the true task objective in the physical world. Residual prediction error can give an infeasible sequence an anomalously low cost, and a larger proposal pool gives such errors more chances to outrank feasible alternatives. We call this conditional failure proposal overgeneration. In Cube candidate execution audits, increasing the total proposal budget from 72 to 288 reduces the feasibility of selection by minimum latent cost from .375 to .062 for position targets and from .344 to .031 for targets defined by position and yaw, although every larger pool contains a feasible sequence. We introduce Adjacent Set Action Reconstruction (ASAR). Among proposals with low cost, ASAR identifies an adjacent set using standardized early action prefixes and reconstructs a full action sequence through locally weighted aggregation with a light anchor from the sequence with minimum cost. On a Carry and Release evaluation set of 75 queries, Kernel ASAR improves event completion success over matching selection by 28.0, 24.0, and 18.7 percentage points under latent cost and by 18.7, 20.0, and 17.3 points under a trajectory reachability cost at 72, 144, and 288 proposals. Analysis of finite proposal pools characterizes selection risk from the lower tail, separation by a related radius support statistic, and sequence containment under an explicit local feasibility condition.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 20 of its 34 references that are in the map. First posted on arXiv 26 Jul 2026.

Builds on

20 of 34 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun

Other references · 19

  1. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  2. 2023Mastering Diverse Domains through World Modelscited by 1,253
  3. 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
  4. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
  5. 2022Transformers are Sample-Efficient World Modelscited by 328
  6. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
  7. 2024OGBench: Benchmarking Offline Goal-Conditioned RLcited by 238
  8. 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 194
  9. 2025Offline Goal-conditioned Reinforcement Learning with Quasimetric Representationscited by 24
  10. 2026stable-worldmodel: A Platform for Reproducible World Modeling Research and Evaluationcited by 20
  11. 2026Predictive but Not Plannable: RC-aux for Latent World Modelscited by 19
  12. 2024TLDR: Unsupervised Goal-Conditioned RL via Temporal Distance-Aware Representationscited by 17
7 more
  1. 2024UniZero: Generalized and Efficient Planning with Scalable Latent World Modelscited by 12
  2. 2025Closing the Train-Test Gap in World Models for Gradient-Based Planningcited by 11
  3. 2026World Model Control by Trajectory Reachability Metricscited by 8
  4. 2026PRISM: PRior-guided Imagination Sampling in world Modelscited by 8
  5. 2026Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planningcited by 8
  6. 2026SAGE: Subgoal-Conditioned Action Generation for Latent World Model Planningcited by 7
  7. 2023Goal-Conditioned Reinforcement Learning with Disentanglement-based Reachability Planningcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Predict Before You Deploy: Offline Prediction of Quantization-Induced Task Degradation for World Action Models
  2. 2026Test-Time Scaling for World Action Models via Zero-Shot Geometric Evaluation
  3. 2026Paired Exact-Reset Evaluation of a Prediction-Derived Medium-to-Full World-Model Cascade
  4. 2026LePlanner: An Iterative Amortized Controller For World Models
  5. 2026LeapBot-JAC: Joint Action Chains for World Action Models
  6. 2026ActionSplice: In-Flight Action Editing for Interactive World Models
  7. 2026Supervise What Decides Success: Criterion-Aligned Auxiliary Losses for Latent World-Model Planning
  8. 2026World Models with Predictable Long-Horizon Marginals