mlsanityData to 14 Oct 2026

Control-Geometry Straightening for Sampling-Based Latent Planning

arXiv 2609.35603 ↗First posted 28 Sep 2026cs.LG stat.MLcited by 0

On the map: World models → Latent predictive world models

Abstract (arXiv)

Joint-embedding predictive architectures enable planning with latent world models, but accurate transition prediction alone does not ensure that the planning objective is easy to optimize. We introduce Control-Geometry Straightening (CGS), a single auxiliary loss that learns planner-friendly representations by directly straightening control geometry for sampling-efficient planning. CGS matches pairwise cosine similarities among actions to those among corresponding latent differences only using local transitions from pixel-action pairs. The loss can be applied across world-model architectures using end-to-end learned or pretrained representations. Under linear-dynamics, our theoretical analysis connects this objective to temporal straightening and more balanced terminal-cost curvature across the full planning horizon, yielding finite-budget guarantees for MPPI, local contraction results for CEM, and convergence bounds for gradient descent. Across four control environments and multiple planners, CGS improves planning with fewer sampled candidates and refinement steps, achieving success-rate gains up to 20 and 12.6 percentage points over LeWorldModel (LeWM) and its temporal-straightening variant (LeWM+TS), respectively, with sampling-based planners using 128 candidates per update. Probes, comparisons with DINO-WM architecture, and planner-side ablations clarify how latent motion organization, state dependence, and dynamical context shape planning behavior. Straightening control geometry thus makes good action sequences easier to find under limited planning budgets.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 17 of its 72 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

17 of 72 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026LpWM: A Case for Sparse Representations in World Models24 Aug
  2. 2026SCALE: State-Calibrated Latent Embeddings for JEPA Planning in the Right Geometry17 Aug
  3. 2026Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control28 Jul
  4. 2026On the Identifiability of Controlled World Models24 Jul
  5. 2026AdaJEPA: An Adaptive Latent World Model30 Jun
  6. 2026Delta-JEPA: Learning Action-Sensitive World Models via Latent Difference Decoding30 Jun
  7. 2026Sensorimotor World Models: Perception for Action via Inverse Dynamics18 Jun
  8. 2026PRISM: PRior-guided Imagination Sampling in world Models6 Jun
  9. 2026Predictive but Not Plannable: RC-aux for Latent World Models8 May
  10. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels13 Mar
  11. 2026Learning Invariant Visual Representations for Planning with Joint-Embedding Predictive World Models20 Feb
  12. 2026Causal-JEPA: Learning World Models through Object-Level Latent Masking11 Feb
1 more
  1. 2025Value-guided action planning with JEPA world models28 Dec

Other references · 4

  1. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  2. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  3. 2026INTACT: Isomorphic Intent-to-Action Learning for Search-Free World Modelscited by 8
  4. 2026Finite-Sample Closed-Loop Stability of Model Predictive Path Integral Control for Linear Time-Invariant Systemscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Temporal Straightening for Latent Planning
  2. 2026Latent Geometry Beyond Search: Amortizing Planning in World Models
  3. 2026ATLAS: Aligned Transport of Latent Structure for Reliable World Model Planning
  4. 2018Learning Latent Dynamics for Planning from Pixels
  5. 2026Beyond a single latent space: a dual-latent world model for long-horizon planning
  6. 2026Anisotropic Representations Improve Planning in JEPA World Models
  7. 2026Order-Consistent Latent Geometry for Reliable Short-Horizon Planning in World Models
  8. 2026Beyond One-Step Accuracy: State-Affine Latent Transition for Reliable Visual Planning