mlsanityData to 14 Oct 2026

When to Re-Plan: Subgoal Persistence in Hierarchical Latent Reasoning

arXiv 2606.03741 ↗First posted 2 Jun 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Long-horizon reasoning requires a system to commit to medium-horizon intent without becoming rigid: re-plan too often and computation never coheres into multi-step structure; commit too long and the plan goes stale. We study this stability-adaptivity tradeoff in the latent reasoning setting, where multi-step computation occurs inside hidden state rather than externalized token traces. We extend the Hierarchical Reasoning Model (HRM) with a feudal-style manager-worker interface: a slow high-level module periodically emits a normalized directional subgoal that persists for P low-level steps, biasing the worker's hidden-state updates and supplying an intrinsic cosine alignment loss. On ARC and ConceptARC, we find that subgoal persistence -- not subgoal injection alone -- is the central knob: moderate periods P in [3, 6] consistently outperform both very frequent (P=1) and very long horizons, with a clear minimum LM loss at P=3 (1.544 vs. 1.674 at P=1, 1.640 baseline; replicated over 5 seeds at mean 1.595, std 0.045). The intrinsic alignment weight lambda shows a complementary narrow optimum (lambda approximately 0.05). A controlled ablation at past-sweet-spot lambda isolates learned directional structure -- not architectural capacity or auxiliary loss alone -- as the source of interference when the alignment signal exceeds its optimum. Together these findings implicate a design principle for compositional planning in latent reasoning systems: medium-horizon intent must be coherent across enough computational steps for compositional structure to form.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 5 of its 9 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

5 of 9 references.

References · 5

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
  3. 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 337
  4. 2025Hierarchical Reasoning Modelcited by 177
  5. 2023The ConceptARC Benchmark: Evaluating Understanding and Generalization in the ARC Domaincited by 101

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Loop the Loopies!cited by 8

Similar, not cited

Close in wording, no citation either way

  1. 2025On the Failure of Latent State Persistence in Large Language Models
  2. 2026Why Limit the Residual Stream to Layers and Not Tokens? Persistent Memory for Continuous Latent Reasoning
  3. 2026Final Checkpoints Are Not Enough: Analyzing Latent Reasoning Faithfulness Along Training Trajectories
  4. 2026LLM Reasoning Is Latent, Not the Chain of Thought
  5. 2026The Ignition Is Real, and It Lives at the Readout: Latent composition, difficulty-clocked ignition, and the interface-constituted commit in a recurrent-depth reasoner
  6. 2026LatentHarness: Learning Latent Actions for Memory and Reasoning via Counterfactual Policy Distillation
  7. 2026Intrinsic Stability Limits of Autoregressive Reasoning: Structural Consequences for Long-Horizon Execution
  8. 2026How Far Ahead Do LLMs Plan? Uncovering the Latent Horizon in Chain-of-Thought Reasoning