When to Re-Plan: Subgoal Persistence in Hierarchical Latent Reasoning
Not on the map. Why?
Abstract (arXiv)
Long-horizon reasoning requires a system to commit to medium-horizon intent without becoming rigid: re-plan too often and computation never coheres into multi-step structure; commit too long and the plan goes stale. We study this stability-adaptivity tradeoff in the latent reasoning setting, where multi-step computation occurs inside hidden state rather than externalized token traces. We extend the Hierarchical Reasoning Model (HRM) with a feudal-style manager-worker interface: a slow high-level module periodically emits a normalized directional subgoal that persists for P low-level steps, biasing the worker's hidden-state updates and supplying an intrinsic cosine alignment loss. On ARC and ConceptARC, we find that subgoal persistence -- not subgoal injection alone -- is the central knob: moderate periods P in [3, 6] consistently outperform both very frequent (P=1) and very long horizons, with a clear minimum LM loss at P=3 (1.544 vs. 1.674 at P=1, 1.640 baseline; replicated over 5 seeds at mean 1.595, std 0.045). The intrinsic alignment weight lambda shows a complementary narrow optimum (lambda approximately 0.05). A controlled ablation at past-sweet-spot lambda isolates learned directional structure -- not architectural capacity or auxiliary loss alone -- as the source of interference when the alignment signal exceeds its optimum. Together these findings implicate a design principle for compositional planning in latent reasoning systems: medium-horizon intent must be coherent across enough computational steps for compositional structure to form.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 5 of its 9 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
5 of 9 references.
References · 5
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 337
- 2025Hierarchical Reasoning Modelcited by 177
- 2023The ConceptARC Benchmark: Evaluating Understanding and Generalization in the ARC Domaincited by 101
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Loop the Loopies!cited by 8
- 2026Loop the Loopies!17 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025On the Failure of Latent State Persistence in Large Language Models
- 2026Why Limit the Residual Stream to Layers and Not Tokens? Persistent Memory for Continuous Latent Reasoning
- 2026Final Checkpoints Are Not Enough: Analyzing Latent Reasoning Faithfulness Along Training Trajectories
- 2026LLM Reasoning Is Latent, Not the Chain of Thought
- 2026The Ignition Is Real, and It Lives at the Readout: Latent composition, difficulty-clocked ignition, and the interface-constituted commit in a recurrent-depth reasoner
- 2026LatentHarness: Learning Latent Actions for Memory and Reasoning via Counterfactual Policy Distillation
- 2026Intrinsic Stability Limits of Autoregressive Reasoning: Structural Consequences for Long-Horizon Execution
- 2026How Far Ahead Do LLMs Plan? Uncovering the Latent Horizon in Chain-of-Thought Reasoning