Natural Language Edge Labelling: Decoupling Intent from Execution in Structured LM Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Controllers for structured LM reasoning (e.g., Chain-of-Thought, self-consistency, and Tree-of-Thoughts) often entangle what to try next with how to execute it, exposing only coarse global knobs and yielding brittle, compute-inefficient, and hard-to-audit behavior. We introduce Natural Language Edge Labelling (NLEL), a labeller-tuner overlay that attaches a free-form natural-language directive to each search edge and translates it into a schema-bounded control vector for decoding, search (branch quotas, exploration β), generation bundle size, retrieval mixtures, and verification passes. A labeller Lambda emits labels from the parent state and a compact context; a tuner Psi maps (P, L, C)→ Pi, with strict schema validation and trust-region projection around safe defaults. Downstream selection remains ToT-style with score S=μ+βσ and depth-annealed β. We show NLEL strictly generalizes CoT/ToT, prove an anytime-monotonicity property for top-k selection under label-conditioned bundles, and bound selector shortfall by control-vector distortion, providing decision-relevant justification for guards like trust regions and verification passes. We instantiate Psi as a prompt-only JSON Parameter Emitter and preregister an evaluation on GSM8K, MATH (subset), StrategyQA, and ARC-Challenge with compute-aware reporting (success@compute, tokens-per-success) and ablations over Lambda, Psi, trust-region radius, and control quantization; preregistered forecasts anticipate accuracy gains at comparable token budgets and improved success@compute under constraints. NLEL offers an interpretable, model-agnostic interface that separates intent from execution for controllable, auditable LM inference.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 10 of its 13 references that are in the map. First posted on arXiv 6 Oct 2025.
Builds on
10 of 13 references.
Closest ancestors · 1
Same direction, newest first
Other references · 9
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training
- 2026BLADE: Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning
- 2024Reliable Reasoning Beyond Natural Language
- 2026Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models
- 2026Process Supervision via Verbal Critique Improves Reasoning in Large Language Models
- 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphs
- 2026A Systematic Study of Small Language Models on Abstract Reasoning Tasks
- 2025Finding the Minimal Parameter Budget for Implicit Reasoning: A Data Complexity Driven Scaling Law for Language Models