mlsanityData to 7 Oct 2026

Natural Language Edge Labelling: Decoupling Intent from Execution in Structured LM Reasoning

arXiv 2510.04817 ↗First posted 6 Oct 2025cs.AIcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Controllers for structured LM reasoning (e.g., Chain-of-Thought, self-consistency, and Tree-of-Thoughts) often entangle what to try next with how to execute it, exposing only coarse global knobs and yielding brittle, compute-inefficient, and hard-to-audit behavior. We introduce Natural Language Edge Labelling (NLEL), a labeller-tuner overlay that attaches a free-form natural-language directive to each search edge and translates it into a schema-bounded control vector for decoding, search (branch quotas, exploration β), generation bundle size, retrieval mixtures, and verification passes. A labeller Lambda emits labels from the parent state and a compact context; a tuner Psi maps (P, L, C)→ Pi, with strict schema validation and trust-region projection around safe defaults. Downstream selection remains ToT-style with score S=μ+βσ and depth-annealed β. We show NLEL strictly generalizes CoT/ToT, prove an anytime-monotonicity property for top-k selection under label-conditioned bundles, and bound selector shortfall by control-vector distortion, providing decision-relevant justification for guards like trust regions and verification passes. We instantiate Psi as a prompt-only JSON Parameter Emitter and preregister an evaluation on GSM8K, MATH (subset), StrategyQA, and ARC-Challenge with compute-aware reporting (success@compute, tokens-per-success) and ablations over Lambda, Psi, trust-region radius, and control quantization; preregistered forecasts anticipate accuracy gains at comparable token budgets and improved success@compute under constraints. NLEL offers an interpretable, model-agnostic interface that separates intent from execution for controllable, auditable LM inference.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 10 of its 13 references that are in the map. First posted on arXiv 6 Oct 2025.

Builds on

10 of 13 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May

Other references · 9

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  7. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  8. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  9. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training
  2. 2026BLADE: Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning
  3. 2024Reliable Reasoning Beyond Natural Language
  4. 2026Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models
  5. 2026Process Supervision via Verbal Critique Improves Reasoning in Large Language Models
  6. 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphs
  7. 2026A Systematic Study of Small Language Models on Abstract Reasoning Tasks
  8. 2025Finding the Minimal Parameter Budget for Implicit Reasoning: A Data Complexity Driven Scaling Law for Language Models