Geometry of Divergence: Tracking Hidden-State Trajectories for Adaptive Multi-Turn Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
also in 1 more
Abstract (arXiv)
LLM agents need to sustain goal-consistent reasoning across long multi-turn interactions under strict resource constraints. However, as the multi-turn context accumulates, it can destabilize the underlying LLM's internal representation of task-relevant information from earlier turns, blurring the boundary between constructive reasoning and representation drift. We formulate multi-turn reasoning as a hidden-state trajectory of the underlying LLM that is characterized via two complementary signals: temporal curvature that captures the directional consistency of turn-to-turn updates, and variance slope which measures the expansion or contraction of the exploration space. Across four tasks and three underlying LLMs, we observed that these geometric signals distinguish between correct and incorrect episodes prior to completion. We further decompose each episode into three-action chains formed from four actions (Read, Write, Respond, Transfer) and show that separability is action-dependent, with different signals distinguishing various chain patterns. Our experiments demonstrate that trajectory geometry can identify critical turns in the reasoning process, increasing task success rates on τ-Bench from 24.1% to 39.6% while reducing token cost by 11.2%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 15 of its 29 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
15 of 29 references.
Closest ancestors · 4
Same direction, newest first
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
- 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks12 Feb
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2022Language Models (Mostly) Know What They Know11 Jul
Other references · 11
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2024Do LLMs Know about Hallucination? An Empirical Investigation of LLM's Hidden Statescited by 52
- 2026When Attention Closes: How LLMs Lose the Thread in Multi-Turn Interactioncited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Scalars: Evaluating and Understanding LLM Reasoning via Geometric Progress and Stability
- 2026When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation
- 2026Directional Reasoning Trajectory Change (DRTC): Identifying Critical Trace Segments in Reasoning Models
- 2026How Far Ahead Do LLMs Plan? Uncovering the Latent Horizon in Chain-of-Thought Reasoning
- 2026LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signals
- 2026Not All Turns Are Equally Hard: Adaptive Thinking Budgets For Efficient Multi-Turn Reasoning in Agents
- 2026Reasoning Models Don't Just Think Longer, They Move Differently
- 2026GRUET: Quantifying Uncertainty of Agentic Reasoning-and-Acting Processes