mlsanityData to 14 Oct 2026

Towards Trustworthy Multi-Turn LLM Agents via Behavioral Guidance

arXiv 2512.11421 ↗First posted 12 Dec 2025cs.AIcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Large Language Models demonstrate strong reasoning and generation abilities, yet their behavior in multi-turn tasks often lacks reliability and verifiability. We present a task completion framework that enables LLM-based agents to act under explicit behavioral guidance in environments described by reinforcement learning formalisms with defined observation, action, and reward signals. The framework integrates three components: a lightweight task profiler that selects reasoning and generation strategies, a reasoning module that learns verifiable observation - action mappings, and a generation module that enforces constraint-compliant outputs through validation or deterministic synthesis. We show that as the agent interacts with the environment, these components co-evolve, yielding trustworthy behavior.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 6 of its 24 references that are in the map. First posted on arXiv 12 Dec 2025.

Builds on

6 of 24 references.

References · 6

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  6. 2025Grammars of Formal Uncertainty: When to Trust LLMs in Automated Reasoning Taskscited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Task Solving to Robust Real-World Adaptation in LLM Agents
  2. 2025Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation
  3. 2025Guiding Exploration in Reinforcement Learning Through LLM-Augmented Observations
  4. 2026Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing
  5. 2026Toward Scalable Verifiable Reward: Proxy State-Based Evaluation for Multi-turn Tool-Calling LLM Agents
  6. 2025Thinking by Doing: Building Efficient World Model Reasoning in LLMs via Multi-turn Interaction
  7. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learning
  8. 2026AgentAbstain: Do LLM Agents Know When Not to Act?