Assertion-Conditioned Compliance: A Provenance-Aware Vulnerability in Multi-Turn Tool-Calling Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Multi-turn tool-calling LLMs (models capable of invoking external APIs or tools across several user turns) have emerged as a key feature in modern AI assistants, enabling extended dialogues from benign tasks to critical business, medical, and financial operations. Yet implementing multi-turn pipelines remains difficult for many safety-critical industries due to ongoing concerns regarding model resilience. While standardized benchmarks such as the Berkeley Function-Calling Leaderboard (BFCL) have underpinned confidence concerning advanced function-calling models (like Salesforce's xLAM V2), there is still a lack of visibility into multi-turn conversation-level robustness, especially given their exposure to real-world systems. In this paper, we introduce Assertion-Conditioned Compliance (A-CC), a novel evaluation paradigm for multi-turn function-calling dialogues. A-CC provides holistic metrics that evaluate a model's behavior when confronted with misleading assertions originating from two distinct vectors: (1) user-sourced assertions (USAs), which measure sycophancy toward plausible but misinformed user beliefs, and (2) function-sourced assertions (FSAs), which measure compliance with plausible but contradictory system policies (e.g., stale hints from unmaintained tools). Our results show that models are highly vulnerable to both USA sycophancy and FSA policy conflicts, confirming A-CC as a critical, latent vulnerability in deployed agents.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 12 of its 19 references that are in the map. First posted on arXiv 29 Nov 2025.
Builds on
12 of 19 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2024ToolACE: Winning the Points of LLM Function Callingcited by 204
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
- 2024ToolSword: Unveiling Safety Issues of Large Language Models in Tool Learning Across Three Stagescited by 77
- 2024What Are Tools Anyway? A Survey from the Language Model Perspectivecited by 53
- 2025TRUTH DECAY: Quantifying Multi-Turn Sycophancy in Language Modelscited by 31
- 2025On the Robustness of Agentic Function Callingcited by 17
- 2025Don't Just Fine-tune the Agent, Tune the Environmentcited by 17
- 2024Enhancing Function-Calling Capabilities in LLMs: Strategies for Prompt Formats, Data Integration, and Multilingual Translationcited by 14
- 2025Unraveling Misinformation Propagation in LLM Reasoningcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents
- 2026MANTRA: Synthesizing SMT-Validated Compliance Benchmarks for Tool-Using LLM Agents
- 2026Operational Hallucination and Safety Drift in AI Agents
- 2026StabilityBench: Benchmarking Instability in LLMs
- 2026Mind the GAP: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents
- 2026The Silicon Mirror: Dynamic Behavioral Gating for Anti-Sycophancy in LLM Agents
- 2025When Refusals Fail: Unstable Safety Mechanisms in Long-Context LLM Agents
- 2025AgentChangeBench: A Multi-Dimensional Evaluation Framework for Goal-Shift Robustness in Conversational AI