mlsanityData to 14 Oct 2026

Reasoning or Rambling? Exploring the Effect of Thinking on Agent Persuasion

arXiv 2509.21054 ↗First posted 25 Sep 2025cs.AI cs.CLcited by 4

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Understanding persuasion is critical for the safety and reliability of multi-agent systems built on large language models (LLMs). This paper studies persuasion dynamics by contrasting general LLMs with Large Reasoning Models (LRMs) that employ explicit ``thinking'' processes. Through large-scale experiments on objective (MMLU) and subjective (PersuasionBench and Perspectrum) tasks, we identify Persuasion Duality: reasoning enhances an agent's persuasive power while simultaneously increasing its resistance to persuasion. For LRMs, adding thinking content increases persuasion rates by 21 pp on average, yet reduces susceptibility to incorrect persuasion by up to 10 pp on objective tasks. Despite these gains, we uncover a critical vulnerability: persuasiveness often stems from superficial cues such as response length and repetition rather than logical validity. Non-semantic padding or repeated conclusions can match or exceed the persuasive effect of coherent reasoning, revealing a strong length bias in agents' judgments. We further show that persuasion propagates non-linearly in multi-hop agent chains, where intermediate agents may amplify or attenuate influence depending on task subjectivity. Finally, guided by attention analysis, we propose a prompt-level adversarial argument detection method that consistently improves agent robustness.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 12 of its 50 references that are in the map. First posted on arXiv 25 Sep 2025.

Builds on

12 of 50 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Exploring the Necessity of Reasoning in LLM-based Agent Scenarios14 Mar

Other references · 11

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
  4. 2025A Survey on Code Generation with LLM-based Agentscited by 106
  5. 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systemscited by 62
  6. 2024Can LLMs Produce Faithful Explanations For Fact-checking? Towards Faithful Explainable Fact-Checking via Multi-Agent Debatecited by 48
  7. 2025MASLab: A Unified and Comprehensive Codebase for LLM-based Multi-Agent Systemscited by 14
  8. 2025When Large Language Models are More PersuasiveThan Incentivized Humans, and Whycited by 13
  9. 2024Moral Persuasion in Large Language Models: Evaluating Susceptibility and Ethical Alignmentcited by 10
  10. 2024LLMs are Biased Evaluators But Not Biased for Retrieval Augmented Generationcited by 5
  11. 2025When Disagreements Elicit Robustness: Investigating Self-Repair Capabilities under LLM Multi-Agent Disagreementscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Persuasion Propagation: Does Persuasion Change AI Agent Behavior?
  2. 2026Not All Flips Are Conformity: Decomposing Stance Convergence in Multi-Agent LLM Debate
  3. 2025The Effect of Belief Boxes and Open-mindedness on Persuasion
  4. 2026Belief Cascades Drive Persuasion in LLM Agent Networks
  5. 2025Persuasiveness and Bias in LLM: Investigating the Impact of Persuasiveness and Reinforcement of Bias in Language Models
  6. 2026When Order Matters: First-Speaker Bias and Mitigation through Personality in Sequential Multi-Agent Debate
  7. 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
  8. 2026Under the Influence: Quantifying Persuasion and Vigilance in Large Language Models