Seeing is Believing? Evaluating Vision-Language Model Susceptibility in Agent-to-Agent Multimodal Persuasion
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
also in 1 more
Abstract (arXiv)
As autonomous agents increasingly interact, they inevitably attempt to influence one another. While prior work in text-only settings has explored the dynamics of Agent-to-Agent (A2A) persuasion, the rise of Vision-Language Models (VLMs) introduces a more complex challenge: multimodal content conveys richer information while integrating subtle, hard-to-detect persuasive cues. To study this vulnerability, we present MMPersuade, a unified framework and dataset for A2A multimodal persuasion. We model interactions between a persuader agent, which leverages images and psychological strategies, and a persuadee VLM. Our benchmark spans commercial, subjective and behavioral, and adversarial contexts, and evaluates persuasion via function-calling that capture behavioral shifts beyond verbal responses. Experiments on six VLMs reveal three findings: (1) multimodal inputs consistently outperform text-only persuasion, with raw visual signals uniquely increasing susceptibility in adversarial settings by bypassing text-activated safety defenses; (2) persuadee vulnerability is highly domain- and format-dependent, with realistic and community-style formats driving susceptibility in commercial settings while different formats dominate in adversarial ones; and (3) psychological strategy efficacy varies with context and model architecture, as more capable models resist benign persuasion yet become more susceptible under adversarial multimodal inputs. Our framework provides a foundation for building more robust and aligned VLMs in multi-agent environments.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 35 references that are in the map. First posted on arXiv 26 Oct 2025.
Builds on
13 of 35 references.
References · 13
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 533
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 177
- 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 107
- 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 105
- 2025A Survey of AI Agent Protocolscited by 77
- 2017Automatic Understanding of Image and Video Advertisementscited by 67
- 2024Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Languagecited by 31
- 2022MetaCLUE: Towards Comprehensive Visual Metaphors Researchcited by 28
- 2025Persuade Me if You Can: A Framework for Evaluating Persuasion Effectiveness and Susceptibility Among Large Language Modelscited by 25
- 2025LLM Can be a Dangerous Persuader: Empirical Study of Persuasion Safety in Large Language Modelscited by 21
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating VLMs on Multimodal Aristotelian Persuasion Tasks
- 2026Learning to Persuade Exposes How Easily LLMs Abandon Correct Beliefs
- 2025Debate with Images: Detecting Deceptive Behaviors in Multimodal Large Language Models
- 2026Can MLLMs Reason About Visual Persuasion? Evaluating the Efficacy and Faithfulness of Reasoning
- 2025When Alignment Fails: Multimodal Adversarial Attacks on Vision-Language-Action Models
- 2026Multimodal Evaluator Preference Collapse: Cross-Modal Coupling in Self-Evolving Agents
- 2026Visual Persuasion: What Influences Decisions of Vision-Language Models?
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications