mlsanityData to 7 Oct 2026

Seeing is Believing? Evaluating Vision-Language Model Susceptibility in Agent-to-Agent Multimodal Persuasion

arXiv 2510.22768 ↗First posted 26 Oct 2025cs.CLcited by 1

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

also in 1 more
Abstract (arXiv)

As autonomous agents increasingly interact, they inevitably attempt to influence one another. While prior work in text-only settings has explored the dynamics of Agent-to-Agent (A2A) persuasion, the rise of Vision-Language Models (VLMs) introduces a more complex challenge: multimodal content conveys richer information while integrating subtle, hard-to-detect persuasive cues. To study this vulnerability, we present MMPersuade, a unified framework and dataset for A2A multimodal persuasion. We model interactions between a persuader agent, which leverages images and psychological strategies, and a persuadee VLM. Our benchmark spans commercial, subjective and behavioral, and adversarial contexts, and evaluates persuasion via function-calling that capture behavioral shifts beyond verbal responses. Experiments on six VLMs reveal three findings: (1) multimodal inputs consistently outperform text-only persuasion, with raw visual signals uniquely increasing susceptibility in adversarial settings by bypassing text-activated safety defenses; (2) persuadee vulnerability is highly domain- and format-dependent, with realistic and community-style formats driving susceptibility in commercial settings while different formats dominate in adversarial ones; and (3) psychological strategy efficacy varies with context and model architecture, as more capable models resist benign persuasion yet become more susceptible under adversarial multimodal inputs. Our framework provides a foundation for building more robust and aligned VLMs in multi-agent environments.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 35 references that are in the map. First posted on arXiv 26 Oct 2025.

Builds on

13 of 35 references.

References · 13

  1. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  2. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
  3. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 533
  4. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 177
  5. 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 107
  6. 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 105
  7. 2025A Survey of AI Agent Protocolscited by 77
  8. 2017Automatic Understanding of Image and Video Advertisementscited by 67
  9. 2024Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Languagecited by 31
  10. 2022MetaCLUE: Towards Comprehensive Visual Metaphors Researchcited by 28
  11. 2025Persuade Me if You Can: A Framework for Evaluating Persuasion Effectiveness and Susceptibility Among Large Language Modelscited by 25
  12. 2025LLM Can be a Dangerous Persuader: Empirical Study of Persuasion Safety in Large Language Modelscited by 21
1 more
  1. 2024Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understandingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evaluating VLMs on Multimodal Aristotelian Persuasion Tasks
  2. 2026Learning to Persuade Exposes How Easily LLMs Abandon Correct Beliefs
  3. 2025Debate with Images: Detecting Deceptive Behaviors in Multimodal Large Language Models
  4. 2026Can MLLMs Reason About Visual Persuasion? Evaluating the Efficacy and Faithfulness of Reasoning
  5. 2025When Alignment Fails: Multimodal Adversarial Attacks on Vision-Language-Action Models
  6. 2026Multimodal Evaluator Preference Collapse: Cross-Modal Coupling in Self-Evolving Agents
  7. 2026Visual Persuasion: What Influences Decisions of Vision-Language Models?
  8. 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications