CogManip: Benchmarking Manipulative Behavior in Multi-Turn Interactions with Large Language Model
Not on the map. Why?
Abstract (arXiv)
Whether Large Language Models (LLMs) exhibit covert psychological manipulation in complex human-AI interactions has garnered increasing safety concerns. However, existing AI safety benchmarks remain largely restricted to explicit rule compliance and static prompts, failing to capture the dynamic and covert nature of manipulative strategies in multi-turn dialogues. We introduce CogManip, a comprehensive benchmark that evaluates 15 manipulation strategy risks across 1,000 multi-turn interaction scenarios, validated by human experts. A systematic evaluation of 13 representative models, including frontier models like GPT-5.4 and DeepSeek-V3.2, reveals significant risk heterogeneities and illuminates the targeted direction for future defense. Further analysis of objective function perturbation reveals that DeepSeek-V3.2's manipulation tactics are highly sensitive to both negative and benign system prompts, demonstrating the critical necessity of prompt-based defense engineering and implicit goal auditing. CogManip offers a robust instrument and perspective for auditing the implicit psychological influence and dynamic strategy selection of modern LLMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 40 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
10 of 40 references.
References · 10
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2025It's the Thought that Counts: Evaluating the Attempts of Frontier LLMs to Persuade on Harmful Topicscited by 14
- 2025Quantifying Cognitive Bias Induction in LLM-Generated Contentcited by 7
- 2026Measuring Progress Toward AGI: A Cognitive Frameworkcited by 6
- 2024Can a large language model be a gaslighter?cited by 5
- 2025ChatbotManip: A Dataset to Facilitate Evaluation and Oversight of Manipulative Chatbot Behaviourcited by 4
- 2025DarkPatterns-LLM: A Multi-Layer Benchmark for Detecting Manipulative and Harmful AI Behaviorcited by 1
Built on by
Not cited yet.