Detecting Conversational Mental Manipulation with Intent-Aware Prompting
Not on the map. Why?
Abstract (arXiv)
Mental manipulation severely undermines mental wellness by covertly and negatively distorting decision-making. While there is an increasing interest in mental health care within the natural language processing community, progress in tackling manipulation remains limited due to the complexity of detecting subtle, covert tactics in conversations. In this paper, we propose Intent-Aware Prompting (IAP), a novel approach for detecting mental manipulations using large language models (LLMs), providing a deeper understanding of manipulative tactics by capturing the underlying intents of participants. Experimental results on the MentalManip dataset demonstrate superior effectiveness of IAP against other advanced prompting strategies. Notably, our approach substantially reduces false negatives, helping detect more instances of mental manipulation with minimal misjudgment of positive cases. The code of this paper is available.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 11 Dec 2024.
Builds on
13 of 27 references.
References · 13
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Boosting Theory-of-Mind Performance in Large Language Models via Promptingcited by 64
- 2024Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theorycited by 60
- 2024CBT-LLM: A Chinese Large Language Model for Cognitive Behavioral Therapy-based Mental Health Question Answeringcited by 45
- 2023When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Taskscited by 37
- 2023Empowering Psychotherapy with Large Language Models: Cognitive Distortion Detection through Diagnosis of Thought Promptingcited by 31
- 2021Defining and Detecting Toxicity on Social Media: Context and Knowledge are Keycited by 29
- 2024MentalManip: A Dataset For Fine-grained Analysis of Mental Manipulation in Conversationscited by 21
- 2024Document-level Causal Relation Extraction with Knowledge-guided Binary Question Answeringcited by 12
- 2024Enhanced Detection of Conversational Mental Manipulation Through Advanced Prompting Techniquescited by 7
- 2024Multi-Session Client-Centered Treatment Outcome Evaluation in Psychotherapycited by 5
1 more
Built on by
Citing papers per year: 2025: 11; 2026: 5.
16 papers.
Sort:
By area:
- 2025A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directionscited by 12
- 2025Lost in Pronunciation: Detecting Chinese Offensive Language Disguised by Phonetic Cloaking Replacementcited by 10
- 2025You Never Know a Person, You Only Know Their Defenses: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversationscited by 7
- 2025Who's Laughing Now? An Overview of Computational Humour Generation and Explanationcited by 5
- 2025ChatbotManip: A Dataset to Facilitate Evaluation and Oversight of Manipulative Chatbot Behaviourcited by 4
- 2025Exploring the Vulnerability of the Content Moderation Guardrail in Large Language Models via Intent Manipulationcited by 3
- 2026Overview of the PsyDefDetect Shared Task at BioNLP 2026: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversationscited by 3
- 2025Boosting Large Language Models for Mental Manipulation Detection via Data Augmentation and Distillationcited by 2
- 2025SELF-PERCEPT: Introspection Improves Large Language Models' Detection of Multi-Person Mental Manipulation in Conversationscited by 2
- 2025Detecting Malicious AI Agents Through Simulated Interactionscited by 1
- 2025CLAIM: An Intent-Driven Multi-Agent Framework for Analyzing Manipulation in Courtroom Dialoguescited by 1
- 2026Detecting Mental Manipulation in Speech via Synthetic Multi-Speaker Dialoguecited by 1
4 more
- 2025Explainable Detection of Implicit Influential Patterns in Conversations via Data Augmentationcited by 0
- 2026AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safetycited by 0
- 2026SDARE-Bench: Evaluating Large Language Models on Conversational Stigma Detection and Response in Dyadic and Group Dialoguecited by 0
- 2026Steering the Compass: Aligning Dynamic Psychological Counseling Conversations with Cognitive Behavioral Therapy Strategiescited by 0
- 2026Steering the Compass: Aligning Dynamic Psychological Counseling Conversations with Cognitive Behavioral Therapy Strategies17 Sep 2026
- 2026SDARE-Bench: Evaluating Large Language Models on Conversational Stigma Detection and Response in Dyadic and Group Dialogue1 Sep 2026
- 2026AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safety3 Jun 2026
- 2026Overview of the PsyDefDetect Shared Task at BioNLP 2026: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations24 May 2026
- 2026Detecting Mental Manipulation in Speech via Synthetic Multi-Speaker Dialogue13 Jan 2026
- 2025You Never Know a Person, You Only Know Their Defenses: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations17 Dec 2025
- 2025Who's Laughing Now? An Overview of Computational Humour Generation and Explanation25 Sep 2025
- 2025Lost in Pronunciation: Detecting Chinese Offensive Language Disguised by Phonetic Cloaking Replacement10 Jul 2025
- 2025Explainable Detection of Implicit Influential Patterns in Conversations via Data Augmentation17 Jun 2025
- 2025ChatbotManip: A Dataset to Facilitate Evaluation and Oversight of Manipulative Chatbot Behaviour11 Jun 2025
- 2025CLAIM: An Intent-Driven Multi-Agent Framework for Analyzing Manipulation in Courtroom Dialogues4 Jun 2025
- 2025SELF-PERCEPT: Introspection Improves Large Language Models' Detection of Multi-Person Mental Manipulation in Conversations27 May 2025
4 more
- 2025Exploring the Vulnerability of the Content Moderation Guardrail in Large Language Models via Intent Manipulation24 May 2025
- 2025Boosting Large Language Models for Mental Manipulation Detection via Data Augmentation and Distillation21 May 2025
- 2025Detecting Malicious AI Agents Through Simulated Interactions31 Mar 2025
- 2025A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directions16 Feb 2025
- 2025Detecting Malicious AI Agents Through Simulated Interactions31 Mar 2025
- 2025A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directionscited by 12
- 2025Lost in Pronunciation: Detecting Chinese Offensive Language Disguised by Phonetic Cloaking Replacementcited by 10
- 2025You Never Know a Person, You Only Know Their Defenses: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversationscited by 7
- 2025Who's Laughing Now? An Overview of Computational Humour Generation and Explanationcited by 5
- 2025ChatbotManip: A Dataset to Facilitate Evaluation and Oversight of Manipulative Chatbot Behaviourcited by 4
- 2026Overview of the PsyDefDetect Shared Task at BioNLP 2026: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversationscited by 3
- 2025Boosting Large Language Models for Mental Manipulation Detection via Data Augmentation and Distillationcited by 2
- 2025SELF-PERCEPT: Introspection Improves Large Language Models' Detection of Multi-Person Mental Manipulation in Conversationscited by 2
- 2025CLAIM: An Intent-Driven Multi-Agent Framework for Analyzing Manipulation in Courtroom Dialoguescited by 1
- 2026Detecting Mental Manipulation in Speech via Synthetic Multi-Speaker Dialoguecited by 1
- 2025Explainable Detection of Implicit Influential Patterns in Conversations via Data Augmentationcited by 0
- 2026AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safetycited by 0
12 most cited of 14 All 14 (JSON)
- 2026Steering the Compass: Aligning Dynamic Psychological Counseling Conversations with Cognitive Behavioral Therapy Strategies17 Sep 2026
- 2026SDARE-Bench: Evaluating Large Language Models on Conversational Stigma Detection and Response in Dyadic and Group Dialogue1 Sep 2026
- 2026AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safety3 Jun 2026
- 2026Overview of the PsyDefDetect Shared Task at BioNLP 2026: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations24 May 2026
- 2026Detecting Mental Manipulation in Speech via Synthetic Multi-Speaker Dialogue13 Jan 2026
- 2025You Never Know a Person, You Only Know Their Defenses: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations17 Dec 2025
- 2025Who's Laughing Now? An Overview of Computational Humour Generation and Explanation25 Sep 2025
- 2025Lost in Pronunciation: Detecting Chinese Offensive Language Disguised by Phonetic Cloaking Replacement10 Jul 2025
- 2025Explainable Detection of Implicit Influential Patterns in Conversations via Data Augmentation17 Jun 2025
- 2025ChatbotManip: A Dataset to Facilitate Evaluation and Oversight of Manipulative Chatbot Behaviour11 Jun 2025
- 2025CLAIM: An Intent-Driven Multi-Agent Framework for Analyzing Manipulation in Courtroom Dialogues4 Jun 2025
- 2025SELF-PERCEPT: Introspection Improves Large Language Models' Detection of Multi-Person Mental Manipulation in Conversations27 May 2025
12 newest of 14 All 14 (JSON)