Empowering Psychotherapy with Large Language Models: Cognitive Distortion Detection through Diagnosis of Thought Prompting
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Mental illness remains one of the most critical public health issues of our time, due to the severe scarcity and accessibility limit of professionals. Psychotherapy requires high-level expertise to conduct deep, complex reasoning and analysis on the cognition modeling of the patients. In the era of Large Language Models, we believe it is the right time to develop AI assistance for computational psychotherapy. We study the task of cognitive distortion detection and propose the Diagnosis of Thought (DoT) prompting. DoT performs diagnosis on the patient's speech via three stages: subjectivity assessment to separate the facts and the thoughts; contrastive reasoning to elicit the reasoning processes supporting and contradicting the thoughts; and schema analysis to summarize the cognition schemas. The generated diagnosis rationales through the three stages are essential for assisting the professionals. Experiments demonstrate that DoT obtains significant improvements over ChatGPT for cognitive distortion detection, while generating high-quality rationales approved by human experts.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 14 of its 37 references that are in the map. First posted on arXiv 11 Oct 2023.
Builds on
14 of 37 references.
Closest ancestors · 1
Same direction, newest first
Other references · 13
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2020A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Supportcited by 182
- 2023Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Modelscited by 163
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 161
- 2022Large Language Models are few(1)-shot Table Reasonerscited by 116
- 2018SMHD: A Large-Scale Resource for Exploring Online Language Usage for Multiple Mental Health Conditionscited by 73
- 2019Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codescited by 25
- 2023Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedbackcited by 23
- 2018RSDD-Time: Temporal Annotation of Self-Reported Mental Health Diagnosescited by 9
Built on by
Citing papers per year: 2024: 14; 2025: 13; 2026: 4.
31 papers.
Sort:
By area:
- 2024HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapycited by 47
- 2024Large Language Models in Mental Health Care: a Scoping Reviewcited by 34
- 2024PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agentscited by 28
- 2024Data-Centric Foundation Models in Computational Healthcare: A Surveycited by 27
- 2024PATIENT-Psi: Using Large Language Models to Simulate Patients for Training Mental Health Professionalscited by 21
- 2024Chain-of-Interaction: Enhancing Large Language Models for Psychiatric Behavior Understanding by Dyadic Contextscited by 19
- 2024Detecting Conversational Mental Manipulation with Intent-Aware Promptingcited by 16
- 2025MAGI: Multi-Agent Guided Interview for Psychiatric Assessmentcited by 14
- 2024CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapycited by 12
- 2025A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directionscited by 12
- 2024Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysiscited by 10
- 2025Preference Learning Unlocks LLMs' Psycho-Counseling Skillscited by 10
19 more
- 2024Socratic Reasoning Improves Positive Text Rewritingcited by 9
- 2024Can LLMs Correct Physicians, Yet? Investigating Effective Interaction Methods in the Medical Domaincited by 7
- 2025The Pursuit of Empathy: Evaluating Small Language Models for PTSD Dialogue Supportcited by 6
- 2025KoACD: The First Korean Adolescent Dataset for Cognitive Distortion Analysis via Role-Switching Multi-LLM Negotiationcited by 4
- 2025Exploratory Study into Relations between Cognitive Distortions and Emotional Appraisalscited by 3
- 2025A Survey of Cognitive Distortion Detection and Classification in NLPcited by 3
- 2024Enhancing Depression-Diagnosis-Oriented Chat with Psychological State Trackingcited by 2
- 2024A Generic Review of Integrating Artificial Intelligence in Cognitive Behavioral Therapycited by 2
- 2025Does "Reasoning" with Large Language Models Improve Recognizing, Generating, and Reframing Unhelpful Thoughts?cited by 2
- 2026Responsible Evaluation of AI for Mental Healthcited by 2
- 2025Multi-View Attention Multiple-Instance Learning Enhanced by LLM Reasoning for Cognitive Distortion Detectioncited by 1
- 2025Towards Consistent Detection of Cognitive Distortions: LLM-Based Annotation and Dataset-Agnostic Evaluationcited by 1
- 2024IoT-Based Preventive Mental Health Using Knowledge Graphs and Standards for Better Well-Beingcited by 0
- 2025CALLM: Understanding Cancer Survivors' Emotions and Intervention Opportunities via Mobile Diaries and Context-Aware Language Modelscited by 0
- 2025When LLM Therapists Become Salespeople: Evaluating Large Language Models for Ethical Motivational Interviewingcited by 0
- 2025Signs of Struggle: Spotting Cognitive Distortions across Language and Registercited by 0
- 2026Assessing the Effectiveness of LLMs in Delivering Cognitive Behavioral Therapycited by 0
- 2026Exploring Profiles of Cognitive Distortions Associated with Mental Health Disorderscited by 0
- 2026Multi-Perspective Triad Interaction Graph Neural Network for Cognitive Distortion Detectioncited by 0
- 2026Multi-Perspective Triad Interaction Graph Neural Network for Cognitive Distortion Detection7 Aug 2026
- 2026Exploring Profiles of Cognitive Distortions Associated with Mental Health Disorders24 May 2026
- 2026Assessing the Effectiveness of LLMs in Delivering Cognitive Behavioral Therapy4 Mar 2026
- 2026Responsible Evaluation of AI for Mental Health20 Jan 2026
- 2025Towards Consistent Detection of Cognitive Distortions: LLM-Based Annotation and Dataset-Agnostic Evaluation3 Nov 2025
- 2025Multi-View Attention Multiple-Instance Learning Enhanced by LLM Reasoning for Cognitive Distortion Detection22 Sep 2025
- 2025Signs of Struggle: Spotting Cognitive Distortions across Language and Register28 Aug 2025
- 2025A Survey of Cognitive Distortion Detection and Classification in NLP13 Aug 2025
- 2025The Pursuit of Empathy: Evaluating Small Language Models for PTSD Dialogue Support21 May 2025
- 2025KoACD: The First Korean Adolescent Dataset for Cognitive Distortion Analysis via Role-Switching Multi-LLM Negotiation1 May 2025
- 2025MAGI: Multi-Agent Guided Interview for Psychiatric Assessment25 Apr 2025
- 2025Does "Reasoning" with Large Language Models Improve Recognizing, Generating, and Reframing Unhelpful Thoughts?31 Mar 2025
19 more
- 2025When LLM Therapists Become Salespeople: Evaluating Large Language Models for Ethical Motivational Interviewing30 Mar 2025
- 2025Exploratory Study into Relations between Cognitive Distortions and Emotional Appraisals20 Mar 2025
- 2025CALLM: Understanding Cancer Survivors' Emotions and Intervention Opportunities via Mobile Diaries and Context-Aware Language Models12 Mar 2025
- 2025Preference Learning Unlocks LLMs' Psycho-Counseling Skills27 Feb 2025
- 2025A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directions16 Feb 2025
- 2024Detecting Conversational Mental Manipulation with Intent-Aware Prompting11 Dec 2024
- 2024CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapy17 Oct 2024
- 2024A Generic Review of Integrating Artificial Intelligence in Cognitive Behavioral Therapy28 Jul 2024
- 2024IoT-Based Preventive Mental Health Using Knowledge Graphs and Standards for Better Well-Being19 Jun 2024
- 2024PATIENT-Psi: Using Large Language Models to Simulate Patients for Training Mental Health Professionals30 May 2024
- 2024Can LLMs Correct Physicians, Yet? Investigating Effective Interaction Methods in the Medical Domain29 Mar 2024
- 2024Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysis24 Mar 2024
- 2024Chain-of-Interaction: Enhancing Large Language Models for Psychiatric Behavior Understanding by Dyadic Contexts20 Mar 2024
- 2024Enhancing Depression-Diagnosis-Oriented Chat with Psychological State Tracking12 Mar 2024
- 2024Socratic Reasoning Improves Positive Text Rewriting5 Mar 2024
- 2024HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapy26 Feb 2024
- 2024PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agents19 Feb 2024
- 2024Data-Centric Foundation Models in Computational Healthcare: A Survey4 Jan 2024
- 2024Large Language Models in Mental Health Care: a Scoping Review1 Jan 2024
- 2024Socratic Reasoning Improves Positive Text Rewritingcited by 9
- 2025Does "Reasoning" with Large Language Models Improve Recognizing, Generating, and Reframing Unhelpful Thoughts?cited by 2
- 2025Multi-View Attention Multiple-Instance Learning Enhanced by LLM Reasoning for Cognitive Distortion Detectioncited by 1
- 2025Multi-View Attention Multiple-Instance Learning Enhanced by LLM Reasoning for Cognitive Distortion Detection22 Sep 2025
- 2025Does "Reasoning" with Large Language Models Improve Recognizing, Generating, and Reframing Unhelpful Thoughts?31 Mar 2025
- 2024Socratic Reasoning Improves Positive Text Rewriting5 Mar 2024
- 2025Preference Learning Unlocks LLMs' Psycho-Counseling Skillscited by 10
- 2025Preference Learning Unlocks LLMs' Psycho-Counseling Skills27 Feb 2025
- 2024HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapycited by 47
- 2024Large Language Models in Mental Health Care: a Scoping Reviewcited by 34
- 2024PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agentscited by 28
- 2024Data-Centric Foundation Models in Computational Healthcare: A Surveycited by 27
- 2024PATIENT-Psi: Using Large Language Models to Simulate Patients for Training Mental Health Professionalscited by 21
- 2024Chain-of-Interaction: Enhancing Large Language Models for Psychiatric Behavior Understanding by Dyadic Contextscited by 19
- 2024Detecting Conversational Mental Manipulation with Intent-Aware Promptingcited by 16
- 2024CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapycited by 12
- 2025A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directionscited by 12
- 2024Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysiscited by 10
- 2024Can LLMs Correct Physicians, Yet? Investigating Effective Interaction Methods in the Medical Domaincited by 7
- 2025The Pursuit of Empathy: Evaluating Small Language Models for PTSD Dialogue Supportcited by 6
12 most cited of 26 All 26 (JSON)
- 2026Multi-Perspective Triad Interaction Graph Neural Network for Cognitive Distortion Detection7 Aug 2026
- 2026Exploring Profiles of Cognitive Distortions Associated with Mental Health Disorders24 May 2026
- 2026Assessing the Effectiveness of LLMs in Delivering Cognitive Behavioral Therapy4 Mar 2026
- 2026Responsible Evaluation of AI for Mental Health20 Jan 2026
- 2025Towards Consistent Detection of Cognitive Distortions: LLM-Based Annotation and Dataset-Agnostic Evaluation3 Nov 2025
- 2025Signs of Struggle: Spotting Cognitive Distortions across Language and Register28 Aug 2025
- 2025A Survey of Cognitive Distortion Detection and Classification in NLP13 Aug 2025
- 2025The Pursuit of Empathy: Evaluating Small Language Models for PTSD Dialogue Support21 May 2025
- 2025KoACD: The First Korean Adolescent Dataset for Cognitive Distortion Analysis via Role-Switching Multi-LLM Negotiation1 May 2025
- 2025When LLM Therapists Become Salespeople: Evaluating Large Language Models for Ethical Motivational Interviewing30 Mar 2025
- 2025Exploratory Study into Relations between Cognitive Distortions and Emotional Appraisals20 Mar 2025
- 2025CALLM: Understanding Cancer Survivors' Emotions and Intervention Opportunities via Mobile Diaries and Context-Aware Language Models12 Mar 2025
12 newest of 26 All 26 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025WiseMind: a knowledge-guided multi-agent framework for accurate and empathetic psychiatric diagnosis
- 2025MindEval: Benchmarking Language Models on Multi-turn Mental Health Support
- 2026Mind Companion: An Embodied Conversational Agent for Process-Based Psychotherapy
- 2024ERD: A Framework for Improving LLM Reasoning for Cognitive Distortion Classification
- 2026Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming
- 2025Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation
- 2023Rethinking Large Language Models in Mental Health Applications
- 2024An Active Inference Strategy for Prompting Reliable Responses from Large Language Models in Medical Practice