mlsanityData to 7 Oct 2026

Training Models to Generate, Recognize, and Reframe Unhelpful Thoughts

arXiv 2307.02768 ↗First posted 6 Jul 2023cs.CLcited by 31

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Many cognitive approaches to well-being, such as recognizing and reframing unhelpful thoughts, have received considerable empirical support over the past decades, yet still lack truly widespread adoption in self-help format. A barrier to that adoption is a lack of adequately specific and diverse dedicated practice material. This work examines whether current language models can be leveraged to both produce a virtually unlimited quantity of practice material illustrating standard unhelpful thought patterns matching specific given contexts, and generate suitable positive reframing proposals. We propose PATTERNREFRAME, a novel dataset of about 10k examples of thoughts containing unhelpful thought patterns conditioned on a given persona, accompanied by about 27k positive reframes. By using this dataset to train and/or evaluate current models, we show that existing models can already be powerful tools to help generate an abundance of tailored practice material and hypotheses, with no or minimal additional model training required.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 33 of its 72 references that are in the map. First posted on arXiv 6 Jul 2023.

Builds on

33 of 72 references.

References · 33

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  8. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  9. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  10. 2018Hierarchical Neural Story Generationcited by 1,182
  11. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  12. 2019How Can We Know What Language Models Know?cited by 953
21 more
  1. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  2. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  3. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  4. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
  5. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
  6. 2020Reducing conversational agents' overconfidence through linguistic calibrationcited by 209
  7. 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 159
  8. 2017ParlAI: A Dialog Research Software Platformcited by 139
  9. 2022Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completioncited by 102
  10. 2020Few-Shot Text Generation with Pattern-Exploiting Trainingcited by 87
  11. 2019Controllable Sentence Simplificationcited by 78
  12. 2020MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Modelscited by 74
  13. 2021Tailor: Generating and Perturbing Text with Semantic Controlscited by 67
  14. 2020Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generationcited by 47
  15. 2020PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generationcited by 35
  16. 2022Inducing Positive Perspectives with Text Reframingcited by 31
  17. 2021A Review of Human Evaluation for Style Transfercited by 19
  18. 2020Towards Preemptive Detection of Depression and Anxiety in Twittercited by 13
  19. 2018Deep learning for language understanding of mental health concepts derived from Cognitive Behavioural Therapycited by 9
  20. 2018Predictive Linguistic Features of Schizophreniacited by 5
  21. 2021Controlled Neural Sentence-Level Reframing of News Articlescited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 8; 2025: 12; 2026: 8.

31 papers.

Sort:

By area:

  1. 2023Challenges and Applications of Large Language Modelscited by 251
  2. 2024Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theorycited by 60
  3. 2024HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapycited by 47
  4. 2024CBT-LLM: A Chinese Large Language Model for Cognitive Behavioral Therapy-based Mental Health Question Answeringcited by 45
  5. 2023Benefits and Harms of Large Language Models in Digital Mental Healthcited by 39
  6. 2023Empowering Psychotherapy with Large Language Models: Cognitive Distortion Detection through Diagnosis of Thought Promptingcited by 31
  7. 2025Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Modelscited by 21
  8. 2024Large Language Models are Capable of Offering Cognitive Reappraisal, if Guidedcited by 13
  9. 2025MIRROR: Multimodal Cognitive Reframing Therapy for Rolling with Resistancecited by 13
  10. 2024CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapycited by 12
  11. 2025A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directionscited by 12
  12. 2025Crisp: Cognitive Restructuring of Negative Thoughts through Multi-turn Supportive Dialoguescited by 11
19 more
  1. 2025Feel the Difference? A Comparative Analysis of Emotional Arcs in Real and LLM-Generated CBT Sessionscited by 11
  2. 2025RainbowPlus: Enhancing Adversarial Prompt Generation via Evolutionary Quality-Diversity Searchcited by 10
  3. 2025Preference Learning Unlocks LLMs' Psycho-Counseling Skillscited by 9
  4. 2025Just a Scratch: Enhancing LLM Capabilities for Self-harm Detection through Intent Differentiation and Emoji Interpretationcited by 7
  5. 2025DiaCBT: A Long-Periodic Dialogue Corpus Guided by Cognitive Conceptualization Diagram for CBT-based Psychological Counselingcited by 4
  6. 2025Exploratory Study into Relations between Cognitive Distortions and Emotional Appraisalscited by 3
  7. 2025A Comprehensive Review of Datasets for Clinical Mental Health AI Systemscited by 3
  8. 2025A Survey of Cognitive Distortion Detection and Classification in NLPcited by 3
  9. 2026RedBench: A Universal Dataset for Comprehensive Red Teaming of Large Language Modelscited by 3
  10. 2024A Generic Review of Integrating Artificial Intelligence in Cognitive Behavioral Therapycited by 2
  11. 2026Graph2Counsel: Clinically Grounded Synthetic Counseling Dialogue Generation from Client Psychological Graphscited by 2
  12. 2024A Multi-Agent Dual Dialogue System to Support Mental Health Care Providerscited by 1
  13. 2026CCD-CBT: Multi-Agent Therapeutic Interaction for CBT Guided by Cognitive Conceptualization Diagramcited by 1
  14. 2024Carrot and Stick: Inducing Self-Motivation with Positive & Negative Feedbackcited by 0
  15. 2026The Art of Socratic Inquiry: A Framework for Proactive Template-Guided Therapeutic Conversation Generationcited by 0
  16. 2026PSY-STEP: Structuring Therapeutic Targets and Action Sequences for Proactive Counseling Dialogue Systemscited by 0
  17. 2026StageWell: A Process-Aligned Chinese Corpus for Positive-Psychology Support Dialoguecited by 0
  18. 2026Steering the Compass: Aligning Dynamic Psychological Counseling Conversations with Cognitive Behavioral Therapy Strategiescited by 0
  19. 2026From Pattern Recognizers to Personalized Companions: A Survey of Large Language Models in Mental Healthcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction
  2. 2025Does "Reasoning" with Large Language Models Improve Recognizing, Generating, and Reframing Unhelpful Thoughts?
  3. 2024Socratic Reasoning Improves Positive Text Rewriting
  4. 2026Why It Hurts: Identifying the Drivers of Negative Thoughts in Emotional Support Conversations
  5. 2024Mitigating Unhelpfulness in Emotional Support Conversations with Multifaceted AI Feedback
  6. 2025How Well Can Reasoning Models Identify and Recover from Unhelpful Thoughts?
  7. 2023Rethinking Large Language Models in Mental Health Applications
  8. 2025Are Today's LLMs Ready to Explain Well-Being Concepts?