mlsanityData to 7 Oct 2026

Towards Privacy-Preserving Mental Health Support with Large Language Models

arXiv 2601.01993 ↗First posted 5 Jan 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have shown promise for mental health support, yet training such models is constrained by the scarcity and sensitivity of real counseling dialogues. In this article, we present MindChat, a privacy-preserving LLM for mental health support, together with MindCorpus, a synthetic multi-turn counseling dataset constructed via a multi-agent role-playing framework. To synthesize high-quality counseling data, the developed dialogue-construction framework employs a dual closed-loop feedback design to integrate psychological expertise and counseling techniques through role-playing: (i) turn-level critique-and-revision to improve coherence and counseling appropriateness within a session, and (ii) session-level strategy refinement to progressively enrich counselor behaviors across sessions. To mitigate privacy risks under decentralized data ownership, we fine-tune the base model using federated learning with parameter-efficient LoRA adapters and incorporate differentially private optimization to reduce membership and memorization risks. Experiments on synthetic-data quality assessment and counseling capability evaluation show that MindCorpus improves training effectiveness and that MindChat is competitive with existing general and counseling-oriented LLM baselines under both automatic LLM-judge and human evaluation protocols, while exhibiting reduced privacy leakage under membership inference attacks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 54 references that are in the map. First posted on arXiv 5 Jan 2026.

Builds on

30 of 54 references.

References · 30

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  5. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  6. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  7. 2020Extracting Training Data from Large Language Modelscited by 2,144
  8. 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 492
  9. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
  10. 2023Detecting Pretraining Data from Large Language Modelscited by 375
  11. 2023Multi-step Jailbreaking Privacy Attacks on ChatGPTcited by 320
  12. 2021Towards Emotional Support Dialog Systemscited by 294
18 more
  1. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 211
  2. 2024Do Membership Inference Attacks Work on Large Language Models?cited by 188
  3. 2023SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversationscited by 109
  4. 2024CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counselingcited by 88
  5. 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversationcited by 79
  6. 2024Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theorycited by 60
  7. 2024HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapycited by 47
  8. 2023SMILE: Single-turn to Multi-turn Inclusive Language Expansion via ChatGPT for Mental Health Supportcited by 46
  9. 2024ESCoT: Towards Interpretable Emotional Support Dialogue Systemscited by 46
  10. 2024PsyDT: Using LLMs to Construct the Digital Twin of Psychological Counselor with Personalized Counseling Style for Psychological Counselingcited by 37
  11. 2024EmoLLM: Multimodal Emotional Understanding Meets Large Language Modelscited by 31
  12. 2023Integration of Large Language Models and Federated Learningcited by 28
  13. 2025Text Data Augmentation for Large Language Models: A Comprehensive Survey of Methods, Challenges, and Opportunitiescited by 21
  14. 2024Unique Security and Privacy Threats of Large Language Models: A Comprehensive Surveycited by 20
  15. 2023Facilitating Multi-turn Emotional Support Conversation with Positive Emotion Elicitation: A Reinforcement Learning Approachcited by 15
  16. 2024Enhancing textual textbook question answering with large language models and retrieval augmented generationcited by 13
  17. 2024Hadamard Adapter: An Extreme Parameter-Efficient Adapter Tuning Method for Pre-trained Language Modelscited by 13
  18. 2025FedMentalCare: Towards Privacy-Preserving Fine-Tuned LLMs to Analyze Mental Health Status Using Federated Learning Frameworkcited by 8

Built on by

Not cited yet.