mlsanityData to 14 Oct 2026

Exploring User Security and Privacy Attitudes and Concerns Toward the Use of General-Purpose LLM Chatbots for Mental Health

arXiv 2507.10695 ↗First posted 14 Jul 2025cs.CY cs.AI cs.CRcited by 13

Not on the map. Why?

Abstract (arXiv)

Individuals are increasingly relying on large language model (LLM)-enabled conversational agents for emotional support. While prior research has examined privacy and security issues in chatbots specifically designed for mental health purposes, these chatbots are overwhelmingly "rule-based" offerings that do not leverage generative AI. Little empirical research currently measures users' privacy and security concerns, attitudes, and expectations when using general-purpose LLM-enabled chatbots to manage and improve mental health. Through 21 semi-structured interviews with U.S. participants, we identified critical misconceptions and a general lack of risk awareness. Participants conflated the human-like empathy exhibited by LLMs with human-like accountability and mistakenly believed that their interactions with these chatbots were safeguarded by the same regulations (e.g., HIPAA) as disclosures with a licensed therapist. We introduce the concept of "intangible vulnerability," where emotional or psychological disclosures are undervalued compared to more tangible forms of information (e.g., financial or location-based data). To address this, we propose recommendations to safeguard user mental health disclosures with general-purpose LLM-enabled chatbots more effectively.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 13 of its 124 references that are in the map. First posted on arXiv 14 Jul 2025.

Builds on

13 of 124 references.

References · 13

  1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  2. 2021Ethical and social risks of harm from Language Modelscited by 966
  3. 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
  4. 2023Cognitive Reframing of Negative Thoughts through Human-Language Model Interactioncited by 77
  5. 2023Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Supportcited by 75
  6. 2024The opportunities and risks of large language models in mental healthcited by 54
  7. 2023MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' Journalingcited by 50
  8. 2023Can Language Models be Instructed to Protect Personal Information?cited by 46
  9. 2023Benefits and Harms of Large Language Models in Digital Mental Healthcited by 40
  10. 2022Inducing Positive Perspectives with Text Reframingcited by 31
  11. 2024The Typing Cure: Experiences with Large Language Model Chatbots for Mental Health Supportcited by 24
  12. 2023Harnessing Large Language Models' Empathetic Response Generation Capabilities for Online Mental Health Counselling Supportcited by 17
1 more
  1. 2023Do You Trust ChatGPT? -- Perceived Credibility of Human and AI-Generated Contentcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 4.

13 papers.

Sort:

By area: