mlsanityData to 14 Oct 2026

Privacy Aware Question-Answering System for Online Mental Health Risk Assessment

arXiv 2306.05652 ↗First posted 9 Jun 2023cs.CL cs.AI cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Social media platforms have enabled individuals suffering from mental illnesses to share their lived experiences and find the online support necessary to cope. However, many users fail to receive genuine clinical support, thus exacerbating their symptoms. Screening users based on what they post online can aid providers in administering targeted healthcare and minimize false positives. Pre-trained Language Models (LMs) can assess users' social media data and classify them in terms of their mental health risk. We propose a Question-Answering (QA) approach to assess mental health risk using the Unified-QA model on two large mental health datasets. To protect user data, we extend Unified-QA by anonymizing the model training process using differential privacy. Our results demonstrate the effectiveness of modeling risk assessment as a QA task, specifically for mental health use cases. Furthermore, the model's performance decreases by less than 1% with the inclusion of differential privacy. The proposed system's performance is indicative of a promising research direction that will lead to the development of privacy-aware diagnostic systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 34 references that are in the map. First posted on arXiv 9 Jun 2023.

Builds on

14 of 34 references.

References · 14

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2016Deep Learning with Differential Privacycited by 2,728
  4. 2020Extracting Training Data from Large Language Modelscited by 2,189
  5. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 476
  6. 2019Why gradient clipping accelerates training: A theoretical justification for adaptivitycited by 341
  7. 2021Pre-Trained Models: Past, Present and Futurecited by 319
  8. 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 195
  9. 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 161
  10. 2015Adding Gradient Noise Improves Learning for Very Deep Networkscited by 145
  11. 2022Privately Fine-Tuning Large Language Models with Differential Privacycited by 39
  12. 2021Benchmarking Differential Privacy and Federated Learning for BERT Modelscited by 28
2 more
  1. 2023Lightweight Transformers for Clinical Natural Language Processingcited by 15
  2. 2022On the Effectiveness of Compact Biomedical Transformerscited by 11

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.