Privacy Aware Question-Answering System for Online Mental Health Risk Assessment
Not on the map. Why?
Abstract (arXiv)
Social media platforms have enabled individuals suffering from mental illnesses to share their lived experiences and find the online support necessary to cope. However, many users fail to receive genuine clinical support, thus exacerbating their symptoms. Screening users based on what they post online can aid providers in administering targeted healthcare and minimize false positives. Pre-trained Language Models (LMs) can assess users' social media data and classify them in terms of their mental health risk. We propose a Question-Answering (QA) approach to assess mental health risk using the Unified-QA model on two large mental health datasets. To protect user data, we extend Unified-QA by anonymizing the model training process using differential privacy. Our results demonstrate the effectiveness of modeling risk assessment as a QA task, specifically for mental health use cases. Furthermore, the model's performance decreases by less than 1% with the inclusion of differential privacy. The proposed system's performance is indicative of a promising research direction that will lead to the development of privacy-aware diagnostic systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 34 references that are in the map. First posted on arXiv 9 Jun 2023.
Builds on
14 of 34 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2016Deep Learning with Differential Privacycited by 2,728
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 476
- 2019Why gradient clipping accelerates training: A theoretical justification for adaptivitycited by 341
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 195
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 161
- 2015Adding Gradient Noise Improves Learning for Very Deep Networkscited by 145
- 2022Privately Fine-Tuning Large Language Models with Differential Privacycited by 39
- 2021Benchmarking Differential Privacy and Federated Learning for BERT Modelscited by 28
2 more
- 2023Lightweight Transformers for Clinical Natural Language Processingcited by 15
- 2022On the Effectiveness of Compact Biomedical Transformerscited by 11
Built on by
Citing papers per year: 2023: 1.
1 paper.
- 2023FIRE: Food Image to REcipe generationcited by 18
- 2023FIRE: Food Image to REcipe generation28 Aug 2023