mlsanityData to 14 Oct 2026

Mental Health Equity in LLMs: Leveraging Multi-Hop Question Answering to Detect Amplified and Silenced Perspectives

arXiv 2506.18116 ↗First posted 22 Jun 2025cs.CL cs.AI cs.CYcited by 3

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) in mental healthcare risk propagating biases that reinforce stigma and harm marginalized groups. While previous research identified concerning trends, systematic methods for detecting intersectional biases remain limited. This work introduces a multi-hop question answering (MHQA) framework to explore LLM response biases in mental health discourse. We analyze content from the Interpretable Mental Health Instruction (IMHI) dataset across symptom presentation, coping mechanisms, and treatment approaches. Using systematic tagging across age, race, gender, and socioeconomic status, we investigate bias patterns at demographic intersections. We evaluate four LLMs: Claude 3.5 Sonnet, Jamba 1.6, Gemma 3, and Llama 4, revealing systematic disparities across sentiment, demographics, and mental health conditions. Our MHQA approach demonstrates superior detection compared to conventional methods, identifying amplification points where biases magnify through sequential reasoning. We implement two debiasing techniques: Roleplay Simulation and Explicit Bias Reduction, achieving 66-94% bias reductions through few-shot prompting with BBQ dataset examples. These findings highlight critical areas where LLMs reproduce mental healthcare biases, providing actionable insights for equitable AI development.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 11 of its 39 references that are in the map. First posted on arXiv 22 Jun 2025.

Builds on

11 of 39 references.

References · 11

  1. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
  2. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  3. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
  4. 2019Dreaddit: A Reddit Dataset for Stress Analysis in Social Mediacited by 81
  5. 2024The opportunities and risks of large language models in mental healthcited by 54
  6. 2023Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Taskscited by 51
  7. 2024Dated Data: Tracing Knowledge Cutoffs in Large Language Modelscited by 51
  8. 2024Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Modelscited by 33
  9. 2023Building Trustworthy NeuroSymbolic AI Systems: Consistency, Reliability, Explainability, and Safetycited by 14
  10. 2024WellDunn: On the Robustness and Explainability of Language Models and Large Language Models in Identifying Wellness Dimensionscited by 10
  11. 2024Unveiling and Mitigating Bias in Mental Health Analysis with Large Language Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.