First, do no harm: Breaking suicidogenic echo chambers in media recommendation
Not on the map. Why?
Abstract (arXiv)
Recommender systems generally optimises user engagement, but this approach is dangerous in mental health contexts. When vulnerable users show signs of suicidal ideation, standard algorithms often trap them in echo chambers of harmful content, worsening their psychological state. In response, we introduce RankAid, a re-ranking method that prioritises clinical safety alongside predictive relevance. It works as an add-on layer to existing models: it penalises risky items and boosts therapeutic content depending on the user's current level of vulnerability. We evaluated this approach using the MovieLens 1M dataset, where items were semantically annotated for clinical risk and therapeutic value using large language models. Our simulations show that our algorithm successfully blocks the recommendation of harmful content during crisis peaks, actively reshaping the feed to support emotional de-escalation. Furthermore, this safety intervention only causes a controlled, acceptable drop in standard accuracy metrics like NDCG. By using asymmetric hyperparameters, RankAid also gives system administrators the flexibility to tune the severity of the intervention based on specific clinical guidelines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 1 of its 23 references that are in the map. First posted on arXiv 24 May 2026.
Builds on
1 of 23 references.
References · 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Re-ranking Using Large Language Models for Mitigating Exposure to Harmful Content on Social Media Platforms
- 2026Seeking Help, Facing Harm: Auditing TikTok's Mental Health Recommendations ↗
- 2026Retrieval-Augmented Generation in LLMs for Mental Health: Quantifying the Incremental Contribution of Retrieval Within a Layered Safety Architecture
- 2025Evaluating Reasoning LLMs for Suicide Screening with the Columbia-Suicide Severity Rating Scale
- 2026SafeCRS: Personalized Safety Alignment for LLM-Based Conversational Recommender Systems
- 2026DistressBench: Evaluating Multi-Dimensional Crisis Support in Large Language Models
- 2026Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming
- 2026MindGuard: Guardrail Classifiers for Multi-Turn Mental Health Support