Just a Scratch: Enhancing LLM Capabilities for Self-harm Detection through Intent Differentiation and Emoji Interpretation
Not on the map. Why?
Abstract (arXiv)
Self-harm detection on social media is critical for early intervention and mental health support, yet remains challenging due to the subtle, context-dependent nature of such expressions. Identifying self-harm intent aids suicide prevention by enabling timely responses, but current large language models (LLMs) struggle to interpret implicit cues in casual language and emojis. This work enhances LLMs' comprehension of self-harm by distinguishing intent through nuanced language-emoji interplay. We present the Centennial Emoji Sensitivity Matrix (CESM-100), a curated set of 100 emojis with contextual self-harm interpretations and the Self-Harm Identification aNd intent Extraction with Supportive emoji sensitivity (SHINES) dataset, offering detailed annotations for self-harm labels, casual mentions (CMs), and serious intents (SIs). Our unified framework: a) enriches inputs using CESM-100; b) fine-tunes LLMs for multi-task learning: self-harm detection (primary) and CM/SI span detection (auxiliary); c) generates explainable rationales for self-harm predictions. We evaluate the framework on three state-of-the-art LLMs-Llama 3, Mental-Alpaca, and MentalLlama, across zero-shot, few-shot, and fine-tuned scenarios. By coupling intent differentiation with contextual cues, our approach commendably enhances LLM performance in both detection and explanation tasks, effectively addressing the inherent ambiguity in self-harm signals. The SHINES dataset, CESM-100 and codebase are publicly available at: https://www.iitp.ac.in/~ai-nlp-ml/resources.html#SHINES .
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 9 of its 37 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
9 of 37 references.
References · 9
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
- 2020Recognizing Emotion Cause in Conversationscited by 66
- 2023Training Models to Generate, Recognize, and Reframe Unhelpful Thoughtscited by 31
- 2024Risks from Language Models for Automated Mental Healthcare: Ethics and Structure for Implementationcited by 27
- 2024Looking Right is Sometimes Right: Investigating the Capabilities of Decoder-only LLMs for Sequence Labelingcited by 24
- 2023Boosting Distress Support Dialogue Responses with Motivational Interviewing Strategycited by 15
- 2023Revisiting Instruction Fine-tuned Model Evaluation to Guide Industrial Applicationscited by 11
- 2023Testing the Limits of Unified Sequence to Sequence LLM Pretraining on Diverse Table Data Taskscited by 10
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025CRADLE Bench: A Clinician-Annotated Benchmark for Multi-Faceted Mental Health Crisis and Safety Risk Detectioncited by 8
- 2026Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teamingcited by 3
- 2026Responsible Evaluation of AI for Mental Healthcited by 2
- 2025Two-Stage Voting for Robust and Efficient Suicide Risk Detection on Social Mediacited by 0
- 2026Expert-Level Crisis Detection in Mental Health Conversationscited by 0
- 2026Analysing Self-Harm Representations in Language Models: a Cross-Architecture Studycited by 0
- 2026From Pattern Recognizers to Personalized Companions: A Survey of Large Language Models in Mental Healthcited by 0
- 2026From Pattern Recognizers to Personalized Companions: A Survey of Large Language Models in Mental Health21 Sep 2026
- 2026Analysing Self-Harm Representations in Language Models: a Cross-Architecture Study24 Jul 2026
- 2026Expert-Level Crisis Detection in Mental Health Conversations9 Jun 2026
- 2026Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming23 Feb 2026
- 2026Responsible Evaluation of AI for Mental Health20 Jan 2026
- 2025CRADLE Bench: A Clinician-Annotated Benchmark for Multi-Faceted Mental Health Crisis and Safety Risk Detection27 Oct 2025
- 2025Two-Stage Voting for Robust and Efficient Suicide Risk Detection on Social Media9 Oct 2025