mlsanityData to 7 Oct 2026

Improving Mental Health Screening and Early Risk Detection in Spanish

arXiv 2607.28476 ↗First posted 30 Jul 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Early detection of mental health disorders is often limited by the lack of specialized resources in Spanish and the difficulty of analyzing long histories of social media posts. This paper addresses these challenges through three main contributions. First, we introduce three Spanish foundational models specifically adapted to the mental health domain through domain-specific pre-training. Second, we propose Incremental Context Expansion (ICE), an automatic relabeling methodology designed for early detection. ICE identifies the point at which cumulative messages provide enough evidence of a disorder, generating more informative training samples. Third, we provide a set of fine-tuned models using the samples generated with the ICE methodology for early risk detection tasks. Our results on three Spanish benchmarks show that combining these specialized models with ICE improves the state-of-the-art, reducing detection latency while maintaining high performance. All models are publicly available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 46 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

15 of 46 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2020Longformer: The Long-Document Transformercited by 3,362
  8. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  9. 2020Are All Languages Created Equal in Multilingual BERT?cited by 206
  10. 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 159
  11. 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
  12. 2022Democratizing Neural Machine Translation with OPUS-MTcited by 57
3 more
  1. 2021MarIA: Spanish Language Modelscited by 36
  2. 2020Suicidal Ideation and Mental Disorder Detection with Attentive Relation Networkscited by 28
  3. 2023Early Detection of Depression and Eating Disorders in Spanish: UNSL at MentalRiskES 2023cited by 5

Built on by

Not cited yet.