Improving Mental Health Screening and Early Risk Detection in Spanish
Not on the map. Why?
Abstract (arXiv)
Early detection of mental health disorders is often limited by the lack of specialized resources in Spanish and the difficulty of analyzing long histories of social media posts. This paper addresses these challenges through three main contributions. First, we introduce three Spanish foundational models specifically adapted to the mental health domain through domain-specific pre-training. Second, we propose Incremental Context Expansion (ICE), an automatic relabeling methodology designed for early detection. ICE identifies the point at which cumulative messages provide enough evidence of a disorder, generating more informative training samples. Third, we provide a set of fine-tuned models using the samples generated with the ICE methodology for early risk detection tasks. Our results on three Spanish benchmarks show that combining these specialized models with ICE improves the state-of-the-art, reducing detection latency while maintaining high performance. All models are publicly available.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 46 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
15 of 46 references.
References · 15
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2020Are All Languages Created Equal in Multilingual BERT?cited by 206
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 159
- 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
- 2022Democratizing Neural Machine Translation with OPUS-MTcited by 57
3 more
Built on by
Not cited yet.