mlsanityData to 14 Oct 2026

Suicide Risk Assessment Using Multimodal Speech Features: A Study on the SW1 Challenge Dataset

arXiv 2505.13069 ↗First posted 19 May 2025cs.CL cs.LG cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

The 1st SpeechWellness Challenge conveys the need for speech-based suicide risk assessment in adolescents. This study investigates a multimodal approach for this challenge, integrating automatic transcription with WhisperX, linguistic embeddings from Chinese RoBERTa, and audio embeddings from WavLM. Additionally, handcrafted acoustic features -- including MFCCs, spectral contrast, and pitch-related statistics -- were incorporated. We explored three fusion strategies: early concatenation, modality-specific processing, and weighted attention with mixup regularization. Results show that weighted attention provided the best generalization, achieving 69% accuracy on the development set, though a performance gap between development and test sets highlights generalization challenges. Our findings, strictly tied to the MINI-KID framework, emphasize the importance of refining embedding representations and fusion mechanisms to enhance classification reliability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 21 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

5 of 21 references.

References · 5

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  4. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
  5. 2025The 1st SpeechWellness Challenge: Detecting Suicide Risk Among Adolescentscited by 6

Built on by

Not cited yet.