mlsanityData to 14 Oct 2026

Beyond Final-Token Classification: Heterogeneous Readouts for Evidence-Grounded Suicide Risk Detection

arXiv 2609.22767 ↗First posted 19 Sep 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The IEEE BigData Cup benchmark combines three prediction problems with different output structures: ordinal suicide-risk classification, multi-label psychosocial factor detection, and extraction of supporting phrases. We introduce heterogeneous readout decomposition (HRD), which separates semantic verification from output realization. A locally deployed Qwen3.8-27B model, adapted with task-specific QLoRA adapters, produces both answer-token margins and layer-63 answer states for card-conditioned queries. HRD compares four latent scores for ordinal risk, retains token margins for most factors while routing seven labels through one shared latent probe, and constructs evidence sets from verbatim span candidates with calibrated, risk-conditional constraints. On two held-out user-grouped confirmation folds, the latent risk readout improves weighted F1 from 0.8237 to 0.8372 and macro F1 from 0.7965 to 0.8185. Selective factor routing improves macro F1 by 0.0105 and tail-label macro F1 by 0.0189; in contrast, global latent replacement and independent label-specific probes fail. The constrained evidence decoder raises pooled phrase F1 from 0.7488 to 0.7609 in row-level out-of-fold evaluation. Lenormand's best public result is 0.8052 on Subtask 1 and 0.6636 on Subtask 2, giving a composite score of 0.7627. These results identify the answer-token boundary, rather than semantic representation alone, as a measurable source of error in this benchmark.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 19 Sep 2026.

Builds on

14 of 20 references.

References · 14

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  3. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
  4. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  5. 2019Designing and Interpreting Probes with Control Taskscited by 640
  6. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
  7. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  8. 2016Rationalizing Neural Predictionscited by 281
  9. 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
  10. 2020Learning to Faithfully Rationalize by Constructioncited by 113
  11. 2021Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Casescited by 77
  12. 2025Large Language Models Do Multi-Label Classification Differentlycited by 13
2 more
  1. 2024Leveraging Large Language Models for Suicide Detection on Social Media with Limited Labelscited by 10
  2. 2025Protective Factor-Aware Dynamic Influence Learning for Suicide Risk Prediction on Social Mediacited by 5

Built on by

Not cited yet.