mlsanityData to 14 Oct 2026

The Divergence Hypothesis: Unmasking Lexical Interference and Label Bias in Mental Health NLP

arXiv 2608.20353 ↗First posted 16 Jun 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Computational mental health (CMH) classifiers often degrade under distribution shift because human annotators and distant-supervision pipelines reward different linguistic signals. We introduce TSS (Triple-Stream Stress probe), a multi-channel diagnostic framework that decomposes text into (A) lexical character n-grams, (B) a small, mostly content-free morpho-syntactic channel, and (C) a 154-feature psycholinguistic style channel. Across four English datasets (N=12,906), TSS reveals a lexical interference effect: adding lexical features to the style channel reduces Macro-F1 on human-labeled data (mean drop 0.072, p<10^-4) but not on auto-labeled data. We propose Degree of Divergence (DoD), a difference-in-differences statistic adapted from econometrics for label-source auditing, with instance-level bootstrap inference; the headline estimate is DoD(BC-A) = 0.0374, 95% CI [0.0097, 0.0651], p=0.0032. A platform-stratified Twitter-only DoD (which removes the Reddit vs. Twitter contrast) reproduces the pattern with bootstrap inference: DoD-Tw(BC-A) = +0.096 (p<0.001) and DoD-Tw(AC-A) = -0.089 (p<0.001). Interventional masking (pos_only) retains ~95-99% of Channel C's performance after destroying content words on human datasets, indicating that the style channel does not rely primarily on lexical surface form. TSS is positioned as a diagnostic audit framework, not a clinical screening tool: it flags label-source-specific shortcut learning before generalization claims are made.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

12 of 36 references.

References · 12

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  5. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
  6. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
  7. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
  8. 2018Annotation Artifacts in Natural Language Inference Datacited by 671
  9. 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 496
  10. 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 439
  11. 2020On the State of Social Media Data for Mental Health Researchcited by 32
  12. 2021Gender and Racial Fairness in Depression Research using Social Mediacited by 17

Built on by

Not cited yet.