mlsanityData to 14 Oct 2026

Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Health

arXiv 2109.13770 ↗First posted 28 Sep 2021cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

Many statistical models have high accuracy on test benchmarks, but are not explainable, struggle in low-resource scenarios, cannot be reused for multiple tasks, and cannot easily integrate domain expertise. These factors limit their use, particularly in settings such as mental health, where it is difficult to annotate datasets and model outputs have significant impact. We introduce a micromodel architecture to address these challenges. Our approach allows researchers to build interpretable representations that embed domain knowledge and provide explanations throughout the model's decision process. We demonstrate the idea on multiple mental health tasks: depression classification, PTSD classification, and suicidal risk assessment. Our systems consistently produce strong results, even in low-resource scenarios, and are more interpretable than alternative methods.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 21 of its 73 references that are in the map. First posted on arXiv 28 Sep 2021.

Builds on

21 of 73 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  5. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  6. 2018Universal Sentence Encodercited by 489
  7. 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 438
  8. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 304
  9. 2016Data Programming: Creating Large Training Sets, Quicklycited by 246
  10. 2019InterpretML: A Unified Framework for Machine Learning Interpretabilitycited by 246
  11. 2020Finding Universal Grammatical Relations in Multilingual BERTcited by 110
  12. 2017Depression and Self-Harm Risk Assessment in Online Forumscited by 84
9 more
  1. 2018SMHD: A Large-Scale Resource for Exploring Online Language Usage for Multiple Mental Health Conditionscited by 73
  2. 2018Training Classifiers with Natural Language Explanationscited by 58
  3. 2018Evaluating Layers of Representation in Neural Machine Translation on Part-of-Speech and Semantic Tagging Taskscited by 56
  4. 2019Outlier Detection for Improved Data Quality and Diversity in Dialog Systemscited by 28
  5. 2017Multi-Task Learning for Mental Health using Social Media Textcited by 25
  6. 2020Infusing Finetuning with Semantic Dependenciescited by 18
  7. 2021Gender and Racial Fairness in Depression Research using Social Mediacited by 17
  8. 2018Attention-Based LSTM for Psychological Stress Detection from Spoken Language Using Distant Supervisioncited by 8
  9. 2020A Survey on Incorporating Domain Knowledge into Deep Learning for Medical Image Analysiscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 6; 2023: 4; 2024: 0; 2025: 1; 2026: 1.

13 papers.

Sort: