mlsanityData to 7 Oct 2026

Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data

arXiv 2106.13213 ↗First posted 24 Jun 2021cs.LG cs.AI cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications for the early detection, intervention, and treatment of mental health disorders. One promising data source to help monitor human behavior is daily smartphone usage. However, care must be taken to summarize behaviors without identifying the user through personal (e.g., personally identifiable information) or protected (e.g., race, gender) attributes. In this paper, we study behavioral markers of daily mood using a recent dataset of mobile behaviors from adolescent populations at high risk of suicidal behaviors. Using computational models, we find that language and multimodal representations of mobile typed text (spanning typed characters, words, keystroke timings, and app usage) are predictive of daily mood. However, we find that models trained to predict mood often also capture private user identities in their intermediate representations. To tackle this problem, we evaluate approaches that obfuscate user identity while remaining predictive. By combining multimodal representations with privacy-preserving learning, we are able to push forward the performance-privacy frontier.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 21 of its 59 references that are in the map. First posted on arXiv 24 Jun 2021.

Builds on

21 of 59 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  3. 2020Longformer: The Long-Document Transformercited by 3,362
  4. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  5. 2016Deep Learning with Differential Privacycited by 2,682
  6. 2020Extracting Training Data from Large Language Modelscited by 2,144
  7. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  8. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  9. 2019Deep Leakage from Gradientscited by 1,004
  10. 2017Federated Multi-Task Learningcited by 669
  11. 2017Differentially Private Federated Learning: A Client Level Perspectivecited by 451
  12. 2020Think Locally, Act Globally: Federated Learning with Local and Global Representationscited by 322
9 more
  1. 2019FedHealth: A Federated Transfer Learning Framework for Wearable Healthcarecited by 182
  2. 2020Threats to Federated Learning: A Surveycited by 171
  3. 2020Towards Debiasing Sentence Representationscited by 170
  4. 2019Inherent Tradeoffs in Learning Fair Representationscited by 144
  5. 2018Multimodal Language Analysis with Recurrent Multistage Fusioncited by 43
  6. 2016Select-Additive Learning: Improving Generalization in Multimodal Sentiment Analysiscited by 29
  7. 2018Bias Amplification in Artificial Intelligence Systemscited by 15
  8. 2018DeepMood: Modeling Mobile Phone Typing Dynamics for Mood Detectioncited by 10
  9. 2018dpMood: Exploiting Local and Periodic Typing Dynamics for Personalized Mood Predictioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 4; 2024: 1; 2025: 1; 2026: 1.

9 papers.