What Twitter Profile and Posted Images Reveal About Depression and Anxiety
Not on the map. Why?
Abstract (arXiv)
Previous work has found strong links between the choice of social media images and users' emotions, demographics and personality traits. In this study, we examine which attributes of profile and posted images are associated with depression and anxiety of Twitter users. We used a sample of 28,749 Facebook users to build a language prediction model of survey-reported depression and anxiety, and validated it on Twitter on a sample of 887 users who had taken anxiety and depression surveys. We then applied it to a different set of 4,132 Twitter users to impute language-based depression and anxiety labels, and extracted interpretable features of posted and profile pictures to uncover the associations with users' depression and anxiety, controlling for demographics. For depression, we find that profile pictures suppress positive emotions rather than display more negative emotions, likely because of social media self-presentation biases. They also tend to show the single face of the user (rather than show her in groups of friends), marking increased focus on the self, emblematic for depression. Posted images are dominated by grayscale and low aesthetic cohesion across a variety of image features. Profile images of anxious users are similarly marked by grayscale and low aesthetic cohesion, but less so than those of depressed users. Finally, we show that image features can be used to predict depression and anxiety, and that multitask learning that includes a joint modeling of demographics improves prediction performance. Overall, we find that the image attributes that mark depression and anxiety offer a rich lens into these conditions largely congruent with the psychological literature, and that images on Twitter allow inferences about the mental health status of users.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 3; 2024: 4; 2025: 2.
17 papers.
Sort:
By area:
- 2021Affective Image Content Analysis: Two Decades Review and New Perspectivescited by 47
- 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformerscited by 18
- 2021Detecting COVID-19 and Community Acquired Pneumonia using Chest CT scan images with Deep Learningcited by 8
- 2024MoodCapture: Depression Detection Using In-the-Wild Smartphone Imagescited by 8
- 2021Computational Emotion Analysis From Images: Recent Advances and Future Directionscited by 6
- 2025Datasets for Depression Modeling in Social Media: An Overviewcited by 5
- 2022DECK: Behavioral Tests to Improve Interpretability and Generalizability of BERT Models Detecting Depression from Textcited by 2
- 2023Follow Us and Become Famous! Insights and Guidelines From Instagram Engagement Mechanismscited by 2
- 2024Multi Class Depression Detection Through Tweets using Artificial Intelligencecited by 2
- 2021Survey of Generative Methods for Social Media Analysiscited by 1
- 2023Predicting mental health using social media: A roadmap for future developmentcited by 1
- 2024Language-based Valence and Arousal Expressions between the United States and China: a Cross-Cultural Examinationcited by 1
5 more
- 2024Enhancing Data Quality through Simple De-duplication: Navigating Responsible Computational Social Science Researchcited by 1
- 2021Social Behavior and Mental Health: A Snapshot Survey under COVID-19 Pandemiccited by 0
- 2022SERCNN: Stacked Embedding Recurrent Convolutional Neural Network in Detecting Depression on Twittercited by 0
- 2022What Are You Anxious About? Examining Subjects of Anxiety during the COVID-19 Pandemiccited by 0
- 2025Discrete Prompt Tuning via Recursive Utilization of Black-box Multimodal Large Language Model for Personalized Visual Emotion Recognitioncited by 0
- 2025Discrete Prompt Tuning via Recursive Utilization of Black-box Multimodal Large Language Model for Personalized Visual Emotion Recognition30 Aug 2025
- 2025Datasets for Depression Modeling in Social Media: An Overview27 Mar 2025
- 2024Enhancing Data Quality through Simple De-duplication: Navigating Responsible Computational Social Science Research4 Oct 2024
- 2024Multi Class Depression Detection Through Tweets using Artificial Intelligence19 Apr 2024
- 2024MoodCapture: Depression Detection Using In-the-Wild Smartphone Images25 Feb 2024
- 2024Language-based Valence and Arousal Expressions between the United States and China: a Cross-Cultural Examination10 Jan 2024
- 2023Predicting mental health using social media: A roadmap for future development25 Jan 2023
- 2023Follow Us and Become Famous! Insights and Guidelines From Instagram Engagement Mechanisms17 Jan 2023
- 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformers13 Jan 2023
- 2022What Are You Anxious About? Examining Subjects of Anxiety during the COVID-19 Pandemic27 Sep 2022
- 2022DECK: Behavioral Tests to Improve Interpretability and Generalizability of BERT Models Detecting Depression from Text12 Sep 2022
- 2022SERCNN: Stacked Embedding Recurrent Convolutional Neural Network in Detecting Depression on Twitter29 Jul 2022
5 more
- 2021Survey of Generative Methods for Social Media Analysis13 Dec 2021
- 2021Affective Image Content Analysis: Two Decades Review and New Perspectives30 Jun 2021
- 2021Social Behavior and Mental Health: A Snapshot Survey under COVID-19 Pandemic17 May 2021
- 2021Detecting COVID-19 and Community Acquired Pneumonia using Chest CT scan images with Deep Learning11 Apr 2021
- 2021Computational Emotion Analysis From Images: Recent Advances and Future Directions19 Mar 2021
- 2021Affective Image Content Analysis: Two Decades Review and New Perspectivescited by 47
- 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformerscited by 18
- 2021Detecting COVID-19 and Community Acquired Pneumonia using Chest CT scan images with Deep Learningcited by 8
- 2024MoodCapture: Depression Detection Using In-the-Wild Smartphone Imagescited by 8
- 2021Computational Emotion Analysis From Images: Recent Advances and Future Directionscited by 6
- 2025Datasets for Depression Modeling in Social Media: An Overviewcited by 5
- 2022DECK: Behavioral Tests to Improve Interpretability and Generalizability of BERT Models Detecting Depression from Textcited by 2
- 2023Follow Us and Become Famous! Insights and Guidelines From Instagram Engagement Mechanismscited by 2
- 2024Multi Class Depression Detection Through Tweets using Artificial Intelligencecited by 2
- 2021Survey of Generative Methods for Social Media Analysiscited by 1
- 2023Predicting mental health using social media: A roadmap for future developmentcited by 1
- 2024Language-based Valence and Arousal Expressions between the United States and China: a Cross-Cultural Examinationcited by 1
12 most cited of 16 All 16 (JSON)
- 2025Datasets for Depression Modeling in Social Media: An Overview27 Mar 2025
- 2024Enhancing Data Quality through Simple De-duplication: Navigating Responsible Computational Social Science Research4 Oct 2024
- 2024Multi Class Depression Detection Through Tweets using Artificial Intelligence19 Apr 2024
- 2024MoodCapture: Depression Detection Using In-the-Wild Smartphone Images25 Feb 2024
- 2024Language-based Valence and Arousal Expressions between the United States and China: a Cross-Cultural Examination10 Jan 2024
- 2023Predicting mental health using social media: A roadmap for future development25 Jan 2023
- 2023Follow Us and Become Famous! Insights and Guidelines From Instagram Engagement Mechanisms17 Jan 2023
- 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformers13 Jan 2023
- 2022What Are You Anxious About? Examining Subjects of Anxiety during the COVID-19 Pandemic27 Sep 2022
- 2022DECK: Behavioral Tests to Improve Interpretability and Generalizability of BERT Models Detecting Depression from Text12 Sep 2022
- 2022SERCNN: Stacked Embedding Recurrent Convolutional Neural Network in Detecting Depression on Twitter29 Jul 2022
- 2021Survey of Generative Methods for Social Media Analysis13 Dec 2021
12 newest of 16 All 16 (JSON)