VIS-DICT: A Visual Dictionary for Missing Modality Imputation in Social Network Depression Detection
Not on the map. Why?
Abstract (arXiv)
Tracking social media posts can help spot early signs of depression. Recent studies show that combining text and images works better for detecting depression than using text alone. However, many social media posts do not have images, which makes it hard to use multimodal models. Most existing methods fill in missing images using retrieval or generative models that need extra training. In this paper, we introduce Vis-Dict, a dictionary-based method that builds missing visual features by linking words to average image vectors from complete training posts. These estimated visual features are then combined with text to track changes in user behavior over time. We tested Vis-Dict on a social media dataset using user timelines of up to 512 posts and compared it with other missing-data methods. The results show that Vis-Dict performs on par with generative networks, reaching an F1-score of 0.9454 and an ROC-AUC of 0.9890. Most importantly, Vis-Dict achieves this strong performance with zero trainable parameters for image generation. These findings show that directly connecting words to visual features is an effective and practical way to handle missing images in depression detection systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 47 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
15 of 47 references.
References · 15
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Layer Normalizationcited by 5,669
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 245
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 92
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 49
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 40
- 2016Instagram photos reveal predictive markers of depressioncited by 25
- 2016Forecasting the onset and course of mental illness with Twitter datacited by 25
Built on by
Not cited yet.