mlsanityData to 14 Oct 2026

VIS-DICT: A Visual Dictionary for Missing Modality Imputation in Social Network Depression Detection

arXiv 2609.05537 ↗First posted 2 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Tracking social media posts can help spot early signs of depression. Recent studies show that combining text and images works better for detecting depression than using text alone. However, many social media posts do not have images, which makes it hard to use multimodal models. Most existing methods fill in missing images using retrieval or generative models that need extra training. In this paper, we introduce Vis-Dict, a dictionary-based method that builds missing visual features by linking words to average image vectors from complete training posts. These estimated visual features are then combined with text to track changes in user behavior over time. We tested Vis-Dict on a social media dataset using user timelines of up to 512 posts and compared it with other missing-data methods. The results show that Vis-Dict performs on par with generative networks, reaching an F1-score of 0.9454 and an ROC-AUC of 0.9890. Most importantly, Vis-Dict achieves this strong performance with zero trainable parameters for image generation. These findings show that directly connecting words to visual features is an effective and practical way to handle missing images in depression detection systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 47 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

15 of 47 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2016Layer Normalizationcited by 5,669
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
  6. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  7. 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 245
  8. 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 92
  9. 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 49
  10. 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 40
  11. 2016Instagram photos reveal predictive markers of depressioncited by 25
  12. 2016Forecasting the onset and course of mental illness with Twitter datacited by 25
3 more
  1. 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformerscited by 18
  2. 2025AMM-Diff: Adaptive Multi-Modality Diffusion Network for Missing Modality Imputationcited by 6
  3. 2025MMFformer: Multimodal Fusion Transformer Network for Depression Detectioncited by 1

Built on by

Not cited yet.