mlsanityData to 7 Oct 2026

CrisisMMD: Multimodal Twitter Datasets from Natural Disasters

arXiv 1805.00713 ↗First posted 2 May 2018cs.SI cs.CYcited by 88

Not on the map. Why?

Abstract (arXiv)

During natural and man-made disasters, people use social media platforms such as Twitter to post textual and multime- dia content to report updates about injured or dead people, infrastructure damage, and missing or found people among other information types. Studies have revealed that this on- line information, if processed timely and effectively, is ex- tremely useful for humanitarian organizations to gain situational awareness and plan relief operations. In addition to the analysis of textual content, recent studies have shown that imagery content on social media can boost disaster response significantly. Despite extensive research that mainly focuses on textual content to extract useful information, limited work has focused on the use of imagery content or the combination of both content types. One of the reasons is the lack of labeled imagery data in this domain. Therefore, in this paper, we aim to tackle this limitation by releasing a large multi-modal dataset collected from Twitter during different natural disasters. We provide three types of annotations, which are useful to address a number of crisis response and management tasks for different humanitarian organizations.

Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 6; 2022: 10; 2023: 12; 2024: 17; 2025: 20; 2026: 23.

88 papers.

Sort:

By area:

  1. 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 74
  2. 2023FedMultimodal: A Benchmark For Multimodal Federated Learningcited by 51
  3. 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 40
  4. 2021HumAID: Human-Annotated Disaster Incidents Data from Twitter with Deep Learning Benchmarkscited by 38
  5. 2025HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generationcited by 31
  6. 2024MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Groundingcited by 29
  7. 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applicationscited by 27
  8. 2024CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informaticscited by 25
  9. 2024Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Spacecited by 21
  10. 2021MEDIC: A Multi-Task Learning Dataset for Disaster Image Classificationcited by 20
  11. 2025Harnessing Large Language Models for Disaster Management: A Surveycited by 20
  12. 2025Aligning Vision to Language: Annotation-Free Multimodal Knowledge Graph Construction for Enhanced LLMs Reasoningcited by 19
38 more
  1. 2024A social context-aware graph-based multimodal attentive learning framework for disaster content classification during emergencies: a benchmark dataset and methodcited by 12
  2. 2023Unleashing the Potential of Large Language Model: Zero-shot VQA for Flood Disaster Scenariocited by 10
  3. 2022Overcoming Language Disparity in Online Content Classification with Multimodal Learningcited by 8
  4. 2023CrisisTransformers: Pre-trained language models and sentence encoders for crisis-related social media textscited by 7
  5. 2024FedMLLM: Federated Fine-tuning MLLM on Multimodal Heterogeneity Datacited by 7
  6. 2022CrisisLTLSum: A Benchmark for Local Crisis Event Timeline Extraction and Summarizationcited by 6
  7. 2024CrisisKAN: Knowledge-infused and Explainable Multimodal Attention Network for Crisis Event Classificationcited by 6
  8. 2022Geo-Information Harvesting from Social Media Datacited by 5
  9. 2024CrisisViT: A Robust Vision Transformer for Crisis Image Classificationcited by 5
  10. 2025MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillationcited by 5
  11. 2025CrowdAgent: Multi-Agent Managed Multi-Source Annotation Systemcited by 5
  12. 2025Distilling Cross-Modal Knowledge via Feature Disentanglementcited by 5
  13. 2021Robust Training of Social Media Image Classification Models for Rapid Disaster Responsecited by 4
  14. 2022What is Your Metric Telling You? Evaluating Classifier Calibration under Context-Specific Definitions of Reliabilitycited by 4
  15. 2022Robustness of Fusion-based Multimodal Classifiers to Cross-Modal Content Dilutionscited by 4
  16. 2022NADBenchmarks -- a compilation of Benchmark Datasets for Machine Learning Tasks related to Natural Disasterscited by 4
  17. 2024Can Text-to-image Model Assist Multi-modal Learning for Visual Recognition with Visual Modality Missing?cited by 4
  18. 2022Deep-Disaster: Unsupervised Disaster Detection and Localization Using Visual Datacited by 3
  19. 2022Cross-Lingual and Cross-Domain Crisis Classification for Low-Resource Scenarioscited by 3
  20. 2022Enhancing Crisis-Related Tweet Classification with Entity-Masked Language Modeling and Multi-Task Learningcited by 3
  21. 2023Floods Relevancy and Identification of Location from Twitter Posts using NLP Techniquescited by 3
  22. 2023PORTRAIT: a hybrid aPproach tO cReate extractive ground-TRuth summAry for dIsaster evenTcited by 3
  23. 2021Sentiment Analysis of Fashion Related Posts in Social Mediacited by 2
  24. 2023Relevance Classification of Flood-related Twitter Posts via Multiple Transformerscited by 2
  25. 2023Image Captioners Sometimes Tell More Than Images They Seecited by 2
  26. 2023Multi-Similarity Contrastive Learningcited by 2
  27. 2024Zero-Shot Classification of Crisis Tweets Using Instruction-Finetuned Large Language Modelscited by 2
  28. 2025Mosaic: Data-Free Knowledge Distillation via Mixture-of-Experts for Heterogeneous Distributed Environmentscited by 2
  29. 2026DisasterInsight: A Building-Centric Benchmark for Evaluating Vision--Language Models in Disaster Responsecited by 2
  30. 2021Identification of Fine-Grained Location Mentions in Crisis Tweetscited by 1
  31. 2023Balanced Multi-modal Federated Learning via Cross-Modal Infiltrationcited by 1
  32. 2024Semantically Enriched Cross-Lingual Sentence Embeddings for Crisis-related Social Media Textscited by 1
  33. 2024ATSumm: Auxiliary information enhanced approach for abstractive disaster Tweet Summarization with sparse training datacited by 1
  34. 2024HumVI: A Multilingual Dataset for Detecting Violent Incidents Impacting Humanitarian Aidcited by 1
  35. 2025FedAPM: Federated Learning via ADMM with Partial Model Personalizationcited by 1
  36. 2025Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completioncited by 1
  37. 2025From Pixels to Damage Severity: Estimating Earthquake Impacts Using Semantic Segmentation of Social Media Imagescited by 1
  38. 2025Assessing On-the-Ground Disaster Impact Using Online Data Sourcescited by 1

50 most cited of 88 All 88 (JSON)