MEDIC: A Multi-Task Learning Dataset for Disaster Image Classification
Not on the map. Why?
Abstract (arXiv)
Recent research in disaster informatics demonstrates a practical and important use case of artificial intelligence to save human lives and suffering during natural disasters based on social media contents (text and images). While notable progress has been made using texts, research on exploiting the images remains relatively under-explored. To advance image-based approaches, we propose MEDIC (Available at: https://crisisnlp.qcri.org/medic/index.html), which is the largest social media image classification dataset for humanitarian response consisting of 71,198 images to address four different tasks in a multi-task learning setup. This is the first dataset of its kind: social media images, disaster response, and multi-task learning research. An important property of this dataset is its high potential to facilitate research on multi-task learning, which recently receives much interest from the machine learning community and has shown remarkable results in terms of memory, inference speed, performance, and generalization capability. Therefore, the proposed dataset is an important resource for advancing image-based disaster management and multi-task machine learning research. We experiment with different deep learning architectures and report promising results, which are above the majority baselines for all tasks. Along with the dataset, we also release all relevant scripts (https://github.com/firojalam/medic).
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 46 of its 109 references that are in the map. First posted on arXiv 29 Aug 2021.
Builds on
46 of 109 references.
References · 46
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
34 more
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
- 2017A Survey on Multi-Task Learningcited by 838
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
- 2019Green AIcited by 620
- 2016Cross-stitch Networks for Multi-task Learningcited by 466
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 374
- 2014CNN Features off-the-shelf: an Astounding Baseline for Recognitioncited by 316
- 2014Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Partscited by 230
- 2016UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memorycited by 200
- 2018NDDR-CNN: Layerwise Feature Fusing in Multi-Task CNNs by Neural Discriminative Dimensionality Reductioncited by 127
- 2018CrisisMMD: Multimodal Twitter Datasets from Natural Disasterscited by 88
- 2016Deep Multi-task Representation Learning: A Tensor Factorisation Approachcited by 69
- 2014Processing Social Media Messages in Mass Emergency: A Surveycited by 50
- 2016Twitter as a Lifeline: Human-annotated Twitter Corpora for NLP of Crisis-related Messagescited by 43
- 2021HumAID: Human-Annotated Disaster Incidents Data from Twitter with Deep Learning Benchmarkscited by 38
- 2016A Unified View of Multi-Label Performance Measurescited by 36
- 2018Domain Adaptation with Adversarial Training and Graph Embeddingscited by 30
- 2019Natural Disasters Detection in Social Media and Satellite imagery: a surveycited by 27
- 2020Multi-task learning for natural language processing in the 2020s: where are we going?cited by 27
- 2020Analysis of Social Media Data using Multimodal Deep Learning for Disaster Responsecited by 23
- 2020Detecting natural disasters, damage, and incidents in the wildcited by 23
- 2020Deep Learning Benchmarks and Datasets for Social Media Image Classification for Disaster Responsecited by 19
- 2019Sentiment Analysis from Images of Natural Disasterscited by 10
- 2019Learning Task Relatedness in Multi-Task Learning for Images in Contextcited by 9
- 2017Automatic Image Filtering on Social Networks Using Deep Learning and Perceptual Hashing During Crisescited by 8
- 2016How Transferable are CNN-based Features for Age and Gender Classification?cited by 7
- 2018Localizing and Quantifying Damage in Social Media Imagescited by 7
- 2020Rapid Damage Assessment Using Social Media Images by Combining Human and Machine Intelligencecited by 7
- 2021Robust Training of Social Media Image Classification Models for Rapid Disaster Responsecited by 4
Built on by
Citing papers per year: 2022: 6; 2023: 3; 2024: 3; 2025: 4; 2026: 4.
20 papers.
Sort:
By area:
- 2022MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuningcited by 109
- 2023ReForm-Eval: Evaluating Large Vision Language Models via Unified Re-Formulation of Task-Oriented Benchmarkscited by 12
- 2024A social context-aware graph-based multimodal attentive learning framework for disaster content classification during emergencies: a benchmark dataset and methodcited by 12
- 2023A Study of Autoregressive Decoders for Multi-Tasking in Computer Visioncited by 10
- 2022NADBenchmarks -- a compilation of Benchmark Datasets for Machine Learning Tasks related to Natural Disasterscited by 4
- 2022Deep-Disaster: Unsupervised Disaster Detection and Localization Using Visual Datacited by 3
- 2024DiRecNetV2: A Transformer-Enhanced Network for Aerial Disaster Recognitioncited by 3
- 2026TinyML Enhances CubeSat Mission Capabilitiescited by 3
- 2022Detecting the Role of an Entity in Harmful Memes: Techniques and Their Limitationscited by 2
- 2022Few-shot Learning for Multi-modal Social Media Event Filteringcited by 2
- 2023Multi-Similarity Contrastive Learningcited by 2
- 2024MTL-Split: Multi-Task Learning for Edge Devices using Split Computingcited by 2
8 more
- 2025Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Networkcited by 2
- 2022TeamX@DravidianLangTech-ACL2022: A Comparative Analysis for Troll-Based Meme Classificationcited by 1
- 2025From Pixels to Damage Severity: Estimating Earthquake Impacts Using Semantic Segmentation of Social Media Imagescited by 1
- 2026DisasterVQA: A Visual Question Answering Benchmark Dataset for Disaster Scenescited by 1
- 2026AI-generated Images Challenge Visual Trust in High-risk Scenarioscited by 1
- 2025Can We Predict the Unpredictable? Leveraging DisasterNet-LLM for Multimodal Disaster Classificationcited by 0
- 2025VISAT: Benchmarking Adversarial and Distribution Shift Robustness in Traffic Sign Recognition with Visual Attributescited by 0
- 2026Survey on Disaster Management Datasets for Remote Sensing Based Emergency Applicationscited by 0
- 2026AI-generated Images Challenge Visual Trust in High-risk Scenarios23 Jul 2026
- 2026Survey on Disaster Management Datasets for Remote Sensing Based Emergency Applications5 May 2026
- 2026TinyML Enhances CubeSat Mission Capabilities20 Mar 2026
- 2026DisasterVQA: A Visual Question Answering Benchmark Dataset for Disaster Scenes20 Jan 2026
- 2025VISAT: Benchmarking Adversarial and Distribution Shift Robustness in Traffic Sign Recognition with Visual Attributes29 Oct 2025
- 2025From Pixels to Damage Severity: Estimating Earthquake Impacts Using Semantic Segmentation of Social Media Images3 Jul 2025
- 2025Can We Predict the Unpredictable? Leveraging DisasterNet-LLM for Multimodal Disaster Classification30 Jun 2025
- 2025Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Network14 May 2025
- 2024DiRecNetV2: A Transformer-Enhanced Network for Aerial Disaster Recognition17 Oct 2024
- 2024A social context-aware graph-based multimodal attentive learning framework for disaster content classification during emergencies: a benchmark dataset and method11 Oct 2024
- 2024MTL-Split: Multi-Task Learning for Edge Devices using Split Computing8 Jul 2024
- 2023ReForm-Eval: Evaluating Large Vision Language Models via Unified Re-Formulation of Task-Oriented Benchmarks4 Oct 2023
8 more
- 2023Multi-Similarity Contrastive Learning6 Jul 2023
- 2023A Study of Autoregressive Decoders for Multi-Tasking in Computer Vision30 Mar 2023
- 2022MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning21 Dec 2022
- 2022NADBenchmarks -- a compilation of Benchmark Datasets for Machine Learning Tasks related to Natural Disasters21 Dec 2022
- 2022Few-shot Learning for Multi-modal Social Media Event Filtering16 Nov 2022
- 2022TeamX@DravidianLangTech-ACL2022: A Comparative Analysis for Troll-Based Meme Classification9 May 2022
- 2022Detecting the Role of an Entity in Harmful Memes: Techniques and Their Limitations9 May 2022
- 2022Deep-Disaster: Unsupervised Disaster Detection and Localization Using Visual Data31 Jan 2022
- 2022MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuningcited by 109
- 2024A social context-aware graph-based multimodal attentive learning framework for disaster content classification during emergencies: a benchmark dataset and methodcited by 12
- 2023A Study of Autoregressive Decoders for Multi-Tasking in Computer Visioncited by 10
- 2022NADBenchmarks -- a compilation of Benchmark Datasets for Machine Learning Tasks related to Natural Disasterscited by 4
- 2022Deep-Disaster: Unsupervised Disaster Detection and Localization Using Visual Datacited by 3
- 2024DiRecNetV2: A Transformer-Enhanced Network for Aerial Disaster Recognitioncited by 3
- 2026TinyML Enhances CubeSat Mission Capabilitiescited by 3
- 2022Detecting the Role of an Entity in Harmful Memes: Techniques and Their Limitationscited by 2
- 2022Few-shot Learning for Multi-modal Social Media Event Filteringcited by 2
- 2023Multi-Similarity Contrastive Learningcited by 2
- 2024MTL-Split: Multi-Task Learning for Edge Devices using Split Computingcited by 2
- 2025Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Networkcited by 2
12 most cited of 18 All 18 (JSON)
- 2026AI-generated Images Challenge Visual Trust in High-risk Scenarios23 Jul 2026
- 2026Survey on Disaster Management Datasets for Remote Sensing Based Emergency Applications5 May 2026
- 2026TinyML Enhances CubeSat Mission Capabilities20 Mar 2026
- 2025VISAT: Benchmarking Adversarial and Distribution Shift Robustness in Traffic Sign Recognition with Visual Attributes29 Oct 2025
- 2025From Pixels to Damage Severity: Estimating Earthquake Impacts Using Semantic Segmentation of Social Media Images3 Jul 2025
- 2025Can We Predict the Unpredictable? Leveraging DisasterNet-LLM for Multimodal Disaster Classification30 Jun 2025
- 2025Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Network14 May 2025
- 2024DiRecNetV2: A Transformer-Enhanced Network for Aerial Disaster Recognition17 Oct 2024
- 2024A social context-aware graph-based multimodal attentive learning framework for disaster content classification during emergencies: a benchmark dataset and method11 Oct 2024
- 2024MTL-Split: Multi-Task Learning for Edge Devices using Split Computing8 Jul 2024
- 2023Multi-Similarity Contrastive Learning6 Jul 2023
- 2023A Study of Autoregressive Decoders for Multi-Tasking in Computer Vision30 Mar 2023
12 newest of 18 All 18 (JSON)