mlsanityData to 14 Oct 2026

Open-Vocabulary vs Supervised Learning Methods for Post-Disaster Visual Scene Understanding

arXiv 2603.01324 ↗First posted 1 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Aerial imagery is critical for large-scale post-disaster damage assessment. Automated interpretation remains challenging due to clutter, visual variability, and strong cross-event domain shift, while supervised approaches still rely on costly, task-specific annotations with limited coverage across disaster types and regions. Recent open-vocabulary and foundation vision models offer an appealing alternative, by reducing dependence on fixed label sets and extensive task-specific annotations. Instead, they leverage large-scale pretraining and vision-language representations. These properties are particularly relevant for post-disaster domains, where visual concepts are ambiguous and data availability is constrained. In this work, we present a comparative evaluation of supervised learning and open-vocabulary vision models for post-disaster scene understanding, focusing on semantic segmentation and object detection across multiple datasets, including FloodNet+, RescueNet, DFire, and LADD. We examine performance trends, failure modes, and practical trade-offs between different learning paradigms, providing insight into their applicability for real-world disaster response. The most notable remark across all evaluated benchmarks is that supervised training remains the most reliable approach (i.e., when the label space is fixed and annotations are available), especially for small objects and fine boundary delineation in cluttered scenes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 57 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

44 of 57 references.

References · 44

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  7. 2023Segment Anythingcited by 8,234
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 2020End-to-End Object Detection with Transformerscited by 7,414
  10. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  11. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  12. 2022A ConvNet for the 2020scited by 3,579
32 more
  1. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  2. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  3. 2016Pyramid Scene Parsing Networkcited by 2,479
  4. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  5. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  6. 2025SAM 3: Segment Anything with Conceptscited by 906
  7. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 718
  8. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
  9. 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 533
  10. 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 375
  11. 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIPcited by 201
  12. 2022MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretrainingcited by 187
  13. 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
  14. 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 139
  15. 2024RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformercited by 91
  16. 2025YOLO26: Key Architectural Enhancements and Performance Benchmarking for Real-Time Object Detectioncited by 79
  17. 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 75
  18. 2023Open-Set Image Tagging with Multi-Grained Text Supervisioncited by 67
  19. 2022RescueNet: A High Resolution UAV Semantic Segmentation Benchmark Dataset for Natural Disaster Damage Assessmentcited by 40
  20. 2025YOLOE: Real-Time Seeing Anythingcited by 36
  21. 2025Real-Time Object Detection Meets DINOv3cited by 27
  22. 2022Incidents1M: a large-scale dataset of images with natural disasters, damage, and incidentscited by 26
  23. 2023Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directionscited by 25
  24. 2025SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Imagescited by 16
  25. 2022Backbones-Review: Feature Extraction Networks for Deep Learning and Deep Reinforcement Learning Approachescited by 15
  26. 2024Self-supervised visual learning in the low-data regime: a comparative evaluationcited by 11
  27. 2025Survey on Hand Gesture Recognition from Visual Inputcited by 10
  28. 2020Towards open and expandable cognitive AI architectures for large-scale multi-agent human-robot collaborative learningcited by 8
  29. 2021User profile-driven large-scale multi-agent learning from demonstration in federated human-robot collaborative environmentscited by 7
  30. 2025Exploring Energy Landscapes for Minimal Counterfactual Explanations: Applications in Cybersecurity and Beyondcited by 6
  31. 2024Distributed maze exploration using multiple agents and optimal goal assignmentcited by 5
  32. 2025TRIFFID: Autonomous Robotic Aid For Increasing First Responders Efficiencycited by 5

Built on by

Not cited yet.