Concept-based explanations of Segmentation and Detection models in Natural Disaster Management
Not on the map. Why?
Abstract (arXiv)
Deep learning models for flood and wildfire segmentation and object detection enable precise, real-time disaster localization when deployed on embedded drone platforms. However, in natural disaster management, the lack of transparency in their decision-making process hinders human trust required for emergency response. To address this, we present an explainability framework for understanding flood segmentation and car detection predictions on the widely used PIDNet and YOLO architectures. More specifically, we introduce a novel redistribution strategy that extends Layer-wise Relevance Propagation (LRP) explanations for sigmoid-gated element-wise fusion layers. This extension allows LRP relevances to flow through the fusion modules of PIDNet, covering the entire computation graph back to the input image. Furthermore, we apply Prototypical Concept-based Explanations (PCX) to provide both local and global explanations at the concept level, revealing which learned features drive the segmentation and detection of specific disaster semantic classes. Experiments on a publicly available flood dataset show that our framework provides reliable and interpretable explanations while maintaining near real-time inference capabilities, rendering it suitable for deployment on resource-constrained platforms, such as Unmanned Aerial Vehicles (UAVs).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 36 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
16 of 36 references.
References · 16
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 416
- 2022YOLOv6: A Single-Stage Object Detection Framework for Industrial Applicationscited by 273
- 2022From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagationcited by 141
- 2020Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAIcited by 125
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2017Explaining Recurrent Neural Network Predictions in Sentiment Analysiscited by 87
- 2022PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllerscited by 84
- 2019Towards Best Practice in Explaining Neural Network Decisions with LRPcited by 70
4 more
- 2022Investigating the fidelity of explainable artificial intelligence methods for applications of convolutional neural networks in geosciencecited by 28
- 2023Understanding the (Extra-)Ordinary: Validating Deep Model Decisions with Prototypical Concept-based Explanationscited by 21
- 2022Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanationscited by 17
- 2025A Close Look at Decomposition-based XAI-Methods for Transformer Language Modelscited by 10
Built on by
Not cited yet.