Det-LIME: Detector-Aware, Multi-Instance Local Interpretable Model-Agnostic Explanations for Automated Marine Mammal Detection
Not on the map. Why?
Abstract (arXiv)
Despite the rapid uptake of black-box object detectors in marine mammal research and monitoring, explainability techniques are rarely integrated into conservation workflows. Furthermore, most classification-oriented explainability tools are ill-suited to detection tasks involving imagery of social organisms or those with colonial life histories, as they ignore multiple detections within a scene and produce single-instance outputs that blur evidence across individuals. These methods also generate low-resolution, often biologically irrelevant visuals, limiting their utility for debugging, targeted data augmentation, and refined data collection. We proposed Det-LIME, a detector-aware, multi-instance adaptation of Local Interpretable Model-Agnostic Explanations (LIME) that produced instance-specific, box-aligned explanations by combining per-detection weighting, a proximity kernel that emphasizes regions near each box, and Intersection-over-Union-based matching to track the same instance across perturbations. We evaluated Det-LIME on aerial drone imagery for harbor seal detection, with an additional seabird case study to assess generality, and compared it with vanilla LIME, Stabilized LIME, Deterministic LIME, and gradient-based attribution methods. Using the Attribution Ratio and Max Saliency Hit Rate metrics, we showed that Det-LIME consistently improved multi-instance attribution. In practice, these higher-resolution, instance-aware explanations provide insight into model outputs and support post-processing, debugging, and actionable improvements in modeling and data collection or augmentation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
12 of 31 references.
References · 12
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 425
- 2016Top-down Neural Attention by Excitation Backpropcited by 321
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
- 2020Black-box Explanation of Object Detectors via Saliency Mapscited by 76
- 2021S-LIME: Stabilized-LIME for Model Explanationcited by 52
- 2021A first step towards automated species recognition from camera trap images of mammals using AI in a European temperate forestcited by 3
- 2025Photorealistic Inpainting for Perturbation-based Explanations in Ecological Monitoringcited by 2
Built on by
Not cited yet.