SPK: Eliciting Structured Prior Knowledge for Interpretable Out-of-Distribution Detection in Real-Time Object Detection
Not on the map. Why?
Abstract (arXiv)
Object detectors often produce over-confident predictions for objects outside their training categories, leading to so-called out-of-distribution (OoD) hallucinations. Existing approaches for detecting or mitigating such hallucinations typically either construct scoring functions directly over learned object detector representations or modify the object detector itself to suppress hallucination emergence. However, the latent priors implicitly encoded in these representations remain largely unexplored and have not been explicitly decoded for OoD detection. To uncover and exploit these latent priors, we propose Structured Prior Knowledge (SPK), a hallucination-oriented framework that explicitly elicits OoD-relevant priors from pretrained object detectors. Specifically, SPK leverages in-distribution data and hallucination-inducing samples as diagnostic supervision to elicit part-level semantic concepts underlying object detector decision-making, rather than using them merely for rejection or object detector adaptation. The elicited semantic priors are further integrated with geometric and contextual priors to form a compact five-dimensional SPK representation for OoD detection. Extensive experiments across diverse object detector architectures and multiple OoD benchmarks demonstrate that SPK achieves state-of-the-art OoD detection. Our findings reveal that pretrained object detectors already encode substantially richer latent knowledge than is typically exploited for OoD detection. More importantly, this knowledge can be explicitly elicited and organized into a compact, structured, and interpretable knowledge space for prediction reliability analysis. This suggests a promising proactive route for improving object detector reliability by explicitly uncovering and leveraging latent priors. Code and data are available at: https://gricad-gitlab.univ-grenoble-alpes.fr/dnn-safety/spk
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 19 Aug 2026.
Builds on
26 of 44 references.
References · 26
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2013Describing Textures in the Wildcited by 2,125
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 708
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 515
14 more
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2018Net2Vec: Quantifying and Explaining how Concepts are Encoded by Filters in Deep Neural Networkscited by 129
- 2021OW-DETR: Open-world Detection Transformercited by 129
- 2019Large-scale interactive object segmentation with human annotatorscited by 110
- 2023Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancementcited by 77
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 2024PartGLEE: A Foundation Model for Recognizing and Parsing Any Objectscited by 15
- 2025Show and Tell: Visually Explainable Deep Neural Nets via Spatially-Aware Concept Bottleneck Modelscited by 12
- 2021Customizable Reference Runtime Monitoring of Neural Networks using Resolution Boxescited by 6
- 2024BAM: Box Abstraction Monitors for Real-time OoD Detection in Object Detectioncited by 5
- 2025Revisiting Out-of-Distribution Detection in Real-time Object Detection: From Benchmark Pitfalls to a New Mitigation Paradigmcited by 2
- 2026Knowing the Unknown: Interpretable Open-World Object Detection via Concept Decomposition Modelcited by 1
- 2026Mitigating Simplicity Bias in OOD Detection through Object Co-occurrence Analysiscited by 1
Built on by
Not cited yet.