Level, Sharpness, and Corpus: Why Zero-Shot OOD Detector Rankings Do Not Transfer
Not on the map. Why?
Abstract (arXiv)
Selecting a zero-shot out-of-distribution (OOD) detector for a new deployment is typically based on benchmark rankings, implicitly assuming that the highest-ranked detector will transfer across domains. We show that this assumption does not hold. Through a controlled portability audit across seventeen in-distribution datasets, three vision-language models, and seven representative zero-shot OOD detectors, we find that detector rankings reverse across deployments, every detector exceeds 80% FPR95 on at least one domain, and the preferred detector depends on both the in-distribution data and the underlying VLM. We trace these reversals to complementary evidence channels in vision-language logits. Corpus-free detectors rely on different combinations of absolute match level and relative or spatial sharpness, while WordNet-based methods additionally depend on external semantic coverage. A simple proposition shows that level and sharpness cannot generally be recovered from one another, explaining why no single detector transfers reliably across deployments. Motivated by this diagnosis, we introduce the Complementary Evidence Guard (CEG), a detector-agnostic wrapper that preserves complementary evidence through a non-compensatory fusion of the base detector, level, and sharpness using only empirical in-distribution percentiles. Controls replacing these channels with entropy, logit variance, or random noise do not reproduce the gains. Without OOD samples, auxiliary corpora, or learned fusion, CEG reduces detector sensitivity and improves GL-MCM from 38.1 to 28.8 and MCM from 42.6 to 30.5 family-balanced FPR95.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
16 of 32 references.
References · 16
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,331
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2021Extract Free Dense Labels from CLIPcited by 583
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
- 2021MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Spacecited by 233
- 2022Delving into Out-of-Distribution Detection with Vision-Language Representationscited by 216
4 more
- 2021Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIPcited by 152
- 2023In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluationcited by 134
- 2023CLIPN for Zero-Shot OOD Detection: Teaching CLIP to Say Nocited by 130
- 2023LoCoOp: Few-Shot Out-of-Distribution Detection via Prompt Learningcited by 107
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025OT-DETECTOR: Delving into Optimal Transport for Zero-shot Out-of-Distribution Detection
- 2023How Does Fine-Tuning Impact Out-of-Distribution Detection for Vision-Language Models?
- 2025An Empirical Analysis of VLM-based OOD Detection: Mechanisms, Advantages, and Sensitivity
- 2025Harnessing Large Language and Vision-Language Models for Robust Out-of-Distribution Detection
- 2024Conjugated Semantic Pool Improves OOD Detection with Pre-trained Vision-Language Models
- 2025A Benchmark and Evaluation for Real-World Out-of-Distribution Detection Using Vision-Language Models
- 2025VisTa: Visual-contextual and Text-augmented Zero-shot Object-level OOD Detection
- 2026TTL: Test-time Textual Learning for OOD Detection with Pretrained Vision-Language Models