Conditional Visual Evidence Utility: State-Dependent Rank Reversals in Frozen Vision-Language Encoders
Not on the map. Why?
Abstract (arXiv)
Static importance scores compress visual evidence into a single ranking, but the value of remaining evidence can change after one cue has been observed. We study this possibility in controlled compositional visual search, where color, shape, and texture evidence can be independently exposed and their conditional marginal utility measured across acquisition states. In a held-out confirmation on 800 scenes, frozen OpenCLIP and SigLIP exhibit robust state-dependent rank reversals that concentrate in candidate-overlap regimes designed to induce ordering changes, persist across two evidence-accumulation constructions and ten equivalent query wordings, and collapse to near-chance-scale behavior under query-scene derangement. A subsequent role-balanced follow-up on 1,200 scenes rotates the abstract roles of initially strong, redundancy-inducing, and comparator attributes; the positive-minus-negative reversal contrast remains positive across all 24 role-permutation, backbone, and evidence-mode cells, although residual attribute-identity effects remain. We further distinguish measured replanning opportunity from prospective predictability. Matched-first-action utility analyses show substantial opportunity to rerank remaining evidence, but lightweight predictors using posterior-based or acquired-embedding state representations do not establish a robust incremental advantage of acquired-state information over legal static controls on the role-balanced benchmark. Together, these results show that conditional visual evidence utility is reliably state dependent in this controlled setting, while separating the existence of changing utility from the stronger claim that those changes are prospectively predictable by a learned selector.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 10 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
10 of 10 references.
References · 10
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2025Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?cited by 76
- 2023Learning to Maximize Mutual Information for Dynamic Feature Selectioncited by 54
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understandingcited by 26
- 2023Estimating Conditional Mutual Information for Dynamic Feature Selectioncited by 20
- 2025Rethinking Visual Token Reduction in LVLMs Under Cross-Modal Misalignmentcited by 11
- 2026Question-guided Visual Compression with Memory Feedback for Long-Term Video Understandingcited by 3
- 2026The Perceptual Bandwidth Bottleneck in Vision-Language Models: Active Visual Reasoning via Sequential Experimental Designcited by 2
Built on by
Not cited yet.