Do vision-language models search like humans? Reasoning tokens as a reaction-time analog in classic visual-search paradigms
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Visual search has been one of the most productive paradigms in the study of visual attention: the way reaction time scales with the number of items distinguishes parallel, "pop-out" search from serial, attention-demanding search. I ask whether vision-language models (VLMs) exhibit the same behavioral signatures. I adapt four classic paradigms: feature versus conjunction search, spatial-configuration (T-vs-L) search, enumeration, and the tilted/vertical search asymmetry; and present them to current frontier and mid-tier models. Because a single model call has no reaction time, I use the number of reasoning ("thinking") tokens a model spends per trial as a within-model analog of search effort, and I compare against a large public human benchmark (Wolfe et al., 2010). The models reproduce several human signatures: feature search costs flat effort while conjunction effort climbs with set size; frontier models hold accuracy where mid-tier models collapse to chance; and a resolution control shows the conjunction cost is genuine search rather than difficulty resolving small shapes. They also diverge from humans in informative ways. The target-present effort slope exceeds the target-absent slope, reversing the human ordering; enumeration remains accurate where humans would lose count; and a reasoning model with adaptive deliberation declines to deliberate on detection tasks altogether, so that a single search expresses itself as an effort gradient in one model and as an accuracy cliff in another. I argue that psychophysical paradigms, applied behaviorally, are a sharp and inexpensive probe of machine visual cognition, and that the points of divergence are as informative as the points of agreement.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 16 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
5 of 16 references.
Closest ancestors · 1
Same direction, newest first
Other references · 4
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2024Vision language models are blind: Failing to translate detailed visual features into wordscited by 147
- 2024Understanding the Limits of Vision Language Models Through the Lens of the Binding Problemcited by 75
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025I Spy With My Model's Eye: Visual Search as a Behavioural Test for MLLMs
- 2026Matched Outcomes, Divergent Gaze: How Foveated MLLMs Search Compared to Humans
- 2026Seeing without Looking: Do Vision-Language Benchmarks Really Test Vision?
- 2026Are VLMs Seeing or Just Saying? Uncovering the Illusion of Visual Re-examination
- 2025Mixed Signals: Decoding VLMs' Reasoning and Underlying Bias in Vision-Language Conflict
- 2025VLMs have Tunnel Vision: Evaluating Nonlocal Visual Reasoning in Leading VLMs
- 2025Caption This, Reason That: VLMs Caught in the Middle
- 2025Can Vision-Language Models Count? A Synthetic Benchmark and Analysis of Attention-Based Interventions