Finding any Waldo: zero-shot invariant and efficient visual search
Not on the map. Why?
Abstract (arXiv)
Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work has focused on searching for perfect matches of a target after extensive category-specific training. Here we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 4; 2022: 4; 2023: 5; 2024: 6; 2025: 5; 2026: 3.
28 papers.
Sort:
By area:
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2020Predicting Goal-directed Human Attention Using Inverse Reinforcement Learningcited by 53
- 2025DyFo: A Training-Free Dynamic Focus Visual Search for Enhancing LMMs in Fine-Grained Visual Understandingcited by 47
- 2023Gazeformer: Scalable, Effective and Fast Prediction of Goal-Directed Human Attentioncited by 37
- 2023Training-free Object Counting with Promptscited by 34
- 2023Unifying Top-down and Bottom-up Scanpath Prediction Using Transformerscited by 22
- 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priorscited by 16
- 2021Visual Search Asymmetry: Deep Nets and Humans Share Similar Inherent Biasescited by 12
- 2021Look Twice: A Generalist Computational Model Predicts Return Fixations across Tasks and Speciescited by 8
- 2022Efficient Zero-shot Visual Search via Target and Context-aware Transformercited by 7
- 2025CoFFT: Chain of Foresight-Focus Thought for Visual Language Modelscited by 6
- 2024Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion Perceptioncited by 5
16 more
- 2024TPP-Gaze: Modelling Gaze Dynamics in Space and Time with Neural Temporal Point Processescited by 4
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstructioncited by 4
- 2026DRS-GUI: Dynamic Region Search for Training-Free GUI Groundingcited by 3
- 2023Learning to search for and detect objects in foveal images using deep learningcited by 2
- 2024Gazing at Rewards: Eye Movements as a Lens into Human and AI Decision-Making in Hybrid Visual Foragingcited by 2
- 2025Human Scanpath Prediction in Target-Present Visual Search with Semantic-Foveal Bayesian Attentioncited by 2
- 2022Learning to See the Elephant in the Room: Self-Supervised Context Reasoning in Humans and AIcited by 1
- 2024Semantic-Based Active Perception for Humanoid Visual Tasks with Foveal Sensorscited by 1
- 2024GazeSearch: Radiology Findings Search Benchmarkcited by 1
- 2021CNN-based search model underestimates attention guidance by simple visual featurescited by 0
- 2021Benchmarking human visual search computational models in natural scenes: models comparison and reference datasetscited by 0
- 2022Predicting Visual Attention and Distraction During Visual Search Using Convolutional Neural Networkscited by 0
- 2022Can Machines Imitate Humans? Integrative Turing-like tests for Language and Vision Demonstrate a Narrowing Gapcited by 0
- 2025Saccade crossing avoidance as a visual search strategycited by 0
- 2026Cost-Efficient Multi-Scale Fovea for Semantic-Based Visual Search Attentioncited by 0
- 2026Task-driven Processing with Coarse-to-Fine Glimpse-based Active Perceptioncited by 0
- 2026Task-driven Processing with Coarse-to-Fine Glimpse-based Active Perception8 Sep 2026
- 2026DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding15 May 2026
- 2026Cost-Efficient Multi-Scale Fovea for Semantic-Based Visual Search Attention4 Apr 2026
- 2025CoFFT: Chain of Foresight-Focus Thought for Visual Language Models26 Sep 2025
- 2025Saccade crossing avoidance as a visual search strategy25 Aug 2025
- 2025Human Scanpath Prediction in Target-Present Visual Search with Semantic-Foveal Bayesian Attention24 Jul 2025
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstruction17 Jun 2025
- 2025DyFo: A Training-Free Dynamic Focus Visual Search for Enhancing LMMs in Fine-Grained Visual Understanding21 Apr 2025
- 2024Gazing at Rewards: Eye Movements as a Lens into Human and AI Decision-Making in Hybrid Visual Foraging14 Nov 2024
- 2024GazeSearch: Radiology Findings Search Benchmark8 Nov 2024
- 2024TPP-Gaze: Modelling Gaze Dynamics in Space and Time with Neural Temporal Point Processes30 Oct 2024
- 2024Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion Perception26 May 2024
16 more
- 2024Semantic-Based Active Perception for Humanoid Visual Tasks with Foveal Sensors16 Apr 2024
- 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priors8 Mar 2024
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs21 Dec 2023
- 2023Training-free Object Counting with Prompts30 Jun 2023
- 2023Learning to search for and detect objects in foveal images using deep learning12 Apr 2023
- 2023Gazeformer: Scalable, Effective and Fast Prediction of Goal-Directed Human Attention27 Mar 2023
- 2023Unifying Top-down and Bottom-up Scanpath Prediction Using Transformers16 Mar 2023
- 2022Efficient Zero-shot Visual Search via Target and Context-aware Transformer24 Nov 2022
- 2022Can Machines Imitate Humans? Integrative Turing-like tests for Language and Vision Demonstrate a Narrowing Gap23 Nov 2022
- 2022Learning to See the Elephant in the Room: Self-Supervised Context Reasoning in Humans and AI23 Nov 2022
- 2022Predicting Visual Attention and Distraction During Visual Search Using Convolutional Neural Networks27 Oct 2022
- 2021Benchmarking human visual search computational models in natural scenes: models comparison and reference datasets10 Dec 2021
- 2021Visual Search Asymmetry: Deep Nets and Humans Share Similar Inherent Biases5 Jun 2021
- 2021CNN-based search model underestimates attention guidance by simple visual features29 Mar 2021
- 2021Look Twice: A Generalist Computational Model Predicts Return Fixations across Tasks and Species5 Jan 2021
- 2020Predicting Goal-directed Human Attention Using Inverse Reinforcement Learning28 May 2020
- 2025DyFo: A Training-Free Dynamic Focus Visual Search for Enhancing LMMs in Fine-Grained Visual Understandingcited by 47
- 2023Gazeformer: Scalable, Effective and Fast Prediction of Goal-Directed Human Attentioncited by 37
- 2023Training-free Object Counting with Promptscited by 34
- 2023Unifying Top-down and Bottom-up Scanpath Prediction Using Transformerscited by 22
- 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priorscited by 16
- 2021Visual Search Asymmetry: Deep Nets and Humans Share Similar Inherent Biasescited by 12
- 2021Look Twice: A Generalist Computational Model Predicts Return Fixations across Tasks and Speciescited by 8
- 2022Efficient Zero-shot Visual Search via Target and Context-aware Transformercited by 7
- 2024Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion Perceptioncited by 5
- 2024TPP-Gaze: Modelling Gaze Dynamics in Space and Time with Neural Temporal Point Processescited by 4
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstructioncited by 4
- 2023Learning to search for and detect objects in foveal images using deep learningcited by 2
12 most cited of 24 All 24 (JSON)
- 2026Task-driven Processing with Coarse-to-Fine Glimpse-based Active Perception8 Sep 2026
- 2026Cost-Efficient Multi-Scale Fovea for Semantic-Based Visual Search Attention4 Apr 2026
- 2025Saccade crossing avoidance as a visual search strategy25 Aug 2025
- 2025Human Scanpath Prediction in Target-Present Visual Search with Semantic-Foveal Bayesian Attention24 Jul 2025
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstruction17 Jun 2025
- 2025DyFo: A Training-Free Dynamic Focus Visual Search for Enhancing LMMs in Fine-Grained Visual Understanding21 Apr 2025
- 2024Gazing at Rewards: Eye Movements as a Lens into Human and AI Decision-Making in Hybrid Visual Foraging14 Nov 2024
- 2024GazeSearch: Radiology Findings Search Benchmark8 Nov 2024
- 2024TPP-Gaze: Modelling Gaze Dynamics in Space and Time with Neural Temporal Point Processes30 Oct 2024
- 2024Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion Perception26 May 2024
- 2024Semantic-Based Active Perception for Humanoid Visual Tasks with Foveal Sensors16 Apr 2024
- 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priors8 Mar 2024
12 newest of 24 All 24 (JSON)