CAT2000: A Large Scale Fixation Dataset for Boosting Saliency Research
Not on the map. Why?
Abstract (arXiv)
Saliency modeling has been an active research area in computer vision for about two decades. Existing state of the art models perform very well in predicting where people look in natural scenes. There is, however, the risk that these models may have been overfitting themselves to available small scale biased datasets, thus trapping the progress in a local minimum. To gain a deeper insight regarding current issues in saliency modeling and to better gauge progress, we recorded eye movements of 120 observers while they freely viewed a large number of naturalistic and artificial images. Our stimuli includes 4000 images; 200 from each of 20 categories covering different types of scenes such as Cartoons, Art, Objects, Low resolution images, Indoor, Outdoor, Jumbled, Random, and Line drawings. We analyze some basic properties of this dataset and compare some successful models. We believe that our dataset opens new challenges for the next generation of saliency models and helps conduct behavioral studies on bottom-up visual attention.
Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 May 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 10; 2022: 5; 2023: 8; 2024: 14; 2025: 7; 2026: 7.
52 papers.
Sort:
By area:
- 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingcited by 56
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2021TranSalNet: Towards perceptually relevant visual saliency predictioncited by 44
- 2019MEDIRL: Predicting the Visual Attention of Drivers via Maximum Entropy Deep Inverse Reinforcement Learningcited by 29
- 2021GOO: A Dataset for Gaze Object Prediction in Retail Environmentscited by 26
- 2023TempSAL -- Uncovering Temporal Information for Deep Saliency Predictioncited by 25
- 2021State-of-the-Art in Human Scanpath Predictioncited by 22
- 2021Image Cropping on Twitter: Fairness Metrics, their Limitations, and the Importance of Representation, Design, and Agencycited by 22
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
- 2022Rectify ViT Shortcut Learning by Visual Saliencycited by 14
- 2024Beyond Average: Individualized Visual Scanpath Predictioncited by 12
- 2024SUM: Saliency Unification through Mamba for Visual Attention Modelingcited by 12
38 more
- 2022Behind the Machine's Gaze: Neural Networks with Biologically-inspired Constraints Exhibit Human-like Visual Attentioncited by 7
- 2023UniAR: A Unified model for predicting human Attention and Responses on visual contentcited by 7
- 2024How is Visual Attention Influenced by Text Guidance? Database and Modelcited by 7
- 2024Brand Visibility in Packaging: A Deep Learning Approach for Logo Detection, Saliency-Map Prediction, and Logo Placement Analysiscited by 6
- 2024Data Augmentation via Latent Diffusion for Saliency Predictioncited by 5
- 2025DiffEye: Diffusion-Based Continuous Eye-Tracking Data Generation Conditioned on Natural Imagescited by 5
- 2023What Do Deep Saliency Models Learn about Visual Attention?cited by 4
- 2024GazeFusion: Saliency-Guided Image Generationcited by 4
- 2024RClicks: Realistic Click Simulation for Benchmarking Interactive Segmentationcited by 4
- 2025Modeling Saliency Dataset Biascited by 4
- 2021A Dataset for Provident Vehicle Detection at Nightcited by 3
- 2023Survey of Consciousness Theory from Computational Perspectivecited by 3
- 2021Matching Representations of Explainable Artificial Intelligence and Eye Gaze for Human-Machine Interactioncited by 2
- 2021Modeling Object Dissimilarity for Deep Saliency Predictioncited by 2
- 2023Learning Saliency From Fixationscited by 2
- 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Imagescited by 2
- 2024Varying Manifolds in Diffusion: From Time-varying Geometries to Visual Saliencycited by 2
- 2025Quality Assessment and Distortion-aware Saliency Prediction for AI-Generated Omnidirectional Imagescited by 2
- 2025Towards Physics-informed Spatial Intelligence with Human Priors: An Autonomous Driving Pilot Studycited by 2
- 2022Attention in Reasoning: Dataset, Analysis, and Modelingcited by 1
- 2023NPF-200: A Multi-Modal Eye Fixation Dataset and Method for Non-Photorealistic Videoscited by 1
- 2024Semantic-Based Active Perception for Humanoid Visual Tasks with Foveal Sensorscited by 1
- 2024Bridging the Gap Between Saliency Prediction and Image Quality Assessmentcited by 1
- 2024MDS-ViTNet: Improving saliency prediction for Eye-Tracking with Vision Transformercited by 1
- 2024VISTA: A Visual and Textual Attention Dataset for Interpreting Multimodal Modelscited by 1
- 2026Raising the Ceiling: Better Empirical Fixation Densities for Saliency Benchmarkingcited by 1
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modelingcited by 1
- 2026DeepGaze3.5-VL: Modeling Scanpaths via Autoregressive Token Predictioncited by 1
- 2021Noise-Aware Video Saliency Predictioncited by 0
- 2021Saliency for free: Saliency prediction as a side-effect of object recognitioncited by 0
- 2022Combining Visual Saliency Methods and Sparse Keypoint Annotations to Providently Detect Vehicles at Nightcited by 0
- 2022Saliency map using features derived from spiking neural networks of primate visual cortexcited by 0
- 2023Int-HRL: Towards Intention-based Hierarchical Reinforcement Learningcited by 0
- 2025Visual Attention Graphcited by 0
- 2025A Comparative Study of Scanpath Models in Graph-Based Visualizationcited by 0
- 2025EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Modelscited by 0
- 2026ObjectVisA-120: Object-based Visual Attention Prediction in Interactive Street-crossing Environmentscited by 0
- 2026Gaze-DETR: Top-Down Guidance Through Priority Maps for Infrared Weak-Small UAV Detection with DETRcited by 0
50 most cited of 52 All 52 (JSON)
- 2026OpenVAM: Open-World Visual Attention Modeling with VLMs25 Sep 2026
- 2026Amplify What You Gaze At: Target Saliency Boosting in Text-to-Image Generation25 Sep 2026
- 2026Gaze-DETR: Top-Down Guidance Through Priority Maps for Infrared Weak-Small UAV Detection with DETR21 Jul 2026
- 2026DeepGaze3.5-VL: Modeling Scanpaths via Autoregressive Token Prediction2 Jul 2026
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modeling2 Jun 2026
- 2026Raising the Ceiling: Better Empirical Fixation Densities for Saliency Benchmarking5 May 2026
- 2026ObjectVisA-120: Object-based Visual Attention Prediction in Interactive Street-crossing Environments19 Jan 2026
- 2025EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models30 Oct 2025
- 2025Towards Physics-informed Spatial Intelligence with Human Priors: An Autonomous Driving Pilot Study24 Oct 2025
- 2025DiffEye: Diffusion-Based Continuous Eye-Tracking Data Generation Conditioned on Natural Images20 Sep 2025
- 2025Quality Assessment and Distortion-aware Saliency Prediction for AI-Generated Omnidirectional Images27 Jun 2025
- 2025Modeling Saliency Dataset Bias15 May 2025
38 more
- 2025A Comparative Study of Scanpath Models in Graph-Based Visualization31 Mar 2025
- 2025Visual Attention Graph11 Mar 2025
- 2024RClicks: Realistic Click Simulation for Benchmarking Interactive Segmentation15 Oct 2024
- 2024VISTA: A Visual and Textual Attention Dataset for Interpreting Multimodal Models6 Oct 2024
- 2024Data Augmentation via Latent Diffusion for Saliency Prediction11 Sep 2024
- 2024SUM: Saliency Unification through Mamba for Visual Attention Modeling25 Jun 2024
- 2024Varying Manifolds in Diffusion: From Time-varying Geometries to Visual Saliency7 Jun 2024
- 2024MDS-ViTNet: Improving saliency prediction for Eye-Tracking with Vision Transformer29 May 2024
- 2024Bridging the Gap Between Saliency Prediction and Image Quality Assessment8 May 2024
- 2024Beyond Average: Individualized Visual Scanpath Prediction18 Apr 2024
- 2024Semantic-Based Active Perception for Humanoid Visual Tasks with Foveal Sensors16 Apr 2024
- 2024How is Visual Attention Influenced by Text Guidance? Database and Model11 Apr 2024
- 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Images26 Mar 2024
- 2024GazeFusion: Saliency-Guided Image Generation16 Mar 2024
- 2024Brand Visibility in Packaging: A Deep Learning Approach for Logo Detection, Saliency-Map Prediction, and Logo Placement Analysis4 Mar 2024
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review8 Feb 2024
- 2023UniAR: A Unified model for predicting human Attention and Responses on visual content15 Dec 2023
- 2023Learning Saliency From Fixations23 Nov 2023
- 2023What Do Deep Saliency Models Learn about Visual Attention?14 Oct 2023
- 2023Survey of Consciousness Theory from Computational Perspective18 Sep 2023
- 2023NPF-200: A Multi-Modal Eye Fixation Dataset and Method for Non-Photorealistic Videos23 Aug 2023
- 2023Int-HRL: Towards Intention-based Hierarchical Reinforcement Learning20 Jun 2023
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embedding17 Mar 2023
- 2023TempSAL -- Uncovering Temporal Information for Deep Saliency Prediction5 Jan 2023
- 2022Rectify ViT Shortcut Learning by Visual Saliency17 Jun 2022
- 2022Saliency map using features derived from spiking neural networks of primate visual cortex2 May 2022
- 2022Combining Visual Saliency Methods and Sparse Keypoint Annotations to Providently Detect Vehicles at Night25 Apr 2022
- 2022Attention in Reasoning: Dataset, Analysis, and Modeling20 Apr 2022
- 2022Behind the Machine's Gaze: Neural Networks with Biologically-inspired Constraints Exhibit Human-like Visual Attention19 Apr 2022
- 2021TranSalNet: Towards perceptually relevant visual saliency prediction7 Oct 2021
- 2021Saliency for free: Saliency prediction as a side-effect of object recognition20 Jul 2021
- 2021A Dataset for Provident Vehicle Detection at Night27 May 2021
- 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modeling26 May 2021
- 2021GOO: A Dataset for Gaze Object Prediction in Retail Environments22 May 2021
- 2021Image Cropping on Twitter: Fairness Metrics, their Limitations, and the Importance of Representation, Design, and Agency18 May 2021
- 2021Noise-Aware Video Saliency Prediction16 Apr 2021
- 2021Modeling Object Dissimilarity for Deep Saliency Prediction8 Apr 2021
- 2021State-of-the-Art in Human Scanpath Prediction24 Feb 2021
50 newest of 52 All 52 (JSON)
- 2024Data Augmentation via Latent Diffusion for Saliency Predictioncited by 5
- 2025DiffEye: Diffusion-Based Continuous Eye-Tracking Data Generation Conditioned on Natural Imagescited by 5
- 2024GazeFusion: Saliency-Guided Image Generationcited by 4
- 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Imagescited by 2
- 2025EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Modelscited by 0
- 2025EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models30 Oct 2025
- 2025DiffEye: Diffusion-Based Continuous Eye-Tracking Data Generation Conditioned on Natural Images20 Sep 2025
- 2024Data Augmentation via Latent Diffusion for Saliency Prediction11 Sep 2024
- 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Images26 Mar 2024
- 2024GazeFusion: Saliency-Guided Image Generation16 Mar 2024
- 2022Attention in Reasoning: Dataset, Analysis, and Modelingcited by 1
- 2022Attention in Reasoning: Dataset, Analysis, and Modeling20 Apr 2022
- 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingcited by 56
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2021TranSalNet: Towards perceptually relevant visual saliency predictioncited by 44
- 2021GOO: A Dataset for Gaze Object Prediction in Retail Environmentscited by 26
- 2023TempSAL -- Uncovering Temporal Information for Deep Saliency Predictioncited by 25
- 2021State-of-the-Art in Human Scanpath Predictioncited by 22
- 2021Image Cropping on Twitter: Fairness Metrics, their Limitations, and the Importance of Representation, Design, and Agencycited by 22
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
- 2022Rectify ViT Shortcut Learning by Visual Saliencycited by 14
- 2024Beyond Average: Individualized Visual Scanpath Predictioncited by 12
- 2022Behind the Machine's Gaze: Neural Networks with Biologically-inspired Constraints Exhibit Human-like Visual Attentioncited by 7
- 2023UniAR: A Unified model for predicting human Attention and Responses on visual contentcited by 7
12 most cited of 44 All 44 (JSON)
- 2026OpenVAM: Open-World Visual Attention Modeling with VLMs25 Sep 2026
- 2026Amplify What You Gaze At: Target Saliency Boosting in Text-to-Image Generation25 Sep 2026
- 2026Gaze-DETR: Top-Down Guidance Through Priority Maps for Infrared Weak-Small UAV Detection with DETR21 Jul 2026
- 2026DeepGaze3.5-VL: Modeling Scanpaths via Autoregressive Token Prediction2 Jul 2026
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modeling2 Jun 2026
- 2026Raising the Ceiling: Better Empirical Fixation Densities for Saliency Benchmarking5 May 2026
- 2026ObjectVisA-120: Object-based Visual Attention Prediction in Interactive Street-crossing Environments19 Jan 2026
- 2025Towards Physics-informed Spatial Intelligence with Human Priors: An Autonomous Driving Pilot Study24 Oct 2025
- 2025Quality Assessment and Distortion-aware Saliency Prediction for AI-Generated Omnidirectional Images27 Jun 2025
- 2025Modeling Saliency Dataset Bias15 May 2025
- 2025A Comparative Study of Scanpath Models in Graph-Based Visualization31 Mar 2025
- 2025Visual Attention Graph11 Mar 2025
12 newest of 44 All 44 (JSON)