A Deep Multi-Level Network for Saliency Prediction
Not on the map. Why?
Abstract (arXiv)
This paper presents a novel deep architecture for saliency prediction. Current state of the art models for saliency prediction employ Fully Convolutional networks that perform a non-linear combination of features extracted from the last convolutional layer to predict saliency maps. We propose an architecture which, instead, combines features extracted at different levels of a Convolutional Neural Network (CNN). Our model is composed of three main blocks: a feature extraction CNN, a feature encoding network, that weights low and high level feature maps, and a prior learning network. We compare our solution with state of the art saliency models on two public benchmarks datasets. Results show that our model outperforms under all evaluation metrics on the SALICON dataset, which is currently the largest public dataset for saliency prediction, and achieves competitive results on the MIT300 benchmark.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 8; 2023: 9; 2024: 10; 2025: 6; 2026: 8.
54 papers.
Sort:
By area:
- 2022Learning Affordance Grounding from Exocentric Imagescited by 82
- 2021DRIVE: Deep Reinforced Accident Anticipation with Visual Explanationcited by 46
- 2021TranSalNet: Towards perceptually relevant visual saliency predictioncited by 44
- 2023Affordance Grounding from Demonstration Video to Target Imagecited by 34
- 2021Learning Visual Affordance Grounding from Demonstration Videoscited by 25
- 2023TempSAL -- Uncovering Temporal Information for Deep Saliency Predictioncited by 25
- 2022Grounded Affordance from Exocentric Viewcited by 21
- 2021Spatio-Temporal Self-Attention Network for Video Saliency Predictioncited by 19
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
- 2022Saliency in Augmented Realitycited by 17
- 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmarkcited by 16
- 2022Rectify ViT Shortcut Learning by Visual Saliencycited by 14
38 more
- 2024INTRA: Interaction Relationship-aware Weakly Supervised Affordance Groundingcited by 12
- 2021MAAD: A Model and Dataset for "Attended Awareness" in Drivingcited by 9
- 2021SalFBNet: Learning Pseudo-Saliency Distribution via Feedback Convolutional Networkscited by 9
- 2021Attention mechanisms and deep learning for machine vision: A survey of the state of the artcited by 8
- 2021SALYPATH: A Deep-Based Architecture for visual attention predictioncited by 7
- 2023Audio-visual Saliency for Omnidirectional Videoscited by 7
- 2024How is Visual Attention Influenced by Text Guidance? Database and Modelcited by 7
- 2026Agentic Retoucher for Text-To-Image Generationcited by 7
- 2024Data Augmentation via Latent Diffusion for Saliency Predictioncited by 5
- 2023Scanpath Prediction in Panoramic Videos via Expected Code Length Minimizationcited by 4
- 2023Rethinking Object Saliency Ranking: A Novel Whole-flow Processing Paradigmcited by 4
- 2024Learning User Embeddings from Human Gaze for Personalised Saliency Predictioncited by 4
- 2024How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Modelcited by 4
- 2025SalM2: An Extremely Lightweight Saliency Mamba Model for Real-Time Cognitive Awareness of Driver Attentioncited by 4
- 2025Closed-Loop Transfer for Weakly-supervised Affordance Groundingcited by 4
- 2024AD-Lite Net: A Lightweight and Concatenated CNN Model for Alzheimer's Detection from MRI Imagescited by 3
- 2021Modeling Object Dissimilarity for Deep Saliency Predictioncited by 2
- 2022Reinforcement Learning for Predicting Traffic Accidentscited by 2
- 2023Learning Saliency From Fixationscited by 2
- 2021DeepRare: Generic Unsupervised Visual Attention Modelscited by 1
- 2021A Simple and efficient deep Scanpath Predictioncited by 1
- 2022Where and What: Driver Attention-based Object Detectioncited by 1
- 2022Clustered Saliency Predictioncited by 1
- 2023Multi-Scale Estimation for Omni-Directional Saliency Maps Using Learnable Equator Biascited by 1
- 2024Learning Gaussian Representation for Eye Fixation Predictioncited by 1
- 2024Comparing Optical Flow and Deep Learning to Enable Computationally Efficient Traffic Event Detection with Space-Filling Curvescited by 1
- 2025Phase-Aligned RoPE for Mixed-Resolution Diffusion Transformercited by 1
- 2026SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptationcited by 1
- 2026From Scene to Object: Text-Guided Dual-Gaze Predictioncited by 1
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinementcited by 1
- 2026Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based modelcited by 1
- 2021Learning from Shader Program Tracescited by 0
- 2021Saliency for free: Saliency prediction as a side-effect of object recognitioncited by 0
- 2023MRGAN360: Multi-stage Recurrent Generative Adversarial Network for 360 Degree Image Saliency Predictioncited by 0
- 2024AHMF: Adaptive Hybrid-Memory-Fusion Model for Driver Attention Predictioncited by 0
- 2024PatchEX: High-Quality Real-Time Temporal Supersampling through Patch-based Parallel Extrapolationcited by 0
- 2025Towards Robust Unsupervised Attention Prediction in Autonomous Drivingcited by 0
- 2025Visual Attention Graphcited by 0
50 most cited of 54 All 54 (JSON)
- 2026FocusDrive: Reasoning with Visual Focus for Autonomous Driving27 Sep 2026
- 2026Zero-shot 2D Grounding with Novel Affordance Types9 Aug 2026
- 2026Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based model22 May 2026
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement8 May 2026
- 2026From Scene to Object: Text-Guided Dual-Gaze Prediction22 Apr 2026
- 2026DiffAttn: Diffusion-Based Drivers' Visual Attention Prediction with LLM-Enhanced Semantic Reasoning30 Mar 2026
- 2026SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptation25 Feb 2026
- 2026Agentic Retoucher for Text-To-Image Generation5 Jan 2026
- 2025Phase-Aligned RoPE for Mixed-Resolution Diffusion Transformer24 Nov 2025
- 2025Closed-Loop Transfer for Weakly-supervised Affordance Grounding20 Oct 2025
- 2025Towards Open World Detection: A Survey22 Aug 2025
- 2025Visual Attention Graph11 Mar 2025
38 more
- 2025SalM2: An Extremely Lightweight Saliency Mamba Model for Real-Time Cognitive Awareness of Driver Attention22 Feb 2025
- 2025Towards Robust Unsupervised Attention Prediction in Autonomous Driving25 Jan 2025
- 2024AD-Lite Net: A Lightweight and Concatenated CNN Model for Alzheimer's Detection from MRI Images12 Sep 2024
- 2024Data Augmentation via Latent Diffusion for Saliency Prediction11 Sep 2024
- 2024INTRA: Interaction Relationship-aware Weakly Supervised Affordance Grounding10 Sep 2024
- 2024How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Model10 Aug 2024
- 2024AHMF: Adaptive Hybrid-Memory-Fusion Model for Driver Attention Prediction24 Jul 2024
- 2024Comparing Optical Flow and Deep Learning to Enable Computationally Efficient Traffic Event Detection with Space-Filling Curves15 Jul 2024
- 2024PatchEX: High-Quality Real-Time Temporal Supersampling through Patch-based Parallel Extrapolation5 Jul 2024
- 2024How is Visual Attention Influenced by Text Guidance? Database and Model11 Apr 2024
- 2024Learning Gaussian Representation for Eye Fixation Prediction21 Mar 2024
- 2024Learning User Embeddings from Human Gaze for Personalised Saliency Prediction20 Mar 2024
- 2023Rethinking Object Saliency Ranking: A Novel Whole-flow Processing Paradigm6 Dec 2023
- 2023Learning Saliency From Fixations23 Nov 2023
- 2023Audio-visual Saliency for Omnidirectional Videos9 Nov 2023
- 2023Multi-Scale Estimation for Omni-Directional Saliency Maps Using Learnable Equator Bias15 Sep 2023
- 2023Scanpath Prediction in Panoramic Videos via Expected Code Length Minimization4 May 2023
- 2023Affordance Grounding from Demonstration Video to Target Image26 Mar 2023
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embedding17 Mar 2023
- 2023MRGAN360: Multi-stage Recurrent Generative Adversarial Network for 360 Degree Image Saliency Prediction15 Mar 2023
- 2023TempSAL -- Uncovering Temporal Information for Deep Saliency Prediction5 Jan 2023
- 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmark19 Dec 2022
- 2022Reinforcement Learning for Predicting Traffic Accidents9 Dec 2022
- 2022Grounded Affordance from Exocentric View28 Aug 2022
- 2022Clustered Saliency Prediction5 Jul 2022
- 2022Rectify ViT Shortcut Learning by Visual Saliency17 Jun 2022
- 2022Where and What: Driver Attention-based Object Detection26 Apr 2022
- 2022Saliency in Augmented Reality18 Apr 2022
- 2022Learning Affordance Grounding from Exocentric Images18 Mar 2022
- 2021A Simple and efficient deep Scanpath Prediction8 Dec 2021
- 2021SalFBNet: Learning Pseudo-Saliency Distribution via Feedback Convolutional Networks7 Dec 2021
- 2021MAAD: A Model and Dataset for "Attended Awareness" in Driving16 Oct 2021
- 2021TranSalNet: Towards perceptually relevant visual saliency prediction7 Oct 2021
- 2021DeepRare: Generic Unsupervised Visual Attention Models23 Sep 2021
- 2021Spatio-Temporal Self-Attention Network for Video Saliency Prediction24 Aug 2021
- 2021Learning Visual Affordance Grounding from Demonstration Videos12 Aug 2021
- 2021DRIVE: Deep Reinforced Accident Anticipation with Visual Explanation21 Jul 2021
- 2021Saliency for free: Saliency prediction as a side-effect of object recognition20 Jul 2021
50 newest of 54 All 54 (JSON)
- 2026Agentic Retoucher for Text-To-Image Generation5 Jan 2026
- 2025Phase-Aligned RoPE for Mixed-Resolution Diffusion Transformer24 Nov 2025
- 2024Data Augmentation via Latent Diffusion for Saliency Prediction11 Sep 2024
- 2026From Scene to Object: Text-Guided Dual-Gaze Predictioncited by 1
- 2026From Scene to Object: Text-Guided Dual-Gaze Prediction22 Apr 2026
- 2022Learning Affordance Grounding from Exocentric Imagescited by 82
- 2021DRIVE: Deep Reinforced Accident Anticipation with Visual Explanationcited by 46
- 2021TranSalNet: Towards perceptually relevant visual saliency predictioncited by 44
- 2023Affordance Grounding from Demonstration Video to Target Imagecited by 34
- 2021Learning Visual Affordance Grounding from Demonstration Videoscited by 25
- 2023TempSAL -- Uncovering Temporal Information for Deep Saliency Predictioncited by 25
- 2022Grounded Affordance from Exocentric Viewcited by 21
- 2021Spatio-Temporal Self-Attention Network for Video Saliency Predictioncited by 19
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
- 2022Saliency in Augmented Realitycited by 17
- 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmarkcited by 16
- 2022Rectify ViT Shortcut Learning by Visual Saliencycited by 14
12 most cited of 46 All 46 (JSON)
- 2026Zero-shot 2D Grounding with Novel Affordance Types9 Aug 2026
- 2026Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based model22 May 2026
- 2026SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptation25 Feb 2026
- 2025Closed-Loop Transfer for Weakly-supervised Affordance Grounding20 Oct 2025
- 2025Towards Open World Detection: A Survey22 Aug 2025
- 2025Visual Attention Graph11 Mar 2025
- 2025Towards Robust Unsupervised Attention Prediction in Autonomous Driving25 Jan 2025
- 2024AD-Lite Net: A Lightweight and Concatenated CNN Model for Alzheimer's Detection from MRI Images12 Sep 2024
- 2024INTRA: Interaction Relationship-aware Weakly Supervised Affordance Grounding10 Sep 2024
- 2024How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Model10 Aug 2024
- 2024AHMF: Adaptive Hybrid-Memory-Fusion Model for Driver Attention Prediction24 Jul 2024
- 2024Comparing Optical Flow and Deep Learning to Enable Computationally Efficient Traffic Event Detection with Space-Filling Curves15 Jul 2024
12 newest of 46 All 46 (JSON)