TempSAL -- Uncovering Temporal Information for Deep Saliency Prediction
Not on the map. Why?
Abstract (arXiv)
Deep saliency prediction algorithms complement the object recognition features, they typically rely on additional information, such as scene context, semantic relationships, gaze direction, and object dissimilarity. However, none of these models consider the temporal nature of gaze shifts during image observation. We introduce a novel saliency prediction model that learns to output saliency maps in sequential time intervals by exploiting human temporal attention patterns. Our approach locally modulates the saliency predictions by combining the learned temporal maps. Our experiments show that our method outperforms the state-of-the-art models, including a multi-duration saliency model, on the SALICON benchmark. Our code will be publicly available on GitHub.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 22 of its 55 references that are in the map. First posted on arXiv 5 Jan 2023.
Builds on
22 of 55 references.
References · 22
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2017Progressive Neural Architecture Searchcited by 487
- 2016What do different evaluation metrics tell us about saliency models?cited by 185
- 2019Salient Object Detection in the Deep Learning Era: An In-Depth Surveycited by 164
- 2016Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Modelcited by 91
- 2020Unified Image and Video Saliency Modelingcited by 75
- 2014Deep Gaze I: Boosting Saliency Prediction with Feature Maps Trained on ImageNetcited by 60
- 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingcited by 56
- 2016A Deep Multi-Level Network for Saliency Predictioncited by 54
10 more
- 2015CAT2000: A Large Scale Fixation Dataset for Boosting Saliency Researchcited by 52
- 2018EML-NET:An Expandable Multi-Layer NETwork for Saliency Predictioncited by 51
- 2019Contextual Encoder-Decoder Network for Visual Saliency Predictioncited by 44
- 2020Predicting Visual Importance Across Graphic Design Typescited by 30
- 2016A Deep Spatial Contextual Long-term Recurrent Convolutional Network for Saliency Detectioncited by 23
- 2019A Dilated Inception Network for Visual Saliency Predictioncited by 22
- 2020Tidying Deep Saliency Prediction Architecturescited by 20
- 2020Saliency Prediction with External Knowledgecited by 5
- 2020RecSal : Deep Recursive Supervision for Visual Saliency Predictioncited by 2
- 2021Modeling Object Dissimilarity for Deep Saliency Predictioncited by 2
Built on by
Citing papers per year: 2024: 11; 2025: 9; 2026: 5.
25 papers.
Sort:
By area:
- 2024GazeXplain: Learning to Predict Natural Language Explanations of Visual Scanpathscited by 15
- 2024Beyond Average: Individualized Visual Scanpath Predictioncited by 12
- 2024SUM: Saliency Unification through Mamba for Visual Attention Modelingcited by 12
- 2024Trends, Applications, and Challenges in Human Attention Modellingcited by 9
- 2024How is Visual Attention Influenced by Text Guidance? Database and Modelcited by 7
- 2024Brand Visibility in Packaging: A Deep Learning Approach for Logo Detection, Saliency-Map Prediction, and Logo Placement Analysiscited by 6
- 2024Data Augmentation via Latent Diffusion for Saliency Predictioncited by 5
- 2025Modeling Saliency Dataset Biascited by 4
- 2025Measuring and Predicting Where and When Pathologists Focus their Visual Attention while Grading Whole Slide Images of Cancercited by 4
- 2025FS-Diff: Semantic guidance and clarity-aware simultaneous multimodal image fusion and super-resolutioncited by 3
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directionscited by 2
- 2024Enhancing Saliency Prediction in Monitoring Tasks: The Role of Visual Highlightscited by 1
13 more
- 2024SalNAS: Efficient Saliency-prediction Neural Architecture Search with self-knowledge distillationcited by 1
- 2024Aligning XAI with EU Regulations for Smart Biomedical Devices: A Methodology for Compliance Analysiscited by 1
- 2024Unlocking Comics: The AI4VA Dataset for Visual Understandingcited by 1
- 2025DTFSal: Audio-Visual Dynamic Token Fusion for Video Saliency Predictioncited by 1
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modelingcited by 1
- 2026DeepGaze3.5-VL: Modeling Scanpaths via Autoregressive Token Predictioncited by 1
- 2025A Comparative Study of Scanpath Models in Graph-Based Visualizationcited by 0
- 2025PRE-MAP: Personalized Reinforced Eye-tracking Multimodal LLM for High-Resolution Multi-Attribute Point Predictioncited by 0
- 2025Controllable Audio-Visual Viewpoint Generation from 360deg Spatial Informationcited by 0
- 2025EgoCampus: Egocentric Pedestrian Eye Gaze Model and Datasetcited by 0
- 2026ObjectVisA-120: Object-based Visual Attention Prediction in Interactive Street-crossing Environmentscited by 0
- 2026Intelligent support for Human Oversight: Integrating Reinforcement Learning with Gaze Simulation to Personalize Highlightingcited by 0
- 2026OpenVAM: Open-World Visual Attention Modeling with VLMscited by 0
- 2026OpenVAM: Open-World Visual Attention Modeling with VLMs25 Sep 2026
- 2026DeepGaze3.5-VL: Modeling Scanpaths via Autoregressive Token Prediction2 Jul 2026
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modeling2 Jun 2026
- 2026Intelligent support for Human Oversight: Integrating Reinforcement Learning with Gaze Simulation to Personalize Highlighting9 Feb 2026
- 2026ObjectVisA-120: Object-based Visual Attention Prediction in Interactive Street-crossing Environments19 Jan 2026
- 2025EgoCampus: Egocentric Pedestrian Eye Gaze Model and Dataset8 Dec 2025
- 2025Controllable Audio-Visual Viewpoint Generation from 360deg Spatial Information7 Oct 2025
- 2025FS-Diff: Semantic guidance and clarity-aware simultaneous multimodal image fusion and super-resolution11 Sep 2025
- 2025Measuring and Predicting Where and When Pathologists Focus their Visual Attention while Grading Whole Slide Images of Cancer3 Aug 2025
- 2025PRE-MAP: Personalized Reinforced Eye-tracking Multimodal LLM for High-Resolution Multi-Attribute Point Prediction25 Jul 2025
- 2025Modeling Saliency Dataset Bias15 May 2025
- 2025DTFSal: Audio-Visual Dynamic Token Fusion for Video Saliency Prediction14 Apr 2025
13 more
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directions9 Apr 2025
- 2025A Comparative Study of Scanpath Models in Graph-Based Visualization31 Mar 2025
- 2024Unlocking Comics: The AI4VA Dataset for Visual Understanding27 Oct 2024
- 2024Data Augmentation via Latent Diffusion for Saliency Prediction11 Sep 2024
- 2024Aligning XAI with EU Regulations for Smart Biomedical Devices: A Methodology for Compliance Analysis27 Aug 2024
- 2024GazeXplain: Learning to Predict Natural Language Explanations of Visual Scanpaths5 Aug 2024
- 2024SalNAS: Efficient Saliency-prediction Neural Architecture Search with self-knowledge distillation29 Jul 2024
- 2024SUM: Saliency Unification through Mamba for Visual Attention Modeling25 Jun 2024
- 2024Enhancing Saliency Prediction in Monitoring Tasks: The Role of Visual Highlights15 May 2024
- 2024Beyond Average: Individualized Visual Scanpath Prediction18 Apr 2024
- 2024How is Visual Attention Influenced by Text Guidance? Database and Model11 Apr 2024
- 2024Brand Visibility in Packaging: A Deep Learning Approach for Logo Detection, Saliency-Map Prediction, and Logo Placement Analysis4 Mar 2024
- 2024Trends, Applications, and Challenges in Human Attention Modelling28 Feb 2024
- 2024GazeXplain: Learning to Predict Natural Language Explanations of Visual Scanpathscited by 15
- 2024Beyond Average: Individualized Visual Scanpath Predictioncited by 12
- 2024Trends, Applications, and Challenges in Human Attention Modellingcited by 9
- 2024How is Visual Attention Influenced by Text Guidance? Database and Modelcited by 7
- 2024Brand Visibility in Packaging: A Deep Learning Approach for Logo Detection, Saliency-Map Prediction, and Logo Placement Analysiscited by 6
- 2025Modeling Saliency Dataset Biascited by 4
- 2025Measuring and Predicting Where and When Pathologists Focus their Visual Attention while Grading Whole Slide Images of Cancercited by 4
- 2025FS-Diff: Semantic guidance and clarity-aware simultaneous multimodal image fusion and super-resolutioncited by 3
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directionscited by 2
- 2024Enhancing Saliency Prediction in Monitoring Tasks: The Role of Visual Highlightscited by 1
- 2024Aligning XAI with EU Regulations for Smart Biomedical Devices: A Methodology for Compliance Analysiscited by 1
- 2024Unlocking Comics: The AI4VA Dataset for Visual Understandingcited by 1
12 most cited of 20 All 20 (JSON)
- 2026OpenVAM: Open-World Visual Attention Modeling with VLMs25 Sep 2026
- 2026DeepGaze3.5-VL: Modeling Scanpaths via Autoregressive Token Prediction2 Jul 2026
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modeling2 Jun 2026
- 2026Intelligent support for Human Oversight: Integrating Reinforcement Learning with Gaze Simulation to Personalize Highlighting9 Feb 2026
- 2026ObjectVisA-120: Object-based Visual Attention Prediction in Interactive Street-crossing Environments19 Jan 2026
- 2025EgoCampus: Egocentric Pedestrian Eye Gaze Model and Dataset8 Dec 2025
- 2025FS-Diff: Semantic guidance and clarity-aware simultaneous multimodal image fusion and super-resolution11 Sep 2025
- 2025Measuring and Predicting Where and When Pathologists Focus their Visual Attention while Grading Whole Slide Images of Cancer3 Aug 2025
- 2025Modeling Saliency Dataset Bias15 May 2025
- 2025DTFSal: Audio-Visual Dynamic Token Fusion for Video Saliency Prediction14 Apr 2025
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directions9 Apr 2025
- 2025A Comparative Study of Scanpath Models in Graph-Based Visualization31 Mar 2025
12 newest of 20 All 20 (JSON)