SaltiNet: Scan-path Prediction on 360 Degree Images using Saliency Volumes
Not on the map. Why?
Abstract (arXiv)
We introduce SaltiNet, a deep neural network for scanpath prediction trained on 360-degree images. The model is based on a temporal-aware novel representation of saliency information named the saliency volume. The first part of the network consists of a model trained to generate saliency volumes, whose parameters are fit by back-propagation computed from a binary cross entropy (BCE) loss over downsampled versions of the saliency volumes. Sampling strategies over these volumes are used to generate scanpaths over the 360-degree images. Our experiments show the advantages of using saliency volumes, and how they can be used for related tasks. Our source code and trained models available at https://github.com/massens/saliency-360salient-2017.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 5; 2024: 8; 2025: 4; 2026: 1.
29 papers.
Sort:
By area:
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2021ScanGAN360: A Generative Model of Realistic Scanpaths for 360circ Imagescited by 23
- 2021State-of-the-Art in Human Scanpath Predictioncited by 22
- 2023Unifying Top-down and Bottom-up Scanpath Prediction Using Transformerscited by 22
- 2023Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessmentcited by 17
- 2024GazeXplain: Learning to Predict Natural Language Explanations of Visual Scanpathscited by 15
- 2022Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360deg Omnidirectional Imagecited by 13
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 2024Beyond Average: Individualized Visual Scanpath Predictioncited by 12
- 2024EyeFormer: Predicting Personalized Scanpaths with Transformer-Guided Reinforcement Learningcited by 8
- 2021SALYPATH: A Deep-Based Architecture for visual attention predictioncited by 7
- 2021Scanpath Prediction on Information Visualisationscited by 5
17 more
- 2023Perceptual Quality Assessment of 360^circ Images Based on Generative Scanpath Representationcited by 5
- 2025Few-shot Personalized Scanpath Predictioncited by 5
- 2025DiffEye: Diffusion-Based Continuous Eye-Tracking Data Generation Conditioned on Natural Imagescited by 5
- 2022SalyPath360: Saliency and Scanpath Prediction Framework for Omnidirectional Imagescited by 4
- 2022Improving saliency models' predictions of the next fixation with humans' intrinsic cost of gaze shiftscited by 4
- 2023Scanpath Prediction in Panoramic Videos via Expected Code Length Minimizationcited by 4
- 2024How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Modelcited by 4
- 2024TPP-Gaze: Modelling Gaze Dynamics in Space and Time with Neural Temporal Point Processescited by 4
- 2022A Probabilistic Time-Evolving Approach to Scanpath Predictioncited by 2
- 2022Modeling Human Eye Movements with Neural Networks in a Maze-Solving Taskcited by 2
- 2021A Simple and efficient deep Scanpath Predictioncited by 1
- 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Imagescited by 1
- 2024Semantic-Based Active Perception for Humanoid Visual Tasks with Foveal Sensorscited by 1
- 2026SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptationcited by 1
- 2024Pathformer3D: A 3D Scanpath Transformer for 360deg Imagescited by 0
- 2025Visual Attention Graphcited by 0
- 2025A Comparative Study of Scanpath Models in Graph-Based Visualizationcited by 0
- 2026SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptation25 Feb 2026
- 2025DiffEye: Diffusion-Based Continuous Eye-Tracking Data Generation Conditioned on Natural Images20 Sep 2025
- 2025Few-shot Personalized Scanpath Prediction7 Apr 2025
- 2025A Comparative Study of Scanpath Models in Graph-Based Visualization31 Mar 2025
- 2025Visual Attention Graph11 Mar 2025
- 2024TPP-Gaze: Modelling Gaze Dynamics in Space and Time with Neural Temporal Point Processes30 Oct 2024
- 2024How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Model10 Aug 2024
- 2024GazeXplain: Learning to Predict Natural Language Explanations of Visual Scanpaths5 Aug 2024
- 2024Pathformer3D: A 3D Scanpath Transformer for 360deg Images15 Jul 2024
- 2024Beyond Average: Individualized Visual Scanpath Prediction18 Apr 2024
- 2024Semantic-Based Active Perception for Humanoid Visual Tasks with Foveal Sensors16 Apr 2024
- 2024EyeFormer: Predicting Personalized Scanpaths with Transformer-Guided Reinforcement Learning15 Apr 2024
17 more
- 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Images26 Mar 2024
- 2023Perceptual Quality Assessment of 360^circ Images Based on Generative Scanpath Representation7 Sep 2023
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges23 May 2023
- 2023Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessment18 May 2023
- 2023Scanpath Prediction in Panoramic Videos via Expected Code Length Minimization4 May 2023
- 2023Unifying Top-down and Bottom-up Scanpath Prediction Using Transformers16 Mar 2023
- 2022Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360deg Omnidirectional Image23 Dec 2022
- 2022Modeling Human Eye Movements with Neural Networks in a Maze-Solving Task20 Dec 2022
- 2022Improving saliency models' predictions of the next fixation with humans' intrinsic cost of gaze shifts9 Jul 2022
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectives21 May 2022
- 2022A Probabilistic Time-Evolving Approach to Scanpath Prediction20 Apr 2022
- 2022SalyPath360: Saliency and Scanpath Prediction Framework for Omnidirectional Images1 Jan 2022
- 2021A Simple and efficient deep Scanpath Prediction8 Dec 2021
- 2021Scanpath Prediction on Information Visualisations4 Dec 2021
- 2021SALYPATH: A Deep-Based Architecture for visual attention prediction29 Jun 2021
- 2021ScanGAN360: A Generative Model of Realistic Scanpaths for 360circ Images25 Mar 2021
- 2021State-of-the-Art in Human Scanpath Prediction24 Feb 2021
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2021ScanGAN360: A Generative Model of Realistic Scanpaths for 360circ Imagescited by 23
- 2021State-of-the-Art in Human Scanpath Predictioncited by 22
- 2023Unifying Top-down and Bottom-up Scanpath Prediction Using Transformerscited by 22
- 2023Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessmentcited by 17
- 2024GazeXplain: Learning to Predict Natural Language Explanations of Visual Scanpathscited by 15
- 2022Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360deg Omnidirectional Imagecited by 13
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 2024Beyond Average: Individualized Visual Scanpath Predictioncited by 12
- 2024EyeFormer: Predicting Personalized Scanpaths with Transformer-Guided Reinforcement Learningcited by 8
- 2021SALYPATH: A Deep-Based Architecture for visual attention predictioncited by 7
- 2021Scanpath Prediction on Information Visualisationscited by 5
12 most cited of 27 All 27 (JSON)
- 2026SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptation25 Feb 2026
- 2025Few-shot Personalized Scanpath Prediction7 Apr 2025
- 2025A Comparative Study of Scanpath Models in Graph-Based Visualization31 Mar 2025
- 2025Visual Attention Graph11 Mar 2025
- 2024TPP-Gaze: Modelling Gaze Dynamics in Space and Time with Neural Temporal Point Processes30 Oct 2024
- 2024How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Model10 Aug 2024
- 2024GazeXplain: Learning to Predict Natural Language Explanations of Visual Scanpaths5 Aug 2024
- 2024Pathformer3D: A 3D Scanpath Transformer for 360deg Images15 Jul 2024
- 2024Beyond Average: Individualized Visual Scanpath Prediction18 Apr 2024
- 2024Semantic-Based Active Perception for Humanoid Visual Tasks with Foveal Sensors16 Apr 2024
- 2024EyeFormer: Predicting Personalized Scanpaths with Transformer-Guided Reinforcement Learning15 Apr 2024
- 2023Perceptual Quality Assessment of 360^circ Images Based on Generative Scanpath Representation7 Sep 2023
12 newest of 27 All 27 (JSON)