Learning Gaussian Representation for Eye Fixation Prediction
Not on the map. Why?
Abstract (arXiv)
Existing eye fixation prediction methods perform the mapping from input images to the corresponding dense fixation maps generated from raw fixation points. However, due to the stochastic nature of human fixation, the generated dense fixation maps may be a less-than-ideal representation of human fixation. To provide a robust fixation model, we introduce Gaussian Representation for eye fixation modeling. Specifically, we propose to model the eye fixation map as a mixture of probability distributions, namely a Gaussian Mixture Model. In this new representation, we use several Gaussian distribution components as an alternative to the provided fixation map, which makes the model more robust to the randomness of fixation. Meanwhile, we design our framework upon some lightweight backbones to achieve real-time fixation prediction. Experimental results on three public fixation prediction datasets (SALICON, MIT1003, TORONTO) demonstrate that our method is fast and effective.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 55 references that are in the map. First posted on arXiv 21 Mar 2024.
Builds on
21 of 55 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,132
- 2016What do different evaluation metrics tell us about saliency models?cited by 184
- 2016Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Modelcited by 91
- 2017Deep Visual Attention Predictioncited by 70
- 2017SalGAN: Visual Saliency Prediction with Generative Adversarial Networkscited by 63
- 2014Deep Gaze I: Boosting Saliency Prediction with Feature Maps Trained on ImageNetcited by 58
- 2016A Deep Multi-Level Network for Saliency Predictioncited by 54
9 more
- 2016DeepGaze II: Reading fixations from deep features trained on object recognitioncited by 54
- 2018EML-NET:An Expandable Multi-Layer NETwork for Saliency Predictioncited by 51
- 2015DeepFix: A Fully Convolutional Neural Network for predicting Human Eye Fixationscited by 47
- 2016Shallow and Deep Convolutional Networks for Saliency Predictioncited by 42
- 2016A Deep Spatial Contextual Long-term Recurrent Convolutional Network for Saliency Detectioncited by 23
- 2018End-to-End Saliency Mapping via Probability Distribution Predictioncited by 17
- 2020Cross-Domain Medical Image Translation by Shared Latent Gaussian Mixture Modelcited by 12
- 2017Visual Saliency Prediction Using a Mixture of Deep Neural Networkscited by 7
- 2016OpenSalicon: An Open Source Implementation of the Salicon Saliency Modelcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.