mlsanityData to 7 Oct 2026

Clustered Saliency Prediction

arXiv 2207.02205 ↗First posted 5 Jul 2022cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

We present a new method for image salience prediction, Clustered Saliency Prediction. This method divides subjects into clusters based on their personal features and their known saliency maps, and generates an image salience model conditioned on the cluster label. We test our approach on a public dataset of personalized saliency maps and cluster the subjects using selected importance weights for personal feature factors. We propose the Multi-Domain Saliency Translation model which uses image stimuli and universal saliency maps to predict saliency maps for each cluster. For obtaining universal saliency maps, we applied various state-of-the-art methods, DeepGaze IIE, ML-Net and SalGAN, and compared their effectiveness in our system. We show that our Clustered Saliency Prediction technique outperforms the universal saliency prediction models. Also, we demonstrate the effectiveness of our clustering method by comparing the results of Clustered Saliency Prediction using clusters obtained by our algorithm with some baseline methods. Finally, we propose an approach to assign new people to their most appropriate cluster and prove its usefulness in the experiments.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 70 references that are in the map. First posted on arXiv 5 Jul 2022.

Builds on

37 of 70 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  6. 2014Going Deeper with Convolutionscited by 4,231
  7. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  8. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  9. 2017Unsupervised Image-to-Image Translation Networkscited by 602
  10. 2014The Secrets of Salient Object Segmentationcited by 200
  11. 2016What do different evaluation metrics tell us about saliency models?cited by 184
  12. 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
25 more
  1. 2016Eye Tracking for Everyonecited by 155
  2. 2016Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Modelcited by 91
  3. 2017Deep Visual Attention Predictioncited by 70
  4. 2018Revisiting Video Saliency: A Large-scale Benchmark and a New Modelcited by 66
  5. 2017SalGAN: Visual Saliency Prediction with Generative Adversarial Networkscited by 63
  6. 2014Deep Gaze I: Boosting Saliency Prediction with Feature Maps Trained on ImageNetcited by 58
  7. 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingcited by 55
  8. 2016A Deep Multi-Level Network for Saliency Predictioncited by 54
  9. 2016DeepGaze II: Reading fixations from deep features trained on object recognitioncited by 54
  10. 2018EML-NET:An Expandable Multi-Layer NETwork for Saliency Predictioncited by 51
  11. 2015DeepFix: A Fully Convolutional Neural Network for predicting Human Eye Fixationscited by 47
  12. 2016Shallow and Deep Convolutional Networks for Saliency Predictioncited by 42
  13. 2016A Deep Spatial Contextual Long-term Recurrent Convolutional Network for Saliency Detectioncited by 23
  14. 2018End-to-End Saliency Mapping via Probability Distribution Predictioncited by 17
  15. 2016Recurrent Mixture Density Network for Spatiotemporal Visual Attentioncited by 16
  16. 2017Predicting Video Saliency with Object-to-Motion CNN and Two-layer Convolutional LSTMcited by 16
  17. 2017Personalized Saliency and its Predictioncited by 13
  18. 2021Understanding Visual Saliency in Mobile User Interfacescited by 13
  19. 2016Learning Gaze Transitions from Depth to Improve Video Saliency Estimationcited by 9
  20. 2018SG-FCN: A Motion and Memory-Based Deep Learning Model for Video Saliency Detectioncited by 6
  21. 2021Transferring Unconditional to Conditional GANs with Hyper-Modulationcited by 4
  22. 2016Exploiting inter-image similarity and ensemble of extreme learners for fixation prediction using deep featurescited by 3
  23. 2017Personalization of Saliency Estimationcited by 2
  24. 2018Where's YOUR focus: Personalized Attentioncited by 2
  25. 2016Deep Learning for Saliency Prediction in Natural Videocited by 1

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.