SalGAN: Visual Saliency Prediction with Generative Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
We introduce SalGAN, a deep convolutional neural network for visual saliency prediction trained with adversarial examples. The first stage of the network consists of a generator model whose weights are learned by back-propagation computed from a binary cross entropy (BCE) loss over downsampled versions of the saliency maps. The resulting prediction is processed by a discriminator network trained to solve a binary classification task between the saliency maps generated by the generative stage and the ground truth ones. Our experiments show how adversarial training allows reaching state-of-the-art performance across different metrics when combined with a widely-used loss function like BCE. Our results can be reproduced with the source code and trained models available at https://imatge-upc.github.io/saliency-salgan-2017/.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jan 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 9; 2023: 13; 2024: 11; 2025: 5; 2026: 6.
63 papers.
Sort:
By area:
- 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
- 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingcited by 55
- 2021Human Hands as Probes for Interactive Object Understandingcited by 51
- 2022In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimationcited by 51
- 2021TranSalNet: Towards perceptually relevant visual saliency predictioncited by 44
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2023Affordance Grounding from Demonstration Video to Target Imagecited by 34
- 2021Learning Visual Affordance Grounding from Demonstration Videoscited by 25
- 2021ScanGAN360: A Generative Model of Realistic Scanpaths for 360circ Imagescited by 23
- 2021ST-MTL: Spatio-Temporal Multitask Learning Model to Predict Scanpath While Tracking Instruments in Robotic Surgerycited by 20
- 2024Controlling the World by Sleight of Handcited by 19
- 2022Saliency in Augmented Realitycited by 17
38 more
- 2022Panoramic Vision Transformer for Saliency Detection in 360deg Videoscited by 15
- 2023Realistic Saliency Guided Image Enhancementcited by 14
- 2024SUM: Saliency Unification through Mamba for Visual Attention Modelingcited by 12
- 2024CaRDiff: Video Salient Object Ranking Chain of Thought Reasoning for Saliency Prediction with Diffusioncited by 12
- 2024INTRA: Interaction Relationship-aware Weakly Supervised Affordance Groundingcited by 12
- 2021Instance-Level Relative Saliency Ranking with Graph Reasoningcited by 9
- 2021Energy-Based Generative Cooperative Saliency Predictioncited by 8
- 2021SALYPATH: A Deep-Based Architecture for visual attention predictioncited by 7
- 2023Audio-visual Saliency for Omnidirectional Videoscited by 7
- 2023UniAR: A Unified model for predicting human Attention and Responses on visual contentcited by 7
- 2024How is Visual Attention Influenced by Text Guidance? Database and Modelcited by 7
- 2021Learning to Predict Salient Faces: A Novel Visual-Audio Saliency Modelcited by 6
- 2025Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networkscited by 5
- 2023Contrastive Language-Image Pretrained Models are Zero-Shot Human Scanpath Predictorscited by 4
- 2023Rethinking Object Saliency Ranking: A Novel Whole-flow Processing Paradigmcited by 4
- 2024GazeFusion: Saliency-Guided Image Generationcited by 4
- 2024How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Modelcited by 4
- 2025Closed-Loop Transfer for Weakly-supervised Affordance Groundingcited by 4
- 2021A Gated Fusion Network for Dynamic Saliency Predictioncited by 3
- 2025Spherical Vision Transformers for Audio-Visual Saliency Prediction in 360-Degree Videoscited by 3
- 2021Where to look at the movies : Analyzing visual attention to understand movie editingcited by 2
- 2021ImportantAug: a data augmentation agent for speechcited by 2
- 2022A Probabilistic Time-Evolving Approach to Scanpath Predictioncited by 2
- 2023Spherical Vision Transformer for 360-degree Video Saliency Predictioncited by 2
- 2023Learning Saliency From Fixationscited by 2
- 2024Relevance for Human Robot Collaborationcited by 2
- 2025AdaptiveAE: An Adaptive Exposure Strategy for HDR Capturing in Dynamic Scenescited by 2
- 2021Joint Learning of Visual-Audio Saliency Prediction and Sound Source Localization on Multi-face Videoscited by 1
- 2021A Simple and efficient deep Scanpath Predictioncited by 1
- 2021Weakly Supervised Visual-Auditory Fixation Prediction with Multigranularity Perceptioncited by 1
- 2022Clustered Saliency Predictioncited by 1
- 2023Multi-Scale Estimation for Omni-Directional Saliency Maps Using Learnable Equator Biascited by 1
- 2024Learning Gaussian Representation for Eye Fixation Predictioncited by 1
- 2026SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptationcited by 1
- 2026Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based modelcited by 1
- 2021Noise-Aware Video Saliency Predictioncited by 0
- 2021Saliency for free: Saliency prediction as a side-effect of object recognitioncited by 0
- 2021Class-Agnostic Segmentation Loss and Its Application to Salient Object Detection and Segmentationcited by 0
50 most cited of 63 All 63 (JSON)
- 2026Zero-shot 2D Grounding with Novel Affordance Types9 Aug 2026
- 2026SED:Lightweight Saliency prediction for Event-based data via Distillation12 Jun 2026
- 2026ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement28 May 2026
- 2026Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based model22 May 2026
- 2026SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptation25 Feb 2026
- 2026SalFormer360: a transformer-based saliency estimation model for 360-degree videos4 Feb 2026
- 2025EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models30 Oct 2025
- 2025Closed-Loop Transfer for Weakly-supervised Affordance Grounding20 Oct 2025
- 2025Spherical Vision Transformers for Audio-Visual Saliency Prediction in 360-Degree Videos27 Aug 2025
- 2025AdaptiveAE: An Adaptive Exposure Strategy for HDR Capturing in Dynamic Scenes19 Aug 2025
- 2025Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networks5 May 2025
- 2024Relevance for Human Robot Collaboration12 Sep 2024
38 more
- 2024INTRA: Interaction Relationship-aware Weakly Supervised Affordance Grounding10 Sep 2024
- 2024CaRDiff: Video Salient Object Ranking Chain of Thought Reasoning for Saliency Prediction with Diffusion21 Aug 2024
- 2024Caption-Driven Explorations: Aligning Image and Text Embeddings through Human-Inspired Foveated Vision19 Aug 2024
- 2024Controlling the World by Sleight of Hand13 Aug 2024
- 2024How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Model10 Aug 2024
- 2024Pathformer3D: A 3D Scanpath Transformer for 360deg Images15 Jul 2024
- 2024SUM: Saliency Unification through Mamba for Visual Attention Modeling25 Jun 2024
- 2024How is Visual Attention Influenced by Text Guidance? Database and Model11 Apr 2024
- 2024Learning Gaussian Representation for Eye Fixation Prediction21 Mar 2024
- 2024GazeFusion: Saliency-Guided Image Generation16 Mar 2024
- 2023UniAR: A Unified model for predicting human Attention and Responses on visual content15 Dec 2023
- 2023Rethinking Object Saliency Ranking: A Novel Whole-flow Processing Paradigm6 Dec 2023
- 2023Learning Saliency From Fixations23 Nov 2023
- 2023Audio-visual Saliency for Omnidirectional Videos9 Nov 2023
- 2023Multi-Scale Estimation for Omni-Directional Saliency Maps Using Learnable Equator Bias15 Sep 2023
- 2023Spherical Vision Transformer for 360-degree Video Saliency Prediction24 Aug 2023
- 2023Few-shot Personalized Saliency Prediction Based on Interpersonal Gaze Patterns6 Jul 2023
- 2023Realistic Saliency Guided Image Enhancement9 Jun 2023
- 2023Contrastive Language-Image Pretrained Models are Zero-Shot Human Scanpath Predictors21 May 2023
- 2023ViDaS Video Depth-aware Saliency Network19 May 2023
- 2023Affordance Grounding from Demonstration Video to Target Image26 Mar 2023
- 2023Affordance Diffusion: Synthesizing Hand-Object Interactions21 Mar 2023
- 2023MRGAN360: Multi-stage Recurrent Generative Adversarial Network for 360 Degree Image Saliency Prediction15 Mar 2023
- 2022Panoramic Vision Transformer for Saliency Detection in 360deg Videos19 Sep 2022
- 2022Saliency-based Multiple Region of Interest Detection from a Single 360deg image8 Sep 2022
- 2022Dual Domain-Adversarial Learning for Audio-Visual Saliency Prediction10 Aug 2022
- 2022In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation8 Aug 2022
- 2022Clustered Saliency Prediction5 Jul 2022
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectives21 May 2022
- 2022A Probabilistic Time-Evolving Approach to Scanpath Prediction20 Apr 2022
- 2022Saliency in Augmented Reality18 Apr 2022
- 2022Where Is My Mind (looking at)? Predicting Visual Attention from Brain Activity11 Jan 2022
- 2021Weakly Supervised Visual-Auditory Fixation Prediction with Multigranularity Perception27 Dec 2021
- 2021Human Hands as Probes for Interactive Object Understanding16 Dec 2021
- 2021ImportantAug: a data augmentation agent for speech14 Dec 2021
- 2021ST-MTL: Spatio-Temporal Multitask Learning Model to Predict Scanpath While Tracking Instruments in Robotic Surgery10 Dec 2021
- 2021A Simple and efficient deep Scanpath Prediction8 Dec 2021
- 2021Joint Learning of Visual-Audio Saliency Prediction and Sound Source Localization on Multi-face Videos5 Nov 2021
50 newest of 63 All 63 (JSON)
- 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
- 2024GazeFusion: Saliency-Guided Image Generationcited by 4
- 2025EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Modelscited by 0
- 2025EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models30 Oct 2025
- 2024GazeFusion: Saliency-Guided Image Generation16 Mar 2024
- 2023Affordance Diffusion: Synthesizing Hand-Object Interactions21 Mar 2023
- 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingcited by 55
- 2021Human Hands as Probes for Interactive Object Understandingcited by 51
- 2022In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimationcited by 51
- 2021TranSalNet: Towards perceptually relevant visual saliency predictioncited by 44
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2023Affordance Grounding from Demonstration Video to Target Imagecited by 34
- 2021Learning Visual Affordance Grounding from Demonstration Videoscited by 25
- 2021ScanGAN360: A Generative Model of Realistic Scanpaths for 360circ Imagescited by 23
- 2021ST-MTL: Spatio-Temporal Multitask Learning Model to Predict Scanpath While Tracking Instruments in Robotic Surgerycited by 20
- 2024Controlling the World by Sleight of Handcited by 19
- 2022Saliency in Augmented Realitycited by 17
- 2022Panoramic Vision Transformer for Saliency Detection in 360deg Videoscited by 15
12 most cited of 57 All 57 (JSON)
- 2026Zero-shot 2D Grounding with Novel Affordance Types9 Aug 2026
- 2026SED:Lightweight Saliency prediction for Event-based data via Distillation12 Jun 2026
- 2026ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement28 May 2026
- 2026Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based model22 May 2026
- 2026SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptation25 Feb 2026
- 2026SalFormer360: a transformer-based saliency estimation model for 360-degree videos4 Feb 2026
- 2025Closed-Loop Transfer for Weakly-supervised Affordance Grounding20 Oct 2025
- 2025Spherical Vision Transformers for Audio-Visual Saliency Prediction in 360-Degree Videos27 Aug 2025
- 2025AdaptiveAE: An Adaptive Exposure Strategy for HDR Capturing in Dynamic Scenes19 Aug 2025
- 2024Relevance for Human Robot Collaboration12 Sep 2024
- 2024INTRA: Interaction Relationship-aware Weakly Supervised Affordance Grounding10 Sep 2024
- 2024Caption-Driven Explorations: Aligning Image and Text Embeddings through Human-Inspired Foveated Vision19 Aug 2024
12 newest of 57 All 57 (JSON)