Synthetic Data Supervised Salient Object Detection
Not on the map. Why?
Abstract (arXiv)
Although deep salient object detection (SOD) has achieved remarkable progress, deep SOD models are extremely data-hungry, requiring large-scale pixel-wise annotations to deliver such promising results. In this paper, we propose a novel yet effective method for SOD, coined SODGAN, which can generate infinite high-quality image-mask pairs requiring only a few labeled data, and these synthesized pairs can replace the human-labeled DUTS-TR to train any off-the-shelf SOD model. Its contribution is three-fold. 1) Our proposed diffusion embedding network can address the manifold mismatch and is tractable for the latent code generation, better matching with the ImageNet latent space. 2) For the first time, our proposed few-shot saliency mask generator can synthesize infinite accurate image synchronized saliency masks with a few labeled data. 3) Our proposed quality-aware discriminator can select highquality synthesized image-mask pairs from noisy synthetic data pool, improving the quality of synthetic data. For the first time, our SODGAN tackles SOD with synthetic data directly generated from the generative model, which opens up a new research paradigm for SOD. Extensive experimental results show that the saliency model trained on synthetic data can achieve 98.4% F-measure of the saliency model trained on the DUTS-TR. Moreover, our approach achieves a new SOTA performance in semi/weakly-supervised methods, and even outperforms several fully-supervised SOTA methods. Code is available at https://github.com/wuzhenyubuaa/SODGAN
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 38 of its 60 references that are in the map. First posted on arXiv 25 Oct 2022.
Builds on
38 of 60 references.
References · 38
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2019Searching for MobileNetV3cited by 1,984
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 566
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
- 2020Multi-scale Interactive Network for Salient Object Detectioncited by 212
- 2014The Secrets of Salient Object Segmentationcited by 200
26 more
- 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
- 2019F3Net: Fusion, Feedback and Focus for Salient Object Detectioncited by 176
- 2019Learning from Synthetic Data for Crowd Counting in the Wildcited by 148
- 2019Meta-Sim: Learning to Generate Synthetic Datasetscited by 128
- 2020Weakly-Supervised Salient Object Detection via Scribble Annotationscited by 96
- 2020Controlling generative models with continuous factors of variationscited by 93
- 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
- 2019Unsupervised Object Segmentation by Redrawingcited by 74
- 2018Explorations in Homeomorphic Variational Auto-Encodingcited by 65
- 2019Emergence of Object Segmentation in Perturbed Generative Modelscited by 57
- 2020Structure-Consistent Weakly Supervised Salient Object Detection with Local Saliency Coherencecited by 55
- 2019Semi-Supervised Video Salient Object Detection Using Pseudo-Labelscited by 54
- 2021Labels4Free: Unsupervised Segmentation using StyleGANcited by 53
- 2020Object Segmentation Without Labels with Large-Scale Generative Modelscited by 52
- 2020Navigating the GAN Parameter Space for Semantic Image Editingcited by 49
- 2018Salient Objects in Clutter: Bringing Salient Object Detection to the Foregroundcited by 47
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Modelscited by 44
- 2019Multi-source weak supervision for saliency detectioncited by 43
- 2021Disentangled High Quality Salient Object Detectioncited by 35
- 2018Weakly Supervised Salient Object Detection Using Image Labelscited by 32
- 2021Saliency-Associated Object Trackingcited by 30
- 2020Learning Noise-Aware Encoder-Decoder from Noisy Labels by Alternating Back-Propagation for Saliency Detectioncited by 29
- 2021MFNet: Multi-filter Directive Network for Weakly Supervised Salient Object Detectioncited by 27
- 2021Few-Cost Salient Object Detection with Adversarial-Paced Learningcited by 17
- 2021Light Field Saliency Detection with Dual Local Graph Learning andReciprocative Guidancecited by 12
- 2021Salient Object Ranking with Position-Preserved Attentioncited by 9
Built on by
Citing papers per year: 2023: 8; 2024: 3; 2025: 3; 2026: 1.
15 papers.
Sort:
By area:
- 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Modelscited by 162
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 122
- 2023DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Controlcited by 44
- 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Modelscited by 31
- 2024Dataset Enhancement with Instance-Level Augmentationscited by 23
- 2023AI-Generated Images as Data Source: The Dawn of Synthetic Eracited by 13
- 2023Object Segmentation by Mining Cross-Modal Semanticscited by 12
- 2023DiffusePast: Diffusion-based Generative Replay for Class Incremental Semantic Segmentationcited by 7
- 2023Few-shot Geometry-Aware Keypoint Localizationcited by 6
- 2025S3OD: Towards Generalizable Salient Object Detection with Synthetic Datacited by 5
- 2024VGGHeads: 3D Multi Head Alignment with a Large-Scale Synthetic Datasetcited by 4
- 2024Facing Asymmetry -- Uncovering the Causal Link between Facial Symmetry and Expression Classifiers using Synthetic Interventionscited by 2
- 2026MagicSeg: Open-World Segmentation Pretraining via Counterfactural Diffusion-Based Auto-Generation20 Mar 2026
- 2025S3OD: Towards Generalizable Salient Object Detection with Synthetic Data24 Oct 2025
- 2025Beyond the Seen: Bounded Distribution Estimation for Open-Vocabulary Learning6 Oct 2025
- 2025Image compositing is all you need for data augmentation19 Feb 2025
- 2024Facing Asymmetry -- Uncovering the Causal Link between Facial Symmetry and Expression Classifiers using Synthetic Interventions24 Sep 2024
- 2024VGGHeads: 3D Multi Head Alignment with a Large-Scale Synthetic Dataset25 Jul 2024
- 2024Dataset Enhancement with Instance-Level Augmentations12 Jun 2024
- 2023DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Control5 Dec 2023
- 2023AI-Generated Images as Data Source: The Dawn of Synthetic Era3 Oct 2023
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Models11 Aug 2023
- 2023DiffusePast: Diffusion-based Generative Replay for Class Incremental Semantic Segmentation2 Aug 2023
- 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models21 Jun 2023
3 more
- 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Modelscited by 162
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 122
- 2023DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Controlcited by 44
- 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Modelscited by 31
- 2024Dataset Enhancement with Instance-Level Augmentationscited by 23
- 2023DiffusePast: Diffusion-based Generative Replay for Class Incremental Semantic Segmentationcited by 7
- 2025Image compositing is all you need for data augmentationcited by 2
- 2026MagicSeg: Open-World Segmentation Pretraining via Counterfactural Diffusion-Based Auto-Generationcited by 0
- 2026MagicSeg: Open-World Segmentation Pretraining via Counterfactural Diffusion-Based Auto-Generation20 Mar 2026
- 2025Image compositing is all you need for data augmentation19 Feb 2025
- 2024Dataset Enhancement with Instance-Level Augmentations12 Jun 2024
- 2023DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Control5 Dec 2023
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Models11 Aug 2023
- 2023DiffusePast: Diffusion-based Generative Replay for Class Incremental Semantic Segmentation2 Aug 2023
- 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models21 Jun 2023
- 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Models21 Mar 2023
- 2023AI-Generated Images as Data Source: The Dawn of Synthetic Eracited by 13
- 2023Object Segmentation by Mining Cross-Modal Semanticscited by 12
- 2023Few-shot Geometry-Aware Keypoint Localizationcited by 6
- 2025S3OD: Towards Generalizable Salient Object Detection with Synthetic Datacited by 5
- 2024VGGHeads: 3D Multi Head Alignment with a Large-Scale Synthetic Datasetcited by 4
- 2024Facing Asymmetry -- Uncovering the Causal Link between Facial Symmetry and Expression Classifiers using Synthetic Interventionscited by 2
- 2025Beyond the Seen: Bounded Distribution Estimation for Open-Vocabulary Learningcited by 1
- 2025S3OD: Towards Generalizable Salient Object Detection with Synthetic Data24 Oct 2025
- 2025Beyond the Seen: Bounded Distribution Estimation for Open-Vocabulary Learning6 Oct 2025
- 2024Facing Asymmetry -- Uncovering the Causal Link between Facial Symmetry and Expression Classifiers using Synthetic Interventions24 Sep 2024
- 2024VGGHeads: 3D Multi Head Alignment with a Large-Scale Synthetic Dataset25 Jul 2024
- 2023AI-Generated Images as Data Source: The Dawn of Synthetic Era3 Oct 2023
- 2023Object Segmentation by Mining Cross-Modal Semantics17 May 2023
- 2023Few-shot Geometry-Aware Keypoint Localization30 Mar 2023