Object Segmentation Without Labels with Large-Scale Generative Models
Not on the map. Why?
Abstract (arXiv)
The recent rise of unsupervised and self-supervised learning has dramatically reduced the dependency on labeled data, providing effective image representations for transfer to downstream vision tasks. Furthermore, recent works employed these representations in a fully unsupervised setup for image classification, reducing the need for human labels on the fine-tuning stage as well. This work demonstrates that large-scale unsupervised models can also perform a more challenging object segmentation task, requiring neither pixel-level nor image-level labeling. Namely, we show that recent unsupervised GANs allow to differentiate between foreground/background pixels, providing high-quality saliency masks. By extensive comparison on standard benchmarks, we outperform existing unsupervised alternatives for object segmentation, achieving new state-of-the-art.
Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 17; 2023: 17; 2024: 7; 2025: 6; 2026: 2.
52 papers.
Sort:
By area:
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 166
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
- 2022Unsupervised Object Localization: Observing the Background to Discover Objectscited by 66
- 2023Diffusion Models for Open-Vocabulary Segmentationcited by 63
- 2022Unsupervised Salient Object Detection with Spectral Cluster Votingcited by 56
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discoverycited by 53
- 2022Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motioncited by 42
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Modelscited by 42
- 2023LD-ZNet: A Latent Diffusion Approach for Text-Based Image Segmentationcited by 29
38 more
- 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clusteringcited by 25
- 2022MOVE: Unsupervised Movable Object Segmentation and Detectioncited by 20
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generationcited by 19
- 2023MOST: Multiple Object localization with Self-supervised Transformers for object discoverycited by 17
- 2022Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Imagescited by 16
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Surveycited by 16
- 2022Synthetic Data Supervised Salient Object Detectioncited by 15
- 2023Weakly-supervised Contrastive Learning for Unsupervised Object Discoverycited by 12
- 2025UCOD-DPL: Unsupervised Camouflaged Object Detection via Dynamic Pseudo-label Learningcited by 10
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-trainingcited by 8
- 2023PaintSeg: Training-free Segmentation via Paintingcited by 7
- 2022FurryGAN: High Quality Foreground-aware Image Synthesiscited by 6
- 2024Upsampling DINOv2 features for unsupervised vision tasks and weakly supervised materials segmentationcited by 6
- 2022Refine and Represent: Region-to-Object Representation Learningcited by 5
- 2022Extracting Semantic Knowledge from GANs with Unsupervised Learningcited by 5
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Modelscited by 5
- 2022Interpreting Latent Spaces of Generative Models for Medical Images using Unsupervised Methodscited by 4
- 2022OAMixer: Object-aware Mixing Layer for Vision Transformerscited by 4
- 2023Learning Neural Eigenfunctions for Unsupervised Semantic Segmentationcited by 4
- 2023Unsupervised Camouflaged Object Segmentation as Domain Adaptationcited by 4
- 2023SEMPART: Self-supervised Multi-resolution Partitioning of Image Semanticscited by 4
- 2023Benchmarking and Analysis of Unsupervised Object Segmentation from Real-world Single Imagescited by 4
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomycited by 4
- 2025unMORE: Unsupervised Multi-Object Segmentation via Center-Boundary Reasoningcited by 4
- 2023Box-based Refinement for Weakly Supervised and Unsupervised Localization Taskscited by 3
- 2022ILSGAN: Independent Layer Synthesis for Unsupervised Foreground-Background Segmentationcited by 2
- 2024SimSAM: Simple Siamese Representations Based Semantic Affinity Matrix for Unsupervised Image Segmentationcited by 2
- 2024Unsupervised Part Discovery via Dual Representation Alignmentcited by 2
- 2022EAA-Net: Rethinking the Autoencoder Architecture with Intra-class Features for Medical Image Segmentationcited by 1
- 2023SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentationcited by 1
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketchescited by 1
- 2026Learning Accurate Segmentation Purely from Self-Supervisioncited by 1
- 2023Local Region-to-Region Mapping-based Approach to Classify Articulated Objectscited by 0
- 2023A Sparse Graph Formulation for Efficient Spectral Image Segmentationcited by 0
- 2024PEEKABOO: Hiding parts of an image for unsupervised object localizationcited by 0
- 2024Seg-HGNN: Unsupervised and Light-Weight Image Segmentation with Hyperbolic Graph Neural Networkscited by 0
- 2025Ensemble Foreground Management for Unsupervised Object Discoverycited by 0
50 most cited of 52 All 52 (JSON)
- 2026Learning Accurate Segmentation Purely from Self-Supervision27 Feb 2026
- 2026PANC: Prior-Aware Normalized Cut via Anchor-Augmented Token Graphs6 Feb 2026
- 2025Towards Open World Detection: A Survey22 Aug 2025
- 2025Ensemble Foreground Management for Unsupervised Object Discovery28 Jul 2025
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2025UCOD-DPL: Unsupervised Camouflaged Object Detection via Dynamic Pseudo-label Learning8 Jun 2025
- 2025unMORE: Unsupervised Multi-Object Segmentation via Center-Boundary Reasoning2 Jun 2025
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketches27 Jan 2025
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy30 Oct 2024
- 2024Upsampling DINOv2 features for unsupervised vision tasks and weakly supervised materials segmentation20 Oct 2024
- 2024Seg-HGNN: Unsupervised and Light-Weight Image Segmentation with Hyperbolic Graph Neural Networks10 Sep 2024
- 2024Unsupervised Part Discovery via Dual Representation Alignment15 Aug 2024
38 more
- 2024PEEKABOO: Hiding parts of an image for unsupervised object localization24 Jul 2024
- 2024SimSAM: Simple Siamese Representations Based Semantic Affinity Matrix for Unsupervised Image Segmentation12 Jun 2024
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models22 Jan 2024
- 2023Benchmarking and Analysis of Unsupervised Object Segmentation from Real-world Single Images8 Dec 2023
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Survey19 Oct 2023
- 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentation25 Sep 2023
- 2023SEMPART: Self-supervised Multi-resolution Partitioning of Image Semantics20 Sep 2023
- 2023Box-based Refinement for Weakly Supervised and Unsupervised Localization Tasks7 Sep 2023
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training22 Aug 2023
- 2023Unsupervised Camouflaged Object Segmentation as Domain Adaptation8 Aug 2023
- 2023Weakly-supervised Contrastive Learning for Unsupervised Object Discovery7 Jul 2023
- 2023A Sparse Graph Formulation for Efficient Spectral Image Segmentation22 Jun 2023
- 2023Diffusion Models for Open-Vocabulary Segmentation15 Jun 2023
- 2023PaintSeg: Training-free Segmentation via Painting30 May 2023
- 2023Local Region-to-Region Mapping-based Approach to Classify Articulated Objects10 May 2023
- 2023MOST: Multiple Object localization with Self-supervised Transformers for object discovery11 Apr 2023
- 2023Learning Neural Eigenfunctions for Unsupervised Semantic Segmentation6 Apr 2023
- 2023LD-ZNet: A Latent Diffusion Approach for Text-Based Image Segmentation22 Mar 2023
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discovery17 Mar 2023
- 2023SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation1 Jan 2023
- 2022Unsupervised Object Localization: Observing the Background to Discover Objects15 Dec 2022
- 2022OAMixer: Object-aware Mixing Layer for Vision Transformers13 Dec 2022
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clustering12 Dec 2022
- 2022Extracting Semantic Knowledge from GANs with Unsupervised Learning30 Nov 2022
- 2022ILSGAN: Independent Layer Synthesis for Unsupervised Foreground-Background Segmentation25 Nov 2022
- 2022Synthetic Data Supervised Salient Object Detection25 Oct 2022
- 2022MOVE: Unsupervised Movable Object Segmentation and Detection14 Oct 2022
- 2022Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Images5 Oct 2022
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cut1 Sep 2022
- 2022Refine and Represent: Region-to-Object Representation Learning25 Aug 2022
- 2022FurryGAN: High Quality Foreground-aware Image Synthesis22 Aug 2022
- 2022EAA-Net: Rethinking the Autoencoder Architecture with Intra-class Features for Medical Image Segmentation19 Aug 2022
- 2022Interpreting Latent Spaces of Generative Models for Medical Images using Unsupervised Methods20 Jul 2022
- 2022Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion16 May 2022
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization16 May 2022
- 2022Unsupervised Salient Object Detection with Spectral Cluster Voting23 Mar 2022
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cut23 Feb 2022
- 2021Label-Efficient Semantic Segmentation with Diffusion Models6 Dec 2021
50 newest of 52 All 52 (JSON)
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
- 2023Diffusion Models for Open-Vocabulary Segmentationcited by 63
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discoverycited by 53
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Modelscited by 42
- 2023LD-ZNet: A Latent Diffusion Approach for Text-Based Image Segmentationcited by 29
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Modelscited by 5
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models22 Jan 2024
- 2023Diffusion Models for Open-Vocabulary Segmentation15 Jun 2023
- 2023LD-ZNet: A Latent Diffusion Approach for Text-Based Image Segmentation22 Mar 2023
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discovery17 Mar 2023
- 2021Label-Efficient Semantic Segmentation with Diffusion Models6 Dec 2021
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 166
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
- 2022Unsupervised Object Localization: Observing the Background to Discover Objectscited by 66
- 2022Unsupervised Salient Object Detection with Spectral Cluster Votingcited by 56
- 2022Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motioncited by 42
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clusteringcited by 25
- 2022MOVE: Unsupervised Movable Object Segmentation and Detectioncited by 20
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generationcited by 19
- 2023MOST: Multiple Object localization with Self-supervised Transformers for object discoverycited by 17
- 2022Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Imagescited by 16
12 most cited of 45 All 45 (JSON)
- 2026Learning Accurate Segmentation Purely from Self-Supervision27 Feb 2026
- 2026PANC: Prior-Aware Normalized Cut via Anchor-Augmented Token Graphs6 Feb 2026
- 2025Towards Open World Detection: A Survey22 Aug 2025
- 2025Ensemble Foreground Management for Unsupervised Object Discovery28 Jul 2025
- 2025UCOD-DPL: Unsupervised Camouflaged Object Detection via Dynamic Pseudo-label Learning8 Jun 2025
- 2025unMORE: Unsupervised Multi-Object Segmentation via Center-Boundary Reasoning2 Jun 2025
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketches27 Jan 2025
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy30 Oct 2024
- 2024Upsampling DINOv2 features for unsupervised vision tasks and weakly supervised materials segmentation20 Oct 2024
- 2024Seg-HGNN: Unsupervised and Light-Weight Image Segmentation with Hyperbolic Graph Neural Networks10 Sep 2024
- 2024Unsupervised Part Discovery via Dual Representation Alignment15 Aug 2024
- 2024PEEKABOO: Hiding parts of an image for unsupervised object localization24 Jul 2024
12 newest of 45 All 45 (JSON)