OneGAN: Simultaneous Unsupervised Learning of Conditional Image Generation, Foreground Segmentation, and Fine-Grained Clustering
Not on the map. Why?
Abstract (arXiv)
We present a method for simultaneously learning, in an unsupervised manner, (i) a conditional image generator, (ii) foreground extraction and segmentation, (iii) clustering into a two-level class hierarchy, and (iv) object removal and background completion, all done without any use of annotation. The method combines a Generative Adversarial Network and a Variational Auto-Encoder, with multiple encoders, generators and discriminators, and benefits from solving all tasks at once. The input to the training scheme is a varied collection of unlabeled images from the same domain, as well as a set of background images without a foreground object. In addition, the image generator can mix the background from one image, with a foreground that is conditioned either on that of a second image or on the index of a desired cluster. The method obtains state of the art results in comparison to the literature methods, when compared to the current state of the art in each of the tasks.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 9; 2023: 8; 2024: 3; 2025: 0; 2026: 1.
28 papers.
Sort:
By area:
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2023Diffusion Models for Open-Vocabulary Segmentationcited by 64
- 2022Improving Object-centric Learning with Query Optimizationcited by 60
- 2021Labels4Free: Unsupervised Segmentation using StyleGANcited by 53
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Modelscited by 44
- 2022Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motioncited by 42
- 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clusteringcited by 25
- 2022MOVE: Unsupervised Movable Object Segmentation and Detectioncited by 20
- 2021DARCNN: Domain Adaptive Region-based Convolutional Neural Network for Unsupervised Instance Segmentation in Biomedical Imagescited by 14
- 2024TKG-DM: Training-free Chroma Key Content Generation Diffusion Modelcited by 11
- 2021Contrastive Fine-grained Class Clustering via Generative Adversarial Networkscited by 9
16 more
- 2023Spotlight Attention: Robust Object-Centric Learning With a Spatial Locality Priorcited by 8
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-trainingcited by 8
- 2021Learning Foreground-Background Segmentation from Improved Layered GANscited by 7
- 2023PaintSeg: Training-free Segmentation via Paintingcited by 7
- 2022Refine and Represent: Region-to-Object Representation Learningcited by 5
- 2022Extracting Semantic Knowledge from GANs with Unsupervised Learningcited by 5
- 2022Foreground-Background Separation through Concept Distillation from Generative Image Foundation Modelscited by 5
- 2023SC-VAE: Sparse Coding-based Variational Autoencoder with Learned ISTAcited by 4
- 2024Revisiting Surgical Instrument Segmentation Without Human Intervention: A Graph Partitioning Viewcited by 3
- 2021CoDeGAN: Contrastive Disentanglement for Generative Adversarial Networkcited by 2
- 2022ILSGAN: Independent Layer Synthesis for Unsupervised Foreground-Background Segmentationcited by 2
- 2023Self-Supervised One-Shot Learning for Automatic Segmentation of StyleGAN Imagescited by 2
- 2023SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentationcited by 1
- 2023GoogLe2Net: Going Transverse with Convolutionscited by 0
- 2024Seg-HGNN: Unsupervised and Light-Weight Image Segmentation with Hyperbolic Graph Neural Networkscited by 0
- 2026Universal Guideline-Driven Image Clustering via a Hybrid LLM Agentcited by 0
- 2026Universal Guideline-Driven Image Clustering via a Hybrid LLM Agent23 Jun 2026
- 2024TKG-DM: Training-free Chroma Key Content Generation Diffusion Model23 Nov 2024
- 2024Seg-HGNN: Unsupervised and Light-Weight Image Segmentation with Hyperbolic Graph Neural Networks10 Sep 2024
- 2024Revisiting Surgical Instrument Segmentation Without Human Intervention: A Graph Partitioning View27 Aug 2024
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training22 Aug 2023
- 2023Diffusion Models for Open-Vocabulary Segmentation15 Jun 2023
- 2023Spotlight Attention: Robust Object-Centric Learning With a Spatial Locality Prior31 May 2023
- 2023PaintSeg: Training-free Segmentation via Painting30 May 2023
- 2023SC-VAE: Sparse Coding-based Variational Autoencoder with Learned ISTA29 Mar 2023
- 2023Self-Supervised One-Shot Learning for Automatic Segmentation of StyleGAN Images10 Mar 2023
- 2023GoogLe2Net: Going Transverse with Convolutions1 Jan 2023
- 2023SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation1 Jan 2023
16 more
- 2022Foreground-Background Separation through Concept Distillation from Generative Image Foundation Models29 Dec 2022
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clustering12 Dec 2022
- 2022Extracting Semantic Knowledge from GANs with Unsupervised Learning30 Nov 2022
- 2022ILSGAN: Independent Layer Synthesis for Unsupervised Foreground-Background Segmentation25 Nov 2022
- 2022Improving Object-centric Learning with Query Optimization17 Oct 2022
- 2022MOVE: Unsupervised Movable Object Segmentation and Detection14 Oct 2022
- 2022Refine and Represent: Region-to-Object Representation Learning25 Aug 2022
- 2022Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion16 May 2022
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization16 May 2022
- 2021Contrastive Fine-grained Class Clustering via Generative Adversarial Networks30 Dec 2021
- 2021Unsupervised Foreground Extraction via Deep Region Competition29 Oct 2021
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Models17 May 2021
- 2021DARCNN: Domain Adaptive Region-based Convolutional Neural Network for Unsupervised Instance Segmentation in Biomedical Images3 Apr 2021
- 2021Learning Foreground-Background Segmentation from Improved Layered GANs1 Apr 2021
- 2021Labels4Free: Unsupervised Segmentation using StyleGAN27 Mar 2021
- 2021CoDeGAN: Contrastive Disentanglement for Generative Adversarial Network5 Mar 2021
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2022Improving Object-centric Learning with Query Optimizationcited by 60
- 2021Labels4Free: Unsupervised Segmentation using StyleGANcited by 53
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Modelscited by 44
- 2022Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motioncited by 42
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clusteringcited by 25
- 2022MOVE: Unsupervised Movable Object Segmentation and Detectioncited by 20
- 2021DARCNN: Domain Adaptive Region-based Convolutional Neural Network for Unsupervised Instance Segmentation in Biomedical Imagescited by 14
- 2021Contrastive Fine-grained Class Clustering via Generative Adversarial Networkscited by 9
- 2023Spotlight Attention: Robust Object-Centric Learning With a Spatial Locality Priorcited by 8
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-trainingcited by 8
- 2021Learning Foreground-Background Segmentation from Improved Layered GANscited by 7
12 most cited of 24 All 24 (JSON)
- 2026Universal Guideline-Driven Image Clustering via a Hybrid LLM Agent23 Jun 2026
- 2024Seg-HGNN: Unsupervised and Light-Weight Image Segmentation with Hyperbolic Graph Neural Networks10 Sep 2024
- 2024Revisiting Surgical Instrument Segmentation Without Human Intervention: A Graph Partitioning View27 Aug 2024
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training22 Aug 2023
- 2023Spotlight Attention: Robust Object-Centric Learning With a Spatial Locality Prior31 May 2023
- 2023PaintSeg: Training-free Segmentation via Painting30 May 2023
- 2023SC-VAE: Sparse Coding-based Variational Autoencoder with Learned ISTA29 Mar 2023
- 2023Self-Supervised One-Shot Learning for Automatic Segmentation of StyleGAN Images10 Mar 2023
- 2023GoogLe2Net: Going Transverse with Convolutions1 Jan 2023
- 2023SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation1 Jan 2023
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clustering12 Dec 2022
- 2022Extracting Semantic Knowledge from GANs with Unsupervised Learning30 Nov 2022
12 newest of 24 All 24 (JSON)