Object Discovery with a Copy-Pasting GAN
Not on the map. Why?
Abstract (arXiv)
We tackle the problem of object discovery, where objects are segmented for a given input image, and the system is trained without using any direct supervision whatsoever. A novel copy-pasting GAN framework is proposed, where the generator learns to discover an object in one image by compositing it into another image such that the discriminator cannot tell that the resulting image is fake. After carefully addressing subtle issues, such as preventing the generator from `cheating', this game results in the generator learning to select objects, as copy-pasting objects is most likely to fool the discriminator. The system is shown to work well on four very different datasets, including large object appearance variations in challenging cluttered backgrounds.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 6; 2023: 9; 2024: 1; 2025: 2; 2026: 1.
29 papers.
Sort:
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2021GENESIS-V2: Inferring Unordered Object Representations without Iterative Refinementcited by 109
- 2021Context Decoupling Augmentation for Weakly Supervised Semantic Segmentationcited by 69
- 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
- 2022Unsupervised Salient Object Detection with Spectral Cluster Votingcited by 56
- 2021Unsupervised Layered Image Decomposition into Object Prototypescited by 50
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Modelscited by 44
- 2021Object-aware Contrastive Learning for Debiased Scene Representationcited by 35
- 2021Compositional Transformers for Scene Generationcited by 24
- 2022Decoder Denoising Pretraining for Semantic Segmentationcited by 20
- 2022MOVE: Unsupervised Movable Object Segmentation and Detectioncited by 20
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypointscited by 17
17 more
- 2022Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Imagescited by 16
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Surveycited by 16
- 2021The Pursuit of Knowledge: Discovering and Localizing Novel Categories using Dual Memorycited by 13
- 2023Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Fieldcited by 10
- 2025UCOD-DPL: Unsupervised Camouflaged Object Detection via Dynamic Pseudo-label Learningcited by 10
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-trainingcited by 8
- 2021Learning Foreground-Background Segmentation from Improved Layered GANscited by 7
- 2023Understanding Self-Supervised Features for Learning Unsupervised Instance Segmentationcited by 7
- 2021Unsupervised Image Decomposition with Phase-Correlation Networkscited by 6
- 2023Learning to Count without Annotationscited by 5
- 2023Learning Neural Eigenfunctions for Unsupervised Semantic Segmentationcited by 4
- 2023Benchmarking and Analysis of Unsupervised Object Segmentation from Real-world Single Imagescited by 4
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomycited by 4
- 2023Self-Supervised Instance Segmentation by Graspingcited by 3
- 2023SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentationcited by 1
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketchescited by 1
- 2026ORGAN: Object-Centric Representation Learning using Cycle Consistent Generative Adversarial Networkscited by 0
- 2026ORGAN: Object-Centric Representation Learning using Cycle Consistent Generative Adversarial Networks2 Mar 2026
- 2025UCOD-DPL: Unsupervised Camouflaged Object Detection via Dynamic Pseudo-label Learning8 Jun 2025
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketches27 Jan 2025
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy30 Oct 2024
- 2023Benchmarking and Analysis of Unsupervised Object Segmentation from Real-world Single Images8 Dec 2023
- 2023Understanding Self-Supervised Features for Learning Unsupervised Instance Segmentation24 Nov 2023
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Survey19 Oct 2023
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training22 Aug 2023
- 2023Learning to Count without Annotations17 Jul 2023
- 2023Self-Supervised Instance Segmentation by Grasping10 May 2023
- 2023Learning Neural Eigenfunctions for Unsupervised Semantic Segmentation6 Apr 2023
- 2023Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field3 Feb 2023
17 more
- 2023SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation1 Jan 2023
- 2022MOVE: Unsupervised Movable Object Segmentation and Detection14 Oct 2022
- 2022Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Images5 Oct 2022
- 2022Decoder Denoising Pretraining for Semantic Segmentation23 May 2022
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypoints21 May 2022
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization16 May 2022
- 2022Unsupervised Salient Object Detection with Spectral Cluster Voting23 Mar 2022
- 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editing4 Dec 2021
- 2021Compositional Transformers for Scene Generation17 Nov 2021
- 2021Unsupervised Image Decomposition with Phase-Correlation Networks7 Oct 2021
- 2021Object-aware Contrastive Learning for Debiased Scene Representation30 Jul 2021
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Models17 May 2021
- 2021The Pursuit of Knowledge: Discovering and Localizing Novel Categories using Dual Memory4 May 2021
- 2021Unsupervised Layered Image Decomposition into Object Prototypes29 Apr 2021
- 2021GENESIS-V2: Inferring Unordered Object Representations without Iterative Refinement20 Apr 2021
- 2021Learning Foreground-Background Segmentation from Improved Layered GANs1 Apr 2021
- 2021Context Decoupling Augmentation for Weakly Supervised Semantic Segmentation2 Mar 2021
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2021GENESIS-V2: Inferring Unordered Object Representations without Iterative Refinementcited by 109
- 2021Context Decoupling Augmentation for Weakly Supervised Semantic Segmentationcited by 69
- 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
- 2022Unsupervised Salient Object Detection with Spectral Cluster Votingcited by 56
- 2021Unsupervised Layered Image Decomposition into Object Prototypescited by 50
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Modelscited by 44
- 2021Object-aware Contrastive Learning for Debiased Scene Representationcited by 35
- 2021Compositional Transformers for Scene Generationcited by 24
- 2022Decoder Denoising Pretraining for Semantic Segmentationcited by 20
- 2022MOVE: Unsupervised Movable Object Segmentation and Detectioncited by 20
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypointscited by 17
12 most cited of 29 All 29 (JSON)
- 2026ORGAN: Object-Centric Representation Learning using Cycle Consistent Generative Adversarial Networks2 Mar 2026
- 2025UCOD-DPL: Unsupervised Camouflaged Object Detection via Dynamic Pseudo-label Learning8 Jun 2025
- 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketches27 Jan 2025
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy30 Oct 2024
- 2023Benchmarking and Analysis of Unsupervised Object Segmentation from Real-world Single Images8 Dec 2023
- 2023Understanding Self-Supervised Features for Learning Unsupervised Instance Segmentation24 Nov 2023
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Survey19 Oct 2023
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training22 Aug 2023
- 2023Learning to Count without Annotations17 Jul 2023
- 2023Self-Supervised Instance Segmentation by Grasping10 May 2023
- 2023Learning Neural Eigenfunctions for Unsupervised Semantic Segmentation6 Apr 2023
- 2023Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field3 Feb 2023
12 newest of 29 All 29 (JSON)