Image Segmentation-based Unsupervised Multiple Objects Discovery
Not on the map. Why?
Abstract (arXiv)
Unsupervised object discovery aims to localize objects in images, while removing the dependence on annotations required by most deep learning-based methods. To address this problem, we propose a fully unsupervised, bottom-up approach, for multiple objects discovery. The proposed approach is a two-stage framework. First, instances of object parts are segmented by using the intra-image similarity between self-supervised local features. The second step merges and filters the object parts to form complete object instances. The latter is performed by two CNN models that capture semantic information on objects from the entire dataset. We demonstrate that the pseudo-labels generated by our method provide a better precision-recall trade-off than existing single and multiple objects discovery methods. In particular, we provide state-of-the-art results for both unsupervised class-agnostic object detection and unsupervised image segmentation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 19 of its 35 references that are in the map. First posted on arXiv 20 Dec 2022.
Builds on
19 of 35 references.
References · 19
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2018Invariant Information Clustering for Unsupervised Image Classification and Segmentationcited by 455
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 230
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 167
- 2021Training Vision Transformers for Image Retrievalcited by 90
- 2015Unsupervised Object Discovery and Localization in the Wild: Part-based Matching with Bottom-up Region Proposalscited by 69
7 more
- 2020Toward unsupervised, multi-object discovery in large-scale image collectionscited by 65
- 2020Unsupervised Learning of Image Segmentation Based on Differentiable Feature Clusteringcited by 61
- 2021Large-Scale Unsupervised Object Discoverycited by 54
- 2019Unsupervised Image Matching and Object Discovery as Optimizationcited by 42
- 2021Semantic Segmentation In-the-Wild Without Seeing Any Segmentation Examplescited by 24
- 2017Deep Descriptor Transforming for Image Co-Localizationcited by 6
- 2022Self-Supervised Pre-training of Vision Transformers for Dense Prediction Taskscited by 1
Built on by
Citing papers per year: 2023: 3; 2024: 1.
4 papers.
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Surveycited by 16
- 2023Weakly-supervised Contrastive Learning for Unsupervised Object Discoverycited by 12
- 2024Interpretable end-to-end Neurosymbolic Reinforcement Learning agentscited by 4
- 2023The Background Also Matters: Background-Aware Motion-Guided Objects Discoverycited by 3
- 2024Interpretable end-to-end Neurosymbolic Reinforcement Learning agents18 Oct 2024
- 2023The Background Also Matters: Background-Aware Motion-Guided Objects Discovery5 Nov 2023
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Survey19 Oct 2023
- 2023Weakly-supervised Contrastive Learning for Unsupervised Object Discovery7 Jul 2023