Large-Scale Unsupervised Object Discovery
Not on the map. Why?
Abstract (arXiv)
Existing approaches to unsupervised object discovery (UOD) do not scale up to large datasets without approximations that compromise their performance. We propose a novel formulation of UOD as a ranking problem, amenable to the arsenal of distributed methods available for eigenvalue problems and link analysis. Through the use of self-supervised features, we also demonstrate the first effective fully unsupervised pipeline for UOD. Extensive experiments on COCO and OpenImages show that, in the single-object discovery setting where a single prominent object is sought in each image, the proposed LOD (Large-scale Object Discovery) approach is on par with, or better than the state of the art for medium-scale datasets (up to 120K images), and over 37% better than the only other algorithms capable of scaling up to 1.7M images. In the multi-object discovery setting where multiple objects are sought in each image, the proposed LOD is over 14% better in average precision (AP) than all other methods for datasets ranging from 20K to 1.7M images. Using self-supervised features, we also show that the proposed method obtains state-of-the-art UOD performance on OpenImages. Our code is publicly available at https://github.com/huyvvo/LOD.
Key facts. Cited by 54 papers in the map (data through 13 Oct 2026). Builds on 31 of its 98 references that are in the map. First posted on arXiv 12 Jun 2021.
Builds on
31 of 98 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2014Microsoft COCO: Common Objects in Contextcited by 17,550
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,625
- 2017Mask R-CNNcited by 7,266
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,713
- 2016Densely Connected Convolutional Networkscited by 6,707
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,840
- 2015Fast R-CNNcited by 2,933
- 2015Learning Deep Features for Discriminative Localizationcited by 2,434
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2016YOLO9000: Better, Faster, Strongercited by 1,430
19 more
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 938
- 2020Object-Centric Learning with Slot Attentioncited by 869
- 2019MONet: Unsupervised Scene Decomposition and Representationcited by 390
- 2019Multi-Object Representation Learning with Iterative Variational Inferencecited by 359
- 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
- 2018Adversarial Complementary Learning for Weakly Supervised Object Localizationcited by 166
- 2019Pyramid Feature Attention Network for Saliency detectioncited by 128
- 2019Attention-based Dropout Layer for Weakly Supervised Object Localizationcited by 125
- 2020Evaluating Weakly Supervised Object Localization Methods Rightcited by 105
- 2018Self-produced Guidance for Weakly-supervised Object Localizationcited by 72
- 2015Unsupervised Object Discovery and Localization in the Wild: Part-based Matching with Bottom-up Region Proposalscited by 69
- 2020Toward unsupervised, multi-object discovery in large-scale image collectionscited by 65
- 2020Inter-Image Communication for Weakly Supervised Localizationcited by 52
- 2021Unsupervised Layered Image Decomposition into Object Prototypescited by 50
- 2015Object detection via a multi-region & semantic segmentation-aware CNN modelcited by 47
- 2019Unsupervised Image Matching and Object Discovery as Optimizationcited by 42
- 2017Unsupervised Object Discovery and Co-Localization by Deep Descriptor Transformingcited by 15
- 2017Deep Descriptor Transforming for Image Co-Localizationcited by 6
- 2016Image Co-localization by Mimicking a Good Detector's Confidence Score Distributioncited by 5
Built on by
Citing papers per year: 2021: 2; 2022: 17; 2023: 20; 2024: 8; 2025: 4; 2026: 3.
54 papers.
Sort:
By area:
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 228
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 220
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 187
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 166
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 113
- 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
- 2022Unsupervised Object Localization: Observing the Background to Discover Objectscited by 66
- 2022Motion Inspired Unsupervised Perception and Prediction in Autonomous Drivingcited by 59
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
- 2022Unsupervised Semantic Segmentation with Self-supervised Object-centric Representationscited by 54
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discoverycited by 53
38 more
- 2023Self-supervised Object-Centric Learning for Videoscited by 49
- 2023CLIP-DIY: CLIP Dense Inference Yields Open-Vocabulary Semantic Segmentation For-Freecited by 39
- 2022Self-Guided Diffusion Modelscited by 37
- 2023Unsupervised Universal Image Segmentationcited by 34
- 2024LiFT: A Surprisingly Simple Lightweight Feature Transform for Dense ViT Descriptorscited by 27
- 2023Towards Unsupervised Object Detection From LiDAR Point Cloudscited by 23
- 2021Object-Aware Cropping for Self-Supervised Learningcited by 22
- 2022Automatic dense annotation of large-vocabulary sign language videoscited by 20
- 2022MOVE: Unsupervised Movable Object Segmentation and Detectioncited by 20
- 2022Active Learning Strategies for Weakly-supervised Object Detectioncited by 17
- 2023MOST: Multiple Object localization with Self-supervised Transformers for object discoverycited by 17
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Surveycited by 16
- 2023Emergent Open-Vocabulary Semantic Segmentation from Off-the-shelf Vision-Language Modelscited by 15
- 2023Weakly-supervised Contrastive Learning for Unsupervised Object Discoverycited by 12
- 2022Learning to Discover and Detect Objectscited by 11
- 2023HEAP: Unsupervised Object Discovery and Localization with Contrastive Groupingcited by 10
- 2024HASSOD: Hierarchical Adaptive Self-Supervised Object Detectioncited by 10
- 2023What's in a Name? Beyond Class Indices for Image Recognitioncited by 9
- 2023FLSL: Feature-level Self-supervised Learningcited by 9
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-trainingcited by 8
- 2023Optical Flow boosts Unsupervised Localization and Segmentationcited by 7
- 2024SOHES: Self-supervised Open-world Hierarchical Entity Segmentationcited by 6
- 2022Foreground Guidance and Multi-Layer Feature Fusion for Unsupervised Object Discovery with Transformerscited by 4
- 2022Image Segmentation-based Unsupervised Multiple Objects Discoverycited by 4
- 2023SEMPART: Self-supervised Multi-resolution Partitioning of Image Semanticscited by 4
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomycited by 4
- 2023Enhancing Interpretable Object Abstraction via Clustering-based Slot Initializationcited by 3
- 2023Box-based Refinement for Weakly Supervised and Unsupervised Localization Taskscited by 3
- 2023The Background Also Matters: Background-Aware Motion-Guided Objects Discoverycited by 3
- 2024Masked Multi-Query Slot Attention for Unsupervised Object Discoverycited by 3
- 2024PANDAS: Prototype-based Novel Class Discovery and Detectioncited by 2
- 2024MOD-UV: Learning Mobile Object Detectors from Unlabeled Videoscited by 2
- 2022Novel 3D Scene Understanding Applications From Recurrence in a Single Imagecited by 1
- 2023Self-Supervised Learning of Object Segmentation from Unlabeled RGB-D Videoscited by 0
- 2024PEEKABOO: Hiding parts of an image for unsupervised object localizationcited by 0
- 2025Object Concepts Emerge from Motioncited by 0
- 2025Ensemble Foreground Management for Unsupervised Object Discoverycited by 0
- 2025S2-UniSeg: Fast Universal Agglomerative Pooling for Scalable Segment Anything without Supervisioncited by 0
50 most cited of 54 All 54 (JSON)
- 2026Object Concepts Emerge from Motion3 Sep 2026
- 2026Real-time Unsupervised Object Discovery from Asynchronous Event Streams27 Aug 2026
- 2026Reference-based Category Discovery: Unsupervised Object Detection with Category Awareness6 May 2026
- 2025DADO: A Depth-Attention framework for Object Discovery8 Oct 2025
- 2025S2-UniSeg: Fast Universal Agglomerative Pooling for Scalable Segment Anything without Supervision9 Aug 2025
- 2025Ensemble Foreground Management for Unsupervised Object Discovery28 Jul 2025
- 2025Object Concepts Emerge from Motion27 May 2025
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy30 Oct 2024
- 2024PEEKABOO: Hiding parts of an image for unsupervised object localization24 Jul 2024
- 2024MOD-UV: Learning Mobile Object Detectors from Unlabeled Videos23 May 2024
- 2024Masked Multi-Query Slot Attention for Unsupervised Object Discovery30 Apr 2024
- 2024SOHES: Self-supervised Open-world Hierarchical Entity Segmentation18 Apr 2024
38 more
- 2024LiFT: A Surprisingly Simple Lightweight Feature Transform for Dense ViT Descriptors21 Mar 2024
- 2024PANDAS: Prototype-based Novel Class Discovery and Detection27 Feb 2024
- 2024HASSOD: Hierarchical Adaptive Self-Supervised Object Detection5 Feb 2024
- 2023HEAP: Unsupervised Object Discovery and Localization with Contrastive Grouping29 Dec 2023
- 2023Unsupervised Universal Image Segmentation28 Dec 2023
- 2023Emergent Open-Vocabulary Semantic Segmentation from Off-the-shelf Vision-Language Models28 Nov 2023
- 2023The Background Also Matters: Background-Aware Motion-Guided Objects Discovery5 Nov 2023
- 2023Towards Unsupervised Object Detection From LiDAR Point Clouds3 Nov 2023
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Survey19 Oct 2023
- 2023Self-supervised Object-Centric Learning for Videos10 Oct 2023
- 2023CLIP-DIY: CLIP Dense Inference Yields Open-Vocabulary Semantic Segmentation For-Free25 Sep 2023
- 2023SEMPART: Self-supervised Multi-resolution Partitioning of Image Semantics20 Sep 2023
- 2023Box-based Refinement for Weakly Supervised and Unsupervised Localization Tasks7 Sep 2023
- 2023Enhancing Interpretable Object Abstraction via Clustering-based Slot Initialization22 Aug 2023
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training22 Aug 2023
- 2023Optical Flow boosts Unsupervised Localization and Segmentation25 Jul 2023
- 2023Weakly-supervised Contrastive Learning for Unsupervised Object Discovery7 Jul 2023
- 2023FLSL: Feature-level Self-supervised Learning9 Jun 2023
- 2023MOST: Multiple Object localization with Self-supervised Transformers for object discovery11 Apr 2023
- 2023Self-Supervised Learning of Object Segmentation from Unlabeled RGB-D Videos9 Apr 2023
- 2023What's in a Name? Beyond Class Indices for Image Recognition5 Apr 2023
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discovery17 Mar 2023
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentation26 Jan 2023
- 2022Image Segmentation-based Unsupervised Multiple Objects Discovery20 Dec 2022
- 2022Unsupervised Object Localization: Observing the Background to Discover Objects15 Dec 2022
- 2022Foreground Guidance and Multi-Layer Feature Fusion for Unsupervised Object Discovery with Transformers24 Oct 2022
- 2022Learning to Discover and Detect Objects19 Oct 2022
- 2022Motion Inspired Unsupervised Perception and Prediction in Autonomous Driving14 Oct 2022
- 2022Novel 3D Scene Understanding Applications From Recurrence in a Single Image14 Oct 2022
- 2022MOVE: Unsupervised Movable Object Segmentation and Detection14 Oct 2022
- 2022Self-Guided Diffusion Models12 Oct 2022
- 2022Bridging the Gap to Real-World Object-Centric Learning29 Sep 2022
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cut1 Sep 2022
- 2022Automatic dense annotation of large-vocabulary sign language videos4 Aug 2022
- 2022Active Learning Strategies for Weakly-supervised Object Detection25 Jul 2022
- 2022Unsupervised Semantic Segmentation with Self-supervised Object-centric Representations11 Jul 2022
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentation13 Jun 2022
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization16 May 2022
50 newest of 54 All 54 (JSON)
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discoverycited by 53
- 2022Self-Guided Diffusion Modelscited by 37
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discovery17 Mar 2023
- 2022Self-Guided Diffusion Models12 Oct 2022
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 228
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 220
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 187
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 113
- 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
- 2022Unsupervised Object Localization: Observing the Background to Discover Objectscited by 66
- 2022Motion Inspired Unsupervised Perception and Prediction in Autonomous Drivingcited by 59
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
- 2022Unsupervised Semantic Segmentation with Self-supervised Object-centric Representationscited by 54
- 2023Self-supervised Object-Centric Learning for Videoscited by 49
- 2023CLIP-DIY: CLIP Dense Inference Yields Open-Vocabulary Semantic Segmentation For-Freecited by 39
12 most cited of 49 All 49 (JSON)
- 2026Object Concepts Emerge from Motion3 Sep 2026
- 2026Real-time Unsupervised Object Discovery from Asynchronous Event Streams27 Aug 2026
- 2026Reference-based Category Discovery: Unsupervised Object Detection with Category Awareness6 May 2026
- 2025DADO: A Depth-Attention framework for Object Discovery8 Oct 2025
- 2025S2-UniSeg: Fast Universal Agglomerative Pooling for Scalable Segment Anything without Supervision9 Aug 2025
- 2025Ensemble Foreground Management for Unsupervised Object Discovery28 Jul 2025
- 2025Object Concepts Emerge from Motion27 May 2025
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy30 Oct 2024
- 2024PEEKABOO: Hiding parts of an image for unsupervised object localization24 Jul 2024
- 2024MOD-UV: Learning Mobile Object Detectors from Unlabeled Videos23 May 2024
- 2024Masked Multi-Query Slot Attention for Unsupervised Object Discovery30 Apr 2024
- 2024SOHES: Self-supervised Open-world Hierarchical Entity Segmentation18 Apr 2024
12 newest of 49 All 49 (JSON)