PEEKABOO: Hiding parts of an image for unsupervised object localization
Not on the map. Why?
Abstract (arXiv)
Localizing objects in an unsupervised manner poses significant challenges due to the absence of key visual information such as the appearance, type and number of objects, as well as the lack of labeled object classes typically available in supervised settings. While recent approaches to unsupervised object localization have demonstrated significant progress by leveraging self-supervised visual representations, they often require computationally intensive training processes, resulting in high resource demands in terms of computation, learnable parameters, and data. They also lack explicit modeling of visual context, potentially limiting their accuracy in object localization. To tackle these challenges, we propose a single-stage learning framework, dubbed PEEKABOO, for unsupervised object localization by learning context-based representations at both the pixel- and shape-level of the localized objects through image masking. The key idea is to selectively hide parts of an image and leverage the remaining image information to infer the location of objects without explicit supervision. The experimental results, both quantitative and qualitative, across various benchmark datasets, demonstrate the simplicity, effectiveness and competitive performance of our approach compared to state-of-the-art methods in both single object discovery and unsupervised salient object detection tasks. Code and pre-trained models are available at: https://github.com/hasibzunair/peekaboo
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 49 references that are in the map. First posted on arXiv 24 Jul 2024.
Builds on
35 of 49 references.
References · 35
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
23 more
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2019Large Scale Adversarial Representation Learningcited by 238
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 227
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 166
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
- 2015The Fast Bilateral Solvercited by 86
- 2022Unsupervised Object Localization: Observing the Background to Discover Objectscited by 66
- 2020Toward unsupervised, multi-object discovery in large-scale image collectionscited by 65
- 2022Unsupervised Salient Object Detection with Spectral Cluster Votingcited by 56
- 2021Large-Scale Unsupervised Object Discoverycited by 54
- 2022Unsupervised Semantic Segmentation with Self-supervised Object-centric Representationscited by 54
- 2020Object Segmentation Without Labels with Large-Scale Generative Modelscited by 52
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Modelscited by 44
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clusteringcited by 25
- 2019Object Discovery From a Single Unlabeled Image by Mining Frequent Itemset With Multi-scale Featurescited by 19
- 2023Weakly-supervised Contrastive Learning for Unsupervised Object Discoverycited by 12
- 2023CPCM: Contextual Point Cloud Modeling for Weakly-supervised Point Cloud Semantic Segmentationcited by 12
- 2023Unsupervised Object Localization with Representer Point Selectioncited by 3
- 2023Learning to recognize occluded and small objects with partial inputscited by 1
Built on by
Not cited yet.