Self-supervised structured object representation learning
Not on the map. Why?
Abstract (arXiv)
Self-supervised learning (SSL) has emerged as a powerful technique for learning visual representations. While recent SSL approaches achieve strong results in global image understanding, they are limited in capturing the structured representation in scenes. In this work, we propose a self-supervised approach that progressively builds structured visual representations by combining semantic grouping, instance level separation, and hierarchical structuring. Our approach, based on a novel ProtoScale module, captures visual elements across multiple spatial scales. Unlike common strategies like DINO that rely on random cropping and global embeddings, we preserve full scene context across augmented views to improve performance in dense prediction tasks. We validate our method on downstream object detection tasks using a combined subset of multiple datasets (COCO and UA-DETRAC). Experimental results show that our method learns object centric representations that enhance supervised object detection and outperform the state-of-the-art methods, even when trained with limited annotated data and fewer fine-tuning epochs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 24 references that are in the map. First posted on arXiv 27 Aug 2025.
Builds on
21 of 24 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2020Object-Centric Learning with Slot Attentioncited by 876
9 more
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 533
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 187
- 2021Efficient Visual Pretraining with Contrastive Detectioncited by 150
- 2021Aligning Pretraining for Detection via Object-Level Contrastive Learningcited by 110
- 2015UA-DETRAC: A New Benchmark and Protocol for Multi-Object Detection and Trackingcited by 98
- 2022Self-Supervised Visual Representation Learning with Semantic Groupingcited by 70
- 2025Vision Transformers Don't Need Trained Registerscited by 41
- 2023MOST: Multiple Object localization with Self-supervised Transformers for object discoverycited by 17
- 2022Towards Sustainable Self-supervised Learningcited by 8
Built on by
Not cited yet.