Self-EMD: Self-Supervised Object Detection without ImageNet
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel self-supervised representation learning method, Self-EMD, for object detection. Our method directly trained on unlabeled non-iconic image dataset like COCO, instead of commonly used iconic-object image dataset like ImageNet. We keep the convolutional feature maps as the image embedding to preserve spatial structures and adopt Earth Mover's Distance (EMD) to compute the similarity between two embeddings. Our Faster R-CNN (ResNet50-FPN) baseline achieves 39.8% mAP on COCO, which is on par with the state of the art self-supervised methods pre-trained on ImageNet. More importantly, it can be further improved to 40.4% mAP with more unlabeled images, showing its great potential for leveraging more easily obtained unlabeled data. Code will be made available.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 23; 2023: 20; 2024: 10; 2025: 5.
70 papers.
Sort:
By area:
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 397
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
- 2021MST: Masked Self-Supervised Transformer for Visual Representationcited by 114
- 2021Aligning Pretraining for Detection via Object-Level Contrastive Learningcited by 110
- 2022Self-Supervised Learning of Object Parts for Semantic Segmentationcited by 90
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 85
- 2022Siamese Image Modeling for Self-Supervised Vision Representation Learningcited by 78
- 2021Unsupervised Object-Level Representation Learning from Scene Imagescited by 72
- 2022Self-Supervised Visual Representation Learning with Semantic Groupingcited by 70
- 2021Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistencycited by 63
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022Hyperbolic Contrastive Learning for Visual Representations beyond Objectscited by 58
38 more
- 2023Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learningcited by 55
- 2022Understanding Masked Image Modeling via Learning Occlusion Invariant Featurecited by 50
- 2023CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understandingcited by 48
- 2022Point-Level Region Contrast for Object Detection Pre-Trainingcited by 41
- 2022Learning Super-Features for Image Retrievalcited by 35
- 2022Dense Learning based Semi-Supervised Object Detectioncited by 32
- 2022UniVIP: A Unified Framework for Self-Supervised Visual Pre-trainingcited by 30
- 2022Versatile Multi-Modal Pre-Training for Human-Centric Perceptioncited by 26
- 2024GroupContrast: Semantic-aware Self-supervised Representation Learning for 3D Understandingcited by 26
- 2021Object-Aware Cropping for Self-Supervised Learningcited by 22
- 2023CrOC: Cross-View Online Clustering for Dense Visual Representation Learningcited by 21
- 2022Partially Does It: Towards Scene-Level FG-SBIR with Partial Inputcited by 20
- 2023Semantics Meets Temporal Correspondence: Self-supervised Object-centric Learning in Videoscited by 20
- 2023Multi-Label Self-Supervised Learning with Scene Imagescited by 17
- 2023CrIBo: Self-Supervised Learning via Cross-Image Object-Level Bootstrappingcited by 17
- 2024Near, far: Patch-ordering enhances vision foundation models' scene understandingcited by 15
- 2023AlignDet: Aligning Pre-training and Fine-tuning in Object Detectioncited by 14
- 2024Crowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenescited by 13
- 2022RoSA: A Robust Self-Aligned Framework for Node-Node Graph Contrastive Learningcited by 12
- 2021Semantic-Aware Generation for Self-Supervised Visual Representation Learningcited by 11
- 2022ConCL: Concept Contrastive Learning for Dense Prediction Pre-training in Pathology Imagescited by 11
- 2021Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectorscited by 9
- 2021Exploring Localization for Self-supervised Fine-grained Contrastive Learningcited by 9
- 2023Self-Supervised Representation Learning from Temporal Ordering of Automated Driving Sequencescited by 9
- 2023SelfDocSeg: A Self-Supervised vision-based Approach towards Document Segmentationcited by 7
- 2023Introspective Deep Metric Learningcited by 7
- 2023Prospective Role of Foundation Models in Advancing Autonomous Vehiclescited by 7
- 2023DenseDINO: Boosting Dense Self-Supervised Learning with Token-Based Point-Level Consistencycited by 6
- 2022DATA: Domain-Aware and Task-Aware Self-supervised Learningcited by 5
- 2022Pixel-Wise Contrastive Distillationcited by 5
- 2023Coarse Is Better? A New Pipeline Towards Self-Supervised Learning with Uncurated Imagescited by 5
- 2023PAD: Self-Supervised Pre-Training with Patchwise-Scale Adapter for Infrared Imagescited by 5
- 2021Residual Contrastive Learning for Image Reconstruction: Learning Transferable Representations from Noisy Imagescited by 3
- 2022CoDo: Contrastive Learning with Downstream Background Invariance for Detectioncited by 3
- 2022OPERA: Omni-Supervised Representation Learning with Hierarchical Supervisionscited by 3
- 2022Local Manifold Augmentation for Multiview Semantic Consistencycited by 3
- 2023De-coupling and De-positioning Dense Self-supervised Learningcited by 3
- 2024LeOCLR: Leveraging Original Images for Contrastive Learning of Visual Representationscited by 3
50 most cited of 70 All 70 (JSON)
- 2025UNIV: Unified Foundation Model for Infrared and Visible Modalities19 Sep 2025
- 2025Beyond Instance Consistency: Investigating View Diversity in Self-supervised Learning14 Sep 2025
- 2025Multiple Object Stitching for Unsupervised Representation Learning9 Jun 2025
- 2025A Contrastive Learning Foundation Model Based on Perfectly Aligned Sample Pairs for Remote Sensing Images26 May 2025
- 2025RADLER: Radar Object Detection Leveraging Semantic 3D City Models and Self-Supervised Radar-Image Learning16 Apr 2025
- 2024Meta-Reflection: A Feedback-Free Reflection Learning Framework18 Dec 2024
- 2024Unlocking the Potential of Weakly Labeled Data: A Co-Evolutionary Learning Framework for Abnormality Detection and Report Generation18 Dec 2024
- 2024Long-Tailed Object Detection Pre-training: Dynamic Rebalancing Contrastive Learning with Dual Reconstruction14 Nov 2024
- 2024Self-Supervised Learning for Real-World Object Detection: a Survey9 Oct 2024
- 2024Near, far: Patch-ordering enhances vision foundation models' scene understanding20 Aug 2024
- 2024Crowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenes16 Jul 2024
- 2024Multi-Grained Contrast for Data-Efficient Unsupervised Representation Learning2 Jul 2024
38 more
- 2024UnSupDLA: Towards Unsupervised Document Layout Analysis10 Jun 2024
- 2024GroupContrast: Semantic-aware Self-supervised Representation Learning for 3D Understanding14 Mar 2024
- 2024LeOCLR: Leveraging Original Images for Contrastive Learning of Visual Representations11 Mar 2024
- 2023PAD: Self-Supervised Pre-Training with Patchwise-Scale Adapter for Infrared Images13 Dec 2023
- 2023Prospective Role of Foundation Models in Advancing Autonomous Vehicles8 Dec 2023
- 2023CrIBo: Self-Supervised Learning via Cross-Image Object-Level Bootstrapping11 Oct 2023
- 2023Introspective Deep Metric Learning11 Sep 2023
- 2023Semantics Meets Temporal Correspondence: Self-supervised Object-centric Learning in Videos19 Aug 2023
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training18 Aug 2023
- 2023Multi-Label Self-Supervised Learning with Scene Images7 Aug 2023
- 2023AlignDet: Aligning Pre-training and Fine-tuning in Object Detection20 Jul 2023
- 2023Coarse Is Better? A New Pipeline Towards Self-Supervised Learning with Uncurated Images7 Jun 2023
- 2023DenseDINO: Boosting Dense Self-Supervised Learning with Token-Based Point-Level Consistency6 Jun 2023
- 2023SelfDocSeg: A Self-Supervised vision-based Approach towards Document Segmentation1 May 2023
- 2023CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding19 Apr 2023
- 2023Multi-Level Contrastive Learning for Dense Prediction Task4 Apr 2023
- 2023De-coupling and De-positioning Dense Self-supervised Learning29 Mar 2023
- 2023Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learning24 Mar 2023
- 2023CrOC: Cross-View Online Clustering for Dense Visual Representation Learning23 Mar 2023
- 2023SeqCo-DETR: Sequence Consistency Training for Self-Supervised Object Detection with Transformers15 Mar 2023
- 2023Efficient Masked Autoencoders with Self-Consistency28 Feb 2023
- 2023Saliency Guided Contrastive Learning on Scene Images22 Feb 2023
- 2023Self-Supervised Representation Learning from Temporal Ordering of Automated Driving Sequences17 Feb 2023
- 2022Hyperbolic Contrastive Learning for Visual Representations beyond Objects1 Dec 2022
- 2022Local Manifold Augmentation for Multiview Semantic Consistency5 Nov 2022
- 2022Pixel-Wise Contrastive Distillation1 Nov 2022
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completion19 Oct 2022
- 2022OPERA: Omni-Supervised Representation Learning with Hierarchical Supervisions11 Oct 2022
- 2022Understanding Masked Image Modeling via Learning Occlusion Invariant Feature8 Aug 2022
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentation28 Jul 2022
- 2022ConCL: Concept Contrastive Learning for Dense Prediction Pre-training in Pathology Images14 Jul 2022
- 2022Siamese Image Modeling for Self-Supervised Vision Representation Learning2 Jun 2022
- 2022Self-Supervised Visual Representation Learning with Semantic Grouping30 May 2022
- 2022Penalizing Proposals using Classifiers for Semi-Supervised Object Detection26 May 2022
- 2022CoDo: Contrastive Learning with Downstream Background Invariance for Detection10 May 2022
- 2022RoSA: A Robust Self-Aligned Framework for Node-Node Graph Contrastive Learning29 Apr 2022
- 2022Self-Supervised Learning of Object Parts for Semantic Segmentation27 Apr 2022
- 2022Dense Learning based Semi-Supervised Object Detection15 Apr 2022
50 newest of 70 All 70 (JSON)
- 2023Efficient Masked Autoencoders with Self-Consistencycited by 2
- 2023Efficient Masked Autoencoders with Self-Consistency28 Feb 2023
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 397
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
- 2021MST: Masked Self-Supervised Transformer for Visual Representationcited by 114
- 2021Aligning Pretraining for Detection via Object-Level Contrastive Learningcited by 110
- 2022Self-Supervised Learning of Object Parts for Semantic Segmentationcited by 90
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 85
- 2022Siamese Image Modeling for Self-Supervised Vision Representation Learningcited by 78
- 2021Unsupervised Object-Level Representation Learning from Scene Imagescited by 72
- 2022Self-Supervised Visual Representation Learning with Semantic Groupingcited by 70
- 2021Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistencycited by 63
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022Hyperbolic Contrastive Learning for Visual Representations beyond Objectscited by 58
12 most cited of 69 All 69 (JSON)
- 2025UNIV: Unified Foundation Model for Infrared and Visible Modalities19 Sep 2025
- 2025Beyond Instance Consistency: Investigating View Diversity in Self-supervised Learning14 Sep 2025
- 2025Multiple Object Stitching for Unsupervised Representation Learning9 Jun 2025
- 2025A Contrastive Learning Foundation Model Based on Perfectly Aligned Sample Pairs for Remote Sensing Images26 May 2025
- 2025RADLER: Radar Object Detection Leveraging Semantic 3D City Models and Self-Supervised Radar-Image Learning16 Apr 2025
- 2024Meta-Reflection: A Feedback-Free Reflection Learning Framework18 Dec 2024
- 2024Unlocking the Potential of Weakly Labeled Data: A Co-Evolutionary Learning Framework for Abnormality Detection and Report Generation18 Dec 2024
- 2024Long-Tailed Object Detection Pre-training: Dynamic Rebalancing Contrastive Learning with Dual Reconstruction14 Nov 2024
- 2024Self-Supervised Learning for Real-World Object Detection: a Survey9 Oct 2024
- 2024Near, far: Patch-ordering enhances vision foundation models' scene understanding20 Aug 2024
- 2024Crowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenes16 Jul 2024
- 2024Multi-Grained Contrast for Data-Efficient Unsupervised Representation Learning2 Jul 2024
12 newest of 69 All 69 (JSON)