Self-supervised Learning of Geometrically Stable Features Through Probabilistic Introspection
Not on the map. Why?
Abstract (arXiv)
Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at extending it to geometry-oriented tasks such as semantic matching and part detection. We do so by building on several recent ideas in unsupervised landmark detection. Our approach learns dense distinctive visual descriptors from an unlabelled dataset of images using synthetic image transformations. It does so by means of a robust probabilistic formulation that can introspectively determine which image regions are likely to result in stable image matching. We show empirically that a network pre-trained in this manner requires significantly less supervision to learn semantic object parts compared to numerous pre-training alternatives. We also show that the pre-trained representation is excellent for semantic object matching.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 11; 2024: 4; 2025: 2.
27 papers.
Sort:
- 2021PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clusteringcited by 163
- 2022Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methodscited by 146
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Surveycited by 52
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
- 2023Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Trainingcited by 39
- 2021Few-shot Keypoint Detection with Uncertainty Learning for Unseen Speciescited by 27
- 2023ASIC: Aligning Sparse in-the-wild Image Collectionscited by 26
- 2023Unified Mask Embedding and Correspondence Learning for Self-Supervised Video Segmentationcited by 16
- 2021Learning Augmentation Distributions using Transformed Risk Minimizationcited by 13
- 2023From Saliency to DINO: Saliency-guided Vision Transformer for Few-shot Keypoint Detectioncited by 8
15 more
- 2022Distilling Knowledge from Self-Supervised Teacher by Embedding Graph Alignmentcited by 7
- 2022Learning Dense Object Descriptors from Multiple Views for Low-shot Category Generalizationcited by 6
- 2023Learning Geometry-aware Representations by Sketchingcited by 5
- 2022Mix-up Self-Supervised Learning for Contrast-agnostic Applicationscited by 3
- 2023Representation Learning Dynamics of Self-Supervised Modelscited by 3
- 2024Self-Supervised Learning for Text Recognition: A Critical Surveycited by 3
- 2023ProcSim: Proxy-based Confidence for Robust Similarity Learningcited by 2
- 2025PartCo: Part-Level Correspondence Priors Enhance Category Discoverycited by 2
- 2023Curricular and Cyclical Loss for Time Series Learning Strategycited by 1
- 2024Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Datacited by 1
- 2024Spatial Context-based Self-Supervised Learning for Handwritten Text Recognitioncited by 1
- 2024Quantum Curriculum Learningcited by 1
- 2023Automatic Detection of Out-of-body Frames in Surgical Videos for Privacy Protection Using Self-supervised Learning and Minimal Labelscited by 0
- 2023Learning Spiking Neural Network from Easy to Hard taskcited by 0
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detectioncited by 0
- 2025PartCo: Part-Level Correspondence Priors Enhance Category Discovery26 Sep 2025
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection10 Jul 2025
- 2024Self-Supervised Learning for Text Recognition: A Critical Survey29 Jul 2024
- 2024Quantum Curriculum Learning2 Jul 2024
- 2024Spatial Context-based Self-Supervised Learning for Handwritten Text Recognition17 Apr 2024
- 2024Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Data27 Feb 2024
- 2023Curricular and Cyclical Loss for Time Series Learning Strategy26 Dec 2023
- 2023ProcSim: Proxy-based Confidence for Robust Similarity Learning1 Nov 2023
- 2023Learning Spiking Neural Network from Easy to Hard task9 Sep 2023
- 2023Representation Learning Dynamics of Self-Supervised Models5 Sep 2023
- 2023Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Training23 May 2023
- 2023Learning Geometry-aware Representations by Sketching17 Apr 2023
15 more
- 2023From Saliency to DINO: Saliency-guided Vision Transformer for Few-shot Keypoint Detection6 Apr 2023
- 2023Automatic Detection of Out-of-body Frames in Surgical Videos for Privacy Protection Using Self-supervised Learning and Minimal Labels31 Mar 2023
- 2023ASIC: Aligning Sparse in-the-wild Image Collections28 Mar 2023
- 2023Unified Mask Embedding and Correspondence Learning for Self-Supervised Video Segmentation17 Mar 2023
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representation8 Mar 2023
- 2022Learning Dense Object Descriptors from Multiple Views for Low-shot Category Generalization28 Nov 2022
- 2022Distilling Knowledge from Self-Supervised Teacher by Embedding Graph Alignment23 Nov 2022
- 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Survey24 Aug 2022
- 2022Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods23 May 2022
- 2022Mix-up Self-Supervised Learning for Contrast-agnostic Applications2 Apr 2022
- 2021Few-shot Keypoint Detection with Uncertainty Learning for Unseen Species12 Dec 2021
- 2021Learning Augmentation Distributions using Transformed Risk Minimization16 Nov 2021
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Network28 Sep 2021
- 2021PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering30 Mar 2021
- 2021Learning Accurate Dense Correspondences and When to Trust Them5 Jan 2021
- 2021PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clusteringcited by 163
- 2022Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methodscited by 146
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Surveycited by 52
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
- 2023Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Trainingcited by 39
- 2021Few-shot Keypoint Detection with Uncertainty Learning for Unseen Speciescited by 27
- 2023ASIC: Aligning Sparse in-the-wild Image Collectionscited by 26
- 2023Unified Mask Embedding and Correspondence Learning for Self-Supervised Video Segmentationcited by 16
- 2021Learning Augmentation Distributions using Transformed Risk Minimizationcited by 13
- 2023From Saliency to DINO: Saliency-guided Vision Transformer for Few-shot Keypoint Detectioncited by 8
12 most cited of 27 All 27 (JSON)
- 2025PartCo: Part-Level Correspondence Priors Enhance Category Discovery26 Sep 2025
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection10 Jul 2025
- 2024Self-Supervised Learning for Text Recognition: A Critical Survey29 Jul 2024
- 2024Quantum Curriculum Learning2 Jul 2024
- 2024Spatial Context-based Self-Supervised Learning for Handwritten Text Recognition17 Apr 2024
- 2024Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Data27 Feb 2024
- 2023Curricular and Cyclical Loss for Time Series Learning Strategy26 Dec 2023
- 2023ProcSim: Proxy-based Confidence for Robust Similarity Learning1 Nov 2023
- 2023Learning Spiking Neural Network from Easy to Hard task9 Sep 2023
- 2023Representation Learning Dynamics of Self-Supervised Models5 Sep 2023
- 2023Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Training23 May 2023
- 2023Learning Geometry-aware Representations by Sketching17 Apr 2023
12 newest of 27 All 27 (JSON)