Correspondence Networks with Adaptive Neighbourhood Consensus
Not on the map. Why?
Abstract (arXiv)
In this paper, we tackle the task of establishing dense visual correspondences between images containing objects of the same category. This is a challenging task due to large intra-class variations and a lack of dense pixel level annotations. We propose a convolutional neural network architecture, called adaptive neighbourhood consensus network (ANC-Net), that can be trained end-to-end with sparse key-point annotations, to handle this challenge. At the core of ANC-Net is our proposed non-isotropic 4D convolution kernel, which forms the building block for the adaptive neighbourhood consensus module for robust matching. We also introduce a simple and efficient multi-scale self-similarity module in ANC-Net to make the learned feature robust to intra-class variations. Furthermore, we propose a novel orthogonal loss that can enforce the one-to-one matching constraint. We thoroughly evaluate the effectiveness of our method on various benchmarks, where it substantially outperforms state-of-the-art methods.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 14; 2023: 6; 2024: 5; 2025: 2; 2026: 4.
42 papers.
Sort:
By area:
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2022Correlation Verification for Image Retrievalcited by 47
- 2021Convolutional Hough Matching Networkscited by 43
- 2023SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matchingcited by 38
- 2022Visual correspondence-based explanations improve AI robustness and human-AI team accuracycited by 37
- 2021Multi-scale Matching Networks for Semantic Correspondencecited by 32
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondencecited by 32
30 more
- 2022Learning Semantic Correspondence with Sparse Annotationscited by 31
- 2021Deep Matching Prior: Test-Time Optimization for Dense Correspondencecited by 30
- 2022Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondencescited by 30
- 2022TransforMatcher: Match-to-Match Attention for Semantic Correspondencecited by 29
- 2023ASIC: Aligning Sparse in-the-wild Image Collectionscited by 26
- 2023FECANet: Boosting Few-Shot Semantic Segmentation with Feature-Enhanced Context-Aware Networkcited by 22
- 2022MSANet: Multi-Similarity and Attention Guidance for Boosting Few-Shot Segmentationcited by 21
- 2021The Animation Transformer: Visual Correspondence via Segment Matchingcited by 20
- 2024Distillation of Diffusion Features for Semantic Correspondencecited by 17
- 2021Cost Aggregation Is All You Need for Few-Shot Segmentationcited by 16
- 2022Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labelscited by 16
- 2024Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondencecited by 14
- 2021Convolutional Hough Matching Networks for Robust and Efficient Visual Correspondencecited by 12
- 2022Demystifying Unsupervised Semantic Correspondence Estimationcited by 9
- 2021DenseGAP: Graph-Structured Dense Correspondence Learning with Anchor Pointscited by 8
- 2022Integrative Feature and Cost Aggregation with Transformers for Dense Correspondencecited by 6
- 2023SimSC: A Simple Framework for Semantic Correspondence with Temperature Learningcited by 6
- 2023Efficient Semantic Matching with Hypercolumn Correlationcited by 6
- 2024Beyond Mask: Rethinking Guidance Types in Few-shot Segmentationcited by 3
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baselinecited by 3
- 2026MARCO: Navigating the Unseen Space of Semantic Correspondencecited by 3
- 2021Understanding Pixel-level 2D Image Semantics with 3D Keypoint Knowledge Enginecited by 2
- 2023Match me if you can: Semi-Supervised Semantic Correspondence Learning with Unpaired Imagescited by 2
- 2024Independently Keypoint Learning for Small Object Semantic Correspondencecited by 2
- 2025Similarity-Aware Selective State-Space Modeling for Semantic Correspondencecited by 1
- 2022Joint Learning of Feature Extraction and Cost Aggregation for Semantic Correspondencecited by 0
- 2024Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attentioncited by 0
- 2026SimpleMatch: A Simple and Strong Baseline for Semantic Correspondencecited by 0
- 2026AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifierscited by 0
- 2026DreamSat-Pose: Spacecraft Pose Estimation from Single-View 3D Reconstructions and Learned 2D-3D Feature Matchingcited by 0
- 2026DreamSat-Pose: Spacecraft Pose Estimation from Single-View 3D Reconstructions and Learned 2D-3D Feature Matching15 Jul 2026
- 2026MARCO: Navigating the Unseen Space of Semantic Correspondence20 Apr 2026
- 2026AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifiers30 Mar 2026
- 2026SimpleMatch: A Simple and Strong Baseline for Semantic Correspondence18 Jan 2026
- 2025Similarity-Aware Selective State-Space Modeling for Semantic Correspondence29 Sep 2025
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baseline23 May 2025
- 2024Distillation of Diffusion Features for Semantic Correspondence4 Dec 2024
- 2024Beyond Mask: Rethinking Guidance Types in Few-shot Segmentation16 Jul 2024
- 2024Independently Keypoint Learning for Small Object Semantic Correspondence3 Apr 2024
- 2024Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondence17 Mar 2024
- 2024Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attention18 Jan 2024
- 2023Match me if you can: Semi-Supervised Semantic Correspondence Learning with Unpaired Images30 Nov 2023
30 more
- 2023Efficient Semantic Matching with Hypercolumn Correlation7 Nov 2023
- 2023SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matching26 Oct 2023
- 2023SimSC: A Simple Framework for Semantic Correspondence with Temperature Learning3 May 2023
- 2023ASIC: Aligning Sparse in-the-wild Image Collections28 Mar 2023
- 2023FECANet: Boosting Few-Shot Semantic Segmentation with Feature-Enhanced Context-Aware Network19 Jan 2023
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondence6 Oct 2022
- 2022Integrative Feature and Cost Aggregation with Transformers for Dense Correspondence19 Sep 2022
- 2022Learning Semantic Correspondence with Sparse Annotations15 Aug 2022
- 2022Visual correspondence-based explanations improve AI robustness and human-AI team accuracy26 Jul 2022
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentation22 Jul 2022
- 2022AiATrack: Attention in Attention for Transformer Visual Tracking20 Jul 2022
- 2022Demystifying Unsupervised Semantic Correspondence Estimation11 Jul 2022
- 2022MSANet: Multi-Similarity and Attention Guidance for Boosting Few-Shot Segmentation20 Jun 2022
- 2022TransforMatcher: Match-to-Match Attention for Semantic Correspondence23 May 2022
- 2022Joint Learning of Feature Extraction and Cost Aggregation for Semantic Correspondence5 Apr 2022
- 2022Correlation Verification for Image Retrieval4 Apr 2022
- 2022Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labels30 Mar 2022
- 2022Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondences8 Mar 2022
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformers14 Feb 2022
- 2021Cost Aggregation Is All You Need for Few-Shot Segmentation22 Dec 2021
- 2021DenseGAP: Graph-Structured Dense Correspondence Learning with Anchor Points13 Dec 2021
- 2021Understanding Pixel-level 2D Image Semantics with 3D Keypoint Knowledge Engine21 Nov 2021
- 2021Convolutional Hough Matching Networks for Robust and Efficient Visual Correspondence11 Sep 2021
- 2021The Animation Transformer: Visual Correspondence via Segment Matching6 Sep 2021
- 2021Relational Embedding for Few-Shot Classification22 Aug 2021
- 2021Multi-scale Matching Networks for Semantic Correspondence31 Jul 2021
- 2021Deep Matching Prior: Test-Time Optimization for Dense Correspondence6 Jun 2021
- 2021CATs: Cost Aggregation Transformers for Visual Correspondence4 Jun 2021
- 2021Hypercorrelation Squeeze for Few-Shot Segmentation4 Apr 2021
- 2021Convolutional Hough Matching Networks31 Mar 2021
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2022Correlation Verification for Image Retrievalcited by 47
- 2021Convolutional Hough Matching Networkscited by 43
- 2022Visual correspondence-based explanations improve AI robustness and human-AI team accuracycited by 37
- 2021Multi-scale Matching Networks for Semantic Correspondencecited by 32
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondencecited by 32
- 2022Learning Semantic Correspondence with Sparse Annotationscited by 31
12 most cited of 40 All 40 (JSON)
- 2026DreamSat-Pose: Spacecraft Pose Estimation from Single-View 3D Reconstructions and Learned 2D-3D Feature Matching15 Jul 2026
- 2026MARCO: Navigating the Unseen Space of Semantic Correspondence20 Apr 2026
- 2026AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifiers30 Mar 2026
- 2026SimpleMatch: A Simple and Strong Baseline for Semantic Correspondence18 Jan 2026
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baseline23 May 2025
- 2024Distillation of Diffusion Features for Semantic Correspondence4 Dec 2024
- 2024Beyond Mask: Rethinking Guidance Types in Few-shot Segmentation16 Jul 2024
- 2024Independently Keypoint Learning for Small Object Semantic Correspondence3 Apr 2024
- 2024Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondence17 Mar 2024
- 2024Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attention18 Jan 2024
- 2023Match me if you can: Semi-Supervised Semantic Correspondence Learning with Unpaired Images30 Nov 2023
- 2023Efficient Semantic Matching with Hypercolumn Correlation7 Nov 2023
12 newest of 40 All 40 (JSON)