Neighbourhood Consensus Networks
Not on the map. Why?
Abstract (arXiv)
We address the problem of finding reliable dense correspondences between a pair of images. This is a challenging task due to strong appearance differences between the corresponding scene elements and ambiguities generated by repetitive patterns. The contributions of this work are threefold. First, inspired by the classic idea of disambiguating feature matches using semi-local constraints, we develop an end-to-end trainable convolutional neural network architecture that identifies sets of spatially consistent matches by analyzing neighbourhood consensus patterns in the 4D space of all possible correspondences between a pair of images without the need for a global geometric model. Second, we demonstrate that the model can be trained effectively from weak supervision in the form of matching and non-matching image pairs without the need for costly manual annotation of point to point correspondences. Third, we show the proposed neighbourhood consensus network can be applied to a range of matching tasks including both category- and instance-level matching, obtaining the state-of-the-art results on the PF Pascal dataset and the InLoc indoor visual localization benchmark.
Key facts. Cited by 174 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 46; 2023: 45; 2024: 20; 2025: 24; 2026: 7.
174 papers.
Sort:
By area:
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2023Emergent Correspondence from Image Diffusioncited by 446
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2022Geometric Transformer for Fast and Robust Point Cloud Registrationcited by 202
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 200
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2023Tracking Everything Everywhere All at Oncecited by 193
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 183
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 171
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 152
38 more
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 136
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 120
- 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 116
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 92
- 2021Lepard: Learning partial point cloud matching in rigid and deformable scenescited by 85
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
- 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 84
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2023Detector-Free Structure from Motioncited by 71
- 2023Rotation-Invariant Transformer for Point Cloud Matchingcited by 69
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 66
- 2022Global Matching with Overlapping Attention for Optical Flow Estimationcited by 64
- 2021GAN-Supervised Dense Visual Alignmentcited by 62
- 2022ClusterGNN: Cluster-based Coarse-to-Fine Graph Neural Network for Efficient Feature Matchingcited by 62
- 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2021HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud Registrationcited by 48
- 2024XoFTR: Cross-modal Feature Matching Transformercited by 48
- 2022Correlation Verification for Image Retrievalcited by 47
- 2021Convolutional Hough Matching Networkscited by 43
- 2021Warp Consistency for Unsupervised Learning of Dense Correspondencescited by 42
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 41
- 2021Planar Surface Reconstruction from Sparse Viewscited by 40
- 2022Visual correspondence-based explanations improve AI robustness and human-AI team accuracycited by 39
- 2023SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matchingcited by 38
- 2023Improving Semantic Correspondence with Viewpoint-Guided Spherical Mapscited by 34
- 2023Rethinking Optical Flow from Geometric Matching Consistent Perspectivecited by 33
- 2021Multi-scale Matching Networks for Semantic Correspondencecited by 32
- 2022TopicFM: Robust and Interpretable Topic-Assisted Feature Matchingcited by 32
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondencecited by 32
- 2021Input-level Inductive Biases for 3D Reconstructioncited by 31
50 most cited of 174 All 174 (JSON)
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026XDG: Accelerated Visual Disambiguation30 Aug 2026
- 2026Efficient 3D Content Reconstruction and Generation18 May 2026
- 2026MARCO: Navigating the Unseen Space of Semantic Correspondence20 Apr 2026
- 2026Improving Local Feature Matching by Entropy-inspired Scale Adaptability and Flow-endowed Local Consistency8 Apr 2026
- 2026EpiMask: Leveraging Epipolar Distance Based Masks in Cross-Attention for Satellite Image Matching23 Mar 2026
- 2026SimpleMatch: A Simple and Strong Baseline for Semantic Correspondence18 Jan 2026
- 2025MARVO: Marine-Adaptive Radiance-aware Visual Odometry28 Nov 2025
- 2025Registration is a Powerful Rotation-Invariance Learner for 3D Anomaly Detection19 Oct 2025
- 2025Similarity-Aware Selective State-Space Modeling for Semantic Correspondence29 Sep 2025
- 2025Cross3DReg: Towards a Large-scale Real-world Cross-source Point Cloud Registration Benchmark8 Sep 2025
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
38 more
- 2025A Single-step Accurate Fingerprint Registration Method Based on Local Feature Matching22 Jul 2025
- 2025FPC-Net: Revisiting SuperPoint with Descriptor-Free Keypoint Detection via Feature Pyramids and Consistency-Based Implicit Matching14 Jul 2025
- 2025Diff2I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Prior9 Jul 2025
- 2025Structure-aware Semantic Discrepancy and Consistency for 3D Medical Image Self-supervised Learning3 Jul 2025
- 2025Single-Frame Point-Pixel Registration via Supervised Cross-Modal Feature Matching28 Jun 2025
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025Self-Supervised Spatial Correspondence Across Modalities3 Jun 2025
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baseline23 May 2025
- 2025Cross-modal feature fusion for robust point cloud registration with ambiguous geometry19 May 2025
- 2025CoMatch: Dynamic Covisibility-Aware Transformer for Bilateral Subpixel-Level Semi-Dense Image Matching31 Mar 2025
- 2025LiM-Loc: Visual Localization with Dense and Accurate 3D Reference Maps Directly Corresponding 2D Keypoints to 3D LiDAR Point Clouds31 Mar 2025
- 2025SatDepth: A Novel Dataset for Satellite Image Matching17 Mar 2025
- 2025HybridReg: Robust 3D Point Cloud Registration with Hybrid Motions10 Mar 2025
- 2025Stereo Any Video: Temporally Consistent Stereo Matching7 Mar 2025
- 2025EDM: Efficient Deep Feature Matching7 Mar 2025
- 2025JamMa: Ultra-lightweight Local Feature Matching with Joint Mamba5 Mar 2025
- 2025MATCHA:Towards Matching Anything24 Jan 2025
- 2025Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentation16 Jan 2025
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Training13 Jan 2025
- 2024Resolving the Ambiguity of Complete-to-Partial Point Cloud Registration for Image-Guided Liver Surgery with Patches-to-Partial Matching26 Dec 2024
- 2024Cross-View Completion Models are Zero-shot Correspondence Estimators12 Dec 2024
- 2024Doppelgangers++: Improved Visual Disambiguation with Geometric 3D Features8 Dec 2024
- 2024Distillation of Diffusion Features for Semantic Correspondence4 Dec 2024
- 2024Refine-by-Align: Reference-Guided Artifacts Refinement through Semantic Alignment30 Nov 2024
- 2024HomoMatcher: Dense Feature Matching Results with Semi-Dense Efficiency by Homography Estimation11 Nov 2024
- 2024Geometry-Aware Feature Matching for Large-Scale Structure from Motion3 Sep 2024
- 2024PRISM: PRogressive dependency maxImization for Scale-invariant image Matching7 Aug 2024
- 20243D Geometric Shape Assembly via Efficient Point Cloud Matching15 Jul 2024
- 2024DSL-FIQA: Assessing Facial Image Quality via Dual-Set Degradation Learning and Landmark-Guided Transformer13 Jun 2024
- 2024Learning Spatial Similarity Distribution for Few-shot Object Counting20 May 2024
- 2024RetinaRegNet: A Zero-Shot Approach for Retinal Image Registration24 Apr 2024
- 2024CorrespondentDream: Enhancing 3D Fidelity of Text-to-3D using Cross-View Correspondences16 Apr 2024
- 2024XoFTR: Cross-modal Feature Matching Transformer15 Apr 2024
- 2024Independently Keypoint Learning for Small Object Semantic Correspondence3 Apr 2024
- 2024Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondence17 Mar 2024
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speed7 Mar 2024
- 2024Are Semi-Dense Detector-Free Methods Good at Matching Local Features?13 Feb 2024
- 2024Local Feature Matching Using Deep Learning: A Survey31 Jan 2024
50 newest of 174 All 174 (JSON)
- 2023Emergent Correspondence from Image Diffusioncited by 446
- 2023SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matchingcited by 38
- 2025Diff2I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Priorcited by 8
- 2024CorrespondentDream: Enhancing 3D Fidelity of Text-to-3D using Cross-View Correspondencescited by 6
- 2025Diff2I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Prior9 Jul 2025
- 2024CorrespondentDream: Enhancing 3D Fidelity of Text-to-3D using Cross-View Correspondences16 Apr 2024
- 2023SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matching26 Oct 2023
- 2023Emergent Correspondence from Image Diffusion6 Jun 2023
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2022Geometric Transformer for Fast and Robust Point Cloud Registrationcited by 202
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 200
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2023Tracking Everything Everywhere All at Oncecited by 193
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 183
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 171
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 152
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
12 most cited of 167 All 167 (JSON)
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026XDG: Accelerated Visual Disambiguation30 Aug 2026
- 2026Efficient 3D Content Reconstruction and Generation18 May 2026
- 2026MARCO: Navigating the Unseen Space of Semantic Correspondence20 Apr 2026
- 2026Improving Local Feature Matching by Entropy-inspired Scale Adaptability and Flow-endowed Local Consistency8 Apr 2026
- 2026EpiMask: Leveraging Epipolar Distance Based Masks in Cross-Attention for Satellite Image Matching23 Mar 2026
- 2026SimpleMatch: A Simple and Strong Baseline for Semantic Correspondence18 Jan 2026
- 2025MARVO: Marine-Adaptive Radiance-aware Visual Odometry28 Nov 2025
- 2025Registration is a Powerful Rotation-Invariance Learner for 3D Anomaly Detection19 Oct 2025
- 2025Cross3DReg: Towards a Large-scale Real-world Cross-source Point Cloud Registration Benchmark8 Sep 2025
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2025A Single-step Accurate Fingerprint Registration Method Based on Local Feature Matching22 Jul 2025
12 newest of 167 All 167 (JSON)