Learning to Find Good Correspondences
Not on the map. Why?
Abstract (arXiv)
We develop a deep architecture to learn to find good correspondences for wide-baseline stereo. Given a set of putative sparse matches and the camera intrinsics, we train our network in an end-to-end fashion to label the correspondences as inliers or outliers, while simultaneously using them to recover the relative pose, as encoded by the essential matrix. Our architecture is based on a multi-layer perceptron operating on pixel coordinates rather than directly on the image, and is thus simple and small. We introduce a novel normalization technique, called Context Normalization, which allows us to process each data point separately while imbuing it with global information, and also makes the network invariant to the order of the correspondences. Our experiments on multiple challenging datasets demonstrate that our method is able to drastically improve the state of the art with little training data.
Key facts. Cited by 176 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 38; 2023: 42; 2024: 22; 2025: 20; 2026: 15.
176 papers.
Sort:
By area:
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 182
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 170
- 2021PointDSC: Robust Point Cloud Registration using Deep Spatial Consistencycited by 142
- 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
- 2023Unsupervised Semantic Correspondence Using Stable Diffusioncited by 120
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
- 2022REGTR: End-to-end Point Cloud Correspondences with Transformerscited by 94
- 2021Learning to Match Features with Seeded Graph Matching Networkcited by 92
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
38 more
- 2024Local All-Pair Correspondence for Point Trackingcited by 77
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 65
- 2022SC^2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registrationcited by 62
- 2022ClusterGNN: Cluster-based Coarse-to-Fine Graph Neural Network for Efficient Feature Matchingcited by 62
- 2023SiLK -- Simple Learned Keypointscited by 54
- 2021Deep Hough Voting for Robust Global Registrationcited by 53
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2022Is Geometry Enough for Matching in Visual Localization?cited by 48
- 2021Progressive Correspondence Pruning by Consensus Learningcited by 46
- 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2022IFOR: Iterative Flow Minimization for Robotic Object Rearrangementcited by 42
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
- 2023Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairscited by 37
- 2023PATS: Patch Area Transportation with Subdivision for Local Feature Matchingcited by 33
- 2022TopicFM: Robust and Interpretable Topic-Assisted Feature Matchingcited by 32
- 2023Doppelgangers: Learning to Disambiguate Images of Similar Structurescited by 32
- 2021Input-level Inductive Biases for 3D Reconstructioncited by 31
- 2023Robust Outlier Rejection for 3D Registration with Variational Bayescited by 31
- 2022Generalized Differentiable RANSACcited by 30
- 2021Learning Camera Localization via Dense Scene Matchingcited by 28
- 2022A case for using rotation invariant features in state of the art feature matcherscited by 27
- 2022Densely Constrained Depth Estimator for Monocular 3D Object Detectioncited by 27
- 2022Self-Supervised Equivariant Learning for Oriented Keypoint Detectioncited by 26
- 2022PlaneFormers: From Sparse View Planes to 3D Reconstructioncited by 26
- 2024Local Feature Matching Using Deep Learning: A Surveycited by 26
- 2023A Robust and Interpretable Deep Learning Framework for Multi-modal Registration via Keypointscited by 25
- 2024Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondencescited by 25
- 2021Generalizable Human Pose Triangulationcited by 24
- 2022LASER: LAtent SpacE Rendering for 2D Visual Localizationcited by 23
- 2023Point-TTA: Test-Time Adaptation for Point Cloud Registration Using Multitask Meta-Auxiliary Learningcited by 23
- 2021Robust Differentiable SVDcited by 19
- 2022End2End Multi-View Feature Matching with Differentiable Pose Optimizationcited by 19
- 2022ECO-TR: Efficient Correspondences Finding Via Coarse-to-Fine Refinementcited by 18
- 2024PartSTAD: 2D-to-3D Part Segmentation Task Adaptationcited by 18
- 2021Neural Reprojection Error: Merging Feature Learning and Camera Pose Estimationcited by 17
- 2021DFM: A Performance Baseline for Deep Feature Matchingcited by 17
- 2022PuzzleFusion: Unleashing the Power of Diffusion Models for Spatial Puzzle Solvingcited by 17
50 most cited of 176 All 176 (JSON)
- 2026MVDG: Efficient Multi-view 3D Disambiguation on Unconstrained Real-World Images1 Oct 2026
- 2026Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation21 Sep 2026
- 2026DiffSAC: Diffusion-guided Sampling for Consensus-based Robust Estimation31 Aug 2026
- 2026Modality-Invariant Coarse-to-Fine Retinal Image Registration14 Aug 2026
- 2026SGFormer: Structure-Guided Transformer for Robust Local Feature Matching4 Aug 2026
- 2026Cross-Coordinate Correspondence Pruning for Image-to-Point Cloud Registration19 Jul 2026
- 2026Anatomy-Grounded Synthetic Coronary Angiography for Geometry-Informed Multi-View Matching26 Jun 2026
- 2026See More, Match Better: Multi-Source Feature Fusion for Two-View Correspondence Learning8 Jun 2026
- 2026SFMambaNet: Spectral-Frequency Enhanced Selective State Space Model for Correspondence Pruning3 Jun 2026
- 2026Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Images8 May 2026
- 2026Non-Minimal Sampling and Consensus for Prohibitively Large Datasets24 Apr 2026
- 2026SceneGlue: Scene-Aware Transformer for Feature Matching without Scene-Level Annotation15 Apr 2026
38 more
- 2026ViBA: Implicit Bundle Adjustment with Geometric and Temporal Consistency for Robust Visual Matching3 Apr 2026
- 2026Understanding and Optimizing Attention-Based Sparse Matching for Diverse Local Features9 Feb 2026
- 2026Coarse-to-Fine Non-rigid Multi-modal Image Registration for Historical Panel Paintings based on Crack Structures22 Jan 2026
- 2025LLHA-Net: A Hierarchical Attention Network for Two-View Correspondence Learning31 Dec 2025
- 2025SC-Net: Robust Correspondence Learning via Spatial and Cross-Channel Context29 Dec 2025
- 2025MGCA-Net: Multi-Graph Contextual Attention Network for Two-View Correspondence Learning29 Dec 2025
- 2025LeCoT: revisiting network architecture for two-view correspondence pruning10 Nov 2025
- 2025GeoMoE: Divide-and-Conquer Motion Field Modeling with Mixture-of-Experts for Two-View Geometry1 Aug 2025
- 2025VMatcher: State-Space Semi-Dense Local Feature Matching31 Jul 2025
- 2025Cross Spatial Temporal Fusion Attention for Remote Sensing Object Detection via Image Feature Matching25 Jul 2025
- 2025CorrMoE: Mixture of Experts with De-stylization Learning for Cross-Scene and Cross-Domain Correspondence Pruning16 Jul 2025
- 2025TurboReg: TurboClique for Robust and Efficient Point Cloud Registration2 Jul 2025
- 2025RealKeyMorph: Keypoints in Real-world Coordinates for Resolution-agnostic Image Registration12 Jun 2025
- 2025SupeRANSAC: One RANSAC to Rule Them All5 Jun 2025
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025Good Keypoints for the Two-View Geometry Estimation Problem24 Mar 2025
- 2025Selecting and Pruning: A Differentiable Causal Sequentialized State-Space Model for Two-View Correspondence Learning23 Mar 2025
- 2025Monte Carlo Diffusion for Generalizable Learning-Based RANSAC12 Mar 2025
- 2025A2-GNN: Angle-Annular GNN for Visual Descriptor-free Camera Relocalization27 Feb 2025
- 2025Correspondence-Free Pose Estimation with Patterns: A Unified Approach for Multi-Dimensional Vision26 Feb 2025
- 2025Accelerating Outlier-robust Rotation Estimation by Stereographic Projection10 Feb 2025
- 2025Progressive Correspondence Regenerator for Robust 3D Registration4 Feb 2025
- 2025MambaGlue: Fast and Robust Local Feature Matching With Mamba1 Feb 2025
- 2024Image Matching Filtering and Refinement by Planes and Beyond14 Nov 2024
- 2024ETO:Efficient Transformer-based Local Feature Matching by Organizing Multiple Homography Hypotheses30 Oct 2024
- 2024EI-Nexus: Towards Unmediated and Flexible Inter-Modality Local Feature Extraction and Matching for Event-Image Data29 Oct 2024
- 2024A Robust Multisource Remote Sensing Image Matching Method Utilizing Attention and Feature Enhancement Against Noise Interference1 Oct 2024
- 2024Str-L Pose: Integrating Point and Structured Line for Relative Pose Estimation in Dual-Graph28 Aug 2024
- 2024CorrAdaptor: Adaptive Local Context Learning for Correspondence Pruning15 Aug 2024
- 2024Alignment Scores: Robust Metrics for Multiview Pose Accuracy Evaluation29 Jul 2024
- 2024Local All-Pair Correspondence for Point Tracking22 Jul 2024
- 2024Learning to Make Keypoints Sub-Pixel Accurate16 Jul 2024
- 2024Consensus Learning with Deep Sets for Essential Matrix Estimation25 Jun 2024
- 2024Breaking the Frame: Visual Place Recognition by Overlap Prediction23 Jun 2024
- 2024Scalable and Generalizable Correspondence Pruning via Geometry-Consistent Pre-training9 Jun 2024
- 2024RESfM: Robust Deep Equivariant Structure from Motion22 Apr 2024
- 2024Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences9 Apr 2024
- 2024Marrying NeRF with Feature Matching for One-step Pose Estimation1 Apr 2024
50 newest of 176 All 176 (JSON)
- 2025MambaGlue: Fast and Robust Local Feature Matching With Mambacited by 5
- 2025Selecting and Pruning: A Differentiable Causal Sequentialized State-Space Model for Two-View Correspondence Learningcited by 1
- 2025VMatcher: State-Space Semi-Dense Local Feature Matchingcited by 0
- 2026SFMambaNet: Spectral-Frequency Enhanced Selective State Space Model for Correspondence Pruningcited by 0
- 2026SFMambaNet: Spectral-Frequency Enhanced Selective State Space Model for Correspondence Pruning3 Jun 2026
- 2025VMatcher: State-Space Semi-Dense Local Feature Matching31 Jul 2025
- 2025Selecting and Pruning: A Differentiable Causal Sequentialized State-Space Model for Two-View Correspondence Learning23 Mar 2025
- 2025MambaGlue: Fast and Robust Local Feature Matching With Mamba1 Feb 2025
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 182
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 170
- 2021PointDSC: Robust Point Cloud Registration using Deep Spatial Consistencycited by 142
- 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
- 2022REGTR: End-to-end Point Cloud Correspondences with Transformerscited by 94
- 2021Learning to Match Features with Seeded Graph Matching Networkcited by 92
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2024Local All-Pair Correspondence for Point Trackingcited by 77
12 most cited of 167 All 167 (JSON)
- 2026MVDG: Efficient Multi-view 3D Disambiguation on Unconstrained Real-World Images1 Oct 2026
- 2026Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation21 Sep 2026
- 2026Modality-Invariant Coarse-to-Fine Retinal Image Registration14 Aug 2026
- 2026SGFormer: Structure-Guided Transformer for Robust Local Feature Matching4 Aug 2026
- 2026Cross-Coordinate Correspondence Pruning for Image-to-Point Cloud Registration19 Jul 2026
- 2026Anatomy-Grounded Synthetic Coronary Angiography for Geometry-Informed Multi-View Matching26 Jun 2026
- 2026See More, Match Better: Multi-Source Feature Fusion for Two-View Correspondence Learning8 Jun 2026
- 2026Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Images8 May 2026
- 2026Non-Minimal Sampling and Consensus for Prohibitively Large Datasets24 Apr 2026
- 2026SceneGlue: Scene-Aware Transformer for Feature Matching without Scene-Level Annotation15 Apr 2026
- 2026ViBA: Implicit Bundle Adjustment with Geometric and Temporal Consistency for Robust Visual Matching3 Apr 2026
- 2026Understanding and Optimizing Attention-Based Sparse Matching for Diverse Local Features9 Feb 2026
12 newest of 167 All 167 (JSON)