Working hard to know your neighbor's margins: Local descriptor learning loss
Not on the map. Why?
Abstract (arXiv)
We introduce a novel loss for learning local feature descriptors which is inspired by the Lowe's matching criterion for SIFT. We show that the proposed loss that maximizes the distance between the closest positive and closest negative patch in the batch is better than complex regularization methods; it works well for both shallow and deep convolution network architectures. Applying the novel loss to the L2Net CNN architecture results in a compact descriptor -- it has the same dimensionality as SIFT (128) that shows state-of-art performance in wide baseline stereo, patch verification and instance retrieval benchmarks. It is fast, computing a descriptor takes about 1 millisecond on a low-end GPU.
Key facts. Cited by 212 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 48; 2022: 33; 2023: 45; 2024: 26; 2025: 32; 2026: 28.
212 papers.
Sort:
By area:
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 182
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 170
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
- 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 120
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
- 2024XFeat: Accelerated Features for Lightweight Image Matchingcited by 113
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2021Learning to Match Features with Seeded Graph Matching Networkcited by 92
- 2021ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extractioncited by 77
38 more
- 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 72
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 65
- 2023DeDoDe: Detect, Don't Describe -- Describe, Don't Detect for Local Feature Matchingcited by 62
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
- 2022Correlation Verification for Image Retrievalcited by 47
- 2021Progressive Correspondence Pruning by Consensus Learningcited by 46
- 2021SOLD2: Self-supervised Occlusion-aware Line Description and Detectioncited by 45
- 2021P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matchingcited by 42
- 2021Planar Surface Reconstruction from Sparse Viewscited by 40
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
- 2022BALF: Simple and Efficient Blur Aware Local Feature Detectorcited by 34
- 2024Data curation via joint example selection further accelerates multimodal learningcited by 32
- 2022Adaptive Assignment for Geometry Aware Local Feature Matchingcited by 30
- 2023POPE: 6-DoF Promptable Pose Estimation of Any Object, in Any Scene, with One Referencecited by 30
- 2022Decoupling Makes Weakly Supervised Local Feature Bettercited by 28
- 2023SFD2: Semantic-guided Feature Detection and Descriptioncited by 28
- 2022Self-Supervised Equivariant Learning for Oriented Keypoint Detectioncited by 26
- 2022ReDFeat: Recoupling Detection and Description for Multimodal Feature Learningcited by 26
- 2023HSCNet++: Hierarchical Scene Coordinate Classification and Regression for Visual Localization with Transformercited by 26
- 2024Local Feature Matching Using Deep Learning: A Surveycited by 26
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motioncited by 25
- 2021Deep learning-based person re-identification methods: A survey and outlook of recent workscited by 23
- 2023Learning Rotation-Equivariant Features for Visual Correspondencecited by 23
- 2022SealID: Saimaa ringed seal re-identification datasetcited by 22
- 2021NinjaDesc: Content-Concealing Visual Descriptors via Adversarial Learningcited by 21
- 2023Steerers: A framework for rotation equivariant keypoint descriptorscited by 21
- 2022ECO-TR: Efficient Correspondences Finding Via Coarse-to-Fine Refinementcited by 18
- 2023Finding Order in Chaos: A Novel Data Augmentation Method for Time Series in Contrastive Learningcited by 18
- 2021Neural Reprojection Error: Merging Feature Learning and Camera Pose Estimationcited by 17
- 2021DFM: A Performance Baseline for Deep Feature Matchingcited by 17
- 2023(LC)2: LiDAR-Camera Loop Constraints For Cross-Modal Place Recognitioncited by 16
- 2023FocusTune: Tuning Visual Localization through Focus-Guided Samplingcited by 16
- 2023Improving Transformer-based Image Matching by Cascaded Capturing Spatially Informative Keypointscited by 15
- 2023Segment Anything Model is a Good Teacher for Local Feature Learningcited by 15
- 2021Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localizationcited by 14
- 2021Contextual Similarity Aggregation with Self-attention for Visual Re-rankingcited by 14
50 most cited of 212 All 212 (JSON)
- 2026How to Reduce Localization Ambiguity? Geometry-Semantic Constrained BEV Representation Learning for Satellite-Ground Localization30 Sep 2026
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 2026Radiation, Rotation and Scale Invariant Feature Descriptor for Multimodal Image Matching6 Sep 2026
- 2026CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space31 Aug 2026
- 2026BlobBoards: Robust Markers for Accurate Pose28 Aug 2026
- 2026SSMB: Self-Supervised Local Feature Detection under Motion Blur27 Aug 2026
- 2026DDMS: Discriminative Distillation of Multi-view Foundational Features into Single-view Models24 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026SGFormer: Structure-Guided Transformer for Robust Local Feature Matching4 Aug 2026
- 2026Exact and Deterministic Patch Descriptor Retrieval via Hierarchical Normalization25 Jun 2026
- 2026Rolling Shutter Relative Pose Estimation Made Practical25 Jun 2026
- 2026Eliciting Complex Spatial Reasoning in MLLMs through Wide-Baseline Matching2 Jun 2026
38 more
- 2026Best Segmentation Buddies for Image-Shape Correspondence18 May 2026
- 2026PySIFT: GPU-Resident Deterministic SIFT for Deep Learning Vision Pipelines18 May 2026
- 2026Depth-Guided Privacy-Preserving Visual Localization Using 3D Sphere Clouds1 May 2026
- 2026Are Pretrained Image Matchers Good Enough for SAR-Optical Satellite Registration?11 Apr 2026
- 2026AsymLoc: Towards Asymmetric Feature Matching for Efficient Visual Localization10 Apr 2026
- 2026Improving Local Feature Matching by Entropy-inspired Scale Adaptability and Flow-endowed Local Consistency8 Apr 2026
- 2026DA-Flow: Degradation-Aware Optical Flow Estimation with Diffusion Models24 Mar 2026
- 2026Benchmarking Efficient & Effective Camera Pose Estimation Strategies for Novel View Synthesis20 Mar 2026
- 2026IUP-Pose: Decoupled Iterative Uncertainty Propagation for Real-time Relative Pose Regression via Implicit Dense Alignment v120 Mar 2026
- 2026RaCo: Ranking and Covariance for Practical Learned Keypoints17 Feb 2026
- 2026Understanding and Optimizing Attention-Based Sparse Matching for Diverse Local Features9 Feb 2026
- 2026SuperPoint-E: local features for 3D reconstruction via tracking adaptation in endoscopy4 Feb 2026
- 2026Coarse-to-Fine Non-rigid Multi-modal Image Registration for Historical Panel Paintings based on Crack Structures22 Jan 2026
- 2026A Streamlined Attention-Based Network for Descriptor Extraction19 Jan 2026
- 2026Multi-Sensor Matching with HyperNetworks18 Jan 2026
- 2026MixRI: Mixing Features of Reference Images for Novel Object Pose Estimation11 Jan 2026
- 2025Self-Supervised Contrastive Embedding Adaptation for Endoscopic Image Matching11 Dec 2025
- 2025Pore-scale Image Patch Dataset and A Comparative Evaluation of Pore-scale Facial Features29 Nov 2025
- 2025Dynamic Jointly Batch Selection for Data Efficient Machine Translation Fine-Tuning6 Nov 2025
- 2025LightGlueStick: a Fast and Robust Glue for Joint Point-Line Matching18 Oct 2025
- 2025Aerial-Ground Image Feature Matching via 3D Gaussian Splatting-based Intermediate View Rendering24 Sep 2025
- 2025A review of Recent Techniques for Person Re-Identification19 Sep 2025
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2025Gaussian kernel-based motion measurement18 Jul 2025
- 2025RIPE: Reinforcement Learning on Unlabeled Image Pairs for Robust Keypoint Extraction7 Jul 2025
- 2025Multi-Expert Learning Framework with the State Space Model for Optical and SAR Image Registration6 Jul 2025
- 2025Grid-Reg: Detector-Free Gridized Feature Learning and Matching for Large-Scale SAR-Optical Image Registration6 Jul 2025
- 2025Unsupervised Pelage Pattern Unwrapping for Animal Re-identification18 Jun 2025
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025UAVPairs: A Challenging Benchmark for Match Pair Retrieval of Large-scale UAV Images28 May 2025
- 2025MorphGuard: Morph Specific Margin Loss for Enhancing Robustness to Face Morphing Attacks15 May 2025
- 2025RDD: Robust Feature Detector and Descriptor using Deformable Transformer12 May 2025
- 2025Not All Pixels Are Equal: Confidence-Guided Attention for Feature Matching4 May 2025
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motion28 Apr 2025
- 2025Dual-Camera All-in-Focus Neural Radiance Fields23 Apr 2025
- 2025Visual Re-Ranking with Non-Visual Side Information15 Apr 2025
- 2025OSDM-MReg: Multimodal Image Registration based One Step Diffusion Model8 Apr 2025
- 2025Learning Affine Correspondences by Integrating Geometric Constraints7 Apr 2025
50 newest of 212 All 212 (JSON)
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 182
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 170
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
- 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 120
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
- 2024XFeat: Accelerated Features for Lightweight Image Matchingcited by 113
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2021Learning to Match Features with Seeded Graph Matching Networkcited by 92
- 2021ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extractioncited by 77
12 most cited of 209 All 209 (JSON)
- 2026How to Reduce Localization Ambiguity? Geometry-Semantic Constrained BEV Representation Learning for Satellite-Ground Localization30 Sep 2026
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 2026Radiation, Rotation and Scale Invariant Feature Descriptor for Multimodal Image Matching6 Sep 2026
- 2026CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space31 Aug 2026
- 2026BlobBoards: Robust Markers for Accurate Pose28 Aug 2026
- 2026SSMB: Self-Supervised Local Feature Detection under Motion Blur27 Aug 2026
- 2026DDMS: Discriminative Distillation of Multi-view Foundational Features into Single-view Models24 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026SGFormer: Structure-Guided Transformer for Robust Local Feature Matching4 Aug 2026
- 2026Exact and Deterministic Patch Descriptor Retrieval via Hierarchical Normalization25 Jun 2026
- 2026Rolling Shutter Relative Pose Estimation Made Practical25 Jun 2026
- 2026Best Segmentation Buddies for Image-Shape Correspondence18 May 2026
12 newest of 209 All 209 (JSON)