Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filters
Not on the map. Why?
Abstract (arXiv)
We introduce a novel approach for keypoint detection task that combines handcrafted and learned CNN filters within a shallow multi-scale architecture. Handcrafted filters provide anchor structures for learned filters, which localize, score and rank repeatable features. Scale-space representation is used within the network to extract keypoints at different levels. We design a loss function to detect robust features that exist across a range of scales and to maximize the repeatability score. Our Key.Net model is trained on data synthetically created from ImageNet and evaluated on HPatches benchmark. Results show that our approach outperforms state-of-the-art detectors in terms of repeatability, matching performance and complexity.
Key facts. Cited by 117 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 18; 2023: 26; 2024: 22; 2025: 17; 2026: 16.
117 papers.
Sort:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
- 2024XFeat: Accelerated Features for Lightweight Image Matchingcited by 113
- 2021ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extractioncited by 77
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 69
- 2023DeDoDe: Detect, Don't Describe -- Describe, Don't Detect for Local Feature Matchingcited by 62
- 2022Correlation Verification for Image Retrievalcited by 47
- 2021P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matchingcited by 42
- 2021Planar Surface Reconstruction from Sparse Viewscited by 40
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
- 2024DeDoDe v2: Analyzing and Improving the DeDoDe Keypoint Detectorcited by 38
38 more
- 2022BALF: Simple and Efficient Blur Aware Local Feature Detectorcited by 34
- 2024Reconstructing People, Places, and Camerascited by 31
- 2022Adaptive Assignment for Geometry Aware Local Feature Matchingcited by 30
- 2022Decoupling Makes Weakly Supervised Local Feature Bettercited by 28
- 2022Self-Supervised Equivariant Learning for Oriented Keypoint Detectioncited by 26
- 2022ReDFeat: Recoupling Detection and Description for Multimodal Feature Learningcited by 26
- 2024Local Feature Matching Using Deep Learning: A Surveycited by 26
- 2023A Robust and Interpretable Deep Learning Framework for Multi-modal Registration via Keypointscited by 25
- 2024Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondencescited by 25
- 2023Adaptive Spot-Guided Transformer for Consistent Local Feature Matchingcited by 22
- 2021NinjaDesc: Content-Concealing Visual Descriptors via Adversarial Learningcited by 21
- 2022Partially Does It: Towards Scene-Level FG-SBIR with Partial Inputcited by 20
- 2022ECO-TR: Efficient Correspondences Finding Via Coarse-to-Fine Refinementcited by 18
- 2021DFM: A Performance Baseline for Deep Feature Matchingcited by 17
- 2024MESA: Matching Everything by Segmenting Anythingcited by 16
- 2023Segment Anything Model is a Good Teacher for Local Feature Learningcited by 15
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2023S-TREK: Sequential Translation and Rotation Equivariant Keypoints for local feature extractioncited by 13
- 2024Learning to Make Keypoints Sub-Pixel Accuratecited by 13
- 2024Towards Foundation Models for 3D Vision: How Close Are We?cited by 13
- 2025RDD: Robust Feature Detector and Descriptor using Deformable Transformercited by 13
- 2021ScaleNet: A Shallow Architecture for Scale Estimationcited by 12
- 2025DaD: Distilled Reinforcement Learning for Diverse Keypoint Detectioncited by 12
- 2023Enhancing Deformable Local Features by Jointly Learning to Detect and Describe Keypointscited by 11
- 2023Two-View Geometry Scoring Without Correspondencescited by 11
- 2021SIFT Matching by Context Exposedcited by 9
- 2022MTLDesc: Looking Wider to Describe Bettercited by 9
- 2022Self-Supervised Learning of Image Scale and Orientationcited by 9
- 2023Searching from Area to Point: A Hierarchical Framework for Semantic-Geometric Combined Feature Matchingcited by 9
- 2021Probabilistic Spatial Distribution Prior Based Attentional Keypoints Matching Networkcited by 8
- 2021DenseGAP: Graph-Structured Dense Correspondence Learning with Anchor Pointscited by 8
- 2022Sim2Real Object-Centric Keypoint Detection and Descriptioncited by 8
- 2023LFM-3D: Learnable Feature Matching Across Wide Baselines Using 3D Signalscited by 8
- 2023Structured Epipolar Matcher for Local Feature Matchingcited by 8
- 2025CA-I2P: Channel-Adaptive Registration Network with Global Optimal Selectioncited by 8
- 2021Matching in the Dark: A Dataset for Matching Image Pairs of Low-light Scenescited by 7
- 2022A Critical Analysis of Image-based Camera Pose Estimation Techniquescited by 7
- 2023Synthesizing Stable Reduced-Order Visuomotor Policies for Nonlinear Systems via Sums-of-Squares Optimizationcited by 7
50 most cited of 117 All 117 (JSON)
- 2026RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching8 Sep 2026
- 2026Radiation, Rotation and Scale Invariant Feature Descriptor for Multimodal Image Matching6 Sep 2026
- 2026NSFlow: End-to-End Differentiable Neuro-Symbolic Optical Flow for Visual Odometry5 Sep 2026
- 2026CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space31 Aug 2026
- 2026SSMB: Self-Supervised Local Feature Detection under Motion Blur27 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026Rolling Shutter Relative Pose Estimation Made Practical25 Jun 2026
- 2026FS-I2P:A Hierarchical Focus-Sweep Registration Network with Dynamically Allocated Depth8 May 2026
- 2026Accelerating Transformer-Based Monocular SLAM via Geometric Utility Scoring9 Apr 2026
- 2026Improving Local Feature Matching by Entropy-inspired Scale Adaptability and Flow-endowed Local Consistency8 Apr 2026
- 2026GESS: Multi-cue Guided Local Feature Learning via Geometric and Semantic Synergy7 Apr 2026
- 2026LoMa: Local Feature Matching Revisited6 Apr 2026
38 more
- 2026EpiMask: Leveraging Epipolar Distance Based Masks in Cross-Attention for Satellite Image Matching23 Mar 2026
- 2026RaCo: Ranking and Covariance for Practical Learned Keypoints17 Feb 2026
- 2026Understanding and Optimizing Attention-Based Sparse Matching for Diverse Local Features9 Feb 2026
- 2026VVLoc: Prior-free 3-DoF Vehicle Visual Localization31 Jan 2026
- 2025Self-Supervised Contrastive Embedding Adaptation for Endoscopic Image Matching11 Dec 2025
- 2025Dropping the D: RGB-D SLAM Without the Depth Sensor7 Oct 2025
- 2025A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Features1 Oct 2025
- 2025SGAD: Semantic and Geometric-aware Descriptor for Local Feature Matching4 Aug 2025
- 2025CA-I2P: Channel-Adaptive Registration Network with Global Optimal Selection26 Jun 2025
- 2025RealKeyMorph: Keypoints in Real-world Coordinates for Resolution-agnostic Image Registration12 Jun 2025
- 2025Task-driven real-world super-resolution of document scans8 Jun 2025
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025RDD: Robust Feature Detector and Descriptor using Deformable Transformer12 May 2025
- 2025Learning Affine Correspondences by Integrating Geometric Constraints7 Apr 2025
- 2025Good Keypoints for the Two-View Geometry Estimation Problem24 Mar 2025
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priors21 Mar 2025
- 2025SatDepth: A Novel Dataset for Satellite Image Matching17 Mar 2025
- 2025DaD: Distilled Reinforcement Learning for Diverse Keypoint Detection10 Mar 2025
- 2025EDM: Efficient Deep Feature Matching7 Mar 2025
- 2025pySLAM: An Open-Source, Modular, and Extensible Framework for SLAM17 Feb 2025
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Training13 Jan 2025
- 2024GIMS: Image Matching System Based on Adaptive Graph Construction and Graph Neural Network24 Dec 2024
- 2024Reconstructing People, Places, and Cameras23 Dec 2024
- 2024Image Matching Filtering and Refinement by Planes and Beyond14 Nov 2024
- 2024Silver medal Solution for Image Matching Challenge 20244 Nov 2024
- 2024Towards Foundation Models for 3D Vision: How Close Are We?14 Oct 2024
- 2024Deep Learning Meets Satellite Images -- An Evaluation on Handcrafted and Learning-based Features for Multi-date Satellite Stereo Images4 Sep 2024
- 2024GMM-IKRS: Gaussian Mixture Models for Interpretable Keypoint Refinement and Scoring30 Aug 2024
- 2024Affine steerers for structured keypoint description26 Aug 2024
- 2024ConDL: Detector-Free Dense Image Matching5 Aug 2024
- 2024MESA: Effective Matching Redundancy Reduction by Semantic Area Segmentation1 Aug 2024
- 2024Learning to Make Keypoints Sub-Pixel Accurate16 Jul 2024
- 2024REMM:Rotation-Equivariant Framework for End-to-End Multimodal Image Matching16 Jul 2024
- 2024Grounding Image Matching in 3D with MASt3R14 Jun 2024
- 2024Scale-Free Image Keypoints Using Differentiable Persistent Homology3 Jun 2024
- 2024Physical Backdoor: Towards Temperature-based Backdoor Attacks in the Physical World30 Apr 2024
- 2024XFeat: Accelerated Features for Lightweight Image Matching30 Apr 2024
- 2024DeDoDe v2: Analyzing and Improving the DeDoDe Keypoint Detector13 Apr 2024
50 newest of 117 All 117 (JSON)
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
- 2024XFeat: Accelerated Features for Lightweight Image Matchingcited by 113
- 2021ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extractioncited by 77
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 69
- 2023DeDoDe: Detect, Don't Describe -- Describe, Don't Detect for Local Feature Matchingcited by 62
- 2022Correlation Verification for Image Retrievalcited by 47
- 2021P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matchingcited by 42
- 2021Planar Surface Reconstruction from Sparse Viewscited by 40
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
- 2024DeDoDe v2: Analyzing and Improving the DeDoDe Keypoint Detectorcited by 38
12 most cited of 117 All 117 (JSON)
- 2026RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching8 Sep 2026
- 2026Radiation, Rotation and Scale Invariant Feature Descriptor for Multimodal Image Matching6 Sep 2026
- 2026NSFlow: End-to-End Differentiable Neuro-Symbolic Optical Flow for Visual Odometry5 Sep 2026
- 2026CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space31 Aug 2026
- 2026SSMB: Self-Supervised Local Feature Detection under Motion Blur27 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026Rolling Shutter Relative Pose Estimation Made Practical25 Jun 2026
- 2026FS-I2P:A Hierarchical Focus-Sweep Registration Network with Dynamically Allocated Depth8 May 2026
- 2026Accelerating Transformer-Based Monocular SLAM via Geometric Utility Scoring9 Apr 2026
- 2026Improving Local Feature Matching by Entropy-inspired Scale Adaptability and Flow-endowed Local Consistency8 Apr 2026
- 2026GESS: Multi-cue Guided Local Feature Learning via Geometric and Semantic Synergy7 Apr 2026
- 2026LoMa: Local Feature Matching Revisited6 Apr 2026
12 newest of 117 All 117 (JSON)