FeatureBooster: Boosting Feature Descriptors with a Lightweight Neural Network
Not on the map. Why?
Abstract (arXiv)
We introduce a lightweight network to improve descriptors of keypoints within the same image. The network takes the original descriptors and the geometric properties of keypoints as the input, and uses an MLP-based self-boosting stage and a Transformer-based cross-boosting stage to enhance the descriptors. The boosted descriptors can be either real-valued or binary ones. We use the proposed network to boost both hand-crafted (ORB, SIFT) and the state-of-the-art learning-based descriptors (SuperPoint, ALIKE) and evaluate them on image matching, visual localization, and structure-from-motion tasks. The results show that our method significantly improves the performance of each task, particularly in challenging cases such as large illumination changes or repetitive patterns. Our method requires only 3.2ms on desktop GPU and 27ms on embedded GPU to process 2000 features, which is fast enough to be applied to a practical system. The code and trained weights are publicly available at github.com/SJTU-ViSYS/FeatureBooster.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 28 Nov 2022.
Builds on
29 of 57 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 324
- 2020DISK: Learning local features with policy gradientcited by 310
17 more
- 2017HPatches: A benchmark and evaluation of handcrafted and learned local descriptorscited by 261
- 2017Working hard to know your neighbor's margins: Local descriptor learning losscited by 212
- 2019R2D2: Repeatable and Reliable Detector and Descriptorcited by 206
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2018LF-Net: Learning Local Features from Imagescited by 151
- 2019SOSNet: Second Order Similarity Regularization for Local Descriptor Learningcited by 131
- 2021An Attention Free Transformercited by 111
- 2020Learning Feature Descriptors using Camera Pose Supervisioncited by 104
- 2019ContextDesc: Local Descriptor Augmentation with Cross-Modality Contextcited by 79
- 2021ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extractioncited by 77
- 2018GeoDesc: Learning Local Descriptors by Integrating Geometry Constraintscited by 52
- 2018Local Descriptors Optimized for Average Precisioncited by 43
- 2020Multi-View Optimization of Local Feature Geometrycited by 24
- 2021RoRD: Rotation-Robust Descriptors and Orthographic Views for Local Feature Matchingcited by 19
- 2020Cross-Descriptor Visual Localization and Mappingcited by 15
- 2018InLoc: Indoor Visual Localization with Dense Matching and View Synthesiscited by 8
- 2018SConE: Siamese Constellation Embedding Descriptor for Image Matchingcited by 1
Built on by
Citing papers per year: 2024: 3; 2025: 3; 2026: 4.
10 papers.
- 2024Local Feature Matching Using Deep Learning: A Surveycited by 26
- 2025LiftFeat: 3D Geometry-Aware Local Feature Matchingcited by 12
- 2025Deep Learning Reforms Image Matching: A Survey and Outlookcited by 7
- 2026RaCo: Ranking and Covariance for Practical Learned Keypointscited by 3
- 2024FBINeRF: Feature-Based Integrated Recurrent Network for Pinhole and Fisheye Neural Radiance Fieldscited by 1
- 2024Matching Semantically Similar Non-Identical Objectscited by 0
- 2025GMatch: A Lightweight, Geometry-Constrained Keypoint Matcher for Zero-Shot 6DoF Pose Estimation in Robotic Grasp Taskscited by 0
- 2026From Pairs to Sequences: Track-Aware Policy Gradients for Keypoint Detectioncited by 0
- 2026Cross-Modality Feature Fusion Based on Structured State Space Duality for Multimodal Image Registration Networkcited by 0
- 2026Desc++: Efficient Descriptor Enhancement for Data Association in Existing Visual SLAM Systemscited by 0
- 2026Desc++: Efficient Descriptor Enhancement for Data Association in Existing Visual SLAM Systems13 Jul 2026
- 2026Cross-Modality Feature Fusion Based on Structured State Space Duality for Multimodal Image Registration Network2 Jun 2026
- 2026From Pairs to Sequences: Track-Aware Policy Gradients for Keypoint Detection24 Feb 2026
- 2026RaCo: Ranking and Covariance for Practical Learned Keypoints17 Feb 2026
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025GMatch: A Lightweight, Geometry-Constrained Keypoint Matcher for Zero-Shot 6DoF Pose Estimation in Robotic Grasp Tasks22 May 2025
- 2025LiftFeat: 3D Geometry-Aware Local Feature Matching6 May 2025
- 2024FBINeRF: Feature-Based Integrated Recurrent Network for Pinhole and Fisheye Neural Radiance Fields3 Aug 2024
- 2024Matching Semantically Similar Non-Identical Objects13 Mar 2024
- 2024Local Feature Matching Using Deep Learning: A Survey31 Jan 2024