LIFT: Learned Invariant Feature Transform
Not on the map. Why?
Abstract (arXiv)
We introduce a novel Deep Network architecture that implements the full feature point handling pipeline, that is, detection, orientation estimation, and feature description. While previous works have successfully tackled each one of these problems individually, we show how to learn to do all three in a unified manner while preserving end-to-end differentiability. We then demonstrate that our Deep pipeline outperforms state-of-the-art methods on a number of benchmark datasets, without the need of retraining.
Key facts. Cited by 306 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 60; 2022: 54; 2023: 67; 2024: 44; 2025: 50; 2026: 31.
306 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
- 20243D Reconstruction with Spatial Memorycited by 277
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 200
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
38 more
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 183
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 147
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 121
- 2023Unsupervised Semantic Correspondence Using Stable Diffusioncited by 120
- 2022TransVPR: Transformer-based place recognition with multi-level attention aggregationcited by 102
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 100
- 2021Learning to Match Features with Seeded Graph Matching Networkcited by 92
- 2023Segment Anything Meets Point Trackingcited by 81
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2021ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extractioncited by 77
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 72
- 2023DeDoDe: Detect, Don't Describe -- Describe, Don't Detect for Local Feature Matchingcited by 63
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 62
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2024OmniGlue: Generalizable Feature Matching with Foundation Model Guidancecited by 56
- 2021DOLG: Single-Stage Image Retrieval with Deep Orthogonal Fusion of Local and Global Featurescited by 54
- 2022SparsePose: Sparse-View Camera Pose Regression and Refinementcited by 53
- 2024XoFTR: Cross-modal Feature Matching Transformercited by 48
- 2022Correlation Verification for Image Retrievalcited by 47
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2025Dynamic Point Maps: A Versatile Representation for Dynamic 3D Reconstructioncited by 44
- 2021P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matchingcited by 42
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
- 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matchingcited by 37
- 2023Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairscited by 37
- 2022BALF: Simple and Efficient Blur Aware Local Feature Detectorcited by 34
- 2022AmsterTime: A Visual Place Recognition Benchmark Dataset for Severe Domain Shiftcited by 32
- 2022TopicFM: Robust and Interpretable Topic-Assisted Feature Matchingcited by 32
- 2023Doppelgangers: Learning to Disambiguate Images of Similar Structurescited by 32
- 2024Reconstructing People, Places, and Camerascited by 31
- 2026Scal3R: Scalable Test-Time Training for Large-Scale 3D Reconstructioncited by 31
- 2021Deep Matching Prior: Test-Time Optimization for Dense Correspondencecited by 30
- 2023PMatch: Paired Masked Image Modeling for Dense Geometric Matchingcited by 29
- 2021Motion Basis Learning for Unsupervised Deep Homography Estimation with Subspace Projectioncited by 28
- 2022Decoupling Makes Weakly Supervised Local Feature Bettercited by 28
50 most cited of 306 All 306 (JSON)
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space31 Aug 2026
- 2026XDG: Accelerated Visual Disambiguation30 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026SGFormer: Structure-Guided Transformer for Robust Local Feature Matching4 Aug 2026
- 2026CamFlow+: Hybrid Motion Bases for 2D Camera Motion Estimation with Stabilization Applications4 Jun 2026
- 2026SAMatcher: Dense Co-Visibility Modeling via Cross-View Fusion for Scale-Imbalance Image Matching2 Jun 2026
- 2026TWINGS: Thin Plate Splines Warp-aligned Initialization for Sparse-View Gaussian Splatting21 May 2026
- 2026Best Segmentation Buddies for Image-Shape Correspondence18 May 2026
38 more
- 2026Efficient 3D Content Reconstruction and Generation18 May 2026
- 2026VGGT-Omega14 May 2026
- 2026REALM: An RGB- and Event-Aligned Latent Manifold for Cross-Modal Perception30 Apr 2026
- 2026Match-Any-Events: Zero-Shot Motion-Robust Feature Matching Across Wide Baselines for Event Cameras20 Apr 2026
- 2026VGGT-Segmentor: Geometry-Enhanced Cross-View Segmentation15 Apr 2026
- 2026Who Handles Orientation? Investigating Invariance in Feature Matching13 Apr 2026
- 2026AsymLoc: Towards Asymmetric Feature Matching for Efficient Visual Localization10 Apr 2026
- 2026Scal3R: Scalable Test-Time Training for Large-Scale 3D Reconstruction9 Apr 2026
- 2026Self-Improving 4D Perception via Self-Distillation9 Apr 2026
- 2026GESS: Multi-cue Guided Local Feature Learning via Geometric and Semantic Synergy7 Apr 2026
- 2026Relational Epipolar Graphs for Robust Relative Camera Pose Estimation6 Apr 2026
- 2026EpiMask: Leveraging Epipolar Distance Based Masks in Cross-Attention for Satellite Image Matching23 Mar 2026
- 2026LST-SLAM: A Stereo Thermal SLAM System for Kilometer-Scale Dynamic Environments24 Feb 2026
- 2026RaCo: Ranking and Covariance for Practical Learned Keypoints17 Feb 2026
- 2026Data-driven registration and modeling of brain deformation for image-guided neurosurgery9 Feb 2026
- 2026SuperPoint-E: local features for 3D reconstruction via tracking adaptation in endoscopy4 Feb 2026
- 2026Deep learning enables urban change profiling through alignment of historical maps2 Feb 2026
- 2026Distill3R: A Pipeline for Democratizing 3D Foundation Models on Commodity Hardware31 Jan 2026
- 2026Second-order Gaussian directional derivative representations for image high-resolution corner detection13 Jan 2026
- 2025MARVO: Marine-Adaptive Radiance-aware Visual Odometry28 Nov 2025
- 2025Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillation27 Nov 2025
- 2025DeepDetect: Learning All-in-One Dense Keypoints20 Oct 2025
- 2025LightGlueStick: a Fast and Robust Glue for Joint Point-Line Matching18 Oct 2025
- 2025SaLon3R: Structure-aware Long-term Generalizable 3D Reconstruction from Unposed Images16 Oct 2025
- 2025Guided Image Feature Matching using Feature Spatial Order12 Oct 2025
- 2025HART: Human Aligned Reconstruction Transformer30 Sep 2025
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representations28 Sep 2025
- 2025Dual-Mode Deep Anomaly Detection for Medical Manufacturing: Structural Similarity and Feature Distance6 Sep 2025
- 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localization25 Aug 2025
- 2025G-CUT3R: Guided 3D Reconstruction with Camera and Depth Prior Integration15 Aug 2025
- 2025Refining Gaussian Splatting: A Volumetric Densification Approach7 Aug 2025
- 2025DOMR: Establishing Cross-View Segmentation via Dense Object Matching6 Aug 2025
- 2025GeoMoE: Divide-and-Conquer Motion Field Modeling with Mixture-of-Experts for Two-View Geometry1 Aug 2025
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2025Estimating 2D Camera Motion with Hybrid Motion Basis30 Jul 2025
- 2025Cross Spatial Temporal Fusion Attention for Remote Sensing Object Detection via Image Feature Matching25 Jul 2025
- 2025A Single-step Accurate Fingerprint Registration Method Based on Local Feature Matching22 Jul 2025
- 2025Gaussian kernel-based motion measurement18 Jul 2025
50 newest of 306 All 306 (JSON)
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 20243D Reconstruction with Spatial Memorycited by 277
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 200
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 183
12 most cited of 298 All 298 (JSON)
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space31 Aug 2026
- 2026XDG: Accelerated Visual Disambiguation30 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026SGFormer: Structure-Guided Transformer for Robust Local Feature Matching4 Aug 2026
- 2026CamFlow+: Hybrid Motion Bases for 2D Camera Motion Estimation with Stabilization Applications4 Jun 2026
- 2026SAMatcher: Dense Co-Visibility Modeling via Cross-View Fusion for Scale-Imbalance Image Matching2 Jun 2026
- 2026TWINGS: Thin Plate Splines Warp-aligned Initialization for Sparse-View Gaussian Splatting21 May 2026
- 2026Best Segmentation Buddies for Image-Shape Correspondence18 May 2026
12 newest of 298 All 298 (JSON)