D2-Net: A Trainable CNN for Joint Detection and Description of Local Features
Not on the map. Why?
Abstract (arXiv)
In this work we address the problem of finding reliable pixel-level correspondences under difficult imaging conditions. We propose an approach where a single convolutional neural network plays a dual role: It is simultaneously a dense feature descriptor and a feature detector. By postponing the detection to a later stage, the obtained keypoints are more stable than their traditional counterparts based on early detection of low-level structures. We show that this model can be trained using pixel correspondences extracted from readily available large-scale SfM reconstructions, without any further annotations. The proposed method obtains state-of-the-art performance on both the difficult Aachen Day-Night localization dataset and the InLoc indoor localization benchmark, as well as competitive performance on other benchmarks for image matching and 3D reconstruction.
Key facts. Cited by 324 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 41; 2022: 56; 2023: 68; 2024: 53; 2025: 69; 2026: 37.
324 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2023Tracking Everything Everywhere All at Oncecited by 190
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 182
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
38 more
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 170
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 120
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
- 2021Learning Multi-Scene Absolute Pose Regression with Transformerscited by 108
- 2022TransVPR: Transformer-based place recognition with multi-level attention aggregationcited by 102
- 2021Learning to Match Features with Seeded Graph Matching Networkcited by 92
- 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 90
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 82
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 81
- 2021ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extractioncited by 77
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
- 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 72
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2021Robust Reference-based Super-Resolution via C2-Matchingcited by 68
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2022EndoMapper dataset of complete calibrated endoscopy procedurescited by 53
- 2024XoFTR: Cross-modal Feature Matching Transformercited by 45
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2021P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matchingcited by 42
- 2021Warp Consistency for Unsupervised Learning of Dense Correspondencescited by 42
- 2022IFOR: Iterative Flow Minimization for Robotic Object Rearrangementcited by 42
- 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 40
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
- 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 39
- 2021Deep Lucas-Kanade Homography for Multimodal Image Alignmentcited by 38
- 2022Visual Localization via Few-Shot Scene Region Classificationcited by 36
- 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
- 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matchingcited by 35
- 2022BALF: Simple and Efficient Blur Aware Local Feature Detectorcited by 34
- 2023PATS: Patch Area Transportation with Subdivision for Local Feature Matchingcited by 33
- 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptorscited by 32
- 2022TopicFM: Robust and Interpretable Topic-Assisted Feature Matchingcited by 32
- 2024The NeRFect Match: Exploring NeRF Features for Visual Localizationcited by 32
- 2023Visual Place Recognition: A Tutorialcited by 31
- 2024GS-CPR: Efficient Camera Pose Refinement via 3D Gaussian Splattingcited by 31
- 2022Adaptive Assignment for Geometry Aware Local Feature Matchingcited by 30
50 most cited of 324 All 324 (JSON)
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026Self-Calibrating Dense Displacement Fields for Reliable Co-Registration of Large Optical Satellite Imagery23 Aug 2026
- 2026RIPE++: Reinforced Keypoint Learning from Positive Pairs Only20 Aug 2026
- 2026Robust structure from motion for aerial-ground images via detector-free feature matching and multi-view track refinement15 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026GS-CPE: Unified 6-Degree-of-Freedom Camera Pose Estimation via 3D Gaussian Splatting11 Aug 2026
- 2026SGFormer: Structure-Guided Transformer for Robust Local Feature Matching4 Aug 2026
- 2026Desc++: Efficient Descriptor Enhancement for Data Association in Existing Visual SLAM Systems13 Jul 2026
- 2026GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training2 Jul 2026
- 2026Planar-SfM: Camera Pose Estimation via Homography Graph Embeddings30 Jun 2026
- 2026SA-Homo: Scale Adaptive Homography Estimation for Scale Variation Scenarios29 Jun 2026
38 more
- 2026SG2Loc: Sequential Visual Localization on 3D Scene Graphs10 Jun 2026
- 2026SAMatcher: Dense Co-Visibility Modeling via Cross-View Fusion for Scale-Imbalance Image Matching2 Jun 2026
- 2026Cross-Modality Feature Fusion Based on Structured State Space Duality for Multimodal Image Registration Network2 Jun 2026
- 2026VGGT-Omega14 May 2026
- 20263DReflecNet: A Large-Scale Dataset for 3D Reconstruction of Reflective, Transparent, and Low-Texture Objects11 May 2026
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrieval10 May 2026
- 2026Match-Any-Events: Zero-Shot Motion-Robust Feature Matching Across Wide Baselines for Event Cameras20 Apr 2026
- 2026SceneGlue: Scene-Aware Transformer for Feature Matching without Scene-Level Annotation15 Apr 2026
- 2026AsymLoc: Towards Asymmetric Feature Matching for Efficient Visual Localization10 Apr 2026
- 2026Accelerating Transformer-Based Monocular SLAM via Geometric Utility Scoring9 Apr 2026
- 2026Scal3R: Scalable Test-Time Training for Large-Scale 3D Reconstruction9 Apr 2026
- 2026Self-Improving 4D Perception via Self-Distillation9 Apr 2026
- 2026Improving Local Feature Matching by Entropy-inspired Scale Adaptability and Flow-endowed Local Consistency8 Apr 2026
- 2026GESS: Multi-cue Guided Local Feature Learning via Geometric and Semantic Synergy7 Apr 2026
- 2026ViBA: Implicit Bundle Adjustment with Geometric and Temporal Consistency for Robust Visual Matching3 Apr 2026
- 2026STAC: Plug-and-Play Spatio-Temporal Aware Cache Compression for Streaming 3D Reconstruction18 Mar 2026
- 2026Semantic Aware Feature Extraction for Enhanced 3D Reconstruction13 Mar 2026
- 2026CM-Bench: A Comprehensive Cross-Modal Feature Matching Benchmark Bridging Visible and Infrared Images13 Mar 2026
- 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistency27 Feb 2026
- 2026From Pairs to Sequences: Track-Aware Policy Gradients for Keypoint Detection24 Feb 2026
- 2026Bonsai: A Framework for Convolutional Neural Network Acceleration Using Criterion-Based Pruning19 Feb 2026
- 2026Understanding and Optimizing Attention-Based Sparse Matching for Diverse Local Features9 Feb 2026
- 2026Distill3R: A Pipeline for Democratizing 3D Foundation Models on Commodity Hardware31 Jan 2026
- 2026Coarse-to-Fine Non-rigid Multi-modal Image Registration for Historical Panel Paintings based on Crack Structures22 Jan 2026
- 2026Second-order Gaussian directional derivative representations for image high-resolution corner detection13 Jan 2026
- 2025Adaptive Covariance and Quaternion-Focused Hybrid Error-State EKF/UKF for Visual-Inertial Odometry19 Dec 2025
- 2025Robust Scene Coordinate Regression via Geometrically-Consistent Global Descriptors19 Dec 2025
- 2025ViGG: Robust RGB-D Point Cloud Registration using Visual-Geometric Mutual Guidance28 Nov 2025
- 2025Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillation27 Nov 2025
- 2025Unlocking Zero-shot Potential of Semi-dense Image Matching via Gaussian Splatting26 Nov 2025
- 2025Coarse-to-Fine Non-Rigid Registration for Side-Scan Sonar Mosaicking19 Nov 2025
- 2025GRLoc: Geometric Representation Regression for Visual Localization17 Nov 2025
- 2025Depth Anything 3: Recovering the Visual Space from Any Views13 Nov 2025
- 2025Morphing Through Time: Diffusion-Based Bridging of Temporal Gaps for Robust Alignment in Change Detection11 Nov 2025
- 2025Zero-Shot Polygon Matching with Pre-trained Models for Pose Estimation and Polygon Cloud from Challenging Stereo8 Nov 2025
- 2025ShapeX: Shapelet-Driven Post Hoc Explanations for Time Series Classification Models23 Oct 2025
- 2025DeepDetect: Learning All-in-One Dense Keypoints20 Oct 2025
- 2025LightGlueStick: a Fast and Robust Glue for Joint Point-Line Matching18 Oct 2025
50 newest of 324 All 324 (JSON)
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activationscited by 20
- 2025Diff2I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Priorcited by 8
- 2025Diff2I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Prior9 Jul 2025
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activations24 May 2025
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence24 May 2023
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2023Tracking Everything Everywhere All at Oncecited by 190
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 182
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 170
12 most cited of 318 All 318 (JSON)
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026Self-Calibrating Dense Displacement Fields for Reliable Co-Registration of Large Optical Satellite Imagery23 Aug 2026
- 2026RIPE++: Reinforced Keypoint Learning from Positive Pairs Only20 Aug 2026
- 2026Robust structure from motion for aerial-ground images via detector-free feature matching and multi-view track refinement15 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026GS-CPE: Unified 6-Degree-of-Freedom Camera Pose Estimation via 3D Gaussian Splatting11 Aug 2026
- 2026SGFormer: Structure-Guided Transformer for Robust Local Feature Matching4 Aug 2026
- 2026Desc++: Efficient Descriptor Enhancement for Data Association in Existing Visual SLAM Systems13 Jul 2026
- 2026GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training2 Jul 2026
- 2026Planar-SfM: Camera Pose Estimation via Homography Graph Embeddings30 Jun 2026
- 2026SA-Homo: Scale Adaptive Homography Estimation for Scale Variation Scenarios29 Jun 2026
12 newest of 318 All 318 (JSON)