Learning to Compare Image Patches via Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
In this paper we show how to learn directly from image data (i.e., without resorting to manually-designed features) a general similarity function for comparing image patches, which is a task of fundamental importance for many computer vision problems. To encode such a function, we opt for a CNN-based model that is trained to account for a wide variety of changes in image appearance. To that end, we explore and study multiple neural network architectures, which are specifically adapted to this task. We show that such an approach can significantly outperform the state-of-the-art on several problems and benchmark datasets.
Key facts. Cited by 109 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Apr 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 40; 2022: 17; 2023: 26; 2024: 16; 2025: 8; 2026: 2.
109 papers.
Sort:
By area:
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 137
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2021Unsupervised Object-Level Representation Learning from Scene Imagescited by 72
- 2021Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondencescited by 66
- 2021Spatially Consistent Representation Learningcited by 64
- 2022Multiview Stereo with Cascaded Epipolar RAFTcited by 51
- 2024VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstructioncited by 50
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
38 more
- 2024Neural Markov Random Field for Stereo Matchingcited by 38
- 2022TINYCD: A (Not So) Deep Learning Model For Change Detectioncited by 35
- 2022Enabling Country-Scale Land Cover Mapping with Meter-Resolution Satellite Imagerycited by 31
- 2024GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstructioncited by 31
- 2021Dual Contrastive Loss and Attention for GANscited by 30
- 2023OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baselinecited by 28
- 2022HIER: Metric Learning Beyond Class Labels via Hierarchical Regularizationcited by 26
- 2023HSCNet++: Hierarchical Scene Coordinate Classification and Regression for Visual Localization with Transformercited by 26
- 2021FCCDN: Feature Constraint Network for VHR Image Change Detectioncited by 25
- 2021AVA-AVD: Audio-Visual Speaker Diarization in the Wildcited by 24
- 2021DFM: A Performance Baseline for Deep Feature Matchingcited by 17
- 2021Stereoscopic Universal Perturbations across Different Architectures and Datasetscited by 17
- 2021RankSRGAN: Super Resolution Generative Adversarial Networks with Learning to Rankcited by 13
- 2022Self-Taught Metric Learning without Labelscited by 13
- 2023BotTriNet: A Unified and Efficient Embedding for Social Bots Detection via Metric Learningcited by 13
- 2021HumanGPS: Geodesic PreServing Feature for Dense Human Correspondencescited by 12
- 2021Deep Multi-View Stereo gone wildcited by 11
- 2021Multimodal Representation for Neural Code Searchcited by 11
- 2021FADNet++: Real-Time and Accurate Disparity Estimation with Configurable Networkscited by 11
- 2021Dr-Vectors: Decision Residual Networks and an Improved Loss for Speaker Recognitioncited by 10
- 2023Learning a Room with the Occ-SDF Hybrid: Signed Distance Function Mingled with Occupancy Aids Scene Representationcited by 10
- 2021Camera Invariant Feature Learning for Generalized Face Anti-spoofingcited by 9
- 2022Multi-View Reconstruction using Signed Ray Distance Functions (SRDF)cited by 9
- 2023SAME++: A Self-supervised Anatomical eMbeddings Enhanced medical image registration framework using stable sampling and regularized transformationcited by 9
- 2021Matching in the Dark: A Dataset for Matching Image Pairs of Low-light Scenescited by 7
- 2022A Critical Analysis of Image-based Camera Pose Estimation Techniquescited by 7
- 2022Learning-Based Dimensionality Reduction for Computing Compact and Effective Local Feature Descriptorscited by 7
- 2023DiViNeT: 3D Reconstruction from Disparate Views via Neural Template Regularizationcited by 7
- 2024Use of Graph Neural Networks in Aiding Defensive Cyber Operationscited by 7
- 2025Deep Learning Reforms Image Matching: A Survey and Outlookcited by 7
- 2022Urban Change Forecasting from Satellite Imagescited by 6
- 2021Improving Deep Metric Learning by Divide and Conquercited by 5
- 2022Deep Rank-Consistent Pyramid Model for Enhanced Crowd Countingcited by 5
- 2023Image Patch-Matching with Graph-Based Learning in Street Scenescited by 5
- 2024Extending 6D Object Pose Estimators for Stereo Visioncited by 5
- 2021A Survey on Active Deep Learning: From Model-driven to Data-drivencited by 4
- 2021A Fusion-Denoising Attack on InstaHide with Data Augmentationcited by 4
- 2021Multi-Head Deep Metric Learning Using Global and Local Representationscited by 4
50 most cited of 109 All 109 (JSON)
- 2026TREK: Distill to Explore, Reinforce to Refine6 Jul 2026
- 2026Multi-Sensor Matching with HyperNetworks18 Jan 2026
- 2025Tree Matching Networks for Natural Language Inference: Parameter-Efficient Semantic Understanding via Dependency Parse Trees28 Nov 2025
- 2025Cheating Stereo Matching in Full-scale: Physical Adversarial Attack against Binocular Depth Estimation in Autonomous Driving18 Nov 2025
- 2025Guided Image Feature Matching using Feature Spatial Order12 Oct 2025
- 2025A Recursive Pyramidal Algorithm for Solving the Image Registration Problem5 Oct 2025
- 2025Refining Gaussian Splatting: A Volumetric Densification Approach7 Aug 2025
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025Multi-view dense image matching with similarity learning and geometry priors16 May 2025
- 2024Why and How: Knowledge-Guided Learning for Cross-Spectral Image Patch Matching15 Dec 2024
- 2024Puzzle Similarity: A Perceptually-guided Cross-Reference Metric for Artifact Detection in 3D Scene Reconstructions26 Nov 2024
38 more
- 2024IO Transformer: Evaluating SwinV2-Based Reward Models for Computer Vision31 Oct 2024
- 2024Change-Aware Siamese Network for Surface Defects Segmentation under Complex Background1 Sep 2024
- 2024ConDL: Detector-Free Dense Image Matching5 Aug 2024
- 2024Multiple Instance Verification9 Jul 2024
- 2024Towards AI Lesion Tracking in PET/CT Imaging: A Siamese-based CNN Pipeline applied on PSMA PET/CT Scans13 Jun 2024
- 2024VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstruction9 Jun 2024
- 2024GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstruction30 May 2024
- 2024Stereo-LiDAR Depth Estimation with Deformable Propagation and Learned Disparity-Depth Conversion11 Apr 2024
- 2024Medical Image Registration and Its Application in Retinal Images: A Review25 Mar 2024
- 2024Relational Representation Learning Network for Cross-Spectral Image Patch Matching18 Mar 2024
- 2024Neural Markov Random Field for Stereo Matching17 Mar 2024
- 2024Pre-examinations Improve Automated Metastases Detection on Cranial MRI13 Mar 2024
- 2024Extending 6D Object Pose Estimators for Stereo Vision8 Feb 2024
- 2024Use of Graph Neural Networks in Aiding Defensive Cyber Operations11 Jan 2024
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance1 Dec 2023
- 2023OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baseline1 Dec 2023
- 2023SAME++: A Self-supervised Anatomical eMbeddings Enhanced medical image registration framework using stable sampling and regularized transformation25 Nov 2023
- 2023Image Patch-Matching with Graph-Based Learning in Street Scenes8 Nov 2023
- 2023Image change detection with only a few samples7 Nov 2023
- 2023Transformer-based Multimodal Change Detection with Multitask Consistency Constraints13 Oct 2023
- 2023A Comprehensive Survey on Deep Neural Image Deblurring7 Oct 2023
- 2023IFAST: Weakly Supervised Interpretable Face Anti-spoofing from Single-shot Binocular NIR Images29 Sep 2023
- 2023Generalization of pixel-wise phase estimation by CNN and improvement of phase-unwrapping by MRF optimization for one-shot 3D scan26 Sep 2023
- 2023TransTouch: Learning Transparent Objects Depth Sensing Through Sparse Touches18 Sep 2023
- 2023Learning multi-domain feature relation for visible and Long-wave Infrared image patch matching9 Aug 2023
- 2023Learning Photometric Feature Transform for Free-form Object Scan7 Aug 2023
- 2023Neural 3D Scene Reconstruction from Multiple 2D Images without 3D Supervision30 Jun 2023
- 2023Improving Reference-based Distinctive Image Captioning with Contrastive Rewards25 Jun 2023
- 2023NERFBK: A High-Quality Benchmark for NERF-Based 3D Reconstruction9 Jun 2023
- 2023DiViNeT: 3D Reconstruction from Disparate Views via Neural Template Regularization7 Jun 2023
- 2023Effective Intrusion Detection in Highly Imbalanced IoT Networks with Lightweight S2CGAN-IDS6 Jun 2023
- 2023FastMESH: Fast Surface Reconstruction by Hexagonal Mesh-based Neural Rendering29 May 2023
- 2023HSCNet++: Hierarchical Scene Coordinate Classification and Regression for Visual Localization with Transformer5 May 2023
- 2023DeepSim-Nets: Deep Similarity Networks for Stereo Image Matching17 Apr 2023
- 2023BotTriNet: A Unified and Efficient Embedding for Social Bots Detection via Metric Learning6 Apr 2023
- 2023Learning a Room with the Occ-SDF Hybrid: Signed Distance Function Mingled with Occupancy Aids Scene Representation16 Mar 2023
- 2023Optimizing CAD Models with Latent Space Manipulation9 Mar 2023
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representation8 Mar 2023
50 newest of 109 All 109 (JSON)
- 2026TREK: Distill to Explore, Reinforce to Refinecited by 1
- 2026TREK: Distill to Explore, Reinforce to Refine6 Jul 2026
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 137
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2021Unsupervised Object-Level Representation Learning from Scene Imagescited by 72
- 2021Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondencescited by 66
- 2021Spatially Consistent Representation Learningcited by 64
- 2022Multiview Stereo with Cascaded Epipolar RAFTcited by 51
- 2024VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstructioncited by 50
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
12 most cited of 107 All 107 (JSON)
- 2026Multi-Sensor Matching with HyperNetworks18 Jan 2026
- 2025Tree Matching Networks for Natural Language Inference: Parameter-Efficient Semantic Understanding via Dependency Parse Trees28 Nov 2025
- 2025Cheating Stereo Matching in Full-scale: Physical Adversarial Attack against Binocular Depth Estimation in Autonomous Driving18 Nov 2025
- 2025Guided Image Feature Matching using Feature Spatial Order12 Oct 2025
- 2025A Recursive Pyramidal Algorithm for Solving the Image Registration Problem5 Oct 2025
- 2025Refining Gaussian Splatting: A Volumetric Densification Approach7 Aug 2025
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025Multi-view dense image matching with similarity learning and geometry priors16 May 2025
- 2024Why and How: Knowledge-Guided Learning for Cross-Spectral Image Patch Matching15 Dec 2024
- 2024Puzzle Similarity: A Perceptually-guided Cross-Reference Metric for Artifact Detection in 3D Scene Reconstructions26 Nov 2024
- 2024Change-Aware Siamese Network for Surface Defects Segmentation under Complex Background1 Sep 2024
12 newest of 107 All 107 (JSON)