Convolutional neural network architecture for geometric matching
Not on the map. Why?
Abstract (arXiv)
We address the problem of determining correspondences between two images in agreement with a geometric model such as an affine or thin-plate spline transformation, and estimating its parameters. The contributions of this work are three-fold. First, we propose a convolutional neural network architecture for geometric matching. The architecture is based on three main components that mimic the standard steps of feature extraction, matching and simultaneous inlier detection and model parameter estimation, while being trainable end-to-end. Second, we demonstrate that the network parameters can be trained from synthetically generated imagery without the need for manual annotation and that our matching layer significantly increases generalization capabilities to never seen before images. Finally, we show that the same model can perform both instance-level and category-level matching giving state-of-the-art results on the challenging Proposal Flow dataset.
Key facts. Cited by 138 papers in the map (data through 13 Oct 2026). First posted on arXiv 16 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 40; 2022: 34; 2023: 22; 2024: 16; 2025: 16; 2026: 10.
138 papers.
Sort:
By area:
- 2023Emergent Correspondence from Image Diffusioncited by 440
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 298
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 217
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 161
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-Oncited by 151
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 97
- 2022NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fieldscited by 86
- 2023Telling Left from Right: Identifying Geometry-Aware Semantic Correspondencecited by 85
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
38 more
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2024Local All-Pair Correspondence for Point Trackingcited by 78
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editingcited by 62
- 2021GAN-Supervised Dense Visual Alignmentcited by 61
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2023Continuous Sign Language Recognition with Correlation Networkcited by 56
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2021Convolutional Hough Matching Networkscited by 43
- 2021Warp Consistency for Unsupervised Learning of Dense Correspondencescited by 42
- 2023Diversity-Measurable Anomaly Detectioncited by 41
- 2023Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Trainingcited by 39
- 2021Viewpoint Invariant Dense Matching for Visual Geolocalizationcited by 36
- 2023Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-trainingcited by 36
- 2021Toward Accurate and Realistic Outfits Visualization with Attention to Detailscited by 33
- 2021Multi-scale Matching Networks for Semantic Correspondencecited by 32
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondencecited by 32
- 2021M3D-VTON: A Monocular-to-3D Virtual Try-On Networkcited by 31
- 2022Learning Semantic Correspondence with Sparse Annotationscited by 31
- 2021Deep Matching Prior: Test-Time Optimization for Dense Correspondencecited by 30
- 2022Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondencescited by 30
- 2023Neural Congealing: Aligning Images to a Joint Semantic Atlascited by 30
- 2022TransforMatcher: Match-to-Match Attention for Semantic Correspondencecited by 29
- 2022C-VTON: Context-Driven Image-Based Virtual Try-On Networkcited by 29
- 2021Unsupervised Human Pose Estimation through Transforming Shape Templatescited by 26
- 2023ASIC: Aligning Sparse in-the-wild Image Collectionscited by 26
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
- 2022Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wildcited by 22
- 2023FECANet: Boosting Few-Shot Semantic Segmentation with Feature-Enhanced Context-Aware Networkcited by 22
- 2022Model-Agnostic Augmentation for Accurate Graph Classificationcited by 21
- 2023Diffusion Model for Dense Matchingcited by 21
- 2021The Functional Correspondence Problemcited by 20
- 2022Stand-Alone Inter-Frame Attention in Video Modelscited by 19
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformerscited by 19
- 2021WAS-VTON: Warping Architecture Search for Virtual Try-on Networkcited by 18
- 2021DFM: A Performance Baseline for Deep Feature Matchingcited by 17
- 2022CoordGAN: Self-Supervised Dense Correspondences Emerge from GANscited by 17
- 2024Distillation of Diffusion Features for Semantic Correspondencecited by 17
50 most cited of 138 All 138 (JSON)
- 2026AlignMorph: Tuning-Free Diffusion Image Morphing via Explicit Semantic Transport21 Sep 2026
- 2026Acoustically Grounded Cost Learning for Open-Vocabulary Audio-Visual Semantic Segmentation29 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 20263DMPE: 3D Multi-Perspective Embedding6 Jul 2026
- 2026SOCO: Benchmarking Semantic Object Correspondence in Vision Foundation Models29 May 2026
- 2026BluRef: Unsupervised Image Deblurring with Dense-Matching References15 Mar 2026
- 2026DCP-CLIP:A Coarse-to-Fine Framework for Open-Vocabulary Semantic Segmentation with Dual Interaction14 Mar 2026
- 2026Gromov Wasserstein Optimal Transport for Semantic Correspondences3 Feb 2026
- 2026Deep learning enables urban change profiling through alignment of historical maps2 Feb 2026
- 2026SimpleMatch: A Simple and Strong Baseline for Semantic Correspondence18 Jan 2026
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformers3 Dec 2025
- 2025View-Consistent Diffusion Representations for 3D-Consistent Video Generation24 Nov 2025
38 more
- 2025Towards Geometry-Grounded Dense Semantic Matching with VGGT Priors25 Sep 2025
- 2025Lost in Translation? Vocabulary Alignment for Source-Free Adaptation in Open-Vocabulary Semantic Segmentation18 Sep 2025
- 2025Towards Robust Semantic Correspondence: A Benchmark and Insights1 Aug 2025
- 2025Vector Contrastive Learning For Pixel-Wise Pretraining In Medical Vision25 Jun 2025
- 2025Do It Yourself: Learning Semantic Correspondence from Pseudo-Labels5 Jun 2025
- 2025Deep Learning Reforms Image Matching: A Survey and Outlook5 Jun 2025
- 2025OV-COAST: Cost Aggregation with Optimal Transport for Open-Vocabulary Semantic Segmentation4 Jun 2025
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baseline23 May 2025
- 2025SC3EF: A Joint Self-Correlation and Cross-Correspondence Estimation Framework for Visible and Thermal Image Registration17 Apr 2025
- 2025AerOSeg: Harnessing SAM for Open-Vocabulary Segmentation in Remote Sensing Images12 Apr 2025
- 2025From Traditional to Deep Learning Approaches in Whole Slide Image Registration: A Methodological Review26 Feb 2025
- 2025FOCUS -- Multi-View Foot Reconstruction From Synthetically Trained Dense Correspondences10 Feb 2025
- 2025Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework5 Feb 2025
- 2025MATCHA:Towards Matching Anything24 Jan 2025
- 2024Distillation of Diffusion Features for Semantic Correspondence4 Dec 2024
- 2024Hierarchical Cross-Attention Network for Virtual Try-On23 Nov 2024
- 2024Tensorial template matching for fast cross-correlation with rotations and its application for tomography5 Aug 2024
- 2024SHIC: Shape-Image Correspondences with no Keypoint Supervision26 Jul 2024
- 2024Local All-Pair Correspondence for Point Tracking22 Jul 2024
- 2024SpaceJAM: a Lightweight and Regularization-free Method for Fast Joint Alignment of Images16 Jul 2024
- 2024CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal Correlation17 Apr 2024
- 2024MOWA: Multiple-in-One Image Warping Model16 Apr 2024
- 2024Independently Keypoint Learning for Small Object Semantic Correspondence3 Apr 2024
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing21 Mar 2024
- 2024ACDG-VTON: Accurate and Contained Diffusion Generation for Virtual Try-On20 Mar 2024
- 2024Zero-Shot Image Feature Consensus with Deep Functional Maps18 Mar 2024
- 2024PARMESAN: Parameter-Free Memory Search and Transduction for Dense Prediction Tasks18 Mar 2024
- 2024Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondence17 Mar 2024
- 2024Matching Semantically Similar Non-Identical Objects13 Mar 2024
- 2024BreastRegNet: A Deep Learning Framework for Registration of Breast Faxitron and Histopathology Images18 Jan 2024
- 2023Match me if you can: Semi-Supervised Semantic Correspondence Learning with Unpaired Images30 Nov 2023
- 2023Telling Left from Right: Identifying Geometry-Aware Semantic Correspondence28 Nov 2023
- 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentation27 Nov 2023
- 2023DocAligner: Annotating Real-world Photographic Document Images by Simply Taking Pictures9 Jun 2023
- 2023Emergent Correspondence from Image Diffusion6 Jun 2023
- 2023Diffusion Model for Dense Matching30 May 2023
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence24 May 2023
- 2023Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Training23 May 2023
50 newest of 138 All 138 (JSON)
- 2023Emergent Correspondence from Image Diffusioncited by 440
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 298
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-Oncited by 151
- 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editingcited by 62
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
- 2023Diffusion Model for Dense Matchingcited by 21
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editingcited by 5
- 2025View-Consistent Diffusion Representations for 3D-Consistent Video Generationcited by 3
- 2026Gromov Wasserstein Optimal Transport for Semantic Correspondencescited by 0
- 2026Gromov Wasserstein Optimal Transport for Semantic Correspondences3 Feb 2026
- 2025View-Consistent Diffusion Representations for 3D-Consistent Video Generation24 Nov 2025
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing21 Mar 2024
- 2023Emergent Correspondence from Image Diffusion6 Jun 2023
- 2023Diffusion Model for Dense Matching30 May 2023
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence24 May 2023
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On22 May 2023
- 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing4 Apr 2023
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translation22 Sep 2022
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 217
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 161
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 97
- 2022NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fieldscited by 86
- 2023Telling Left from Right: Identifying Geometry-Aware Semantic Correspondencecited by 85
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2024Local All-Pair Correspondence for Point Trackingcited by 78
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
12 most cited of 129 All 129 (JSON)
- 2026AlignMorph: Tuning-Free Diffusion Image Morphing via Explicit Semantic Transport21 Sep 2026
- 2026Acoustically Grounded Cost Learning for Open-Vocabulary Audio-Visual Semantic Segmentation29 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 20263DMPE: 3D Multi-Perspective Embedding6 Jul 2026
- 2026SOCO: Benchmarking Semantic Object Correspondence in Vision Foundation Models29 May 2026
- 2026BluRef: Unsupervised Image Deblurring with Dense-Matching References15 Mar 2026
- 2026DCP-CLIP:A Coarse-to-Fine Framework for Open-Vocabulary Semantic Segmentation with Dual Interaction14 Mar 2026
- 2026Deep learning enables urban change profiling through alignment of historical maps2 Feb 2026
- 2026SimpleMatch: A Simple and Strong Baseline for Semantic Correspondence18 Jan 2026
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformers3 Dec 2025
- 2025Towards Geometry-Grounded Dense Semantic Matching with VGGT Priors25 Sep 2025
- 2025Lost in Translation? Vocabulary Alignment for Source-Free Adaptation in Open-Vocabulary Semantic Segmentation18 Sep 2025
12 newest of 129 All 129 (JSON)