SPair-71k: A Large-scale Benchmark for Semantic Correspondence
Not on the map. Why?
Abstract (arXiv)
Establishing visual correspondences under large intra-class variations, which is often referred to as semantic correspondence or semantic matching, remains a challenging problem in computer vision. Despite its significance, however, most of the datasets for semantic correspondence are limited to a small amount of image pairs with similar viewpoints and scales. In this paper, we present a new large-scale benchmark dataset of semantically paired images, SPair-71k, which contains 70,958 image pairs with diverse variations in viewpoint and scale. Compared to previous datasets, it is significantly larger in number and contains more accurate and richer annotations. We believe this dataset will provide a reliable testbed to study the problem of semantic correspondence and will help to advance research in this area. We provide the results of recent methods on our new dataset as baselines for further research. Our benchmark is available online at http://cvlab.postech.ac.kr/research/SPair-71k/.
Key facts. Cited by 140 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 16; 2023: 23; 2024: 28; 2025: 26; 2026: 30.
140 papers.
Sort:
By area:
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 2023What does CLIP know about a red circle? Visual prompt engineering for VLMscited by 215
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
- 2023Unsupervised Semantic Correspondence Using Stable Diffusioncited by 120
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2023Telling Left from Right: Identifying Geometry-Aware Semantic Correspondencecited by 85
- 2024RandAR: Decoder-only Autoregressive Visual Generation in Random Orderscited by 82
38 more
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2021GAN-Supervised Dense Visual Alignmentcited by 61
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2023NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotationscited by 53
- 2024Diffusion Models and Representation Learning: A Surveycited by 53
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
- 2023FeatureNeRF: Learning Generalizable NeRFs by Distilling Foundation Modelscited by 47
- 2022Teaching Matters: Investigating the Role of Supervision in Vision Transformerscited by 45
- 2021Convolutional Hough Matching Networkscited by 43
- 2021Warp Consistency for Unsupervised Learning of Dense Correspondencescited by 42
- 2024CleanDIFT: Diffusion Features without Noisecited by 42
- 2023SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matchingcited by 38
- 2023Improving Semantic Correspondence with Viewpoint-Guided Spherical Mapscited by 33
- 2021Multi-scale Matching Networks for Semantic Correspondencecited by 32
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondencecited by 32
- 2022Learning Semantic Correspondence with Sparse Annotationscited by 31
- 2022Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondencescited by 30
- 2022Graph Matching with Bi-level Noisy Correspondencecited by 30
- 2023Neural Congealing: Aligning Images to a Joint Semantic Atlascited by 30
- 2022TransforMatcher: Match-to-Match Attention for Semantic Correspondencecited by 29
- 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Workscited by 29
- 2024LiFT: A Surprisingly Simple Lightweight Feature Transform for Dense ViT Descriptorscited by 27
- 2023ASIC: Aligning Sparse in-the-wild Image Collectionscited by 26
- 2024Not All Diffusion Model Activations Have Been Evaluated as Discriminative Featurescited by 23
- 2025Franca: Nested Matryoshka Clustering for Scalable Visual Representation Learningcited by 21
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activationscited by 20
- 2023SEGIC: Unleashing the Emergent Correspondence for In-Context Segmentationcited by 19
- 2024Distillation of Diffusion Features for Semantic Correspondencecited by 17
- 2021Cost Aggregation Is All You Need for Few-Shot Segmentationcited by 16
- 2022Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labelscited by 16
- 2024Law of Vision Representation in MLLMscited by 16
- 2025Latent Implicit Visual Reasoningcited by 16
- 2024Near, far: Patch-ordering enhances vision foundation models' scene understandingcited by 15
- 2024Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondencecited by 14
- 2024Toward a Holistic Evaluation of Robustness in CLIP Modelscited by 13
- 2025Do It Yourself: Learning Semantic Correspondence from Pseudo-Labelscited by 13
50 most cited of 140 All 140 (JSON)
- 2026Harness Compilation: Which Decisions Should a Small Vision-Language Model Keep?8 Oct 2026
- 2026DisParQ: Self-Supervised Part Concepts for Interpretable Vision Foundation Models7 Oct 2026
- 2026RBF-GNN: Rational Basis Functions for Pseudo-Coordinate based Graph Convolutions29 Sep 2026
- 2026ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding24 Sep 2026
- 2026Two Global Crops Suffice: Locating Semantic Emergence in DINO-Style Self-Supervised Learning23 Sep 2026
- 2026AlignMorph: Tuning-Free Diffusion Image Morphing via Explicit Semantic Transport21 Sep 2026
- 2026Diffusion Trajectory Modeling for Semantic Correspondence14 Sep 2026
- 2026TDDN: Text-aligned Diffused DINO Network for Puzzle Understanding7 Sep 2026
- 2026DDMS: Discriminative Distillation of Multi-view Foundational Features into Single-view Models24 Aug 2026
- 2026Probing Diffusion Denoising Dynamics for Contrastive Representation Learning10 Jul 2026
- 2026Quantum-Inspired Harmonic Decision Models: A Computational Framework for Music Generation6 Jul 2026
- 2026Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulation3 Jul 2026
38 more
- 2026ViT-Up: Faithful Feature Upsampling for Vision Transformers12 Jun 2026
- 2026SOCO: Benchmarking Semantic Object Correspondence in Vision Foundation Models29 May 2026
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence28 May 2026
- 2026Category-Level 3D Correspondence in Camera Space via Morphable Object Priors27 May 2026
- 2026SEMAGIC: Learning Semantically Consistent Deformable 3D Representations from In-the-Wild Images27 May 2026
- 2026Weighted Reverse Convolution for Feature Upsampling17 May 2026
- 2026MARCO: Navigating the Unseen Space of Semantic Correspondence20 Apr 2026
- 2026Zero-Ablation Overstates Register Content Dependence in DINO Vision Transformers15 Apr 2026
- 2026VLMs Need Words: Vision Language Models Ignore Visual Detail In Favor of Semantic Anchors2 Apr 2026
- 2026INSID3: Training-Free In-Context Segmentation with DINOv330 Mar 2026
- 2026Efficient Universal Perception Encoder23 Mar 2026
- 2026Shape-of-You: Fused Gromov-Wasserstein Optimal Transport for Semantic Correspondence in-the-Wild12 Mar 2026
- 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfer16 Feb 2026
- 2026VersaViT: Enhancing MLLM Vision Backbones via Task-Guided Optimization10 Feb 2026
- 2026Gromov Wasserstein Optimal Transport for Semantic Correspondences3 Feb 2026
- 2026IOTA: Corrective Knowledge-Guided Prompt Learning via Black-White Box Framework28 Jan 2026
- 2026Revisiting Multi-Task Visual Representation Learning20 Jan 2026
- 2026SimpleMatch: A Simple and Strong Baseline for Semantic Correspondence18 Jan 2026
- 2025Latent Implicit Visual Reasoning24 Dec 2025
- 2025Visually Prompted Benchmarks Are Surprisingly Fragile19 Dec 2025
- 2025On Geometric Understanding and Learned Priors in Feed-forward 3D Reconstruction Models12 Dec 2025
- 2025Understanding Task Transfer in Vision-Language Models24 Nov 2025
- 2025FastJAM: a Fast Joint Alignment Model for Images26 Oct 2025
- 2025Visual Representations inside the Language Model6 Oct 2025
- 2025Similarity-Aware Selective State-Space Modeling for Semantic Correspondence29 Sep 2025
- 2025Mind-the-Glitch: Visual Correspondence for Detecting Inconsistencies in Subject-Driven Generation26 Sep 2025
- 2025Towards Geometry-Grounded Dense Semantic Matching with VGGT Priors25 Sep 2025
- 2025Weakly-Supervised Learning of Dense Functional Correspondences4 Sep 2025
- 2025GECO: Geometrically Consistent Embedding with Lightspeed Inference1 Aug 2025
- 2025Towards Robust Semantic Correspondence: A Benchmark and Insights1 Aug 2025
- 2025Hallucination Score: Towards Mitigating Hallucinations in Generative Image Super-Resolution18 Jul 2025
- 2025Franca: Nested Matryoshka Clustering for Scalable Visual Representation Learning18 Jul 2025
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 2025Jamais Vu: Exposing the Generalization Gap in Supervised Semantic Correspondence9 Jun 2025
- 2025Do It Yourself: Learning Semantic Correspondence from Pseudo-Labels5 Jun 2025
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activations24 May 2025
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baseline23 May 2025
- 2025Common3D: Self-Supervised Learning of 3D Morphable Models for Common Objects in Neural Feature Space30 Apr 2025
50 newest of 140 All 140 (JSON)
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
- 2023Unsupervised Semantic Correspondence Using Stable Diffusioncited by 120
- 2024Diffusion Models and Representation Learning: A Surveycited by 53
- 2024CleanDIFT: Diffusion Features without Noisecited by 42
- 2023SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matchingcited by 38
- 2024Not All Diffusion Model Activations Have Been Evaluated as Discriminative Featurescited by 23
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activationscited by 20
- 2025Mind-the-Glitch: Visual Correspondence for Detecting Inconsistencies in Subject-Driven Generationcited by 6
- 2024Suppress Content Shift: Better Diffusion Features via Off-the-Shelf Generation Techniquescited by 2
- 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfercited by 1
12 most cited of 17 All 17 (JSON)
- 2026Diffusion Trajectory Modeling for Semantic Correspondence14 Sep 2026
- 2026Probing Diffusion Denoising Dynamics for Contrastive Representation Learning10 Jul 2026
- 2026Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulation3 Jul 2026
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence28 May 2026
- 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfer16 Feb 2026
- 2026Gromov Wasserstein Optimal Transport for Semantic Correspondences3 Feb 2026
- 2025Mind-the-Glitch: Visual Correspondence for Detecting Inconsistencies in Subject-Driven Generation26 Sep 2025
- 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activations24 May 2025
- 2024CleanDIFT: Diffusion Features without Noise4 Dec 2024
- 2024Suppress Content Shift: Better Diffusion Features via Off-the-Shelf Generation Techniques9 Oct 2024
- 2024Not All Diffusion Model Activations Have Been Evaluated as Discriminative Features4 Oct 2024
- 2024Diffusion Models and Representation Learning: A Survey30 Jun 2024
12 newest of 17 All 17 (JSON)
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2023What does CLIP know about a red circle? Visual prompt engineering for VLMscited by 215
- 2024Law of Vision Representation in MLLMscited by 16
- 2024Toward a Holistic Evaluation of Robustness in CLIP Modelscited by 13
- 2025Visual Representations inside the Language Modelcited by 13
- 2026VLMs Need Words: Vision Language Models Ignore Visual Detail In Favor of Semantic Anchorscited by 12
- 2025Weakly-Supervised Learning of Dense Functional Correspondencescited by 2
- 2025Understanding Task Transfer in Vision-Language Modelscited by 2
- 2026Revisiting Multi-Task Visual Representation Learningcited by 2
- 2026VersaViT: Enhancing MLLM Vision Backbones via Task-Guided Optimizationcited by 1
- 2026VLMs Need Words: Vision Language Models Ignore Visual Detail In Favor of Semantic Anchors2 Apr 2026
- 2026VersaViT: Enhancing MLLM Vision Backbones via Task-Guided Optimization10 Feb 2026
- 2026Revisiting Multi-Task Visual Representation Learning20 Jan 2026
- 2025Understanding Task Transfer in Vision-Language Models24 Nov 2025
- 2025Visual Representations inside the Language Model6 Oct 2025
- 2025Weakly-Supervised Learning of Dense Functional Correspondences4 Sep 2025
- 2024Toward a Holistic Evaluation of Robustness in CLIP Models2 Oct 2024
- 2024Law of Vision Representation in MLLMs29 Aug 2024
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceive18 Apr 2024
- 2023What does CLIP know about a red circle? Visual prompt engineering for VLMs13 Apr 2023
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2023Telling Left from Right: Identifying Geometry-Aware Semantic Correspondencecited by 85
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2021GAN-Supervised Dense Visual Alignmentcited by 61
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2023NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotationscited by 53
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
12 most cited of 108 All 108 (JSON)
- 2026Harness Compilation: Which Decisions Should a Small Vision-Language Model Keep?8 Oct 2026
- 2026DisParQ: Self-Supervised Part Concepts for Interpretable Vision Foundation Models7 Oct 2026
- 2026RBF-GNN: Rational Basis Functions for Pseudo-Coordinate based Graph Convolutions29 Sep 2026
- 2026ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding24 Sep 2026
- 2026Two Global Crops Suffice: Locating Semantic Emergence in DINO-Style Self-Supervised Learning23 Sep 2026
- 2026AlignMorph: Tuning-Free Diffusion Image Morphing via Explicit Semantic Transport21 Sep 2026
- 2026DDMS: Discriminative Distillation of Multi-view Foundational Features into Single-view Models24 Aug 2026
- 2026Quantum-Inspired Harmonic Decision Models: A Computational Framework for Music Generation6 Jul 2026
- 2026ViT-Up: Faithful Feature Upsampling for Vision Transformers12 Jun 2026
- 2026SOCO: Benchmarking Semantic Object Correspondence in Vision Foundation Models29 May 2026
- 2026Category-Level 3D Correspondence in Camera Space via Morphable Object Priors27 May 2026
- 2026SEMAGIC: Learning Semantically Consistent Deformable 3D Representations from In-the-Wild Images27 May 2026
12 newest of 108 All 108 (JSON)