# Dense Semantic Correspondence where Every Pixel is a Classifier

arXiv: https://arxiv.org/abs/1505.04143 · HTML: https://mlsanity.com/paper/1505.04143/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 May 2015.

## Built on by (most cited first, 15 of 15)

- [Convolutional Hough Matching Networks](https://mlsanity.com/paper/2103.16831/) (2021)
- [Bi-level Feature Alignment for Versatile Image Translation and Manipulation](https://mlsanity.com/paper/2107.03021/) (2021)
- [DensePose From WiFi](https://mlsanity.com/paper/2301.00250/) (2022)
- [Convolutional Hough Matching Networks for Robust and Efficient Visual Correspondence](https://mlsanity.com/paper/2109.05221/) (2021)
- [Learning Contrastive Representation for Semantic Correspondence](https://mlsanity.com/paper/2109.10967/) (2021)
- [Demystifying Unsupervised Semantic Correspondence Estimation](https://mlsanity.com/paper/2207.05054/) (2022)
- [A Review on Visual Privacy Preservation Techniques for Active and Assisted Living](https://mlsanity.com/paper/2112.09422/) (2021)
- [Learning Geometry-aware Representations by Sketching](https://mlsanity.com/paper/2304.08204/) (2023)
- [Semantic Correspondence: Unified Benchmarking and a Strong Baseline](https://mlsanity.com/paper/2505.18060/) (2025)
- [Match me if you can: Semi-Supervised Semantic Correspondence Learning with Unpaired Images](https://mlsanity.com/paper/2311.18540/) (2023)
- [Independently Keypoint Learning for Small Object Semantic Correspondence](https://mlsanity.com/paper/2404.02678/) (2024)
- [Semi-supervised Dense Keypoints Using Unlabeled Multiview Images](https://mlsanity.com/paper/2109.09299/) (2021)
- [Similarity-Aware Selective State-Space Modeling for Semantic Correspondence](https://mlsanity.com/paper/2509.24318/) (2025)
- [Introducing the structural bases of typicality effects in deep learning](https://mlsanity.com/paper/2107.03279/) (2021)
- [Learning Space-Time Semantic Correspondences](https://mlsanity.com/paper/2306.10208/) (2023)

## Abstract (arXiv)

Determining dense semantic correspondences across objects and scenes is a difficult problem that underpins many higher-level computer vision algorithms. Unlike canonical dense correspondence problems which consider images that are spatially or temporally adjacent, semantic correspondence is characterized by images that share similar high-level structures whose exact appearance and geometry may differ. Motivated by object recognition literature and recent work on rapidly estimating linear classifiers, we treat semantic correspondence as a constrained detection problem, where an exemplar LDA classifier is learned for each pixel. LDA classifiers have two distinct benefits: (i) they exhibit higher average precision than similarity metrics typically used in correspondence problems, and (ii) unlike exemplar SVM, can output globally interpretable posterior probabilities without calibration, whilst also being significantly faster to train. We pose the correspondence problem as a graphical model, where the unary potentials are computed via convolution with the set of exemplar classifiers, and the joint potentials enforce smoothly varying correspondence assignment.
