Hyperpixel Flow: Semantic Correspondence with Multi-layer Neural Features
Not on the map. Why?
Abstract (arXiv)
Establishing visual correspondences under large intra-class variations requires analyzing images at different levels, from features linked to semantics and context to local patterns, while being invariant to instance-specific details. To tackle these challenges, we represent images by "hyperpixels" that leverage a small number of relevant features selected among early to late layers of a convolutional neural network. Taking advantage of the condensed features of hyperpixels, we develop an effective real-time matching algorithm based on Hough geometric voting. The proposed method, hyperpixel flow, sets a new state of the art on three standard benchmarks as well as a new dataset, SPair-71k, which contains a significantly larger number of image pairs than existing datasets, with more accurate and richer annotations for in-depth analysis.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 16; 2023: 12; 2024: 5; 2025: 6; 2026: 2.
56 papers.
Sort:
By area:
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2021GAN-Supervised Dense Visual Alignmentcited by 61
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2021Deep Hough Voting for Robust Global Registrationcited by 53
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2021Convolutional Hough Matching Networkscited by 43
- 2023SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matchingcited by 38
- 2021Multi-scale Matching Networks for Semantic Correspondencecited by 32
38 more
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondencecited by 32
- 2021Input-level Inductive Biases for 3D Reconstructioncited by 31
- 2022Learning Semantic Correspondence with Sparse Annotationscited by 31
- 2022Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondencescited by 30
- 2023Neural Congealing: Aligning Images to a Joint Semantic Atlascited by 30
- 2022TransforMatcher: Match-to-Match Attention for Semantic Correspondencecited by 29
- 2022Self-Supervised Equivariant Learning for Oriented Keypoint Detectioncited by 26
- 2023ASIC: Aligning Sparse in-the-wild Image Collectionscited by 26
- 2022Integrative Few-Shot Learning for Classification and Segmentationcited by 25
- 2023Learning Rotation-Equivariant Features for Visual Correspondencecited by 23
- 2022MSANet: Multi-Similarity and Attention Guidance for Boosting Few-Shot Segmentationcited by 21
- 2021Cost Aggregation Is All You Need for Few-Shot Segmentationcited by 16
- 2022Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labelscited by 16
- 2024Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondencecited by 14
- 2022Semantic-Aware Fine-Grained Correspondencecited by 13
- 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglementcited by 13
- 2021Convolutional Hough Matching Networks for Robust and Efficient Visual Correspondencecited by 12
- 2021Learning Contrastive Representation for Semantic Correspondencecited by 11
- 2022Demystifying Unsupervised Semantic Correspondence Estimationcited by 9
- 2025RIPE: Reinforcement Learning on Unlabeled Image Pairs for Robust Keypoint Extractioncited by 9
- 2023Masked and Adaptive Transformer for Exemplar Based Image Translationcited by 8
- 2022Integrative Feature and Cost Aggregation with Transformers for Dense Correspondencecited by 6
- 2023SimSC: A Simple Framework for Semantic Correspondence with Temperature Learningcited by 6
- 2023Efficient Semantic Matching with Hypercolumn Correlationcited by 6
- 2022Multi-layer Representation Learning for Robust OOD Image Classificationcited by 5
- 2023DeDA: Deep Directed Accumulatorcited by 5
- 2025Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentationcited by 4
- 2025Learning 3D Scene Analogies with Neural Contextual Scene Mapscited by 4
- 2026PCA-Seg: Revisiting Cost Aggregation for Open-Vocabulary Semantic and Part Segmentationcited by 4
- 2022Motion Aware Self-Supervision for Generic Event Boundary Detectioncited by 3
- 2024SAMIC: Segment Anything with In-Context Spatial Prompt Engineeringcited by 3
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baselinecited by 3
- 2021Understanding Pixel-level 2D Image Semantics with 3D Keypoint Knowledge Enginecited by 2
- 2023Match me if you can: Semi-Supervised Semantic Correspondence Learning with Unpaired Imagescited by 2
- 2024Independently Keypoint Learning for Small Object Semantic Correspondencecited by 2
- 2022DSI2I: Dense Style for Unpaired Image-to-Image Translationcited by 1
- 2021Reconstructing and grounding narrated instructional videos in 3Dcited by 0
- 2021HoughCL: Finding Better Positive Pairs in Dense Self-supervised Learningcited by 0
50 most cited of 56 All 56 (JSON)
- 2026AlignMorph: Tuning-Free Diffusion Image Morphing via Explicit Semantic Transport21 Sep 2026
- 2026PCA-Seg: Revisiting Cost Aggregation for Open-Vocabulary Semantic and Part Segmentation18 Mar 2026
- 2025Generating Part-Based Global Explanations Via Correspondence18 Sep 2025
- 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglement2 Sep 2025
- 2025RIPE: Reinforcement Learning on Unlabeled Image Pairs for Robust Keypoint Extraction7 Jul 2025
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baseline23 May 2025
- 2025Learning 3D Scene Analogies with Neural Contextual Scene Maps20 Mar 2025
- 2025Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentation16 Jan 2025
- 2024SAMIC: Segment Anything with In-Context Spatial Prompt Engineering16 Dec 2024
- 2024Independently Keypoint Learning for Small Object Semantic Correspondence3 Apr 2024
- 2024Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondence17 Mar 2024
- 2024Matching Semantically Similar Non-Identical Objects13 Mar 2024
38 more
- 2024Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attention18 Jan 2024
- 2023Match me if you can: Semi-Supervised Semantic Correspondence Learning with Unpaired Images30 Nov 2023
- 2023Efficient Semantic Matching with Hypercolumn Correlation7 Nov 2023
- 2023SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matching26 Oct 2023
- 2023Learning Space-Time Semantic Correspondences16 Jun 2023
- 2023DAGrid: Directed Accumulator Grid5 Jun 2023
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondence23 May 2023
- 2023SimSC: A Simple Framework for Semantic Correspondence with Temperature Learning3 May 2023
- 2023Masked and Adaptive Transformer for Exemplar Based Image Translation30 Mar 2023
- 2023ASIC: Aligning Sparse in-the-wild Image Collections28 Mar 2023
- 2023Learning Rotation-Equivariant Features for Visual Correspondence25 Mar 2023
- 2023DeDA: Deep Directed Accumulator15 Mar 2023
- 2023Neural Congealing: Aligning Images to a Joint Semantic Atlas8 Feb 2023
- 2022DSI2I: Dense Style for Unpaired Image-to-Image Translation26 Dec 2022
- 2022Motion Aware Self-Supervision for Generic Event Boundary Detection11 Oct 2022
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondence6 Oct 2022
- 2022Integrative Feature and Cost Aggregation with Transformers for Dense Correspondence19 Sep 2022
- 2022Learning Semantic Correspondence with Sparse Annotations15 Aug 2022
- 2022Multi-layer Representation Learning for Robust OOD Image Classification27 Jul 2022
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentation22 Jul 2022
- 2022Semantic-Aware Fine-Grained Correspondence21 Jul 2022
- 2022Demystifying Unsupervised Semantic Correspondence Estimation11 Jul 2022
- 2022MSANet: Multi-Similarity and Attention Guidance for Boosting Few-Shot Segmentation20 Jun 2022
- 2022TransforMatcher: Match-to-Match Attention for Semantic Correspondence23 May 2022
- 2022Self-Supervised Equivariant Learning for Oriented Keypoint Detection19 Apr 2022
- 2022Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labels30 Mar 2022
- 2022Integrative Few-Shot Learning for Classification and Segmentation29 Mar 2022
- 2022Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondences8 Mar 2022
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformers14 Feb 2022
- 2021Cost Aggregation Is All You Need for Few-Shot Segmentation22 Dec 2021
- 2021GAN-Supervised Dense Visual Alignment9 Dec 2021
- 2021Input-level Inductive Biases for 3D Reconstruction6 Dec 2021
- 2021Understanding Pixel-level 2D Image Semantics with 3D Keypoint Knowledge Engine21 Nov 2021
- 2021HoughCL: Finding Better Positive Pairs in Dense Self-supervised Learning21 Nov 2021
- 2021Learning Contrastive Representation for Semantic Correspondence22 Sep 2021
- 2021Convolutional Hough Matching Networks for Robust and Efficient Visual Correspondence11 Sep 2021
- 2021Reconstructing and grounding narrated instructional videos in 3D9 Sep 2021
- 2021Deep Hough Voting for Robust Global Registration9 Sep 2021
50 newest of 56 All 56 (JSON)
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2021GAN-Supervised Dense Visual Alignmentcited by 61
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2021Deep Hough Voting for Robust Global Registrationcited by 53
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2021Convolutional Hough Matching Networkscited by 43
- 2021Multi-scale Matching Networks for Semantic Correspondencecited by 32
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondencecited by 32
- 2021Input-level Inductive Biases for 3D Reconstructioncited by 31
12 most cited of 53 All 53 (JSON)
- 2026AlignMorph: Tuning-Free Diffusion Image Morphing via Explicit Semantic Transport21 Sep 2026
- 2025Generating Part-Based Global Explanations Via Correspondence18 Sep 2025
- 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglement2 Sep 2025
- 2025RIPE: Reinforcement Learning on Unlabeled Image Pairs for Robust Keypoint Extraction7 Jul 2025
- 2025Semantic Correspondence: Unified Benchmarking and a Strong Baseline23 May 2025
- 2025Learning 3D Scene Analogies with Neural Contextual Scene Maps20 Mar 2025
- 2025Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentation16 Jan 2025
- 2024SAMIC: Segment Anything with In-Context Spatial Prompt Engineering16 Dec 2024
- 2024Independently Keypoint Learning for Small Object Semantic Correspondence3 Apr 2024
- 2024Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondence17 Mar 2024
- 2024Matching Semantically Similar Non-Identical Objects13 Mar 2024
- 2024Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attention18 Jan 2024
12 newest of 53 All 53 (JSON)