GECO: Geometrically Consistent Embedding with Lightspeed Inference
Not on the map. Why?
Abstract (arXiv)
Recent advances in feature learning have shown that self-supervised vision foundation models can capture semantic correspondences but often lack awareness of underlying 3D geometry. GECO addresses this gap by producing geometrically coherent features that semantically distinguish parts based on geometry (e.g., left/right eyes, front/back legs). We propose a training framework based on optimal transport, enabling supervision beyond keypoints, even under occlusions and disocclusions. With a lightweight architecture, GECO runs at 30 fps, 98.2% faster than prior methods, while achieving state-of-the-art performance on PFPascal, APK, and CUB, improving PCK by 6.0%, 6.2%, and 4.1%, respectively. Finally, we show that PCK alone is insufficient to capture geometric quality and introduce new metrics and insights for more geometry-aware feature learning. Link to project page: https://reginehartwig.github.io/publications/geco/
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 54 of its 69 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
54 of 69 references.
References · 54
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
38 more
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2023Emergent Correspondence from Image Diffusioncited by 446
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2021Deep ViT Features as Dense Visual Descriptorscited by 330
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2014Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Partscited by 232
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 214
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 177
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 152
- 2019SPair-71k: A Large-scale Benchmark for Semantic Correspondencecited by 146
- 2023Unsupervised Semantic Correspondence Using Stable Diffusioncited by 120
- 2023Telling Left from Right: Identifying Geometry-Aware Semantic Correspondencecited by 86
- 2024Improving 2D Feature Representations by 3D-Aware Fine-Tuningcited by 71
- 2021Unsupervised Part Discovery from Contrastive Reconstructioncited by 57
- 2022Zero-Shot Category-Level Object Pose Estimationcited by 57
- 2024Diffusion Models and Representation Learning: A Surveycited by 54
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
- 2017Proposal Flow: Semantic Correspondences from Object Proposalscited by 47
- 2024CleanDIFT: Diffusion Features without Noisecited by 44
- 2023Improving Semantic Correspondence with Viewpoint-Guided Spherical Mapscited by 34
- 2022Learning Semantic Correspondence with Sparse Annotationscited by 31
- 2022Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondencescited by 30
- 2023ASIC: Aligning Sparse in-the-wild Image Collectionscited by 27
- 2024Feat2GS: Probing Visual Foundation Models with Gaussian Splattingcited by 27
- 2022Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistencycited by 26
- 20233DiffTection: 3D Object Detection with Geometry-Aware Diffusion Featurescited by 26
- 2024Doppelgangers++: Improved Visual Disambiguation with Geometric 3D Featurescited by 20
- 2024Distillation of Diffusion Features for Semantic Correspondencecited by 17
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026MARCO: Navigating the Unseen Space of Semantic Correspondencecited by 3
- 2026Shape-of-You: Fused Gromov-Wasserstein Optimal Transport for Semantic Correspondence in-the-Wildcited by 1
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondencecited by 1
- 2026Quantum-Inspired Harmonic Decision Models: A Computational Framework for Music Generationcited by 1
- 2026Ordered Diffusion for 3D Human Registrationcited by 1
- 2026ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decodingcited by 0
- 2026ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding24 Sep 2026
- 2026Ordered Diffusion for 3D Human Registration6 Aug 2026
- 2026Quantum-Inspired Harmonic Decision Models: A Computational Framework for Music Generation6 Jul 2026
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence28 May 2026
- 2026MARCO: Navigating the Unseen Space of Semantic Correspondence20 Apr 2026
- 2026Shape-of-You: Fused Gromov-Wasserstein Optimal Transport for Semantic Correspondence in-the-Wild12 Mar 2026