GLASS: Graph and Vision-Language Assisted Semantic Shape Correspondence
Not on the map. Why?
Abstract (arXiv)
Establishing dense correspondence across 3D shapes is crucial for fundamental downstream tasks, including texture transfer, shape interpolation, and robotic manipulation. However, learning these mappings without manual supervision remains a formidable challenge, particularly under severe non-isometric deformations and in inter-class settings where geometric cues are ambiguous. Conventional functional map methods, while elegant, typically struggle in these regimes due to their reliance on isometry. To address this, we present GLASS, a framework that bridges the gap by integrating geometric spectral analysis with rich semantic priors from vision-language foundation models. GLASS introduces three key innovations: (i) a view-consistent strategy that enables robust multi-view visual feature extraction from powerful vision foundation models; (ii) the injection of language embeddings into vertex descriptors via zero-shot 3D segmentation, capturing high-level part semantics; and (iii) a graph-assisted contrastive loss that enforces structural consistency between regions (e.g., source's head'' leftrightarrow target's head'') by leveraging geodesic and topological relationships between regions. This design allows GLASS to learn globally coherent and semantically consistent maps without ground-truth supervision. Extensive experiments demonstrate that GLASS achieves state-of-the-art performance across all regimes, maintaining high accuracy on standard near-isometric tasks while significantly advancing performance in challenging settings. Specifically, it achieves average geodesic errors of 0.21, 4.5, and 5.6 on the inter-class benchmark SNIS and non-isometric benchmarks SMAL and TOPKIDS, reducing errors from URSSM baselines of 0.49, 6.0, and 8.9 by 57%, 25%, and 37%, respectively.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 8 Mar 2026.
Builds on
38 of 52 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2025DINOv3cited by 1,297
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
26 more
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 2017Deep Functional Maps: Structured Prediction for Dense Shape Correspondencecited by 134
- 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 114
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2018Unsupervised Deep Learning for Structured Shape Matchingcited by 81
- 2021NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Gocited by 81
- 2018Continuous and Orientation-preserving Correspondences via Functional Mapscited by 77
- 2020Deep Shells: Unsupervised Shape Correspondence with Optimal Transportcited by 74
- 2019Smooth Shells: Multi-Scale Shape Registration with Functional Mapscited by 72
- 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
- 2023Unsupervised Learning of Robust Spectral Shape Matchingcited by 57
- 2023Diffusion 3D Features (Diff3F): Decorating Untextured Shapes with Distilled Semantic Featurescited by 55
- 2022Unsupervised Deep Multi-Shape Matchingcited by 39
- 2022Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape Matchingcited by 35
- 2024DenseMatcher: Learning 3D Semantic Correspondence for Category-Level Manipulation from a Single Democited by 34
- 2023Zero-Shot 3D Shape Correspondencecited by 33
- 2023Spatially and Spectrally Consistent Deep Functional Mapscited by 30
- 2023Unsupervised Deep Probabilistic Approach for Partial Point Cloud Registrationcited by 26
- 2023Self-Supervised Learning for Multimodal Non-Rigid 3D Shape Matchingcited by 23
- 2023Back to 3D: Few-Shot 3D Keypoint Detection with Back-Projected 2D Featurescited by 17
- 2025Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondencecited by 16
- 2024Memory-Scalable and Simplified Functional Map Learningcited by 14
- 2023Geometrically-driven Aggregation for Zero-shot 3D Point Cloud Understandingcited by 13
- 2025Rethinking Graph Contrastive Learning through Relative Similarity Preservationcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SGMatch: Semantic-Guided Non-Rigid Shape Matching with Flow Regularization
- 2026Universal 3D Shape Matching via Coarse-to-Fine Language Guidance
- 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
- 2026Uncovering and Shaping the Latent Representation of 3D Scene Topology in Vision-Language Models
- 2026BareBones: Benchmarking Zero-Shot Geometric Comprehension in VLMs
- 2022Semantic Abstraction: Open-World 3D Scene Understanding from 2D Vision-Language Models
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence
- 2026Cog3DMap: Multi-View Vision-Language Reasoning with 3D Cognitive Maps