mlsanityData to 7 Oct 2026

GLASS: Graph and Vision-Language Assisted Semantic Shape Correspondence

arXiv 2603.07652 ↗First posted 8 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Establishing dense correspondence across 3D shapes is crucial for fundamental downstream tasks, including texture transfer, shape interpolation, and robotic manipulation. However, learning these mappings without manual supervision remains a formidable challenge, particularly under severe non-isometric deformations and in inter-class settings where geometric cues are ambiguous. Conventional functional map methods, while elegant, typically struggle in these regimes due to their reliance on isometry. To address this, we present GLASS, a framework that bridges the gap by integrating geometric spectral analysis with rich semantic priors from vision-language foundation models. GLASS introduces three key innovations: (i) a view-consistent strategy that enables robust multi-view visual feature extraction from powerful vision foundation models; (ii) the injection of language embeddings into vertex descriptors via zero-shot 3D segmentation, capturing high-level part semantics; and (iii) a graph-assisted contrastive loss that enforces structural consistency between regions (e.g., source's head'' leftrightarrow target's head'') by leveraging geodesic and topological relationships between regions. This design allows GLASS to learn globally coherent and semantically consistent maps without ground-truth supervision. Extensive experiments demonstrate that GLASS achieves state-of-the-art performance across all regimes, maintaining high accuracy on standard near-isometric tasks while significantly advancing performance in challenging settings. Specifically, it achieves average geodesic errors of 0.21, 4.5, and 5.6 on the inter-class benchmark SNIS and non-isometric benchmarks SMAL and TOPKIDS, reducing errors from URSSM baselines of 0.49, 6.0, and 8.9 by 57%, 25%, and 37%, respectively.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 8 Mar 2026.

Builds on

38 of 52 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  7. 2025DINOv3cited by 1,297
  8. 2021Grounded Language-Image Pre-trainingcited by 1,147
  9. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  10. 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
  11. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
  12. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
26 more
  1. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
  2. 2017Deep Functional Maps: Structured Prediction for Dense Shape Correspondencecited by 134
  3. 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
  4. 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
  5. 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 114
  6. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  7. 2018Unsupervised Deep Learning for Structured Shape Matchingcited by 81
  8. 2021NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Gocited by 81
  9. 2018Continuous and Orientation-preserving Correspondences via Functional Mapscited by 77
  10. 2020Deep Shells: Unsupervised Shape Correspondence with Optimal Transportcited by 74
  11. 2019Smooth Shells: Multi-Scale Shape Registration with Functional Mapscited by 72
  12. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  13. 2023Unsupervised Learning of Robust Spectral Shape Matchingcited by 57
  14. 2023Diffusion 3D Features (Diff3F): Decorating Untextured Shapes with Distilled Semantic Featurescited by 55
  15. 2022Unsupervised Deep Multi-Shape Matchingcited by 39
  16. 2022Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape Matchingcited by 35
  17. 2024DenseMatcher: Learning 3D Semantic Correspondence for Category-Level Manipulation from a Single Democited by 34
  18. 2023Zero-Shot 3D Shape Correspondencecited by 33
  19. 2023Spatially and Spectrally Consistent Deep Functional Mapscited by 30
  20. 2023Unsupervised Deep Probabilistic Approach for Partial Point Cloud Registrationcited by 26
  21. 2023Self-Supervised Learning for Multimodal Non-Rigid 3D Shape Matchingcited by 23
  22. 2023Back to 3D: Few-Shot 3D Keypoint Detection with Back-Projected 2D Featurescited by 17
  23. 2025Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondencecited by 16
  24. 2024Memory-Scalable and Simplified Functional Map Learningcited by 14
  25. 2023Geometrically-driven Aggregation for Zero-shot 3D Point Cloud Understandingcited by 13
  26. 2025Rethinking Graph Contrastive Learning through Relative Similarity Preservationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026SGMatch: Semantic-Guided Non-Rigid Shape Matching with Flow Regularization
  2. 2026Universal 3D Shape Matching via Coarse-to-Fine Language Guidance
  3. 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
  4. 2026Uncovering and Shaping the Latent Representation of 3D Scene Topology in Vision-Language Models
  5. 2026BareBones: Benchmarking Zero-Shot Geometric Comprehension in VLMs
  6. 2022Semantic Abstraction: Open-World 3D Scene Understanding from 2D Vision-Language Models
  7. 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence
  8. 2026Cog3DMap: Multi-View Vision-Language Reasoning with 3D Cognitive Maps