TokenMatch: 3D Mesh Correspondence Transformer with Curvature-Guided Tokenisation
Not on the map. Why?
Abstract (arXiv)
While data-driven 3D shape correspondence estimation has recently seen substantial progress, robust matching under partial observations and strong non-isometric deformations remains challenging. Existing learning-based approaches often rely on hand-crafted descriptors or template-based representations, whereas recent generative models over functional maps suffer from high inference cost, limited interpretability, and poor generalisation to partial shapes. In response to these limitations, this paper introduces TokenMatch, a new transformer-based unified model for estimating 3D shape correspondences. Our feed-forward approach trained exclusively on BeCoS, a challenging non-isometric partial-to-partial shape-matching dataset, can generalise to matching full shapes without retraining or fine-tuning. TokenMatch uses self- and cross-attention mechanisms to efficiently learn patch-level and point-level relations as well as dense correspondences between shape pairs. Our core insight is that meshes can be adaptively tokenised into patches using shape curvature guidance, enabling effective learning of shape-specific geometric descriptors for correspondence estimation. We evaluate TokenMatch on standard benchmarks for partial and full shape matching, including CP2P, PSMAL, BeCoS, FAUST, SCAPE, and SHREC'19. Our method achieves consistently high performance, in most cases outperforming existing methods for partial and full shape matching in the mean geodesic error and intersection-over-union metrics, while also running faster at sub-second inference speeds.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 76 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
52 of 76 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2017Learning from Synthetic Humanscited by 359
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 164
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 2017Deep Functional Maps: Structured Prediction for Dense Shape Correspondencecited by 134
- 2023State of the Art on Diffusion Models for Visual Computingcited by 127
38 more
- 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generationcited by 83
- 2018Unsupervised Deep Learning for Structured Shape Matchingcited by 81
- 2019Smooth Shells: Multi-Scale Shape Registration with Functional Mapscited by 72
- 2015Partial Functional Correspondencecited by 61
- 2021Subdivision-Based Mesh Convolution Networkscited by 60
- 2022A Survey of Non-Rigid 3D Registrationcited by 59
- 2021DPFM: Deep Partial Functional Mapscited by 58
- 2023Unsupervised Learning of Robust Spectral Shape Matchingcited by 57
- 2021Shape registration in the time of transformerscited by 51
- 2022Smooth Non-Rigid Shape Matching via Effective Dirichlet Energy Optimizationcited by 37
- 2022Deep Orientation-Aware Functional Maps: Tackling Symmetry Issues in Shape Matchingcited by 36
- 2022Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape Matchingcited by 35
- 2022MeshMAE: Masked Autoencoders for 3D Mesh Data Analysiscited by 31
- 2023Spatially and Spectrally Consistent Deep Functional Mapscited by 30
- 2021Q-Match: Iterative Shape Matching via Quantum Annealingcited by 27
- 2020Structured Regularization of Functional Map Computationscited by 26
- 2024Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolationcited by 26
- 2023Self-Supervised Learning for Multimodal Non-Rigid 3D Shape Matchingcited by 23
- 2023NICP: Neural ICP for 3D Human Registration at Scalecited by 21
- 2022A Scalable Combinatorial Solver for Elastic Geometrically Consistent 3D Shape Matchingcited by 19
- 2023Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matchingcited by 18
- 2024Partial-to-Partial Shape Matching with Geometric Consistencycited by 16
- 2024Memory-Scalable and Simplified Functional Map Learningcited by 14
- 2025Denoising Functional Maps: Diffusion Models for Shape Correspondencecited by 14
- 2023Self-supervised Pre-training with Masked Shape Prediction for 3D Scene Understandingcited by 13
- 2023Geometrically Consistent Partial Shape Matchingcited by 13
- 2023On Unsupervised Partial Shape Correspondencecited by 11
- 2024Deformation Recovery: Localized Learning for Detail-Preserving Deformationscited by 11
- 2024Beyond Complete Shapes: A Benchmark for Quantitative Evaluation of 3D Shape Surface Matching Algorithmscited by 11
- 2015Point-wise Map Recovery and Refinement from Functional Correspondencecited by 10
- 2022Overlap-guided Gaussian Mixture Models for Point Cloud Registrationcited by 10
- 2025DiffuMatch: Category-Agnostic Spectral Diffusion Priors for Robust Non-rigid Shape Matchingcited by 10
- 2019DispVoxNets: Non-Rigid Point Set Alignment with Supervised Learning Proxiescited by 8
- 2020Weakly Supervised Deep Functional Map for Shape Matchingcited by 8
- 2025FRIDU: Functional Map Refinement with Guided Image Diffusioncited by 4
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunitiescited by 4
- 2024Curvature Informed Furthest Point Samplingcited by 1
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.