Unsupervised Learning of Robust Spectral Shape Matching
Not on the map. Why?
Abstract (arXiv)
We propose a novel learning-based approach for robust 3D shape matching. Our method builds upon deep functional maps and can be trained in a fully unsupervised manner. Previous deep functional map methods mainly focus on predicting optimised functional maps alone, and then rely on off-the-shelf post-processing to obtain accurate point-wise maps during inference. However, this two-stage procedure for obtaining point-wise maps often yields sub-optimal performance. In contrast, building upon recent insights about the relation between functional maps and point-wise maps, we propose a novel unsupervised loss to couple the functional maps and point-wise maps, and thereby directly obtain point-wise maps without any post-processing. Our approach obtains accurate correspondences not only for near-isometric shapes, but also for more challenging non-isometric shapes and partial shapes, as well as shapes with different discretisation or topological noise. Using a total of nine diverse datasets, we extensively evaluate the performance and demonstrate that our method substantially outperforms previous state-of-the-art methods, even compared to recent supervised methods. Our code is available at https://github.com/dongliangcao/Unsupervised-Learning-of-Robust-Spectral-Shape-Matching.
Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). Builds on 38 of its 83 references that are in the map. First posted on arXiv 27 Apr 2023.
Builds on
38 of 83 references.
References · 38
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2017Learning from Synthetic Humanscited by 359
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 20193D Morphable Face Models -- Past, Present and Futurecited by 270
- 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 164
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 2017Deep Functional Maps: Structured Prediction for Dense Shape Correspondencecited by 134
- 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 124
26 more
- 2018Unsupervised Deep Learning for Structured Shape Matchingcited by 81
- 2021NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Gocited by 81
- 2018Continuous and Orientation-preserving Correspondences via Functional Mapscited by 77
- 2020Deep Shells: Unsupervised Shape Correspondence with Optimal Transportcited by 74
- 2019Smooth Shells: Multi-Scale Shape Registration with Functional Mapscited by 72
- 2015Partial Functional Correspondencecited by 61
- 2021DPFM: Deep Partial Functional Mapscited by 58
- 2021Shape registration in the time of transformerscited by 51
- 2020Correspondence Learning via Linearly-invariant Embeddingcited by 48
- 2020CNNs on Surfaces using Rotation-Equivariant Featurescited by 43
- 2022Unsupervised Deep Multi-Shape Matchingcited by 39
- 2022Smooth Non-Rigid Shape Matching via Effective Dirichlet Energy Optimizationcited by 37
- 2022Deep Orientation-Aware Functional Maps: Tackling Symmetry Issues in Shape Matchingcited by 36
- 2022Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape Matchingcited by 35
- 2020Isometric Multi-Shape Matchingcited by 33
- 2017Product Manifold Filter: Non-Rigid Shape Correspondence via Kernel Density Estimation in the Product Spacecited by 30
- 2019ZoomOut: Spectral Upsampling for Efficient Shape Correspondencecited by 30
- 2020Structured Regularization of Functional Map Computationscited by 26
- 2018Higher-order Projected Power Iterations for Scalable Multi-Matchingcited by 24
- 2020MINA: Convex Mixed-Integer Programming for Non-Rigid Shape Alignmentcited by 20
- 2018Reversible Harmonic Maps between Discrete Surfacescited by 19
- 2022A Scalable Combinatorial Solver for Elastic Geometrically Consistent 3D Shape Matchingcited by 19
- 2023NCP: Neural Correspondence Prior for Effective Unsupervised Shape Matchingcited by 18
- 2021Complex Functional Maps : a Conformal Link Between Tangent Bundlescited by 17
- 2020MapTree: Recovering Multiple Solutions in the Space of Mapscited by 11
- 2015Point-wise Map Recovery and Refinement from Functional Correspondencecited by 10
Built on by
Citing papers per year: 2023: 7; 2024: 14; 2025: 17; 2026: 19.
57 papers.
Sort:
By area:
- 2023Zero-Shot 3D Shape Correspondencecited by 33
- 2024Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolationcited by 26
- 2023Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matchingcited by 18
- 2024Partial-to-Partial Shape Matching with Geometric Consistencycited by 16
- 2024Memory-Scalable and Simplified Functional Map Learningcited by 14
- 2025Denoising Functional Maps: Diffusion Models for Shape Correspondencecited by 14
- 2023Geometrically Consistent Partial Shape Matchingcited by 13
- 2024Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learningcited by 12
- 2024Wormhole Loss for Partial Shape Matchingcited by 12
- 2023On Unsupervised Partial Shape Correspondencecited by 11
- 2024Beyond Complete Shapes: A Benchmark for Quantitative Evaluation of 3D Shape Surface Matching Algorithmscited by 11
- 2024Finsler-Laplace-Beltrami Operators with Application to Shape Analysiscited by 10
38 more
- 2025DiffuMatch: Category-Agnostic Spectral Diffusion Priors for Robust Non-rigid Shape Matchingcited by 10
- 2023Revisiting Map Relations for Unsupervised Non-Rigid Shape Matchingcited by 8
- 2023DiscoMatch: Fast Discrete Optimisation for Geometrically Consistent 3D Shape Matchingcited by 7
- 2024Shape Non-rigid Kinematics (SNK): A Zero-Shot Method for Non-Rigid Shape Matching via Unsupervised Functional Map Regularized Reconstructioncited by 7
- 2024CanFields: Consolidating Diffeomorphic Flows for Non-Rigid 4D Interpolation from Arbitrary-Length Sequencescited by 7
- 2024Synchronous Diffusion for Unsupervised Smooth Non-Rigid 3D Shape Matchingcited by 7
- 20254Deform: Neural Surface Deformation for Robust Shape Interpolationcited by 7
- 2025Stable-SCore: A Stable Registration-based Framework for 3D Shape Correspondencecited by 7
- 2025Fast Globally Optimal and Geometrically Consistent 3D Shape Matchingcited by 4
- 2025FRIDU: Functional Map Refinement with Guided Image Diffusioncited by 4
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunitiescited by 4
- 2025FUSE: A Flow-based Mapping Between Shapescited by 3
- 2023Unsupervised Deep Graph Matching Based on Cycle Consistencycited by 2
- 2025Neural Descriptors: Self-Supervised Learning of Robust Local Surface Descriptors Using Polynomial Patchescited by 2
- 2025LiteGE: Lightweight Geodesic Embedding for Efficient Geodesics Computation and Non-Isometric Shape Correspondencecited by 2
- 2026Symmetry Informative and Agnostic Feature Disentanglement for 3D Shapescited by 2
- 2026SGMatch: Semantic-Guided Non-Rigid Shape Matching with Flow Regularizationcited by 2
- 2026RINO: Rotation-Invariant Non-Rigid Correspondencescited by 2
- 2024SPARE: Symmetrized Point-to-Plane Distance for Robust Non-Rigid 3D Registrationcited by 1
- 2024LBONet: Supervised Spectral Descriptors for Shape Analysiscited by 1
- 2025ARC-Flow : Articulated, Resolution-Agnostic, Correspondence-Free Matching and Interpolation of 3D Shapes Under Flow Fieldscited by 1
- 2025DcMatch: Unsupervised Multi-Shape Matching with Dual-Level Consistencycited by 1
- 2026An Integer Linear Programming Approach to Geometrically Consistent Partial-Partial Shape Matchingcited by 1
- 2026Universal 3D Shape Matching via Coarse-to-Fine Language Guidancecited by 1
- 2026GLASS: Graph and Vision-Language Assisted Semantic Shape Correspondencecited by 1
- 2026DeepShapeMatchingKit: Accelerated Functional Map Solver and Shape Matching Pipelines Revisitedcited by 1
- 2026SGSoft: Learning Fused Semantic-Geometric Features for 3D Shape Correspondence via Template-Guided Soft Signalscited by 1
- 2026From Extrinsic to Intrinsic: Geodesic-Guided Representation Learning for 3D Geometric Datacited by 1
- 2026Hyper-Network Neural Functional Maps for Unsupervised Robust 3D Shape Matchingcited by 1
- 2024Deep Frequency-Aware Functional Maps for Robust Shape Matchingcited by 0
- 2024Deep Learning-Based Quasi-Conformal Surface Registration for Partial 3D Faces Applied to Facial Recognitioncited by 0
- 2025Sinkhorn Normalization of Diffusion Kernelscited by 0
- 2025LUIVITON: Learned Universal Interoperable VIrtual Try-ONcited by 0
- 2025Matching Shapes Under Different Topologies: A Topology-Adaptive Deformation Guided Approachcited by 0
- 2025Densemarks: Learning Canonical Embeddings for Human Heads Images via Point Trackscited by 0
- 2025The Joint Gromov Wasserstein Objective for Multiple Object Matchingcited by 0
- 2025Unified Brain Surface and Volume Registrationcited by 0
- 2026Geometry-Grounded Articulation and Test-Time Adaptation for Zero-Shot, Scalable Shape Matching in the Wildcited by 0
50 most cited of 57 All 57 (JSON)
- 2026NHO: A Neural Hamiltonian Operator for Anchor-based Region Localization and Dense Correspondence29 Sep 2026
- 2026NeuralSRNF: Neural Square Root Normal Fields for the Statistical Shape Analysis and Generation of Nonrigid 3D and 4D Objects23 Sep 2026
- 2026TokenMatch: 3D Mesh Correspondence Transformer with Curvature-Guided Tokenisation3 Sep 2026
- 2026CANIS: Generation-Assisted 3D Canonicalization via an Image-Semantic Bridge7 Aug 2026
- 2026MDND: Unsupervised Learning Guided by Non-Differentiable Refinement for Shape Correspondence17 Jul 2026
- 2026RealSkin: Spatio-Spectral Partial Neural Adjoint Maps for Image-to-3D Attribute Transfer14 Jul 2026
- 2026GenSP: Consistent Spherical Parameterization via Learning Shape Generative Models1 Jul 2026
- 2026Hyper-Network Neural Functional Maps for Unsupervised Robust 3D Shape Matching29 Jun 2026
- 2026Geometry-Grounded Articulation and Test-Time Adaptation for Zero-Shot, Scalable Shape Matching in the Wild28 Jun 2026
- 2026From Extrinsic to Intrinsic: Geodesic-Guided Representation Learning for 3D Geometric Data1 Jun 2026
- 2026SGSoft: Learning Fused Semantic-Geometric Features for 3D Shape Correspondence via Template-Guided Soft Signals18 May 2026
- 2026DeepShapeMatchingKit: Accelerated Functional Map Solver and Shape Matching Pipelines Revisited11 Apr 2026
38 more
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunities1 Apr 2026
- 2026RINO: Rotation-Invariant Non-Rigid Correspondences29 Mar 2026
- 2026SGMatch: Semantic-Guided Non-Rigid Shape Matching with Flow Regularization13 Mar 2026
- 2026GLASS: Graph and Vision-Language Assisted Semantic Shape Correspondence8 Mar 2026
- 2026Universal 3D Shape Matching via Coarse-to-Fine Language Guidance22 Feb 2026
- 2026An Integer Linear Programming Approach to Geometrically Consistent Partial-Partial Shape Matching6 Feb 2026
- 2026Symmetry Informative and Agnostic Feature Disentanglement for 3D Shapes21 Jan 2026
- 2025Unified Brain Surface and Volume Registration22 Dec 2025
- 2025LiteGE: Lightweight Geodesic Embedding for Efficient Geodesics Computation and Non-Isometric Shape Correspondence19 Dec 2025
- 2025The Joint Gromov Wasserstein Objective for Multiple Object Matching21 Nov 2025
- 2025FUSE: A Flow-based Mapping Between Shapes17 Nov 2025
- 2025Densemarks: Learning Canonical Embeddings for Human Heads Images via Point Tracks4 Nov 2025
- 2025Matching Shapes Under Different Topologies: A Topology-Adaptive Deformation Guided Approach8 Sep 2025
- 2025LUIVITON: Learned Universal Interoperable VIrtual Try-ON5 Sep 2025
- 2025DcMatch: Unsupervised Multi-Shape Matching with Dual-Level Consistency1 Sep 2025
- 2025DiffuMatch: Category-Agnostic Spectral Diffusion Priors for Robust Non-rigid Shape Matching31 Jul 2025
- 2025Sinkhorn Normalization of Diffusion Kernels8 Jul 2025
- 2025FRIDU: Functional Map Refinement with Guided Image Diffusion17 Jun 2025
- 2025Fast Globally Optimal and Geometrically Consistent 3D Shape Matching8 Apr 2025
- 2025Stable-SCore: A Stable Registration-based Framework for 3D Shape Correspondence27 Mar 2025
- 2025Neural Descriptors: Self-Supervised Learning of Robust Local Surface Descriptors Using Polynomial Patches5 Mar 2025
- 2025ARC-Flow : Articulated, Resolution-Agnostic, Correspondence-Free Matching and Interpolation of 3D Shapes Under Flow Fields4 Mar 2025
- 2025Denoising Functional Maps: Diffusion Models for Shape Correspondence3 Mar 2025
- 20254Deform: Neural Surface Deformation for Robust Shape Interpolation27 Feb 2025
- 2024LBONet: Supervised Spectral Descriptors for Shape Analysis13 Nov 2024
- 2024Beyond Complete Shapes: A Benchmark for Quantitative Evaluation of 3D Shape Surface Matching Algorithms5 Nov 2024
- 2024Wormhole Loss for Partial Shape Matching30 Oct 2024
- 2024Synchronous Diffusion for Unsupervised Smooth Non-Rigid 3D Shape Matching11 Jul 2024
- 2024CanFields: Consolidating Diffeomorphic Flows for Non-Rigid 4D Interpolation from Arbitrary-Length Sequences5 Jun 2024
- 2024SPARE: Symmetrized Point-to-Plane Distance for Robust Non-Rigid 3D Registration30 May 2024
- 2024Deep Learning-Based Quasi-Conformal Surface Registration for Partial 3D Faces Applied to Facial Recognition16 May 2024
- 2024Partial-to-Partial Shape Matching with Geometric Consistency18 Apr 2024
- 2024Finsler-Laplace-Beltrami Operators with Application to Shape Analysis5 Apr 2024
- 2024Memory-Scalable and Simplified Functional Map Learning30 Mar 2024
- 2024Shape Non-rigid Kinematics (SNK): A Zero-Shot Method for Non-Rigid Shape Matching via Unsupervised Functional Map Regularized Reconstruction11 Mar 2024
- 2024Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learning4 Mar 2024
- 2024Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolation29 Feb 2024
- 2024Deep Frequency-Aware Functional Maps for Robust Shape Matching6 Feb 2024
50 newest of 57 All 57 (JSON)
- 2025Denoising Functional Maps: Diffusion Models for Shape Correspondencecited by 14
- 2025DiffuMatch: Category-Agnostic Spectral Diffusion Priors for Robust Non-rigid Shape Matchingcited by 10
- 2025FRIDU: Functional Map Refinement with Guided Image Diffusioncited by 4
- 2025FUSE: A Flow-based Mapping Between Shapescited by 3
- 2025FUSE: A Flow-based Mapping Between Shapes17 Nov 2025
- 2025DiffuMatch: Category-Agnostic Spectral Diffusion Priors for Robust Non-rigid Shape Matching31 Jul 2025
- 2025FRIDU: Functional Map Refinement with Guided Image Diffusion17 Jun 2025
- 2025Denoising Functional Maps: Diffusion Models for Shape Correspondence3 Mar 2025
- 2023Zero-Shot 3D Shape Correspondencecited by 33
- 2024Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolationcited by 26
- 2023Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matchingcited by 18
- 2024Partial-to-Partial Shape Matching with Geometric Consistencycited by 16
- 2024Memory-Scalable and Simplified Functional Map Learningcited by 14
- 2023Geometrically Consistent Partial Shape Matchingcited by 13
- 2024Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learningcited by 12
- 2024Wormhole Loss for Partial Shape Matchingcited by 12
- 2023On Unsupervised Partial Shape Correspondencecited by 11
- 2024Beyond Complete Shapes: A Benchmark for Quantitative Evaluation of 3D Shape Surface Matching Algorithmscited by 11
- 2024Finsler-Laplace-Beltrami Operators with Application to Shape Analysiscited by 10
- 2023Revisiting Map Relations for Unsupervised Non-Rigid Shape Matchingcited by 8
12 most cited of 52 All 52 (JSON)
- 2026NHO: A Neural Hamiltonian Operator for Anchor-based Region Localization and Dense Correspondence29 Sep 2026
- 2026NeuralSRNF: Neural Square Root Normal Fields for the Statistical Shape Analysis and Generation of Nonrigid 3D and 4D Objects23 Sep 2026
- 2026TokenMatch: 3D Mesh Correspondence Transformer with Curvature-Guided Tokenisation3 Sep 2026
- 2026CANIS: Generation-Assisted 3D Canonicalization via an Image-Semantic Bridge7 Aug 2026
- 2026MDND: Unsupervised Learning Guided by Non-Differentiable Refinement for Shape Correspondence17 Jul 2026
- 2026RealSkin: Spatio-Spectral Partial Neural Adjoint Maps for Image-to-3D Attribute Transfer14 Jul 2026
- 2026GenSP: Consistent Spherical Parameterization via Learning Shape Generative Models1 Jul 2026
- 2026Hyper-Network Neural Functional Maps for Unsupervised Robust 3D Shape Matching29 Jun 2026
- 2026Geometry-Grounded Articulation and Test-Time Adaptation for Zero-Shot, Scalable Shape Matching in the Wild28 Jun 2026
- 2026From Extrinsic to Intrinsic: Geodesic-Guided Representation Learning for 3D Geometric Data1 Jun 2026
- 2026SGSoft: Learning Fused Semantic-Geometric Features for 3D Shape Correspondence via Template-Guided Soft Signals18 May 2026
- 2026DeepShapeMatchingKit: Accelerated Functional Map Solver and Shape Matching Pipelines Revisited11 Apr 2026
12 newest of 52 All 52 (JSON)