# Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolation

arXiv: https://arxiv.org/abs/2402.18920 · HTML: https://mlsanity.com/paper/2402.18920/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- Builds on 46 of its 93 references that are in the map.
- First posted on arXiv 29 Feb 2024.

## Builds on (most cited first, 30 of 46)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Dynamic Graph CNN for Learning on Point Clouds](https://mlsanity.com/paper/1801.07829/) (2018)
- [3D Menagerie: Modeling the 3D shape and pose of animals](https://mlsanity.com/paper/1611.07700/) (2016)
- [3D Morphable Face Models -- Past, Present and Future](https://mlsanity.com/paper/1909.01815/) (2019)
- [Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge](https://mlsanity.com/paper/1612.08012/) (2016)
- [Embodied Hands: Modeling and Capturing Hands and Bodies Together](https://mlsanity.com/paper/2201.02610/) (2022)
- [DiffusionNet: Discretization Agnostic Learning on Surfaces](https://mlsanity.com/paper/2012.00888/) (2020)
- [3D-CODED : 3D Correspondences by Deep Deformation](https://mlsanity.com/paper/1806.05228/) (2018)
- [Deep Functional Maps: Structured Prediction for Dense Shape Correspondence](https://mlsanity.com/paper/1704.08686/) (2017)
- [Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondence](https://mlsanity.com/paper/2003.14286/) (2020)
- [4DComplete: Non-Rigid Motion Estimation Beyond the Observable Surface](https://mlsanity.com/paper/2105.01905/) (2021)
- [Unsupervised Deep Learning for Structured Shape Matching](https://mlsanity.com/paper/1812.03794/) (2018)
- [NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go](https://mlsanity.com/paper/2106.09431/) (2021)
- [Continuous and Orientation-preserving Correspondences via Functional Maps](https://mlsanity.com/paper/1806.04455/) (2018)
- [Deep Shells: Unsupervised Shape Correspondence with Optimal Transport](https://mlsanity.com/paper/2010.15261/) (2020)
- [Smooth Shells: Multi-Scale Shape Registration with Functional Maps](https://mlsanity.com/paper/1905.12512/) (2019)
- [Partial Functional Correspondence](https://mlsanity.com/paper/1506.05274/) (2015)
- [Unsupervised Shape and Pose Disentanglement for 3D Meshes](https://mlsanity.com/paper/2007.11341/) (2020)
- [A Survey of Non-Rigid 3D Registration](https://mlsanity.com/paper/2203.07858/) (2022)
- [DPFM: Deep Partial Functional Maps](https://mlsanity.com/paper/2110.09994/) (2021)
- [Unsupervised Learning of Robust Spectral Shape Matching](https://mlsanity.com/paper/2304.14419/) (2023)
- [LIMP: Learning Latent Shape Representations with Metric Preservation Priors](https://mlsanity.com/paper/2003.12283/) (2020)
- [Shape registration in the time of transformers](https://mlsanity.com/paper/2106.13679/) (2021)
- [CorrNet3D: Unsupervised End-to-end Learning of Dense Correspondence for 3D Point Clouds](https://mlsanity.com/paper/2012.15638/) (2020)
- [Unsupervised Deep Multi-Shape Matching](https://mlsanity.com/paper/2207.09610/) (2022)
- [Smooth Non-Rigid Shape Matching via Effective Dirichlet Energy Optimization](https://mlsanity.com/paper/2210.02870/) (2022)
- [Deep Orientation-Aware Functional Maps: Tackling Symmetry Issues in Shape Matching](https://mlsanity.com/paper/2204.13453/) (2022)
- [Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape Matching](https://mlsanity.com/paper/2210.06373/) (2022)
- [Product Manifold Filter: Non-Rigid Shape Correspondence via Kernel Density Estimation in the Product Space](https://mlsanity.com/paper/1701.00669/) (2017)
- [ZoomOut: Spectral Upsampling for Efficient Shape Correspondence](https://mlsanity.com/paper/1904.07865/) (2019)

## Built on by (most cited first, 26 of 26)

- [Denoising Functional Maps: Diffusion Models for Shape Correspondence](https://mlsanity.com/paper/2503.01845/) (2025)
- [Beyond Complete Shapes: A Benchmark for Quantitative Evaluation of 3D Shape Surface Matching Algorithms](https://mlsanity.com/paper/2411.03511/) (2024)
- [DiffuMatch: Category-Agnostic Spectral Diffusion Priors for Robust Non-rigid Shape Matching](https://mlsanity.com/paper/2507.23715/) (2025)
- [CanFields: Consolidating Diffeomorphic Flows for Non-Rigid 4D Interpolation from Arbitrary-Length Sequences](https://mlsanity.com/paper/2406.18582/) (2024)
- [Synchronous Diffusion for Unsupervised Smooth Non-Rigid 3D Shape Matching](https://mlsanity.com/paper/2407.08244/) (2024)
- [4Deform: Neural Surface Deformation for Robust Shape Interpolation](https://mlsanity.com/paper/2502.20208/) (2025)
- [Stable-SCore: A Stable Registration-based Framework for 3D Shape Correspondence](https://mlsanity.com/paper/2503.21766/) (2025)
- [Dynamic Neural Surfaces for Elastic 4D Shape Representation and Analysis](https://mlsanity.com/paper/2503.03132/) (2025)
- [FUSE: A Flow-based Mapping Between Shapes](https://mlsanity.com/paper/2511.13431/) (2025)
- [FOLIAGE: Towards Physical Intelligence World Models Via Unbounded Surface Evolution](https://mlsanity.com/paper/2506.03173/) (2025)
- [LiteGE: Lightweight Geodesic Embedding for Efficient Geodesics Computation and Non-Isometric Shape Correspondence](https://mlsanity.com/paper/2512.17781/) (2025)
- [SGMatch: Semantic-Guided Non-Rigid Shape Matching with Flow Regularization](https://mlsanity.com/paper/2603.12937/) (2026)
- [RINO: Rotation-Invariant Non-Rigid Correspondences](https://mlsanity.com/paper/2603.27773/) (2026)
- [PaNDaS: Learnable Deformation Modeling with Localized Control](https://mlsanity.com/paper/2412.02306/) (2024)
- [ARC-Flow : Articulated, Resolution-Agnostic, Correspondence-Free Matching and Interpolation of 3D Shapes Under Flow Fields](https://mlsanity.com/paper/2503.02606/) (2025)
- [ScanMove: Motion Prediction and Transfer for Unregistered Body Meshes](https://mlsanity.com/paper/2508.21095/) (2025)
- [SemMorph3D: Unsupervised Semantic-Aware 3D Morphing via Mesh-Guided Gaussians](https://mlsanity.com/paper/2510.02034/) (2025)
- [Universal 3D Shape Matching via Coarse-to-Fine Language Guidance](https://mlsanity.com/paper/2602.19112/) (2026)
- [DeepShapeMatchingKit: Accelerated Functional Map Solver and Shape Matching Pipelines Revisited](https://mlsanity.com/paper/2604.10377/) (2026)
- [SGSoft: Learning Fused Semantic-Geometric Features for 3D Shape Correspondence via Template-Guided Soft Signals](https://mlsanity.com/paper/2605.18039/) (2026)
- [From Extrinsic to Intrinsic: Geodesic-Guided Representation Learning for 3D Geometric Data](https://mlsanity.com/paper/2606.02268/) (2026)
- [MeshLoom: Feed-Forward Non-Rigid Registration of Mesh Sequences](https://mlsanity.com/paper/2606.17027/) (2026)
- [Matching Shapes Under Different Topologies: A Topology-Adaptive Deformation Guided Approach](https://mlsanity.com/paper/2509.06862/) (2025)
- [Geometry-Grounded Articulation and Test-Time Adaptation for Zero-Shot, Scalable Shape Matching in the Wild](https://mlsanity.com/paper/2606.29167/) (2026)
- [TokenMatch: 3D Mesh Correspondence Transformer with Curvature-Guided Tokenisation](https://mlsanity.com/paper/2609.04202/) (2026)
- [NeuralSRNF: Neural Square Root Normal Fields for the Statistical Shape Analysis and Generation of Nonrigid 3D and 4D Objects](https://mlsanity.com/paper/2609.27728/) (2026)

## Abstract (arXiv)

Although 3D shape matching and interpolation are highly interrelated, they are often studied separately and applied sequentially to relate different 3D shapes, thus resulting in sub-optimal performance. In this work we present a unified framework to predict both point-wise correspondences and shape interpolation between 3D shapes. To this end, we combine the deep functional map framework with classical surface deformation models to map shapes in both spectral and spatial domains. On the one hand, by incorporating spatial maps, our method obtains more accurate and smooth point-wise correspondences compared to previous functional map methods for shape matching. On the other hand, by introducing spectral maps, our method gets rid of commonly used but computationally expensive geodesic distance constraints that are only valid for near-isometric shape deformations. Furthermore, we propose a novel test-time adaptation scheme to capture both pose-dominant and shape-dominant deformations. Using different challenging datasets, we demonstrate that our method outperforms previous state-of-the-art methods for both shape matching and interpolation, even compared to supervised approaches.