Lepard: Learning partial point cloud matching in rigid and deformable scenes
Not on the map. Why?
Abstract (arXiv)
We present Lepard, a Learning based approach for partial point cloud matching in rigid and deformable scenes. The key characteristics are the following techniques that exploit 3D positional knowledge for point cloud matching: 1) An architecture that disentangles point cloud representation into feature space and 3D position space. 2) A position encoding method that explicitly reveals 3D relative distance information through the dot product of vectors. 3) A repositioning technique that modifies the crosspoint-cloud relative positions. Ablation studies demonstrate the effectiveness of the above techniques. In rigid cases, Lepard combined with RANSAC and ICP demonstrates state-of-the-art registration recall of 93.9% / 71.3% on the 3DMatch / 3DLoMatch. In deformable cases, Lepard achieves +27.1% / +34.8% higher non-rigid feature matching recall than the prior art on our newly constructed 4DMatch / 4DLoMatch benchmark.
Key facts. Cited by 85 papers in the map (data through 14 Oct 2026). Builds on 50 of its 86 references that are in the map. First posted on arXiv 24 Nov 2021.
Builds on
50 of 86 references.
References · 50
- 2017Attention Is All You Needcited by 60,361
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 336
- 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 321
- 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 290
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
38 more
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 242
- 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 233
- 2020Deep Global Registrationcited by 229
- 2020RPM-Net: Robust Point Matching using Learned Featurescited by 182
- 2018PPFNet: Global Context Aware Local Features for Robust 3D Point Matchingcited by 181
- 2020D3Feat: Joint Learning of Dense Detection and Description of 3D Local Featurescited by 177
- 2018Neighbourhood Consensus Networkscited by 174
- 2018The Perfect Match: 3D Point Cloud Matching with Smoothed Densitiescited by 169
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 2016Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registrationcited by 159
- 2021CoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registrationcited by 152
- 2019PRNet: Self-Supervised Learning for Partial-to-Partial Registrationcited by 146
- 2020SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registrationcited by 142
- 2021PointDSC: Robust Point Cloud Registration using Deep Spatial Consistencycited by 142
- 2018PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptorscited by 141
- 2020FLOT: Scene Flow on Point Clouds Guided by Optimal Transportcited by 129
- 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 124
- 20193DRegNet: A Deep Neural Network for 3D Point Registrationcited by 96
- 2021Neural Scene Flow Priorcited by 91
- 2019DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Datacited by 77
- 2016VolumeDeform: Real-time Volumetric Non-rigid Reconstructioncited by 75
- 2021You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptorscited by 68
- 2021Weakly Supervised Learning of Rigid 3D Scene Flowcited by 60
- 2021DPFM: Deep Partial Functional Mapscited by 58
- 2021OMNet: Learning Overlapping Mask for Partial-to-Partial Point Cloud Registrationcited by 51
- 2020Neural Non-Rigid Trackingcited by 49
- 2020End-to-End Learning Local Multi-view Descriptors for 3D Point Cloudscited by 47
- 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
- 2017Learning Compact Geometric Featurescited by 45
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2019PointPWC-Net: A Coarse-to-Fine Network for Supervised and Self-Supervised Scene Flow Estimation on 3D Point Cloudscited by 38
- 2019SurfelWarp: Efficient Non-Volumetric Single View Dynamic Reconstructioncited by 31
- 2021Bootstrap Your Own Correspondencescited by 27
- 2021Self-supervised Geometric Perceptioncited by 26
- 2020Non-Rigid Puzzlescited by 18
- 2020Learning to Optimize Non-Rigid Trackingcited by 16
- 2020SplitFusion: Simultaneous Tracking and Mapping for Non-Rigid Scenescited by 4
Built on by
Citing papers per year: 2022: 6; 2023: 23; 2024: 30; 2025: 16; 2026: 10.
85 papers.
Sort:
By area:
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
- 2024Pixtral 12Bcited by 179
- 20233D Registration with Maximal Cliquescited by 84
- 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 84
- 2023Rotation-Invariant Transformer for Point Cloud Matchingcited by 69
- 2022Non-rigid Point Cloud Registration with Neural Deformation Pyramidcited by 42
- 2023Dynamic Point Fieldscited by 37
- 2023Robust Outlier Rejection for 3D Registration with Variational Bayescited by 31
- 2024MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Imagescited by 28
- 2022RIGA: Rotation-Invariant and Globally-Aware Descriptors for Point Cloud Registrationcited by 25
- 20233D Implicit Transporter for Temporally Consistent Keypoint Discoverycited by 20
- 2023Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweightingcited by 19
38 more
- 2024One-Shot Imitation Learning with Invariance Matching for Robotic Manipulationcited by 18
- 2023Deep Graph-based Spatial Consistency for Robust Non-rigid Point Cloud Registrationcited by 15
- 2024Extend Your Own Correspondences: Unsupervised Distant Point Cloud Registration by Progressive Distance Extensioncited by 15
- 2022Fast and Robust Non-Rigid Registration Using Accelerated Majorization-Minimizationcited by 12
- 2022Learning Feature Descriptors for Pre- and Intra-operative Point Cloud Matching for Laparoscopic Liver Registrationcited by 12
- 2023Density-invariant Features for Distant Point Cloud Registrationcited by 12
- 2023Non-Rigid Shape Registration via Deep Functional Maps Priorcited by 12
- 2024SPAFormer: Sequential 3D Part Assembly with Transformerscited by 12
- 2024SRIF: Semantic Shape Registration Empowered by Diffusion-based Image Morphing and Flow Estimationcited by 12
- 2024Beyond Complete Shapes: A Benchmark for Quantitative Evaluation of 3D Shape Surface Matching Algorithmscited by 11
- 2025ACORD: An Expert-Annotated Retrieval Dataset for Legal Contract Draftingcited by 11
- 2024Correspondence-Free Non-Rigid Point Set Registration Using Unsupervised Clustering Analysiscited by 10
- 2024DV-Matcher: Deformation-based Non-Rigid Point Cloud Matching Guided by Pre-trained Visual Featurescited by 10
- 2023Learning Accurate Template Matching with Differentiable Coarse-to-Fine Correspondence Refinementcited by 9
- 2025Register Any Point: Scaling 3D Point Cloud Registration by Flow Matchingcited by 9
- 2023Root Pose Decomposition Towards Generic Non-rigid 3D Reconstruction with Monocular Videoscited by 8
- 2025Landmark-Free Preoperative-to-Intraoperative Registration in Laparoscopic Liver Resectioncited by 7
- 2022UTOPIC: Uncertainty-aware Overlap Prediction Network for Partial Point Cloud Registrationcited by 6
- 2024PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformercited by 6
- 2025IC-World: In-Context Generation for Shared World Modelingcited by 6
- 2024Point Tree Transformer for Point Cloud Registrationcited by 5
- 2023Robust-DefReg: A Robust Deformable Point Cloud Registration Method based on Graph Convolutional Neural Networkscited by 4
- 2024ML-SemReg: Boosting Point Cloud Registration with Multi-level Semantic Consistencycited by 4
- 2024PointRegGPT: Boosting 3D Point Cloud Registration using Generative Point-Cloud Pairs for Trainingcited by 4
- 2024Resolving the Ambiguity of Complete-to-Partial Point Cloud Registration for Image-Guided Liver Surgery with Patches-to-Partial Matchingcited by 4
- 2025Occlusion-aware Non-Rigid Point Cloud Registration via Unsupervised Neural Deformation Correntropycited by 4
- 2024PosDiffNet: Positional Neural Diffusion for Point Cloud Registration in a Large Field of View with Perturbationscited by 3
- 2024Diff-Reg v1: Diffusion Matching Model for Registration Problemcited by 3
- 2024UMERegRobust - Universal Manifold Embedding Compatible Features for Robust Point Cloud Registrationcited by 3
- 2025FUSER: Feed-Forward MUltiview 3D Registration Transformer and SE(3)N Diffusion Refinementcited by 3
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformercited by 3
- 2023Graph Matching Optimization Network for Point Cloud Registrationcited by 2
- 2023SphereNet: Learning a Noise-Robust and General Descriptor for Point Cloud Registrationcited by 2
- 2023SuPerPM: A Surgical Perception Framework Based on Deep Point Matching Learned from Physical Constrained Simulation Datacited by 2
- 2024Prim2Room: Layout-Controllable Room Mesh Generation from Primitivescited by 2
- 2024GERA: Geometric Embedding for Efficient Point Registration Analysiscited by 2
- 2024LoGDesc: Local geometric features aggregation for robust point cloud registrationcited by 2
- 20243D Registration in 30 Years: A Surveycited by 2
50 most cited of 85 All 85 (JSON)
- 2026Context without Commitment: Robust Dense Correspondence under Non-Rigid Deformation29 Sep 2026
- 2026Levy-Driven Correspondence Estimation for Registration26 Sep 2026
- 2026BridgeMatch: Conditional Transport Bridges in Matching Matrix Space for 3D Deformable Registration10 Sep 2026
- 2026CANIS: Generation-Assisted 3D Canonicalization via an Image-Semantic Bridge7 Aug 2026
- 2026Splat-based 3D Scene Reconstruction with Extreme Motion-blur18 Jul 2026
- 2026DINE: Distance Is Not Enough -- Learning Global Deformation Priors for Robust Soft-Tissue Point Cloud Registration16 Jul 2026
- 2026Point-Wise Geometry-Aware Transformer for Partial-to-Full Point Cloud Registration in Computer-Assisted Surgery11 Jun 2026
- 2026Towards Patient-Specific Deformable Registration in Laparoscopic Surgery14 Apr 2026
- 2026Lookalike3D: Seeing Double in 3D25 Mar 2026
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformer15 Mar 2026
- 2025Training-Free Global Geometric Association for 4D LiDAR Panoptic Segmentation22 Dec 2025
- 2025ManiLong-Shot: Interaction-Aware One-Shot Imitation Learning for Long-Horizon Manipulation18 Dec 2025
38 more
- 2025Geometry-to-Image Synthesis-Driven Generative Point Cloud Registration10 Dec 2025
- 2025FUSER: Feed-Forward MUltiview 3D Registration Transformer and SE(3)N Diffusion Refinement10 Dec 2025
- 2025IC-World: In-Context Generation for Shared World Modeling1 Dec 2025
- 2025Register Any Point: Scaling 3D Point Cloud Registration by Flow Matching1 Dec 2025
- 2025ERNet: Efficient Non-Rigid Registration Network for Point Sequences17 Oct 2025
- 2025SingRef6D: Monocular Novel Object Pose Estimation with a Single RGB Reference26 Sep 2025
- 2025PIVOTS: Aligning unseen Structures using Preoperative to Intraoperative Volume-To-Surface Registration for Liver Navigation27 Jul 2025
- 2025NFR: Neural Feature-Guided Non-Rigid Shape Registration28 May 2025
- 2025Multiview Point Cloud Registration via Optimization in an Autoencoder Latent Space30 Apr 2025
- 2025Landmark-Free Preoperative-to-Intraoperative Registration in Laparoscopic Liver Resection21 Apr 2025
- 2025HybridReg: Robust 3D Point Cloud Registration with Hybrid Motions10 Mar 2025
- 2025Occlusion-aware Non-Rigid Point Cloud Registration via Unsupervised Neural Deformation Correntropy15 Feb 2025
- 2025DefTransNet: A Transformer-based Method for Non-Rigid Point Cloud Registration in the Simulation of Soft Tissue Deformation10 Feb 2025
- 2025ACORD: An Expert-Annotated Retrieval Dataset for Legal Contract Drafting11 Jan 2025
- 2024Resolving the Ambiguity of Complete-to-Partial Point Cloud Registration for Image-Guided Liver Surgery with Patches-to-Partial Matching26 Dec 2024
- 20243D Registration in 30 Years: A Survey18 Dec 2024
- 2024EADReg: Probabilistic Correspondence Generation with Efficient Autoregressive Diffusion Model for Outdoor Point Cloud Registration22 Nov 2024
- 2024Beyond Complete Shapes: A Benchmark for Quantitative Evaluation of 3D Shape Surface Matching Algorithms5 Nov 2024
- 2024UniRiT: Towards Few-Shot Non-Rigid Point Cloud Registration30 Oct 2024
- 2024Memory-Efficient Point Cloud Registration via Overlapping Region Sampling29 Oct 2024
- 2024Pixtral 12B9 Oct 2024
- 2024LoGDesc: Local geometric features aggregation for robust point cloud registration3 Oct 2024
- 2024GERA: Geometric Embedding for Efficient Point Registration Analysis1 Oct 2024
- 2024SynBench: A Synthetic Benchmark for Non-rigid 3D Point Cloud Registration22 Sep 2024
- 2024SRIF: Semantic Shape Registration Empowered by Diffusion-based Image Morphing and Flow Estimation18 Sep 2024
- 2024Prim2Room: Layout-Controllable Room Mesh Generation from Primitives9 Sep 2024
- 2024UMERegRobust - Universal Manifold Embedding Compatible Features for Robust Point Cloud Registration22 Aug 2024
- 2024DV-Matcher: Deformation-based Non-Rigid Point Cloud Matching Guided by Pre-trained Visual Features16 Aug 2024
- 2024PointRegGPT: Boosting 3D Point Cloud Registration using Generative Point-Cloud Pairs for Training19 Jul 2024
- 2024ML-SemReg: Boosting Point Cloud Registration with Multi-level Semantic Consistency13 Jul 2024
- 2024BiEquiFormer: Bi-Equivariant Representations for Global Point Cloud Registration11 Jul 2024
- 2024Correspondence-Free Non-Rigid Point Set Registration Using Unsupervised Clustering Analysis27 Jun 2024
- 2024Point Tree Transformer for Point Cloud Registration25 Jun 2024
- 2024Correspondence Free Multivector Cloud Registration using Conformal Geometric Algebra17 Jun 2024
- 2024SPARE: Symmetrized Point-to-Plane Distance for Robust Non-Rigid 3D Registration30 May 2024
- 2024One-Shot Imitation Learning with Invariance Matching for Robotic Manipulation21 May 2024
- 2024PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformer22 Apr 2024
- 2024Diff-Reg v1: Diffusion Matching Model for Registration Problem29 Mar 2024
50 newest of 85 All 85 (JSON)
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
- 2024SRIF: Semantic Shape Registration Empowered by Diffusion-based Image Morphing and Flow Estimationcited by 12
- 2025Register Any Point: Scaling 3D Point Cloud Registration by Flow Matchingcited by 9
- 2024EADReg: Probabilistic Correspondence Generation with Efficient Autoregressive Diffusion Model for Outdoor Point Cloud Registrationcited by 0
- 2026BridgeMatch: Conditional Transport Bridges in Matching Matrix Space for 3D Deformable Registrationcited by 0
- 2026BridgeMatch: Conditional Transport Bridges in Matching Matrix Space for 3D Deformable Registration10 Sep 2026
- 2025Register Any Point: Scaling 3D Point Cloud Registration by Flow Matching1 Dec 2025
- 2024EADReg: Probabilistic Correspondence Generation with Efficient Autoregressive Diffusion Model for Outdoor Point Cloud Registration22 Nov 2024
- 2024SRIF: Semantic Shape Registration Empowered by Diffusion-based Image Morphing and Flow Estimation18 Sep 2024
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representations16 Feb 2024
- 2023Analogy-Forming Transformers for Few-Shot 3D Parsingcited by 1
- 2023Analogy-Forming Transformers for Few-Shot 3D Parsing27 Apr 2023
- 2024Pixtral 12Bcited by 179
- 2024Pixtral 12B9 Oct 2024
- 20233D Registration with Maximal Cliquescited by 84
- 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 84
- 2023Rotation-Invariant Transformer for Point Cloud Matchingcited by 69
- 2022Non-rigid Point Cloud Registration with Neural Deformation Pyramidcited by 42
- 2023Dynamic Point Fieldscited by 37
- 2023Robust Outlier Rejection for 3D Registration with Variational Bayescited by 31
- 2024MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Imagescited by 28
- 2022RIGA: Rotation-Invariant and Globally-Aware Descriptors for Point Cloud Registrationcited by 25
- 20233D Implicit Transporter for Temporally Consistent Keypoint Discoverycited by 20
- 2023Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweightingcited by 19
- 2023Deep Graph-based Spatial Consistency for Robust Non-rigid Point Cloud Registrationcited by 15
- 2024Extend Your Own Correspondences: Unsupervised Distant Point Cloud Registration by Progressive Distance Extensioncited by 15
12 most cited of 75 All 75 (JSON)
- 2026Context without Commitment: Robust Dense Correspondence under Non-Rigid Deformation29 Sep 2026
- 2026Levy-Driven Correspondence Estimation for Registration26 Sep 2026
- 2026CANIS: Generation-Assisted 3D Canonicalization via an Image-Semantic Bridge7 Aug 2026
- 2026Splat-based 3D Scene Reconstruction with Extreme Motion-blur18 Jul 2026
- 2026DINE: Distance Is Not Enough -- Learning Global Deformation Priors for Robust Soft-Tissue Point Cloud Registration16 Jul 2026
- 2026Point-Wise Geometry-Aware Transformer for Partial-to-Full Point Cloud Registration in Computer-Assisted Surgery11 Jun 2026
- 2026Towards Patient-Specific Deformable Registration in Laparoscopic Surgery14 Apr 2026
- 2026Lookalike3D: Seeing Double in 3D25 Mar 2026
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformer15 Mar 2026
- 2025Training-Free Global Geometric Association for 4D LiDAR Panoptic Segmentation22 Dec 2025
- 2025Geometry-to-Image Synthesis-Driven Generative Point Cloud Registration10 Dec 2025
- 2025FUSER: Feed-Forward MUltiview 3D Registration Transformer and SE(3)N Diffusion Refinement10 Dec 2025
12 newest of 75 All 75 (JSON)