Loss Distillation via Gradient Matching for Point Cloud Completion with Weighted Chamfer Distance
Not on the map. Why?
Abstract (arXiv)
3D point clouds enhanced the robot's ability to perceive the geometrical information of the environments, making it possible for many downstream tasks such as grasp pose detection and scene understanding. The performance of these tasks, though, heavily relies on the quality of data input, as incomplete can lead to poor results and failure cases. Recent training loss functions designed for deep learning-based point cloud completion, such as Chamfer distance (CD) and its variants (eg HyperCD ), imply a good gradient weighting scheme can significantly boost performance. However, these CD-based loss functions usually require data-related parameter tuning, which can be time-consuming for data-extensive tasks. To address this issue, we aim to find a family of weighted training losses (em weighted CD) that requires no parameter tuning. To this end, we propose a search scheme, em Loss Distillation via Gradient Matching, to find good candidate loss functions by mimicking the learning behavior in backpropagation between HyperCD and weighted CD. Once this is done, we propose a novel bilevel optimization formula to train the backbone network based on the weighted CD loss. We observe that: (1) with proper weighted functions, the weighted CD can always achieve similar performance to HyperCD, and (2) the Landau weighted CD, namely em Landau CD, can outperform HyperCD for point cloud completion and lead to new state-of-the-art results on several benchmark datasets. it Our demo code is available at urlhttps://github.com/Zhang-VISLab/IROS2024-LossDistillationWeightedCD.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 33 of its 51 references that are in the map. First posted on arXiv 10 Sep 2024.
Builds on
33 of 51 references.
References · 33
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 557
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2018PCN: Point Completion Networkcited by 382
- 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 312
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 284
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 259
- 2020Bilevel Optimization: Convergence Analysis and Enhanced Designcited by 219
- 2020GRNet: Gridding Residual Network for Dense Point Cloud Completioncited by 174
21 more
- 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 162
- 2020Cascaded Refinement Network for Point Cloud Completioncited by 112
- 2021Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completioncited by 111
- 2017Grasp Pose Detection in Point Cloudscited by 107
- 2021A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completioncited by 100
- 2020PMP-Net: Point Cloud Completion by Learning Multi-step Point Moving Pathscited by 97
- 2022SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformercited by 83
- 2020Detail Preserved Point Cloud Completion via Separated Feature Aggregationcited by 70
- 2022PointAttN: You Only Need Attention for Point Cloud Completioncited by 43
- 2022Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformercited by 38
- 2022Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detectioncited by 34
- 2020Knowledge Distillation in Deep Learning and its Applicationscited by 29
- 2022LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned Keypointscited by 27
- 20193D Local Features for Direct Pairwise Registrationcited by 26
- 2020DPDist : Comparing Point Clouds Using Deep Point Cloud Distancecited by 22
- 2022FBNet: Feedback Network for Point Cloud Completioncited by 20
- 2024Imagination Policy: Using Generative Point Cloud Models for Learning Manipulation Policiescited by 18
- 2024OrbitGrasp: SE(3)-Equivariant Grasp Learningcited by 15
- 2021Attention-based Transformation from Latent Features to Point Cloudscited by 8
- 2020FPCC: Fast Point Cloud Clustering based Instance Segmentation for Industrial Bin-pickingcited by 7
- 2019COSMOS: Coordination of High-Level Synthesis and Memory Optimization for Hardware Acceleratorscited by 4
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2026DINE: Distance Is Not Enough -- Learning Global Deformation Priors for Robust Soft-Tissue Point Cloud Registrationcited by 1
- 2025Med-PU: Point Cloud Upsampling for High-Fidelity 3D Medical Shape Reconstructioncited by 0
- 2025A Strong View-Free Baseline Approach for Single-View Image Guided Point Cloud Completioncited by 0
- 2025NexusFlow: Unifying Disparate Tasks under Partial Supervision via Invertible Flow Networkscited by 0
- 2026DINE: Distance Is Not Enough -- Learning Global Deformation Priors for Robust Soft-Tissue Point Cloud Registration16 Jul 2026
- 2025NexusFlow: Unifying Disparate Tasks under Partial Supervision via Invertible Flow Networks6 Dec 2025
- 2025A Strong View-Free Baseline Approach for Single-View Image Guided Point Cloud Completion18 Jun 2025
- 2025Med-PU: Point Cloud Upsampling for High-Fidelity 3D Medical Shape Reconstruction28 Jan 2025