3D Shape Completion on Unseen Categories:A Weakly-supervised Approach
Not on the map. Why?
Abstract (arXiv)
3D shapes captured by scanning devices are often incomplete due to occlusion. 3D shape completion methods have been explored to tackle this limitation. However, most of these methods are only trained and tested on a subset of categories, resulting in poor generalization to unseen categories. In this paper, we introduce a novel weakly-supervised framework to reconstruct the complete shapes from unseen categories. We first propose an end-to-end prior-assisted shape learning network that leverages data from the seen categories to infer a coarse shape. Specifically, we construct a prior bank consisting of representative shapes from the seen categories. Then, we design a multi-scale pattern correlation module for learning the complete shape of the input by analyzing the correlation between local patterns within the input and the priors at various scales. In addition, we propose a self-supervised shape refinement model to further refine the coarse shape. Considering the shape variability of 3D objects across categories, we construct a category-specific prior bank to facilitate shape refinement. Then, we devise a voxel-based partial matching loss and leverage the partial scans to drive the refinement process. Extensive experimental results show that our approach is superior to state-of-the-art methods by a large margin.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 49 of its 57 references that are in the map. First posted on arXiv 19 Jan 2024.
Builds on
49 of 57 references.
References · 49
- 2017Attention Is All You Needcited by 60,361
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2020Convolutional Occupancy Networkscited by 761
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2018PCN: Point Completion Networkcited by 384
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
37 more
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
- 2020GRNet: Gridding Residual Network for Dense Point Cloud Completioncited by 174
- 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 164
- 2020Self-supervised Single-view 3D Reconstruction via Semantic Consistencycited by 127
- 2020Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Reviewcited by 108
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2020Self-Supervised Learning for Domain Adaptation on Point-Cloudscited by 99
- 2022SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformercited by 83
- 2021Unsupervised 3D Shape Completion through GAN Inversioncited by 70
- 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformerscited by 67
- 2019Unpaired Point Cloud Completion on Real Scans using Adversarial Trainingcited by 66
- 2018Scan2Mesh: From Unstructured Range Scans to 3D Meshescited by 51
- 2021Cycle4Completion: Unpaired Point Cloud Completion using Cycle Transformation with Missing Region Codingcited by 50
- 2021Perceptual Quality Assessment of Colored 3D Point Cloudscited by 49
- 2021View-Guided Point Cloud Completioncited by 46
- 2023ProxyFormer: Proxy Alignment Assisted Point Cloud Completion with Missing Part Sensitive Transformercited by 43
- 2019A Skeleton-bridged Deep Learning Approach for Generating Meshes of Complex Topologies from Single RGB Imagescited by 37
- 2021Meta-PU: An Arbitrary-Scale Upsampling Network for Point Cloudcited by 35
- 2020Weakly-supervised 3D Shape Completion in the Wildcited by 33
- 2020SkeletonNet: A Topology-Preserving Solution for Learning Mesh Reconstruction of Object Surfaces from RGB Imagescited by 30
- 2019Few-Shot Generalization for Single-Image 3D Reconstruction via Priorscited by 25
- 2020TearingNet: Point Cloud Autoencoder to Learn Topology-Friendly Representationscited by 23
- 2022CSDN: Cross-modal Shape-transfer Dual-refinement Network for Point Cloud Completioncited by 22
- 2022PatchComplete: Learning Multi-Resolution Patch Priors for 3D Shape Completion on Unseen Categoriescited by 21
- 2020Cascaded Refinement Network for Point Cloud Completion with Self-supervisioncited by 20
- 2022Learning a Structured Latent Space for Unsupervised Point Cloud Completioncited by 17
- 2021Self-Supervised Point Cloud Completion via Inpaintingcited by 16
- 2021Progressive Seed Generation Auto-encoder for Unsupervised Point Cloud Learningcited by 12
- 2022CP3: Unifying Point Cloud Completion by Pretrain-Prompt-Predict Paradigmcited by 9
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectivescited by 9
- 2023ACL-SPC: Adaptive Closed-Loop system for Self-Supervised Point Cloud Completioncited by 9
- 2023SCoDA: Domain Adaptive Shape Completion for Real Scanscited by 9
- 2022Leveraging Single-View Images for Unsupervised 3D Point Cloud Completioncited by 8
- 2022PatchRD: Detail-Preserving Shape Completion by Learning Patch Retrieval and Deformationcited by 7
- 2023Unsupervised 3D Shape Reconstruction by Part Retrieval and Assemblycited by 7
- 2023SuperUDF: Self-supervised UDF Estimation for Surface Reconstructioncited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 2.
6 papers.
- 2024Unsupervised 3D Point Cloud Completion via Multi-view Adversarial Learningcited by 6
- 2026MGPC: Multimodal Network for Generalizable Point Cloud Completion With Modality Dropout and Progressive Decodingcited by 2
- 2025HuGDiffusion: Generalizable Single-Image Human Rendering via 3D Gaussian Diffusioncited by 1
- 2025Reasoning-Driven Amodal Completion: Collaborative Agents and Perceptual Evaluationcited by 1
- 2026VIAFormer: Voxel-Image Alignment Transformer for High-Fidelity Voxel Refinementcited by 1
- 2025PVNet: Point-Voxel Interaction LiDAR Scene Upsampling Via Diffusion Modelscited by 0
- 2026VIAFormer: Voxel-Image Alignment Transformer for High-Fidelity Voxel Refinement20 Jan 2026
- 2026MGPC: Multimodal Network for Generalizable Point Cloud Completion With Modality Dropout and Progressive Decoding7 Jan 2026
- 2025Reasoning-Driven Amodal Completion: Collaborative Agents and Perceptual Evaluation24 Dec 2025
- 2025PVNet: Point-Voxel Interaction LiDAR Scene Upsampling Via Diffusion Models23 Aug 2025
- 2025HuGDiffusion: Generalizable Single-Image Human Rendering via 3D Gaussian Diffusion25 Jan 2025
- 2024Unsupervised 3D Point Cloud Completion via Multi-view Adversarial Learning13 Jul 2024