mlsanityData to 14 Oct 2026

3D Shape Completion on Unseen Categories:A Weakly-supervised Approach

arXiv 2401.10578 ↗First posted 19 Jan 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

3D shapes captured by scanning devices are often incomplete due to occlusion. 3D shape completion methods have been explored to tackle this limitation. However, most of these methods are only trained and tested on a subset of categories, resulting in poor generalization to unseen categories. In this paper, we introduce a novel weakly-supervised framework to reconstruct the complete shapes from unseen categories. We first propose an end-to-end prior-assisted shape learning network that leverages data from the seen categories to infer a coarse shape. Specifically, we construct a prior bank consisting of representative shapes from the seen categories. Then, we design a multi-scale pattern correlation module for learning the complete shape of the input by analyzing the correlation between local patterns within the input and the priors at various scales. In addition, we propose a self-supervised shape refinement model to further refine the coarse shape. Considering the shape variability of 3D objects across categories, we construct a category-specific prior bank to facilitate shape refinement. Then, we devise a voxel-based partial matching loss and leverage the partial scans to drive the refinement process. Extensive experimental results show that our approach is superior to state-of-the-art methods by a large margin.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 49 of its 57 references that are in the map. First posted on arXiv 19 Jan 2024.

Builds on

49 of 57 references.

References · 49

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  5. 2020Convolutional Occupancy Networkscited by 761
  6. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
  7. 2018PCN: Point Completion Networkcited by 384
  8. 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
  9. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  10. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
  11. 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
  12. 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
37 more
  1. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  2. 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
  3. 2020GRNet: Gridding Residual Network for Dense Point Cloud Completioncited by 174
  4. 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 164
  5. 2020Self-supervised Single-view 3D Reconstruction via Semantic Consistencycited by 127
  6. 2020Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Reviewcited by 108
  7. 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
  8. 2020Self-Supervised Learning for Domain Adaptation on Point-Cloudscited by 99
  9. 2022SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformercited by 83
  10. 2021Unsupervised 3D Shape Completion through GAN Inversioncited by 70
  11. 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformerscited by 67
  12. 2019Unpaired Point Cloud Completion on Real Scans using Adversarial Trainingcited by 66
  13. 2018Scan2Mesh: From Unstructured Range Scans to 3D Meshescited by 51
  14. 2021Cycle4Completion: Unpaired Point Cloud Completion using Cycle Transformation with Missing Region Codingcited by 50
  15. 2021Perceptual Quality Assessment of Colored 3D Point Cloudscited by 49
  16. 2021View-Guided Point Cloud Completioncited by 46
  17. 2023ProxyFormer: Proxy Alignment Assisted Point Cloud Completion with Missing Part Sensitive Transformercited by 43
  18. 2019A Skeleton-bridged Deep Learning Approach for Generating Meshes of Complex Topologies from Single RGB Imagescited by 37
  19. 2021Meta-PU: An Arbitrary-Scale Upsampling Network for Point Cloudcited by 35
  20. 2020Weakly-supervised 3D Shape Completion in the Wildcited by 33
  21. 2020SkeletonNet: A Topology-Preserving Solution for Learning Mesh Reconstruction of Object Surfaces from RGB Imagescited by 30
  22. 2019Few-Shot Generalization for Single-Image 3D Reconstruction via Priorscited by 25
  23. 2020TearingNet: Point Cloud Autoencoder to Learn Topology-Friendly Representationscited by 23
  24. 2022CSDN: Cross-modal Shape-transfer Dual-refinement Network for Point Cloud Completioncited by 22
  25. 2022PatchComplete: Learning Multi-Resolution Patch Priors for 3D Shape Completion on Unseen Categoriescited by 21
  26. 2020Cascaded Refinement Network for Point Cloud Completion with Self-supervisioncited by 20
  27. 2022Learning a Structured Latent Space for Unsupervised Point Cloud Completioncited by 17
  28. 2021Self-Supervised Point Cloud Completion via Inpaintingcited by 16
  29. 2021Progressive Seed Generation Auto-encoder for Unsupervised Point Cloud Learningcited by 12
  30. 2022CP3: Unifying Point Cloud Completion by Pretrain-Prompt-Predict Paradigmcited by 9
  31. 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectivescited by 9
  32. 2023ACL-SPC: Adaptive Closed-Loop system for Self-Supervised Point Cloud Completioncited by 9
  33. 2023SCoDA: Domain Adaptive Shape Completion for Real Scanscited by 9
  34. 2022Leveraging Single-View Images for Unsupervised 3D Point Cloud Completioncited by 8
  35. 2022PatchRD: Detail-Preserving Shape Completion by Learning Patch Retrieval and Deformationcited by 7
  36. 2023Unsupervised 3D Shape Reconstruction by Part Retrieval and Assemblycited by 7
  37. 2023SuperUDF: Self-supervised UDF Estimation for Surface Reconstructioncited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 2.

6 papers.