mlsanityData to 14 Oct 2026

MGPC: Multimodal Network for Generalizable Point Cloud Completion With Modality Dropout and Progressive Decoding

arXiv 2601.03660 ↗First posted 7 Jan 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Point cloud completion aims to recover complete 3D geometry from partial observations caused by limited viewpoints and occlusions. Existing learning-based works, including 3D Convolutional Neural Network (CNN)-based, point-based, and Transformer-based methods, have achieved strong performance on synthetic benchmarks. However, due to the limitations of modality, scalability, and generative capacity, their generalization to novel objects and real-world scenarios remains challenging. In this paper, we propose MGPC, a generalizable multimodal point cloud completion framework that integrates point clouds, RGB images, and text within a unified architecture. MGPC introduces an innovative modality dropout strategy, a Transformer-based fusion module, and a novel progressive generator to improve robustness, scalability, and geometric modeling capability. We further develop an automatic data generation pipeline and construct MGPC-1M, a large-scale benchmark with over 1,000 categories and one million training pairs. Extensive experiments on MGPC-1M and in-the-wild data demonstrate that the proposed method consistently outperforms prior baselines and exhibits strong generalization under real-world conditions.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 64 of its 91 references that are in the map. First posted on arXiv 7 Jan 2026.

Builds on

64 of 91 references.

References · 64

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  7. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  8. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  10. 2020Point Transformercited by 1,470
  11. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  12. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
38 more
  1. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  2. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  3. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  4. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  5. 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
  6. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  7. 2018PCN: Point Completion Networkcited by 384
  8. 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
  9. 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
  10. 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 184
  11. 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 164
  12. 2020PF-Net: Point Fractal Network for 3D Point Cloud Completioncited by 146
  13. 2019Morphing and Sampling Network for Dense Point Cloud Completioncited by 132
  14. 2020Cascaded Refinement Network for Point Cloud Completioncited by 112
  15. 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 108
  16. 2021Variational Relational Point Completion Networkcited by 104
  17. 2021A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completioncited by 100
  18. 2020PMP-Net: Point Cloud Completion by Learning Multi-step Point Moving Pathscited by 97
  19. 2017High-Resolution Shape Completion Using Deep Neural Networks for Global Structure and Local Geometry Inferencecited by 87
  20. 2022SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformercited by 83
  21. 2023Multiview Compressive Coding for 3D Reconstructioncited by 71
  22. 2020Detail Preserved Point Cloud Completion via Separated Feature Aggregationcited by 70
  23. 2020PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsamplingcited by 69
  24. 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformerscited by 67
  25. 2021View-Guided Point Cloud Completioncited by 46
  26. 2021Style-based Point Generator with Adversarial Rendering for Point Cloud Completioncited by 45
  27. 2022Comprehensive Review of Deep Learning-Based 3D Point Cloud Completion Processing and Analysiscited by 44
  28. 2022PointAttN: You Only Need Attention for Point Cloud Completioncited by 44
  29. 2023ProxyFormer: Proxy Alignment Assisted Point Cloud Completion with Missing Part Sensitive Transformercited by 43
  30. 2022Cross-modal Learning for Image-Guided Point Cloud Shape Completioncited by 36
  31. 2021Meta-PU: An Arbitrary-Scale Upsampling Network for Point Cloudcited by 35
  32. 2023SVDFormer: Complementing Point Cloud via Self-view Augmentation and Self-structure Dual-generatorcited by 34
  33. 2020Deep Octree-based CNNs with Output-Guided Skip Connections for 3D Shape and Scene Completioncited by 33
  34. 2018View-volume Network for Semantic Scene Completion from a Single Depth Imagecited by 26
  35. 2018Extreme Relative Pose Estimation for RGB-D Scans via Scene Completioncited by 22
  36. 2022CSDN: Cross-modal Shape-transfer Dual-refinement Network for Point Cloud Completioncited by 22
  37. 2024CRA-PCN: Point Cloud Completion with Intra- and Inter-level Cross-Resolution Transformerscited by 21
  38. 2021ME-PCN: Point Completion Conditioned on Mask Emptinesscited by 18

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.