MGPC: Multimodal Network for Generalizable Point Cloud Completion With Modality Dropout and Progressive Decoding
Not on the map. Why?
Abstract (arXiv)
Point cloud completion aims to recover complete 3D geometry from partial observations caused by limited viewpoints and occlusions. Existing learning-based works, including 3D Convolutional Neural Network (CNN)-based, point-based, and Transformer-based methods, have achieved strong performance on synthetic benchmarks. However, due to the limitations of modality, scalability, and generative capacity, their generalization to novel objects and real-world scenarios remains challenging. In this paper, we propose MGPC, a generalizable multimodal point cloud completion framework that integrates point clouds, RGB images, and text within a unified architecture. MGPC introduces an innovative modality dropout strategy, a Transformer-based fusion module, and a novel progressive generator to improve robustness, scalability, and geometric modeling capability. We further develop an automatic data generation pipeline and construct MGPC-1M, a large-scale benchmark with over 1,000 categories and one million training pairs. Extensive experiments on MGPC-1M and in-the-wild data demonstrate that the proposed method consistently outperforms prior baselines and exhibits strong generalization under real-world conditions.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 64 of its 91 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
64 of 91 references.
References · 64
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2020Point Transformercited by 1,470
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
38 more
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2018PCN: Point Completion Networkcited by 384
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 184
- 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 164
- 2020PF-Net: Point Fractal Network for 3D Point Cloud Completioncited by 146
- 2019Morphing and Sampling Network for Dense Point Cloud Completioncited by 132
- 2020Cascaded Refinement Network for Point Cloud Completioncited by 112
- 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 108
- 2021Variational Relational Point Completion Networkcited by 104
- 2021A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completioncited by 100
- 2020PMP-Net: Point Cloud Completion by Learning Multi-step Point Moving Pathscited by 97
- 2017High-Resolution Shape Completion Using Deep Neural Networks for Global Structure and Local Geometry Inferencecited by 87
- 2022SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformercited by 83
- 2023Multiview Compressive Coding for 3D Reconstructioncited by 71
- 2020Detail Preserved Point Cloud Completion via Separated Feature Aggregationcited by 70
- 2020PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsamplingcited by 69
- 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformerscited by 67
- 2021View-Guided Point Cloud Completioncited by 46
- 2021Style-based Point Generator with Adversarial Rendering for Point Cloud Completioncited by 45
- 2022Comprehensive Review of Deep Learning-Based 3D Point Cloud Completion Processing and Analysiscited by 44
- 2022PointAttN: You Only Need Attention for Point Cloud Completioncited by 44
- 2023ProxyFormer: Proxy Alignment Assisted Point Cloud Completion with Missing Part Sensitive Transformercited by 43
- 2022Cross-modal Learning for Image-Guided Point Cloud Shape Completioncited by 36
- 2021Meta-PU: An Arbitrary-Scale Upsampling Network for Point Cloudcited by 35
- 2023SVDFormer: Complementing Point Cloud via Self-view Augmentation and Self-structure Dual-generatorcited by 34
- 2020Deep Octree-based CNNs with Output-Guided Skip Connections for 3D Shape and Scene Completioncited by 33
- 2018View-volume Network for Semantic Scene Completion from a Single Depth Imagecited by 26
- 2018Extreme Relative Pose Estimation for RGB-D Scans via Scene Completioncited by 22
- 2022CSDN: Cross-modal Shape-transfer Dual-refinement Network for Point Cloud Completioncited by 22
- 2024CRA-PCN: Point Cloud Completion with Intra- and Inter-level Cross-Resolution Transformerscited by 21
- 2021ME-PCN: Point Completion Conditioned on Mask Emptinesscited by 18
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.