SplAttN: Bridging 2D and 3D with Gaussian Soft Splatting and Attention for Point Cloud Completion
Not on the map. Why?
Abstract (arXiv)
Although multi-modal learning has advanced point cloud completion, the theoretical mechanisms remain unclear. Recent works attribute success to the connection between modalities, yet we identify that standard hard projection severs this connection: projecting a sparse point cloud onto the image plane yields an extremely sparse support, which hinders visual prior propagation, a failure mode we term Cross-Modal Entropy Collapse. To address this practical limitation, we propose SplAttN, which replaces hard projection with Differentiable Gaussian Splatting to produce a dense, continuous image-plane representation. By reformulating projection as continuous density estimation, SplAttN avoids collapsed sparse support, facilitates gradient flow, and improves cross-modal connection learnability. Extensive experiments show that SplAttN achieves state-of-the-art performance on PCN and ShapeNet-55/34. Crucially, we utilize the real-world KITTI benchmark as a stress test for multi-modal reliance. Counter-factual evaluation reveals that while baselines degenerate into unimodal template retrievers insensitive to visual removal, SplAttN maintains a robust dependency on visual cues, validating that our method establishes an effective cross-modal connection. Code is available at https://github.com/zay002/SplAttN.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 2 May 2026.
Builds on
38 of 49 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
- 2015Cyclical Learning Rates for Training Neural Networkscited by 627
- 2018PCN: Point Completion Networkcited by 382
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 284
26 more
- 2020Softmax Splatting for Video Frame Interpolationcited by 276
- 2022TinyViT: Fast Pretraining Distillation for Small Vision Transformerscited by 232
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 186
- 2020GRNet: Gridding Residual Network for Dense Point Cloud Completioncited by 174
- 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 162
- 2020Cascaded Refinement Network for Point Cloud Completioncited by 112
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
- 2022SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformercited by 83
- 2020Detail Preserved Point Cloud Completion via Separated Feature Aggregationcited by 70
- 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformerscited by 65
- 2022PMP-Net++: Point Cloud Completion by Transformer-Enhanced Multi-step Point Moving Pathscited by 57
- 2021View-Guided Point Cloud Completioncited by 46
- 2022PointAttN: You Only Need Attention for Point Cloud Completioncited by 43
- 2023ProxyFormer: Proxy Alignment Assisted Point Cloud Completion with Missing Part Sensitive Transformercited by 43
- 2023Point-Cloud Completion with Pretrained Text-to-image Diffusion Modelscited by 37
- 2022Cross-modal Learning for Image-Guided Point Cloud Shape Completioncited by 36
- 2023SVDFormer: Complementing Point Cloud via Self-view Augmentation and Self-structure Dual-generatorcited by 34
- 2021ASFM-Net: Asymmetrical Siamese Feature Matching Network for Point Completioncited by 28
- 2022LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned Keypointscited by 27
- 2023A Theory of Multimodal Learningcited by 25
- 2024CRA-PCN: Point Cloud Completion with Intra- and Inter-level Cross-Resolution Transformerscited by 21
- 2022FBNet: Feedback Network for Point Cloud Completioncited by 20
- 2024SplatFormer: Point Transformer for Robust 3D Gaussian Splattingcited by 15
- 2025SymmCompletion: High-Fidelity and High-Consistency Point Cloud Completion with Symmetry Guidancecited by 15
- 2024GeoFormer: Learning Point Cloud Completion with Tri-Plane Integrated Transformercited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.