mlsanityData to 7 Oct 2026

SplAttN: Bridging 2D and 3D with Gaussian Soft Splatting and Attention for Point Cloud Completion

arXiv 2605.01466 ↗First posted 2 May 2026cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Although multi-modal learning has advanced point cloud completion, the theoretical mechanisms remain unclear. Recent works attribute success to the connection between modalities, yet we identify that standard hard projection severs this connection: projecting a sparse point cloud onto the image plane yields an extremely sparse support, which hinders visual prior propagation, a failure mode we term Cross-Modal Entropy Collapse. To address this practical limitation, we propose SplAttN, which replaces hard projection with Differentiable Gaussian Splatting to produce a dense, continuous image-plane representation. By reformulating projection as continuous density estimation, SplAttN avoids collapsed sparse support, facilitates gradient flow, and improves cross-modal connection learnability. Extensive experiments show that SplAttN achieves state-of-the-art performance on PCN and ShapeNet-55/34. Crucially, we utilize the real-world KITTI benchmark as a stress test for multi-modal reliance. Counter-factual evaluation reveals that while baselines degenerate into unimodal template retrievers insensitive to visual removal, SplAttN maintains a robust dependency on visual cues, validating that our method establishes an effective cross-modal connection. Code is available at https://github.com/zay002/SplAttN.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 2 May 2026.

Builds on

38 of 49 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  7. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  8. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  9. 2015Cyclical Learning Rates for Training Neural Networkscited by 627
  10. 2018PCN: Point Completion Networkcited by 382
  11. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  12. 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 284
26 more
  1. 2020Softmax Splatting for Video Frame Interpolationcited by 276
  2. 2022TinyViT: Fast Pretraining Distillation for Small Vision Transformerscited by 232
  3. 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
  4. 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 186
  5. 2020GRNet: Gridding Residual Network for Dense Point Cloud Completioncited by 174
  6. 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 162
  7. 2020Cascaded Refinement Network for Point Cloud Completioncited by 112
  8. 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
  9. 2022SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformercited by 83
  10. 2020Detail Preserved Point Cloud Completion via Separated Feature Aggregationcited by 70
  11. 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformerscited by 65
  12. 2022PMP-Net++: Point Cloud Completion by Transformer-Enhanced Multi-step Point Moving Pathscited by 57
  13. 2021View-Guided Point Cloud Completioncited by 46
  14. 2022PointAttN: You Only Need Attention for Point Cloud Completioncited by 43
  15. 2023ProxyFormer: Proxy Alignment Assisted Point Cloud Completion with Missing Part Sensitive Transformercited by 43
  16. 2023Point-Cloud Completion with Pretrained Text-to-image Diffusion Modelscited by 37
  17. 2022Cross-modal Learning for Image-Guided Point Cloud Shape Completioncited by 36
  18. 2023SVDFormer: Complementing Point Cloud via Self-view Augmentation and Self-structure Dual-generatorcited by 34
  19. 2021ASFM-Net: Asymmetrical Siamese Feature Matching Network for Point Completioncited by 28
  20. 2022LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned Keypointscited by 27
  21. 2023A Theory of Multimodal Learningcited by 25
  22. 2024CRA-PCN: Point Cloud Completion with Intra- and Inter-level Cross-Resolution Transformerscited by 21
  23. 2022FBNet: Feedback Network for Point Cloud Completioncited by 20
  24. 2024SplatFormer: Point Transformer for Robust 3D Gaussian Splattingcited by 15
  25. 2025SymmCompletion: High-Fidelity and High-Consistency Point Cloud Completion with Symmetry Guidancecited by 15
  26. 2024GeoFormer: Learning Point Cloud Completion with Tri-Plane Integrated Transformercited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.