Learning Generalizable Shape Completion with SIM(3) Equivariance
Not on the map. Why?
Abstract (arXiv)
3D shape completion methods typically assume scans are pre-aligned to a canonical frame. This leaks pose and scale cues that networks may exploit to memorize absolute positions rather than inferring intrinsic geometry. When such alignment is absent in real data, performance collapses. We argue that robust generalization demands architectural equivariance to the similarity group, SIM(3), so the model remains agnostic to pose and scale. Following this principle, we introduce the first SIM(3)-equivariant shape completion network, whose modular layers successively canonicalize features, reason over similarity-invariant geometry, and restore the original frame. Under a de-biased evaluation protocol that removes the hidden cues, our model outperforms both equivariant and augmentation baselines on the PCN benchmark. It also sets new cross-domain records on real driving and indoor scans, lowering minimal matching distance on KITTI by 17% and Chamfer distance ℓ1 on OmniObject3D by 14%. Perhaps surprisingly, ours under the stricter protocol still outperforms competitors under their biased settings. These results establish full SIM(3) equivariance as an effective route to truly generalizable shape completion. Project page: https://sime-completion.github.io.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 53 of its 67 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
53 of 67 references.
References · 53
- 2017Attention Is All You Needcited by 60,361
- 2016Layer Normalizationcited by 5,669
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
- 2018Spherical CNNscited by 456
- 2018PCN: Point Completion Networkcited by 384
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 305
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 300
38 more
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
- 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 267
- 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 248
- 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 228
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
- 2020GRNet: Gridding Residual Network for Dense Point Cloud Completioncited by 174
- 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 164
- 2017High-Resolution Shape Completion Using Deep Neural Networks for Global Structure and Local Geometry Inferencecited by 87
- 2022SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformercited by 83
- 2021Equivariant Point Network for 3D Point Cloud Analysiscited by 81
- 2016Shape Completion Enabled Robotic Graspingcited by 79
- 2024EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learningcited by 75
- 2021Coordinate Independent Convolutional Networks -- Isometry and Gauge Equivariant Convolutions on Riemannian Manifoldscited by 73
- 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformerscited by 67
- 2021Leveraging SE(3) Equivariance for Self-Supervised Category-Level Object Pose Estimationcited by 45
- 2023EquivAct: SIM(3)-Equivariant Visuomotor Policies beyond Rigid Object Manipulationcited by 37
- 2022ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapescited by 31
- 20193D-Rotation-Equivariant Quaternion Neural Networkscited by 30
- 2022SE(3)-Equivariant Attention Networks for Shape Reconstruction in Function Spacecited by 27
- 2022VN-Transformer: Rotation-Equivariant Attention for Vector Neuronscited by 27
- 2021Homogeneous vector bundles and G-equivariant convolutional neural networkscited by 21
- 2022Rotationally Equivariant 3D Object Detectioncited by 21
- 2022Unified Fourier-based Kernel and Nonlinearity Design for Equivariant Networks on Homogeneous Spacescited by 20
- 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fieldscited by 19
- 2024Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solvingcited by 19
- 20223D Equivariant Graph Implicit Functionscited by 18
- 2023EFEM: Equivariant Neural Field Expectation Maximization for 3D Object Segmentation Without Scene Supervisioncited by 18
- 2022E2PN: Efficient SE(3)-Equivariant Point Networkcited by 17
- 2022Shape-Pose Disentanglement using SE(3)-equivariant Vector Neuronscited by 16
- 2025Probing Equivariance and Symmetry Breaking in Convolutional Networkscited by 12
- 2022Coarse-to-Fine Point Cloud Registration with SE(3)-Equivariant Representationscited by 9
- 2023SCoDA: Domain Adaptive Shape Completion for Real Scanscited by 9
- 2023SCARP: 3D Shape Completion in ARbitrary Poses for Improved Graspingcited by 8
- 2024SE(3) Equivariant Ray Embeddings for Implicit Multi-View Depth Estimationcited by 6
- 2025Parametric Point Cloud Completion for Polygonal Surface Reconstructioncited by 6
- 2024Building-PCC: Building Point Cloud Completion Benchmarkscited by 5
- 2022SO(3)-Pose: SO(3)-Equivariance Learning for 6D Object Pose Estimationcited by 4
- 2024SE3ET: SE(3)-Equivariant Transformer for Low-Overlap Point Cloud Registrationcited by 4
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.