When Do Geometric Algebra Layers Beat Scalarization? A Controlled Study on SO(3)-Equivariant Vector Laws
Not on the map. Why?
Abstract (arXiv)
Compact networks built from Clifford algebra Cl(3,0) primitives are exactly SO(3)-equivariant and learn synthetic 3D vector laws from few samples. We ask whether the geometric algebra structure itself contributes anything beyond exact equivariance. We compare against a minimal scalarization baseline: invariant dot products fed to a small MLP that outputs coefficients on the equivariant basis {v_i, v_i x v_j}, which is also exactly equivariant. On single-stage laws (rotation by axis-angle, cross product, central force), scalarization matches or beats the Cl(3,0) network at a fraction of the training cost, so the geometric algebra adds nothing there. On compositional targets whose computation graph nests group operations (apply R2 R1 to a point; map a local force through an orientation, then take a torque), the Cl(3,0) network beats scalarization by an order of magnitude in the low-data regime, reaching with 100 samples what the baseline needs 3000 for, and the gap survives strengthening the baseline with the triple-product invariant and 17x more parameters, external Vector Neurons and e3nn baselines, and a multiplicative coefficient network. Ablations show the required network depth tracks the rotation chain length, and scalarization falls below the constant predictor on chains of four rotations. The advantage is not composition per se: on a rotation-free nested cross product, which flattens into polynomial invariant coefficients, scalarization wins by 24x. No tested model, equivariant or not, extrapolates invariant magnitudes: on radius and separation shifts every model is worse than a constant predictor once errors are normalized. We conclude that geometric algebra layers are not a general shortcut for low-data 3D learning, but become useful precisely when the target composes group elements in depth.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 16 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
14 of 16 references.
References · 14
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 708
- 2019General E(2)-Equivariant Steerable CNNscited by 446
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 305
- 2022e3nn: Euclidean Neural Networkscited by 174
- 2021Scalars are universal: Equivariant machine learning, structured like classical physicscited by 127
- 2022Clifford Neural Layers for PDE Modelingcited by 92
- 2020On the Universality of Rotation Equivariant Point Cloud Networkscited by 80
- 2023Clifford Group Equivariant Neural Networkscited by 55
Built on by
Not cited yet.