mlsanityData to 7 Oct 2026

Equivariant Frames and the Impossibility of Continuous Canonicalization

arXiv 2402.16077 ↗First posted 25 Feb 2024cs.LGcited by 41

Not on the map. Why?

Abstract (arXiv)

Canonicalization provides an architecture-agnostic method for enforcing equivariance, with generalizations such as frame-averaging recently gaining prominence as a lightweight and flexible alternative to equivariant architectures. Recent works have found an empirical benefit to using probabilistic frames instead, which learn weighted distributions over group elements. In this work, we provide strong theoretical justification for this phenomenon: for commonly-used groups, there is no efficiently computable choice of frame that preserves continuity of the function being averaged. In other words, unweighted frame-averaging can turn a smooth, non-symmetric function into a discontinuous, symmetric function. To address this fundamental robustness problem, we formally define and construct weighted frames, which provably preserve continuity, and demonstrate their utility by constructing efficient and continuous weighted frames for the actions of SO(2), SO(3), and Sn on point clouds.

Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 25 Feb 2024.

Builds on

21 of 29 references.

References · 21

  1. 2021E(n) Equivariant Graph Neural Networkscited by 951
  2. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  3. 2022DiffDock: Diffusion Steps, Twists, and Turns for Molecular Dockingcited by 307
  4. 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
  5. 2021Frame Averaging for Invariant and Equivariant Network Designcited by 166
  6. 2018Universal approximations of invariant maps by neural networkscited by 127
  7. 2023Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNscited by 113
  8. 2022Understanding and Extending Subgraph GNNs by Rethinking Their Symmetriescited by 112
  9. 2022Equivariance with Learned Canonicalization Functionscited by 106
  10. 2021Learning with invariances in random features and kernel modelscited by 89
  11. 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 75
  12. 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 72
9 more
  1. 2019FSPool: Learning Set Representations with Featurewise Sort Poolingcited by 53
  2. 2023A new perspective on building efficient and expressive 3D equivariant graph neural networkscited by 46
  3. 2023Equivariant Adaptation of Large Pretrained Modelscited by 40
  4. 2023Smooth, exact rotational symmetrization for deep learning on point cloudscited by 39
  5. 2023Neural Injective Functions for Multisets, Measures and Graphs via a Finite Witness Theoremcited by 33
  6. 2022Equivariant Point Cloud Analysis via Learning Orientations for Message Passingcited by 32
  7. 2021Provably Strict Generalisation Benefit for Invariance in Kernel Methodscited by 29
  8. 2023Learning Probabilistic Symmetrization for Architecture Agnostic Equivariancecited by 25
  9. 2018Learning Representations of Sets through Optimized Permutationscited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 19; 2026: 14.

41 papers.

Sort:

By area:

  1. 2024A Canonicalization Perspective on Invariant and Equivariant Learningcited by 25
  2. 2024Lie Algebra Canonicalization: Equivariant Neural Operators under arbitrary Lie Groupscited by 23
  3. 2024Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Modelscited by 21
  4. 2024Equivariance via Minimal Frame Averaging for More Symmetries and Efficiencycited by 18
  5. 2025Improving Equivariant Networks with Probabilistic Symmetry Breakingcited by 15
  6. 2024Probing the effects of broken symmetries in machine learningcited by 13
  7. 2025Lorentz Local Canonicalization: How to Make Any Network Lorentz-Equivariantcited by 12
  8. 2025Achieving Approximate Symmetry Is Exponentially Easier than Exact Symmetrycited by 6
  9. 2025Learning with Exact Invariances in Polynomial Timecited by 5
  10. 2025Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local Framescited by 5
  11. 2025Learning Inter-Atomic Potentials without Explicit Equivariancecited by 5
  12. 2026Rethinking Diffusion Models with Symmetries through Canonicalization with Applications to Molecular Graph Generationcited by 5
29 more
  1. 2025On Universality Classes of Equivariant Networkscited by 4
  2. 2025Bi-Lipschitz Ansatz for Anti-Symmetric Functionscited by 3
  3. 2025Spectral Graph Neural Networks are Incomplete on Graphs with a Simple Spectrumcited by 3
  4. 2025Scalable Non-Equivariant 3D Molecule Generation via Rotational Alignmentcited by 3
  5. 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networkscited by 3
  6. 2025InertialAR: Autoregressive 3D Molecule Generation with Inertial Framescited by 3
  7. 2026Data Augmentation: A Fourier Analysis Perspectivecited by 3
  8. 2025Representing spherical tensors with scalar-based machine-learning modelscited by 2
  9. 2025CP2: Leveraging Geometry for Conformal Prediction via Canonicalizationcited by 2
  10. 2026Inverting Data Transformations via Diffusion Samplingcited by 2
  11. 2026Efficient Learning and Symmetry Discovery under Exact Invariancescited by 2
  12. 2025Diagonal Symmetrization of Neural Network Solvers for the Many-Electron Schr"odinger Equationcited by 1
  13. 2025Tensor Decomposition Networks for Fast Machine Learning Interatomic Potential Computationscited by 1
  14. 2025Can Data-Driven Dynamics Reveal Hidden Physics? There Is A Need for Interpretable Neural Operatorscited by 1
  15. 2025On Uncertainty Calibration for Equivariant Functionscited by 1
  16. 2026Quantitative Approximation Rates for Group Equivariant Learningcited by 1
  17. 2024Approximating invariant functions with the sorting trick is theoretically justifiedcited by 0
  18. 2024Improving Molecular Modeling with Geometric GNNs: an Empirical Studycited by 0
  19. 2024SymDiff: Equivariant Diffusion via Stochastic Symmetrisationcited by 0
  20. 2025CrystalFramer: Rethinking the Role of Frames for SE(3)-Invariant Crystal Structure Modelingcited by 0
  21. 2026Efficient Equivariant High-Order Crystal Tensor Prediction via Cartesian Local-Environment Many-Body Couplingcited by 0
  22. 2026Diffeomorphism-Equivariant Neural Networkscited by 0
  23. 2026When and How to Canonize: A Generalization Perspectivecited by 0
  24. 2026PACE-FNO: Physics-Aligned Canonical Equivariance for Fourier Neural Operatorscited by 0
  25. 2026Weisfeiler-Leman Is Incomplete on Simple Spectrum Graphs, so Canonicalize Themcited by 0
  26. 2026Zero-Shot Test-Time Canonicalization using Out-of-Distribution Scoringcited by 0
  27. 2026Rotational Equivariance in Machine Learning: A Comprehensive Tutorialcited by 0
  28. 2026Sparse Data Augmentation for Optimization with Provable Guaranteescited by 0
  29. 2026GLASS: Global Latent Aggregation with Slot-based Set Decoding for Scalable All-Atom Crystal Generationcited by 0