On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups
Not on the map. Why?
Abstract (arXiv)
Convolutional neural networks have been extremely successful in the image recognition domain because they ensure equivariance to translations. There have been many recent attempts to generalize this framework to other domains, including graphs and data lying on manifolds. In this paper we give a rigorous, theoretical treatment of convolution and equivariance in neural networks with respect to not just translations, but the action of any compact group. Our main result is to prove that (given some natural constraints) convolutional structure is not just a sufficient, but also a necessary condition for equivariance to the action of a compact group. Our exposition makes use of concepts from representation theory and noncommutative harmonic analysis and derives new generalized convolution formulae.
Key facts. Cited by 300 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 56; 2022: 60; 2023: 55; 2024: 42; 2025: 47; 2026: 40.
300 papers.
Sort:
By area:
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2024FlowMM: Generating Materials with Riemannian Flow Matchingcited by 109
- 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 107
- 2022Approximately Equivariant Networks for Imperfectly Symmetric Dynamicscited by 97
- 2022Clifford Neural Layers for PDE Modelingcited by 92
- 2021Provably Strict Generalisation Benefit for Equivariant Modelscited by 91
38 more
- 2021Automatic Symmetry Discovery with Lie Algebra Convolutional Networkcited by 83
- 2021Is Attention Better Than Matrix Decomposition?cited by 77
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 76
- 2023Permutation Equivariant Neural Functionalscited by 70
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 65
- 2022Theory for Equivariant Quantum Neural Networkscited by 62
- 2022Theory of Graph Neural Networks: Representation and Learningcited by 61
- 2021Robust Equivariant Imaging: a fully unsupervised framework for learning to image from noisy and partial measurementscited by 56
- 2022Group-Invariant Quantum Machine Learningcited by 56
- 2023Clifford Group Equivariant Neural Networkscited by 55
- 2022Learning Symmetric Embeddings for Equivariant World Modelscited by 54
- 2021Lossy Compression for Lossless Predictioncited by 52
- 2022Theoretical Guarantees for Permutation-Equivariant Quantum Neural Networkscited by 52
- 2023Neural Functional Transformerscited by 52
- 2023Approximation-Generalization Trade-offs under (Approximate) Group Equivariancecited by 46
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
- 2023Generative Adversarial Symmetry Discoverycited by 42
- 2022Relaxing Equivariance Constraints with Non-stationary Continuous Filterscited by 41
- 2023Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation Spacecited by 41
- 2022Representation Theory for Geometric Quantum Machine Learningcited by 40
- 2021Autobahn: Automorphism-based Graph Neural Netscited by 39
- 2022Unsupervised Learning of Group Invariant and Equivariant Representationscited by 39
- 2021Transporting Causal Mechanisms for Unsupervised Domain Adaptationcited by 38
- 2021Ab-Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functionscited by 37
- 2023EquivAct: SIM(3)-Equivariant Visuomotor Policies beyond Rigid Object Manipulationcited by 37
- 2021DISCO: accurate Discrete Scale Convolutionscited by 36
- 2021Category Theory in Machine Learningcited by 36
- 2021Top-N: Equivariant set and graph generation without exchangeabilitycited by 36
- 2025Symmetry in Neural Network Parameter Spacescited by 36
- 2023Equivariant Deep Weight Space Alignmentcited by 35
- 2021Skip-Convolutions for Efficient Video Processingcited by 32
- 2021Provably Strict Generalisation Benefit for Invariance in Kernel Methodscited by 30
- 2021Symmetry-via-Duality: Invariant Neural Network Densities from Parameter-Space Correlatorscited by 29
- 2021Speeding up Learning Quantum States through Group Equivariant Convolutional Quantum Ans"atzecited by 29
- 2022Data-driven emergence of convolutional structure in neural networkscited by 29
- 2023Self-Supervised Learning with Lie Symmetries for Partial Differential Equationscited by 29
- 2023Latent Space Symmetry Discoverycited by 29
- 2022A case for using rotation invariant features in state of the art feature matcherscited by 27
50 most cited of 300 All 300 (JSON)
- 2026Graph Metanetworks for Transformer Based Language Models13 Oct 2026
- 2026Looped Reasoning Finishes Earlier Than You Think13 Oct 2026
- 2026SO(3)-RoPE for Spherical Transformers5 Oct 2026
- 2026Warm-starting PDE solvers with any-dimensional machine learning30 Sep 2026
- 2026Transversal Pooling Neural Networks28 Sep 2026
- 2026LieDiscover: Adaptive Symbolic Library Construction for Explicit Open-form Symmetry Discovery27 Sep 2026
- 2026Budgeted Quotient-Residual Guidance for Frozen Pocket-Conditioned Molecular Diffusion25 Sep 2026
- 2026Theory for groupoid equivariant neural networks: an approach for steerable CNNs on bounded domains22 Sep 2026
- 2026Inherent Trade-offs when Enforcing Correct Data Symmetries in Multi-head Self-attention31 Aug 2026
- 2026Twin Worlds: Equivariance-Based Abstention for Evidence-Grounded Reasoning28 Aug 2026
- 2026Boosting Data Augmentation with Stochastic Weight Averaging14 Aug 2026
- 2026Flash EQ-Linear: Accelerating Equivariant Linear Layers via Group-wise Discrete Fourier Transform23 Jul 2026
38 more
- 2026EdgeBench: Unveiling Scaling Laws of Learning from Real-World Environments6 Jul 2026
- 2026Group-Equivariant Poincar'e Convolutional Networks1 Jul 2026
- 2026Symmetry-Structured Neural Completion of Islamic Geometric Patterns from Sparse Control Geometry30 Jun 2026
- 2026A Unified Framework for Vision Transformers Equivariant to Discrete Subgroups of O(2)26 Jun 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026Equivariance and Augmentation for Bayesian Neural Networks24 Jun 2026
- 2026REViT: Roto-reflection Equivariant Convolutional Vision Transformer24 Jun 2026
- 2026What Your Model Threw Away and Why You'll Want It Back: Masking, Fingerprinting, and Privacy from Discarded Geometry17 Jun 2026
- 2026Revisiting Neural Processes via Fourier Transform and Volterra Series31 May 2026
- 2026Measuring the Symmetry--Data Exchange Rate31 May 2026
- 2026What are the Right Symmetries for Formal Theorem Proving?21 May 2026
- 2026Velocityformer: Broken-Symmetry-Matched Equivariant Graph Transformers for Cosmological Velocity Reconstruction20 May 2026
- 2026Stimulus symmetries can confound representational similarity analyses20 May 2026
- 2026Axiomatizing Neural Networks via Pursuit of Subspaces19 May 2026
- 2026Steerable Neural ODEs on Homogeneous Spaces11 May 2026
- 2026Operator-Guided Invariance Learning for Continuous Reinforcement Learning7 May 2026
- 2026Semantic Richness or Geometric Reasoning? The Fragility of VLM's Visual Invariance2 Apr 2026
- 2026Spectral methods: crucial for machine learning, natural for quantum computers?25 Mar 2026
- 2026Permutation-Equivariant 2D State Space Models: Theory and Canonical Architecture for Multivariate Time Series7 Mar 2026
- 2026Spectral Discovery of Continuous Symmetries via Generalized Fourier Transforms7 Mar 2026
- 2026A Hypertoroidal Covering for Perfect Color Equivariance4 Mar 2026
- 2026Orthogonal Uplift Learning with Permutation-Invariant Representations for Combinatorial Treatments23 Feb 2026
- 2026Toward Manifest Relationality in Transformers via Symmetry Reduction21 Feb 2026
- 2026Inverting Data Transformations via Diffusion Sampling9 Feb 2026
- 2026Diffeomorphism-Equivariant Neural Networks6 Feb 2026
- 2026Breaking Symmetry Bottlenecks in GNN Readouts5 Feb 2026
- 2026Recurrent Equivariant Constraint Modulation: Learning Per-Layer Symmetry Relaxation from Data2 Feb 2026
- 2026Artificial Intelligence and Symmetries: Learning, Encoding, and Discovering Structure in Physical Data2 Feb 2026
- 2025Group Cross-Correlations with Faintly Constrained Filters31 Dec 2025
- 2025Discovering Symmetry Groups with Flow Matching23 Dec 2025
- 2025A Single Architecture for Representing Invariance Under Any Space Group16 Dec 2025
- 2025An Operator-Consistent Graph Neural Network for Learning Diffusion Dynamics on Irregular Meshes5 Dec 2025
- 2025Categorical Equivariant Deep Learning: Category-Equivariant Neural Networks and Universal Approximation Theorems23 Nov 2025
- 2025Learning with Category-Equivariant Architectures for Human Activity Recognition3 Nov 2025
- 2025Learning with Category-Equivariant Representations for Human Activity Recognition2 Nov 2025
- 2025Equivariance by Contrast: Identifiable Equivariant Embeddings from Unlabeled Finite Group Actions24 Oct 2025
- 2025Symmetries in PAC-Bayesian Learning20 Oct 2025
- 2025On Universality of Deep Equivariant Networks17 Oct 2025
50 newest of 300 All 300 (JSON)
- 2024Structure Preserving Diffusion Modelscited by 3
- 2026Inverting Data Transformations via Diffusion Samplingcited by 2
- 2026Inverting Data Transformations via Diffusion Sampling9 Feb 2026
- 2024Structure Preserving Diffusion Models29 Feb 2024
- 2022Learning Symmetric Embeddings for Equivariant World Modelscited by 54
- 2022Learning Symmetric Embeddings for Equivariant World Models24 Apr 2022
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2024FlowMM: Generating Materials with Riemannian Flow Matchingcited by 109
- 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 107
- 2022Approximately Equivariant Networks for Imperfectly Symmetric Dynamicscited by 97
- 2022Clifford Neural Layers for PDE Modelingcited by 92
- 2021Provably Strict Generalisation Benefit for Equivariant Modelscited by 91
12 most cited of 292 All 292 (JSON)
- 2026Graph Metanetworks for Transformer Based Language Models13 Oct 2026
- 2026Looped Reasoning Finishes Earlier Than You Think13 Oct 2026
- 2026SO(3)-RoPE for Spherical Transformers5 Oct 2026
- 2026Warm-starting PDE solvers with any-dimensional machine learning30 Sep 2026
- 2026Transversal Pooling Neural Networks28 Sep 2026
- 2026LieDiscover: Adaptive Symbolic Library Construction for Explicit Open-form Symmetry Discovery27 Sep 2026
- 2026Budgeted Quotient-Residual Guidance for Frozen Pocket-Conditioned Molecular Diffusion25 Sep 2026
- 2026Theory for groupoid equivariant neural networks: an approach for steerable CNNs on bounded domains22 Sep 2026
- 2026Inherent Trade-offs when Enforcing Correct Data Symmetries in Multi-head Self-attention31 Aug 2026
- 2026Boosting Data Augmentation with Stochastic Weight Averaging14 Aug 2026
- 2026Flash EQ-Linear: Accelerating Equivariant Linear Layers via Group-wise Discrete Fourier Transform23 Jul 2026
- 2026EdgeBench: Unveiling Scaling Laws of Learning from Real-World Environments6 Jul 2026
12 newest of 292 All 292 (JSON)