What is an equivariant neural network?
Not on the map. Why?
Abstract (arXiv)
We explain equivariant neural networks, a notion underlying breakthroughs in machine learning from deep convolutional neural networks for computer vision to AlphaFold 2 for protein structure prediction, without assuming knowledge of equivariance or neural networks. The basic mathematical ideas are simple but are often obscured by engineering complications that come with practical realizations. We extract and focus on the mathematical aspects, and limit ourselves to a cursory treatment of the engineering issues at the end.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 11 of its 25 references that are in the map. First posted on arXiv 15 May 2022.
Builds on
11 of 25 references.
References · 11
- 2017Deep Setscited by 1,394
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2019Making Convolutional Networks Shift-Invariant Againcited by 390
- 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 348
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 296
- 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 185
- 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 168
- 2019On the Universality of Invariant Networkscited by 151
- 2019Deep neural network solution of the electronic Schr"odinger equationcited by 124
- 2020Lorentz Group Equivariant Neural Network for Particle Physicscited by 120
Built on by
Citing papers per year: 2022: 4; 2023: 7; 2024: 5; 2025: 3; 2026: 2.
21 papers.
Sort:
- 2025An Efficient Sparse Kernel Generator for O(3)-Equivariant Deep Networkscited by 19
- 2022Brauer's Group Equivariant Neural Networkscited by 17
- 2022Connecting Permutation Equivariant Neural Networks and Partition Diagramscited by 9
- 2023Any-dimensional equivariant neural networkscited by 8
- 2023A Comparison Between Invariant and Equivariant Classical and Quantum Graph Neural Networkscited by 6
- 2023How Jellyfish Characterise Alternating Group Equivariant Neural Networkscited by 5
- 2023Geometry of Linear Neural Networks: Equivariance and Invariance under Permutation Groupscited by 5
- 2023Graph Automorphism Group Equivariant Neural Networkscited by 4
- 2024Lorentz-Equivariant Quantum Graph Neural Network for High-Energy Physicscited by 4
- 2024Equivariant neural networks and piecewise linear representation theorycited by 3
- 2022Split personalities in Bayesian Neural Networks: the case for full marginalisationcited by 1
- 2022VC dimensions of group convolutional neural networkscited by 1
9 more
- 2024A large language model-type architecture for high-dimensional molecular potential energy surfacescited by 1
- 2023Discrete neural nets and polymorphic learningcited by 0
- 2023Compact Matrix Quantum Group Equivariant Neural Networkscited by 0
- 2024CNN-based Compressor Mass Flow Estimator in Industrial Aircraft Vapor Cycle Systemcited by 0
- 2024Lie-Equivariant Quantum Graph Neural Networkscited by 0
- 2025Precoder Learning by Leveraging Unitary Equivariance Propertycited by 0
- 2025Feature Shift Localization Networkcited by 0
- 2026Multi-objective optimization and quantum hybridization of equivariant deep learning interatomic potentialscited by 0
- 2026REViT: Roto-reflection Equivariant Convolutional Vision Transformercited by 0
- 2026REViT: Roto-reflection Equivariant Convolutional Vision Transformer24 Jun 2026
- 2026Multi-objective optimization and quantum hybridization of equivariant deep learning interatomic potentials18 Feb 2026
- 2025Feature Shift Localization Network10 Jun 2025
- 2025Precoder Learning by Leveraging Unitary Equivariance Property12 Mar 2025
- 2025An Efficient Sparse Kernel Generator for O(3)-Equivariant Deep Networks23 Jan 2025
- 2024A large language model-type architecture for high-dimensional molecular potential energy surfaces5 Dec 2024
- 2024Lie-Equivariant Quantum Graph Neural Networks22 Nov 2024
- 2024Lorentz-Equivariant Quantum Graph Neural Network for High-Energy Physics3 Nov 2024
- 2024Equivariant neural networks and piecewise linear representation theory1 Aug 2024
- 2024CNN-based Compressor Mass Flow Estimator in Industrial Aircraft Vapor Cycle System27 May 2024
- 2023A Comparison Between Invariant and Equivariant Classical and Quantum Graph Neural Networks30 Nov 2023
- 2023Compact Matrix Quantum Group Equivariant Neural Networks10 Nov 2023
9 more
- 2023Geometry of Linear Neural Networks: Equivariance and Invariance under Permutation Groups24 Sep 2023
- 2023Discrete neural nets and polymorphic learning29 Jul 2023
- 2023Graph Automorphism Group Equivariant Neural Networks15 Jul 2023
- 2023Any-dimensional equivariant neural networks10 Jun 2023
- 2023How Jellyfish Characterise Alternating Group Equivariant Neural Networks24 Jan 2023
- 2022VC dimensions of group convolutional neural networks19 Dec 2022
- 2022Connecting Permutation Equivariant Neural Networks and Partition Diagrams16 Dec 2022
- 2022Brauer's Group Equivariant Neural Networks16 Dec 2022
- 2022Split personalities in Bayesian Neural Networks: the case for full marginalisation23 May 2022
- 2025An Efficient Sparse Kernel Generator for O(3)-Equivariant Deep Networkscited by 19
- 2022Brauer's Group Equivariant Neural Networkscited by 17
- 2022Connecting Permutation Equivariant Neural Networks and Partition Diagramscited by 9
- 2023Any-dimensional equivariant neural networkscited by 8
- 2023A Comparison Between Invariant and Equivariant Classical and Quantum Graph Neural Networkscited by 6
- 2023How Jellyfish Characterise Alternating Group Equivariant Neural Networkscited by 5
- 2023Geometry of Linear Neural Networks: Equivariance and Invariance under Permutation Groupscited by 5
- 2023Graph Automorphism Group Equivariant Neural Networkscited by 4
- 2024Lorentz-Equivariant Quantum Graph Neural Network for High-Energy Physicscited by 4
- 2024Equivariant neural networks and piecewise linear representation theorycited by 3
- 2022Split personalities in Bayesian Neural Networks: the case for full marginalisationcited by 1
- 2022VC dimensions of group convolutional neural networkscited by 1
12 most cited of 21 All 21 (JSON)
- 2026REViT: Roto-reflection Equivariant Convolutional Vision Transformer24 Jun 2026
- 2026Multi-objective optimization and quantum hybridization of equivariant deep learning interatomic potentials18 Feb 2026
- 2025Feature Shift Localization Network10 Jun 2025
- 2025Precoder Learning by Leveraging Unitary Equivariance Property12 Mar 2025
- 2025An Efficient Sparse Kernel Generator for O(3)-Equivariant Deep Networks23 Jan 2025
- 2024A large language model-type architecture for high-dimensional molecular potential energy surfaces5 Dec 2024
- 2024Lie-Equivariant Quantum Graph Neural Networks22 Nov 2024
- 2024Lorentz-Equivariant Quantum Graph Neural Network for High-Energy Physics3 Nov 2024
- 2024Equivariant neural networks and piecewise linear representation theory1 Aug 2024
- 2024CNN-based Compressor Mass Flow Estimator in Industrial Aircraft Vapor Cycle System27 May 2024
- 2023A Comparison Between Invariant and Equivariant Classical and Quantum Graph Neural Networks30 Nov 2023
- 2023Compact Matrix Quantum Group Equivariant Neural Networks10 Nov 2023
12 newest of 21 All 21 (JSON)