Any-dimensional equivariant neural networks
Not on the map. Why?
Abstract (arXiv)
Traditional supervised learning aims to learn an unknown mapping by fitting a function to a set of input-output pairs with a fixed dimension. The fitted function is then defined on inputs of the same dimension. However, in many settings, the unknown mapping takes inputs in any dimension; examples include graph parameters defined on graphs of any size and physics quantities defined on an arbitrary number of particles. We leverage a newly-discovered phenomenon in algebraic topology, called representation stability, to define equivariant neural networks that can be trained with data in a fixed dimension and then extended to accept inputs in any dimension. Our approach is user-friendly, requiring only the network architecture and the groups for equivariance, and can be combined with any training procedure. We provide a simple open-source implementation of our methods and offer preliminary numerical experiments.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 17 of its 61 references that are in the map. First posted on arXiv 10 Jun 2023.
Builds on
17 of 61 references.
References · 17
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2017Deep Setscited by 1,394
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 348
- 2018Invariant and Equivariant Graph Networkscited by 339
- 2016Steerable CNNscited by 298
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 296
- 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 185
- 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 168
5 more
- 2021Scalars are universal: Equivariant machine learning, structured like classical physicscited by 127
- 2020Lorentz Group Equivariant Neural Network for Particle Physicscited by 120
- 2020Building powerful and equivariant graph neural networks with structural message-passingcited by 95
- 2022What is an equivariant neural network?cited by 21
- 2022Dimensionless machine learning: Imposing exact units equivariancecited by 16
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 3.
8 papers.
- 2024Symmetry-Based Structured Matrices for Efficient Approximately Equivariant Networkscited by 7
- 2024Graph neural networks and non-commuting operatorscited by 5
- 2024From Learning to Optimize to Learning Optimization Algorithmscited by 2
- 2025Towards Coordinate- and Dimension-Agnostic Machine Learning for Partial Differential Equationscited by 1
- 2026Any-Dimensional Invariant Universalitycited by 1
- 2025Axial Neural Networks for Dimension-Free Foundation Modelscited by 0
- 2026Graded Representation Theory of Equivariant Neural Networkscited by 0
- 2026Warm-starting PDE solvers with any-dimensional machine learningcited by 0
- 2026Warm-starting PDE solvers with any-dimensional machine learning30 Sep 2026
- 2026Graded Representation Theory of Equivariant Neural Networks22 Sep 2026
- 2026Any-Dimensional Invariant Universality22 May 2026
- 2025Axial Neural Networks for Dimension-Free Foundation Models15 Oct 2025
- 2025Towards Coordinate- and Dimension-Agnostic Machine Learning for Partial Differential Equations22 May 2025
- 2024Graph neural networks and non-commuting operators6 Nov 2024
- 2024Symmetry-Based Structured Matrices for Efficient Approximately Equivariant Networks18 Sep 2024
- 2024From Learning to Optimize to Learning Optimization Algorithms28 May 2024