Universal approximations of permutation invariant/equivariant functions by deep neural networks
Not on the map. Why?
Abstract (arXiv)
In this paper, we develop a theory about the relationship between G-invariant/equivariant functions and deep neural networks for finite group G. Especially, for a given G-invariant/equivariant function, we construct its universal approximator by deep neural network whose layers equip G-actions and each affine transformations are G-equivariant/invariant. Due to representation theory, we can show that this approximator has exponentially fewer free parameters than usual models.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 9; 2024: 2; 2025: 3; 2026: 2.
29 papers.
Sort:
By area:
- 2021Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformerscited by 101
- 2022Equivariant Hypergraph Diffusion Neural Operatorscited by 45
- 2022Low Dimensional Invariant Embeddings for Universal Geometric Learningcited by 38
- 2023The Exact Sample Complexity Gain from Invariances for Kernel Regressioncited by 27
- 2023Explainable Equivariant Neural Networks for Particle Physics: PELICANcited by 22
- 2022Permutation Invariant Representations with Applications to Graph Deep Learningcited by 20
- 2021Explicitly antisymmetrized neural network layers for variational Monte Carlo simulationcited by 14
- 2021Neural Trees for Learning on Graphscited by 13
- 2022Universality of Group Convolutional Neural Networks Based on Ridgelet Analysis on Groupscited by 11
- 2021Symmetry reduction for deep reinforcement learning active control of chaotic spatiotemporal dynamicscited by 10
- 2022Deep Neural Network Approximation of Invariant Functions through Dynamical Systemscited by 8
- 2023Postprocessing of Ensemble Weather Forecasts Using Permutation-invariant Neural Networkscited by 7
17 more
- 2023Polynomial Width is Sufficient for Set Representation with High-dimensional Featurescited by 6
- 2022KASAM: Spline Additive Models for Function Approximationcited by 4
- 2023Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectivescited by 4
- 2023Addressing imperfect symmetry: A novel symmetry-learning actor-critic extensioncited by 4
- 2025Approximation of Permutation Invariant Polynomials by Transformers: Efficient Construction in Column-Sizecited by 3
- 2026Rethinking Zero-Shot Time Series Classification: From Task-specific Classifiers to In-Context Inferencecited by 3
- 2021Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?cited by 2
- 2023P-Tensors: a General Formalism for Constructing Higher Order Message Passing Networkscited by 2
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learningcited by 2
- 2026Any-Dimensional Invariant Universalitycited by 1
- 2021Pointspectrum: Equivariance Meets Laplacian Filtering for Graph Representation Learningcited by 0
- 2022On the Approximation and Complexity of Deep Neural Networks to Invariant Functionscited by 0
- 2023A Structural Approach to the Design of Domain Specific Neural Network Architecturescited by 0
- 2023PolyGET: Accelerating Polymer Simulations by Accurate and Generalizable Forcefield with Equivariant Transformercited by 0
- 2024Decomposition of Equivariant Maps via Invariant Maps: Application to Universal Approximation under Symmetrycited by 0
- 2025Transformers Are Universally Consistentcited by 0
- 2025On the Dimension-Free Approximation of Deep Neural Networks for Symmetric Korobov Functionscited by 0
- 2026Any-Dimensional Invariant Universality22 May 2026
- 2026Rethinking Zero-Shot Time Series Classification: From Task-specific Classifiers to In-Context Inference31 Jan 2026
- 2025On the Dimension-Free Approximation of Deep Neural Networks for Symmetric Korobov Functions16 Nov 2025
- 2025Transformers Are Universally Consistent30 May 2025
- 2025Approximation of Permutation Invariant Polynomials by Transformers: Efficient Construction in Column-Size17 Feb 2025
- 2024Decomposition of Equivariant Maps via Invariant Maps: Application to Universal Approximation under Symmetry25 Sep 2024
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning11 Sep 2024
- 2023Postprocessing of Ensemble Weather Forecasts Using Permutation-invariant Neural Networks8 Sep 2023
- 2023Addressing imperfect symmetry: A novel symmetry-learning actor-critic extension6 Sep 2023
- 2023PolyGET: Accelerating Polymer Simulations by Accurate and Generalizable Forcefield with Equivariant Transformer1 Sep 2023
- 2023Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectives1 Sep 2023
- 2023Explainable Equivariant Neural Networks for Particle Physics: PELICAN31 Jul 2023
17 more
- 2023Polynomial Width is Sufficient for Set Representation with High-dimensional Features8 Jul 2023
- 2023P-Tensors: a General Formalism for Constructing Higher Order Message Passing Networks19 Jun 2023
- 2023The Exact Sample Complexity Gain from Invariances for Kernel Regression24 Mar 2023
- 2023A Structural Approach to the Design of Domain Specific Neural Network Architectures23 Jan 2023
- 2022On the Approximation and Complexity of Deep Neural Networks to Invariant Functions27 Oct 2022
- 2022Deep Neural Network Approximation of Invariant Functions through Dynamical Systems18 Aug 2022
- 2022Equivariant Hypergraph Diffusion Neural Operators14 Jul 2022
- 2022Universality of Group Convolutional Neural Networks Based on Ridgelet Analysis on Groups30 May 2022
- 2022KASAM: Spline Additive Models for Function Approximation12 May 2022
- 2022Low Dimensional Invariant Embeddings for Universal Geometric Learning5 May 2022
- 2022Permutation Invariant Representations with Applications to Graph Deep Learning14 Mar 2022
- 2021Explicitly antisymmetrized neural network layers for variational Monte Carlo simulation7 Dec 2021
- 2021Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?14 Oct 2021
- 2021Pointspectrum: Equivariance Meets Laplacian Filtering for Graph Representation Learning6 Sep 2021
- 2021Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers28 Jul 2021
- 2021Neural Trees for Learning on Graphs15 May 2021
- 2021Symmetry reduction for deep reinforcement learning active control of chaotic spatiotemporal dynamics9 Apr 2021
- 2022KASAM: Spline Additive Models for Function Approximationcited by 4
- 2022KASAM: Spline Additive Models for Function Approximation12 May 2022
- 2021Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformerscited by 101
- 2022Equivariant Hypergraph Diffusion Neural Operatorscited by 45
- 2022Low Dimensional Invariant Embeddings for Universal Geometric Learningcited by 38
- 2023The Exact Sample Complexity Gain from Invariances for Kernel Regressioncited by 27
- 2023Explainable Equivariant Neural Networks for Particle Physics: PELICANcited by 22
- 2022Permutation Invariant Representations with Applications to Graph Deep Learningcited by 20
- 2021Explicitly antisymmetrized neural network layers for variational Monte Carlo simulationcited by 14
- 2021Neural Trees for Learning on Graphscited by 13
- 2022Universality of Group Convolutional Neural Networks Based on Ridgelet Analysis on Groupscited by 11
- 2021Symmetry reduction for deep reinforcement learning active control of chaotic spatiotemporal dynamicscited by 10
- 2022Deep Neural Network Approximation of Invariant Functions through Dynamical Systemscited by 8
- 2023Postprocessing of Ensemble Weather Forecasts Using Permutation-invariant Neural Networkscited by 7
12 most cited of 27 All 27 (JSON)
- 2026Any-Dimensional Invariant Universality22 May 2026
- 2026Rethinking Zero-Shot Time Series Classification: From Task-specific Classifiers to In-Context Inference31 Jan 2026
- 2025On the Dimension-Free Approximation of Deep Neural Networks for Symmetric Korobov Functions16 Nov 2025
- 2025Transformers Are Universally Consistent30 May 2025
- 2025Approximation of Permutation Invariant Polynomials by Transformers: Efficient Construction in Column-Size17 Feb 2025
- 2024Decomposition of Equivariant Maps via Invariant Maps: Application to Universal Approximation under Symmetry25 Sep 2024
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning11 Sep 2024
- 2023Postprocessing of Ensemble Weather Forecasts Using Permutation-invariant Neural Networks8 Sep 2023
- 2023Addressing imperfect symmetry: A novel symmetry-learning actor-critic extension6 Sep 2023
- 2023PolyGET: Accelerating Polymer Simulations by Accurate and Generalizable Forcefield with Equivariant Transformer1 Sep 2023
- 2023Explainable Equivariant Neural Networks for Particle Physics: PELICAN31 Jul 2023
- 2023Polynomial Width is Sufficient for Set Representation with High-dimensional Features8 Jul 2023
12 newest of 27 All 27 (JSON)