The general theory of permutation equivarant neural networks and higher order graph variational encoders
Not on the map. Why?
Abstract (arXiv)
Previous work on symmetric group equivariant neural networks generally only considered the case where the group acts by permuting the elements of a single vector. In this paper we derive formulae for general permutation equivariant layers, including the case where the layer acts on matrices by permuting their rows and columns simultaneously. This case arises naturally in graph learning and relation learning applications. As a specific case of higher order permutation equivariant networks, we present a second order graph variational encoder, and show that the latent distribution of equivariant generative models must be exchangeable. We demonstrate the efficacy of this architecture on the tasks of link prediction in citation graphs and molecular graph generation.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 7; 2023: 6; 2024: 6; 2025: 3; 2026: 2.
28 papers.
Sort:
By area:
- 2023Permutation Equivariant Neural Functionalscited by 69
- 2022Theory for Equivariant Quantum Neural Networkscited by 60
- 2022Theoretical Guarantees for Permutation-Equivariant Quantum Neural Networkscited by 52
- 2023Neural Functional Transformerscited by 50
- 2021Autobahn: Automorphism-based Graph Neural Netscited by 39
- 2021Speeding up Learning Quantum States through Group Equivariant Convolutional Quantum Ans"atzecited by 29
- 2024Universal Neural Functionalscited by 25
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2022Temporal Multiresolution Graph Neural Networks For Epidemic Predictioncited by 11
- 2022Turbocharging Solution Concepts: Solving NEs, CEs and CCEs with Neural Equilibrium Solverscited by 10
- 2022Connecting Permutation Equivariant Neural Networks and Partition Diagramscited by 9
- 2024Steerable Transformers for Volumetric Datacited by 8
16 more
- 2023Fast computation of permutation equivariant layers with the partition algebracited by 7
- 2023A Comparison Between Invariant and Equivariant Classical and Quantum Graph Neural Networkscited by 6
- 2022Unifying O(3) Equivariant Neural Networks Design with Tensor-Network Formalismcited by 3
- 2025Graph Counterfactual Explainable AI via Latent Space Traversalcited by 3
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networkscited by 3
- 2023P-Tensors: a General Formalism for Constructing Higher Order Message Passing Networkscited by 2
- 2024Interpreting Equivariant Representationscited by 2
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learningcited by 2
- 2024Revisiting Multi-Permutation Equivariance through the Lens of Irreducible Representationscited by 2
- 2022Equivariant neural networks for recovery of Hadamard matricescited by 1
- 2026EquiFusion: Kinematics-Agnostic Human Motion Prediction via Equivariant Latent Diffusioncited by 1
- 2021Symmetry-aware Neural Architecture for Embodied Visual Navigationcited by 0
- 2023Target-aware Variational Auto-encoders for Ligand Generation with Multimodal Protein Representation Learningcited by 0
- 2024Range-aware Positional Encoding via High-order Pretraining: Theory and Practicecited by 0
- 2025Permutation Equivariant Neural Networks for Symmetric Tensorscited by 0
- 2026Eigenvalues of the Hessian in Deep Learning: The Origin of Symmetry and Its Breakingcited by 0
- 2026Eigenvalues of the Hessian in Deep Learning: The Origin of Symmetry and Its Breaking7 Oct 2026
- 2026EquiFusion: Kinematics-Agnostic Human Motion Prediction via Equivariant Latent Diffusion13 Jul 2026
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networks29 Sep 2025
- 2025Permutation Equivariant Neural Networks for Symmetric Tensors14 Mar 2025
- 2025Graph Counterfactual Explainable AI via Latent Space Traversal15 Jan 2025
- 2024Revisiting Multi-Permutation Equivariance through the Lens of Irreducible Representations9 Oct 2024
- 2024Range-aware Positional Encoding via High-order Pretraining: Theory and Practice27 Sep 2024
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning11 Sep 2024
- 2024Steerable Transformers for Volumetric Data24 May 2024
- 2024Universal Neural Functionals7 Feb 2024
- 2024Interpreting Equivariant Representations23 Jan 2024
- 2023A Comparison Between Invariant and Equivariant Classical and Quantum Graph Neural Networks30 Nov 2023
16 more
- 2023Target-aware Variational Auto-encoders for Ligand Generation with Multimodal Protein Representation Learning2 Aug 2023
- 2023P-Tensors: a General Formalism for Constructing Higher Order Message Passing Networks19 Jun 2023
- 2023Neural Functional Transformers22 May 2023
- 2023Fast computation of permutation equivariant layers with the partition algebra10 Mar 2023
- 2023Permutation Equivariant Neural Functionals27 Feb 2023
- 2022Connecting Permutation Equivariant Neural Networks and Partition Diagrams16 Dec 2022
- 2022Unifying O(3) Equivariant Neural Networks Design with Tensor-Network Formalism14 Nov 2022
- 2022Theoretical Guarantees for Permutation-Equivariant Quantum Neural Networks18 Oct 2022
- 2022Turbocharging Solution Concepts: Solving NEs, CEs and CCEs with Neural Equilibrium Solvers17 Oct 2022
- 2022Theory for Equivariant Quantum Neural Networks16 Oct 2022
- 2022Temporal Multiresolution Graph Neural Networks For Epidemic Prediction30 May 2022
- 2022Equivariant neural networks for recovery of Hadamard matrices31 Jan 2022
- 2021Symmetry-aware Neural Architecture for Embodied Visual Navigation17 Dec 2021
- 2021Speeding up Learning Quantum States through Group Equivariant Convolutional Quantum Ans"atze14 Dec 2021
- 2021Multiresolution Equivariant Graph Variational Autoencoder2 Jun 2021
- 2021Autobahn: Automorphism-based Graph Neural Nets2 Mar 2021
- 2023Permutation Equivariant Neural Functionalscited by 69
- 2022Theory for Equivariant Quantum Neural Networkscited by 60
- 2022Theoretical Guarantees for Permutation-Equivariant Quantum Neural Networkscited by 52
- 2023Neural Functional Transformerscited by 50
- 2021Autobahn: Automorphism-based Graph Neural Netscited by 39
- 2021Speeding up Learning Quantum States through Group Equivariant Convolutional Quantum Ans"atzecited by 29
- 2024Universal Neural Functionalscited by 25
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2022Temporal Multiresolution Graph Neural Networks For Epidemic Predictioncited by 11
- 2022Turbocharging Solution Concepts: Solving NEs, CEs and CCEs with Neural Equilibrium Solverscited by 10
- 2022Connecting Permutation Equivariant Neural Networks and Partition Diagramscited by 9
- 2024Steerable Transformers for Volumetric Datacited by 8
12 most cited of 27 All 27 (JSON)
- 2026Eigenvalues of the Hessian in Deep Learning: The Origin of Symmetry and Its Breaking7 Oct 2026
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networks29 Sep 2025
- 2025Permutation Equivariant Neural Networks for Symmetric Tensors14 Mar 2025
- 2025Graph Counterfactual Explainable AI via Latent Space Traversal15 Jan 2025
- 2024Revisiting Multi-Permutation Equivariance through the Lens of Irreducible Representations9 Oct 2024
- 2024Range-aware Positional Encoding via High-order Pretraining: Theory and Practice27 Sep 2024
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning11 Sep 2024
- 2024Steerable Transformers for Volumetric Data24 May 2024
- 2024Universal Neural Functionals7 Feb 2024
- 2024Interpreting Equivariant Representations23 Jan 2024
- 2023A Comparison Between Invariant and Equivariant Classical and Quantum Graph Neural Networks30 Nov 2023
- 2023Target-aware Variational Auto-encoders for Ligand Generation with Multimodal Protein Representation Learning2 Aug 2023
12 newest of 27 All 27 (JSON)