mlsanityData to 14 Oct 2026

A Unified Framework for Discovering Discrete Symmetries

arXiv 2309.02898 ↗First posted 6 Sep 2023cs.LG cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

We consider the problem of learning a function respecting a symmetry from among a class of symmetries. We develop a unified framework that enables symmetry discovery across a broad range of subgroups including locally symmetric, dihedral and cyclic subgroups. At the core of the framework is a novel architecture composed of linear, matrix-valued and non-linear functions that expresses functions invariant to these subgroups in a principled manner. The structure of the architecture enables us to leverage multi-armed bandit algorithms and gradient descent to efficiently optimize over the linear and the non-linear functions, respectively, and to infer the symmetry that is ultimately learnt. We also discuss the necessity of the matrix-valued functions in the architecture. Experiments on image-digit sum and polynomial regression tasks demonstrate the effectiveness of our approach.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 34 of its 70 references that are in the map. First posted on arXiv 6 Sep 2023.

Builds on

34 of 70 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  5. 2017Deep Setscited by 1,421
  6. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
  7. 2016Group Equivariant Convolutional Networkscited by 1,165
  8. 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
  9. 2018Spherical CNNscited by 456
  10. 2019General E(2)-Equivariant Steerable CNNscited by 446
  11. 2016Steerable CNNscited by 305
  12. 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 300
22 more
  1. 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 248
  2. 2022Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problemcited by 236
  3. 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 228
  4. 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 194
  5. 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 171
  6. 2019On the Universality of Invariant Networkscited by 152
  7. 2017Equivariance Through Parameter-Sharingcited by 141
  8. 2020Incorporating Symmetry into Deep Dynamics Models for Improved Generalizationcited by 126
  9. 2020Lorentz Group Equivariant Neural Network for Particle Physicscited by 121
  10. 2018Janossy Pooling: Learning Deep Permutation-Invariant Functions for Variable-Size Inputscited by 98
  11. 2019Sequential Experimental Design for Transductive Linear Banditscited by 91
  12. 2021Automatic Symmetry Discovery with Lie Algebra Convolutional Networkcited by 83
  13. 2020Meta-Learning Symmetries by Reparameterizationcited by 76
  14. 2018Deep Models of Interactions Across Setscited by 69
  15. 2021Universal Approximation of Functions on Setscited by 62
  16. 2020Learning Invariances in Neural Networkscited by 52
  17. 2020Universal Equivariant Multilayer Perceptronscited by 49
  18. 2023Generative Adversarial Symmetry Discoverycited by 42
  19. 2014Learning the Irreducible Representations of Commutative Lie Groupscited by 41
  20. 2020Theoretical Aspects of Group Equivariant Neural Networkscited by 25
  21. 2020Analysis and Design of Thompson Sampling for Stochastic Partial Monitoringcited by 9
  22. 2022Learning to Infer Structures of Network Gamescited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 2; 2026: 3.

7 papers.