mlsanityData to 14 Oct 2026

Learning Polynomial Problems with SL(2,ℝ) Equivariance

arXiv 2312.02146 ↗First posted 4 Dec 2023cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Optimizing and certifying the positivity of polynomials are fundamental primitives across mathematics and engineering applications, from dynamical systems to operations research. However, solving these problems in practice requires large semidefinite programs, with poor scaling in dimension and degree. In this work, we demonstrate for the first time that neural networks can effectively solve such problems in a data-driven fashion, achieving tenfold speedups while retaining high accuracy. Moreover, we observe that these polynomial learning problems are equivariant to the non-compact group SL(2,ℝ), which consists of area-preserving linear transformations. We therefore adapt our learning pipelines to accommodate this structure, including data augmentation, a new SL(2,ℝ)-equivariant architecture, and an architecture equivariant with respect to its maximal compact subgroup, SO(2, ℝ). Surprisingly, the most successful approaches in practice do not enforce equivariance to the entire group, which we prove arises from an unusual lack of architecture universality for SL(2,ℝ) in particular. A consequence of this result, which is of independent interest, is that there exists an equivariant function for which there is no sequence of equivariant polynomials multiplied by arbitrary invariants that approximates the original function. This is a rare example of a symmetric problem where data augmentation outperforms a fully equivariant architecture, and provides interesting lessons in both theory and practice for other problems with non-compact symmetries.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 56 references that are in the map. First posted on arXiv 4 Dec 2023.

Builds on

24 of 56 references.

References · 24

  1. 2021Convex optimizationcited by 2,515
  2. 2016Group Equivariant Convolutional Networkscited by 1,165
  3. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
  4. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 708
  5. 2017Solving high-dimensional partial differential equations using deep learningcited by 556
  6. 2018Spherical CNNscited by 456
  7. 2019Cormorant: Covariant Molecular Neural Networkscited by 263
  8. 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
  9. 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
  10. 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 187
  11. 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 171
  12. 2021Frame Averaging for Invariant and Equivariant Network Designcited by 168
12 more
  1. 2018Universal approximations of invariant maps by neural networkscited by 127
  2. 2020Lorentz Group Equivariant Neural Network for Particle Physicscited by 121
  3. 2021Provably Strict Generalisation Benefit for Equivariant Modelscited by 91
  4. 2020On the Universality of Rotation Equivariant Point Cloud Networkscited by 80
  5. 2022The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetrycited by 33
  6. 2022Equivariance versus Augmentation for Spherical Imagescited by 24
  7. 2021Enabling equivariance for arbitrary Lie groupscited by 22
  8. 2023A General Theory of Correct, Incorrect, and Extrinsic Equivariancecited by 19
  9. 2022A PAC-Bayesian Generalization Bound for Equivariant Networkscited by 18
  10. 2015Some Applications of Polynomial Optimization in Operations Research and Real-Time Decision Makingcited by 11
  11. 2021Invariant polynomials and machine learningcited by 4
  12. 2023Improved Nonnegativity Testing in the Bernstein Basis via Geometric Meanscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.