mlsanityData to 7 Oct 2026

Preserving Continuous Symmetry in Discrete Spaces: Geometric-Aware Quantization for SO(3)-Equivariant GNNs

arXiv 2603.05343 ↗First posted 5 Mar 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Equivariant Graph Neural Networks (GNNs) are essential for physically consistent molecular simulations but suffer from high computational costs and memory bottlenecks, especially with high-order representations. While low-bit quantization offers a solution, applying it naively to rotation-sensitive features destroys the SO(3)-equivariant structure, leading to significant errors and violations of conservation laws. To address this issue, in this work, we propose a Geometric-Aware Quantization (GAQ) framework that compresses and accelerates equivariant models while rigorously preserving continuous symmetry in discrete spaces. Our approach introduces three key contributions: (1) a Magnitude-Direction Decoupled Quantization (MDDQ) scheme that separates invariant lengths from equivariant orientations to maintain geometric fidelity; (2) a symmetry-aware training strategy that treats scalar and vector features with distinct quantization schedules; and (3) a robust attention normalization mechanism to stabilize gradients in low-bit regimes. Experiments on the rMD17 benchmark demonstrate that our W4A8 models match the accuracy of FP32 baselines (9.31 meV vs. 23.20 meV) while reducing Local Equivariance Error (LEE) by over 30x compared to naive quantization. On consumer hardware, GAQ achieves 2.39x inference speedup and 4x memory reduction, enabling stable, energy-conserving molecular dynamics simulations for nanosecond timescales.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 31 references that are in the map. First posted on arXiv 5 Mar 2026.

Builds on

25 of 31 references.

References · 25

  1. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  2. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
  3. 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,338
  4. 2016Group Equivariant Convolutional Networkscited by 1,154
  5. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  6. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  7. 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
  8. 2019Learned Step Size Quantizationcited by 604
  9. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  10. 2016DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradientscited by 557
  11. 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 517
  12. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
13 more
  1. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
  2. 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 348
  3. 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 293
  4. 2020Query-Key Normalization for Transformerscited by 266
  5. 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 254
  6. 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 185
  7. 2022QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantizationcited by 175
  8. 2021SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effectscited by 103
  9. 2020Degree-Quant: Quantization-Aware Training for Graph Neural Networkscited by 93
  10. 2022The Lie Derivative for Measuring Learned Equivariancecited by 51
  11. 2022So3krates: Equivariant attention for interactions on arbitrary length-scales in molecular systemscited by 39
  12. 2022Exact conservation laws for neural network integrators of dynamical systemscited by 15
  13. 2025Optimal Invariant Bases for Atomistic Machine Learningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Scalable Non-Equivariant 3D Molecule Generation via Rotational Alignment
  2. 2025Training Dynamics of Learning 3D-Rotational Equivariance
  3. 2025Improving Equivariant Networks with Probabilistic Symmetry Breaking
  4. 2025Symmetry-Aware Generative Modeling through Learned Canonicalization
  5. 2026GEqTrain: A Configuration-Driven Framework for Retargeting Equivariant Graph Neural Networks Across 3D Scientific Tasks
  6. 2022Learning Symmetric Embeddings for Equivariant World Models
  7. 2025Large Language-Geometry Model: When LLM meets Equivariance
  8. 2026Balancing Symmetry and Efficiency in Graph Flow Matching