mlsanityData to 14 Oct 2026

Fundamental Limits of Crystalline Equivariant Graph Neural Networks: A Circuit Complexity Perspective

arXiv 2510.05494 ↗First posted 7 Oct 2025cs.LG cs.CCcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph neural networks (GNNs) have become a core paradigm for learning on relational data. In materials science, equivariant GNNs (EGNNs) have emerged as a compelling backbone for crystalline-structure prediction, owing to their ability to respect Euclidean symmetries and periodic boundary conditions. Despite strong empirical performance, their expressive power in periodic, symmetry-constrained settings remains poorly understood. This work characterizes the intrinsic computational and expressive limits of EGNNs for crystalline-structure prediction through a circuit-complexity lens. We analyze the computations carried out by EGNN layers acting on node features, atomic coordinates, and lattice matrices, and prove that, under polynomial precision, embedding width d=O(n) for n nodes, O(1) layers, and O(1)-depth, O(n)-width MLP instantiations of the message/update/readout maps, these models admit a simulation by a uniform mathsfTC0 threshold-circuit family of polynomial size (with an explicit constant-depth bound). Situating EGNNs within mathsfTC0 provides a concrete ceiling on the decision and prediction problems solvable by such architectures under realistic resource constraints and clarifies which architectural modifications (e.g., increased depth, richer geometric primitives, or wider layers) are required to transcend this regime. The analysis complements Weisfeiler-Lehman style results that do not directly transfer to periodic crystals, and offers a complexity-theoretic foundation for symmetry-aware graph learning on crystalline systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 101 of its 119 references that are in the map. First posted on arXiv 7 Oct 2025.

Builds on

101 of 119 references.

References · 101

  1. 2022Flow Matching for Generative Modelingcited by 5,702
  2. 2018How Powerful are Graph Neural Networks?cited by 4,393
  3. 2018Neural Ordinary Differential Equationscited by 3,779
  4. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  5. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
  6. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  7. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  8. 2021E(n) Equivariant Graph Neural Networkscited by 965
  9. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
  10. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  11. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
  12. 2019Provably Powerful Graph Networkscited by 389
38 more
  1. 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 343
  2. 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 313
  3. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
  4. 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 294
  5. 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 270
  6. 2022Transformers Learn Shortcuts to Automatacited by 268
  7. 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
  8. 2024Chain of Thought Empowers Transformers to Solve Inherently Serial Problemscited by 260
  9. 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 255
  10. 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
  11. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 240
  12. 2023Looped Transformers as Programmable Computerscited by 237
  13. 2021Frame Averaging for Invariant and Equivariant Network Designcited by 168
  14. 2023Flow Matching in Latent Spacecited by 160
  15. 2023Crystal Structure Prediction by Joint Equivariant Diffusioncited by 148
  16. 2021Saturated Transformers are Constant-Depth Threshold Circuitscited by 139
  17. 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 121
  18. 2024AlphaFold Meets Flow Matching for Generating Protein Ensemblescited by 110
  19. 2024FlowMM: Generating Materials with Riemannian Flow Matchingcited by 109
  20. 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 104
  21. 2023Fast Attention Requires Bounded Entriescited by 102
  22. 2023MatterGen: a generative model for inorganic materials designcited by 98
  23. 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalystscited by 95
  24. 2024Fine-Tuned Language Models Generate Stable Inorganic Materials as Textcited by 93
  25. 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 73
  26. 2024Space Group Constrained Crystal Generationcited by 73
  27. 2021Moser Flow: Divergence-based Generative Modeling on Manifoldscited by 67
  28. 2022A Logic for Expressing Log-Precision Transformerscited by 67
  29. 2021Reconstruction for Powerful Graph Representationscited by 65
  30. 2023Language models can generate molecules, materials, and protein binding sites directly in three dimensions as XYZ, CIF, and PDB filescited by 59
  31. 2022Ordered Subgraph Aggregation Networkscited by 57
  32. 2022Matching Normalizing Flows and Probability Paths on Manifoldscited by 57
  33. 2022Efficient Video Prediction via Sparsely Conditioned Flow Matchingcited by 55
  34. 2023Scalable Diffusion for Materials Generationcited by 54
  35. 2023Geometric Algebra Transformercited by 48
  36. 2023Iterative α-(de)Blending: a Minimalist Deterministic Diffusion Modelcited by 46
  37. 2024Why Larger Language Models Do In-context Learning Differently?cited by 45
  38. 2023How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computationcited by 44

50 most cited of 101 All 101 (JSON)

Built on by

Not cited yet.