mlsanityData to 7 Oct 2026

Reciprocal Space Attention for Learning Long-Range Interactions

arXiv 2510.13055 ↗First posted 15 Oct 2025cond-mat.mtrl-sci cs.LG physics.chem-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine learning interatomic potentials (MLIPs) have revolutionized the modeling of materials and molecules by directly fitting to ab initio data. However, while these models excel at capturing local and semi-local interactions, they often prove insufficient when an explicit and efficient treatment of long-range interactions is required. To address this limitation, we introduce Reciprocal-Space Attention (RSA), a framework designed to capture long-range interactions in the Fourier domain. RSA can be integrated with any existing local or semi-local MLIP framework. The central contribution of this work is the mapping of a linear-scaling attention mechanism into Fourier space, enabling the explicit modeling of long-range interactions such as electrostatics and dispersion without relying on predefined charges or other empirical assumptions. We demonstrate the effectiveness of our method as a long-range correction to the MACE backbone across diverse benchmarks, including dimer binding curves, dispersion-dominated layered phosphorene exfoliation, and the molecular dipole density of bulk water. Our results show that RSA consistently captures long-range physics across a broad range of chemical and materials systems. The code and datasets for this work is available at https://github.com/rfhari/reciprocal_space_attention

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 62 references that are in the map. First posted on arXiv 15 Oct 2025.

Builds on

19 of 62 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  3. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  4. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  5. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  6. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  7. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
  8. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
  9. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 245
  10. 2021SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effectscited by 103
  11. 2022The Design Space of E(3)-Equivariant Atom-Centered Interatomic Potentialscited by 100
  12. 2025UMA: A Family of Universal Models for Atomscited by 99
7 more
  1. 2023Ewald-based Long-Range Message Passing for Molecular Graphscited by 46
  2. 2024Latent Ewald summation for machine learning of long-range interactionscited by 26
  3. 2025PET-MAD, a lightweight universal interatomic potential for advanced materials modelingcited by 23
  4. 202086 PFLOPS Deep Potential Molecular Dynamics simulation of 100 million atoms with ab initio accuracycited by 15
  5. 2024Euclidean Fast Attention -- Machine Learning Global Atomic Representations at Linear Costcited by 12
  6. 2024Neural P3M: A Long-Range Interaction Modeling Enhancer for Geometric GNNscited by 9
  7. 2025Universal Machine Learning Interatomic Potentials are Ready for Solid Ion Conductorscited by 1

Built on by

Not cited yet.