mlsanityData to 7 Oct 2026

Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systems

arXiv 2502.19227 ↗First posted 26 Feb 2025physics.chem-ph cond-mat.mtrl-sci cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

Density Functional Theory (DFT) is a pivotal method within quantum chemistry and materials science, with its core involving the construction and solution of the Kohn-Sham Hamiltonian. Despite its importance, the application of DFT is frequently limited by the substantial computational resources required to construct the Kohn-Sham Hamiltonian. In response to these limitations, current research has employed deep-learning models to efficiently predict molecular and solid Hamiltonians, with roto-translational symmetries encoded in their neural networks. However, the scalability of prior models may be problematic when applied to large molecules, resulting in non-physical predictions of ground-state properties. In this study, we generate a substantially larger training set (PubChemQH) than used previously and use it to create a scalable model for DFT calculations with physical accuracy. For our model, we introduce a loss function derived from physical principles, which we call Wavefunction Alignment Loss (WALoss). WALoss involves performing a basis change on the predicted Hamiltonian to align it with the observed one; thus, the resulting differences can serve as a surrogate for orbital energy differences, allowing models to make better predictions for molecular orbitals and total energies than previously possible. WALoss also substantially accelerates self-consistent-field (SCF) DFT calculations. Here, we show it achieves a reduction in total energy prediction error by a factor of 1347 and an SCF calculation speed-up by a factor of 18%. These substantial improvements set new benchmarks for achieving accurate and applicable predictions in larger molecular systems.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 44 of its 96 references that are in the map. First posted on arXiv 26 Feb 2025.

Builds on

44 of 96 references.

References · 44

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  2. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  3. 2024Mixtral of Expertscited by 1,785
  4. 2016Group Equivariant Convolutional Networkscited by 1,154
  5. 2021E(n) Equivariant Graph Neural Networkscited by 951
  6. 2021Scaling Vision with Sparse Mixture of Expertscited by 740
  7. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  8. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  9. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  10. 2020Directional Message Passing for Molecular Graphscited by 556
  11. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
  12. 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 391
32 more
  1. 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
  2. 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 308
  3. 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 296
  4. 2019Cormorant: Covariant Molecular Neural Networkscited by 262
  5. 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
  6. 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 254
  7. 2022Unified Scaling Laws for Routed Language Modelscited by 249
  8. 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
  9. 2021Spherical Message Passing for 3D Graph Networkscited by 166
  10. 2019Deep neural network solution of the electronic Schr"odinger equationcited by 124
  11. 2023Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNscited by 113
  12. 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 75
  13. 2019Unifying machine learning and quantum chemistry -- a deep neural network for molecular wavefunctionscited by 73
  14. 2022ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphscited by 69
  15. 2021SE(3)-equivariant prediction of molecular wavefunctions and electronic densitiescited by 67
  16. 2023A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systemscited by 65
  17. 2023TensorNet: Cartesian Tensor Representations for Efficient Learning of Molecular Potentialscited by 53
  18. 2019Eigenvalue and Generalized Eigenvalue Problems: Tutorialcited by 45
  19. 2022So3krates: Equivariant attention for interactions on arbitrary length-scales in molecular systemscited by 39
  20. 2023Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltoniancited by 38
  21. 2023QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Moleculescited by 26
  22. 2023Evaluation of the MACE Force Field Architecture: from Medicinal Chemistry to Materials Sciencecited by 25
  23. 2023Highly Accurate Quantum Chemical Property Prediction with Uni-Mol+cited by 22
  24. 2024Uni-Mol2: Exploring Molecular Pretraining Model at Scalecited by 20
  25. 2018MT-CGCNN: Integrating Crystal Graph Convolutional Neural Network with Multitask Learning for Material Property Predictioncited by 17
  26. 2021Learning ground states of quantum Hamiltonians with graph networkscited by 12
  27. 2023PubChemQC B3LYP/6-31G*//PM6 dataset: the Electronic Structures of 86 Million Molecules using B3LYP/6-31G* calculationscited by 12
  28. 2025E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Productscited by 12
  29. 2020A deep neural network for molecular wave functions in quasi-atomic minimal basis representationcited by 10
  30. 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsitycited by 10
  31. 2022Transferable E(3) equivariant parameterization for Hamiltonian of molecules and solidscited by 7
  32. 2023E(3) Equivariant Graph Neural Networks for Particle-Based Fluid Mechanicscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 7.

13 papers.

Sort:

By area: