Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systems
Not on the map. Why?
Abstract (arXiv)
Density Functional Theory (DFT) is a pivotal method within quantum chemistry and materials science, with its core involving the construction and solution of the Kohn-Sham Hamiltonian. Despite its importance, the application of DFT is frequently limited by the substantial computational resources required to construct the Kohn-Sham Hamiltonian. In response to these limitations, current research has employed deep-learning models to efficiently predict molecular and solid Hamiltonians, with roto-translational symmetries encoded in their neural networks. However, the scalability of prior models may be problematic when applied to large molecules, resulting in non-physical predictions of ground-state properties. In this study, we generate a substantially larger training set (PubChemQH) than used previously and use it to create a scalable model for DFT calculations with physical accuracy. For our model, we introduce a loss function derived from physical principles, which we call Wavefunction Alignment Loss (WALoss). WALoss involves performing a basis change on the predicted Hamiltonian to align it with the observed one; thus, the resulting differences can serve as a surrogate for orbital energy differences, allowing models to make better predictions for molecular orbitals and total energies than previously possible. WALoss also substantially accelerates self-consistent-field (SCF) DFT calculations. Here, we show it achieves a reduction in total energy prediction error by a factor of 1347 and an SCF calculation speed-up by a factor of 18%. These substantial improvements set new benchmarks for achieving accurate and applicable predictions in larger molecular systems.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 44 of its 96 references that are in the map. First posted on arXiv 26 Feb 2025.
Builds on
44 of 96 references.
References · 44
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2024Mixtral of Expertscited by 1,785
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2021Scaling Vision with Sparse Mixture of Expertscited by 740
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2020Directional Message Passing for Molecular Graphscited by 556
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
- 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 391
32 more
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
- 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 308
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 296
- 2019Cormorant: Covariant Molecular Neural Networkscited by 262
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 254
- 2022Unified Scaling Laws for Routed Language Modelscited by 249
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
- 2021Spherical Message Passing for 3D Graph Networkscited by 166
- 2019Deep neural network solution of the electronic Schr"odinger equationcited by 124
- 2023Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNscited by 113
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 75
- 2019Unifying machine learning and quantum chemistry -- a deep neural network for molecular wavefunctionscited by 73
- 2022ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphscited by 69
- 2021SE(3)-equivariant prediction of molecular wavefunctions and electronic densitiescited by 67
- 2023A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systemscited by 65
- 2023TensorNet: Cartesian Tensor Representations for Efficient Learning of Molecular Potentialscited by 53
- 2019Eigenvalue and Generalized Eigenvalue Problems: Tutorialcited by 45
- 2022So3krates: Equivariant attention for interactions on arbitrary length-scales in molecular systemscited by 39
- 2023Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltoniancited by 38
- 2023QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Moleculescited by 26
- 2023Evaluation of the MACE Force Field Architecture: from Medicinal Chemistry to Materials Sciencecited by 25
- 2023Highly Accurate Quantum Chemical Property Prediction with Uni-Mol+cited by 22
- 2024Uni-Mol2: Exploring Molecular Pretraining Model at Scalecited by 20
- 2018MT-CGCNN: Integrating Crystal Graph Convolutional Neural Network with Multitask Learning for Material Property Predictioncited by 17
- 2021Learning ground states of quantum Hamiltonians with graph networkscited by 12
- 2023PubChemQC B3LYP/6-31G*//PM6 dataset: the Electronic Structures of 86 Million Molecules using B3LYP/6-31G* calculationscited by 12
- 2025E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Productscited by 12
- 2020A deep neural network for molecular wave functions in quasi-atomic minimal basis representationcited by 10
- 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsitycited by 10
- 2022Transferable E(3) equivariant parameterization for Hamiltonian of molecules and solidscited by 7
- 2023E(3) Equivariant Graph Neural Networks for Particle-Based Fluid Mechanicscited by 7
Built on by
Citing papers per year: 2025: 6; 2026: 7.
13 papers.
Sort:
By area:
- 2025HIP: Hessian Interatomic Potentials without derivativescited by 11
- 2025High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Predictioncited by 10
- 2025Learning from the electronic structure of molecules across the periodic tablecited by 7
- 2025Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local Framescited by 5
- 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fieldscited by 3
- 2026Transferable SCF-Acceleration through Solver-Aligned Initialization Learningcited by 3
- 2025Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of Materialscited by 2
- 2025Towards A Transferable Acceleration Method for Density Functional Theorycited by 2
- 2026M=oLe-Lambda: Learning the Coupled-Cluster Response State for Energies, Gradients, and Propertiescited by 1
- 2026Coupled Cluster con M=oLe: Molecular Orbital Learning for Neural Wavefunctionscited by 0
- 2026A Fixed-Point Neural Operator for Size- and Functional-Transferable Hamiltonian Predictioncited by 0
- 2026MALOQ: Massively Accelerated Learning of Operators for Quantum Transportcited by 0
1 more
- 2026Physics-Aligned Electronic Ground-State Learning Improves Generalization7 Oct 2026
- 2026MALOQ: Massively Accelerated Learning of Operators for Quantum Transport27 Jun 2026
- 2026A Fixed-Point Neural Operator for Size- and Functional-Transferable Hamiltonian Prediction12 Jun 2026
- 2026M=oLe-Lambda: Learning the Coupled-Cluster Response State for Energies, Gradients, and Properties28 May 2026
- 2026Transferable SCF-Acceleration through Solver-Aligned Initialization Learning23 Apr 2026
- 2026Coupled Cluster con M=oLe: Molecular Orbital Learning for Neural Wavefunctions23 Feb 2026
- 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fields29 Jan 2026
- 2025Learning from the electronic structure of molecules across the periodic table30 Sep 2025
- 2025Towards A Transferable Acceleration Method for Density Functional Theory30 Sep 2025
- 2025HIP: Hessian Interatomic Potentials without derivatives25 Sep 2025
- 2025Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of Materials24 Sep 2025
- 2025Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local Frames11 Jun 2025
- 2025HIP: Hessian Interatomic Potentials without derivativescited by 11
- 2025High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Predictioncited by 10
- 2025Learning from the electronic structure of molecules across the periodic tablecited by 7
- 2025Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local Framescited by 5
- 2026Transferable SCF-Acceleration through Solver-Aligned Initialization Learningcited by 3
- 2025Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of Materialscited by 2
- 2025Towards A Transferable Acceleration Method for Density Functional Theorycited by 2
- 2026M=oLe-Lambda: Learning the Coupled-Cluster Response State for Energies, Gradients, and Propertiescited by 1
- 2026Coupled Cluster con M=oLe: Molecular Orbital Learning for Neural Wavefunctionscited by 0
- 2026A Fixed-Point Neural Operator for Size- and Functional-Transferable Hamiltonian Predictioncited by 0
- 2026MALOQ: Massively Accelerated Learning of Operators for Quantum Transportcited by 0
- 2026Physics-Aligned Electronic Ground-State Learning Improves Generalizationcited by 0
- 2026Physics-Aligned Electronic Ground-State Learning Improves Generalization7 Oct 2026
- 2026MALOQ: Massively Accelerated Learning of Operators for Quantum Transport27 Jun 2026
- 2026A Fixed-Point Neural Operator for Size- and Functional-Transferable Hamiltonian Prediction12 Jun 2026
- 2026M=oLe-Lambda: Learning the Coupled-Cluster Response State for Energies, Gradients, and Properties28 May 2026
- 2026Transferable SCF-Acceleration through Solver-Aligned Initialization Learning23 Apr 2026
- 2026Coupled Cluster con M=oLe: Molecular Orbital Learning for Neural Wavefunctions23 Feb 2026
- 2025Learning from the electronic structure of molecules across the periodic table30 Sep 2025
- 2025Towards A Transferable Acceleration Method for Density Functional Theory30 Sep 2025
- 2025HIP: Hessian Interatomic Potentials without derivatives25 Sep 2025
- 2025Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of Materials24 Sep 2025
- 2025Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local Frames11 Jun 2025
- 2025High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Prediction24 May 2025