# Towards A Transferable Acceleration Method for Density Functional Theory

arXiv: https://arxiv.org/abs/2509.25724 · HTML: https://mlsanity.com/paper/2509.25724/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 21 of its 55 references that are in the map.
- First posted on arXiv 30 Sep 2025.

## Builds on (most cited first, 21 of 21)

- [E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials](https://mlsanity.com/paper/2101.03164/) (2021)
- [On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups](https://mlsanity.com/paper/1802.03690/) (2018)
- [e3nn: Euclidean Neural Networks](https://mlsanity.com/paper/2207.09453/) (2022)
- [Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNs](https://mlsanity.com/paper/2302.03655/) (2023)
- [Unifying machine learning and quantum chemistry -- a deep neural network for molecular wavefunctions](https://mlsanity.com/paper/1906.10033/) (2019)
- [By-passing the Kohn-Sham equations with machine learning](https://mlsanity.com/paper/1609.02815/) (2016)
- [SE(3)-equivariant prediction of molecular wavefunctions and electronic densities](https://mlsanity.com/paper/2106.02347/) (2021)
- [Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltonian](https://mlsanity.com/paper/2306.04922/) (2023)
- [QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Molecules](https://mlsanity.com/paper/2306.09549/) (2023)
- [Equivariant graph neural networks for fast electron density estimation of molecules, liquids, and solids](https://mlsanity.com/paper/2112.00652/) (2021)
- [An Efficient Sparse Kernel Generator for O(3)-Equivariant Deep Networks](https://mlsanity.com/paper/2501.13986/) (2025)
- [Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systems](https://mlsanity.com/paper/2502.19227/) (2025)
- [Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction](https://mlsanity.com/paper/2403.09560/) (2024)
- [Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsity](https://mlsanity.com/paper/2502.01171/) (2025)
- [High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Prediction](https://mlsanity.com/paper/2505.18817/) (2025)
- [ELECTRA: A Cartesian Network for 3D Charge Density Prediction with Floating Orbitals](https://mlsanity.com/paper/2503.08305/) (2025)
- [A Recipe for Charge Density Prediction](https://mlsanity.com/paper/2405.19276/) (2024)
- [Image Super-resolution Inspired Electron Density Prediction](https://mlsanity.com/paper/2402.12335/) (2024)
- [Accelerating Finite-temperature Kohn-Sham Density Functional Theory with Deep Neural Networks](https://mlsanity.com/paper/2010.04905/) (2020)
- [Data-Driven Parametrization of Molecular Mechanics Force Fields for Expansive Chemical Space Coverage](https://mlsanity.com/paper/2408.12817/) (2024)
- [Machine learning for accuracy in density functional approximations](https://mlsanity.com/paper/2311.00196/) (2023)

## Built on by (most cited first, 3 of 3)

- [Coupled Cluster con M=oLe: Molecular Orbital Learning for Neural Wavefunctions](https://mlsanity.com/paper/2602.20232/) (2026)
- [Equivariant Flow Matching for Electron Density Prediction](https://mlsanity.com/paper/2610.02651/) (2026)
- [Physics-Aligned Electronic Ground-State Learning Improves Generalization](https://mlsanity.com/paper/2610.10298/) (2026)

## Abstract (arXiv)

Recently, sophisticated deep learning-based approaches have been developed for generating efficient initial guesses to accelerate the convergence of density functional theory (DFT) calculations. While the actual initial guesses are often density matrices (DM), quantities that can convert into density matrices also qualify as alternative forms of initial guesses. Hence, existing works mostly rely on the prediction of the Hamiltonian matrix for obtaining high-quality initial guesses. However, the Hamiltonian matrix is both numerically difficult to predict and intrinsically non-transferable, hindering the application of such models in real scenarios. In light of this, we propose a method that constructs DFT initial guesses by predicting the electron density in a compact auxiliary basis representation using E(3)-equivariant neural networks. Trained exclusively on small molecules with up to 20 atoms, our model achieves an average 33.3% reduction in SCF iterations for molecules three times larger (up to 60 atoms). This result is particularly significant given that baseline Hamiltonian-based methods fail to generalize, often increasing the iteration count by over 80% or failing to converge entirely on these larger systems. Furthermore, we demonstrate that this acceleration is robustly scalable: the model successfully accelerates calculations for systems with up to 900 atoms (polymers and polypeptides) without retraining. To the best of our knowledge, this work represents the first and robust candidate for a universally transferable DFT acceleration method. We also released the SCFbench dataset and its accompanying code to facilitate future research in this promising direction.