Infusing Self-Consistency into Density Functional Theory Hamiltonian Prediction via Deep Equilibrium Models
Not on the map. Why?
Abstract (arXiv)
In this study, we introduce a unified neural network architecture, the Deep Equilibrium Density Functional Theory Hamiltonian (DEQH) model, which incorporates Deep Equilibrium Models (DEQs) for predicting Density Functional Theory (DFT) Hamiltonians. The DEQH model inherently captures the self-consistency nature of Hamiltonian, a critical aspect often overlooked by traditional machine learning approaches for Hamiltonian prediction. By employing DEQ within our model architecture, we circumvent the need for DFT calculations during the training phase to introduce the Hamiltonian's self-consistency, thus addressing computational bottlenecks associated with large or complex systems. We propose a versatile framework that combines DEQ with off-the-shelf machine learning models for predicting Hamiltonians. When benchmarked on the MD17 and QH9 datasets, DEQHNet, an instantiation of the DEQH framework, has demonstrated a significant improvement in prediction accuracy. Beyond a predictor, the DEQH model is a Hamiltonian solver, in the sense that it uses the fixed-point solving capability of the deep equilibrium model to iteratively solve for the Hamiltonian. Ablation studies of DEQHNet further elucidate the network's effectiveness, offering insights into the potential of DEQ-integrated networks for Hamiltonian learning. We open source our implementation at https://github.com/Zun-Wang/DEQHNet.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 28 of its 54 references that are in the map. First posted on arXiv 6 Jun 2024.
Builds on
28 of 54 references.
References · 28
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2019Deep Equilibrium Modelscited by 603
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
- 2020Directional Message Passing for Molecular Graphscited by 556
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
- 2019Cormorant: Covariant Molecular Neural Networkscited by 262
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
16 more
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
- 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 254
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
- 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 179
- 2022e3nn: Euclidean Neural Networkscited by 171
- 2020Multiscale Deep Equilibrium Modelscited by 149
- 2019Unifying machine learning and quantum chemistry -- a deep neural network for molecular wavefunctionscited by 73
- 2022ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphscited by 69
- 2021SE(3)-equivariant prediction of molecular wavefunctions and electronic densitiescited by 67
- 2023Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltoniancited by 38
- 2021Informing Geometric Deep Learning with Electronic Interactions to Accelerate Quantum Chemistrycited by 27
- 2023QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Moleculescited by 26
- 2023TorchDEQ: A Library for Deep Equilibrium Modelscited by 21
- 2024Self-Consistency Training for Density-Functional-Theory Hamiltonian Predictioncited by 12
- 2024Reducing the Cost of Quantum Chemical Data By Backpropagating Through Density Functional Theorycited by 4
- 2024Self-consistent Validation for Machine Learning Electronic Structurecited by 2
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsitycited by 10
- 2025High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Predictioncited by 10
- 2026Lipschitz Multiscale Deep Equilibrium Models: A Theoretically Guaranteed and Accelerated Approachcited by 1
- 2026Implicit Machine Learning Force Fields Accelerate Molecular Dynamics Simulationscited by 1
- 2025On The Finetuning of MLIPs Through the Lens of Iterated Maps With BPTTcited by 0
- 2026A Fixed-Point Neural Operator for Size- and Functional-Transferable Hamiltonian Predictioncited by 0
- 2026Implicit Machine Learning Force Fields Accelerate Molecular Dynamics Simulations31 Jul 2026
- 2026A Fixed-Point Neural Operator for Size- and Functional-Transferable Hamiltonian Prediction12 Jun 2026
- 2026Lipschitz Multiscale Deep Equilibrium Models: A Theoretically Guaranteed and Accelerated Approach3 Feb 2026
- 2025On The Finetuning of MLIPs Through the Lens of Iterated Maps With BPTT30 Nov 2025
- 2025High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Prediction24 May 2025
- 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsity3 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2023Investigating the Behavior of Diffusion Models for Accelerating Electronic Structure Calculations
- 2026TritonDFT: Automating DFT with a Multi-Agent Framework
- 2026Physics-Aligned Electronic Ground-State Learning Improves Generalization
- 2026Agentic Discovery of Exchange-Correlation Density Functionals
- 2026Equivariant Flow Matching for Electron Density Prediction
- 2024Chemistry-Inspired Diffusion with Non-Differentiable Guidance
- 2024Molecular relaxation by reverse diffusion with time step prediction
- 2026Equivariant Evidential Deep Learning for Interatomic Potentials