Kohn-Sham equations as regularizer: building prior knowledge into machine-learned physics
Not on the map. Why?
Abstract (arXiv)
Including prior knowledge is important for effective machine learning models in physics, and is usually achieved by explicitly adding loss terms or constraints on model architectures. Prior knowledge embedded in the physics computation itself rarely draws attention. We show that solving the Kohn-Sham equations when training neural networks for the exchange-correlation functional provides an implicit regularization that greatly improves generalization. Two separations suffice for learning the entire one-dimensional H2 dissociation curve within chemical accuracy, including the strongly correlated region. Our models also generalize to unseen types of molecules and overcome self-interaction error.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 8; 2023: 6; 2024: 7; 2025: 1; 2026: 3.
36 papers.
Sort:
- 2021Machine learning accelerated computational fluid dynamicscited by 461
- 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modelingcited by 59
- 2022SchNetPack 2.0: A neural network toolbox for atomistic machine learningcited by 29
- 2021Informing Geometric Deep Learning with Electronic Interactions to Accelerate Quantum Chemistrycited by 27
- 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
- 2021Learning the exchange-correlation functional from nature with fully differentiable density functional theorycited by 23
- 2022Evolving symbolic density functionalscited by 19
- 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Futurecited by 18
- 2021Differentiable Physics: A Position Piececited by 12
- 2023Overcoming the Barrier of Orbital-Free Density Functional Theory for Molecular Systems Using Deep Learningcited by 11
- 2021Physics perception in sloshing scenes with guaranteed thermodynamic consistencycited by 10
- 2021Audacity of huge: overcoming challenges of data scarcity and data quality for machine learning in computational materials discoverycited by 10
24 more
- 2022Constants of motion networkcited by 10
- 2022A composable machine-learning approach for steady-state simulations on high-resolution gridscited by 8
- 2024Image Super-resolution Inspired Electron Density Predictioncited by 8
- 2025Accurate and scalable exchange-correlation with deep learningcited by 8
- 2021DQC: a Python program package for Differentiable Quantum Chemistrycited by 7
- 2023D4FT: A Deep Learning Approach to Kohn-Sham Density Functional Theorycited by 6
- 2024Learning Equivariant Non-Local Electron Density Functionalscited by 6
- 2024Reducing the Cost of Quantum Chemical Data By Backpropagating Through Density Functional Theorycited by 4
- 2021A composable autoencoder-based iterative algorithm for accelerating numerical simulationscited by 3
- 2021How Well Does Kohn-Sham Regularizer Work for Weakly Correlated Systems?cited by 3
- 2022A Transferable Recommender Approach for Selecting the Best Density Functional Approximations in Chemical Discoverycited by 3
- 2023Variational principle to regularize machine-learned density functionals: the non-interacting kinetic-energy functionalcited by 2
- 2026Derivative Informed Learning of Exchange-Correlation Functionalscited by 2
- 2023Grad DFT: a software library for machine learning enhanced density functional theorycited by 1
- 2024Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencodercited by 1
- 2024NeuralSCF: Neural network self-consistent fields for density functional theorycited by 1
- 2024Data-driven Modeling in Metrology -- A Short Introduction, Current Developments and Future Perspectivescited by 1
- 2022Self-consistent Gradient-like Eigen Decomposition in Solving Schr"odinger Equationscited by 0
- 2022AD-NEGF: An End-to-End Differentiable Quantum Transport Simulator for Sensitivity Analysis and Inverse Problemscited by 0
- 2023Generating QM1B with PySCFIPUcited by 0
- 2023Deep Learning with Physics Priors as Generalized Regularizerscited by 0
- 2024Machine learning approach for vibronically renormalized electronic band structurescited by 0
- 2026A fully differentiable framework for training proxy Exchange Correlation Functionals for periodic systemscited by 0
- 2026Benchmarking Optimizers to Solve Inverse Problems with Differentiable Physics Simulatorscited by 0
- 2026Benchmarking Optimizers to Solve Inverse Problems with Differentiable Physics Simulators12 Sep 2026
- 2026Derivative Informed Learning of Exchange-Correlation Functionals2 Jun 2026
- 2026A fully differentiable framework for training proxy Exchange Correlation Functionals for periodic systems17 Feb 2026
- 2025Accurate and scalable exchange-correlation with deep learning17 Jun 2025
- 2024Learning Equivariant Non-Local Electron Density Functionals10 Oct 2024
- 2024Machine learning approach for vibronically renormalized electronic band structures3 Sep 2024
- 2024Data-driven Modeling in Metrology -- A Short Introduction, Current Developments and Future Perspectives24 Jun 2024
- 2024NeuralSCF: Neural network self-consistent fields for density functional theory22 Jun 2024
- 2024Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencoder18 Apr 2024
- 2024Image Super-resolution Inspired Electron Density Prediction19 Feb 2024
- 2024Reducing the Cost of Quantum Chemical Data By Backpropagating Through Density Functional Theory6 Feb 2024
- 2023Deep Learning with Physics Priors as Generalized Regularizers14 Dec 2023
24 more
- 2023Generating QM1B with PySCFIPU2 Nov 2023
- 2023Overcoming the Barrier of Orbital-Free Density Functional Theory for Molecular Systems Using Deep Learning28 Sep 2023
- 2023Grad DFT: a software library for machine learning enhanced density functional theory23 Sep 2023
- 2023Variational principle to regularize machine-learned density functionals: the non-interacting kinetic-energy functional30 Jun 2023
- 2023D4FT: A Deep Learning Approach to Kohn-Sham Density Functional Theory1 Mar 2023
- 2022SchNetPack 2.0: A neural network toolbox for atomistic machine learning11 Dec 2022
- 2022Partial Differential Equations Meet Deep Neural Networks: A Survey27 Oct 2022
- 2022A composable machine-learning approach for steady-state simulations on high-resolution grids11 Oct 2022
- 2022Constants of motion network22 Aug 2022
- 2022A Transferable Recommender Approach for Selecting the Best Density Functional Approximations in Chemical Discovery21 Jul 2022
- 2022Evolving symbolic density functionals3 Mar 2022
- 2022AD-NEGF: An End-to-End Differentiable Quantum Transport Simulator for Sensitivity Analysis and Inverse Problems10 Feb 2022
- 2022Self-consistent Gradient-like Eigen Decomposition in Solving Schr"odinger Equations3 Feb 2022
- 2021Audacity of huge: overcoming challenges of data scarcity and data quality for machine learning in computational materials discovery2 Nov 2021
- 2021How Well Does Kohn-Sham Regularizer Work for Weakly Correlated Systems?28 Oct 2021
- 2021DQC: a Python program package for Differentiable Quantum Chemistry22 Oct 2021
- 2021A composable autoencoder-based iterative algorithm for accelerating numerical simulations7 Oct 2021
- 2021Differentiable Physics: A Position Piece14 Sep 2021
- 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Future10 Aug 2021
- 2021Physics perception in sloshing scenes with guaranteed thermodynamic consistency24 Jun 2021
- 2021Informing Geometric Deep Learning with Electronic Interactions to Accelerate Quantum Chemistry31 May 2021
- 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling25 Feb 2021
- 2021Learning the exchange-correlation functional from nature with fully differentiable density functional theory8 Feb 2021
- 2021Machine learning accelerated computational fluid dynamics28 Jan 2021
- 2021Machine learning accelerated computational fluid dynamicscited by 461
- 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modelingcited by 59
- 2022SchNetPack 2.0: A neural network toolbox for atomistic machine learningcited by 29
- 2021Informing Geometric Deep Learning with Electronic Interactions to Accelerate Quantum Chemistrycited by 27
- 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
- 2021Learning the exchange-correlation functional from nature with fully differentiable density functional theorycited by 23
- 2022Evolving symbolic density functionalscited by 19
- 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Futurecited by 18
- 2021Differentiable Physics: A Position Piececited by 12
- 2023Overcoming the Barrier of Orbital-Free Density Functional Theory for Molecular Systems Using Deep Learningcited by 11
- 2021Physics perception in sloshing scenes with guaranteed thermodynamic consistencycited by 10
- 2021Audacity of huge: overcoming challenges of data scarcity and data quality for machine learning in computational materials discoverycited by 10
12 most cited of 36 All 36 (JSON)
- 2026Benchmarking Optimizers to Solve Inverse Problems with Differentiable Physics Simulators12 Sep 2026
- 2026Derivative Informed Learning of Exchange-Correlation Functionals2 Jun 2026
- 2026A fully differentiable framework for training proxy Exchange Correlation Functionals for periodic systems17 Feb 2026
- 2025Accurate and scalable exchange-correlation with deep learning17 Jun 2025
- 2024Learning Equivariant Non-Local Electron Density Functionals10 Oct 2024
- 2024Machine learning approach for vibronically renormalized electronic band structures3 Sep 2024
- 2024Data-driven Modeling in Metrology -- A Short Introduction, Current Developments and Future Perspectives24 Jun 2024
- 2024NeuralSCF: Neural network self-consistent fields for density functional theory22 Jun 2024
- 2024Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencoder18 Apr 2024
- 2024Image Super-resolution Inspired Electron Density Prediction19 Feb 2024
- 2024Reducing the Cost of Quantum Chemical Data By Backpropagating Through Density Functional Theory6 Feb 2024
- 2023Deep Learning with Physics Priors as Generalized Regularizers14 Dec 2023
12 newest of 36 All 36 (JSON)