mlsanityData to 14 Oct 2026

SE(3)-equivariant prediction of molecular wavefunctions and electronic densities

arXiv 2106.02347 ↗First posted 4 Jun 2021physics.chem-ph stat.MLcited by 67

Not on the map. Why?

Abstract (arXiv)

Machine learning has enabled the prediction of quantum chemical properties with high accuracy and efficiency, allowing to bypass computationally costly ab initio calculations. Instead of training on a fixed set of properties, more recent approaches attempt to learn the electronic wavefunction (or density) as a central quantity of atomistic systems, from which all other observables can be derived. This is complicated by the fact that wavefunctions transform non-trivially under molecular rotations, which makes them a challenging prediction target. To solve this issue, we introduce general SE(3)-equivariant operations and building blocks for constructing deep learning architectures for geometric point cloud data and apply them to reconstruct wavefunctions of atomistic systems with unprecedented accuracy. Our model achieves speedups of over three orders of magnitude compared to ab initio methods and reduces prediction errors by up to two orders of magnitude compared to the previous state-of-the-art. This accuracy makes it possible to derive properties such as energies and forces directly from the wavefunction in an end-to-end manner. We demonstrate the potential of our approach in a transfer learning application, where a model trained on low accuracy reference wavefunctions implicitly learns to correct for electronic many-body interactions from observables computed at a higher level of theory. Such machine-learned wavefunction surrogates pave the way towards novel semi-empirical methods, offering resolution at an electronic level while drastically decreasing computational cost. Additionally, the predicted wavefunctions can serve as initial guess in conventional ab initio methods, decreasing the number of iterations required to arrive at a converged solution, thus leading to significant speedups without any loss of accuracy or robustness.

Key facts. Cited by 67 papers in the map (data through 14 Oct 2026). Builds on 34 of its 74 references that are in the map. First posted on arXiv 4 Jun 2021.

Builds on

34 of 74 references.

References · 34

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  3. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  4. 2016Identity Mappings in Deep Residual Networkscited by 1,965
  5. 2016Group Equivariant Convolutional Networkscited by 1,165
  6. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  7. 2019On the Convergence of Adam and Beyondcited by 841
  8. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
  9. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 708
  10. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
  11. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
  12. 2018Spherical CNNscited by 456
22 more
  1. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
  2. 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 354
  3. 2016Steerable CNNscited by 305
  4. 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 295
  5. 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 267
  6. 2019Cormorant: Covariant Molecular Neural Networkscited by 263
  7. 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
  8. 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 228
  9. 2020Machine Learning Force Fieldscited by 207
  10. 2019Universal Invariant and Equivariant Graph Neural Networkscited by 183
  11. 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 171
  12. 2019Deep neural network solution of the electronic Schr"odinger equationcited by 127
  13. 2021SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effectscited by 104
  14. 2016Rotation equivariant vector field networkscited by 99
  15. 2019Unifying machine learning and quantum chemistry -- a deep neural network for molecular wavefunctionscited by 73
  16. 2016By-passing the Kohn-Sham equations with machine learningcited by 67
  17. 2020OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Featurescited by 64
  18. 2018Covariant Compositional Networks For Learning Graphscited by 54
  19. 2015On Invariance and Selectivity in Representation Learningcited by 18
  20. 2020Machine learning of solvent effects on molecular spectra and reactionscited by 14
  21. 2018Solid Harmonic Wavelet Scattering for Predictions of Molecule Propertiescited by 12
  22. 2020A deep neural network for molecular wave functions in quasi-atomic minimal basis representationcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 2; 2022: 11; 2023: 11; 2024: 19; 2025: 13; 2026: 11.

67 papers.

Sort:

  1. 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
  2. 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
  3. 2022Graph neural networks for materials science and chemistrycited by 182
  4. 2021Geometric Deep Learning on Molecular Representationscited by 113
  5. 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
  6. 2022Structure-based drug design with geometric deep learningcited by 40
  7. 2022So3krates: Equivariant attention for interactions on arbitrary length-scales in molecular systemscited by 39
  8. 2023Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltoniancited by 39
  9. 2023Geometric Clifford Algebra Networkscited by 38
  10. 2024Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Productscited by 36
  11. 2022SchNetPack 2.0: A neural network toolbox for atomistic machine learningcited by 29
  12. 2023QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Moleculescited by 26
38 more
  1. 2022Generative Coarse-Graining of Molecular Conformationscited by 21
  2. 2024Equivariance via Minimal Frame Averaging for More Symmetries and Efficiencycited by 19
  3. 2024Generalizing Denoising to Non-Equilibrium Structures Improves Equivariant Force Fieldscited by 18
  4. 2025Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systemscited by 14
  5. 2023Higher-Order Equivariant Neural Networks for Charge Density Prediction in Materialscited by 13
  6. 2024Self-Consistency Training for Density-Functional-Theory Hamiltonian Predictioncited by 12
  7. 2024Euclidean Fast Attention -- Machine Learning Global Atomic Representations at Linear Costcited by 12
  8. 2025HIP: Hessian Interatomic Potentials without derivativescited by 12
  9. 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsitycited by 11
  10. 2025High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Predictioncited by 11
  11. 2026EquiformerV3: Scaling Efficient, Expressive, and General SE(3)-Equivariant Graph Attention Transformerscited by 11
  12. 2022Knowledge-augmented Deep Learning and Its Applications: A Surveycited by 10
  13. 2025How simple can you go? An off-the-shelf transformer approach to molecular dynamicscited by 10
  14. 2025ELECTRA: A Cartesian Network for 3D Charge Density Prediction with Floating Orbitalscited by 10
  15. 2022Accurate Machine Learned Quantum-Mechanical Force Fields for Biomolecular Simulationscited by 9
  16. 2023Variational Monte Carlo on a Budget -- Fine-tuning pre-trained Neural Wavefunctionscited by 9
  17. 2022Transferable E(3) equivariant parameterization for Hamiltonian of molecules and solidscited by 8
  18. 2023Learning Harmonic Molecular Representations on Riemannian Manifoldcited by 8
  19. 2024Image Super-resolution Inspired Electron Density Predictioncited by 8
  20. 2024Learning local equivariant representations for quantum operatorscited by 8
  21. 2022Algorithmic Differentiation for Automated Modeling of Machine Learned Force Fieldscited by 7
  22. 2023Towards a Foundation Model for Neural Network Wavefunctionscited by 7
  23. 2025Learning from the electronic structure of molecules across the periodic tablecited by 7
  24. 2024Infusing Self-Consistency into Density Functional Theory Hamiltonian Prediction via Deep Equilibrium Modelscited by 6
  25. 2024Equivariant Graph Network Approximations of High-Degree Polynomials for Force Field Predictioncited by 6
  26. 2025Learning with Exact Invariances in Polynomial Timecited by 6
  27. 2025Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local Framescited by 6
  28. 2024Reducing the Cost of Quantum Chemical Data By Backpropagating Through Density Functional Theorycited by 4
  29. 2024Equivariant Neural Tangent Kernelscited by 4
  30. 2023Equivariant Matrix Function Neural Networkscited by 3
  31. 2024Universal Machine Learning Kohn-Sham Hamiltonian for Materialscited by 3
  32. 2025Towards A Transferable Acceleration Method for Density Functional Theorycited by 3
  33. 2026E2Former-V2: On-the-Fly Equivariant Attention with Linear Activation Memorycited by 3
  34. 2023Electronic excited states from physically-constrained machine learningcited by 2
  35. 2024Towards Harmonization of SO(3)-Equivariance and Expressiveness: a Hybrid Deep Learning Framework for Electronic-Structure Hamiltonian Predictioncited by 2
  36. 2024nabla2DFT: A Universal Quantum Chemistry Dataset of Drug-Like Molecules and a Benchmark for Neural Network Potentialscited by 2
  37. 2025Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of Materialscited by 2
  38. 2023Equivariant Neural Networks for Spin Dynamics Simulations of Itinerant Magnetscited by 1

50 most cited of 67 All 67 (JSON)